3D multi-view convolutional neural networks for lung nodule classification

PubMed Central

Kang, Guixia; Hou, Beibei; Zhang, Ningbo

2017-01-01

The 3D convolutional neural network (CNN) is able to make full use of the spatial 3D context information of lung nodules, and the multi-view strategy has been shown to be useful for improving the performance of 2D CNN in classifying lung nodules. In this paper, we explore the classification of lung nodules using the 3D multi-view convolutional neural networks (MV-CNN) with both chain architecture and directed acyclic graph architecture, including 3D Inception and 3D Inception-ResNet. All networks employ the multi-view-one-network strategy. We conduct a binary classification (benign and malignant) and a ternary classification (benign, primary malignant and metastatic malignant) on Computed Tomography (CT) images from Lung Image Database Consortium and Image Database Resource Initiative database (LIDC-IDRI). All results are obtained via 10-fold cross validation. As regards the MV-CNN with chain architecture, results show that the performance of 3D MV-CNN surpasses that of 2D MV-CNN by a significant margin. Finally, a 3D Inception network achieved an error rate of 4.59% for the binary classification and 7.70% for the ternary classification, both of which represent superior results for the corresponding task. We compare the multi-view-one-network strategy with the one-view-one-network strategy. The results reveal that the multi-view-one-network strategy can achieve a lower error rate than the one-view-one-network strategy. PMID:29145492

Neural Predictors of Visuomotor Adaptation Rate and Multi-Day Savings

NASA Technical Reports Server (NTRS)

Cassady, Kaitlin; Ruitenberg, Marit; Koppelmans, Vincent; Reuter-Lorenz, Patricia; De Dios, Yiri; Gadd, Nichole; Wood, Scott; Riascos Castenada, Roy; Kofman, Igor; Bloomberg, Jacob;

Internal models for interpreting neural population activity during sensorimotor control

PubMed Central

Golub, Matthew D; Yu, Byron M; Chase, Steven M

2015-01-01

To successfully guide limb movements, the brain takes in sensory information about the limb, internally tracks the state of the limb, and produces appropriate motor commands. It is widely believed that this process uses an internal model, which describes our prior beliefs about how the limb responds to motor commands. Here, we leveraged a brain-machine interface (BMI) paradigm in rhesus monkeys and novel statistical analyses of neural population activity to gain insight into moment-by-moment internal model computations. We discovered that a mismatch between subjects’ internal models and the actual BMI explains roughly 65% of movement errors, as well as long-standing deficiencies in BMI speed control. We then used the internal models to characterize how the neural population activity changes during BMI learning. More broadly, this work provides an approach for interpreting neural population activity in the context of how prior beliefs guide the transformation of sensory input to motor output. DOI: http://dx.doi.org/10.7554/eLife.10015.001 PMID:26646183

Density-based clustering: A 'landscape view' of multi-channel neural data for inference and dynamic complexity analysis.

PubMed

Baglietto, Gabriel; Gigante, Guido; Del Giudice, Paolo

2017-01-01

Two, partially interwoven, hot topics in the analysis and statistical modeling of neural data, are the development of efficient and informative representations of the time series derived from multiple neural recordings, and the extraction of information about the connectivity structure of the underlying neural network from the recorded neural activities. In the present paper we show that state-space clustering can provide an easy and effective option for reducing the dimensionality of multiple neural time series, that it can improve inference of synaptic couplings from neural activities, and that it can also allow the construction of a compact representation of the multi-dimensional dynamics, that easily lends itself to complexity measures. We apply a variant of the 'mean-shift' algorithm to perform state-space clustering, and validate it on an Hopfield network in the glassy phase, in which metastable states are largely uncorrelated from memories embedded in the synaptic matrix. In this context, we show that the neural states identified as clusters' centroids offer a parsimonious parametrization of the synaptic matrix, which allows a significant improvement in inferring the synaptic couplings from the neural activities. Moving to the more realistic case of a multi-modular spiking network, with spike-frequency adaptation inducing history-dependent effects, we propose a procedure inspired by Boltzmann learning, but extending its domain of application, to learn inter-module synaptic couplings so that the spiking network reproduces a prescribed pattern of spatial correlations; we then illustrate, in the spiking network, how clustering is effective in extracting relevant features of the network's state-space landscape. Finally, we show that the knowledge of the cluster structure allows casting the multi-dimensional neural dynamics in the form of a symbolic dynamics of transitions between clusters; as an illustration of the potential of such reduction, we define and

Neural Population Coding of Multiple Stimuli

PubMed Central

Ma, Wei Ji

2015-01-01

In natural scenes, objects generally appear together with other objects. Yet, theoretical studies of neural population coding typically focus on the encoding of single objects in isolation. Experimental studies suggest that neural responses to multiple objects are well described by linear or nonlinear combinations of the responses to constituent objects, a phenomenon we call stimulus mixing. Here, we present a theoretical analysis of the consequences of common forms of stimulus mixing observed in cortical responses. We show that some of these mixing rules can severely compromise the brain's ability to decode the individual objects. This cost is usually greater than the cost incurred by even large reductions in the gain or large increases in neural variability, explaining why the benefits of attention can be understood primarily in terms of a stimulus selection, or demixing, mechanism rather than purely as a gain increase or noise reduction mechanism. The cost of stimulus mixing becomes even higher when the number of encoded objects increases, suggesting a novel mechanism that might contribute to set size effects observed in myriad psychophysical tasks. We further show that a specific form of neural correlation and heterogeneity in stimulus mixing among the neurons can partially alleviate the harmful effects of stimulus mixing. Finally, we derive simple conditions that must be satisfied for unharmful mixing of stimuli. PMID:25740513

SOX2 expression levels distinguish between neural progenitor populations of the developing dorsal telencephalon.

PubMed

Hutton, Scott R; Pevny, Larysa H

2011-04-01

The HMG-Box transcription factor SOX2 is expressed in neural progenitor populations throughout the developing and adult central nervous system and is necessary to maintain their progenitor identity. However, it is unclear whether SOX2 levels are uniformly expressed across all neural progenitor populations. In the developing dorsal telencephalon, two distinct populations of neural progenitors, radial glia and intermediate progenitor cells, are responsible for generating a majority of excitatory neurons found in the adult neocortex. Here we demonstrate, using both cellular and molecular analyses, that SOX2 is differentially expressed between radial glial and intermediate progenitor populations. Moreover, utilizing a SOX2(EGFP) mouse line, we show that this differential expression can be used to prospectively isolate distinct, viable populations of radial glia and intermediate cells for in vitro analysis. Given the limited repertoire of cell-surface markers currently available for neural progenitor cells, this provides an invaluable tool for prospectively identifying and isolating distinct classes of neural progenitor cells from the central nervous system. Copyright © 2011 Elsevier Inc. All rights reserved.

Propagating Neural Source Revealed by Doppler Shift of Population Spiking Frequency

PubMed Central

Zhang, Mingming; Shivacharan, Rajat S.; Chiang, Chia-Chu; Gonzalez-Reyes, Luis E.

2016-01-01

Electrical activity in the brain during normal and abnormal function is associated with propagating waves of various speeds and directions. It is unclear how both fast and slow traveling waves with sometime opposite directions can coexist in the same neural tissue. By recording population spikes simultaneously throughout the unfolded rodent hippocampus with a penetrating microelectrode array, we have shown that fast and slow waves are causally related, so a slowly moving neural source generates fast-propagating waves at ∼0.12 m/s. The source of the fast population spikes is limited in space and moving at ∼0.016 m/s based on both direct and Doppler measurements among 36 different spiking trains among eight different hippocampi. The fact that the source is itself moving can account for the surprising direction reversal of the wave. Therefore, these results indicate that a small neural focus can move and that this phenomenon could explain the apparent wave reflection at tissue edges or multiple foci observed at different locations in neural tissue. SIGNIFICANCE STATEMENT The use of novel techniques with an unfolded hippocampus and penetrating microelectrode array to record and analyze neural activity has revealed the existence of a source of neural signals that propagates throughout the hippocampus. The source itself is electrically silent, but its location can be inferred by building isochrone maps of population spikes that the source generates. The movement of the source can also be tracked by observing the Doppler frequency shift of these spikes. These results have general implications for how neural signals are generated and propagated in the hippocampus; moreover, they have important implications for the understanding of seizure generation and foci localization. PMID:27013678

Single Image Super-Resolution Based on Multi-Scale Competitive Convolutional Neural Network

PubMed Central

Qu, Xiaobo; He, Yifan

2018-01-01

Deep convolutional neural networks (CNNs) are successful in single-image super-resolution. Traditional CNNs are limited to exploit multi-scale contextual information for image reconstruction due to the fixed convolutional kernel in their building modules. To restore various scales of image details, we enhance the multi-scale inference capability of CNNs by introducing competition among multi-scale convolutional filters, and build up a shallow network under limited computational resources. The proposed network has the following two advantages: (1) the multi-scale convolutional kernel provides the multi-context for image super-resolution, and (2) the maximum competitive strategy adaptively chooses the optimal scale of information for image reconstruction. Our experimental results on image super-resolution show that the performance of the proposed network outperforms the state-of-the-art methods. PMID:29509666

Single Image Super-Resolution Based on Multi-Scale Competitive Convolutional Neural Network.

PubMed

Du, Xiaofeng; Qu, Xiaobo; He, Yifan; Guo, Di

2018-03-06

Deep convolutional neural networks (CNNs) are successful in single-image super-resolution. Traditional CNNs are limited to exploit multi-scale contextual information for image reconstruction due to the fixed convolutional kernel in their building modules. To restore various scales of image details, we enhance the multi-scale inference capability of CNNs by introducing competition among multi-scale convolutional filters, and build up a shallow network under limited computational resources. The proposed network has the following two advantages: (1) the multi-scale convolutional kernel provides the multi-context for image super-resolution, and (2) the maximum competitive strategy adaptively chooses the optimal scale of information for image reconstruction. Our experimental results on image super-resolution show that the performance of the proposed network outperforms the state-of-the-art methods.

Hierarchical graphical-based human pose estimation via local multi-resolution convolutional neural network

NASA Astrophysics Data System (ADS)

Zhu, Aichun; Wang, Tian; Snoussi, Hichem

2018-03-01

This paper addresses the problems of the graphical-based human pose estimation in still images, including the diversity of appearances and confounding background clutter. We present a new architecture for estimating human pose using a Convolutional Neural Network (CNN). Firstly, a Relative Mixture Deformable Model (RMDM) is defined by each pair of connected parts to compute the relative spatial information in the graphical model. Secondly, a Local Multi-Resolution Convolutional Neural Network (LMR-CNN) is proposed to train and learn the multi-scale representation of each body parts by combining different levels of part context. Thirdly, a LMR-CNN based hierarchical model is defined to explore the context information of limb parts. Finally, the experimental results demonstrate the effectiveness of the proposed deep learning approach for human pose estimation.

Knowledge extraction from evolving spiking neural networks with rank order population coding.

PubMed

Soltic, Snjezana; Kasabov, Nikola

2010-12-01

This paper demonstrates how knowledge can be extracted from evolving spiking neural networks with rank order population coding. Knowledge discovery is a very important feature of intelligent systems. Yet, a disproportionally small amount of research is centered on the issue of knowledge extraction from spiking neural networks which are considered to be the third generation of artificial neural networks. The lack of knowledge representation compatibility is becoming a major detriment to end users of these networks. We show that a high-level knowledge can be obtained from evolving spiking neural networks. More specifically, we propose a method for fuzzy rule extraction from an evolving spiking network with rank order population coding. The proposed method was used for knowledge discovery on two benchmark taste recognition problems where the knowledge learnt by an evolving spiking neural network was extracted in the form of zero-order Takagi-Sugeno fuzzy IF-THEN rules.

Measuring Fisher Information Accurately in Correlated Neural Populations

PubMed Central

Kohn, Adam; Pouget, Alexandre

2015-01-01

Neural responses are known to be variable. In order to understand how this neural variability constrains behavioral performance, we need to be able to measure the reliability with which a sensory stimulus is encoded in a given population. However, such measures are challenging for two reasons: First, they must take into account noise correlations which can have a large influence on reliability. Second, they need to be as efficient as possible, since the number of trials available in a set of neural recording is usually limited by experimental constraints. Traditionally, cross-validated decoding has been used as a reliability measure, but it only provides a lower bound on reliability and underestimates reliability substantially in small datasets. We show that, if the number of trials per condition is larger than the number of neurons, there is an alternative, direct estimate of reliability which consistently leads to smaller errors and is much faster to compute. The superior performance of the direct estimator is evident both for simulated data and for neuronal population recordings from macaque primary visual cortex. Furthermore we propose generalizations of the direct estimator which measure changes in stimulus encoding across conditions and the impact of correlations on encoding and decoding, typically denoted by Ishuffle and Idiag respectively. PMID:26030735

Dual Roles for Spike Signaling in Cortical Neural Populations

PubMed Central

Ballard, Dana H.; Jehee, Janneke F. M.

2011-01-01

A prominent feature of signaling in cortical neurons is that of randomness in the action potential. The output of a typical pyramidal cell can be well fit with a Poisson model, and variations in the Poisson rate repeatedly have been shown to be correlated with stimuli. However while the rate provides a very useful characterization of neural spike data, it may not be the most fundamental description of the signaling code. Recent data showing γ frequency range multi-cell action potential correlations, together with spike timing dependent plasticity, are spurring a re-examination of the classical model, since precise timing codes imply that the generation of spikes is essentially deterministic. Could the observed Poisson randomness and timing determinism reflect two separate modes of communication, or do they somehow derive from a single process? We investigate in a timing-based model whether the apparent incompatibility between these probabilistic and deterministic observations may be resolved by examining how spikes could be used in the underlying neural circuits. The crucial component of this model draws on dual roles for spike signaling. In learning receptive fields from ensembles of inputs, spikes need to behave probabilistically, whereas for fast signaling of individual stimuli, the spikes need to behave deterministically. Our simulations show that this combination is possible if deterministic signals using γ latency coding are probabilistically routed through different members of a cortical cell population at different times. This model exhibits standard features characteristic of Poisson models such as orientation tuning and exponential interval histograms. In addition, it makes testable predictions that follow from the γ latency coding. PMID:21687798

Population clocks: motor timing with neural dynamics

PubMed Central

Buonomano, Dean V.; Laje, Rodrigo

2010-01-01

An understanding of sensory and motor processing will require elucidation of the mechanisms by which the brain tells time. Open questions relate to whether timing relies on dedicated or intrinsic mechanisms and whether distinct mechanisms underlie timing across scales and modalities. Although experimental and theoretical studies support the notion that neural circuits are intrinsically capable of sensory timing on short scales, few general models of motor timing have been proposed. For one class of models, population clocks, it is proposed that time is encoded in the time-varying patterns of activity of a population of neurons. We argue that population clocks emerge from the internal dynamics of recurrently connected networks, are biologically realistic and account for many aspects of motor timing. PMID:20889368

Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition

NASA Astrophysics Data System (ADS)

Yin, Xi; Liu, Xiaoming

2018-02-01

This paper explores multi-task learning (MTL) for face recognition. We answer the questions of how and why MTL can improve the face recognition performance. First, we propose a multi-task Convolutional Neural Network (CNN) for face recognition where identity classification is the main task and pose, illumination, and expression estimations are the side tasks. Second, we develop a dynamic-weighting scheme to automatically assign the loss weight to each side task, which is a crucial problem in MTL. Third, we propose a pose-directed multi-task CNN by grouping different poses to learn pose-specific identity features, simultaneously across all poses. Last but not least, we propose an energy-based weight analysis method to explore how CNN-based MTL works. We observe that the side tasks serve as regularizations to disentangle the variations from the learnt identity features. Extensive experiments on the entire Multi-PIE dataset demonstrate the effectiveness of the proposed approach. To the best of our knowledge, this is the first work using all data in Multi-PIE for face recognition. Our approach is also applicable to in-the-wild datasets for pose-invariant face recognition and achieves comparable or better performance than state of the art on LFW, CFP, and IJB-A datasets.

Multi-layer holographic bifurcative neural network system for real-time adaptive EOS data analysis

NASA Technical Reports Server (NTRS)

Liu, Hua-Kuang; Huang, K. S.; Diep, J.

1993-01-01

Optical data processing techniques have the inherent advantage of high data throughout, low weight and low power requirements. These features are particularly desirable for onboard spacecraft in-situ real-time data analysis and data compression applications. the proposed multi-layer optical holographic neural net pattern recognition technique will utilize the nonlinear photorefractive devices for real-time adaptive learning to classify input data content and recognize unexpected features. Information can be stored either in analog or digital form in a nonlinear photofractive device. The recording can be accomplished in time scales ranging from milliseconds to microseconds. When a system consisting of these devices is organized in a multi-layer structure, a feedforward neural net with bifurcating data classification capability is formed. The interdisciplinary research will involve the collaboration with top digital computer architecture experts at the University of Southern California.

Drift in Neural Population Activity Causes Working Memory to Deteriorate Over Time.

PubMed

Schneegans, Sebastian; Bays, Paul M

2018-05-23

Short-term memories are thought to be maintained in the form of sustained spiking activity in neural populations. Decreases in recall precision observed with increasing number of memorized items can be accounted for by a limit on total spiking activity, resulting in fewer spikes contributing to the representation of each individual item. Longer retention intervals likewise reduce recall precision, but it is unknown what changes in population activity produce this effect. One possibility is that spiking activity becomes attenuated over time, such that the same mechanism accounts for both effects of set size and retention duration. Alternatively, reduced performance may be caused by drift in the encoded value over time, without a decrease in overall spiking activity. Human participants of either sex performed a variable-delay cued recall task with a saccadic response, providing a precise measure of recall latency. Based on a spike integration model of decision making, if the effects of set size and retention duration are both caused by decreased spiking activity, we would predict a fixed relationship between recall precision and response latency across conditions. In contrast, the drift hypothesis predicts no systematic changes in latency with increasing delays. Our results show both an increase in latency with set size, and a decrease in response precision with longer delays within each set size, but no systematic increase in latency for increasing delay durations. These results were quantitatively reproduced by a model based on a limited neural resource in which working memories drift rather than decay with time. SIGNIFICANCE STATEMENT Rapid deterioration over seconds is a defining feature of short-term memory, but what mechanism drives this degradation of internal representations? Here, we extend a successful population coding model of working memory by introducing possible mechanisms of delay effects. We show that a decay in neural signal over time predicts that

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

PubMed

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

Population-wide distributions of neural activity during perceptual decision-making

PubMed Central

Machens, Christian

2018-01-01

Cortical activity involves large populations of neurons, even when it is limited to functionally coherent areas. Electrophysiological recordings, on the other hand, involve comparatively small neural ensembles, even when modern-day techniques are used. Here we review results which have started to fill the gap between these two scales of inquiry, by shedding light on the statistical distributions of activity in large populations of cells. We put our main focus on data recorded in awake animals that perform simple decision-making tasks and consider statistical distributions of activity throughout cortex, across sensory, associative, and motor areas. We transversally review the complexity of these distributions, from distributions of firing rates and metrics of spike-train structure, through distributions of tuning to stimuli or actions and of choice signals, and finally the dynamical evolution of neural population activity and the distributions of (pairwise) neural interactions. This approach reveals shared patterns of statistical organization across cortex, including: (i) long-tailed distributions of activity, where quasi-silence seems to be the rule for a majority of neurons; that are barely distinguishable between spontaneous and active states; (ii) distributions of tuning parameters for sensory (and motor) variables, which show an extensive extrapolation and fragmentation of their representations in the periphery; and (iii) population-wide dynamics that reveal rotations of internal representations over time, whose traces can be found both in stimulus-driven and internally generated activity. We discuss how these insights are leading us away from the notion of discrete classes of cells, and are acting as powerful constraints on theories and models of cortical organization and population coding. PMID:23123501

Super-linear Precision in Simple Neural Population Codes

NASA Astrophysics Data System (ADS)

Schwab, David; Fiete, Ila

2015-03-01

A widely used tool for quantifying the precision with which a population of noisy sensory neurons encodes the value of an external stimulus is the Fisher Information (FI). Maximizing the FI is also a commonly used objective for constructing optimal neural codes. The primary utility and importance of the FI arises because it gives, through the Cramer-Rao bound, the smallest mean-squared error achievable by any unbiased stimulus estimator. However, it is well-known that when neural firing is sparse, optimizing the FI can result in codes that perform very poorly when considering the resulting mean-squared error, a measure with direct biological relevance. Here we construct optimal population codes by minimizing mean-squared error directly and study the scaling properties of the resulting network, focusing on the optimal tuning curve width. We then extend our results to continuous attractor networks that maintain short-term memory of external stimuli in their dynamics. Here we find similar scaling properties in the structure of the interactions that minimize diffusive information loss.

Gamma Oscillations of Spiking Neural Populations Enhance Signal Discrimination

PubMed Central

Masuda, Naoki; Doiron, Brent

2007-01-01

Selective attention is an important filter for complex environments where distractions compete with signals. Attention increases both the gamma-band power of cortical local field potentials and the spike-field coherence within the receptive field of an attended object. However, the mechanisms by which gamma-band activity enhances, if at all, the encoding of input signals are not well understood. We propose that gamma oscillations induce binomial-like spike-count statistics across noisy neural populations. Using simplified models of spiking neurons, we show how the discrimination of static signals based on the population spike-count response is improved with gamma induced binomial statistics. These results give an important mechanistic link between the neural correlates of attention and the discrimination tasks where attention is known to enhance performance. Further, they show how a rhythmicity of spike responses can enhance coding schemes that are not temporally sensitive. PMID:18052541

Multi-Level and Multi-Scale Feature Aggregation Using Pretrained Convolutional Neural Networks for Music Auto-Tagging

NASA Astrophysics Data System (ADS)

Lee, Jongpil; Nam, Juhan

2017-08-01

Music auto-tagging is often handled in a similar manner to image classification by regarding the 2D audio spectrogram as image data. However, music auto-tagging is distinguished from image classification in that the tags are highly diverse and have different levels of abstractions. Considering this issue, we propose a convolutional neural networks (CNN)-based architecture that embraces multi-level and multi-scaled features. The architecture is trained in three steps. First, we conduct supervised feature learning to capture local audio features using a set of CNNs with different input sizes. Second, we extract audio features from each layer of the pre-trained convolutional networks separately and aggregate them altogether given a long audio clip. Finally, we put them into fully-connected networks and make final predictions of the tags. Our experiments show that using the combination of multi-level and multi-scale features is highly effective in music auto-tagging and the proposed method outperforms previous state-of-the-arts on the MagnaTagATune dataset and the Million Song Dataset. We further show that the proposed architecture is useful in transfer learning.

Toward multi-area distributed network of implanted neural interrogators

NASA Astrophysics Data System (ADS)

Powell, Marc P.; Hou, Xiaoxiao; Galligan, Craig; Ashe, Jeffrey; Borton, David A.

2017-08-01

As we aim to improve our understanding of the brain, it is critical that researchers have simultaneous multi-area, large-scale access to the brain. Information processing in the brain occurs through close and distant coupling of functional sub-domains, as opposed to within isolated single neurons. However, commercially available neural interfaces capable of sensing electrophysiology of single neurons, currently allow access to only a small, mm3 volume of cortical cells, are not scalable to recording from orders of magnitude more neurons, and leverage bulky, skull mounted hardware and cabling sensitive to relative movements of the skull and brain. In this work, we propose a system capable of recording from many individual distributed neural interrogator nodes, untethered from any external electronics. Using an array of epidural inductive coils to wirelessly power the implanted electronics, the system is intended to be agnostic to the surgical placement of any individual node. Here, we demonstrate the ability to transmit nearly 15mW of power with greater than 50% power transfer efficiency, benchtop testing of individual subcircuit system components showing successful digitization of neural signals, and wireless transmission currently supporting a data rate of 3.84Mbps. We leverage a software defined radio based RF receiver to demodulate the data which can be stored in memory for later retrieval. Finally, we introduce a packaging technology capable of isolating active electronics from the surrounding tissue while providing capability for electrical feed-through assemblies for external neural interfacing. We expect, based on the presented preliminary findings, that the system can be integrated into a platform technology for the study of the intricate interactions between cortical domains.

A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs

PubMed Central

Faugeras, Olivier; Touboul, Jonathan; Cessac, Bruno

2008-01-01

We deal with the problem of bridging the gap between two scales in neuronal modeling. At the first (microscopic) scale, neurons are considered individually and their behavior described by stochastic differential equations that govern the time variations of their membrane potentials. They are coupled by synaptic connections acting on their resulting activity, a nonlinear function of their membrane potential. At the second (mesoscopic) scale, interacting populations of neurons are described individually by similar equations. The equations describing the dynamical and the stationary mean-field behaviors are considered as functional equations on a set of stochastic processes. Using this new point of view allows us to prove that these equations are well-posed on any finite time interval and to provide a constructive method for effectively computing their unique solution. This method is proved to converge to the unique solution and we characterize its complexity and convergence rate. We also provide partial results for the stationary problem on infinite time intervals. These results shed some new light on such neural mass models as the one of Jansen and Rit (1995): their dynamics appears as a coarse approximation of the much richer dynamics that emerges from our analysis. Our numerical experiments confirm that the framework we propose and the numerical methods we derive from it provide a new and powerful tool for the exploration of neural behaviors at different scales. PMID:19255631

Fuzzy Neural Network-Based Interacting Multiple Model for Multi-Node Target Tracking Algorithm

PubMed Central

Sun, Baoliang; Jiang, Chunlan; Li, Ming

2016-01-01

An interacting multiple model for multi-node target tracking algorithm was proposed based on a fuzzy neural network (FNN) to solve the multi-node target tracking problem of wireless sensor networks (WSNs). Measured error variance was adaptively adjusted during the multiple model interacting output stage using the difference between the theoretical and estimated values of the measured error covariance matrix. The FNN fusion system was established during multi-node fusion to integrate with the target state estimated data from different nodes and consequently obtain network target state estimation. The feasibility of the algorithm was verified based on a network of nine detection nodes. Experimental results indicated that the proposed algorithm could trace the maneuvering target effectively under sensor failure and unknown system measurement errors. The proposed algorithm exhibited great practicability in the multi-node target tracking of WSNs. PMID:27809271

Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays

PubMed Central

Grosberg, Lauren E.; Madugula, Sasidhar; Litke, Alan; Cunningham, John; Chichilnisky, E. J.; Paninski, Liam

2017-01-01

Simultaneous electrical stimulation and recording using multi-electrode arrays can provide a valuable technique for studying circuit connectivity and engineering neural interfaces. However, interpreting these measurements is challenging because the spike sorting process (identifying and segregating action potentials arising from different neurons) is greatly complicated by electrical stimulation artifacts across the array, which can exhibit complex and nonlinear waveforms, and overlap temporarily with evoked spikes. Here we develop a scalable algorithm based on a structured Gaussian Process model to estimate the artifact and identify evoked spikes. The effectiveness of our methods is demonstrated in both real and simulated 512-electrode recordings in the peripheral primate retina with single-electrode and several types of multi-electrode stimulation. We establish small error rates in the identification of evoked spikes, with a computational complexity that is compatible with real-time data analysis. This technology may be helpful in the design of future high-resolution sensory prostheses based on tailored stimulation (e.g., retinal prostheses), and for closed-loop neural stimulation at a much larger scale than currently possible. PMID:29131818

Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays.

PubMed

Mena, Gonzalo E; Grosberg, Lauren E; Madugula, Sasidhar; Hottowy, Paweł; Litke, Alan; Cunningham, John; Chichilnisky, E J; Paninski, Liam

2017-11-01

Simultaneous electrical stimulation and recording using multi-electrode arrays can provide a valuable technique for studying circuit connectivity and engineering neural interfaces. However, interpreting these measurements is challenging because the spike sorting process (identifying and segregating action potentials arising from different neurons) is greatly complicated by electrical stimulation artifacts across the array, which can exhibit complex and nonlinear waveforms, and overlap temporarily with evoked spikes. Here we develop a scalable algorithm based on a structured Gaussian Process model to estimate the artifact and identify evoked spikes. The effectiveness of our methods is demonstrated in both real and simulated 512-electrode recordings in the peripheral primate retina with single-electrode and several types of multi-electrode stimulation. We establish small error rates in the identification of evoked spikes, with a computational complexity that is compatible with real-time data analysis. This technology may be helpful in the design of future high-resolution sensory prostheses based on tailored stimulation (e.g., retinal prostheses), and for closed-loop neural stimulation at a much larger scale than currently possible.

Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size.

PubMed

Schwalger, Tilo; Deger, Moritz; Gerstner, Wulfram

2017-04-01

Neural population equations such as neural mass or field models are widely used to study brain activity on a large scale. However, the relation of these models to the properties of single neurons is unclear. Here we derive an equation for several interacting populations at the mesoscopic scale starting from a microscopic model of randomly connected generalized integrate-and-fire neuron models. Each population consists of 50-2000 neurons of the same type but different populations account for different neuron types. The stochastic population equations that we find reveal how spike-history effects in single-neuron dynamics such as refractoriness and adaptation interact with finite-size fluctuations on the population level. Efficient integration of the stochastic mesoscopic equations reproduces the statistical behavior of the population activities obtained from microscopic simulations of a full spiking neural network model. The theory describes nonlinear emergent dynamics such as finite-size-induced stochastic transitions in multistable networks and synchronization in balanced networks of excitatory and inhibitory neurons. The mesoscopic equations are employed to rapidly integrate a model of a cortical microcircuit consisting of eight neuron types, which allows us to predict spontaneous population activities as well as evoked responses to thalamic input. Our theory establishes a general framework for modeling finite-size neural population dynamics based on single cell and synapse parameters and offers an efficient approach to analyzing cortical circuits and computations.

Cardiac Arrhythmia Classification by Multi-Layer Perceptron and Convolution Neural Networks.

PubMed

Savalia, Shalin; Emamian, Vahid

2018-05-04

The electrocardiogram (ECG) plays an imperative role in the medical field, as it records heart signal over time and is used to discover numerous cardiovascular diseases. If a documented ECG signal has a certain irregularity in its predefined features, this is called arrhythmia, the types of which include tachycardia, bradycardia, supraventricular arrhythmias, and ventricular, etc. This has encouraged us to do research that consists of distinguishing between several arrhythmias by using deep neural network algorithms such as multi-layer perceptron (MLP) and convolution neural network (CNN). The TensorFlow library that was established by Google for deep learning and machine learning is used in python to acquire the algorithms proposed here. The ECG databases accessible at PhysioBank.com and kaggle.com were used for training, testing, and validation of the MLP and CNN algorithms. The proposed algorithm consists of four hidden layers with weights, biases in MLP, and four-layer convolution neural networks which map ECG samples to the different classes of arrhythmia. The accuracy of the algorithm surpasses the performance of the current algorithms that have been developed by other cardiologists in both sensitivity and precision.

Modelling innovation performance of European regions using multi-output neural networks

PubMed Central

Henriques, Roberto

2017-01-01

Regional innovation performance is an important indicator for decision-making regarding the implementation of policies intended to support innovation. However, patterns in regional innovation structures are becoming increasingly diverse, complex and nonlinear. To address these issues, this study aims to develop a model based on a multi-output neural network. Both intra- and inter-regional determinants of innovation performance are empirically investigated using data from the 4th and 5th Community Innovation Surveys of NUTS 2 (Nomenclature of Territorial Units for Statistics) regions. The results suggest that specific innovation strategies must be developed based on the current state of input attributes in the region. Thus, it is possible to develop appropriate strategies and targeted interventions to improve regional innovation performance. We demonstrate that support of entrepreneurship is an effective instrument of innovation policy. We also provide empirical support that both business and government R&D activity have a sigmoidal effect, implying that the most effective R&D support should be directed to regions with below-average and average R&D activity. We further show that the multi-output neural network outperforms traditional statistical and machine learning regression models. In general, therefore, it seems that the proposed model can effectively reflect both the multiple-output nature of innovation performance and the interdependency of the output attributes. PMID:28968449

Modelling innovation performance of European regions using multi-output neural networks.

PubMed

Hajek, Petr; Henriques, Roberto

2017-01-01

Regional innovation performance is an important indicator for decision-making regarding the implementation of policies intended to support innovation. However, patterns in regional innovation structures are becoming increasingly diverse, complex and nonlinear. To address these issues, this study aims to develop a model based on a multi-output neural network. Both intra- and inter-regional determinants of innovation performance are empirically investigated using data from the 4th and 5th Community Innovation Surveys of NUTS 2 (Nomenclature of Territorial Units for Statistics) regions. The results suggest that specific innovation strategies must be developed based on the current state of input attributes in the region. Thus, it is possible to develop appropriate strategies and targeted interventions to improve regional innovation performance. We demonstrate that support of entrepreneurship is an effective instrument of innovation policy. We also provide empirical support that both business and government R&D activity have a sigmoidal effect, implying that the most effective R&D support should be directed to regions with below-average and average R&D activity. We further show that the multi-output neural network outperforms traditional statistical and machine learning regression models. In general, therefore, it seems that the proposed model can effectively reflect both the multiple-output nature of innovation performance and the interdependency of the output attributes.

High-Lift Optimization Design Using Neural Networks on a Multi-Element Airfoil

NASA Technical Reports Server (NTRS)

Greenman, Roxana M.; Roth, Karlin R.; Smith, Charles A. (Technical Monitor)

1998-01-01

The high-lift performance of a multi-element airfoil was optimized by using neural-net predictions that were trained using a computational data set. The numerical data was generated using a two-dimensional, incompressible, Navier-Stokes algorithm with the Spalart-Allmaras turbulence model. Because it is difficult to predict maximum lift for high-lift systems, an empirically-based maximum lift criteria was used in this study to determine both the maximum lift and the angle at which it occurs. Multiple input, single output networks were trained using the NASA Ames variation of the Levenberg-Marquardt algorithm for each of the aerodynamic coefficients (lift, drag, and moment). The artificial neural networks were integrated with a gradient-based optimizer. Using independent numerical simulations and experimental data for this high-lift configuration, it was shown that this design process successfully optimized flap deflection, gap, overlap, and angle of attack to maximize lift. Once the neural networks were trained and integrated with the optimizer, minimal additional computer resources were required to perform optimization runs with different initial conditions and parameters. Applying the neural networks within the high-lift rigging optimization process reduced the amount of computational time and resources by 83% compared with traditional gradient-based optimization procedures for multiple optimization runs.

A multi-populations multi-strategies differential evolution algorithm for structural optimization of metal nanoclusters

NASA Astrophysics Data System (ADS)

Fan, Tian-E.; Shao, Gui-Fang; Ji, Qing-Shuang; Zheng, Ji-Wen; Liu, Tun-dong; Wen, Yu-Hua

2016-11-01

Theoretically, the determination of the structure of a cluster is to search the global minimum on its potential energy surface. The global minimization problem is often nondeterministic-polynomial-time (NP) hard and the number of local minima grows exponentially with the cluster size. In this article, a multi-populations multi-strategies differential evolution algorithm has been proposed to search the globally stable structure of Fe and Cr nanoclusters. The algorithm combines a multi-populations differential evolution with an elite pool scheme to keep the diversity of the solutions and avoid prematurely trapping into local optima. Moreover, multi-strategies such as growing method in initialization and three differential strategies in mutation are introduced to improve the convergence speed and lower the computational cost. The accuracy and effectiveness of our algorithm have been verified by comparing the results of Fe clusters with Cambridge Cluster Database. Meanwhile, the performance of our algorithm has been analyzed by comparing the convergence rate and energy evaluations with the classical DE algorithm. The multi-populations, multi-strategies mutation and growing method in initialization in our algorithm have been considered respectively. Furthermore, the structural growth pattern of Cr clusters has been predicted by this algorithm. The results show that the lowest-energy structure of Cr clusters contains many icosahedra, and the number of the icosahedral rings rises with increasing size.

Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size

PubMed Central

Gerstner, Wulfram

2017-01-01

Neural population equations such as neural mass or field models are widely used to study brain activity on a large scale. However, the relation of these models to the properties of single neurons is unclear. Here we derive an equation for several interacting populations at the mesoscopic scale starting from a microscopic model of randomly connected generalized integrate-and-fire neuron models. Each population consists of 50–2000 neurons of the same type but different populations account for different neuron types. The stochastic population equations that we find reveal how spike-history effects in single-neuron dynamics such as refractoriness and adaptation interact with finite-size fluctuations on the population level. Efficient integration of the stochastic mesoscopic equations reproduces the statistical behavior of the population activities obtained from microscopic simulations of a full spiking neural network model. The theory describes nonlinear emergent dynamics such as finite-size-induced stochastic transitions in multistable networks and synchronization in balanced networks of excitatory and inhibitory neurons. The mesoscopic equations are employed to rapidly integrate a model of a cortical microcircuit consisting of eight neuron types, which allows us to predict spontaneous population activities as well as evoked responses to thalamic input. Our theory establishes a general framework for modeling finite-size neural population dynamics based on single cell and synapse parameters and offers an efficient approach to analyzing cortical circuits and computations. PMID:28422957

Probabilistic and Other Neural Nets in Multi-Hole Probe Calibration and Flow Angularity Pattern Recognition

NASA Technical Reports Server (NTRS)

Baskaran, Subbiah; Ramachandran, Narayanan; Noever, David

1998-01-01

The use of probabilistic (PNN) and multilayer feed forward (MLFNN) neural networks are investigated for calibration of multi-hole pressure probes and the prediction of associated flow angularity patterns in test flow fields. Both types of networks are studied in detail for their calibration and prediction characteristics. The current formalism can be applied to any multi-hole probe, however the test results for the most commonly used five-hole Cone and Prism probe types alone are reported in this article.

Distributed collaborative probabilistic design of multi-failure structure with fluid-structure interaction using fuzzy neural network of regression

NASA Astrophysics Data System (ADS)

Song, Lu-Kai; Wen, Jie; Fei, Cheng-Wei; Bai, Guang-Chen

2018-05-01

To improve the computing efficiency and precision of probabilistic design for multi-failure structure, a distributed collaborative probabilistic design method-based fuzzy neural network of regression (FR) (called as DCFRM) is proposed with the integration of distributed collaborative response surface method and fuzzy neural network regression model. The mathematical model of DCFRM is established and the probabilistic design idea with DCFRM is introduced. The probabilistic analysis of turbine blisk involving multi-failure modes (deformation failure, stress failure and strain failure) was investigated by considering fluid-structure interaction with the proposed method. The distribution characteristics, reliability degree, and sensitivity degree of each failure mode and overall failure mode on turbine blisk are obtained, which provides a useful reference for improving the performance and reliability of aeroengine. Through the comparison of methods shows that the DCFRM reshapes the probability of probabilistic analysis for multi-failure structure and improves the computing efficiency while keeping acceptable computational precision. Moreover, the proposed method offers a useful insight for reliability-based design optimization of multi-failure structure and thereby also enriches the theory and method of mechanical reliability design.

Multi-modality image fusion based on enhanced fuzzy radial basis function neural networks.

PubMed

Chao, Zhen; Kim, Dohyeon; Kim, Hee-Joung

2018-04-01

In clinical applications, single modality images do not provide sufficient diagnostic information. Therefore, it is necessary to combine the advantages or complementarities of different modalities of images. Recently, neural network technique was applied to medical image fusion by many researchers, but there are still many deficiencies. In this study, we propose a novel fusion method to combine multi-modality medical images based on the enhanced fuzzy radial basis function neural network (Fuzzy-RBFNN), which includes five layers: input, fuzzy partition, front combination, inference, and output. Moreover, we propose a hybrid of the gravitational search algorithm (GSA) and error back propagation algorithm (EBPA) to train the network to update the parameters of the network. Two different patterns of images are used as inputs of the neural network, and the output is the fused image. A comparison with the conventional fusion methods and another neural network method through subjective observation and objective evaluation indexes reveals that the proposed method effectively synthesized the information of input images and achieved better results. Meanwhile, we also trained the network by using the EBPA and GSA, individually. The results reveal that the EBPGSA not only outperformed both EBPA and GSA, but also trained the neural network more accurately by analyzing the same evaluation indexes. Copyright © 2018 Associazione Italiana di Fisica Medica. Published by Elsevier Ltd. All rights reserved.

Population coding and decoding in a neural field: a computational study.

PubMed

Wu, Si; Amari, Shun-Ichi; Nakahara, Hiroyuki

2002-05-01

This study uses a neural field model to investigate computational aspects of population coding and decoding when the stimulus is a single variable. A general prototype model for the encoding process is proposed, in which neural responses are correlated, with strength specified by a gaussian function of their difference in preferred stimuli. Based on the model, we study the effect of correlation on the Fisher information, compare the performances of three decoding methods that differ in the amount of encoding information being used, and investigate the implementation of the three methods by using a recurrent network. This study not only rediscovers main results in existing literatures in a unified way, but also reveals important new features, especially when the neural correlation is strong. As the neural correlation of firing becomes larger, the Fisher information decreases drastically. We confirm that as the width of correlation increases, the Fisher information saturates and no longer increases in proportion to the number of neurons. However, we prove that as the width increases further--wider than (sqrt)2 times the effective width of the turning function--the Fisher information increases again, and it increases without limit in proportion to the number of neurons. Furthermore, we clarify the asymptotic efficiency of the maximum likelihood inference (MLI) type of decoding methods for correlated neural signals. It shows that when the correlation covers a nonlocal range of population (excepting the uniform correlation and when the noise is extremely small), the MLI type of method, whose decoding error satisfies the Cauchy-type distribution, is not asymptotically efficient. This implies that the variance is no longer adequate to measure decoding accuracy.

Estimate the effective connectivity in multi-coupled neural mass model using particle swarm optimization

NASA Astrophysics Data System (ADS)

Shan, Bonan; Wang, Jiang; Deng, Bin; Zhang, Zhen; Wei, Xile

2017-03-01

Assessment of the effective connectivity among different brain regions during seizure is a crucial problem in neuroscience today. As a consequence, a new model inversion framework of brain function imaging is introduced in this manuscript. This framework is based on approximating brain networks using a multi-coupled neural mass model (NMM). NMM describes the excitatory and inhibitory neural interactions, capturing the mechanisms involved in seizure initiation, evolution and termination. Particle swarm optimization method is used to estimate the effective connectivity variation (the parameters of NMM) and the epileptiform dynamics (the states of NMM) that cannot be directly measured using electrophysiological measurement alone. The estimated effective connectivity includes both the local connectivity parameters within a single region NMM and the remote connectivity parameters between multi-coupled NMMs. When the epileptiform activities are estimated, a proportional-integral controller outputs control signal so that the epileptiform spikes can be inhibited immediately. Numerical simulations are carried out to illustrate the effectiveness of the proposed framework. The framework and the results have a profound impact on the way we detect and treat epilepsy.

Scaling Properties of Dimensionality Reduction for Neural Populations and Network Models

PubMed Central

Cowley, Benjamin R.; Doiron, Brent; Kohn, Adam

2016-01-01

Recent studies have applied dimensionality reduction methods to understand how the multi-dimensional structure of neural population activity gives rise to brain function. It is unclear, however, how the results obtained from dimensionality reduction generalize to recordings with larger numbers of neurons and trials or how these results relate to the underlying network structure. We address these questions by applying factor analysis to recordings in the visual cortex of non-human primates and to spiking network models that self-generate irregular activity through a balance of excitation and inhibition. We compared the scaling trends of two key outputs of dimensionality reduction—shared dimensionality and percent shared variance—with neuron and trial count. We found that the scaling properties of networks with non-clustered and clustered connectivity differed, and that the in vivo recordings were more consistent with the clustered network. Furthermore, recordings from tens of neurons were sufficient to identify the dominant modes of shared variability that generalize to larger portions of the network. These findings can help guide the interpretation of dimensionality reduction outputs in regimes of limited neuron and trial sampling and help relate these outputs to the underlying network structure. PMID:27926936

Neural-like computing with populations of superparamagnetic basis functions.

PubMed

Mizrahi, Alice; Hirtzlin, Tifenn; Fukushima, Akio; Kubota, Hitoshi; Yuasa, Shinji; Grollier, Julie; Querlioz, Damien

2018-04-18

In neuroscience, population coding theory demonstrates that neural assemblies can achieve fault-tolerant information processing. Mapped to nanoelectronics, this strategy could allow for reliable computing with scaled-down, noisy, imperfect devices. Doing so requires that the population components form a set of basis functions in terms of their response functions to inputs, offering a physical substrate for computing. Such a population can be implemented with CMOS technology, but the corresponding circuits have high area or energy requirements. Here, we show that nanoscale magnetic tunnel junctions can instead be assembled to meet these requirements. We demonstrate experimentally that a population of nine junctions can implement a basis set of functions, providing the data to achieve, for example, the generation of cursive letters. We design hybrid magnetic-CMOS systems based on interlinked populations of junctions and show that they can learn to realize non-linear variability-resilient transformations with a low imprint area and low power.

Multi-focus image fusion with the all convolutional neural network

NASA Astrophysics Data System (ADS)

Du, Chao-ben; Gao, She-sheng

2018-01-01

A decision map contains complete and clear information about the image to be fused, which is crucial to various image fusion issues, especially multi-focus image fusion. However, in order to get a satisfactory image fusion effect, getting a decision map is very necessary and usually difficult to finish. In this letter, we address this problem with convolutional neural network (CNN), aiming to get a state-of-the-art decision map. The main idea is that the max-pooling of CNN is replaced by a convolution layer, the residuals are propagated backwards by gradient descent, and the training parameters of the individual layers of the CNN are updated layer by layer. Based on this, we propose a new all CNN (ACNN)-based multi-focus image fusion method in spatial domain. We demonstrate that the decision map obtained from the ACNN is reliable and can lead to high-quality fusion results. Experimental results clearly validate that the proposed algorithm can obtain state-of-the-art fusion performance in terms of both qualitative and quantitative evaluations.

Anomalous Signal Detection in ELF Band Electromagnetic Wave using Multi-layer Neural Network with Wavelet Decomposition

NASA Astrophysics Data System (ADS)

Itai, Akitoshi; Yasukawa, Hiroshi; Takumi, Ichi; Hata, Masayasu

It is well known that electromagnetic waves radiated from the earth's crust are useful for predicting earthquakes. We analyze the electromagnetic waves received at the extremely low frequency band of 223Hz. These observed signals contain the seismic radiation from the earth's crust, but also include several undesired signals. Our research focuses on the signal detection technique to identify an anomalous signal corresponding to the seismic radiation in the observed signal. Conventional anomalous signal detections lack a wide applicability due to their assumptions, e.g. the digital data have to be observed at the same time or the same sensor. In order to overcome the limitation related to the observed signal, we proposed the anomalous signals detection based on a multi-layer neural network which is trained by digital data observed during a span of a day. In the neural network approach, training data do not need to be recorded at the same place or the same time. However, some noises, which have a large amplitude, are detected as the anomalous signal. This paper develops a multi-layer neural network to decrease the false detection of the anomalous signal from the electromagnetic wave. The training data for the proposed network is the decomposed signal of the observed signal during several days, since the seismic radiations are often recorded from several days to a couple of weeks. Results show that the proposed neural network is useful to achieve the accurate detection of the anomalous signal that indicates seismic activity.

Demixed principal component analysis of neural population data.

PubMed

Kobak, Dmitry; Brendel, Wieland; Constantinidis, Christos; Feierstein, Claudia E; Kepecs, Adam; Mainen, Zachary F; Qi, Xue-Lian; Romo, Ranulfo; Uchida, Naoshige; Machens, Christian K

2016-04-12

Neurons in higher cortical areas, such as the prefrontal cortex, are often tuned to a variety of sensory and motor variables, and are therefore said to display mixed selectivity. This complexity of single neuron responses can obscure what information these areas represent and how it is represented. Here we demonstrate the advantages of a new dimensionality reduction technique, demixed principal component analysis (dPCA), that decomposes population activity into a few components. In addition to systematically capturing the majority of the variance of the data, dPCA also exposes the dependence of the neural representation on task parameters such as stimuli, decisions, or rewards. To illustrate our method we reanalyze population data from four datasets comprising different species, different cortical areas and different experimental tasks. In each case, dPCA provides a concise way of visualizing the data that summarizes the task-dependent features of the population response in a single figure.

Demixed principal component analysis of neural population data

PubMed Central

Kobak, Dmitry; Brendel, Wieland; Constantinidis, Christos; Feierstein, Claudia E; Kepecs, Adam; Mainen, Zachary F; Qi, Xue-Lian; Romo, Ranulfo; Uchida, Naoshige; Machens, Christian K

2016-01-01

Neurons in higher cortical areas, such as the prefrontal cortex, are often tuned to a variety of sensory and motor variables, and are therefore said to display mixed selectivity. This complexity of single neuron responses can obscure what information these areas represent and how it is represented. Here we demonstrate the advantages of a new dimensionality reduction technique, demixed principal component analysis (dPCA), that decomposes population activity into a few components. In addition to systematically capturing the majority of the variance of the data, dPCA also exposes the dependence of the neural representation on task parameters such as stimuli, decisions, or rewards. To illustrate our method we reanalyze population data from four datasets comprising different species, different cortical areas and different experimental tasks. In each case, dPCA provides a concise way of visualizing the data that summarizes the task-dependent features of the population response in a single figure. DOI: http://dx.doi.org/10.7554/eLife.10989.001 PMID:27067378

Crowd counting via region based multi-channel convolution neural network

NASA Astrophysics Data System (ADS)

Cao, Xiaoguang; Gao, Siqi; Bai, Xiangzhi

2017-11-01

This paper proposed a novel region based multi-channel convolution neural network architecture for crowd counting. In order to effectively solve the perspective distortion in crowd datasets with a great diversity of scales, this work combines the main channel and three branch channels. These channels extract both the global and region features. And the results are used to estimate density map. Moreover, kernels with ladder-shaped sizes are designed across all the branch channels, which generate adaptive region features. Also, branch channels use relatively deep and shallow network to achieve more accurate detector. By using these strategies, the proposed architecture achieves state-of-the-art performance on ShanghaiTech datasets and competitive performance on UCF_CC_50 datasets.

Phase synchronization motion and neural coding in dynamic transmission of neural information.

PubMed

Wang, Rubin; Zhang, Zhikang; Qu, Jingyi; Cao, Jianting

2011-07-01

In order to explore the dynamic characteristics of neural coding in the transmission of neural information in the brain, a model of neural network consisting of three neuronal populations is proposed in this paper using the theory of stochastic phase dynamics. Based on the model established, the neural phase synchronization motion and neural coding under spontaneous activity and stimulation are examined, for the case of varying network structure. Our analysis shows that, under the condition of spontaneous activity, the characteristics of phase neural coding are unrelated to the number of neurons participated in neural firing within the neuronal populations. The result of numerical simulation supports the existence of sparse coding within the brain, and verifies the crucial importance of the magnitudes of the coupling coefficients in neural information processing as well as the completely different information processing capability of neural information transmission in both serial and parallel couplings. The result also testifies that under external stimulation, the bigger the number of neurons in a neuronal population, the more the stimulation influences the phase synchronization motion and neural coding evolution in other neuronal populations. We verify numerically the experimental result in neurobiology that the reduction of the coupling coefficient between neuronal populations implies the enhancement of lateral inhibition function in neural networks, with the enhancement equivalent to depressing neuronal excitability threshold. Thus, the neuronal populations tend to have a stronger reaction under the same stimulation, and more neurons get excited, leading to more neurons participating in neural coding and phase synchronization motion.

A thesaurus for a neural population code

PubMed Central

Ganmor, Elad; Segev, Ronen; Schneidman, Elad

2015-01-01

Information is carried in the brain by the joint spiking patterns of large groups of noisy, unreliable neurons. This noise limits the capacity of the neural code and determines how information can be transmitted and read-out. To accurately decode, the brain must overcome this noise and identify which patterns are semantically similar. We use models of network encoding noise to learn a thesaurus for populations of neurons in the vertebrate retina responding to artificial and natural videos, measuring the similarity between population responses to visual stimuli based on the information they carry. This thesaurus reveals that the code is organized in clusters of synonymous activity patterns that are similar in meaning but may differ considerably in their structure. This organization is highly reminiscent of the design of engineered codes. We suggest that the brain may use this structure and show how it allows accurate decoding of novel stimuli from novel spiking patterns. DOI: http://dx.doi.org/10.7554/eLife.06134.001 PMID:26347983

Distributed Neural Processing Predictors of Multi-dimensional Properties of Affect

PubMed Central

Bush, Keith A.; Inman, Cory S.; Hamann, Stephan; Kilts, Clinton D.; James, G. Andrew

2017-01-01

Recent evidence suggests that emotions have a distributed neural representation, which has significant implications for our understanding of the mechanisms underlying emotion regulation and dysregulation as well as the potential targets available for neuromodulation-based emotion therapeutics. This work adds to this evidence by testing the distribution of neural representations underlying the affective dimensions of valence and arousal using representational models that vary in both the degree and the nature of their distribution. We used multi-voxel pattern classification (MVPC) to identify whole-brain patterns of functional magnetic resonance imaging (fMRI)-derived neural activations that reliably predicted dimensional properties of affect (valence and arousal) for visual stimuli viewed by a normative sample (n = 32) of demographically diverse, healthy adults. Inter-subject leave-one-out cross-validation showed whole-brain MVPC significantly predicted (p < 0.001) binarized normative ratings of valence (positive vs. negative, 59% accuracy) and arousal (high vs. low, 56% accuracy). We also conducted group-level univariate general linear modeling (GLM) analyses to identify brain regions whose response significantly differed for the contrasts of positive versus negative valence or high versus low arousal. Multivoxel pattern classifiers using voxels drawn from all identified regions of interest (all-ROIs) exhibited mixed performance; arousal was predicted significantly better than chance but worse than the whole-brain classifier, whereas valence was not predicted significantly better than chance. Multivoxel classifiers derived using individual ROIs generally performed no better than chance. Although performance of the all-ROI classifier improved with larger ROIs (generated by relaxing the clustering threshold), performance was still poorer than the whole-brain classifier. These findings support a highly distributed model of neural processing for the affective

Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning

PubMed Central

Dann, Benjamin

2016-01-01

Recent models of movement generation in motor cortex have sought to explain neural activity not as a function of movement parameters, known as representational models, but as a dynamical system acting at the level of the population. Despite evidence supporting this framework, the evaluation of representational models and their integration with dynamical systems is incomplete in the literature. Using a representational velocity-tuning based simulation of center-out reaching, we show that incorporating variable latency offsets between neural activity and kinematics is sufficient to generate rotational dynamics at the level of neural populations, a phenomenon observed in motor cortex. However, we developed a covariance-matched permutation test (CMPT) that reassigns neural data between task conditions independently for each neuron while maintaining overall neuron-to-neuron relationships, revealing that rotations based on the representational model did not uniquely depend on the underlying condition structure. In contrast, rotations based on either a dynamical model or motor cortex data depend on this relationship, providing evidence that the dynamical model more readily explains motor cortex activity. Importantly, implementing a recurrent neural network we demonstrate that both representational tuning properties and rotational dynamics emerge, providing evidence that a dynamical system can reproduce previous findings of representational tuning. Finally, using motor cortex data in combination with the CMPT, we show that results based on small numbers of neurons or conditions should be interpreted cautiously, potentially informing future experimental design. Together, our findings reinforce the view that representational models lack the explanatory power to describe complex aspects of single neuron and population level activity. PMID:27814352

Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning.

PubMed

Michaels, Jonathan A; Dann, Benjamin; Scherberger, Hansjörg

2016-11-01

Recent models of movement generation in motor cortex have sought to explain neural activity not as a function of movement parameters, known as representational models, but as a dynamical system acting at the level of the population. Despite evidence supporting this framework, the evaluation of representational models and their integration with dynamical systems is incomplete in the literature. Using a representational velocity-tuning based simulation of center-out reaching, we show that incorporating variable latency offsets between neural activity and kinematics is sufficient to generate rotational dynamics at the level of neural populations, a phenomenon observed in motor cortex. However, we developed a covariance-matched permutation test (CMPT) that reassigns neural data between task conditions independently for each neuron while maintaining overall neuron-to-neuron relationships, revealing that rotations based on the representational model did not uniquely depend on the underlying condition structure. In contrast, rotations based on either a dynamical model or motor cortex data depend on this relationship, providing evidence that the dynamical model more readily explains motor cortex activity. Importantly, implementing a recurrent neural network we demonstrate that both representational tuning properties and rotational dynamics emerge, providing evidence that a dynamical system can reproduce previous findings of representational tuning. Finally, using motor cortex data in combination with the CMPT, we show that results based on small numbers of neurons or conditions should be interpreted cautiously, potentially informing future experimental design. Together, our findings reinforce the view that representational models lack the explanatory power to describe complex aspects of single neuron and population level activity.

Fuzzy Neural Classifiers for Multi-Wavelength Interdigital Sensors

NASA Astrophysics Data System (ADS)

Xenides, D.; Vlachos, D. S.; Simos, T. E.

2007-12-01

The use of multi-wavelength interdigital sensors for non-destructive testing is based on the capability of the measuring system to classify the measured impendence according to some physical properties of the material under test. By varying the measuring frequency and the wavelength of the sensor (and thus the penetration depth of the electric field inside the material under test) we can produce images that correspond to various configurations of dielectric materials under different geometries. The implementation of a fuzzy neural network witch inputs these images for both quantitative and qualitative sensing is demonstrated. The architecture of the system is presented with some references to the general theory of fuzzy sets and fuzzy calculus. Experimental results are presented in the case of a set of 8 well characterized dielectric layers. Finally the effect of network parameters to the functionality of the system is discussed, especially in the case of functions evaluating the fuzzy AND and OR operations.

Effects of bursting dynamic features on the generation of multi-clustered structure of neural network with symmetric spike-timing-dependent plasticity learning rule.

PubMed

Liu, Hui; Song, Yongduan; Xue, Fangzheng; Li, Xiumin

2015-11-01

In this paper, the generation of multi-clustered structure of self-organized neural network with different neuronal firing patterns, i.e., bursting or spiking, has been investigated. The initially all-to-all-connected spiking neural network or bursting neural network can be self-organized into clustered structure through the symmetric spike-timing-dependent plasticity learning for both bursting and spiking neurons. However, the time consumption of this clustering procedure of the burst-based self-organized neural network (BSON) is much shorter than the spike-based self-organized neural network (SSON). Our results show that the BSON network has more obvious small-world properties, i.e., higher clustering coefficient and smaller shortest path length than the SSON network. Also, the results of larger structure entropy and activity entropy of the BSON network demonstrate that this network has higher topological complexity and dynamical diversity, which benefits for enhancing information transmission of neural circuits. Hence, we conclude that the burst firing can significantly enhance the efficiency of clustering procedure and the emergent clustered structure renders the whole network more synchronous and therefore more sensitive to weak input. This result is further confirmed from its improved performance on stochastic resonance. Therefore, we believe that the multi-clustered neural network which self-organized from the bursting dynamics has high efficiency in information processing.

Effects of bursting dynamic features on the generation of multi-clustered structure of neural network with symmetric spike-timing-dependent plasticity learning rule

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Hui; Song, Yongduan; Xue, Fangzheng

In this paper, the generation of multi-clustered structure of self-organized neural network with different neuronal firing patterns, i.e., bursting or spiking, has been investigated. The initially all-to-all-connected spiking neural network or bursting neural network can be self-organized into clustered structure through the symmetric spike-timing-dependent plasticity learning for both bursting and spiking neurons. However, the time consumption of this clustering procedure of the burst-based self-organized neural network (BSON) is much shorter than the spike-based self-organized neural network (SSON). Our results show that the BSON network has more obvious small-world properties, i.e., higher clustering coefficient and smaller shortest path length than themore » SSON network. Also, the results of larger structure entropy and activity entropy of the BSON network demonstrate that this network has higher topological complexity and dynamical diversity, which benefits for enhancing information transmission of neural circuits. Hence, we conclude that the burst firing can significantly enhance the efficiency of clustering procedure and the emergent clustered structure renders the whole network more synchronous and therefore more sensitive to weak input. This result is further confirmed from its improved performance on stochastic resonance. Therefore, we believe that the multi-clustered neural network which self-organized from the bursting dynamics has high efficiency in information processing.« less

Multi-layer neural networks for robot control

NASA Technical Reports Server (NTRS)

Pourboghrat, Farzad

1989-01-01

Two neural learning controller designs for manipulators are considered. The first design is based on a neural inverse-dynamics system. The second is the combination of the first one with a neural adaptive state feedback system. Both types of controllers enable the manipulator to perform any given task very well after a period of training and to do other untrained tasks satisfactorily. The second design also enables the manipulator to compensate for unpredictable perturbations.

Expectation and Surprise Determine Neural Population Responses in the Ventral Visual Stream

PubMed Central

Egner, Tobias; Monti, Jim M.; Summerfield, Christopher

2014-01-01

Visual cortex is traditionally viewed as a hierarchy of neural feature detectors, with neural population responses being driven by bottom-up stimulus features. Conversely, “predictive coding” models propose that each stage of the visual hierarchy harbors two computationally distinct classes of processing unit: representational units that encode the conditional probability of a stimulus and provide predictions to the next lower level; and error units that encode the mismatch between predictions and bottom-up evidence, and forward prediction error to the next higher level. Predictive coding therefore suggests that neural population responses in category-selective visual regions, like the fusiform face area (FFA), reflect a summation of activity related to prediction (“face expectation”) and prediction error (“face surprise”), rather than a homogenous feature detection response. We tested the rival hypotheses of the feature detection and predictive coding models by collecting functional magnetic resonance imaging data from the FFA while independently varying both stimulus features (faces vs houses) and subjects’ perceptual expectations regarding those features (low vs medium vs high face expectation). The effects of stimulus and expectation factors interacted, whereby FFA activity elicited by face and house stimuli was indistinguishable under high face expectation and maximally differentiated under low face expectation. Using computational modeling, we show that these data can be explained by predictive coding but not by feature detection models, even when the latter are augmented with attentional mechanisms. Thus, population responses in the ventral visual stream appear to be determined by feature expectation and surprise rather than by stimulus features per se. PMID:21147999

Multi-InDel Analysis for Ancestry Inference of Sub-Populations in China

PubMed Central

Sun, Kuan; Ye, Yi; Luo, Tao; Hou, Yiping

2016-01-01

Ancestry inference is of great interest in diverse areas of scientific researches, including the forensic biology, medical genetics and anthropology. Various methods have been published for distinguishing populations. However, few reports refer to sub-populations (like ethnic groups) within Asian populations for the limitation of markers. Several InDel loci located very tightly in physical positions were treated as one marker by us, which is multi-InDel. The multi-InDel shows potential as Ancestry Inference Marker (AIM). In this study, we performed a genome-wide scan for multi-InDels as AIM. After examining the FST distributions in the 1000 Genomes Database, 12 candidates were selected and validated for eastern Asian populations. A multiplexed assay was developed as a panel to genotype 12 multi-InDel markers simultaneously. Ancestry component analysis with STRUCTURE and principal component analysis (PCA) were employed to estimate its capability for ancestry inference. Furthermore, ancestry assignments of trial individuals were conducted. It proved to be very effective when 210 samples from Han and Tibetan individuals in China were tested. The panel consisting of multi-InDel markers exhibited considerable potency in ancestry inference, and was suggested to be applied in forensic practices and genetic population studies. PMID:28004788

A multi-scale convolutional neural network for phenotyping high-content cellular images.

PubMed

Godinez, William J; Hossain, Imtiaz; Lazic, Stanley E; Davies, John W; Zhang, Xian

2017-07-01

Identifying phenotypes based on high-content cellular images is challenging. Conventional image analysis pipelines for phenotype identification comprise multiple independent steps, with each step requiring method customization and adjustment of multiple parameters. Here, we present an approach based on a multi-scale convolutional neural network (M-CNN) that classifies, in a single cohesive step, cellular images into phenotypes by using directly and solely the images' pixel intensity values. The only parameters in the approach are the weights of the neural network, which are automatically optimized based on training images. The approach requires no a priori knowledge or manual customization, and is applicable to single- or multi-channel images displaying single or multiple cells. We evaluated the classification performance of the approach on eight diverse benchmark datasets. The approach yielded overall a higher classification accuracy compared with state-of-the-art results, including those of other deep CNN architectures. In addition to using the network to simply obtain a yes-or-no prediction for a given phenotype, we use the probability outputs calculated by the network to quantitatively describe the phenotypes. This study shows that these probability values correlate with chemical treatment concentrations. This finding validates further our approach and enables chemical treatment potency estimation via CNNs. The network specifications and solver definitions are provided in Supplementary Software 1. william_jose.godinez_navarro@novartis.com or xian-1.zhang@novartis.com. Supplementary data are available at Bioinformatics online. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com

FACS-based Isolation of Neural and Glioma Stem Cell Populations from Fresh Human Tissues Utilizing EGF Ligand

PubMed Central

Tome-Garcia, Jessica; Doetsch, Fiona; Tsankova, Nadejda M.

2018-01-01

Direct isolation of human neural and glioma stem cells from fresh tissues permits their biological study without prior culture and may capture novel aspects of their molecular phenotype in their native state. Recently, we demonstrated the ability to prospectively isolate stem cell populations from fresh human germinal matrix and glioblastoma samples, exploiting the ability of cells to bind the Epidermal Growth Factor (EGF) ligand in fluorescence-activated cell sorting (FACS). We demonstrated that FACS-isolated EGF-bound neural and glioblastoma populations encompass the sphere-forming colonies in vitro, and are capable of both self-renewal and multilineage differentiation. Here we describe in detail the purification methodology of EGF-bound (i.e., EGFR+) human neural and glioma cells with stem cell properties from fresh postmortem and surgical tissues. The ability to prospectively isolate stem cell populations using native ligand-binding ability opens new doors for understanding both normal and tumor cell biology in uncultured conditions, and is applicable for various downstream molecular sequencing studies at both population and single-cell resolution. PMID:29516026

Coherent population transfer in multi-level Allen-Eberly models

NASA Astrophysics Data System (ADS)

Li, Wei; Cen, Li-Xiang

2018-04-01

We investigate the solvability of multi-level extensions of the Allen-Eberly model and the population transfer yielded by the corresponding dynamical evolution. We demonstrate that, under a matching condition of the frequency, the driven two-level system and its multi-level extensions possess a stationary-state solution in a canonical representation associated with a unitary transformation. As a consequence, we show that the resulting protocol is able to realize complete population transfer in a nonadiabatic manner. Moreover, we explore the imperfect pulsing process with truncation and display that the nonadiabatic effect in the evolution can lead to suppression to the cutoff error of the protocol.

TopologyNet: Topology based deep convolutional and multi-task neural networks for biomolecular property predictions

PubMed Central

2017-01-01

Although deep learning approaches have had tremendous success in image, video and audio processing, computer vision, and speech recognition, their applications to three-dimensional (3D) biomolecular structural data sets have been hindered by the geometric and biological complexity. To address this problem we introduce the element-specific persistent homology (ESPH) method. ESPH represents 3D complex geometry by one-dimensional (1D) topological invariants and retains important biological information via a multichannel image-like representation. This representation reveals hidden structure-function relationships in biomolecules. We further integrate ESPH and deep convolutional neural networks to construct a multichannel topological neural network (TopologyNet) for the predictions of protein-ligand binding affinities and protein stability changes upon mutation. To overcome the deep learning limitations from small and noisy training sets, we propose a multi-task multichannel topological convolutional neural network (MM-TCNN). We demonstrate that TopologyNet outperforms the latest methods in the prediction of protein-ligand binding affinities, mutation induced globular protein folding free energy changes, and mutation induced membrane protein folding free energy changes. Availability: weilab.math.msu.edu/TDL/ PMID:28749969

Multi-population Genomic Relationships for Estimating Current Genetic Variances Within and Genetic Correlations Between Populations.

PubMed

Wientjes, Yvonne C J; Bijma, Piter; Vandenplas, Jérémie; Calus, Mario P L

2017-10-01

Different methods are available to calculate multi-population genomic relationship matrices. Since those matrices differ in base population, it is anticipated that the method used to calculate genomic relationships affects the estimate of genetic variances, covariances, and correlations. The aim of this article is to define the multi-population genomic relationship matrix to estimate current genetic variances within and genetic correlations between populations. The genomic relationship matrix containing two populations consists of four blocks, one block for population 1, one block for population 2, and two blocks for relationships between the populations. It is known, based on literature, that by using current allele frequencies to calculate genomic relationships within a population, current genetic variances are estimated. In this article, we theoretically derived the properties of the genomic relationship matrix to estimate genetic correlations between populations and validated it using simulations. When the scaling factor of across-population genomic relationships is equal to the product of the square roots of the scaling factors for within-population genomic relationships, the genetic correlation is estimated unbiasedly even though estimated genetic variances do not necessarily refer to the current population. When this property is not met, the correlation based on estimated variances should be multiplied by a correction factor based on the scaling factors. In this study, we present a genomic relationship matrix which directly estimates current genetic variances as well as genetic correlations between populations. Copyright © 2017 by the Genetics Society of America.

Lung nodule malignancy prediction using multi-task convolutional neural network

NASA Astrophysics Data System (ADS)

Li, Xiuli; Kao, Yueying; Shen, Wei; Li, Xiang; Xie, Guotong

2017-03-01

In this paper, we investigated the problem of diagnostic lung nodule malignancy prediction using thoracic Computed Tomography (CT) screening. Unlike most existing studies classify the nodules into two types benign and malignancy, we interpreted the nodule malignancy prediction as a regression problem to predict continuous malignancy level. We proposed a joint multi-task learning algorithm using Convolutional Neural Network (CNN) to capture nodule heterogeneity by extracting discriminative features from alternatingly stacked layers. We trained a CNN regression model to predict the nodule malignancy, and designed a multi-task learning mechanism to simultaneously share knowledge among 9 different nodule characteristics (Subtlety, Calcification, Sphericity, Margin, Lobulation, Spiculation, Texture, Diameter and Malignancy), and improved the final prediction result. Each CNN would generate characteristic-specific feature representations, and then we applied multi-task learning on the features to predict the corresponding likelihood for that characteristic. We evaluated the proposed method on 2620 nodules CT scans from LIDC-IDRI dataset with the 5-fold cross validation strategy. The multitask CNN regression result for regression RMSE and mapped classification ACC were 0.830 and 83.03%, while the results for single task regression RMSE 0.894 and mapped classification ACC 74.9%. Experiments show that the proposed method could predict the lung nodule malignancy likelihood effectively and outperforms the state-of-the-art methods. The learning framework could easily be applied in other anomaly likelihood prediction problem, such as skin cancer and breast cancer. It demonstrated the possibility of our method facilitating the radiologists for nodule staging assessment and individual therapeutic planning.

Convolutional Neural Network for Multi-Source Deep Learning Crop Classification in Ukraine

NASA Astrophysics Data System (ADS)

Lavreniuk, M. S.

2016-12-01

Land cover and crop type maps are one of the most essential inputs when dealing with environmental and agriculture monitoring tasks [1]. During long time neural network (NN) approach was one of the most efficient and popular approach for most applications, including crop classification using remote sensing data, with high an overall accuracy (OA) [2]. In the last years the most popular and efficient method for multi-sensor and multi-temporal land cover classification is convolution neural networks (CNNs). Taking into account presence clouds in optical data, self-organizing Kohonen maps (SOMs) are used to restore missing pixel values in a time series of optical imagery from Landsat-8 satellite. After missing data restoration, optical data from Landsat-8 was merged with Sentinel-1A radar data for better crop types discrimination [3]. An ensemble of CNNs is proposed for multi-temporal satellite images supervised classification. Each CNN in the corresponding ensemble is a 1-d CNN with 4 layers implemented using the Google's library TensorFlow. The efficiency of the proposed approach was tested on a time-series of Landsat-8 and Sentinel-1A images over the JECAM test site (Kyiv region) in Ukraine in 2015. Overall classification accuracy for ensemble of CNNs was 93.5% that outperformed an ensemble of multi-layer perceptrons (MLPs) by +0.8% and allowed us to better discriminate summer crops, in particular maize and soybeans. For 2016 we would like to validate this method using Sentinel-1 and Sentinel-2 data for Ukraine territory within ESA project on country level demonstration Sen2Agri. 1. A. Kolotii et al., "Comparison of biophysical and satellite predictors for wheat yield forecasting in Ukraine," The Int. Arch. of Photogram., Rem. Sens. and Spatial Inform. Scie., vol. 40, no. 7, pp. 39-44, 2015. 2. F. Waldner et al., "Towards a set of agrosystem-specific cropland mapping methods to address the global cropland diversity," Int. Journal of Rem. Sens. vol. 37, no. 14, pp

Maternal vitamin B12 status and risk of neural tube defects in a population with high neural tube defect prevalence and no folic Acid fortification.

PubMed

Molloy, Anne M; Kirke, Peadar N; Troendle, James F; Burke, Helen; Sutton, Marie; Brody, Lawrence C; Scott, John M; Mills, James L

2009-03-01

Folic acid fortification has reduced neural tube defect prevalence by 50% to 70%. It is unlikely that fortification levels will be increased to reduce neural tube defect prevalence further. Therefore, it is important to identify other modifiable risk factors. Vitamin B(12) is metabolically related to folate; moreover, previous studies have found low B(12) status in mothers of children affected by neural tube defect. Our objective was to quantify the effect of low B(12) status on neural tube defect risk in a high-prevalence, unfortified population. We assessed pregnancy vitamin B(12) status concentrations in blood samples taken at an average of 15 weeks' gestation from 3 independent nested case-control groups of Irish women within population-based cohorts, at a time when vitamin supplementation or food fortification was rare. Group 1 blood samples were from 95 women during a neural tube defect-affected pregnancy and 265 control subjects. Group 2 included blood samples from 107 women who had a previous neural tube defect birth but whose current pregnancy was not affected and 414 control subjects. Group 3 samples were from 76 women during an affected pregnancy and 222 control subjects. Mothers of children affected by neural tube defect had significantly lower B(12) status. In all 3 groups those in the lowest B(12) quartiles, compared with the highest, had between two and threefold higher adjusted odds ratios for being the mother of a child affected by neural tube defect. Pregnancy blood B(12) concentrations of <250 ng/L were associated with the highest risks. Deficient or inadequate maternal vitamin B(12) status is associated with a significantly increased risk for neural tube defects. We suggest that women have vitamin B(12) levels of >300 ng/L (221 pmol/L) before becoming pregnant. Improving B(12) status beyond this level may afford a further reduction in risk, but this is uncertain.

SNAVA-A real-time multi-FPGA multi-model spiking neural network simulation architecture.

PubMed

Sripad, Athul; Sanchez, Giovanny; Zapata, Mireya; Pirrone, Vito; Dorta, Taho; Cambria, Salvatore; Marti, Albert; Krishnamourthy, Karthikeyan; Madrenas, Jordi

2018-01-01

Spiking Neural Networks (SNN) for Versatile Applications (SNAVA) simulation platform is a scalable and programmable parallel architecture that supports real-time, large-scale, multi-model SNN computation. This parallel architecture is implemented in modern Field-Programmable Gate Arrays (FPGAs) devices to provide high performance execution and flexibility to support large-scale SNN models. Flexibility is defined in terms of programmability, which allows easy synapse and neuron implementation. This has been achieved by using a special-purpose Processing Elements (PEs) for computing SNNs, and analyzing and customizing the instruction set according to the processing needs to achieve maximum performance with minimum resources. The parallel architecture is interfaced with customized Graphical User Interfaces (GUIs) to configure the SNN's connectivity, to compile the neuron-synapse model and to monitor SNN's activity. Our contribution intends to provide a tool that allows to prototype SNNs faster than on CPU/GPU architectures but significantly cheaper than fabricating a customized neuromorphic chip. This could be potentially valuable to the computational neuroscience and neuromorphic engineering communities. Copyright © 2017 Elsevier Ltd. All rights reserved.

Live Imaging Followed by Single Cell Tracking to Monitor Cell Biology and the Lineage Progression of Multiple Neural Populations.

PubMed

Gómez-Villafuertes, Rosa; Paniagua-Herranz, Lucía; Gascon, Sergio; de Agustín-Durán, David; Ferreras, María de la O; Gil-Redondo, Juan Carlos; Queipo, María José; Menendez-Mendez, Aida; Pérez-Sen, Ráquel; Delicado, Esmerilda G; Gualix, Javier; Costa, Marcos R; Schroeder, Timm; Miras-Portugal, María Teresa; Ortega, Felipe

2017-12-16

Understanding the mechanisms that control critical biological events of neural cell populations, such as proliferation, differentiation, or cell fate decisions, will be crucial to design therapeutic strategies for many diseases affecting the nervous system. Current methods to track cell populations rely on their final outcomes in still images and they generally fail to provide sufficient temporal resolution to identify behavioral features in single cells. Moreover, variations in cell death, behavioral heterogeneity within a cell population, dilution, spreading, or the low efficiency of the markers used to analyze cells are all important handicaps that will lead to incomplete or incorrect read-outs of the results. Conversely, performing live imaging and single cell tracking under appropriate conditions represents a powerful tool to monitor each of these events. Here, a time-lapse video-microscopy protocol, followed by post-processing, is described to track neural populations with single cell resolution, employing specific software. The methods described enable researchers to address essential questions regarding the cell biology and lineage progression of distinct neural populations.

Evolvable Neural Software System

NASA Technical Reports Server (NTRS)

Curtis, Steven A.

2009-01-01

The Evolvable Neural Software System (ENSS) is composed of sets of Neural Basis Functions (NBFs), which can be totally autonomously created and removed according to the changing needs and requirements of the software system. The resulting structure is both hierarchical and self-similar in that a given set of NBFs may have a ruler NBF, which in turn communicates with other sets of NBFs. These sets of NBFs may function as nodes to a ruler node, which are also NBF constructs. In this manner, the synthetic neural system can exhibit the complexity, three-dimensional connectivity, and adaptability of biological neural systems. An added advantage of ENSS over a natural neural system is its ability to modify its core genetic code in response to environmental changes as reflected in needs and requirements. The neural system is fully adaptive and evolvable and is trainable before release. It continues to rewire itself while on the job. The NBF is a unique, bilevel intelligence neural system composed of a higher-level heuristic neural system (HNS) and a lower-level, autonomic neural system (ANS). Taken together, the HNS and the ANS give each NBF the complete capabilities of a biological neural system to match sensory inputs to actions. Another feature of the NBF is the Evolvable Neural Interface (ENI), which links the HNS and ANS. The ENI solves the interface problem between these two systems by actively adapting and evolving from a primitive initial state (a Neural Thread) to a complicated, operational ENI and successfully adapting to a training sequence of sensory input. This simulates the adaptation of a biological neural system in a developmental phase. Within the greater multi-NBF and multi-node ENSS, self-similar ENI s provide the basis for inter-NBF and inter-node connectivity.

Shades of grey; Assessing the contribution of the magno- and parvocellular systems to neural processing of the retinal input in the human visual system from the influence of neural population size and its discharge activity on the VEP.

PubMed

Marcar, Valentine L; Baselgia, Silvana; Lüthi-Eisenegger, Barbara; Jäncke, Lutz

2018-03-01

Retinal input processing in the human visual system involves a phasic and tonic neural response. We investigated the role of the magno- and parvocellular systems by comparing the influence of the active neural population size and its discharge activity on the amplitude and latency of four VEP components. We recorded the scalp electric potential of 20 human volunteers viewing a series of dartboard images presented as a pattern reversing and pattern on-/offset stimulus. These patterns were designed to vary both neural population size coding the temporal- and spatial luminance contrast property and the discharge activity of the population involved in a systematic manner. When the VEP amplitude reflected the size of the neural population coding the temporal luminance contrast property of the image, the influence of luminance contrast followed the contrast response function of the parvocellular system. When the VEP amplitude reflected the size of the neural population responding to the spatial luminance contrast property the image, the influence of luminance contrast followed the contrast response function of the magnocellular system. The latencies of the VEP components examined exhibited the same behavior across our stimulus series. This investigation demonstrates the complex interplay of the magno- and parvocellular systems on the neural response as captured by the VEP. It also demonstrates a linear relationship between stimulus property, neural response, and the VEP and reveals the importance of feedback projections in modulating the ongoing neural response. In doing so, it corroborates the conclusions of our previous study.

Deep convolutional neural network training enrichment using multi-view object-based analysis of Unmanned Aerial systems imagery for wetlands classification

NASA Astrophysics Data System (ADS)

Liu, Tao; Abd-Elrahman, Amr

2018-05-01

Deep convolutional neural network (DCNN) requires massive training datasets to trigger its image classification power, while collecting training samples for remote sensing application is usually an expensive process. When DCNN is simply implemented with traditional object-based image analysis (OBIA) for classification of Unmanned Aerial systems (UAS) orthoimage, its power may be undermined if the number training samples is relatively small. This research aims to develop a novel OBIA classification approach that can take advantage of DCNN by enriching the training dataset automatically using multi-view data. Specifically, this study introduces a Multi-View Object-based classification using Deep convolutional neural network (MODe) method to process UAS images for land cover classification. MODe conducts the classification on multi-view UAS images instead of directly on the orthoimage, and gets the final results via a voting procedure. 10-fold cross validation results show the mean overall classification accuracy increasing substantially from 65.32%, when DCNN was applied on the orthoimage to 82.08% achieved when MODe was implemented. This study also compared the performances of the support vector machine (SVM) and random forest (RF) classifiers with DCNN under traditional OBIA and the proposed multi-view OBIA frameworks. The results indicate that the advantage of DCNN over traditional classifiers in terms of accuracy is more obvious when these classifiers were applied with the proposed multi-view OBIA framework than when these classifiers were applied within the traditional OBIA framework.

Population equations for degree-heterogenous neural networks

NASA Astrophysics Data System (ADS)

Kähne, M.; Sokolov, I. M.; Rüdiger, S.

2017-11-01

We develop a statistical framework for studying recurrent networks with broad distributions of the number of synaptic links per neuron. We treat each group of neurons with equal input degree as one population and derive a system of equations determining the population-averaged firing rates. The derivation rests on an assumption of a large number of neurons and, additionally, an assumption of a large number of synapses per neuron. For the case of binary neurons, analytical solutions can be constructed, which correspond to steps in the activity versus degree space. We apply this theory to networks with degree-correlated topology and show that complex, multi-stable regimes can result for increasing correlations. Our work is motivated by the recent finding of subnetworks of highly active neurons and the fact that these neurons tend to be connected to each other with higher probability.

Detecting a hierarchical genetic population structure via Multi-InDel markers on the X chromosome

PubMed Central

Fan, Guang Yao; Ye, Yi; Hou, Yi Ping

2016-01-01

Detecting population structure and estimating individual biogeographical ancestry are very important in population genetics studies, biomedical research and forensics. Single-nucleotide polymorphism (SNP) has long been considered to be a primary ancestry-informative marker (AIM), but it is constrained by complex and time-consuming genotyping protocols. Following up on our previous study, we propose that a multi-insertion-deletion polymorphism (Multi-InDel) with multiple haplotypes can be useful in ancestry inference and hierarchical genetic population structures. A validation study for the X chromosome Multi-InDel marker (X-Multi-InDel) as a novel AIM was conducted. Genetic polymorphisms and genetic distances among three Chinese populations and 14 worldwide populations obtained from the 1000 Genomes database were analyzed. A Bayesian clustering method (STRUCTURE) was used to discern the continental origins of Europe, East Asia, and Africa. A minimal panel of ten X-Multi-InDels was verified to be sufficient to distinguish human ancestries from three major continental regions with nearly the same efficiency of the earlier panel with 21 insertion-deletion AIMs. Along with the development of more X-Multi-InDels, an approach using this novel marker has the potential for broad applicability as a cost-effective tool toward more accurate determinations of individual biogeographical ancestry and population stratification. PMID:27535707

Neural Networks

NASA Astrophysics Data System (ADS)

Schwindling, Jerome

2010-04-01

This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p.) corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.

Super-pixel extraction based on multi-channel pulse coupled neural network

NASA Astrophysics Data System (ADS)

Xu, GuangZhu; Hu, Song; Zhang, Liu; Zhao, JingJing; Fu, YunXia; Lei, BangJun

2018-04-01

Super-pixel extraction techniques group pixels to form over-segmented image blocks according to the similarity among pixels. Compared with the traditional pixel-based methods, the image descripting method based on super-pixel has advantages of less calculation, being easy to perceive, and has been widely used in image processing and computer vision applications. Pulse coupled neural network (PCNN) is a biologically inspired model, which stems from the phenomenon of synchronous pulse release in the visual cortex of cats. Each PCNN neuron can correspond to a pixel of an input image, and the dynamic firing pattern of each neuron contains both the pixel feature information and its context spatial structural information. In this paper, a new color super-pixel extraction algorithm based on multi-channel pulse coupled neural network (MPCNN) was proposed. The algorithm adopted the block dividing idea of SLIC algorithm, and the image was divided into blocks with same size first. Then, for each image block, the adjacent pixels of each seed with similar color were classified as a group, named a super-pixel. At last, post-processing was adopted for those pixels or pixel blocks which had not been grouped. Experiments show that the proposed method can adjust the number of superpixel and segmentation precision by setting parameters, and has good potential for super-pixel extraction.

Degraded attentional modulation of cortical neural populations in strabismic amblyopia

PubMed Central

Hou, Chuan; Kim, Yee-Joon; Lai, Xin Jie; Verghese, Preeti

2016-01-01

Behavioral studies have reported reduced spatial attention in amblyopia, a developmental disorder of spatial vision. However, the neural populations in the visual cortex linked with these behavioral spatial attention deficits have not been identified. Here, we use functional MRI–informed electroencephalography source imaging to measure the effect of attention on neural population activity in the visual cortex of human adult strabismic amblyopes who were stereoblind. We show that compared with controls, the modulatory effects of selective visual attention on the input from the amblyopic eye are substantially reduced in the primary visual cortex (V1) as well as in extrastriate visual areas hV4 and hMT+. Degraded attentional modulation is also found in the normal-acuity fellow eye in areas hV4 and hMT+ but not in V1. These results provide electrophysiological evidence that abnormal binocular input during a developmental critical period may impact cortical connections between the visual cortex and higher level cortices beyond the known amblyopic losses in V1 and V2, suggesting that a deficit of attentional modulation in the visual cortex is an important component of the functional impairment in amblyopia. Furthermore, we find that degraded attentional modulation in V1 is correlated with the magnitude of interocular suppression and the depth of amblyopia. These results support the view that the visual suppression often seen in strabismic amblyopia might be a form of attentional neglect of the visual input to the amblyopic eye. PMID:26885628

Degraded attentional modulation of cortical neural populations in strabismic amblyopia.

PubMed

Hou, Chuan; Kim, Yee-Joon; Lai, Xin Jie; Verghese, Preeti

2016-01-01

Behavioral studies have reported reduced spatial attention in amblyopia, a developmental disorder of spatial vision. However, the neural populations in the visual cortex linked with these behavioral spatial attention deficits have not been identified. Here, we use functional MRI-informed electroencephalography source imaging to measure the effect of attention on neural population activity in the visual cortex of human adult strabismic amblyopes who were stereoblind. We show that compared with controls, the modulatory effects of selective visual attention on the input from the amblyopic eye are substantially reduced in the primary visual cortex (V1) as well as in extrastriate visual areas hV4 and hMT+. Degraded attentional modulation is also found in the normal-acuity fellow eye in areas hV4 and hMT+ but not in V1. These results provide electrophysiological evidence that abnormal binocular input during a developmental critical period may impact cortical connections between the visual cortex and higher level cortices beyond the known amblyopic losses in V1 and V2, suggesting that a deficit of attentional modulation in the visual cortex is an important component of the functional impairment in amblyopia. Furthermore, we find that degraded attentional modulation in V1 is correlated with the magnitude of interocular suppression and the depth of amblyopia. These results support the view that the visual suppression often seen in strabismic amblyopia might be a form of attentional neglect of the visual input to the amblyopic eye.

Revealing unobserved factors underlying cortical activity with a rectified latent variable model applied to neural population recordings.

PubMed

Whiteway, Matthew R; Butts, Daniel A

2017-03-01

The activity of sensory cortical neurons is not only driven by external stimuli but also shaped by other sources of input to the cortex. Unlike external stimuli, these other sources of input are challenging to experimentally control, or even observe, and as a result contribute to variability of neural responses to sensory stimuli. However, such sources of input are likely not "noise" and may play an integral role in sensory cortex function. Here we introduce the rectified latent variable model (RLVM) in order to identify these sources of input using simultaneously recorded cortical neuron populations. The RLVM is novel in that it employs nonnegative (rectified) latent variables and is much less restrictive in the mathematical constraints on solutions because of the use of an autoencoder neural network to initialize model parameters. We show that the RLVM outperforms principal component analysis, factor analysis, and independent component analysis, using simulated data across a range of conditions. We then apply this model to two-photon imaging of hundreds of simultaneously recorded neurons in mouse primary somatosensory cortex during a tactile discrimination task. Across many experiments, the RLVM identifies latent variables related to both the tactile stimulation as well as nonstimulus aspects of the behavioral task, with a majority of activity explained by the latter. These results suggest that properly identifying such latent variables is necessary for a full understanding of sensory cortical function and demonstrate novel methods for leveraging large population recordings to this end. NEW & NOTEWORTHY The rapid development of neural recording technologies presents new opportunities for understanding patterns of activity across neural populations. Here we show how a latent variable model with appropriate nonlinear form can be used to identify sources of input to a neural population and infer their time courses. Furthermore, we demonstrate how these sources are

Locally optimal extracellular stimulation for chaotic desynchronization of neural populations.

PubMed

Wilson, Dan; Moehlis, Jeff

2014-10-01

We use optimal control theory to design a methodology to find locally optimal stimuli for desynchronization of a model of neurons with extracellular stimulation. This methodology yields stimuli which lead to positive Lyapunov exponents, and hence desynchronizes a neural population. We analyze this methodology in the presence of interneuron coupling to make predictions about the strength of stimulation required to overcome synchronizing effects of coupling. This methodology suggests a powerful alternative to pulsatile stimuli for deep brain stimulation as it uses less energy than pulsatile stimuli, and could eliminate the time consuming tuning process.

Predicting non-melanoma skin cancer via a multi-parameterized artificial neural network.

PubMed

Roffman, David; Hart, Gregory; Girardi, Michael; Ko, Christine J; Deng, Jun

2018-01-26

Ultraviolet radiation (UVR) exposure and family history are major associated risk factors for the development of non-melanoma skin cancer (NMSC). The objective of this study was to develop and validate a multi-parameterized artificial neural network based on available personal health information for early detection of NMSC with high sensitivity and specificity, even in the absence of known UVR exposure and family history. The 1997-2015 NHIS adult survey data used to train and validate our neural network (NN) comprised of 2,056 NMSC and 460,574 non-cancer cases. We extracted 13 parameters for our NN: gender, age, BMI, diabetic status, smoking status, emphysema, asthma, race, Hispanic ethnicity, hypertension, heart diseases, vigorous exercise habits, and history of stroke. This study yielded an area under the ROC curve of 0.81 and 0.81 for training and validation, respectively. Our results (training sensitivity 88.5% and specificity 62.2%, validation sensitivity 86.2% and specificity 62.7%) were comparable to a previous study of basal and squamous cell carcinoma prediction that also included UVR exposure and family history information. These results indicate that our NN is robust enough to make predictions, suggesting that we have identified novel associations and potential predictive parameters of NMSC.

Visual pathways from the perspective of cost functions and multi-task deep neural networks.

PubMed

Scholte, H Steven; Losch, Max M; Ramakrishnan, Kandan; de Haan, Edward H F; Bohte, Sander M

2018-01-01

Vision research has been shaped by the seminal insight that we can understand the higher-tier visual cortex from the perspective of multiple functional pathways with different goals. In this paper, we try to give a computational account of the functional organization of this system by reasoning from the perspective of multi-task deep neural networks. Machine learning has shown that tasks become easier to solve when they are decomposed into subtasks with their own cost function. We hypothesize that the visual system optimizes multiple cost functions of unrelated tasks and this causes the emergence of a ventral pathway dedicated to vision for perception, and a dorsal pathway dedicated to vision for action. To evaluate the functional organization in multi-task deep neural networks, we propose a method that measures the contribution of a unit towards each task, applying it to two networks that have been trained on either two related or two unrelated tasks, using an identical stimulus set. Results show that the network trained on the unrelated tasks shows a decreasing degree of feature representation sharing towards higher-tier layers while the network trained on related tasks uniformly shows high degree of sharing. We conjecture that the method we propose can be used to analyze the anatomical and functional organization of the visual system and beyond. We predict that the degree to which tasks are related is a good descriptor of the degree to which they share downstream cortical-units. Copyright © 2017 Elsevier Ltd. All rights reserved.

Real-time simulation of large-scale neural architectures for visual features computation based on GPU.

PubMed

Chessa, Manuela; Bianchi, Valentina; Zampetti, Massimo; Sabatini, Silvio P; Solari, Fabio

2012-01-01

The intrinsic parallelism of visual neural architectures based on distributed hierarchical layers is well suited to be implemented on the multi-core architectures of modern graphics cards. The design strategies that allow us to optimally take advantage of such parallelism, in order to efficiently map on GPU the hierarchy of layers and the canonical neural computations, are proposed. Specifically, the advantages of a cortical map-like representation of the data are exploited. Moreover, a GPU implementation of a novel neural architecture for the computation of binocular disparity from stereo image pairs, based on populations of binocular energy neurons, is presented. The implemented neural model achieves good performances in terms of reliability of the disparity estimates and a near real-time execution speed, thus demonstrating the effectiveness of the devised design strategies. The proposed approach is valid in general, since the neural building blocks we implemented are a common basis for the modeling of visual neural functionalities.

Neural population encoding and decoding of sound source location across sound level in the rabbit inferior colliculus

PubMed Central

Delgutte, Bertrand

2015-01-01

At lower levels of sensory processing, the representation of a stimulus feature in the response of a neural population can vary in complex ways across different stimulus intensities, potentially changing the amount of feature-relevant information in the response. How higher-level neural circuits could implement feature decoding computations that compensate for these intensity-dependent variations remains unclear. Here we focused on neurons in the inferior colliculus (IC) of unanesthetized rabbits, whose firing rates are sensitive to both the azimuthal position of a sound source and its sound level. We found that the azimuth tuning curves of an IC neuron at different sound levels tend to be linear transformations of each other. These transformations could either increase or decrease the mutual information between source azimuth and spike count with increasing level for individual neurons, yet population azimuthal information remained constant across the absolute sound levels tested (35, 50, and 65 dB SPL), as inferred from the performance of a maximum-likelihood neural population decoder. We harnessed evidence of level-dependent linear transformations to reduce the number of free parameters in the creation of an accurate cross-level population decoder of azimuth. Interestingly, this decoder predicts monotonic azimuth tuning curves, broadly sensitive to contralateral azimuths, in neurons at higher levels in the auditory pathway. PMID:26490292

Microfluidic neurite guidance to study structure-function relationships in topologically-complex population-based neural networks.

PubMed

Honegger, Thibault; Thielen, Moritz I; Feizi, Soheil; Sanjana, Neville E; Voldman, Joel

2016-06-22

The central nervous system is a dense, layered, 3D interconnected network of populations of neurons, and thus recapitulating that complexity for in vitro CNS models requires methods that can create defined topologically-complex neuronal networks. Several three-dimensional patterning approaches have been developed but none have demonstrated the ability to control the connections between populations of neurons. Here we report a method using AC electrokinetic forces that can guide, accelerate, slow down and push up neurites in un-modified collagen scaffolds. We present a means to create in vitro neural networks of arbitrary complexity by using such forces to create 3D intersections of primary neuronal populations that are plated in a 2D plane. We report for the first time in vitro basic brain motifs that have been previously observed in vivo and show that their functional network is highly decorrelated to their structure. This platform can provide building blocks to reproduce in vitro the complexity of neural circuits and provide a minimalistic environment to study the structure-function relationship of the brain circuitry.

Microfluidic neurite guidance to study structure-function relationships in topologically-complex population-based neural networks

NASA Astrophysics Data System (ADS)

Honegger, Thibault; Thielen, Moritz I.; Feizi, Soheil; Sanjana, Neville E.; Voldman, Joel

2016-06-01

The central nervous system is a dense, layered, 3D interconnected network of populations of neurons, and thus recapitulating that complexity for in vitro CNS models requires methods that can create defined topologically-complex neuronal networks. Several three-dimensional patterning approaches have been developed but none have demonstrated the ability to control the connections between populations of neurons. Here we report a method using AC electrokinetic forces that can guide, accelerate, slow down and push up neurites in un-modified collagen scaffolds. We present a means to create in vitro neural networks of arbitrary complexity by using such forces to create 3D intersections of primary neuronal populations that are plated in a 2D plane. We report for the first time in vitro basic brain motifs that have been previously observed in vivo and show that their functional network is highly decorrelated to their structure. This platform can provide building blocks to reproduce in vitro the complexity of neural circuits and provide a minimalistic environment to study the structure-function relationship of the brain circuitry.

Estimation of effective connectivity using multi-layer perceptron artificial neural network.

PubMed

Talebi, Nasibeh; Nasrabadi, Ali Motie; Mohammad-Rezazadeh, Iman

2018-02-01

Studies on interactions between brain regions estimate effective connectivity, (usually) based on the causality inferences made on the basis of temporal precedence. In this study, the causal relationship is modeled by a multi-layer perceptron feed-forward artificial neural network, because of the ANN's ability to generate appropriate input-output mapping and to learn from training examples without the need of detailed knowledge of the underlying system. At any time instant, the past samples of data are placed in the network input, and the subsequent values are predicted at its output. To estimate the strength of interactions, the measure of " Causality coefficient " is defined based on the network structure, the connecting weights and the parameters of hidden layer activation function. Simulation analysis demonstrates that the method, called "CREANN" (Causal Relationship Estimation by Artificial Neural Network), can estimate time-invariant and time-varying effective connectivity in terms of MVAR coefficients. The method shows robustness with respect to noise level of data. Furthermore, the estimations are not significantly influenced by the model order (considered time-lag), and the different initial conditions (initial random weights and parameters of the network). CREANN is also applied to EEG data collected during a memory recognition task. The results implicate that it can show changes in the information flow between brain regions, involving in the episodic memory retrieval process. These convincing results emphasize that CREANN can be used as an appropriate method to estimate the causal relationship among brain signals.

Enrichment of skin-derived neural precursor cells from dermal cell populations by altering culture conditions.

PubMed

Bayati, Vahid; Gazor, Rohoullah; Nejatbakhsh, Reza; Negad Dehbashi, Fereshteh

2016-01-01

As stem cells play a critical role in tissue repair, their manipulation for being applied in regenerative medicine is of great importance. Skin-derived precursors (SKPs) may be good candidates for use in cell-based therapy as the only neural stem cells which can be isolated from an accessible tissue, skin. Herein, we presented a simple protocol to enrich neural SKPs by monolayer adherent cultivation to prove the efficacy of this method. To enrich neural SKPs from dermal cell populations, we have found that a monolayer adherent cultivation helps to increase the numbers of neural precursor cells. Indeed, we have cultured dermal cells as monolayer under serum-supplemented (control) and serum-supplemented culture, followed by serum free cultivation (test) and compared. Finally, protein markers of SKPs were assessed and compared in both experimental groups and differentiation potential was evaluated in enriched culture. The cells of enriched culture concurrently expressed fibronectin, vimentin and nestin, an intermediate filament protein expressed in neural and skeletal muscle precursors as compared to control culture. In addition, they possessed a multipotential capacity to differentiate into neurogenic, glial, adipogenic, osteogenic and skeletal myogenic cell lineages. It was concluded that serum-free adherent culture reinforced by growth factors have been shown to be effective on proliferation of skin-derived neural precursor cells (skin-NPCs) and drive their selective and rapid expansion.

Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses

NASA Astrophysics Data System (ADS)

Serb, Alexander; Bill, Johannes; Khiat, Ali; Berdan, Radu; Legenstein, Robert; Prodromakis, Themis

2016-09-01

In an increasingly data-rich world the need for developing computing systems that cannot only process, but ideally also interpret big data is becoming continuously more pressing. Brain-inspired concepts have shown great promise towards addressing this need. Here we demonstrate unsupervised learning in a probabilistic neural network that utilizes metal-oxide memristive devices as multi-state synapses. Our approach can be exploited for processing unlabelled data and can adapt to time-varying clusters that underlie incoming data by supporting the capability of reversible unsupervised learning. The potential of this work is showcased through the demonstration of successful learning in the presence of corrupted input data and probabilistic neurons, thus paving the way towards robust big-data processors.

Construction of multi-agent mobile robots control system in the problem of persecution with using a modified reinforcement learning method based on neural networks

NASA Astrophysics Data System (ADS)

Patkin, M. L.; Rogachev, G. N.

2018-02-01

A method for constructing a multi-agent control system for mobile robots based on training with reinforcement using deep neural networks is considered. Synthesis of the management system is proposed to be carried out with reinforcement training and the modified Actor-Critic method, in which the Actor module is divided into Action Actor and Communication Actor in order to simultaneously manage mobile robots and communicate with partners. Communication is carried out by sending partners at each step a vector of real numbers that are added to the observation vector and affect the behaviour. Functions of Actors and Critic are approximated by deep neural networks. The Critics value function is trained by using the TD-error method and the Actor’s function by using DDPG. The Communication Actor’s neural network is trained through gradients received from partner agents. An environment in which a cooperative multi-agent interaction is present was developed, computer simulation of the application of this method in the control problem of two robots pursuing two goals was carried out.

Enabling Low-Power, Multi-Modal Neural Interfaces Through a Common, Low-Bandwidth Feature Space.

PubMed

Irwin, Zachary T; Thompson, David E; Schroeder, Karen E; Tat, Derek M; Hassani, Ali; Bullard, Autumn J; Woo, Shoshana L; Urbanchek, Melanie G; Sachs, Adam J; Cederna, Paul S; Stacey, William C; Patil, Parag G; Chestek, Cynthia A

2016-05-01

Brain-Machine Interfaces (BMIs) have shown great potential for generating prosthetic control signals. Translating BMIs into the clinic requires fully implantable, wireless systems; however, current solutions have high power requirements which limit their usability. Lowering this power consumption typically limits the system to a single neural modality, or signal type, and thus to a relatively small clinical market. Here, we address both of these issues by investigating the use of signal power in a single narrow frequency band as a decoding feature for extracting information from electrocorticographic (ECoG), electromyographic (EMG), and intracortical neural data. We have designed and tested the Multi-modal Implantable Neural Interface (MINI), a wireless recording system which extracts and transmits signal power in a single, configurable frequency band. In prerecorded datasets, we used the MINI to explore low frequency signal features and any resulting tradeoff between power savings and decoding performance losses. When processing intracortical data, the MINI achieved a power consumption 89.7% less than a more typical system designed to extract action potential waveforms. When processing ECoG and EMG data, the MINI achieved similar power reductions of 62.7% and 78.8%. At the same time, using the single signal feature extracted by the MINI, we were able to decode all three modalities with less than a 9% drop in accuracy relative to using high-bandwidth, modality-specific signal features. We believe this system architecture can be used to produce a viable, cost-effective, clinical BMI.

Single-site neural tube closure in human embryos revisited.

PubMed

de Bakker, Bernadette S; Driessen, Stan; Boukens, Bastiaan J D; van den Hoff, Maurice J B; Oostra, Roelof-Jan

2017-10-01

Since the multi-site closure theory was first proposed in 1991 as explanation for the preferential localizations of neural tube defects, the closure of the neural tube has been debated. Although the multi-site closure theory is much cited in clinical literature, single-site closure is most apparent in literature concerning embryology. Inspired by Victor Hamburgers (1900-2001) statement that "our real teacher has been and still is the embryo, who is, incidentally, the only teacher who is always right", we decided to critically review both theories of neural tube closure. To verify the theories of closure, we studied serial histological sections of 10 mouse embryos between 8.5 and 9.5 days of gestation and 18 human embryos of the Carnegie collection between Carnegie stage 9 (19-21 days) and 13 (28-32 days). Neural tube closure was histologically defined by the neuroepithelial remodeling of the two adjoining neural fold tips in the midline. We did not observe multiple fusion sites in neither mouse nor human embryos. A meta-analysis of case reports on neural tube defects showed that defects can occur at any level of the neural axis. Our data indicate that the human neural tube fuses at a single site and, therefore, we propose to reinstate the single-site closure theory for neural tube closure. We showed that neural tube defects are not restricted to a specific location, thereby refuting the reasoning underlying the multi-site closure theory. Clin. Anat. 30:988-999, 2017. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

The Effect of Inhibitory Neuron on the Evolution Model of Higher-Order Coupling Neural Oscillator Population

PubMed Central

Qi, Yi; Wang, Rubin; Jiao, Xianfa; Du, Ying

2014-01-01

We proposed a higher-order coupling neural network model including the inhibitory neurons and examined the dynamical evolution of average number density and phase-neural coding under the spontaneous activity and external stimulating condition. The results indicated that increase of inhibitory coupling strength will cause decrease of average number density, whereas increase of excitatory coupling strength will cause increase of stable amplitude of average number density. Whether the neural oscillator population is able to enter the new synchronous oscillation or not is determined by excitatory and inhibitory coupling strength. In the presence of external stimulation, the evolution of the average number density is dependent upon the external stimulation and the coupling term in which the dominator will determine the final evolution. PMID:24516505

Independent components of neural activity carry information on individual populations.

PubMed

Głąbska, Helena; Potworowski, Jan; Łęski, Szymon; Wójcik, Daniel K

2014-01-01

Local field potential (LFP), the low-frequency part of the potential recorded extracellularly in the brain, reflects neural activity at the population level. The interpretation of LFP is complicated because it can mix activity from remote cells, on the order of millimeters from the electrode. To understand better the relation between the recordings and the local activity of cells we used a large-scale network thalamocortical model to compute simultaneous LFP, transmembrane currents, and spiking activity. We used this model to study the information contained in independent components obtained from the reconstructed Current Source Density (CSD), which smooths transmembrane currents, decomposed further with Independent Component Analysis (ICA). We found that the three most robust components matched well the activity of two dominating cell populations: superior pyramidal cells in layer 2/3 (rhythmic spiking) and tufted pyramids from layer 5 (intrinsically bursting). The pyramidal population from layer 2/3 could not be well described as a product of spatial profile and temporal activation, but by a sum of two such products which we recovered in two of the ICA components in our analysis, which correspond to the two first principal components of PCA decomposition of layer 2/3 population activity. At low noise one more cell population could be discerned but it is unlikely that it could be recovered in experiment given typical noise ranges.

Independent Components of Neural Activity Carry Information on Individual Populations

PubMed Central

Głąbska, Helena; Potworowski, Jan; Łęski, Szymon; Wójcik, Daniel K.

2014-01-01

Local field potential (LFP), the low-frequency part of the potential recorded extracellularly in the brain, reflects neural activity at the population level. The interpretation of LFP is complicated because it can mix activity from remote cells, on the order of millimeters from the electrode. To understand better the relation between the recordings and the local activity of cells we used a large-scale network thalamocortical model to compute simultaneous LFP, transmembrane currents, and spiking activity. We used this model to study the information contained in independent components obtained from the reconstructed Current Source Density (CSD), which smooths transmembrane currents, decomposed further with Independent Component Analysis (ICA). We found that the three most robust components matched well the activity of two dominating cell populations: superior pyramidal cells in layer 2/3 (rhythmic spiking) and tufted pyramids from layer 5 (intrinsically bursting). The pyramidal population from layer 2/3 could not be well described as a product of spatial profile and temporal activation, but by a sum of two such products which we recovered in two of the ICA components in our analysis, which correspond to the two first principal components of PCA decomposition of layer 2/3 population activity. At low noise one more cell population could be discerned but it is unlikely that it could be recovered in experiment given typical noise ranges. PMID:25153730

Optical Neural Interfaces

PubMed Central

Warden, Melissa R.; Cardin, Jessica A.; Deisseroth, Karl

2014-01-01

Genetically encoded optical actuators and indicators have changed the landscape of neuroscience, enabling targetable control and readout of specific components of intact neural circuits in behaving animals. Here, we review the development of optical neural interfaces, focusing on hardware designed for optical control of neural activity, integrated optical control and electrical readout, and optical readout of population and single-cell neural activity in freely moving mammals. PMID:25014785

Self-Tuning Fully-Connected PID Neural Network System for Distributed Temperature Sensing and Control of Instrument with Multi-Modules.

PubMed

Zhang, Zhen; Ma, Cheng; Zhu, Rong

2016-10-14

High integration of multi-functional instruments raises a critical issue in temperature control that is challenging due to its spatial-temporal complexity. This paper presents a multi-input multi-output (MIMO) self-tuning temperature sensing and control system for efficiently modulating the temperature environment within a multi-module instrument. The smart system ensures that the internal temperature of the instrument converges to a target without the need of a system model, thus making the control robust. The system consists of a fully-connected proportional-integral-derivative (PID) neural network (FCPIDNN) and an on-line self-tuning module. The experimental results show that the presented system can effectively control the internal temperature under various mission scenarios, in particular, it is able to self-reconfigure upon actuator failure. The system provides a new scheme for a complex and time-variant MIMO control system which can be widely applied for the distributed measurement and control of the environment in instruments, integration electronics, and house constructions.

Groupies and Loners: The Population of Multi-planet Systems

NASA Astrophysics Data System (ADS)

Van Laerhoven, Christa L.; Greenberg, Richard

2014-11-01

Observational surveys with Kepler and other telescopes have shown that multi-planet systems are very numerous. Considering the secular dynamcis of multi-planet systems provides substantial insight into the interactions between planets in those systems. Since the underlying secular structure of a multi-planet system (the secular eigenmodes) can be calculated using only the planets' masses and semi-major axes, one can elucidate the eccentricity and inclination behavior of planets in those systems even without knowing the planets' current eccentricities and inclinations. We have calculated both the eccentricity and inclination secular eigenmodes for the population of known multi-planet systems whose planets have well determined masses and periods. We will discuss the commonality of dynamically grouped planets ('groupies') vs dynamically uncoupled planets ('loners'), and compare to what would be expected from randomly generated systems with the same overall distribution of masses and semi-major axes. We will also discuss the occurrence of planets that strongly influence the behavior of other planets without being influenced by those others ('overlords'). Examples will be given and general trends will be discussed.

Artificial vision by multi-layered neural networks: neocognitron and its advances.

PubMed

Fukushima, Kunihiko

2013-01-01

The neocognitron is a neural network model proposed by Fukushima (1980). Its architecture was suggested by neurophysiological findings on the visual systems of mammals. It is a hierarchical multi-layered network. It acquires the ability to robustly recognize visual patterns through learning. Although the neocognitron has a long history, modifications of the network to improve its performance are still going on. For example, a recent neocognitron uses a new learning rule, named add-if-silent, which makes the learning process much simpler and more stable. Nevertheless, a high recognition rate can be kept with a smaller scale of the network. Referring to the history of the neocognitron, this paper discusses recent advances in the neocognitron. We also show that various new functions can be realized by, for example, introducing top-down connections to the neocognitron: mechanism of selective attention, recognition and completion of partly occluded patterns, restoring occluded contours, and so on. Copyright © 2012 Elsevier Ltd. All rights reserved.

Intelligent multi-spectral IR image segmentation

NASA Astrophysics Data System (ADS)

Lu, Thomas; Luong, Andrew; Heim, Stephen; Patel, Maharshi; Chen, Kang; Chao, Tien-Hsin; Chow, Edward; Torres, Gilbert

2017-05-01

This article presents a neural network based multi-spectral image segmentation method. A neural network is trained on the selected features of both the objects and background in the longwave (LW) Infrared (IR) images. Multiple iterations of training are performed until the accuracy of the segmentation reaches satisfactory level. The segmentation boundary of the LW image is used to segment the midwave (MW) and shortwave (SW) IR images. A second neural network detects the local discontinuities and refines the accuracy of the local boundaries. This article compares the neural network based segmentation method to the Wavelet-threshold and Grab-Cut methods. Test results have shown increased accuracy and robustness of this segmentation scheme for multi-spectral IR images.

Efficient organ localization using multi-label convolutional neural networks in thorax-abdomen CT scans

NASA Astrophysics Data System (ADS)

Efrain Humpire-Mamani, Gabriel; Arindra Adiyoso Setio, Arnaud; van Ginneken, Bram; Jacobs, Colin

2018-04-01

Automatic localization of organs and other structures in medical images is an important preprocessing step that can improve and speed up other algorithms such as organ segmentation, lesion detection, and registration. This work presents an efficient method for simultaneous localization of multiple structures in 3D thorax-abdomen CT scans. Our approach predicts the location of multiple structures using a single multi-label convolutional neural network for each orthogonal view. Each network takes extra slices around the current slice as input to provide extra context. A sigmoid layer is used to perform multi-label classification. The output of the three networks is subsequently combined to compute a 3D bounding box for each structure. We used our approach to locate 11 structures of interest. The neural network was trained and evaluated on a large set of 1884 thorax-abdomen CT scans from patients undergoing oncological workup. Reference bounding boxes were annotated by human observers. The performance of our method was evaluated by computing the wall distance to the reference bounding boxes. The bounding boxes annotated by the first human observer were used as the reference standard for the test set. Using the best configuration, we obtained an average wall distance of 3.20~+/-~7.33 mm in the test set. The second human observer achieved 1.23~+/-~3.39 mm. For all structures, the results were better than those reported in previously published studies. In conclusion, we proposed an efficient method for the accurate localization of multiple organs. Our method uses multiple slices as input to provide more context around the slice under analysis, and we have shown that this improves performance. This method can easily be adapted to handle more organs.

A design philosophy for multi-layer neural networks with applications to robot control

NASA Technical Reports Server (NTRS)

Vadiee, Nader; Jamshidi, MO

1989-01-01

A system is proposed which receives input information from many sensors that may have diverse scaling, dimension, and data representations. The proposed system tolerates sensory information with faults. The proposed self-adaptive processing technique has great promise in integrating the techniques of artificial intelligence and neural networks in an attempt to build a more intelligent computing environment. The proposed architecture can provide a detailed decision tree based on the input information, information stored in a long-term memory, and the adapted rule-based knowledge. A mathematical model for analysis will be obtained to validate the cited hypotheses. An extensive software program will be developed to simulate a typical example of pattern recognition problem. It is shown that the proposed model displays attention, expectation, spatio-temporal, and predictory behavior which are specific to the human brain. The anticipated results of this research project are: (1) creation of a new dynamic neural network structure, and (2) applications to and comparison with conventional multi-layer neural network structures. The anticipated benefits from this research are vast. The model can be used in a neuro-computer architecture as a building block which can perform complicated, nonlinear, time-varying mapping from a multitude of input excitory classes to an output or decision environment. It can be used for coordinating different sensory inputs and past experience of a dynamic system and actuating signals. The commercial applications of this project can be the creation of a special-purpose neuro-computer hardware which can be used in spatio-temporal pattern recognitions in such areas as air defense systems, e.g., target tracking, and recognition. Potential robotics-related applications are trajectory planning, inverse dynamics computations, hierarchical control, task-oriented control, and collision avoidance.

Coculture with endothelial cells reduces the population of cycling LeX neural precursors but increases that of quiescent cells with a side population phenotype

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mathieu, Celine; Fouchet, Pierre; Gauthier, Laurent R.

2006-04-01

Neural stem cell proliferation and differentiation are regulated by external cues from their microenvironment. As endothelial cells are closely associated with neural stem cell in brain germinal zones, we investigated whether endothelial cells may interfere with neurogenesis. Neural precursor cells (NPC) from telencephalon of EGFP mouse embryos were cocultured in direct contact with endothelial cells. Endothelial cells did not modify the overall proliferation and apoptosis of neural cells, albeit they transiently delayed spontaneous apoptosis. These effects appeared to be specific to endothelial cells since a decrease in proliferation and a raise in apoptosis were observed in cocultures with fibroblasts. Endothelialmore » cells stimulated the differentiation of NPC into astrocytes and into neurons, whereas they reduced differentiation into oligodendrocytes in comparison to adherent cultures on polyornithine. Determination of NPC clonogenicity and quantification of LeX expression, a marker for NPC, showed that endothelial cells decreased the number of cycling NPC. On the other hand, the presence of endothelial cells increased the number of neural cells having 'side population' phenotype, another marker reported on NPC, which we have shown to contain quiescent cells. Thus, we show that endothelial cells may regulate neurogenesis by acting at different level of NPC differentiation, proliferation and quiescence.« less

Critical and maximally informative encoding between neural populations in the retina

PubMed Central

Kastner, David B.; Baccus, Stephen A.; Sharpee, Tatyana O.

2015-01-01

Computation in the brain involves multiple types of neurons, yet the organizing principles for how these neurons work together remain unclear. Information theory has offered explanations for how different types of neurons can maximize the transmitted information by encoding different stimulus features. However, recent experiments indicate that separate neuronal types exist that encode the same filtered version of the stimulus, but then the different cell types signal the presence of that stimulus feature with different thresholds. Here we show that the emergence of these neuronal types can be quantitatively described by the theory of transitions between different phases of matter. The two key parameters that control the separation of neurons into subclasses are the mean and standard deviation (SD) of noise affecting neural responses. The average noise across the neural population plays the role of temperature in the classic theory of phase transitions, whereas the SD is equivalent to pressure or magnetic field, in the case of liquid–gas and magnetic transitions, respectively. Our results account for properties of two recently discovered types of salamander Off retinal ganglion cells, as well as the absence of multiple types of On cells. We further show that, across visual stimulus contrasts, retinal circuits continued to operate near the critical point whose quantitative characteristics matched those expected near a liquid–gas critical point and described by the nearest-neighbor Ising model in three dimensions. By operating near a critical point, neural circuits can maximize information transmission in a given environment while retaining the ability to quickly adapt to a new environment. PMID:25675497

An Adaptive Multi-Sensor Data Fusion Method Based on Deep Convolutional Neural Networks for Fault Diagnosis of Planetary Gearbox

PubMed Central

Jing, Luyang; Wang, Taiyong; Zhao, Ming; Wang, Peng

2017-01-01

A fault diagnosis approach based on multi-sensor data fusion is a promising tool to deal with complicated damage detection problems of mechanical systems. Nevertheless, this approach suffers from two challenges, which are (1) the feature extraction from various types of sensory data and (2) the selection of a suitable fusion level. It is usually difficult to choose an optimal feature or fusion level for a specific fault diagnosis task, and extensive domain expertise and human labor are also highly required during these selections. To address these two challenges, we propose an adaptive multi-sensor data fusion method based on deep convolutional neural networks (DCNN) for fault diagnosis. The proposed method can learn features from raw data and optimize a combination of different fusion levels adaptively to satisfy the requirements of any fault diagnosis task. The proposed method is tested through a planetary gearbox test rig. Handcraft features, manual-selected fusion levels, single sensory data, and two traditional intelligent models, back-propagation neural networks (BPNN) and a support vector machine (SVM), are used as comparisons in the experiment. The results demonstrate that the proposed method is able to detect the conditions of the planetary gearbox effectively with the best diagnosis accuracy among all comparative methods in the experiment. PMID:28230767

Increasing magnetite contents of polymeric magnetic particles dramatically improves labeling of neural stem cell transplant populations.

PubMed

Adams, Christopher F; Rai, Ahmad; Sneddon, Gregor; Yiu, Humphrey H P; Polyak, Boris; Chari, Divya M

2015-01-01

Safe and efficient delivery of therapeutic cells to sites of injury/disease in the central nervous system is a key goal for the translation of clinical cell transplantation therapies. Recently, 'magnetic cell localization strategies' have emerged as a promising and safe approach for targeted delivery of magnetic particle (MP) labeled stem cells to pathology sites. For neuroregenerative applications, this approach is limited by the lack of available neurocompatible MPs, and low cell labeling achieved in neural stem/precursor populations. We demonstrate that high magnetite content, self-sedimenting polymeric MPs [unfunctionalized poly(lactic acid) coated, without a transfecting component] achieve efficient labeling (≥90%) of primary neural stem cells (NSCs)-a 'hard-to-label' transplant population of major clinical relevance. Our protocols showed high safety with respect to key stem cell regenerative parameters. Critically, labeled cells were effectively localized in an in vitro flow system by magnetic force highlighting the translational potential of the methods used. Copyright © 2015 Elsevier Inc. All rights reserved.

Genetic algorithm for neural networks optimization

NASA Astrophysics Data System (ADS)

Setyawati, Bina R.; Creese, Robert C.; Sahirman, Sidharta

2004-11-01

This paper examines the forecasting performance of multi-layer feed forward neural networks in modeling a particular foreign exchange rates, i.e. Japanese Yen/US Dollar. The effects of two learning methods, Back Propagation and Genetic Algorithm, in which the neural network topology and other parameters fixed, were investigated. The early results indicate that the application of this hybrid system seems to be well suited for the forecasting of foreign exchange rates. The Neural Networks and Genetic Algorithm were programmed using MATLAB«.

Representation of pitch chroma by multi-peak spectral tuning in human auditory cortex.

PubMed

Moerel, Michelle; De Martino, Federico; Santoro, Roberta; Yacoub, Essa; Formisano, Elia

2015-02-01

Musical notes played at octave intervals (i.e., having the same pitch chroma) are perceived as similar. This well-known perceptual phenomenon lays at the foundation of melody recognition and music perception, yet its neural underpinnings remain largely unknown to date. Using fMRI with high sensitivity and spatial resolution, we examined the contribution of multi-peak spectral tuning to the neural representation of pitch chroma in human auditory cortex in two experiments. In experiment 1, our estimation of population spectral tuning curves from the responses to natural sounds confirmed--with new data--our recent results on the existence of cortical ensemble responses finely tuned to multiple frequencies at one octave distance (Moerel et al., 2013). In experiment 2, we fitted a mathematical model consisting of a pitch chroma and height component to explain the measured fMRI responses to piano notes. This analysis revealed that the octave-tuned populations-but not other cortical populations-harbored a neural representation of musical notes according to their pitch chroma. These results indicate that responses of auditory cortical populations selectively tuned to multiple frequencies at one octave distance predict well the perceptual similarity of musical notes with the same chroma, beyond the physical (frequency) distance of notes. Copyright © 2014 Elsevier Inc. All rights reserved.

Neural Substrate of Group Mental Health: Insights from Multi-Brain Reference Frame in Functional Neuroimaging.

PubMed

Ray, Dipanjan; Roy, Dipanjan; Sindhu, Brahmdeep; Sharan, Pratap; Banerjee, Arpan

2017-01-01

Contemporary mental health practice primarily centers around the neurobiological and psychological processes at the individual level. However, a more careful consideration of interpersonal and other group-level attributes (e.g., interpersonal relationship, mutual trust/hostility, interdependence, and cooperation) and a better grasp of their pathology can add a crucial dimension to our understanding of mental health problems. A few recent studies have delved into the interpersonal behavioral processes in the context of different psychiatric abnormalities. Neuroimaging can supplement these approaches by providing insight into the neurobiology of interpersonal functioning. Keeping this view in mind, we discuss a recently developed approach in functional neuroimaging that calls for a shift from a focus on neural information contained within brain space to a multi-brain framework exploring degree of similarity/dissimilarity of neural signals between multiple interacting brains. We hypothesize novel applications of quantitative neuroimaging markers like inter-subject correlation that might be able to evaluate the role of interpersonal attributes affecting an individual or a group. Empirical evidences of the usage of these markers in understanding the neurobiology of social interactions are provided to argue for their application in future mental health research.

Neural Substrate of Group Mental Health: Insights from Multi-Brain Reference Frame in Functional Neuroimaging

PubMed Central

Ray, Dipanjan; Roy, Dipanjan; Sindhu, Brahmdeep; Sharan, Pratap; Banerjee, Arpan

2017-01-01

Contemporary mental health practice primarily centers around the neurobiological and psychological processes at the individual level. However, a more careful consideration of interpersonal and other group-level attributes (e.g., interpersonal relationship, mutual trust/hostility, interdependence, and cooperation) and a better grasp of their pathology can add a crucial dimension to our understanding of mental health problems. A few recent studies have delved into the interpersonal behavioral processes in the context of different psychiatric abnormalities. Neuroimaging can supplement these approaches by providing insight into the neurobiology of interpersonal functioning. Keeping this view in mind, we discuss a recently developed approach in functional neuroimaging that calls for a shift from a focus on neural information contained within brain space to a multi-brain framework exploring degree of similarity/dissimilarity of neural signals between multiple interacting brains. We hypothesize novel applications of quantitative neuroimaging markers like inter-subject correlation that might be able to evaluate the role of interpersonal attributes affecting an individual or a group. Empirical evidences of the usage of these markers in understanding the neurobiology of social interactions are provided to argue for their application in future mental health research. PMID:29033866

Major transcriptome re-organisation and abrupt changes in signalling, cell cycle and chromatin regulation at neural differentiation in vivo.

PubMed

Olivera-Martinez, Isabel; Schurch, Nick; Li, Roman A; Song, Junfang; Halley, Pamela A; Das, Raman M; Burt, Dave W; Barton, Geoffrey J; Storey, Kate G

2014-08-01

Here, we exploit the spatial separation of temporal events of neural differentiation in the elongating chick body axis to provide the first analysis of transcriptome change in progressively more differentiated neural cell populations in vivo. Microarray data, validated against direct RNA sequencing, identified: (1) a gene cohort characteristic of the multi-potent stem zone epiblast, which contains neuro-mesodermal progenitors that progressively generate the spinal cord; (2) a major transcriptome re-organisation as cells then adopt a neural fate; and (3) increasing diversity as neural patterning and neuron production begin. Focussing on the transition from multi-potent to neural state cells, we capture changes in major signalling pathways, uncover novel Wnt and Notch signalling dynamics, and implicate new pathways (mevalonate pathway/steroid biogenesis and TGFβ). This analysis further predicts changes in cellular processes, cell cycle, RNA-processing and protein turnover as cells acquire neural fate. We show that these changes are conserved across species and provide biological evidence for reduced proteasome efficiency and a novel lengthening of S phase. This latter step may provide time for epigenetic events to mediate large-scale transcriptome re-organisation; consistent with this, we uncover simultaneous downregulation of major chromatin modifiers as the neural programme is established. We further demonstrate that transcription of one such gene, HDAC1, is dependent on FGF signalling, making a novel link between signals that control neural differentiation and transcription of a core regulator of chromatin organisation. Our work implicates new signalling pathways and dynamics, cellular processes and epigenetic modifiers in neural differentiation in vivo, identifying multiple new potential cellular and molecular mechanisms that direct differentiation. © 2014. Published by The Company of Biologists Ltd.

Multi-objective evolutionary optimization for constructing neural networks for virtual reality visual data mining: application to geophysical prospecting.

PubMed

Valdés, Julio J; Barton, Alan J

2007-05-01

A method for the construction of virtual reality spaces for visual data mining using multi-objective optimization with genetic algorithms on nonlinear discriminant (NDA) neural networks is presented. Two neural network layers (the output and the last hidden) are used for the construction of simultaneous solutions for: (i) a supervised classification of data patterns and (ii) an unsupervised similarity structure preservation between the original data matrix and its image in the new space. A set of spaces are constructed from selected solutions along the Pareto front. This strategy represents a conceptual improvement over spaces computed by single-objective optimization. In addition, genetic programming (in particular gene expression programming) is used for finding analytic representations of the complex mappings generating the spaces (a composition of NDA and orthogonal principal components). The presented approach is domain independent and is illustrated via application to the geophysical prospecting of caves.

Suppression of seizures based on the multi-coupled neural mass model.

PubMed

Cao, Yuzhen; Ren, Kaili; Su, Fei; Deng, Bin; Wei, Xile; Wang, Jiang

2015-10-01

Epilepsy is one of the most common serious neurological disorders, which affects approximately 1% of population in the world. In order to effectively control the seizures, we propose a novel control methodology, which combines the feedback linearization control (FLC) with the underlying mechanism of epilepsy, to achieve the suppression of seizures. The three coupled neural mass model is constructed to study the property of the electroencephalographs (EEGs). Meanwhile, with the model we research on the propagation of epileptiform waves and the synchronization of populations, which are taken as the foundation of our control method. Results show that the proposed approach not only yields excellent performances in clamping the pathological spiking patterns to the reference signals derived under the normal state but also achieves the normalization of the pathological parameter, where the parameters are estimated from EEGs with Unscented Kalman Filter. The specific contribution of this paper is to treat the epilepsy from its pathogenesis with the FLC, which provides critical theoretical basis for the clinical treatment of neurological disorders.

Purification of Immature Neuronal Cells from Neural Stem Cell Progeny

PubMed Central

Azari, Hassan; Osborne, Geoffrey W.; Yasuda, Takahiro; Golmohammadi, Mohammad G.; Rahman, Maryam; Deleyrolle, Loic P.; Esfandiari, Ebrahim; Adams, David J.; Scheffler, Bjorn; Steindler, Dennis A.; Reynolds, Brent A.

2011-01-01

Large-scale proliferation and multi-lineage differentiation capabilities make neural stem cells (NSCs) a promising renewable source of cells for therapeutic applications. However, the practical application for neuronal cell replacement is limited by heterogeneity of NSC progeny, relatively low yield of neurons, predominance of astrocytes, poor survival of donor cells following transplantation and the potential for uncontrolled proliferation of precursor cells. To address these impediments, we have developed a method for the generation of highly enriched immature neurons from murine NSC progeny. Adaptation of the standard differentiation procedure in concert with flow cytometry selection, using scattered light and positive fluorescent light selection based on cell surface antibody binding, provided a near pure (97%) immature neuron population. Using the purified neurons, we screened a panel of growth factors and found that bone morphogenetic protein-4 (BMP-4) demonstrated a strong survival effect on the cells in vitro, and enhanced their functional maturity. This effect was maintained following transplantation into the adult mouse striatum where we observed a 2-fold increase in the survival of the implanted cells and a 3-fold increase in NeuN expression. Additionally, based on the neural-colony forming cell assay (N-CFCA), we noted a 64 fold reduction of the bona fide NSC frequency in neuronal cell population and that implanted donor cells showed no signs of excessive or uncontrolled proliferation. The ability to provide defined neural cell populations from renewable sources such as NSC may find application for cell replacement therapies in the central nervous system. PMID:21687800

Predicting human protein function with multi-task deep neural networks.

PubMed

Fa, Rui; Cozzetto, Domenico; Wan, Cen; Jones, David T

2018-01-01

Machine learning methods for protein function prediction are urgently needed, especially now that a substantial fraction of known sequences remains unannotated despite the extensive use of functional assignments based on sequence similarity. One major bottleneck supervised learning faces in protein function prediction is the structured, multi-label nature of the problem, because biological roles are represented by lists of terms from hierarchically organised controlled vocabularies such as the Gene Ontology. In this work, we build on recent developments in the area of deep learning and investigate the usefulness of multi-task deep neural networks (MTDNN), which consist of upstream shared layers upon which are stacked in parallel as many independent modules (additional hidden layers with their own output units) as the number of output GO terms (the tasks). MTDNN learns individual tasks partially using shared representations and partially from task-specific characteristics. When no close homologues with experimentally validated functions can be identified, MTDNN gives more accurate predictions than baseline methods based on annotation frequencies in public databases or homology transfers. More importantly, the results show that MTDNN binary classification accuracy is higher than alternative machine learning-based methods that do not exploit commonalities and differences among prediction tasks. Interestingly, compared with a single-task predictor, the performance improvement is not linearly correlated with the number of tasks in MTDNN, but medium size models provide more improvement in our case. One of advantages of MTDNN is that given a set of features, there is no requirement for MTDNN to have a bootstrap feature selection procedure as what traditional machine learning algorithms do. Overall, the results indicate that the proposed MTDNN algorithm improves the performance of protein function prediction. On the other hand, there is still large room for deep learning

Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets.

PubMed

Hu, Peijun; Wu, Fa; Peng, Jialin; Bao, Yuanyuan; Chen, Feng; Kong, Dexing

2017-03-01

Multi-organ segmentation from CT images is an essential step for computer-aided diagnosis and surgery planning. However, manual delineation of the organs by radiologists is tedious, time-consuming and poorly reproducible. Therefore, we propose a fully automatic method for the segmentation of multiple organs from three-dimensional abdominal CT images. The proposed method employs deep fully convolutional neural networks (CNNs) for organ detection and segmentation, which is further refined by a time-implicit multi-phase evolution method. Firstly, a 3D CNN is trained to automatically localize and delineate the organs of interest with a probability prediction map. The learned probability map provides both subject-specific spatial priors and initialization for subsequent fine segmentation. Then, for the refinement of the multi-organ segmentation, image intensity models, probability priors as well as a disjoint region constraint are incorporated into an unified energy functional. Finally, a novel time-implicit multi-phase level-set algorithm is utilized to efficiently optimize the proposed energy functional model. Our method has been evaluated on 140 abdominal CT scans for the segmentation of four organs (liver, spleen and both kidneys). With respect to the ground truth, average Dice overlap ratios for the liver, spleen and both kidneys are 96.0, 94.2 and 95.4%, respectively, and average symmetric surface distance is less than 1.3 mm for all the segmented organs. The computation time for a CT volume is 125 s in average. The achieved accuracy compares well to state-of-the-art methods with much higher efficiency. A fully automatic method for multi-organ segmentation from abdominal CT images was developed and evaluated. The results demonstrated its potential in clinical usage with high effectiveness, robustness and efficiency.

Efficiency of multi-breed genomic selection for dairy cattle breeds with different sizes of reference population.

PubMed

Hozé, C; Fritz, S; Phocas, F; Boichard, D; Ducrocq, V; Croiseau, P

2014-01-01

Single-breed genomic selection (GS) based on medium single nucleotide polymorphism (SNP) density (~50,000; 50K) is now routinely implemented in several large cattle breeds. However, building large enough reference populations remains a challenge for many medium or small breeds. The high-density BovineHD BeadChip (HD chip; Illumina Inc., San Diego, CA) containing 777,609 SNP developed in 2010 is characterized by short-distance linkage disequilibrium expected to be maintained across breeds. Therefore, combining reference populations can be envisioned. A population of 1,869 influential ancestors from 3 dairy breeds (Holstein, Montbéliarde, and Normande) was genotyped with the HD chip. Using this sample, 50K genotypes were imputed within breed to high-density genotypes, leading to a large HD reference population. This population was used to develop a multi-breed genomic evaluation. The goal of this paper was to investigate the gain of multi-breed genomic evaluation for a small breed. The advantage of using a large breed (Normande in the present study) to mimic a small breed is the large potential validation population to compare alternative genomic selection approaches more reliably. In the Normande breed, 3 training sets were defined with 1,597, 404, and 198 bulls, and a unique validation set included the 394 youngest bulls. For each training set, estimated breeding values (EBV) were computed using pedigree-based BLUP, single-breed BayesC, or multi-breed BayesC for which the reference population was formed by any of the Normande training data sets and 4,989 Holstein and 1,788 Montbéliarde bulls. Phenotypes were standardized by within-breed genetic standard deviation, the proportion of polygenic variance was set to 30%, and the estimated number of SNP with a nonzero effect was about 7,000. The 2 genomic selection (GS) approaches were performed using either the 50K or HD genotypes. The correlations between EBV and observed daughter yield deviations (DYD) were computed

Multi-National Banknote Classification Based on Visible-light Line Sensor and Convolutional Neural Network.

PubMed

Pham, Tuyen Danh; Lee, Dong Eun; Park, Kang Ryoung

2017-07-08

Automatic recognition of banknotes is applied in payment facilities, such as automated teller machines (ATMs) and banknote counters. Besides the popular approaches that focus on studying the methods applied to various individual types of currencies, there have been studies conducted on simultaneous classification of banknotes from multiple countries. However, their methods were conducted with limited numbers of banknote images, national currencies, and denominations. To address this issue, we propose a multi-national banknote classification method based on visible-light banknote images captured by a one-dimensional line sensor and classified by a convolutional neural network (CNN) considering the size information of each denomination. Experiments conducted on the combined banknote image database of six countries with 62 denominations gave a classification accuracy of 100%, and results show that our proposed algorithm outperforms previous methods.

Multi-National Banknote Classification Based on Visible-light Line Sensor and Convolutional Neural Network

PubMed Central

Pham, Tuyen Danh; Lee, Dong Eun; Park, Kang Ryoung

2017-01-01

Automatic recognition of banknotes is applied in payment facilities, such as automated teller machines (ATMs) and banknote counters. Besides the popular approaches that focus on studying the methods applied to various individual types of currencies, there have been studies conducted on simultaneous classification of banknotes from multiple countries. However, their methods were conducted with limited numbers of banknote images, national currencies, and denominations. To address this issue, we propose a multi-national banknote classification method based on visible-light banknote images captured by a one-dimensional line sensor and classified by a convolutional neural network (CNN) considering the size information of each denomination. Experiments conducted on the combined banknote image database of six countries with 62 denominations gave a classification accuracy of 100%, and results show that our proposed algorithm outperforms previous methods. PMID:28698466

Neural Timing is Linked to Speech Perception in Noise

PubMed Central

Samira, Anderson; Erika, Skoe; Bharath, Chandrasekaran; Nina, Kraus

2010-01-01

Understanding speech in background noise is challenging for every listener, including those with normal peripheral hearing. This difficulty is due in part to the disruptive effects of noise on neural synchrony, resulting in degraded representation of speech at cortical and subcortical levels as reflected by electrophysiological responses. These problems are especially pronounced in clinical populations such as children with learning impairments. Given the established effects of noise on evoked responses, we hypothesized that listening-in-noise problems are associated with degraded processing of timing information at the brainstem level. Participants (66 children, ages 8 to 14 years, 22 females) were divided into groups based on their performance on clinical measures of speech-in-noise perception (SIN) and reading. We compared brainstem responses to speech syllables between top and bottom SIN and reading groups in the presence and absence of competing multi-talker babble. In the quiet condition, neural response timing was equivalent between groups. In noise, however, the bottom groups exhibited greater neural delays relative to the top groups. Group-specific timing delays occurred exclusively in response to the noise-vulnerable formant transition, not to the more perceptually-robust, steady-state portion of the stimulus. These results demonstrate that neural timing is disrupted by background noise and that greater disruptions are associated with the inability to perceive speech in challenging listening conditions. PMID:20371812

Multi-objective optimization in systematic conservation planning and the representation of genetic variability among populations.

PubMed

Schlottfeldt, S; Walter, M E M T; Carvalho, A C P L F; Soares, T N; Telles, M P C; Loyola, R D; Diniz-Filho, J A F

2015-06-18

Biodiversity crises have led scientists to develop strategies for achieving conservation goals. The underlying principle of these strategies lies in systematic conservation planning (SCP), in which there are at least 2 conflicting objectives, making it a good candidate for multi-objective optimization. Although SCP is typically applied at the species level (or hierarchically higher), it can be used at lower hierarchical levels, such as using alleles as basic units for analysis, for conservation genetics. Here, we propose a method of SCP using a multi-objective approach. We used non-dominated sorting genetic algorithm II in order to identify the smallest set of local populations of Dipteryx alata (baru) (a Brazilian Cerrado species) for conservation, representing the known genetic diversity and using allele frequency information associated with heterozygosity and Hardy-Weinberg equilibrium. We worked in 3 variations for the problem. First, we reproduced a previous experiment, but using a multi-objective approach. We found that the smallest set of populations needed to represent all alleles under study was 7, corroborating the results of the previous study, but with more distinct solutions. In the 2nd and 3rd variations, we performed simultaneous optimization of 4 and 5 objectives, respectively. We found similar but refined results for 7 populations, and a larger portfolio considering intra-specific diversity and persistence with populations ranging from 8-22. This is the first study to apply multi-objective algorithms to an SCP problem using alleles at the population level as basic units for analysis.

Residual Shuffling Convolutional Neural Networks for Deep Semantic Image Segmentation Using Multi-Modal Data

NASA Astrophysics Data System (ADS)

Chen, K.; Weinmann, M.; Gao, X.; Yan, M.; Hinz, S.; Jutzi, B.; Weinmann, M.

2018-05-01

In this paper, we address the deep semantic segmentation of aerial imagery based on multi-modal data. Given multi-modal data composed of true orthophotos and the corresponding Digital Surface Models (DSMs), we extract a variety of hand-crafted radiometric and geometric features which are provided separately and in different combinations as input to a modern deep learning framework. The latter is represented by a Residual Shuffling Convolutional Neural Network (RSCNN) combining the characteristics of a Residual Network with the advantages of atrous convolution and a shuffling operator to achieve a dense semantic labeling. Via performance evaluation on a benchmark dataset, we analyze the value of different feature sets for the semantic segmentation task. The derived results reveal that the use of radiometric features yields better classification results than the use of geometric features for the considered dataset. Furthermore, the consideration of data on both modalities leads to an improvement of the classification results. However, the derived results also indicate that the use of all defined features is less favorable than the use of selected features. Consequently, data representations derived via feature extraction and feature selection techniques still provide a gain if used as the basis for deep semantic segmentation.

Neural networks distinguish between taste qualities based on receptor cell population responses.

PubMed

Varkevisser, B; Peterson, D; Ogura, T; Kinnamon, S C

2001-06-01

Response features of taste receptor cell action potentials were examined using an artificial neural network to determine whether they contain information about taste quality. Using the loose patch technique to record from hamster taste buds in vivo we recorded population responses of single fungiform papillae to NaCl (100 mM), sucrose (200 mM) and the synthetic sweetener NC-00274-01 (NC-01) (200 microM). Features of each response describing both burst and inter-burst characteristics were then presented to an artificial neural network for pairwise classification of taste stimuli. Responses to NaCl could be distinguished from those to both NC-01 and sucrose with accuracies of up to 86%. In contrast, pairwise comparisons between sucrose and NC-01 were not successful, scoring at chance (50%). Also, comparisons between two different concentrations of NaCl, 0.01 and 0.005 M, scored at chance. Pairwise comparisons using only those features that relate to the inter-burst behavior of the response (i.e. bursting rate) did not hinder the performance of the neural network as both sweeteners versus NaCl received scores of 75--85%. Comparisons using features corresponding to each individual burst scored poorly, receiving scores only slightly above chance. We then compared the sweeteners with varying concentrations of NaCl (0.1, 0.01, 0.005 and 0.001 M) using only those features corresponding to bursting rate within a 1 s time window. The neural network was capable of distinguishing between NaCl and NC-01 at all concentrations tested; while comparisons between NaCl and sucrose received high scores at all concentrations except 0.001 M. These results show that two different taste qualities can be distinguished from each other based solely on the bursting rates of action potentials in single taste buds and that this distinction is independent of stimulation intensity down to 0.001 M NaCl. These data suggest that action potentials in taste receptor cells may play a role in taste

Modular neural networks: a survey.

PubMed

Auda, G; Kamel, M

1999-04-01

Modular Neural Networks (MNNs) is a rapidly growing field in artificial Neural Networks (NNs) research. This paper surveys the different motivations for creating MNNs: biological, psychological, hardware, and computational. Then, the general stages of MNN design are outlined and surveyed as well, viz., task decomposition techniques, learning schemes and multi-module decision-making strategies. Advantages and disadvantages of the surveyed methods are pointed out, and an assessment with respect to practical potential is provided. Finally, some general recommendations for future designs are presented.

Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation

PubMed Central

Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

2015-01-01

The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6–8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multimodality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement. PMID:25562829

A neural network approach to lung nodule segmentation

NASA Astrophysics Data System (ADS)

Hu, Yaoxiu; Menon, Prahlad G.

2016-03-01

Computed tomography (CT) imaging is a sensitive and specific lung cancer screening tool for the high-risk population and shown to be promising for detection of lung cancer. This study proposes an automatic methodology for detecting and segmenting lung nodules from CT images. The proposed methods begin with thorax segmentation, lung extraction and reconstruction of the original shape of the parenchyma using morphology operations. Next, a multi-scale hessian-based vesselness filter is applied to extract lung vasculature in lung. The lung vasculature mask is subtracted from the lung region segmentation mask to extract 3D regions representing candidate pulmonary nodules. Finally, the remaining structures are classified as nodules through shape and intensity features which are together used to train an artificial neural network. Up to 75% sensitivity and 98% specificity was achieved for detection of lung nodules in our testing dataset, with an overall accuracy of 97.62%+/-0.72% using 11 selected features as input to the neural network classifier, based on 4-fold cross-validation studies. Receiver operator characteristics for identifying nodules revealed an area under curve of 0.9476.

Forecasting influenza-like illness dynamics for military populations using neural networks and social media

DOE PAGES

Volkova, Svitlana; Ayton, Ellyn; Porterfield, Katherine; ...

2017-12-15

This work is the first to take advantage of recurrent neural networks to predict influenza-like-illness (ILI) dynamics from various linguistic signals extracted from social media data. Unlike other approaches that rely on timeseries analysis of historical ILI data [1, 2] and the state-of-the-art machine learning models [3, 4], we build and evaluate the predictive power of Long Short Term Memory (LSTMs) architectures capable of nowcasting (predicting in \\real-time") and forecasting (predicting the future) ILI dynamics in the 2011 { 2014 influenza seasons. To build our models we integrate information people post in social media e.g., topics, stylistic and syntactic patterns,more » emotions and opinions, and communication behavior. We then quantitatively evaluate the predictive power of different social media signals and contrast the performance of the-state-of-the-art regression models with neural networks. Finally, we combine ILI and social media signals to build joint neural network models for ILI dynamics prediction. Unlike the majority of the existing work, we specifically focus on developing models for local rather than national ILI surveillance [1], specifically for military rather than general populations [3] in 26 U.S. and six international locations. Our approach demonstrates several advantages: (a) Neural network models learned from social media data yield the best performance compared to previously used regression models. (b) Previously under-explored language and communication behavior features are more predictive of ILI dynamics than syntactic and stylistic signals expressed in social media. (c) Neural network models learned exclusively from social media signals yield comparable or better performance to the models learned from ILI historical data, thus, signals from social media can be potentially used to accurately forecast ILI dynamics for the regions where ILI historical data is not available. (d) Neural network models learned from combined ILI and

Forecasting influenza-like illness dynamics for military populations using neural networks and social media

DOE Office of Scientific and Technical Information (OSTI.GOV)

Volkova, Svitlana; Ayton, Ellyn; Porterfield, Katherine

This work is the first to take advantage of recurrent neural networks to predict influenza-like-illness (ILI) dynamics from various linguistic signals extracted from social media data. Unlike other approaches that rely on timeseries analysis of historical ILI data [1, 2] and the state-of-the-art machine learning models [3, 4], we build and evaluate the predictive power of Long Short Term Memory (LSTMs) architectures capable of nowcasting (predicting in \\real-time") and forecasting (predicting the future) ILI dynamics in the 2011 { 2014 influenza seasons. To build our models we integrate information people post in social media e.g., topics, stylistic and syntactic patterns,more » emotions and opinions, and communication behavior. We then quantitatively evaluate the predictive power of different social media signals and contrast the performance of the-state-of-the-art regression models with neural networks. Finally, we combine ILI and social media signals to build joint neural network models for ILI dynamics prediction. Unlike the majority of the existing work, we specifically focus on developing models for local rather than national ILI surveillance [1], specifically for military rather than general populations [3] in 26 U.S. and six international locations. Our approach demonstrates several advantages: (a) Neural network models learned from social media data yield the best performance compared to previously used regression models. (b) Previously under-explored language and communication behavior features are more predictive of ILI dynamics than syntactic and stylistic signals expressed in social media. (c) Neural network models learned exclusively from social media signals yield comparable or better performance to the models learned from ILI historical data, thus, signals from social media can be potentially used to accurately forecast ILI dynamics for the regions where ILI historical data is not available. (d) Neural network models learned from combined ILI and

Multi-task transfer learning deep convolutional neural network: application to computer-aided diagnosis of breast cancer on mammograms

NASA Astrophysics Data System (ADS)

Samala, Ravi K.; Chan, Heang-Ping; Hadjiiski, Lubomir M.; Helvie, Mark A.; Cha, Kenny H.; Richter, Caleb D.

2017-12-01

Transfer learning in deep convolutional neural networks (DCNNs) is an important step in its application to medical imaging tasks. We propose a multi-task transfer learning DCNN with the aim of translating the ‘knowledge’ learned from non-medical images to medical diagnostic tasks through supervised training and increasing the generalization capabilities of DCNNs by simultaneously learning auxiliary tasks. We studied this approach in an important application: classification of malignant and benign breast masses. With Institutional Review Board (IRB) approval, digitized screen-film mammograms (SFMs) and digital mammograms (DMs) were collected from our patient files and additional SFMs were obtained from the Digital Database for Screening Mammography. The data set consisted of 2242 views with 2454 masses (1057 malignant, 1397 benign). In single-task transfer learning, the DCNN was trained and tested on SFMs. In multi-task transfer learning, SFMs and DMs were used to train the DCNN, which was then tested on SFMs. N-fold cross-validation with the training set was used for training and parameter optimization. On the independent test set, the multi-task transfer learning DCNN was found to have significantly (p  =  0.007) higher performance compared to the single-task transfer learning DCNN. This study demonstrates that multi-task transfer learning may be an effective approach for training DCNN in medical imaging applications when training samples from a single modality are limited.

Neural constraints on learning.

PubMed

Sadtler, Patrick T; Quick, Kristin M; Golub, Matthew D; Chase, Steven M; Ryu, Stephen I; Tyler-Kabara, Elizabeth C; Yu, Byron M; Batista, Aaron P

2014-08-28

Learning, whether motor, sensory or cognitive, requires networks of neurons to generate new activity patterns. As some behaviours are easier to learn than others, we asked if some neural activity patterns are easier to generate than others. Here we investigate whether an existing network constrains the patterns that a subset of its neurons is capable of exhibiting, and if so, what principles define this constraint. We employed a closed-loop intracortical brain-computer interface learning paradigm in which Rhesus macaques (Macaca mulatta) controlled a computer cursor by modulating neural activity patterns in the primary motor cortex. Using the brain-computer interface paradigm, we could specify and alter how neural activity mapped to cursor velocity. At the start of each session, we observed the characteristic activity patterns of the recorded neural population. The activity of a neural population can be represented in a high-dimensional space (termed the neural space), wherein each dimension corresponds to the activity of one neuron. These characteristic activity patterns comprise a low-dimensional subspace (termed the intrinsic manifold) within the neural space. The intrinsic manifold presumably reflects constraints imposed by the underlying neural circuitry. Here we show that the animals could readily learn to proficiently control the cursor using neural activity patterns that were within the intrinsic manifold. However, animals were less able to learn to proficiently control the cursor using activity patterns that were outside of the intrinsic manifold. These results suggest that the existing structure of a network can shape learning. On a timescale of hours, it seems to be difficult to learn to generate neural activity patterns that are not consistent with the existing network structure. These findings offer a network-level explanation for the observation that we are more readily able to learn new skills when they are related to the skills that we already

Bilingualism provides a neural reserve for aging populations.

PubMed

Abutalebi, Jubin; Guidi, Lucia; Borsa, Virginia; Canini, Matteo; Della Rosa, Pasquale A; Parris, Ben A; Weekes, Brendan S

2015-03-01

It has been postulated that bilingualism may act as a cognitive reserve and recent behavioral evidence shows that bilinguals are diagnosed with dementia about 4-5 years later compared to monolinguals. In the present study, we investigated the neural basis of these putative protective effects in a group of aging bilinguals as compared to a matched monolingual control group. For this purpose, participants completed the Erikson Flanker task and their performance was correlated to gray matter (GM) volume in order to investigate if cognitive performance predicts GM volume specifically in areas affected by aging. We performed an ex-Gaussian analysis on the resulting RTs and report that aging bilinguals performed better than aging monolinguals on the Flanker task. Bilingualism was overall associated with increased GM in the ACC. Likewise, aging induced effects upon performance correlated only for monolinguals to decreased gray matter in the DLPFC. Taken together, these neural regions might underlie the benefits of bilingualism and act as a neural reserve that protects against the cognitive decline that occurs during aging. Copyright © 2015 Elsevier Ltd. All rights reserved.

NeuroMEMS: Neural Probe Microtechnologies

PubMed Central

HajjHassan, Mohamad; Chodavarapu, Vamsy; Musallam, Sam

2008-01-01

Neural probe technologies have already had a significant positive effect on our understanding of the brain by revealing the functioning of networks of biological neurons. Probes are implanted in different areas of the brain to record and/or stimulate specific sites in the brain. Neural probes are currently used in many clinical settings for diagnosis of brain diseases such as seizers, epilepsy, migraine, Alzheimer's, and dementia. We find these devices assisting paralyzed patients by allowing them to operate computers or robots using their neural activity. In recent years, probe technologies were assisted by rapid advancements in microfabrication and microelectronic technologies and thus are enabling highly functional and robust neural probes which are opening new and exciting avenues in neural sciences and brain machine interfaces. With a wide variety of probes that have been designed, fabricated, and tested to date, this review aims to provide an overview of the advances and recent progress in the microfabrication techniques of neural probes. In addition, we aim to highlight the challenges faced in developing and implementing ultra-long multi-site recording probes that are needed to monitor neural activity from deeper regions in the brain. Finally, we review techniques that can improve the biocompatibility of the neural probes to minimize the immune response and encourage neural growth around the electrodes for long term implantation studies. PMID:27873894

Cropping Pattern Detection and Change Analysis in Central Luzon, Philippines Using Multi-Temporal MODIS Imagery and Artificial Neural Network Classifier

NASA Astrophysics Data System (ADS)

dela Torre, D. M.; Perez, G. J. P.

2016-12-01

Cropping practices in the Philippines has been intensifying with greater demand for food and agricultural supplies in view of an increasing population and advanced technologies for farming. This has not been monitored regularly using traditional methods but alternative methods using remote sensing has been promising yet underutilized. This study employed multi-temporal data from MODIS and neural network classifier to map annual land use in agricultural areas from 2001-2014 in Central Luzon, the primary rice growing area of the Philippines. Land use statistics derived from these maps were compared with historical El Nino events to examine how land area is affected by drought events. Fourteen maps of agricultural land use was produced, with the primary classes being single-cropping, double-cropping and perennial crops with secondary classes of forests, urban, bare, water and other classes. Primary classes were produced from the neural network classifier while secondary classes were derived from NDVI threshold masks. The overall accuracy for the 2014 map was 62.05% and a kappa statistic of 0.45. 155.56% increase in single-cropping systems from 2001 to 2014 was observed while double cropping systems decreased by 14.83%. Perennials increased by 76.21% while built-up areas decreased by 12.22% within the 14-year interval. There are several sources of error including mixed-pixels, scale-conversion problems and limited ground reference data. An analysis including El Niño events in 2004 and 2010 demonstrated that marginally irrigated areas that usually planted twice in a year resorted to single cropping, indicating that scarcity of water limited the intensification allowable in the area. Findings from this study can be used to predict future use of agricultural land in the country and also examine how farmlands have responded to climatic factors and stressors.

Neural dynamic optimization for control systems. I. Background.

PubMed

Seong, C Y; Widrow, B

2001-01-01

The paper presents neural dynamic optimization (NDO) as a method of optimal feedback control for nonlinear multi-input-multi-output (MIMO) systems. The main feature of NDO is that it enables neural networks to approximate the optimal feedback solution whose existence dynamic programming (DP) justifies, thereby reducing the complexities of computation and storage problems of the classical methods such as DP. This paper mainly describes the background and motivations for the development of NDO, while the two other subsequent papers of this topic present the theory of NDO and demonstrate the method with several applications including control of autonomous vehicles and of a robot arm, respectively.

Neural dynamic optimization for control systems.III. Applications.

PubMed

Seong, C Y; Widrow, B

2001-01-01

For pt.II. see ibid., p. 490-501. The paper presents neural dynamic optimization (NDO) as a method of optimal feedback control for nonlinear multi-input-multi-output (MIMO) systems. The main feature of NDO is that it enables neural networks to approximate the optimal feedback solution whose existence dynamic programming (DP) justifies, thereby reducing the complexities of computation and storage problems of the classical methods such as DP. This paper demonstrates NDO with several applications including control of autonomous vehicles and of a robot-arm, while the two other companion papers of this topic describes the background for the development of NDO and present the theory of the method, respectively.

Neural dynamic optimization for control systems.II. Theory.

PubMed

Seong, C Y; Widrow, B

2001-01-01

The paper presents neural dynamic optimization (NDO) as a method of optimal feedback control for nonlinear multi-input-multi-output (MIMO) systems. The main feature of NDO is that it enables neural networks to approximate the optimal feedback solution whose existence dynamic programming (DP) justifies, thereby reducing the complexities of computation and storage problems of the classical methods such as DP. This paper mainly describes the theory of NDO, while the two other companion papers of this topic explain the background for the development of NDO and demonstrate the method with several applications including control of autonomous vehicles and of a robot arm, respectively.

Modelling multi-pulse population dynamics from ultrafast spectroscopy.

PubMed

van Wilderen, Luuk J G W; Lincoln, Craig N; van Thor, Jasper J

2011-03-21

Current advanced laser, optics and electronics technology allows sensitive recording of molecular dynamics, from single resonance to multi-colour and multi-pulse experiments. Extracting the occurring (bio-) physical relevant pathways via global analysis of experimental data requires a systematic investigation of connectivity schemes. Here we present a Matlab-based toolbox for this purpose. The toolbox has a graphical user interface which facilitates the application of different reaction models to the data to generate the coupled differential equations. Any time-dependent dataset can be analysed to extract time-independent correlations of the observables by using gradient or direct search methods. Specific capabilities (i.e. chirp and instrument response function) for the analysis of ultrafast pump-probe spectroscopic data are included. The inclusion of an extra pulse that interacts with a transient phase can help to disentangle complex interdependent pathways. The modelling of pathways is therefore extended by new theory (which is included in the toolbox) that describes the finite bleach (orientation) effect of single and multiple intense polarised femtosecond pulses on an ensemble of randomly oriented particles in the presence of population decay. For instance, the generally assumed flat-top multimode beam profile is adapted to a more realistic Gaussian shape, exposing the need for several corrections for accurate anisotropy measurements. In addition, the (selective) excitation (photoselection) and anisotropy of populations that interact with single or multiple intense polarised laser pulses is demonstrated as function of power density and beam profile. Using example values of real world experiments it is calculated to what extent this effectively orients the ensemble of particles. Finally, the implementation includes the interaction with multiple pulses in addition to depth averaging in optically dense samples. In summary, we show that mathematical modelling is

Modelling Multi-Pulse Population Dynamics from Ultrafast Spectroscopy

PubMed Central

van Wilderen, Luuk J. G. W.; Lincoln, Craig N.; van Thor, Jasper J.

2011-01-01

Current advanced laser, optics and electronics technology allows sensitive recording of molecular dynamics, from single resonance to multi-colour and multi-pulse experiments. Extracting the occurring (bio-) physical relevant pathways via global analysis of experimental data requires a systematic investigation of connectivity schemes. Here we present a Matlab-based toolbox for this purpose. The toolbox has a graphical user interface which facilitates the application of different reaction models to the data to generate the coupled differential equations. Any time-dependent dataset can be analysed to extract time-independent correlations of the observables by using gradient or direct search methods. Specific capabilities (i.e. chirp and instrument response function) for the analysis of ultrafast pump-probe spectroscopic data are included. The inclusion of an extra pulse that interacts with a transient phase can help to disentangle complex interdependent pathways. The modelling of pathways is therefore extended by new theory (which is included in the toolbox) that describes the finite bleach (orientation) effect of single and multiple intense polarised femtosecond pulses on an ensemble of randomly oriented particles in the presence of population decay. For instance, the generally assumed flat-top multimode beam profile is adapted to a more realistic Gaussian shape, exposing the need for several corrections for accurate anisotropy measurements. In addition, the (selective) excitation (photoselection) and anisotropy of populations that interact with single or multiple intense polarised laser pulses is demonstrated as function of power density and beam profile. Using example values of real world experiments it is calculated to what extent this effectively orients the ensemble of particles. Finally, the implementation includes the interaction with multiple pulses in addition to depth averaging in optically dense samples. In summary, we show that mathematical modelling is

Current steering to activate targeted neural pathways during deep brain stimulation of the subthalamic region

PubMed Central

Chaturvedi, Ashutosh; Foutz, Thomas J.; McIntyre, Cameron C.

2012-01-01

Deep brain stimulation (DBS) has steadily evolved into an established surgical therapy for numerous neurological disorders, most notably Parkinson’s disease (PD). Traditional DBS technology relies on voltage-controlled stimulation with a single source; however, recent engineering advances are providing current-controlled devices with multiple independent sources. These new stimulators deliver constant current to the brain tissue, irrespective of impedance changes that occur around the electrode, and enable more specific steering of current towards targeted regions of interest. In this study, we examined the impact of current steering between multiple electrode contacts to directly activate three distinct neural populations in the subthalamic region commonly stimulated for the treatment of PD: projection neurons of the subthalamic nucleus (STN), globus pallidus internus (GPi) fibers of the lenticular fasiculus, and internal capsule (IC) fibers of passage. We used three-dimensional finite element electric field models, along with detailed multi-compartment cable models of the three neural populations to determine their activations using a wide range of stimulation parameter settings. Our results indicate that selective activation of neural populations largely depends on the location of the active electrode(s). Greater activation of the GPi and STN populations (without activating any side-effect related IC fibers) was achieved by current steering with multiple independent sources, compared to a single current source. Despite this potential advantage, it remains to be seen if these theoretical predictions result in a measurable clinical effect that outweighs the added complexity of the expanded stimulation parameter search space generated by the more flexible technology. PMID:22277548

Swallow segmentation with artificial neural networks and multi-sensor fusion.

PubMed

Lee, Joon; Steele, Catriona M; Chau, Tom

2009-11-01

Swallow segmentation is a critical precursory step to the analysis of swallowing signal characteristics. In an effort to automatically segment swallows, we investigated artificial neural networks (ANN) with information from cervical dual-axis accelerometry, submental MMG, and nasal airflow. Our objectives were (1) to investigate the relationship between segmentation performance and the number of signal sources and (2) to identify the signals or signal combinations most useful for swallow segmentation. Signals were acquired from 17 healthy adults in both discrete and continuous swallowing tasks using five stimuli. Training and test feature vectors were constructed with variances from single or multiple signals, estimated within 200 ms moving windows with 50% overlap. Corresponding binary target labels (swallow or non-swallow) were derived by manual segmentation. A separate 3-layer ANN was trained for each participant-signal combination, and all possible signal combinations were investigated. As more signal sources were included, segmentation performance improved in terms of sensitivity, specificity, accuracy, and adjusted accuracy. The combination of all four signal sources achieved the highest mean accuracy and adjusted accuracy of 88.5% and 89.6%, respectively. A-P accelerometry proved to be the most discriminatory source, while the inclusion of MMG or nasal airflow resulted in the least performance improvement. These findings suggest that an ANN, multi-sensor fusion approach to segmentation is worthy of further investigation in swallowing studies.

Forecasting influenza-like illness dynamics for military populations using neural networks and social media

PubMed Central

Ayton, Ellyn; Porterfield, Katherine; Corley, Courtney D.

2017-01-01

This work is the first to take advantage of recurrent neural networks to predict influenza-like illness (ILI) dynamics from various linguistic signals extracted from social media data. Unlike other approaches that rely on timeseries analysis of historical ILI data and the state-of-the-art machine learning models, we build and evaluate the predictive power of neural network architectures based on Long Short Term Memory (LSTMs) units capable of nowcasting (predicting in “real-time”) and forecasting (predicting the future) ILI dynamics in the 2011 – 2014 influenza seasons. To build our models we integrate information people post in social media e.g., topics, embeddings, word ngrams, stylistic patterns, and communication behavior using hashtags and mentions. We then quantitatively evaluate the predictive power of different social media signals and contrast the performance of the-state-of-the-art regression models with neural networks using a diverse set of evaluation metrics. Finally, we combine ILI and social media signals to build a joint neural network model for ILI dynamics prediction. Unlike the majority of the existing work, we specifically focus on developing models for local rather than national ILI surveillance, specifically for military rather than general populations in 26 U.S. and six international locations., and analyze how model performance depends on the amount of social media data available per location. Our approach demonstrates several advantages: (a) Neural network architectures that rely on LSTM units trained on social media data yield the best performance compared to previously used regression models. (b) Previously under-explored language and communication behavior features are more predictive of ILI dynamics than stylistic and topic signals expressed in social media. (c) Neural network models learned exclusively from social media signals yield comparable or better performance to the models learned from ILI historical data, thus, signals

Forecasting influenza-like illness dynamics for military populations using neural networks and social media.

PubMed

Volkova, Svitlana; Ayton, Ellyn; Porterfield, Katherine; Corley, Courtney D

2017-01-01

This work is the first to take advantage of recurrent neural networks to predict influenza-like illness (ILI) dynamics from various linguistic signals extracted from social media data. Unlike other approaches that rely on timeseries analysis of historical ILI data and the state-of-the-art machine learning models, we build and evaluate the predictive power of neural network architectures based on Long Short Term Memory (LSTMs) units capable of nowcasting (predicting in "real-time") and forecasting (predicting the future) ILI dynamics in the 2011 - 2014 influenza seasons. To build our models we integrate information people post in social media e.g., topics, embeddings, word ngrams, stylistic patterns, and communication behavior using hashtags and mentions. We then quantitatively evaluate the predictive power of different social media signals and contrast the performance of the-state-of-the-art regression models with neural networks using a diverse set of evaluation metrics. Finally, we combine ILI and social media signals to build a joint neural network model for ILI dynamics prediction. Unlike the majority of the existing work, we specifically focus on developing models for local rather than national ILI surveillance, specifically for military rather than general populations in 26 U.S. and six international locations., and analyze how model performance depends on the amount of social media data available per location. Our approach demonstrates several advantages: (a) Neural network architectures that rely on LSTM units trained on social media data yield the best performance compared to previously used regression models. (b) Previously under-explored language and communication behavior features are more predictive of ILI dynamics than stylistic and topic signals expressed in social media. (c) Neural network models learned exclusively from social media signals yield comparable or better performance to the models learned from ILI historical data, thus, signals from

Cognitive Neural Prosthetics

PubMed Central

Andersen, Richard A.; Hwang, Eun Jung; Mulliken, Grant H.

2010-01-01

The cognitive neural prosthetic (CNP) is a very versatile method for assisting paralyzed patients and patients with amputations. The CNP records the cognitive state of the subject, rather than signals strictly related to motor execution or sensation. We review a number of high-level cortical signals and their application for CNPs, including intention, motor imagery, decision making, forward estimation, executive function, attention, learning, and multi-effector movement planning. CNPs are defined by the cognitive function they extract, not the cortical region from which the signals are recorded. However, some cortical areas may be better than others for particular applications. Signals can also be extracted in parallel from multiple cortical areas using multiple implants, which in many circumstances can increase the range of applications of CNPs. The CNP approach relies on scientific understanding of the neural processes involved in cognition, and many of the decoding algorithms it uses also have parallels to underlying neural circuit functions. PMID:19575625

Cooperative learning neural network output feedback control of uncertain nonlinear multi-agent systems under directed topologies

NASA Astrophysics Data System (ADS)

Wang, W.; Wang, D.; Peng, Z. H.

2017-09-01

Without assuming that the communication topologies among the neural network (NN) weights are to be undirected and the states of each agent are measurable, the cooperative learning NN output feedback control is addressed for uncertain nonlinear multi-agent systems with identical structures in strict-feedback form. By establishing directed communication topologies among NN weights to share their learned knowledge, NNs with cooperative learning laws are employed to identify the uncertainties. By designing NN-based κ-filter observers to estimate the unmeasurable states, a new cooperative learning output feedback control scheme is proposed to guarantee that the system outputs can track nonidentical reference signals with bounded tracking errors. A simulation example is given to demonstrate the effectiveness of the theoretical results.

Reward magnitude tracking by neural populations in ventral striatum

PubMed Central

Fiallos, Ana M.; Bricault, Sarah J.; Cai, Lili X.; Worku, Hermoon A.; Colonnese, Matthew T.; Westmeyer, Gil; Jasanoff, Alan

2017-01-01

Evaluation of the magnitudes of intrinsically rewarding stimuli is essential for assigning value and guiding behavior. By combining parametric manipulation of a primary reward, medial forebrain bundle (MFB) microstimulation, with functional magnetic imaging (fMRI) in rodents, we delineated a broad network of structures activated by behaviorally characterized levels of rewarding stimulation. Correlation of psychometric behavioral measurements with fMRI response magnitudes revealed regions whose activity corresponded closely to the subjective magnitude of rewards. The largest and most reliable focus of reward magnitude tracking was observed in the shell region of the nucleus accumbens (NAc). Although the nonlinear nature of neurovascular coupling complicates interpretation of fMRI findings in precise neurophysiological terms, reward magnitude tracking was not observed in vascular compartments and could not be explained by saturation of region-specific hemodynamic responses. In addition, local pharmacological inactivation of NAc changed the profile of animals’ responses to rewards of different magnitudes without altering mean reward response rates, further supporting a hypothesis that neural population activity in this region contributes to assessment of reward magnitudes. PMID:27789262

DataHigh: Graphical user interface for visualizing and interacting with high-dimensional neural activity

PubMed Central

Cowley, Benjamin R.; Kaufman, Matthew T.; Butler, Zachary S.; Churchland, Mark M.; Ryu, Stephen I.; Shenoy, Krishna V.; Yu, Byron M.

2014-01-01

Objective Analyzing and interpreting the activity of a heterogeneous population of neurons can be challenging, especially as the number of neurons, experimental trials, and experimental conditions increases. One approach is to extract a set of latent variables that succinctly captures the prominent co-fluctuation patterns across the neural population. A key problem is that the number of latent variables needed to adequately describe the population activity is often greater than three, thereby preventing direct visualization of the latent space. By visualizing a small number of 2-d projections of the latent space or each latent variable individually, it is easy to miss salient features of the population activity. Approach To address this limitation, we developed a Matlab graphical user interface (called DataHigh) that allows the user to quickly and smoothly navigate through a continuum of different 2-d projections of the latent space. We also implemented a suite of additional visualization tools (including playing out population activity timecourses as a movie and displaying summary statistics, such as covariance ellipses and average timecourses) and an optional tool for performing dimensionality reduction. Main results To demonstrate the utility and versatility of DataHigh, we used it to analyze single-trial spike count and single-trial timecourse population activity recorded using a multi-electrode array, as well as trial-averaged population activity recorded using single electrodes. Significance DataHigh was developed to fulfill a need for visualization in exploratory neural data analysis, which can provide intuition that is critical for building scientific hypotheses and models of population activity. PMID:24216250

DataHigh: graphical user interface for visualizing and interacting with high-dimensional neural activity

NASA Astrophysics Data System (ADS)

Cowley, Benjamin R.; Kaufman, Matthew T.; Butler, Zachary S.; Churchland, Mark M.; Ryu, Stephen I.; Shenoy, Krishna V.; Yu, Byron M.

2013-12-01

Objective. Analyzing and interpreting the activity of a heterogeneous population of neurons can be challenging, especially as the number of neurons, experimental trials, and experimental conditions increases. One approach is to extract a set of latent variables that succinctly captures the prominent co-fluctuation patterns across the neural population. A key problem is that the number of latent variables needed to adequately describe the population activity is often greater than 3, thereby preventing direct visualization of the latent space. By visualizing a small number of 2-d projections of the latent space or each latent variable individually, it is easy to miss salient features of the population activity. Approach. To address this limitation, we developed a Matlab graphical user interface (called DataHigh) that allows the user to quickly and smoothly navigate through a continuum of different 2-d projections of the latent space. We also implemented a suite of additional visualization tools (including playing out population activity timecourses as a movie and displaying summary statistics, such as covariance ellipses and average timecourses) and an optional tool for performing dimensionality reduction. Main results. To demonstrate the utility and versatility of DataHigh, we used it to analyze single-trial spike count and single-trial timecourse population activity recorded using a multi-electrode array, as well as trial-averaged population activity recorded using single electrodes. Significance. DataHigh was developed to fulfil a need for visualization in exploratory neural data analysis, which can provide intuition that is critical for building scientific hypotheses and models of population activity.

DataHigh: graphical user interface for visualizing and interacting with high-dimensional neural activity.

PubMed

Cowley, Benjamin R; Kaufman, Matthew T; Butler, Zachary S; Churchland, Mark M; Ryu, Stephen I; Shenoy, Krishna V; Yu, Byron M

2013-12-01

Analyzing and interpreting the activity of a heterogeneous population of neurons can be challenging, especially as the number of neurons, experimental trials, and experimental conditions increases. One approach is to extract a set of latent variables that succinctly captures the prominent co-fluctuation patterns across the neural population. A key problem is that the number of latent variables needed to adequately describe the population activity is often greater than 3, thereby preventing direct visualization of the latent space. By visualizing a small number of 2-d projections of the latent space or each latent variable individually, it is easy to miss salient features of the population activity. To address this limitation, we developed a Matlab graphical user interface (called DataHigh) that allows the user to quickly and smoothly navigate through a continuum of different 2-d projections of the latent space. We also implemented a suite of additional visualization tools (including playing out population activity timecourses as a movie and displaying summary statistics, such as covariance ellipses and average timecourses) and an optional tool for performing dimensionality reduction. To demonstrate the utility and versatility of DataHigh, we used it to analyze single-trial spike count and single-trial timecourse population activity recorded using a multi-electrode array, as well as trial-averaged population activity recorded using single electrodes. DataHigh was developed to fulfil a need for visualization in exploratory neural data analysis, which can provide intuition that is critical for building scientific hypotheses and models of population activity.

Interactive natural language acquisition in a multi-modal recurrent neural architecture

NASA Astrophysics Data System (ADS)

Heinrich, Stefan; Wermter, Stefan

2018-01-01

For the complex human brain that enables us to communicate in natural language, we gathered good understandings of principles underlying language acquisition and processing, knowledge about sociocultural conditions, and insights into activity patterns in the brain. However, we were not yet able to understand the behavioural and mechanistic characteristics for natural language and how mechanisms in the brain allow to acquire and process language. In bridging the insights from behavioural psychology and neuroscience, the goal of this paper is to contribute a computational understanding of appropriate characteristics that favour language acquisition. Accordingly, we provide concepts and refinements in cognitive modelling regarding principles and mechanisms in the brain and propose a neurocognitively plausible model for embodied language acquisition from real-world interaction of a humanoid robot with its environment. In particular, the architecture consists of a continuous time recurrent neural network, where parts have different leakage characteristics and thus operate on multiple timescales for every modality and the association of the higher level nodes of all modalities into cell assemblies. The model is capable of learning language production grounded in both, temporal dynamic somatosensation and vision, and features hierarchical concept abstraction, concept decomposition, multi-modal integration, and self-organisation of latent representations.

Application of Two-Dimensional AWE Algorithm in Training Multi-Dimensional Neural Network Model

DTIC Science & Technology

2003-07-01

hybrid scheme . the general neural network method (Table 3.1). The training process of the software- ACKNOWLEDGMENT "Neuralmodeler" is shown in Fig. 3.2...engineering. Artificial neural networks (ANNs) have emerged Training a neural network model is the key of as a powerful technique for modeling general neural...coefficients am, the derivatives method of moments (MoM). The variables in the of matrix I have to be generated . A closed form model are frequency

Multi-mode energy management strategy for fuel cell electric vehicles based on driving pattern identification using learning vector quantization neural network algorithm

NASA Astrophysics Data System (ADS)

Song, Ke; Li, Feiqiang; Hu, Xiao; He, Lin; Niu, Wenxu; Lu, Sihao; Zhang, Tong

2018-06-01

The development of fuel cell electric vehicles can to a certain extent alleviate worldwide energy and environmental issues. While a single energy management strategy cannot meet the complex road conditions of an actual vehicle, this article proposes a multi-mode energy management strategy for electric vehicles with a fuel cell range extender based on driving condition recognition technology, which contains a patterns recognizer and a multi-mode energy management controller. This paper introduces a learning vector quantization (LVQ) neural network to design the driving patterns recognizer according to a vehicle's driving information. This multi-mode strategy can automatically switch to the genetic algorithm optimized thermostat strategy under specific driving conditions in the light of the differences in condition recognition results. Simulation experiments were carried out based on the model's validity verification using a dynamometer test bench. Simulation results show that the proposed strategy can obtain better economic performance than the single-mode thermostat strategy under dynamic driving conditions.

Deducing the multi-trader population driving a financial market

NASA Astrophysics Data System (ADS)

Gupta, Nachi; Hauser, Raphael; Johnson, Neil

2005-12-01

We have previously laid out a basic framework for predicting financial movements and pockets of predictability by tracking the distribution of a multi-trader population playing on an artificial financial market model. This work explores extensions to this basic framework. We allow for more intelligent agents with a richer strategy set, and we no longer constrain the distribution over these agents to a probability space. We then introduce a fusion scheme which accounts for multiple runs of randomly chosen sets of possible agent types. We also discuss a mechanism for bias removal on the estimates.

Coronary Artery Diagnosis Aided by Neural Network

NASA Astrophysics Data System (ADS)

Stefko, Kamil

2007-01-01

Coronary artery disease is due to atheromatous narrowing and subsequent occlusion of the coronary vessel. Application of optimised feed forward multi-layer back propagation neural network (MLBP) for detection of narrowing in coronary artery vessels is presented in this paper. The research was performed using 580 data records from traditional ECG exercise test confirmed by coronary arteriography results. Each record of training database included description of the state of a patient providing input data for the neural network. Level and slope of ST segment of a 12 lead ECG signal recorded at rest and after effort (48 floating point values) was the main component of input data for neural network was. Coronary arteriography results (verified the existence or absence of more than 50% stenosis of the particular coronary vessels) were used as a correct neural network training output pattern. More than 96% of cases were correctly recognised by especially optimised and a thoroughly verified neural network. Leave one out method was used for neural network verification so 580 data records could be used for training as well as for verification of neural network.

Polygenic risk for five psychiatric disorders and cross-disorder and disorder-specific neural connectivity in two independent populations.

PubMed

Wang, Tianqi; Zhang, Xiaolong; Li, Ang; Zhu, Meifang; Liu, Shu; Qin, Wen; Li, Jin; Yu, Chunshui; Jiang, Tianzi; Liu, Bing

2017-01-01

Major psychiatric disorders, including attention deficit hyperactivity disorder (ADHD), autism (AUT), bipolar disorder (BD), major depressive disorder (MDD), and schizophrenia (SZ), are highly heritable and polygenic. Evidence suggests that these five disorders have both shared and distinct genetic risks and neural connectivity abnormalities. To measure aggregate genetic risks, the polygenic risk score (PGRS) was computed. Two independent general populations (N = 360 and N = 323) were separately examined to investigate whether the cross-disorder PGRS and PGRS for a specific disorder were associated with individual variability in functional connectivity. Consistent altered functional connectivity was found with the bilateral insula: for the left supplementary motor area and the left superior temporal gyrus with the cross-disorder PGRS, for the left insula and right middle and superior temporal lobe associated with the PGRS for autism, for the bilateral midbrain, posterior cingulate, cuneus, and precuneus associated with the PGRS for BD, and for the left angular gyrus and the left dorsolateral prefrontal cortex associated with the PGRS for schizophrenia. No significant functional connectivity was found associated with the PGRS for ADHD and MDD. Our findings indicated that genetic effects on the cross-disorder and disorder-specific neural connectivity of common genetic risk loci are detectable in the general population. Our findings also indicated that polygenic risk contributes to the main neurobiological phenotypes of psychiatric disorders and that identifying cross-disorder and specific functional connectivity related to polygenic risks may elucidate the neural pathways for these disorders.

Thirst Driving and Suppressing Signals Encoded by Distinct Neural Populations in the Brain

PubMed Central

Oka, Yuki; Ye, Mingyu; Zuker, Charles S.

2014-01-01

Thirst is the basic instinct to drink water. Previously, it was shown that neurons in several circumventricular organs (CVO) of the hypothalamus are activated by thirst-inducing conditions 1. Here, we identify two distinct, genetically-separable neural populations in the subfornical organ (SFO) that trigger or suppress thirst. We show that optogenetic activation of SFO excitatory neurons, marked by the expression of the transcription factor ETV-1, evokes intense drinking behavior, and does so even in fully water-satiated animals. The light-induced response is highly specific for water, immediate, and strictly locked to the laser stimulus. In contrast, activation of a second population of SFO neurons, marked by expression of the vesicular GABA transporter VGAT, drastically suppressed drinking, even in water-craving thirsty animals. These results reveal an innate brain circuit that can turn on and off an animal’s water-drinking behavior, and likely functions as a center for thirst control in the mammalian brain. PMID:25624099

Forecasting the mortality rates of Indonesian population by using neural network

NASA Astrophysics Data System (ADS)

Safitri, Lutfiani; Mardiyati, Sri; Rahim, Hendrisman

2018-03-01

A model that can represent a problem is required in conducting a forecasting. One of the models that has been acknowledged by the actuary community in forecasting mortality rate is the Lee-Certer model. Lee Carter model supported by Neural Network will be used to calculate mortality forecasting in Indonesia. The type of Neural Network used is feedforward neural network aligned with backpropagation algorithm in python programming language. And the final result of this study is mortality rate in forecasting Indonesia for the next few years

multi-dice: r package for comparative population genomic inference under hierarchical co-demographic models of independent single-population size changes.

PubMed

Xue, Alexander T; Hickerson, Michael J

2017-11-01

Population genetic data from multiple taxa can address comparative phylogeographic questions about community-scale response to environmental shifts, and a useful strategy to this end is to employ hierarchical co-demographic models that directly test multi-taxa hypotheses within a single, unified analysis. This approach has been applied to classical phylogeographic data sets such as mitochondrial barcodes as well as reduced-genome polymorphism data sets that can yield 10,000s of SNPs, produced by emergent technologies such as RAD-seq and GBS. A strategy for the latter had been accomplished by adapting the site frequency spectrum to a novel summarization of population genomic data across multiple taxa called the aggregate site frequency spectrum (aSFS), which potentially can be deployed under various inferential frameworks including approximate Bayesian computation, random forest and composite likelihood optimization. Here, we introduce the r package multi-dice, a wrapper program that exploits existing simulation software for flexible execution of hierarchical model-based inference using the aSFS, which is derived from reduced genome data, as well as mitochondrial data. We validate several novel software features such as applying alternative inferential frameworks, enforcing a minimal threshold of time surrounding co-demographic pulses and specifying flexible hyperprior distributions. In sum, multi-dice provides comparative analysis within the familiar R environment while allowing a high degree of user customization, and will thus serve as a tool for comparative phylogeography and population genomics. © 2017 The Authors. Molecular Ecology Resources Published by John Wiley & Sons Ltd.

Artificial neural network models for prediction of cardiovascular autonomic dysfunction in general Chinese population

PubMed Central

2013-01-01

Background The present study aimed to develop an artificial neural network (ANN) based prediction model for cardiovascular autonomic (CA) dysfunction in the general population. Methods We analyzed a previous dataset based on a population sample consisted of 2,092 individuals aged 30–80 years. The prediction models were derived from an exploratory set using ANN analysis. Performances of these prediction models were evaluated in the validation set. Results Univariate analysis indicated that 14 risk factors showed statistically significant association with CA dysfunction (P < 0.05). The mean area under the receiver-operating curve was 0.762 (95% CI 0.732–0.793) for prediction model developed using ANN analysis. The mean sensitivity, specificity, positive and negative predictive values were similar in the prediction models was 0.751, 0.665, 0.330 and 0.924, respectively. All HL statistics were less than 15.0. Conclusion ANN is an effective tool for developing prediction models with high value for predicting CA dysfunction among the general population. PMID:23902963

Estimation of corn yield using multi-temporal optical and radar satellite data and artificial neural networks

NASA Astrophysics Data System (ADS)

Fieuzal, R.; Marais Sicre, C.; Baup, F.

2017-05-01

The yield forecasting of corn constitutes a key issue in agricultural management, particularly in the context of demographic pressure and climate change. This study presents two methods to estimate yields using artificial neural networks: a diagnostic approach based on all the satellite data acquired throughout the agricultural season, and a real-time approach, where estimates are updated after each image was acquired in the microwave and optical domains (Formosat-2, Spot-4/5, TerraSAR-X, and Radarsat-2) throughout the crop cycle. The results are based on the Multispectral Crop Monitoring experimental campaign conducted by the CESBIO (Centre d'Études de la BIOsphère) laboratory in 2010 over an agricultural region in southwestern France. Among the tested sensor configurations (multi-frequency, multi-polarization or multi-source data), the best yield estimation performance (using the diagnostic approach) is obtained with reflectance acquired in the red wavelength region, with a coefficient of determination of 0.77 and an RMSE of 6.6 q ha-1. In the real-time approach the combination of red reflectance and CHH backscattering coefficients provides the best compromise between the accuracy and earliness of the yield estimate (more than 3 months before the harvest), with an R2 of 0.69 and an RMSE of 7.0 q ha-1 during the development of the central stem. The two best yield estimates are similar in most cases (for more than 80% of the monitored fields), and the differences are related to discrepancies in the crop growth cycle and/or the consequences of pests.

Satellite rainfall monitoring over Africa using multi-spectral MSG data in an artificial neural network approach

NASA Astrophysics Data System (ADS)

Chadwick, Robin; Grimes, David

2010-05-01

Rainfall monitoring over Africa is crucial for a variety of humanitarian and agricultural purposes, and satellites have been used for some time to provide real-time rainfall estimates over the region. Several recent applications of satellite rainfall estimates, such as flash-flood warning systems and crop-yield models, require accurate rainfall totals at daily timescales or below. Multi-spectral Meteosat Second Generation (MSG) data provide information on cloud properties such as optical depth and cloud particle size and phase. These parameters are all relevant to the probability of rainfall occurring from a cloud and the likely intensity of that rainfall, so the use of MSG data should lead to improved satellite rainfall estimates. An artificial neural network (ANN) using multi-spectral inputs from MSG has been trained to provide daily rainfall estimates over Ethiopia, using daily rain-gauge data for calibration. Although ANN methods have previously been applied to the problem of producing rainfall estimates from multi-spectral satellite data, in general precipitation radar data have been used for calibration. The advantage of using rain-gauge data is that gauges are far more widespread over Africa than radar networks, so this method can be easily transferred and if necessary re-calibrated in different climatological regions of the continent. The ANN estimates have been validated against independent Ethiopian gauge data at a variety of time and space scales. The ANN shows an improvement in accuracy at daily timescale when compared to rainfall estimates from the TAMSAT algorithm, which uses only single channel MSG data.

Artificial bee colony algorithm with dynamic multi-population

NASA Astrophysics Data System (ADS)

Zhang, Ming; Ji, Zhicheng; Wang, Yan

2017-07-01

To improve the convergence rate and make a balance between the global search and local turning abilities, this paper proposes a decentralized form of artificial bee colony (ABC) algorithm with dynamic multi-populations by means of fuzzy C-means (FCM) clustering. Each subpopulation periodically enlarges with the same size during the search process, and the overlapping individuals among different subareas work for delivering information acting as exploring the search space with diffusion of solutions. Moreover, a Gaussian-based search equation with redefined local attractor is proposed to further accelerate the diffusion of the best solution and guide the search towards potential areas. Experimental results on a set of benchmarks demonstrate the competitive performance of our proposed approach.

Cross-Participant EEG-Based Assessment of Cognitive Workload Using Multi-Path Convolutional Recurrent Neural Networks.

PubMed

Hefron, Ryan; Borghetti, Brett; Schubert Kabban, Christine; Christensen, James; Estepp, Justin

2018-04-26

Applying deep learning methods to electroencephalograph (EEG) data for cognitive state assessment has yielded improvements over previous modeling methods. However, research focused on cross-participant cognitive workload modeling using these techniques is underrepresented. We study the problem of cross-participant state estimation in a non-stimulus-locked task environment, where a trained model is used to make workload estimates on a new participant who is not represented in the training set. Using experimental data from the Multi-Attribute Task Battery (MATB) environment, a variety of deep neural network models are evaluated in the trade-space of computational efficiency, model accuracy, variance and temporal specificity yielding three important contributions: (1) The performance of ensembles of individually-trained models is statistically indistinguishable from group-trained methods at most sequence lengths. These ensembles can be trained for a fraction of the computational cost compared to group-trained methods and enable simpler model updates. (2) While increasing temporal sequence length improves mean accuracy, it is not sufficient to overcome distributional dissimilarities between individuals’ EEG data, as it results in statistically significant increases in cross-participant variance. (3) Compared to all other networks evaluated, a novel convolutional-recurrent model using multi-path subnetworks and bi-directional, residual recurrent layers resulted in statistically significant increases in predictive accuracy and decreases in cross-participant variance.

Opacity annotation of diffuse lung diseases using deep convolutional neural network with multi-channel information

NASA Astrophysics Data System (ADS)

Mabu, Shingo; Kido, Shoji; Hashimoto, Noriaki; Hirano, Yasushi; Kuremoto, Takashi

2018-02-01

This research proposes a multi-channel deep convolutional neural network (DCNN) for computer-aided diagnosis (CAD) that classifies normal and abnormal opacities of diffuse lung diseases in Computed Tomography (CT) images. Because CT images are gray scale, DCNN usually uses one channel for inputting image data. On the other hand, this research uses multi-channel DCNN where each channel corresponds to the original raw image or the images transformed by some preprocessing techniques. In fact, the information obtained only from raw images is limited and some conventional research suggested that preprocessing of images contributes to improving the classification accuracy. Thus, the combination of the original and preprocessed images is expected to show higher accuracy. The proposed method realizes region of interest (ROI)-based opacity annotation. We used lung CT images taken in Yamaguchi University Hospital, Japan, and they are divided into 32 × 32 ROI images. The ROIs contain six kinds of opacities: consolidation, ground-glass opacity (GGO), emphysema, honeycombing, nodular, and normal. The aim of the proposed method is to classify each ROI into one of the six opacities (classes). The DCNN structure is based on VGG network that secured the first and second places in ImageNet ILSVRC-2014. From the experimental results, the classification accuracy of the proposed method was better than the conventional method with single channel, and there was a significant difference between them.

Cross-Participant EEG-Based Assessment of Cognitive Workload Using Multi-Path Convolutional Recurrent Neural Networks

PubMed Central

Hefron, Ryan; Borghetti, Brett; Schubert Kabban, Christine; Christensen, James; Estepp, Justin

2018-01-01

Applying deep learning methods to electroencephalograph (EEG) data for cognitive state assessment has yielded improvements over previous modeling methods. However, research focused on cross-participant cognitive workload modeling using these techniques is underrepresented. We study the problem of cross-participant state estimation in a non-stimulus-locked task environment, where a trained model is used to make workload estimates on a new participant who is not represented in the training set. Using experimental data from the Multi-Attribute Task Battery (MATB) environment, a variety of deep neural network models are evaluated in the trade-space of computational efficiency, model accuracy, variance and temporal specificity yielding three important contributions: (1) The performance of ensembles of individually-trained models is statistically indistinguishable from group-trained methods at most sequence lengths. These ensembles can be trained for a fraction of the computational cost compared to group-trained methods and enable simpler model updates. (2) While increasing temporal sequence length improves mean accuracy, it is not sufficient to overcome distributional dissimilarities between individuals’ EEG data, as it results in statistically significant increases in cross-participant variance. (3) Compared to all other networks evaluated, a novel convolutional-recurrent model using multi-path subnetworks and bi-directional, residual recurrent layers resulted in statistically significant increases in predictive accuracy and decreases in cross-participant variance. PMID:29701668

Multi-model ensemble hydrological simulation using a BP Neural Network for the upper Yalongjiang River Basin, China

NASA Astrophysics Data System (ADS)

Li, Zhanjie; Yu, Jingshan; Xu, Xinyi; Sun, Wenchao; Pang, Bo; Yue, Jiajia

2018-06-01

Hydrological models are important and effective tools for detecting complex hydrological processes. Different models have different strengths when capturing the various aspects of hydrological processes. Relying on a single model usually leads to simulation uncertainties. Ensemble approaches, based on multi-model hydrological simulations, can improve application performance over single models. In this study, the upper Yalongjiang River Basin was selected for a case study. Three commonly used hydrological models (SWAT, VIC, and BTOPMC) were selected and used for independent simulations with the same input and initial values. Then, the BP neural network method was employed to combine the results from the three models. The results show that the accuracy of BP ensemble simulation is better than that of the single models.

Phenotypic chemical screening using a zebrafish neural crest EMT reporter identifies retinoic acid as an inhibitor of epithelial morphogenesis

PubMed Central

Jimenez, Laura; Wang, Jindong; Morrison, Monique A.; Whatcott, Clifford; Soh, Katherine K.; Warner, Steven; Bearss, David; Jette, Cicely A.; Stewart, Rodney A.

2016-01-01

ABSTRACT The epithelial-to-mesenchymal transition (EMT) is a highly conserved morphogenetic program essential for embryogenesis, regeneration and cancer metastasis. In cancer cells, EMT also triggers cellular reprogramming and chemoresistance, which underlie disease relapse and decreased survival. Hence, identifying compounds that block EMT is essential to prevent or eradicate disseminated tumor cells. Here, we establish a whole-animal-based EMT reporter in zebrafish for rapid drug screening, called Tg(snai1b:GFP), which labels epithelial cells undergoing EMT to produce sox10-positive neural crest (NC) cells. Time-lapse and lineage analysis of Tg(snai1b:GFP) embryos reveal that cranial NC cells delaminate from two regions: an early population delaminates adjacent to the neural plate, whereas a later population delaminates from within the dorsal neural tube. Treating Tg(snai1b:GFP) embryos with candidate small-molecule EMT-inhibiting compounds identified TP-0903, a multi-kinase inhibitor that blocked cranial NC cell delamination in both the lateral and medial populations. RNA sequencing (RNA-Seq) analysis and chemical rescue experiments show that TP-0903 acts through stimulating retinoic acid (RA) biosynthesis and RA-dependent transcription. These studies identify TP-0903 as a new therapeutic for activating RA in vivo and raise the possibility that RA-dependent inhibition of EMT contributes to its prior success in eliminating disseminated cancer cells. PMID:26794130

A multi-channel low-power system-on-chip for single-unit recording and narrowband wireless transmission of neural signal.

PubMed

Bonfanti, A; Ceravolo, M; Zambra, G; Gusmeroli, R; Spinelli, A S; Lacaita, A L; Angotzi, G N; Baranauskas, G; Fadiga, L

2010-01-01

This paper reports a multi-channel neural recording system-on-chip (SoC) with digital data compression and wireless telemetry. The circuit consists of a 16 amplifiers, an analog time division multiplexer, an 8-bit SAR AD converter, a digital signal processor (DSP) and a wireless narrowband 400-MHz binary FSK transmitter. Even though only 16 amplifiers are present in our current die version, the whole system is designed to work with 64 channels demonstrating the feasibility of a digital processing and narrowband wireless transmission of 64 neural recording channels. A digital data compression, based on the detection of action potentials and storage of correspondent waveforms, allows the use of a 1.25-Mbit/s binary FSK wireless transmission. This moderate bit-rate and a low frequency deviation, Manchester-coded modulation are crucial for exploiting a narrowband wireless link and an efficient embeddable antenna. The chip is realized in a 0.35- εm CMOS process with a power consumption of 105 εW per channel (269 εW per channel with an extended transmission range of 4 m) and an area of 3.1 × 2.7 mm(2). The transmitted signal is captured by a digital TV tuner and demodulated by a wideband phase-locked loop (PLL), and then sent to a PC via an FPGA module. The system has been tested for electrical specifications and its functionality verified in in-vivo neural recording experiments.

Road screening and distribution route multi-objective robust optimization for hazardous materials based on neural network and genetic algorithm.

PubMed

Ma, Changxi; Hao, Wei; Pan, Fuquan; Xiang, Wang

2018-01-01

Route optimization of hazardous materials transportation is one of the basic steps in ensuring the safety of hazardous materials transportation. The optimization scheme may be a security risk if road screening is not completed before the distribution route is optimized. For road screening issues of hazardous materials transportation, a road screening algorithm of hazardous materials transportation is built based on genetic algorithm and Levenberg-Marquardt neural network (GA-LM-NN) by analyzing 15 attributes data of each road network section. A multi-objective robust optimization model with adjustable robustness is constructed for the hazardous materials transportation problem of single distribution center to minimize transportation risk and time. A multi-objective genetic algorithm is designed to solve the problem according to the characteristics of the model. The algorithm uses an improved strategy to complete the selection operation, applies partial matching cross shift and single ortho swap methods to complete the crossover and mutation operation, and employs an exclusive method to construct Pareto optimal solutions. Studies show that the sets of hazardous materials transportation road can be found quickly through the proposed road screening algorithm based on GA-LM-NN, whereas the distribution route Pareto solutions with different levels of robustness can be found rapidly through the proposed multi-objective robust optimization model and algorithm.

Representation of pitch chroma by multi-peak spectral tuning in human auditory cortex

PubMed Central

Moerel, Michelle; De Martino, Federico; Santoro, Roberta; Yacoub, Essa; Formisano, Elia

2015-01-01

Musical notes played at octave intervals (i.e., having the same pitch chroma) are perceived as similar. This well-known perceptual phenomenon lays at the foundation of melody recognition and music perception, yet its neural underpinnings remain largely unknown to date. Using fMRI with high sensitivity and spatial resolution, we examined the contribution of multi-peak spectral tuning to the neural representation of pitch chroma in human auditory cortex in two experiments. In experiment 1, our estimation of population spectral tuning curves from the responses to natural sounds confirmed—with new data—our recent results on the existence of cortical ensemble responses finely tuned to multiple frequencies at one octave distance (Moerel et al., 2013). In experiment 2, we fitted a mathematical model consisting of a pitch chroma and height component to explain the measured fMRI responses to piano notes. This analysis revealed that the octave-tuned populations—but not other cortical populations—harbored a neural representation of musical notes according to their pitch chroma. These results indicate that responses of auditory cortical populations selectively tuned to multiple frequencies at one octave distance predict well the perceptual similarity of musical notes with the same chroma, beyond the physical (frequency) distance of notes. PMID:25479020

Machine Vision Within The Framework Of Collective Neural Assemblies

NASA Astrophysics Data System (ADS)

Gupta, Madan M.; Knopf, George K.

1990-03-01

The proposed mechanism for designing a robust machine vision system is based on the dynamic activity generated by the various neural populations embedded in nervous tissue. It is postulated that a hierarchy of anatomically distinct tissue regions are involved in visual sensory information processing. Each region may be represented as a planar sheet of densely interconnected neural circuits. Spatially localized aggregates of these circuits represent collective neural assemblies. Four dynamically coupled neural populations are assumed to exist within each assembly. In this paper we present a state-variable model for a tissue sheet derived from empirical studies of population dynamics. Each population is modelled as a nonlinear second-order system. It is possible to emulate certain observed physiological and psychophysiological phenomena of biological vision by properly programming the interconnective gains . Important early visual phenomena such as temporal and spatial noise insensitivity, contrast sensitivity and edge enhancement will be discussed for a one-dimensional tissue model.

Study of parameter identification using hybrid neural-genetic algorithm in electro-hydraulic servo system

NASA Astrophysics Data System (ADS)

Moon, Byung-Young

2005-12-01

The hybrid neural-genetic multi-model parameter estimation algorithm was demonstrated. This method can be applied to structured system identification of electro-hydraulic servo system. This algorithms consist of a recurrent incremental credit assignment(ICRA) neural network and a genetic algorithm. The ICRA neural network evaluates each member of a generation of model and genetic algorithm produces new generation of model. To evaluate the proposed method, electro-hydraulic servo system was designed and manufactured. The experiment was carried out to figure out the hybrid neural-genetic multi-model parameter estimation algorithm. As a result, the dynamic characteristics were obtained such as the parameters(mass, damping coefficient, bulk modulus, spring coefficient), which minimize total square error. The result of this study can be applied to hydraulic systems in industrial fields.

Applications of neural network methods to the processing of earth observation satellite data.

PubMed

Loyola, Diego G

2006-03-01

The new generation of earth observation satellites carries advanced sensors that will gather very precise data for studying the Earth system and global climate. This paper shows that neural network methods can be successfully used for solving forward and inverse remote sensing problems, providing both accurate and fast solutions. Two examples of multi-neural network systems for the determination of cloud properties and for the retrieval of total columns of ozone using satellite data are presented. The developed algorithms based on multi-neural network are currently being used for the operational processing of European atmospheric satellite sensors and will play a key role in related satellite missions planed for the near future.

Phylogenetic convolutional neural networks in metagenomics.

PubMed

Fioravanti, Diego; Giarratano, Ylenia; Maggio, Valerio; Agostinelli, Claudio; Chierici, Marco; Jurman, Giuseppe; Furlanello, Cesare

2018-03-08

Convolutional Neural Networks can be effectively used only when data are endowed with an intrinsic concept of neighbourhood in the input space, as is the case of pixels in images. We introduce here Ph-CNN, a novel deep learning architecture for the classification of metagenomics data based on the Convolutional Neural Networks, with the patristic distance defined on the phylogenetic tree being used as the proximity measure. The patristic distance between variables is used together with a sparsified version of MultiDimensional Scaling to embed the phylogenetic tree in a Euclidean space. Ph-CNN is tested with a domain adaptation approach on synthetic data and on a metagenomics collection of gut microbiota of 38 healthy subjects and 222 Inflammatory Bowel Disease patients, divided in 6 subclasses. Classification performance is promising when compared to classical algorithms like Support Vector Machines and Random Forest and a baseline fully connected neural network, e.g. the Multi-Layer Perceptron. Ph-CNN represents a novel deep learning approach for the classification of metagenomics data. Operatively, the algorithm has been implemented as a custom Keras layer taking care of passing to the following convolutional layer not only the data but also the ranked list of neighbourhood of each sample, thus mimicking the case of image data, transparently to the user.

Multi-Frame Convolutional Neural Networks for Object Detection in Temporal Data

DTIC Science & Technology

2017-03-01

maximum 200 words) Given the problem of detecting objects in video , existing neural-network solutions rely on a post-processing step to combine...information across frames and strengthen conclusions. This technique has been successful for videos with simple, dominant objects but it cannot detect objects...Computer Science iii THIS PAGE INTENTIONALLY LEFT BLANK iv ABSTRACT Given the problem of detecting objects in video , existing neural-network solutions rely

Dissociation between Neural Signatures of Stimulus and Choice in Population Activity of Human V1 during Perceptual Decision-Making

PubMed Central

Choe, Kyoung Whan; Blake, Randolph

2014-01-01

Primary visual cortex (V1) forms the initial cortical representation of objects and events in our visual environment, and it distributes information about that representation to higher cortical areas within the visual hierarchy. Decades of work have established tight linkages between neural activity occurring in V1 and features comprising the retinal image, but it remains debatable how that activity relates to perceptual decisions. An actively debated question is the extent to which V1 responses determine, on a trial-by-trial basis, perceptual choices made by observers. By inspecting the population activity of V1 from human observers engaged in a difficult visual discrimination task, we tested one essential prediction of the deterministic view: choice-related activity, if it exists in V1, and stimulus-related activity should occur in the same neural ensemble of neurons at the same time. Our findings do not support this prediction: while cortical activity signifying the variability in choice behavior was indeed found in V1, that activity was dissociated from activity representing stimulus differences relevant to the task, being advanced in time and carried by a different neural ensemble. The spatiotemporal dynamics of population responses suggest that short-term priors, perhaps formed in higher cortical areas involved in perceptual inference, act to modulate V1 activity prior to stimulus onset without modifying subsequent activity that actually represents stimulus features within V1. PMID:24523561

Neural crest contributions to the lamprey head

NASA Technical Reports Server (NTRS)

McCauley, David W.; Bronner-Fraser, Marianne

2003-01-01

The neural crest is a vertebrate-specific cell population that contributes to the facial skeleton and other derivatives. We have performed focal DiI injection into the cranial neural tube of the developing lamprey in order to follow the migratory pathways of discrete groups of cells from origin to destination and to compare neural crest migratory pathways in a basal vertebrate to those of gnathostomes. The results show that the general pathways of cranial neural crest migration are conserved throughout the vertebrates, with cells migrating in streams analogous to the mandibular and hyoid streams. Caudal branchial neural crest cells migrate ventrally as a sheet of cells from the hindbrain and super-pharyngeal region of the neural tube and form a cylinder surrounding a core of mesoderm in each pharyngeal arch, similar to that seen in zebrafish and axolotl. In addition to these similarities, we also uncovered important differences. Migration into the presumptive caudal branchial arches of the lamprey involves both rostral and caudal movements of neural crest cells that have not been described in gnathostomes, suggesting that barriers that constrain rostrocaudal movement of cranial neural crest cells may have arisen after the agnathan/gnathostome split. Accordingly, neural crest cells from a single axial level contributed to multiple arches and there was extensive mixing between populations. There was no apparent filling of neural crest derivatives in a ventral-to-dorsal order, as has been observed in higher vertebrates, nor did we find evidence of a neural crest contribution to cranial sensory ganglia. These results suggest that migratory constraints and additional neural crest derivatives arose later in gnathostome evolution.

Isolation and culture of neural crest cells from embryonic murine neural tube.

PubMed

Pfaltzgraff, Elise R; Mundell, Nathan A; Labosky, Patricia A

2012-06-02

The embryonic neural crest (NC) is a multipotent progenitor population that originates at the dorsal aspect of the neural tube, undergoes an epithelial to mesenchymal transition (EMT) and migrates throughout the embryo, giving rise to diverse cell types. NC also has the unique ability to influence the differentiation and maturation of target organs. When explanted in vitro, NC progenitors undergo self-renewal, migrate and differentiate into a variety of tissue types including neurons, glia, smooth muscle cells, cartilage and bone. NC multipotency was first described from explants of the avian neural tube. In vitro isolation of NC cells facilitates the study of NC dynamics including proliferation, migration, and multipotency. Further work in the avian and rat systems demonstrated that explanted NC cells retain their NC potential when transplanted back into the embryo. Because these inherent cellular properties are preserved in explanted NC progenitors, the neural tube explant assay provides an attractive option for studying the NC in vitro. To attain a better understanding of the mammalian NC, many methods have been employed to isolate NC populations. NC-derived progenitors can be cultured from post-migratory locations in both the embryo and adult to study the dynamics of post-migratory NC progenitors, however isolation of NC progenitors as they emigrate from the neural tube provides optimal preservation of NC cell potential and migratory properties. Some protocols employ fluorescence activated cell sorting (FACS) to isolate a NC population enriched for particular progenitors. However, when starting with early stage embryos, cell numbers adequate for analyses are difficult to obtain with FACS, complicating the isolation of early NC populations from individual embryos. Here, we describe an approach that does not rely on FACS and results in an approximately 96% pure NC population based on a Wnt1-Cre activated lineage reporter. The method presented here is adapted from

Isolation and Culture of Neural Crest Cells from Embryonic Murine Neural Tube

PubMed Central

Pfaltzgraff, Elise R.; Mundell, Nathan A.; Labosky, Patricia A.

2012-01-01

The embryonic neural crest (NC) is a multipotent progenitor population that originates at the dorsal aspect of the neural tube, undergoes an epithelial to mesenchymal transition (EMT) and migrates throughout the embryo, giving rise to diverse cell types 1-3. NC also has the unique ability to influence the differentiation and maturation of target organs4-6. When explanted in vitro, NC progenitors undergo self-renewal, migrate and differentiate into a variety of tissue types including neurons, glia, smooth muscle cells, cartilage and bone. NC multipotency was first described from explants of the avian neural tube7-9. In vitro isolation of NC cells facilitates the study of NC dynamics including proliferation, migration, and multipotency. Further work in the avian and rat systems demonstrated that explanted NC cells retain their NC potential when transplanted back into the embryo10-13. Because these inherent cellular properties are preserved in explanted NC progenitors, the neural tube explant assay provides an attractive option for studying the NC in vitro. To attain a better understanding of the mammalian NC, many methods have been employed to isolate NC populations. NC-derived progenitors can be cultured from post-migratory locations in both the embryo and adult to study the dynamics of post-migratory NC progenitors11,14-20, however isolation of NC progenitors as they emigrate from the neural tube provides optimal preservation of NC cell potential and migratory properties13,21,22. Some protocols employ fluorescence activated cell sorting (FACS) to isolate a NC population enriched for particular progenitors11,13,14,17. However, when starting with early stage embryos, cell numbers adequate for analyses are difficult to obtain with FACS, complicating the isolation of early NC populations from individual embryos. Here, we describe an approach that does not rely on FACS and results in an approximately 96% pure NC population based on a Wnt1-Cre activated lineage reporter

Hardware Acceleration of Adaptive Neural Algorithms.

DOE Office of Scientific and Technical Information (OSTI.GOV)

James, Conrad D.

As tradit ional numerical computing has faced challenges, researchers have turned towards alternative computing approaches to reduce power - per - computation metrics and improve algorithm performance. Here, we describe an approach towards non - conventional computing that strengthens the connection between machine learning and neuroscience concepts. The Hardware Acceleration of Adaptive Neural Algorithms (HAANA) project ha s develop ed neural machine learning algorithms and hardware for applications in image processing and cybersecurity. While machine learning methods are effective at extracting relevant features from many types of data, the effectiveness of these algorithms degrades when subjected to real - worldmore » conditions. Our team has generated novel neural - inspired approa ches to improve the resiliency and adaptability of machine learning algorithms. In addition, we have also designed and fabricated hardware architectures and microelectronic devices specifically tuned towards the training and inference operations of neural - inspired algorithms. Finally, our multi - scale simulation framework allows us to assess the impact of microelectronic device properties on algorithm performance.« less

Neural Categorization of Vibrotactile Frequency in Flutter and Vibration Stimulations: An fMRI Study.

PubMed

Kim, Junsuk; Chung, Yoon Gi; Chung, Soon-Cheol; Bulthoff, Heinrich H; Kim, Sung-Phil

2016-01-01

As the use of wearable haptic devices with vibrating alert features is commonplace, an understanding of the perceptual categorization of vibrotactile frequencies has become important. This understanding can be substantially enhanced by unveiling how neural activity represents vibrotactile frequency information. Using functional magnetic resonance imaging (fMRI), this study investigated categorical clustering patterns of the frequency-dependent neural activity evoked by vibrotactile stimuli with gradually changing frequencies from 20 to 200 Hz. First, a searchlight multi-voxel pattern analysis (MVPA) was used to find brain regions exhibiting neural activities associated with frequency information. We found that the contralateral postcentral gyrus (S1) and the supramarginal gyrus (SMG) carried frequency-dependent information. Next, we applied multidimensional scaling (MDS) to find low-dimensional neural representations of different frequencies obtained from the multi-voxel activity patterns within these regions. The clustering analysis on the MDS results showed that neural activity patterns of 20-100 Hz and 120-200 Hz were divided into two distinct groups. Interestingly, this neural grouping conformed to the perceptual frequency categories found in the previous behavioral studies. Our findings therefore suggest that neural activity patterns in the somatosensory cortical regions may provide a neural basis for the perceptual categorization of vibrotactile frequency.

Multi-strategy coevolving aging particle optimization.

PubMed

Iacca, Giovanni; Caraffini, Fabio; Neri, Ferrante

2014-02-01

We propose Multi-Strategy Coevolving Aging Particles (MS-CAP), a novel population-based algorithm for black-box optimization. In a memetic fashion, MS-CAP combines two components with complementary algorithm logics. In the first stage, each particle is perturbed independently along each dimension with a progressively shrinking (decaying) radius, and attracted towards the current best solution with an increasing force. In the second phase, the particles are mutated and recombined according to a multi-strategy approach in the fashion of the ensemble of mutation strategies in Differential Evolution. The proposed algorithm is tested, at different dimensionalities, on two complete black-box optimization benchmarks proposed at the Congress on Evolutionary Computation 2010 and 2013. To demonstrate the applicability of the approach, we also test MS-CAP to train a Feedforward Neural Network modeling the kinematics of an 8-link robot manipulator. The numerical results show that MS-CAP, for the setting considered in this study, tends to outperform the state-of-the-art optimization algorithms on a large set of problems, thus resulting in a robust and versatile optimizer.

SpikingLab: modelling agents controlled by Spiking Neural Networks in Netlogo.

PubMed

Jimenez-Romero, Cristian; Johnson, Jeffrey

2017-01-01

The scientific interest attracted by Spiking Neural Networks (SNN) has lead to the development of tools for the simulation and study of neuronal dynamics ranging from phenomenological models to the more sophisticated and biologically accurate Hodgkin-and-Huxley-based and multi-compartmental models. However, despite the multiple features offered by neural modelling tools, their integration with environments for the simulation of robots and agents can be challenging and time consuming. The implementation of artificial neural circuits to control robots generally involves the following tasks: (1) understanding the simulation tools, (2) creating the neural circuit in the neural simulator, (3) linking the simulated neural circuit with the environment of the agent and (4) programming the appropriate interface in the robot or agent to use the neural controller. The accomplishment of the above-mentioned tasks can be challenging, especially for undergraduate students or novice researchers. This paper presents an alternative tool which facilitates the simulation of simple SNN circuits using the multi-agent simulation and the programming environment Netlogo (educational software that simplifies the study and experimentation of complex systems). The engine proposed and implemented in Netlogo for the simulation of a functional model of SNN is a simplification of integrate and fire (I&F) models. The characteristics of the engine (including neuronal dynamics, STDP learning and synaptic delay) are demonstrated through the implementation of an agent representing an artificial insect controlled by a simple neural circuit. The setup of the experiment and its outcomes are described in this work.

Computing with Neural Synchrony

PubMed Central

Brette, Romain

2012-01-01

Neurons communicate primarily with spikes, but most theories of neural computation are based on firing rates. Yet, many experimental observations suggest that the temporal coordination of spikes plays a role in sensory processing. Among potential spike-based codes, synchrony appears as a good candidate because neural firing and plasticity are sensitive to fine input correlations. However, it is unclear what role synchrony may play in neural computation, and what functional advantage it may provide. With a theoretical approach, I show that the computational interest of neural synchrony appears when neurons have heterogeneous properties. In this context, the relationship between stimuli and neural synchrony is captured by the concept of synchrony receptive field, the set of stimuli which induce synchronous responses in a group of neurons. In a heterogeneous neural population, it appears that synchrony patterns represent structure or sensory invariants in stimuli, which can then be detected by postsynaptic neurons. The required neural circuitry can spontaneously emerge with spike-timing-dependent plasticity. Using examples in different sensory modalities, I show that this allows simple neural circuits to extract relevant information from realistic sensory stimuli, for example to identify a fluctuating odor in the presence of distractors. This theory of synchrony-based computation shows that relative spike timing may indeed have computational relevance, and suggests new types of neural network models for sensory processing with appealing computational properties. PMID:22719243

Convolutional neural network for road extraction

NASA Astrophysics Data System (ADS)

Li, Junping; Ding, Yazhou; Feng, Fajie; Xiong, Baoyu; Cui, Weihong

2017-11-01

In this paper, the convolution neural network with large block input and small block output was used to extract road. To reflect the complex road characteristics in the study area, a deep convolution neural network VGG19 was conducted for road extraction. Based on the analysis of the characteristics of different sizes of input block, output block and the extraction effect, the votes of deep convolutional neural networks was used as the final road prediction. The study image was from GF-2 panchromatic and multi-spectral fusion in Yinchuan. The precision of road extraction was 91%. The experiments showed that model averaging can improve the accuracy to some extent. At the same time, this paper gave some advice about the choice of input block size and output block size.

Image-Based Multi-Target Tracking through Multi-Bernoulli Filtering with Interactive Likelihoods.

PubMed

Hoak, Anthony; Medeiros, Henry; Povinelli, Richard J

2017-03-03

We develop an interactive likelihood (ILH) for sequential Monte Carlo (SMC) methods for image-based multiple target tracking applications. The purpose of the ILH is to improve tracking accuracy by reducing the need for data association. In addition, we integrate a recently developed deep neural network for pedestrian detection along with the ILH with a multi-Bernoulli filter. We evaluate the performance of the multi-Bernoulli filter with the ILH and the pedestrian detector in a number of publicly available datasets (2003 PETS INMOVE, Australian Rules Football League (AFL) and TUD-Stadtmitte) using standard, well-known multi-target tracking metrics (optimal sub-pattern assignment (OSPA) and classification of events, activities and relationships for multi-object trackers (CLEAR MOT)). In all datasets, the ILH term increases the tracking accuracy of the multi-Bernoulli filter.

Image-Based Multi-Target Tracking through Multi-Bernoulli Filtering with Interactive Likelihoods

PubMed Central

Hoak, Anthony; Medeiros, Henry; Povinelli, Richard J.

2017-01-01

We develop an interactive likelihood (ILH) for sequential Monte Carlo (SMC) methods for image-based multiple target tracking applications. The purpose of the ILH is to improve tracking accuracy by reducing the need for data association. In addition, we integrate a recently developed deep neural network for pedestrian detection along with the ILH with a multi-Bernoulli filter. We evaluate the performance of the multi-Bernoulli filter with the ILH and the pedestrian detector in a number of publicly available datasets (2003 PETS INMOVE, Australian Rules Football League (AFL) and TUD-Stadtmitte) using standard, well-known multi-target tracking metrics (optimal sub-pattern assignment (OSPA) and classification of events, activities and relationships for multi-object trackers (CLEAR MOT)). In all datasets, the ILH term increases the tracking accuracy of the multi-Bernoulli filter. PMID:28273796

Neural Activity Patterns in the Human Brain Reflect Tactile Stickiness Perception.

PubMed

Kim, Junsuk; Yeon, Jiwon; Ryu, Jaekyun; Park, Jang-Yeon; Chung, Soon-Cheol; Kim, Sung-Phil

2017-01-01

Our previous human fMRI study found brain activations correlated with tactile stickiness perception using the uni-variate general linear model (GLM) (Yeon et al., 2017). Here, we conducted an in-depth investigation on neural correlates of sticky sensations by employing a multivoxel pattern analysis (MVPA) on the same dataset. In particular, we statistically compared multi-variate neural activities in response to the three groups of sticky stimuli: A supra-threshold group including a set of sticky stimuli that evoked vivid sticky perception; an infra-threshold group including another set of sticky stimuli that barely evoked sticky perception; and a sham group including acrylic stimuli with no physically sticky property. Searchlight MVPAs were performed to search for local activity patterns carrying neural information of stickiness perception. Similar to the uni-variate GLM results, significant multi-variate neural activity patterns were identified in postcentral gyrus, subcortical (basal ganglia and thalamus), and insula areas (insula and adjacent areas). Moreover, MVPAs revealed that activity patterns in posterior parietal cortex discriminated the perceptual intensities of stickiness, which was not present in the uni-variate analysis. Next, we applied a principal component analysis (PCA) to the voxel response patterns within identified clusters so as to find low-dimensional neural representations of stickiness intensities. Follow-up clustering analyses clearly showed separate neural grouping configurations between the Supra- and Infra-threshold groups. Interestingly, this neural categorization was in line with the perceptual grouping pattern obtained from the psychophysical data. Our findings thus suggest that different stickiness intensities would elicit distinct neural activity patterns in the human brain and may provide a neural basis for the perception and categorization of tactile stickiness.

Neural Activity Patterns in the Human Brain Reflect Tactile Stickiness Perception

PubMed Central

Kim, Junsuk; Yeon, Jiwon; Ryu, Jaekyun; Park, Jang-Yeon; Chung, Soon-Cheol; Kim, Sung-Phil

2017-01-01

Our previous human fMRI study found brain activations correlated with tactile stickiness perception using the uni-variate general linear model (GLM) (Yeon et al., 2017). Here, we conducted an in-depth investigation on neural correlates of sticky sensations by employing a multivoxel pattern analysis (MVPA) on the same dataset. In particular, we statistically compared multi-variate neural activities in response to the three groups of sticky stimuli: A supra-threshold group including a set of sticky stimuli that evoked vivid sticky perception; an infra-threshold group including another set of sticky stimuli that barely evoked sticky perception; and a sham group including acrylic stimuli with no physically sticky property. Searchlight MVPAs were performed to search for local activity patterns carrying neural information of stickiness perception. Similar to the uni-variate GLM results, significant multi-variate neural activity patterns were identified in postcentral gyrus, subcortical (basal ganglia and thalamus), and insula areas (insula and adjacent areas). Moreover, MVPAs revealed that activity patterns in posterior parietal cortex discriminated the perceptual intensities of stickiness, which was not present in the uni-variate analysis. Next, we applied a principal component analysis (PCA) to the voxel response patterns within identified clusters so as to find low-dimensional neural representations of stickiness intensities. Follow-up clustering analyses clearly showed separate neural grouping configurations between the Supra- and Infra-threshold groups. Interestingly, this neural categorization was in line with the perceptual grouping pattern obtained from the psychophysical data. Our findings thus suggest that different stickiness intensities would elicit distinct neural activity patterns in the human brain and may provide a neural basis for the perception and categorization of tactile stickiness. PMID:28936171

Development of module for neural network identification of attacks on applications and services in multi-cloud platforms

NASA Astrophysics Data System (ADS)

Parfenov, D. I.; Bolodurina, I. P.

2018-05-01

The article presents the results of developing an approach to detecting and protecting against network attacks on the corporate infrastructure deployed on the multi-cloud platform. The proposed approach is based on the combination of two technologies: a softwareconfigurable network and virtualization of network functions. The approach for searching for anomalous traffic is to use a hybrid neural network consisting of a self-organizing Kohonen network and a multilayer perceptron. The study of the work of the prototype of the system for detecting attacks, the method of forming a learning sample, and the course of experiments are described. The study showed that using the proposed approach makes it possible to increase the effectiveness of the obfuscation of various types of attacks and at the same time does not reduce the performance of the network

Msx1-Positive Progenitors in the Retinal Ciliary Margin Give Rise to Both Neural and Non-neural Progenies in Mammals.

PubMed

Bélanger, Marie-Claude; Robert, Benoit; Cayouette, Michel

2017-01-23

In lower vertebrates, stem/progenitor cells located in a peripheral domain of the retina, called the ciliary margin zone (CMZ), cooperate with retinal domain progenitors to build the mature neural retina. In mammals, it is believed that the CMZ lacks neurogenic potential and that the retina develops from one pool of multipotent retinal progenitor cells (RPCs). Here we identify a population of Msx1-expressing progenitors in the mouse CMZ that is both molecularly and functionally distinct from RPCs. Using genetic lineage tracing, we report that Msx1 progenitors have unique developmental properties compared with RPCs. Msx1 lineages contain both neural retina and non-neural ciliary epithelial progenies and overall generate fewer photoreceptors than classical RPC lineages. Furthermore, we show that the endocytic adaptor protein Numb regulates the balance between neural and non-neural fates in Msx1 progenitors. These results uncover a population of CMZ progenitors, distinct from classical RPCs, that also contributes to mammalian retinogenesis. Copyright © 2017 Elsevier Inc. All rights reserved.

An application of artificial neural intelligence for personal dose assessment using a multi-area OSL dosimetry system.

PubMed

Lee, S Y; Kim, B H; Lee, K J

2001-06-01

Significant advances have been made in recent years to improve measurement technology and performance of phosphor materials in the fields of optically stimulated luminescence (OSL) dosimetry. Pulsed and continuous wave OSL studies recently carried out on alpha-Al2O3:C have shown that the material seems to be the most promising for routine application of OSL for dosimetric purposes. The main objective of the study is to propose a new personal dosimetry system using alpha-Al2O3:C by taking advantage of its optical properties and energy dependencies. In the process of the study, a new dose assessment algorithm was developed using artificial neural networks in hopes of achieving a higher degree of accuracy and precision in personal OSL dosimetry system. The original hypothesis of this work is that the spectral information of X- and gamma-ray fields may be obtained by the analysis of the response of a multi-element system. In this study, a feedforward neural network using the error back-propagation method with Bayesian optimization was applied for the response unfolding procedure. The validation of the proposed algorithm was investigated by unfolding the 10 measured responses of alpha-Al2O3:C for arbitrarily mixed photon fields which range from 20 to 662 keV. c2001 Elsevier Science Ltd. All rights reserved.

Artificial neural network cardiopulmonary modeling and diagnosis

DOEpatents

Kangas, L.J.; Keller, P.E.

1997-10-28

The present invention is a method of diagnosing a cardiopulmonary condition in an individual by comparing data from a progressive multi-stage test for the individual to a non-linear multi-variate model, preferably a recurrent artificial neural network having sensor fusion. The present invention relies on a cardiovascular model developed from physiological measurements of an individual. Any differences between the modeled parameters and the parameters of an individual at a given time are used for diagnosis. 12 figs.

Artificial neural network cardiopulmonary modeling and diagnosis

DOEpatents

Kangas, Lars J.; Keller, Paul E.

1997-01-01

The present invention is a method of diagnosing a cardiopulmonary condition in an individual by comparing data from a progressive multi-stage test for the individual to a non-linear multi-variate model, preferably a recurrent artificial neural network having sensor fusion. The present invention relies on a cardiovascular model developed from physiological measurements of an individual. Any differences between the modeled parameters and the parameters of an individual at a given time are used for diagnosis.

3D High Resolution Mesh Deformation Based on Multi Library Wavelet Neural Network Architecture

NASA Astrophysics Data System (ADS)

Dhibi, Naziha; Elkefi, Akram; Bellil, Wajdi; Amar, Chokri Ben

2016-12-01

This paper deals with the features of a novel technique for large Laplacian boundary deformations using estimated rotations. The proposed method is based on a Multi Library Wavelet Neural Network structure founded on several mother wavelet families (MLWNN). The objective is to align features of mesh and minimize distortion with a fixed feature that minimizes the sum of the distances between all corresponding vertices. New mesh deformation method worked in the domain of Region of Interest (ROI). Our approach computes deformed ROI, updates and optimizes it to align features of mesh based on MLWNN and spherical parameterization configuration. This structure has the advantage of constructing the network by several mother wavelets to solve high dimensions problem using the best wavelet mother that models the signal better. The simulation test achieved the robustness and speed considerations when developing deformation methodologies. The Mean-Square Error and the ratio of deformation are low compared to other works from the state of the art. Our approach minimizes distortions with fixed features to have a well reconstructed object.

Vertically aligned carbon nanofiber as nano-neuron interface for monitoring neural function

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ericson, Milton Nance; McKnight, Timothy E; Melechko, Anatoli Vasilievich

2012-01-01

Neural chips, which are capable of simultaneous, multi-site neural recording and stimulation, have been used to detect and modulate neural activity for almost 30 years. As a neural interface, neural chips provide dynamic functional information for neural decoding and neural control. By improving sensitivity and spatial resolution, nano-scale electrodes may revolutionize neural detection and modulation at cellular and molecular levels as nano-neuron interfaces. We developed a carbon-nanofiber neural chip with lithographically defined arrays of vertically aligned carbon nanofiber electrodes and demonstrated its capability of both stimulating and monitoring electrophysiological signals from brain tissues in vitro and monitoring dynamic information ofmore » neuroplasticity. This novel nano-neuron interface can potentially serve as a precise, informative, biocompatible, and dual-mode neural interface for monitoring of both neuroelectrical and neurochemical activity at the single cell level and even inside the cell.« less

Chimera States in Neural Oscillators

NASA Astrophysics Data System (ADS)

Bahar, Sonya; Glaze, Tera

2014-03-01

Chimera states have recently been explored both theoretically and experimentally, in various coupled nonlinear oscillators, ranging from phase-oscillator models to coupled chemical reactions. In a chimera state, both coherent and incoherent (or synchronized and desynchronized) states occur simultaneously in populations of identical oscillators. We investigate chimera behavior in a population of neural oscillators using the Huber-Braun model, a Hodgkin-Huxley-like model originally developed to characterize the temperature-dependent bursting behavior of mammalian cold receptors. One population of neurons is allowed to synchronize, with each neuron receiving input from all the others in its group (global within-group coupling). Subsequently, a second population of identical neurons is placed under an identical global within-group coupling, and the two populations are also coupled to each other (between-group coupling). For certain values of the coupling constants, the neurons in the two populations exhibit radically different synchronization behavior. We will discuss the range of chimera activity in the model, and discuss its implications for actual neural activity, such as unihemispheric sleep.

Portfolio theory as a management tool to guide conservation and restoration of multi-stock fish populations

USGS Publications Warehouse

DuFour, Mark R.; May, Cassandra J.; Roseman, Edward F.; Ludsin, Stuart A.; Vandergoot, Christopher S.; Pritt, Jeremy J.; Fraker, Michael E.; Davis, Jeremiah J.; Tyson, Jeffery T.; Miner, Jeffery G.; Marschall, Elizabeth A.; Mayer, Christine M.

2015-01-01

Habitat degradation and harvest have upset the natural buffering mechanism (i.e., portfolio effects) of many large-scale multi-stock fisheries by reducing spawning stock diversity that is vital for generating population stability and resilience. The application of portfolio theory offers a means to guide management activities by quantifying the importance of multi-stock dynamics and suggesting conservation and restoration strategies to improve naturally occurring portfolio effects. Our application of portfolio theory to Lake Erie Sander vitreus (walleye), a large population that is supported by riverine and open-lake reef spawning stocks, has shown that portfolio effects generated by annual inter-stock larval fish production are currently suboptimal when compared to potential buffering capacity. Reduced production from riverine stocks has resulted in a single open-lake reef stock dominating larval production, and in turn, high inter-annual recruitment variability during recent years. Our analyses have shown (1) a weak average correlation between annual river and reef larval production (ρ̄ = 0.24), suggesting that a natural buffering capacity exists in the population, and (2) expanded annual production of larvae (potential recruits) from riverine stocks could stabilize the fishery by dampening inter-annual recruitment variation. Ultimately, our results demonstrate how portfolio theory can be used to quantify the importance of spawning stock diversity and guide management on ecologically relevant scales (i.e., spawning stocks) leading to greater stability and resilience of multi-stock populations and fisheries.

Neural decoding of attentional selection in multi-speaker environments without access to clean sources

NASA Astrophysics Data System (ADS)

O'Sullivan, James; Chen, Zhuo; Herrero, Jose; McKhann, Guy M.; Sheth, Sameer A.; Mehta, Ashesh D.; Mesgarani, Nima

2017-10-01

Objective. People who suffer from hearing impairments can find it difficult to follow a conversation in a multi-speaker environment. Current hearing aids can suppress background noise; however, there is little that can be done to help a user attend to a single conversation amongst many without knowing which speaker the user is attending to. Cognitively controlled hearing aids that use auditory attention decoding (AAD) methods are the next step in offering help. Translating the successes in AAD research to real-world applications poses a number of challenges, including the lack of access to the clean sound sources in the environment with which to compare with the neural signals. We propose a novel framework that combines single-channel speech separation algorithms with AAD. Approach. We present an end-to-end system that (1) receives a single audio channel containing a mixture of speakers that is heard by a listener along with the listener’s neural signals, (2) automatically separates the individual speakers in the mixture, (3) determines the attended speaker, and (4) amplifies the attended speaker’s voice to assist the listener. Main results. Using invasive electrophysiology recordings, we identified the regions of the auditory cortex that contribute to AAD. Given appropriate electrode locations, our system is able to decode the attention of subjects and amplify the attended speaker using only the mixed audio. Our quality assessment of the modified audio demonstrates a significant improvement in both subjective and objective speech quality measures. Significance. Our novel framework for AAD bridges the gap between the most recent advancements in speech processing technologies and speech prosthesis research and moves us closer to the development of cognitively controlled hearable devices for the hearing impaired.

A cortical neural prosthesis for restoring and enhancing memory

NASA Astrophysics Data System (ADS)

Berger, Theodore W.; Hampson, Robert E.; Song, Dong; Goonawardena, Anushka; Marmarelis, Vasilis Z.; Deadwyler, Sam A.

2011-08-01

A primary objective in developing a neural prosthesis is to replace neural circuitry in the brain that no longer functions appropriately. Such a goal requires artificial reconstruction of neuron-to-neuron connections in a way that can be recognized by the remaining normal circuitry, and that promotes appropriate interaction. In this study, the application of a specially designed neural prosthesis using a multi-input/multi-output (MIMO) nonlinear model is demonstrated by using trains of electrical stimulation pulses to substitute for MIMO model derived ensemble firing patterns. Ensembles of CA3 and CA1 hippocampal neurons, recorded from rats performing a delayed-nonmatch-to-sample (DNMS) memory task, exhibited successful encoding of trial-specific sample lever information in the form of different spatiotemporal firing patterns. MIMO patterns, identified online and in real-time, were employed within a closed-loop behavioral paradigm. Results showed that the model was able to predict successful performance on the same trial. Also, MIMO model-derived patterns, delivered as electrical stimulation to the same electrodes, improved performance under normal testing conditions and, more importantly, were capable of recovering performance when delivered to animals with ensemble hippocampal activity compromised by pharmacologic blockade of synaptic transmission. These integrated experimental-modeling studies show for the first time that, with sufficient information about the neural coding of memories, a neural prosthesis capable of real-time diagnosis and manipulation of the encoding process can restore and even enhance cognitive, mnemonic processes.

Constructing general partial differential equations using polynomial and neural networks.

PubMed

Zjavka, Ladislav; Pedrycz, Witold

2016-01-01

Sum fraction terms can approximate multi-variable functions on the basis of discrete observations, replacing a partial differential equation definition with polynomial elementary data relation descriptions. Artificial neural networks commonly transform the weighted sum of inputs to describe overall similarity relationships of trained and new testing input patterns. Differential polynomial neural networks form a new class of neural networks, which construct and solve an unknown general partial differential equation of a function of interest with selected substitution relative terms using non-linear multi-variable composite polynomials. The layers of the network generate simple and composite relative substitution terms whose convergent series combinations can describe partial dependent derivative changes of the input variables. This regression is based on trained generalized partial derivative data relations, decomposed into a multi-layer polynomial network structure. The sigmoidal function, commonly used as a nonlinear activation of artificial neurons, may transform some polynomial items together with the parameters with the aim to improve the polynomial derivative term series ability to approximate complicated periodic functions, as simple low order polynomials are not able to fully make up for the complete cycles. The similarity analysis facilitates substitutions for differential equations or can form dimensional units from data samples to describe real-world problems. Copyright © 2015 Elsevier Ltd. All rights reserved.

Population structuring of multi-copy, antigen-encoding genes in Plasmodium falciparum

PubMed Central

Artzy-Randrup, Yael; Rorick, Mary M; Day, Karen; Chen, Donald; Dobson, Andrew P; Pascual, Mercedes

2012-01-01

The coexistence of multiple independently circulating strains in pathogen populations that undergo sexual recombination is a central question of epidemiology with profound implications for control. An agent-based model is developed that extends earlier ‘strain theory’ by addressing the var gene family of Plasmodium falciparum. The model explicitly considers the extensive diversity of multi-copy genes that undergo antigenic variation via sequential, mutually exclusive expression. It tracks the dynamics of all unique var repertoires in a population of hosts, and shows that even under high levels of sexual recombination, strain competition mediated through cross-immunity structures the parasite population into a subset of coexisting dominant repertoires of var genes whose degree of antigenic overlap depends on transmission intensity. Empirical comparison of patterns of genetic variation at antigenic and neutral sites supports this role for immune selection in structuring parasite diversity. DOI: http://dx.doi.org/10.7554/eLife.00093.001 PMID:23251784

Multi-Agent Inference in Social Networks: A Finite Population Learning Approach.

PubMed

Fan, Jianqing; Tong, Xin; Zeng, Yao

When people in a society want to make inference about some parameter, each person may want to use data collected by other people. Information (data) exchange in social networks is usually costly, so to make reliable statistical decisions, people need to trade off the benefits and costs of information acquisition. Conflicts of interests and coordination problems will arise in the process. Classical statistics does not consider people's incentives and interactions in the data collection process. To address this imperfection, this work explores multi-agent Bayesian inference problems with a game theoretic social network model. Motivated by our interest in aggregate inference at the societal level, we propose a new concept, finite population learning , to address whether with high probability, a large fraction of people in a given finite population network can make "good" inference. Serving as a foundation, this concept enables us to study the long run trend of aggregate inference quality as population grows.

Multi-Agent Inference in Social Networks: A Finite Population Learning Approach

PubMed Central

Tong, Xin; Zeng, Yao

2016-01-01

When people in a society want to make inference about some parameter, each person may want to use data collected by other people. Information (data) exchange in social networks is usually costly, so to make reliable statistical decisions, people need to trade off the benefits and costs of information acquisition. Conflicts of interests and coordination problems will arise in the process. Classical statistics does not consider people’s incentives and interactions in the data collection process. To address this imperfection, this work explores multi-agent Bayesian inference problems with a game theoretic social network model. Motivated by our interest in aggregate inference at the societal level, we propose a new concept, finite population learning, to address whether with high probability, a large fraction of people in a given finite population network can make “good” inference. Serving as a foundation, this concept enables us to study the long run trend of aggregate inference quality as population grows. PMID:27076691

Multi-Lingual Deep Neural Networks for Language Recognition

DTIC Science & Technology

2016-08-08

training configurations for the NIST 2011 and 2015 lan- guage recognition evaluations (LRE11 and LRE15). The best per- forming multi-lingual BN-DNN...very ef- fective approach in the NIST 2015 language recognition evaluation (LRE15) open training condition [4, 5]. In this work we evaluate the impact...language are summarized in Table 2. Two language recognition tasks are used for evaluating the multi-lingual bottleneck systems. The first is the NIST

Neural coding in graphs of bidirectional associative memories.

PubMed

Bouchain, A David; Palm, Günther

2012-01-24

In the last years we have developed large neural network models for the realization of complex cognitive tasks in a neural network architecture that resembles the network of the cerebral cortex. We have used networks of several cortical modules that contain two populations of neurons (one excitatory, one inhibitory). The excitatory populations in these so-called "cortical networks" are organized as a graph of Bidirectional Associative Memories (BAMs), where edges of the graph correspond to BAMs connecting two neural modules and nodes of the graph correspond to excitatory populations with associative feedback connections (and inhibitory interneurons). The neural code in each of these modules consists essentially of the firing pattern of the excitatory population, where mainly it is the subset of active neurons that codes the contents to be represented. The overall activity can be used to distinguish different properties of the patterns that are represented which we need to distinguish and control when performing complex tasks like language understanding with these cortical networks. The most important pattern properties or situations are: exactly fitting or matching input, incomplete information or partially matching pattern, superposition of several patterns, conflicting information, and new information that is to be learned. We show simple simulations of these situations in one area or module and discuss how to distinguish these situations based on the overall internal activation of the module. This article is part of a Special Issue entitled "Neural Coding". Copyright © 2011 Elsevier B.V. All rights reserved.

Artificial Neural Networks: A Novel Approach to Analysing the Nutritional Ecology of a Blowfly Species, Chrysomya megacephala

PubMed Central

Bianconi, André; Zuben, Cláudio J. Von; Serapião, Adriane B. de S.; Govone, José S.

2010-01-01

Bionomic features of blowflies may be clarified and detailed by the deployment of appropriate modelling techniques such as artificial neural networks, which are mathematical tools widely applied to the resolution of complex biological problems. The principal aim of this work was to use three well-known neural networks, namely Multi-Layer Perceptron (MLP), Radial Basis Function (RBF), and Adaptive Neural Network-Based Fuzzy Inference System (ANFIS), to ascertain whether these tools would be able to outperform a classical statistical method (multiple linear regression) in the prediction of the number of resultant adults (survivors) of experimental populations of Chrysomya megacephala (F.) (Diptera: Calliphoridae), based on initial larval density (number of larvae), amount of available food, and duration of immature stages. The coefficient of determination (R2) derived from the RBF was the lowest in the testing subset in relation to the other neural networks, even though its R2 in the training subset exhibited virtually a maximum value. The ANFIS model permitted the achievement of the best testing performance. Hence this model was deemed to be more effective in relation to MLP and RBF for predicting the number of survivors. All three networks outperformed the multiple linear regression, indicating that neural models could be taken as feasible techniques for predicting bionomic variables concerning the nutritional dynamics of blowflies. PMID:20569135

Multi-Population Invariance with Dichotomous Measures: Combining Multi-Group and MIMIC Methodologies in Evaluating the General Aptitude Test in the Arabic Language

ERIC Educational Resources Information Center

Sideridis, Georgios D.; Tsaousis, Ioannis; Al-harbi, Khaleel A.

2015-01-01

The purpose of the present study was to extend the model of measurement invariance by simultaneously estimating invariance across multiple populations in the dichotomous instrument case using multi-group confirmatory factor analytic and multiple indicator multiple causes (MIMIC) methodologies. Using the Arabic version of the General Aptitude Test…

Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database

PubMed Central

Seo, Jeong Gi; Kwak, Jiyong; Um, Terry Taewoong; Rim, Tyler Hyungtaek

2017-01-01

Deep learning emerges as a powerful tool for analyzing medical images. Retinal disease detection by using computer-aided diagnosis from fundus image has emerged as a new method. We applied deep learning convolutional neural network by using MatConvNet for an automated detection of multiple retinal diseases with fundus photographs involved in STructured Analysis of the REtina (STARE) database. Dataset was built by expanding data on 10 categories, including normal retina and nine retinal diseases. The optimal outcomes were acquired by using a random forest transfer learning based on VGG-19 architecture. The classification results depended greatly on the number of categories. As the number of categories increased, the performance of deep learning models was diminished. When all 10 categories were included, we obtained results with an accuracy of 30.5%, relative classifier information (RCI) of 0.052, and Cohen’s kappa of 0.224. Considering three integrated normal, background diabetic retinopathy, and dry age-related macular degeneration, the multi-categorical classifier showed accuracy of 72.8%, 0.283 RCI, and 0.577 kappa. In addition, several ensemble classifiers enhanced the multi-categorical classification performance. The transfer learning incorporated with ensemble classifier of clustering and voting approach presented the best performance with accuracy of 36.7%, 0.053 RCI, and 0.225 kappa in the 10 retinal diseases classification problem. First, due to the small size of datasets, the deep learning techniques in this study were ineffective to be applied in clinics where numerous patients suffering from various types of retinal disorders visit for diagnosis and treatment. Second, we found that the transfer learning incorporated with ensemble classifiers can improve the classification performance in order to detect multi-categorical retinal diseases. Further studies should confirm the effectiveness of algorithms with large datasets obtained from hospitals. PMID

Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database.

PubMed

Choi, Joon Yul; Yoo, Tae Keun; Seo, Jeong Gi; Kwak, Jiyong; Um, Terry Taewoong; Rim, Tyler Hyungtaek

2017-01-01

Deep learning emerges as a powerful tool for analyzing medical images. Retinal disease detection by using computer-aided diagnosis from fundus image has emerged as a new method. We applied deep learning convolutional neural network by using MatConvNet for an automated detection of multiple retinal diseases with fundus photographs involved in STructured Analysis of the REtina (STARE) database. Dataset was built by expanding data on 10 categories, including normal retina and nine retinal diseases. The optimal outcomes were acquired by using a random forest transfer learning based on VGG-19 architecture. The classification results depended greatly on the number of categories. As the number of categories increased, the performance of deep learning models was diminished. When all 10 categories were included, we obtained results with an accuracy of 30.5%, relative classifier information (RCI) of 0.052, and Cohen's kappa of 0.224. Considering three integrated normal, background diabetic retinopathy, and dry age-related macular degeneration, the multi-categorical classifier showed accuracy of 72.8%, 0.283 RCI, and 0.577 kappa. In addition, several ensemble classifiers enhanced the multi-categorical classification performance. The transfer learning incorporated with ensemble classifier of clustering and voting approach presented the best performance with accuracy of 36.7%, 0.053 RCI, and 0.225 kappa in the 10 retinal diseases classification problem. First, due to the small size of datasets, the deep learning techniques in this study were ineffective to be applied in clinics where numerous patients suffering from various types of retinal disorders visit for diagnosis and treatment. Second, we found that the transfer learning incorporated with ensemble classifiers can improve the classification performance in order to detect multi-categorical retinal diseases. Further studies should confirm the effectiveness of algorithms with large datasets obtained from hospitals.

Beyond mind-reading: multi-voxel pattern analysis of fMRI data.

PubMed

Norman, Kenneth A; Polyn, Sean M; Detre, Greg J; Haxby, James V

2006-09-01

A key challenge for cognitive neuroscience is determining how mental representations map onto patterns of neural activity. Recently, researchers have started to address this question by applying sophisticated pattern-classification algorithms to distributed (multi-voxel) patterns of functional MRI data, with the goal of decoding the information that is represented in the subject's brain at a particular point in time. This multi-voxel pattern analysis (MVPA) approach has led to several impressive feats of mind reading. More importantly, MVPA methods constitute a useful new tool for advancing our understanding of neural information processing. We review how researchers are using MVPA methods to characterize neural coding and information processing in domains ranging from visual perception to memory search.

Variable Neural Adaptive Robust Control: A Switched System Approach

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lian, Jianming; Hu, Jianghai; Zak, Stanislaw H.

2015-05-01

Variable neural adaptive robust control strategies are proposed for the output tracking control of a class of multi-input multi-output uncertain systems. The controllers incorporate a variable-structure radial basis function (RBF) network as the self-organizing approximator for unknown system dynamics. The variable-structure RBF network solves the problem of structure determination associated with fixed-structure RBF networks. It can determine the network structure on-line dynamically by adding or removing radial basis functions according to the tracking performance. The structure variation is taken into account in the stability analysis of the closed-loop system using a switched system approach with the aid of the piecewisemore » quadratic Lyapunov function. The performance of the proposed variable neural adaptive robust controllers is illustrated with simulations.« less

Associations between life conditions and multi-morbidity in marginalized populations: the case of Palestinian refugees

PubMed Central

Hojeij, Safa; Elzein, Kareem; Chaaban, Jad; Seyfert, Karin

2014-01-01

Background: Evidence suggests that higher multi-morbidity rates among people with low socioeconomic status produces and maintains poverty. Our research explores the relationship between socioeconomic deprivation and multi-morbidity among Palestinian refugees in Lebanon, a marginalized and impoverished population. Methods: A representative sample of Palestinian refugees in Lebanon was surveyed, interviewing 2501 respondents (97% response rate). Multi-morbidity was measured by mental health, chronic and acute illnesses and disability. Multinomial logistic regression models assessed the association between indicators of poverty and multi-morbidities. Results: Findings showed that 14% of respondents never went to school, 41% of households reported water leakage and 10% suffered from severe food insecurity. Participants with an elementary education or less and those completing intermediate school were more than twice as likely to report two health problems than those with secondary education or more (OR: 2.60, CI: 1.73–3.91; OR: 2.47, CI: 1.62–3.77, respectively). Those living in households with water leakage were nearly twice as likely to have three or more health reports (OR = 1.88, CI = 1.45–2.44); this pattern was more pronounced for severely food insecure households (OR = 3.41, CI = 1.83–6.35). Conclusion: We identified a positive gradient between socioeconomic status and multi-morbidity within a refugee population. These findings reflect inequalities produced by the health and social systems in Lebanon, a problem expected to worsen following the massive influx of refugees from Syria. Ending legal discrimination and funding infrastructural, housing and health service improvements may counteract the effects of deprivation. Addressing this problem requires providing a decent livelihood for refugees in Lebanon. PMID:24994504

A multi-scale hybrid neural network retrieval model for dust storm detection, a study in Asia

NASA Astrophysics Data System (ADS)

Wong, Man Sing; Xiao, Fei; Nichol, Janet; Fung, Jimmy; Kim, Jhoon; Campbell, James; Chan, P. W.

2015-05-01

Dust storms are known to have adverse effects on human health and significant impact on weather, air quality, hydrological cycle, and ecosystem. Atmospheric dust loading is also one of the large uncertainties in global climate modeling, due to its significant impact on the radiation budget and atmospheric stability. Observations of dust storms in humid tropical south China (e.g. Hong Kong), are challenging due to high industrial pollution from the nearby Pearl River Delta region. This study develops a method for dust storm detection by combining ground station observations (PM10 concentration, AERONET data), geostationary satellite images (MTSAT), and numerical weather and climatic forecasting products (WRF/Chem). The method is based on a hybrid neural network (NN) retrieval model for two scales: (i) a NN model for near real-time detection of dust storms at broader regional scale; (ii) a NN model for detailed dust storm mapping for Hong Kong and Taiwan. A feed-forward multilayer perceptron (MLP) NN, trained using back propagation (BP) algorithm, was developed and validated by the k-fold cross validation approach. The accuracy of the near real-time detection MLP-BP network is 96.6%, and the accuracies for the detailed MLP-BP neural network for Hong Kong and Taiwan is 74.8%. This newly automated multi-scale hybrid method can be used to give advance near real-time mapping of dust storms for environmental authorities and the public. It is also beneficial for identifying spatial locations of adverse air quality conditions, and estimates of low visibility associated with dust events for port and airport authorities.

Bidirectional Neural Interfaces

PubMed Central

Masters, Matthew R.; Thakor, Nitish V.

2016-01-01

A bidirectional neural interface is a device that transfers information into and out of the nervous system. This class of devices has potential to improve treatment and therapy in several patient populations. Progress in very-large-scale integration (VLSI) has advanced the design of complex integrated circuits. System-on-chip (SoC) devices are capable of recording neural electrical activity and altering natural activity with electrical stimulation. Often, these devices include wireless powering and telemetry functions. This review presents the state of the art of bidirectional circuits as applied to neuroprosthetic, neurorepair, and neurotherapeutic systems. PMID:26753776

Multi-Temporal Land Cover Classification with Long Short-Term Memory Neural Networks

NASA Astrophysics Data System (ADS)

Rußwurm, M.; Körner, M.

2017-05-01

Land cover classification (LCC) is a central and wide field of research in earth observation and has already put forth a variety of classification techniques. Many approaches are based on classification techniques considering observation at certain points in time. However, some land cover classes, such as crops, change their spectral characteristics due to environmental influences and can thus not be monitored effectively with classical mono-temporal approaches. Nevertheless, these temporal observations should be utilized to benefit the classification process. After extensive research has been conducted on modeling temporal dynamics by spectro-temporal profiles using vegetation indices, we propose a deep learning approach to utilize these temporal characteristics for classification tasks. In this work, we show how long short-term memory (LSTM) neural networks can be employed for crop identification purposes with SENTINEL 2A observations from large study areas and label information provided by local authorities. We compare these temporal neural network models, i.e., LSTM and recurrent neural network (RNN), with a classical non-temporal convolutional neural network (CNN) model and an additional support vector machine (SVM) baseline. With our rather straightforward LSTM variant, we exceeded state-of-the-art classification performance, thus opening promising potential for further research.

Comparative transcriptome analysis in induced neural stem cells reveals defined neural cell identities in vitro and after transplantation into the adult rodent brain.

PubMed

Hallmann, Anna-Lena; Araúzo-Bravo, Marcos J; Zerfass, Christina; Senner, Volker; Ehrlich, Marc; Psathaki, Olympia E; Han, Dong Wook; Tapia, Natalia; Zaehres, Holm; Schöler, Hans R; Kuhlmann, Tanja; Hargus, Gunnar

2016-05-01

Reprogramming technology enables the production of neural progenitor cells (NPCs) from somatic cells by direct transdifferentiation. However, little is known on how neural programs in these induced neural stem cells (iNSCs) differ from those of alternative stem cell populations in vitro and in vivo. Here, we performed transcriptome analyses on murine iNSCs in comparison to brain-derived neural stem cells (NSCs) and pluripotent stem cell-derived NPCs, which revealed distinct global, neural, metabolic and cell cycle-associated marks in these populations. iNSCs carried a hindbrain/posterior cell identity, which could be shifted towards caudal, partially to rostral but not towards ventral fates in vitro. iNSCs survived after transplantation into the rodent brain and exhibited in vivo-characteristics, neural and metabolic programs similar to transplanted NSCs. However, iNSCs vastly retained caudal identities demonstrating cell-autonomy of regional programs in vivo. These data could have significant implications for a variety of in vitro- and in vivo-applications using iNSCs. Copyright © 2016 Roslin Cells Ltd. Published by Elsevier B.V. All rights reserved.

Financial time series prediction using spiking neural networks.

PubMed

Reid, David; Hussain, Abir Jaafar; Tawfik, Hissam

2014-01-01

In this paper a novel application of a particular type of spiking neural network, a Polychronous Spiking Network, was used for financial time series prediction. It is argued that the inherent temporal capabilities of this type of network are suited to non-stationary data such as this. The performance of the spiking neural network was benchmarked against three systems: two "traditional", rate-encoded, neural networks; a Multi-Layer Perceptron neural network and a Dynamic Ridge Polynomial neural network, and a standard Linear Predictor Coefficients model. For this comparison three non-stationary and noisy time series were used: IBM stock data; US/Euro exchange rate data, and the price of Brent crude oil. The experiments demonstrated favourable prediction results for the Spiking Neural Network in terms of Annualised Return and prediction error for 5-Step ahead predictions. These results were also supported by other relevant metrics such as Maximum Drawdown and Signal-To-Noise ratio. This work demonstrated the applicability of the Polychronous Spiking Network to financial data forecasting and this in turn indicates the potential of using such networks over traditional systems in difficult to manage non-stationary environments.

Financial Time Series Prediction Using Spiking Neural Networks

PubMed Central

Reid, David; Hussain, Abir Jaafar; Tawfik, Hissam

2014-01-01

In this paper a novel application of a particular type of spiking neural network, a Polychronous Spiking Network, was used for financial time series prediction. It is argued that the inherent temporal capabilities of this type of network are suited to non-stationary data such as this. The performance of the spiking neural network was benchmarked against three systems: two “traditional”, rate-encoded, neural networks; a Multi-Layer Perceptron neural network and a Dynamic Ridge Polynomial neural network, and a standard Linear Predictor Coefficients model. For this comparison three non-stationary and noisy time series were used: IBM stock data; US/Euro exchange rate data, and the price of Brent crude oil. The experiments demonstrated favourable prediction results for the Spiking Neural Network in terms of Annualised Return and prediction error for 5-Step ahead predictions. These results were also supported by other relevant metrics such as Maximum Drawdown and Signal-To-Noise ratio. This work demonstrated the applicability of the Polychronous Spiking Network to financial data forecasting and this in turn indicates the potential of using such networks over traditional systems in difficult to manage non-stationary environments. PMID:25170618

Multi-scale, multi-modal analysis uncovers complex relationship at the brain tissue-implant neural interface: new emphasis on the biological interface

NASA Astrophysics Data System (ADS)

Michelson, Nicholas J.; Vazquez, Alberto L.; Eles, James R.; Salatino, Joseph W.; Purcell, Erin K.; Williams, Jordan J.; Cui, X. Tracy; Kozai, Takashi D. Y.

2018-06-01

Objective. Implantable neural electrode devices are important tools for neuroscience research and have an increasing range of clinical applications. However, the intricacies of the biological response after implantation, and their ultimate impact on recording performance, remain challenging to elucidate. Establishing a relationship between the neurobiology and chronic recording performance is confounded by technical challenges related to traditional electrophysiological, material, and histological limitations. This can greatly impact the interpretations of results pertaining to device performance and tissue health surrounding the implant. Approach. In this work, electrophysiological activity and immunohistological analysis are compared after controlling for motion artifacts, quiescent neuronal activity, and material failure of devices in order to better understand the relationship between histology and electrophysiological outcomes. Main results. Even after carefully accounting for these factors, the presence of viable neurons and lack of glial scarring does not convey single unit recording performance. Significance. To better understand the biological factors influencing neural activity, detailed cellular and molecular tissue responses were examined. Decreases in neural activity and blood oxygenation in the tissue surrounding the implant, shift in expression levels of vesicular transporter proteins and ion channels, axon and myelin injury, and interrupted blood flow in nearby capillaries can impact neural activity around implanted neural interfaces. Combined, these tissue changes highlight the need for more comprehensive, basic science research to elucidate the relationship between biology and chronic electrophysiology performance in order to advance neural technologies.

Associations between life conditions and multi-morbidity in marginalized populations: the case of Palestinian refugees.

PubMed

Habib, Rima R; Hojeij, Safa; Elzein, Kareem; Chaaban, Jad; Seyfert, Karin

2014-10-01

Evidence suggests that higher multi-morbidity rates among people with low socioeconomic status produces and maintains poverty. Our research explores the relationship between socioeconomic deprivation and multi-morbidity among Palestinian refugees in Lebanon, a marginalized and impoverished population. A representative sample of Palestinian refugees in Lebanon was surveyed, interviewing 2501 respondents (97% response rate). Multi-morbidity was measured by mental health, chronic and acute illnesses and disability. Multinomial logistic regression models assessed the association between indicators of poverty and multi-morbidities. Findings showed that 14% of respondents never went to school, 41% of households reported water leakage and 10% suffered from severe food insecurity. Participants with an elementary education or less and those completing intermediate school were more than twice as likely to report two health problems than those with secondary education or more (OR: 2.60, CI: 1.73-3.91; OR: 2.47, CI: 1.62-3.77, respectively). Those living in households with water leakage were nearly twice as likely to have three or more health reports (OR = 1.88, CI = 1.45-2.44); this pattern was more pronounced for severely food insecure households (OR = 3.41, CI = 1.83-6.35). We identified a positive gradient between socioeconomic status and multi-morbidity within a refugee population. These findings reflect inequalities produced by the health and social systems in Lebanon, a problem expected to worsen following the massive influx of refugees from Syria. Ending legal discrimination and funding infrastructural, housing and health service improvements may counteract the effects of deprivation. Addressing this problem requires providing a decent livelihood for refugees in Lebanon. © The Author 2014. Published by Oxford University Press on behalf of the European Public Health Association.

Recruitment and Consolidation of Cell Assemblies for Words by Way of Hebbian Learning and Competition in a Multi-Layer Neural Network

PubMed Central

Garagnani, Max; Wennekers, Thomas; Pulvermüller, Friedemann

2009-01-01

Current cognitive theories postulate either localist representations of knowledge or fully overlapping, distributed ones. We use a connectionist model that closely replicates known anatomical properties of the cerebral cortex and neurophysiological principles to show that Hebbian learning in a multi-layer neural network leads to memory traces (cell assemblies) that are both distributed and anatomically distinct. Taking the example of word learning based on action-perception correlation, we document mechanisms underlying the emergence of these assemblies, especially (i) the recruitment of neurons and consolidation of connections defining the kernel of the assembly along with (ii) the pruning of the cell assembly’s halo (consisting of very weakly connected cells). We found that, whereas a learning rule mapping covariance led to significant overlap and merging of assemblies, a neurobiologically grounded synaptic plasticity rule with fixed LTP/LTD thresholds produced minimal overlap and prevented merging, exhibiting competitive learning behaviour. Our results are discussed in light of current theories of language and memory. As simulations with neurobiologically realistic neural networks demonstrate here spontaneous emergence of lexical representations that are both cortically dispersed and anatomically distinct, both localist and distributed cognitive accounts receive partial support. PMID:20396612

Recruitment and Consolidation of Cell Assemblies for Words by Way of Hebbian Learning and Competition in a Multi-Layer Neural Network.

PubMed

Garagnani, Max; Wennekers, Thomas; Pulvermüller, Friedemann

2009-06-01

Current cognitive theories postulate either localist representations of knowledge or fully overlapping, distributed ones. We use a connectionist model that closely replicates known anatomical properties of the cerebral cortex and neurophysiological principles to show that Hebbian learning in a multi-layer neural network leads to memory traces (cell assemblies) that are both distributed and anatomically distinct. Taking the example of word learning based on action-perception correlation, we document mechanisms underlying the emergence of these assemblies, especially (i) the recruitment of neurons and consolidation of connections defining the kernel of the assembly along with (ii) the pruning of the cell assembly's halo (consisting of very weakly connected cells). We found that, whereas a learning rule mapping covariance led to significant overlap and merging of assemblies, a neurobiologically grounded synaptic plasticity rule with fixed LTP/LTD thresholds produced minimal overlap and prevented merging, exhibiting competitive learning behaviour. Our results are discussed in light of current theories of language and memory. As simulations with neurobiologically realistic neural networks demonstrate here spontaneous emergence of lexical representations that are both cortically dispersed and anatomically distinct, both localist and distributed cognitive accounts receive partial support.

Establishing neural crest identity: a gene regulatory recipe

PubMed Central

Simões-Costa, Marcos; Bronner, Marianne E.

2015-01-01

The neural crest is a stem/progenitor cell population that contributes to a wide variety of derivatives, including sensory and autonomic ganglia, cartilage and bone of the face and pigment cells of the skin. Unique to vertebrate embryos, it has served as an excellent model system for the study of cell behavior and identity owing to its multipotency, motility and ability to form a broad array of cell types. Neural crest development is thought to be controlled by a suite of transcriptional and epigenetic inputs arranged hierarchically in a gene regulatory network. Here, we examine neural crest development from a gene regulatory perspective and discuss how the underlying genetic circuitry results in the features that define this unique cell population. PMID:25564621

Wireless Microstimulators for Neural Prosthetics

PubMed Central

Sahin, Mesut; Pikov, Victor

2016-01-01

One of the roadblocks in the field of neural prosthetics is the lack of microelectronic devices for neural stimulation that can last a lifetime in the central nervous system. Wireless multi-electrode arrays are being developed to improve the longevity of implants by eliminating the wire interconnects as well as the chronic tissue reactions due to the tethering forces generated by these wires. An area of research that has not been sufficiently investigated is a simple single-channel passive microstimulator that can collect the stimulus energy that is transmitted wirelessly through the tissue and immediately convert it into the stimulus pulse. For example, many neural prosthetic approaches to intraspinal microstimulation require only a few channels of stimulation. Wired spinal cord implants are not practical for human subjects because of the extensive flexions and rotations that the spinal cord experiences. Thus, intraspinal microstimulation may be a pioneering application that can benefit from submillimetersize floating stimulators. Possible means of energizing such a floating microstimulator, such as optical, acoustic, and electromagnetic waves, are discussed. PMID:21488815

Robust information propagation through noisy neural circuits

PubMed Central

Pouget, Alexandre

2017-01-01

Sensory neurons give highly variable responses to stimulation, which can limit the amount of stimulus information available to downstream circuits. Much work has investigated the factors that affect the amount of information encoded in these population responses, leading to insights about the role of covariability among neurons, tuning curve shape, etc. However, the informativeness of neural responses is not the only relevant feature of population codes; of potentially equal importance is how robustly that information propagates to downstream structures. For instance, to quantify the retina’s performance, one must consider not only the informativeness of the optic nerve responses, but also the amount of information that survives the spike-generating nonlinearity and noise corruption in the next stage of processing, the lateral geniculate nucleus. Our study identifies the set of covariance structures for the upstream cells that optimize the ability of information to propagate through noisy, nonlinear circuits. Within this optimal family are covariances with “differential correlations”, which are known to reduce the information encoded in neural population activities. Thus, covariance structures that maximize information in neural population codes, and those that maximize the ability of this information to propagate, can be very different. Moreover, redundancy is neither necessary nor sufficient to make population codes robust against corruption by noise: redundant codes can be very fragile, and synergistic codes can—in some cases—optimize robustness against noise. PMID:28419098

The neural processing of taste

PubMed Central

Lemon, Christian H; Katz, Donald B

2007-01-01

Although there have been many recent advances in the field of gustatory neurobiology, our knowledge of how the nervous system is organized to process information about taste is still far from complete. Many studies on this topic have focused on understanding how gustatory neural circuits are spatially organized to represent information about taste quality (e.g., "sweet", "salty", "bitter", etc.). Arguments pertaining to this issue have largely centered on whether taste is carried by dedicated neural channels or a pattern of activity across a neural population. But there is now mounting evidence that the timing of neural events may also importantly contribute to the representation of taste. In this review, we attempt to summarize recent findings in the field that pertain to these issues. Both space and time are variables likely related to the mechanism of the gustatory neural code: information about taste appears to reside in spatial and temporal patterns of activation in gustatory neurons. What is more, the organization of the taste network in the brain would suggest that the parameters of space and time extend to the neural processing of gustatory information on a much grander scale. PMID:17903281

Neural signatures of trust in reciprocity: a coordinate-based meta-analysis

PubMed Central

Bellucci, Gabriele; Chernyak, Sergey V.; Goodyear, Kimberly; Eickhoff, Simon B.; Krueger, Frank

2017-01-01

Trust in reciprocity (TR) is defined as the risky decision to invest valued resources in another party with the hope of mutual benefit. Several fMRI studies have investigated the neural correlates of TR in one-shot and multi-round versions of the investment game (IG). However, an overall characterization of the underlying neural networks remains elusive. Here, we employed a coordinate-based meta-analysis (activation likelihood estimation method, 30 papers) to investigate consistent brain activations in each of the IG stages (i.e., the trust, reciprocity and feedback stage). Our results showed consistent activations in the anterior insula (AI) during trust decisions in the one-shot IG and decisions to reciprocate in the multi-round IG, likely related to representations of aversive feelings. Moreover, decisions to reciprocate also consistently engaged the intraparietal sulcus, probably involved in evaluations of the reciprocity options. On the contrary, trust decisions in the multi-round IG consistently activated the ventral striatum, likely associated with reward prediction error signals. Finally, the dorsal striatum was found consistently recruited during the feedback stage of the multi-round IG, likely related to reinforcement learning. In conclusion, our results indicate different neural networks underlying trust, reciprocity and feedback learning. These findings suggest that although decisions to trust and reciprocate may elicit aversive feelings likely evoked by the uncertainty about the decision outcomes and the pressing requirements of social standards, multiple interactions allow people to build interpersonal trust for cooperation via a learning mechanism by which they arguably learn to distinguish trustworthy from untrustworthy partners. PMID:27859899

A biologically inspired neural net for trajectory formation and obstacle avoidance.

PubMed

Glasius, R; Komoda, A; Gielen, S C

1996-06-01

In this paper we present a biologically inspired two-layered neural network for trajectory formation and obstacle avoidance. The two topographically ordered neural maps consist of analog neurons having continuous dynamics. The first layer, the sensory map, receives sensory information and builds up an activity pattern which contains the optimal solution (i.e. shortest path without collisions) for any given set of current position, target positions and obstacle positions. Targets and obstacles are allowed to move, in which case the activity pattern in the sensory map will change accordingly. The time evolution of the neural activity in the second layer, the motor map, results in a moving cluster of activity, which can be interpreted as a population vector. Through the feedforward connections between the two layers, input of the sensory map directs the movement of the cluster along the optimal path from the current position of the cluster to the target position. The smooth trajectory is the result of the intrinsic dynamics of the network only. No supervisor is required. The output of the motor map can be used for direct control of an autonomous system in a cluttered environment or for control of the actuators of a biological limb or robot manipulator. The system is able to reach a target even in the presence of an external perturbation. Computer simulations of a point robot and a multi-joint manipulator illustrate the theory.

Predicate calculus for an architecture of multiple neural networks

NASA Astrophysics Data System (ADS)

Consoli, Robert H.

1990-08-01

Future projects with neural networks will require multiple individual network components. Current efforts along these lines are ad hoc. This paper relates the neural network to a classical device and derives a multi-part architecture from that model. Further it provides a Predicate Calculus variant for describing the location and nature of the trainings and suggests Resolution Refutation as a method for determining the performance of the system as well as the location of needed trainings for specific proofs. 2. THE NEURAL NETWORK AND A CLASSICAL DEVICE Recently investigators have been making reports about architectures of multiple neural networksL234. These efforts are appearing at an early stage in neural network investigations they are characterized by architectures suggested directly by the problem space. Touretzky and Hinton suggest an architecture for processing logical statements1 the design of this architecture arises from the syntax of a restricted class of logical expressions and exhibits syntactic limitations. In similar fashion a multiple neural netword arises out of a control problem2 from the sequence learning problem3 and from the domain of machine learning. 4 But a general theory of multiple neural devices is missing. More general attempts to relate single or multiple neural networks to classical computing devices are not common although an attempt is made to relate single neural devices to a Turing machines and Sun et a!. develop a multiple neural architecture that performs pattern classification.

Neural dynamic programming and its application to control systems

NASA Astrophysics Data System (ADS)

Seong, Chang-Yun

There are few general practical feedback control methods for nonlinear MIMO (multi-input-multi-output) systems, although such methods exist for their linear counterparts. Neural Dynamic Programming (NDP) is proposed as a practical design method of optimal feedback controllers for nonlinear MIMO systems. NDP is an offspring of both neural networks and optimal control theory. In optimal control theory, the optimal solution to any nonlinear MIMO control problem may be obtained from the Hamilton-Jacobi-Bellman equation (HJB) or the Euler-Lagrange equations (EL). The two sets of equations provide the same solution in different forms: EL leads to a sequence of optimal control vectors, called Feedforward Optimal Control (FOC); HJB yields a nonlinear optimal feedback controller, called Dynamic Programming (DP). DP produces an optimal solution that can reject disturbances and uncertainties as a result of feedback. Unfortunately, computation and storage requirements associated with DP solutions can be problematic, especially for high-order nonlinear systems. This dissertation presents an approximate technique for solving the DP problem based on neural network techniques that provides many of the performance benefits (e.g., optimality and feedback) of DP and benefits from the numerical properties of neural networks. We formulate neural networks to approximate optimal feedback solutions whose existence DP justifies. We show the conditions under which NDP closely approximates the optimal solution. Finally, we introduce the learning operator characterizing the learning process of the neural network in searching the optimal solution. The analysis of the learning operator provides not only a fundamental understanding of the learning process in neural networks but also useful guidelines for selecting the number of weights of the neural network. As a result, NDP finds---with a reasonable amount of computation and storage---the optimal feedback solutions to nonlinear MIMO control

The Relation Between Inflation in Type-I and Type-II Error Rate and Population Divergence in Genome-Wide Association Analysis of Multi-Ethnic Populations.

PubMed

Derks, E M; Zwinderman, A H; Gamazon, E R

2017-05-01

Population divergence impacts the degree of population stratification in Genome Wide Association Studies. We aim to: (i) investigate type-I error rate as a function of population divergence (F ST ) in multi-ethnic (admixed) populations; (ii) evaluate the statistical power and effect size estimates; and (iii) investigate the impact of population stratification on the results of gene-based analyses. Quantitative phenotypes were simulated. Type-I error rate was investigated for Single Nucleotide Polymorphisms (SNPs) with varying levels of F ST between the ancestral European and African populations. Type-II error rate was investigated for a SNP characterized by a high value of F ST . In all tests, genomic MDS components were included to correct for population stratification. Type-I and type-II error rate was adequately controlled in a population that included two distinct ethnic populations but not in admixed samples. Statistical power was reduced in the admixed samples. Gene-based tests showed no residual inflation in type-I error rate.

Investigation of Implantable Multi-Channel Electrode Array in Rat Cerebral Cortex Used for Recording

NASA Astrophysics Data System (ADS)

Taniguchi, Noriyuki; Fukayama, Osamu; Suzuki, Takafumi; Mabuchi, Kunihiko

There have recently been many studies concerning the control of robot movements using neural signals recorded from the brain (usually called the Brain-Machine interface (BMI)). We fabricated implantable multi-electrode arrays to obtain neural signals from the rat cerebral cortex. As any multi-electrode array should have electrode alignment that minimizes invasion, it is necessary to customize the recording site. We designed three types of 22-channel multi-electrode arrays, i.e., 1) wide, 2) three-layered, and 3) separate. The first extensively covers the cerebral cortex. The second has a length of 2 mm, which can cover the area of the primary motor cortex. The third array has a separate structure, which corresponds to the position of the forelimb and hindlimb areas of the primary motor cortex. These arrays were implanted into the cerebral cortex of a rat. We estimated the walking speed from neural signals using our fabricated three-layered array to investigate its feasibility for BMI research. The neural signal of the rat and its walking speed were simultaneously recorded. The results revealed that evaluation using either the anterior electrode group or posterior group provided accurate estimates. However, two electrode groups around the center yielded poor estimates although it was possible to record neural signals.

Efficiency turns the table on neural encoding, decoding and noise.

PubMed

Deneve, Sophie; Chalk, Matthew

2016-04-01

Sensory neurons are usually described with an encoding model, for example, a function that predicts their response from the sensory stimulus using a receptive field (RF) or a tuning curve. However, central to theories of sensory processing is the notion of 'efficient coding'. We argue here that efficient coding implies a completely different neural coding strategy. Instead of a fixed encoding model, neural populations would be described by a fixed decoding model (i.e. a model reconstructing the stimulus from the neural responses). Because the population solves a global optimization problem, individual neurons are variable, but not noisy, and have no truly invariant tuning curve or receptive field. We review recent experimental evidence and implications for neural noise correlations, robustness and adaptation. Copyright © 2016. Published by Elsevier Ltd.

New genes in the evolution of the neural crest differentiation program

PubMed Central

2007-01-01

Background Development of the vertebrate head depends on the multipotency and migratory behavior of neural crest derivatives. This cell population is considered a vertebrate innovation and, accordingly, chordate ancestors lacked neural crest counterparts. The identification of neural crest specification genes expressed in the neural plate of basal chordates, in addition to the discovery of pigmented migratory cells in ascidians, has challenged this hypothesis. These new findings revive the debate on what is new and what is ancient in the genetic program that controls neural crest formation. Results To determine the origin of neural crest genes, we analyzed Phenotype Ontology annotations to select genes that control the development of this tissue. Using a sequential blast pipeline, we phylogenetically classified these genes, as well as those associated with other tissues, in order to define tissue-specific profiles of gene emergence. Of neural crest genes, 9% are vertebrate innovations. Our comparative analyses show that, among different tissues, the neural crest exhibits a particularly high rate of gene emergence during vertebrate evolution. A remarkable proportion of the new neural crest genes encode soluble ligands that control neural crest precursor specification into each cell lineage, including pigmented, neural, glial, and skeletal derivatives. Conclusion We propose that the evolution of the neural crest is linked not only to the recruitment of ancestral regulatory genes but also to the emergence of signaling peptides that control the increasingly complex lineage diversification of this plastic cell population. PMID:17352807

Ultrasoft microwire neural electrodes improve chronic tissue integration

PubMed Central

Du, Zhanhong Jeff; Kolarcik, Christi L.; Kozai, Takashi D.Y.; Luebben, Silvia D.; Sapp, Shawn A.; Zheng, Xin Sally; Nabity, James A.; Cui, X. Tracy

2017-01-01

Chronically implanted neural multi-electrode arrays (MEA) are an essential technology for recording electrical signals from neurons and/or modulating neural activity through stimulation. However, current MEAs, regardless of the type, elicit an inflammatory response that ultimately leads to device failure. Traditionally, rigid materials like tungsten and silicon have been employed to interface with the relatively soft neural tissue. The large stiffness mismatch is thought to exacerbate the inflammatory response. In order to minimize the disparity between the device and the brain, we fabricated novel ultrasoft electrodes consisting of elastomers and conducting polymers with mechanical properties much more similar to those of brain tissue than previous neural implants. In this study, these ultrasoft microelectrodes were inserted and released using a stainless steel shuttle with polyethyleneglycol (PEG) glue. The implanted microwires showed functionality in acute neural stimulation. When implanted for 1 or 8 weeks, the novel soft implants demonstrated significantly reduced inflammatory tissue response at week 8 compared to tungsten wires of similar dimension and surface chemistry. Furthermore, a higher degree of cell body distortion was found next to the tungsten implants compared to the polymer implants. Our results support the use of these novel ultrasoft electrodes for long term neural implants. PMID:28185910

Attention Effects on Neural Population Representations for Shape and Location Are Stronger in the Ventral than Dorsal Stream

PubMed Central

2018-01-01

Abstract We examined how attention causes neural population representations of shape and location to change in ventral stream (AIT) and dorsal stream (LIP). Monkeys performed two identical delayed-match-to-sample (DMTS) tasks, attending either to shape or location. In AIT, shapes were more discriminable when directing attention to shape rather than location, measured by an increase in mean distance between population response vectors. In LIP, attending to location rather than shape did not increase the discriminability of different stimulus locations. Even when factoring out the change in mean vector response distance, multidimensional scaling (MDS) still showed a significant task difference in AIT, but not LIP, indicating that beyond increasing discriminability, attention also causes a nonlinear warping of representation space in AIT. Despite single-cell attentional modulations in both areas, our data show that attentional modulations of population representations are weaker in LIP, likely due to a need to maintain veridical representations for visuomotor control. PMID:29876521

Enhancement of cognitive and neural functions through complex reasoning training: evidence from normal and clinical populations

PubMed Central

Chapman, Sandra B.; Mudar, Raksha A.

2014-01-01

Public awareness of cognitive health is fairly recent compared to physical health. Growing evidence suggests that cognitive training offers promise in augmenting cognitive brain performance in normal and clinical populations. Targeting higher-order cognitive functions, such as reasoning in particular, may promote generalized cognitive changes necessary for supporting the complexities of daily life. This data-driven perspective highlights cognitive and brain changes measured in randomized clinical trials that trained gist reasoning strategies in populations ranging from teenagers to healthy older adults, individuals with brain injury to those at-risk for Alzheimer's disease. The evidence presented across studies support the potential for Gist reasoning training to strengthen cognitive performance in trained and untrained domains and to engage more efficient communication across widespread neural networks that support higher-order cognition. The meaningful benefits of Gist training provide compelling motivation to examine optimal dose for sustained benefits as well as to explore additive benefits of meditation, physical exercise, and/or improved sleep in future studies. PMID:24808834

Neural Correlation Is Stimulus Modulated by Feedforward Inhibitory Circuitry

PubMed Central

Middleton, Jason W.; Omar, Cyrus; Doiron, Brent; Simons, Daniel J.

2012-01-01

Correlated variability of neural spiking activity has important consequences for signal processing. How incoming sensory signals shape correlations of population responses remains unclear. Cross-correlations between spiking of different neurons may be particularly consequential in sparsely firing neural populations such as those found in layer 2/3 of sensory cortex. In rat whisker barrel cortex, we found that pairs of excitatory layer 2/3 neurons exhibit similarly low levels of spike count correlation during both spontaneous and sensory-evoked states. The spontaneous activity of excitatory–inhibitory neuron pairs is positively correlated, while sensory stimuli actively decorrelate joint responses. Computational modeling shows how threshold nonlinearities and local inhibition form the basis of a general decorrelating mechanism. We show that inhibitory population activity maintains low correlations in excitatory populations, especially during periods of sensory-evoked coactivation. The role of feedforward inhibition has been previously described in the context of trial-averaged phenomena. Our findings reveal a novel role for inhibition to shape correlations of neural variability and thereby prevent excessive correlations in the face of feedforward sensory-evoked activation. PMID:22238086

Evaluating targeted interventions via meta-population models with multi-level mixing.

PubMed

Feng, Zhilan; Hill, Andrew N; Curns, Aaron T; Glasser, John W

2017-05-01

Among the several means by which heterogeneity can be modeled, Levins' (1969) meta-population approach preserves the most analytical tractability, a virtue to the extent that generality is desirable. When model populations are stratified, contacts among their respective sub-populations must be described. Using a simple meta-population model, Feng et al. (2015) showed that mixing among sub-populations, as well as heterogeneity in characteristics affecting sub-population reproduction numbers, must be considered when evaluating public health interventions to prevent or control infectious disease outbreaks. They employed the convex combination of preferential within- and proportional among-group contacts first described by Nold (1980) and subsequently generalized by Jacquez et al. (1988). As the utility of meta-population modeling depends on more realistic mixing functions, the authors added preferential contacts between parents and children and among co-workers (Glasser et al., 2012). Here they further generalize this function by including preferential contacts between grandparents and grandchildren, but omit workplace contacts. They also describe a general multi-level mixing scheme, provide three two-level examples, and apply two of them. In their first application, the authors describe age- and gender-specific patterns in face-to-face conversations (Mossong et al., 2008), proxies for contacts by which respiratory pathogens might be transmitted, that are consistent with everyday experience. This suggests that meta-population models with inter-generational mixing could be employed to evaluate prolonged school-closures, a proposed pandemic mitigation measure that could expose grandparents, and other elderly surrogate caregivers for working parents, to infectious children. In their second application, the authors use a meta-population SEIR model stratified by 7 age groups and 50 states plus the District of Columbia, to compare actual with optimal vaccination during the

Time-frequency analysis of neuronal populations with instantaneous resolution based on noise-assisted multivariate empirical mode decomposition.

PubMed

Alegre-Cortés, J; Soto-Sánchez, C; Pizá, Á G; Albarracín, A L; Farfán, F D; Felice, C J; Fernández, E

2016-07-15

Linear analysis has classically provided powerful tools for understanding the behavior of neural populations, but the neuron responses to real-world stimulation are nonlinear under some conditions, and many neuronal components demonstrate strong nonlinear behavior. In spite of this, temporal and frequency dynamics of neural populations to sensory stimulation have been usually analyzed with linear approaches. In this paper, we propose the use of Noise-Assisted Multivariate Empirical Mode Decomposition (NA-MEMD), a data-driven template-free algorithm, plus the Hilbert transform as a suitable tool for analyzing population oscillatory dynamics in a multi-dimensional space with instantaneous frequency (IF) resolution. The proposed approach was able to extract oscillatory information of neurophysiological data of deep vibrissal nerve and visual cortex multiunit recordings that were not evidenced using linear approaches with fixed bases such as the Fourier analysis. Texture discrimination analysis performance was increased when Noise-Assisted Multivariate Empirical Mode plus Hilbert transform was implemented, compared to linear techniques. Cortical oscillatory population activity was analyzed with precise time-frequency resolution. Similarly, NA-MEMD provided increased time-frequency resolution of cortical oscillatory population activity. Noise-Assisted Multivariate Empirical Mode Decomposition plus Hilbert transform is an improved method to analyze neuronal population oscillatory dynamics overcoming linear and stationary assumptions of classical methods. Copyright © 2016 Elsevier B.V. All rights reserved.

SU-F-E-09: Respiratory Signal Prediction Based On Multi-Layer Perceptron Neural Network Using Adjustable Training Samples

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sun, W; Jiang, M; Yin, F

Purpose: Dynamic tracking of moving organs, such as lung and liver tumors, under radiation therapy requires prediction of organ motions prior to delivery. The shift of moving organ may change a lot due to huge transform of respiration at different periods. This study aims to reduce the influence of that changes using adjustable training signals and multi-layer perceptron neural network (ASMLP). Methods: Respiratory signals obtained using a Real-time Position Management(RPM) device were used for this study. The ASMLP uses two multi-layer perceptron neural networks(MLPs) to infer respiration position alternately and the training sample will be updated with time. Firstly, amore » Savitzky-Golay finite impulse response smoothing filter was established to smooth the respiratory signal. Secondly, two same MLPs were developed to estimate respiratory position from its previous positions separately. Weights and thresholds were updated to minimize network errors according to Leverberg-Marquart optimization algorithm through backward propagation method. Finally, MLP 1 was used to predict 120∼150s respiration position using 0∼120s training signals. At the same time, MLP 2 was trained using 30∼150s training signals. Then MLP is used to predict 150∼180s training signals according to 30∼150s training signals. The respiration position is predicted as this way until it was finished. Results: In this experiment, the two methods were used to predict 2.5 minute respiratory signals. For predicting 1s ahead of response time, correlation coefficient was improved from 0.8250(MLP method) to 0.8856(ASMLP method). Besides, a 30% improvement of mean absolute error between MLP(0.1798 on average) and ASMLP(0.1267 on average) was achieved. For predicting 2s ahead of response time, correlation coefficient was improved from 0.61415 to 0.7098.Mean absolute error of MLP method(0.3111 on average) was reduced by 35% using ASMLP method(0.2020 on average). Conclusion: The preliminary results

The utilization of neural nets in populating an object-oriented database

NASA Technical Reports Server (NTRS)

Campbell, William J.; Hill, Scott E.; Cromp, Robert F.

1989-01-01

Existing NASA supported scientific data bases are usually developed, managed and populated in a tedious, error prone and self-limiting way in terms of what can be described in a relational Data Base Management System (DBMS). The next generation Earth remote sensing platforms (i.e., Earth Observation System, (EOS), will be capable of generating data at a rate of over 300 Mbs per second from a suite of instruments designed for different applications. What is needed is an innovative approach that creates object-oriented databases that segment, characterize, catalog and are manageable in a domain-specific context and whose contents are available interactively and in near-real-time to the user community. Described here is work in progress that utilizes an artificial neural net approach to characterize satellite imagery of undefined objects into high-level data objects. The characterized data is then dynamically allocated to an object-oriented data base where it can be reviewed and assessed by a user. The definition, development, and evolution of the overall data system model are steps in the creation of an application-driven knowledge-based scientific information system.

High prevalence of daily and multi-site pain – a cross-sectional population-based study among 3000 Danish adolescents

PubMed Central

2013-01-01

Background Daily pain and multi-site pain are both associated with reduction in work ability and health-related quality of life (HRQoL) among adults. However, no population-based studies have yet investigated the prevalence of daily and multi-site pain among adolescents and how these are associated with respondent characteristics. The purpose of this study was to investigate the prevalence of self-reported daily and multi-site pain among adolescents aged 12–19 years and associations of almost daily pain and multi-site pain with respondent characteristics (sex, age, body mass index, HRQoL and sports participation). Methods A population-based cross-sectional study was conducted among 4,007 adolescents aged 12–19 years in Denmark. Adolescents answered an online questionnaire during physical education lessons. The questionnaire contained a mannequin divided into 12 regions on which the respondents indicated their current pain sites and pain frequency (rarely, monthly, weekly, more than once per week, almost daily pain), characteristics, sports participation and HRQoL measured by the EuroQoL 5D. Multivariate regression was used to calculate the odds ratio for the association between almost daily pain, multi-site pain and respondent characteristics. Results The response rate was 73.7%. A total of 2,953 adolescents (62% females) answered the questionnaire. 33.3% reported multi-site pain (pain in >1 region) while 19.8% reported almost daily pain. 61% reported current pain in at least one region with knee and back pain being the most common sites. Female sex (OR: 1.35-1.44) and a high level of sports participation (OR: 1.51-2.09) were associated with increased odds of having almost daily pain and multi-site pain. Better EQ-5D score was associated with decreased odds of having almost daily pain or multi-site pain (OR: 0.92-0.94). Conclusion In this population-based cohort of school-attending Danish adolescents, nearly two out of three reported current pain and, on

Urdu Nasta'liq text recognition using implicit segmentation based on multi-dimensional long short term memory neural networks.

PubMed

Naz, Saeeda; Umar, Arif Iqbal; Ahmed, Riaz; Razzak, Muhammad Imran; Rashid, Sheikh Faisal; Shafait, Faisal

2016-01-01

The recognition of Arabic script and its derivatives such as Urdu, Persian, Pashto etc. is a difficult task due to complexity of this script. Particularly, Urdu text recognition is more difficult due to its Nasta'liq writing style. Nasta'liq writing style inherits complex calligraphic nature, which presents major issues to recognition of Urdu text owing to diagonality in writing, high cursiveness, context sensitivity and overlapping of characters. Therefore, the work done for recognition of Arabic script cannot be directly applied to Urdu recognition. We present Multi-dimensional Long Short Term Memory (MDLSTM) Recurrent Neural Networks with an output layer designed for sequence labeling for recognition of printed Urdu text-lines written in the Nasta'liq writing style. Experiments show that MDLSTM attained a recognition accuracy of 98% for the unconstrained Urdu Nasta'liq printed text, which significantly outperforms the state-of-the-art techniques.

Development of a Semi-Quantitative Food Frequency Questionnaire to Assess the Dietary Intake of a Multi-Ethnic Urban Asian Population.

PubMed

Neelakantan, Nithya; Whitton, Clare; Seah, Sharna; Koh, Hiromi; Rebello, Salome A; Lim, Jia Yi; Chen, Shiqi; Chan, Mei Fen; Chew, Ling; van Dam, Rob M

2016-08-27

Assessing habitual food consumption is challenging in multi-ethnic cosmopolitan settings. We systematically developed a semi-quantitative food frequency questionnaire (FFQ) in a multi-ethnic population in Singapore, using data from two 24-h dietary recalls from a nationally representative sample of 805 Singapore residents of Chinese, Malay and Indian ethnicity aged 18-79 years. Key steps included combining reported items on 24-h recalls into standardized food groups, developing a food list for the FFQ, pilot testing of different question formats, and cognitive interviews. Percentage contribution analysis and stepwise regression analysis were used to identify foods contributing cumulatively ≥90% to intakes and individually ≥1% to intake variance of key nutrients, for the total study population and for each ethnic group separately. Differences between ethnic groups were observed in proportions of consumers of certain foods (e.g., lentil stews, 1%-47%; and pork dishes, 0%-50%). The number of foods needed to explain variability in nutrient intakes differed substantially by ethnic groups and was substantially larger for the total population than for separate ethnic groups. A 163-item FFQ covered >95% of total population intake for all key nutrients. The methodological insights provided in this paper may be useful in developing similar FFQs in other multi-ethnic settings.

Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI

NASA Astrophysics Data System (ADS)

Olyaee, Saeed; Hamedi, Samaneh

2011-02-01

In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.

Neural crest contribution to the cardiovascular system.

PubMed

Brown, Christopher B; Baldwin, H Scott

2006-01-01

Normal cardiovascular development requires complex remodeling of the outflow tract and pharyngeal arch arteries to create the separate pulmonic and systemic circulations. During remodeling, the outflow tract is septated to form the ascending aorta and the pulmonary trunk. The initially symmetrical pharyngeal arch arteries are remodeled to form the aortic arch, subclavian and carotid arteries. Remodeling is mediated by a population of neural crest cells arising between the mid-otic placode and somite four called the cardiac neural crest. Cardiac neural crest cells form smooth muscle and pericytes in the great arteries, and the neurons of cardiac innervation. In addition to the physical contribution of smooth muscle to the cardiovascular system, cardiac neural crest cells also provide signals required for the maintenance and differentiation of the other cell layers in the pharyngeal apparatus. Reciprocal signaling between the cardiac neural crest cells and cardiogenic mesoderm of the secondary heart field is required for elaboration of the conotruncus and disruption in this signaling results in primary myocardial dysfunction. Cardiovascular defects attributed to the cardiac neural crest cells may reflect either cell autonomous defects in the neural crest or defects in signaling between the neural crest and adjacent cell layers.

Multi-agent Simulations of Population Behavior: A Promising Tool for Systems Biology.

PubMed

Colosimo, Alfredo

2018-01-01

This contribution reports on the simulation of some dynamical events observed in the collective behavior of different kinds of populations, ranging from shape-changing cells in a Petri dish to functionally correlated brain areas in vivo. The unifying methodological approach, based upon a Multi-Agent Simulation (MAS) paradigm as incorporated in the NetLogo™ interpreter, is a direct consequence of the cornerstone that simple, individual actions within a population of interacting agents often give rise to complex, collective behavior.The discussion will mainly focus on the emergence and spreading of synchronous activities within the population, as well as on the modulation of the collective behavior exerted by environmental force-fields. A relevant section of this contribution is dedicated to the extension of the MAS paradigm to Brain Network models. In such a general framework some recent applications taken from the direct experience of the author, and exploring the activation patterns characteristic of specific brain functional states, are described, and their impact on the Systems-Biology universe underlined.

Competitive Learning Neural Network Ensemble Weighted by Predicted Performance

ERIC Educational Resources Information Center

Ye, Qiang

2010-01-01

Ensemble approaches have been shown to enhance classification by combining the outputs from a set of voting classifiers. Diversity in error patterns among base classifiers promotes ensemble performance. Multi-task learning is an important characteristic for Neural Network classifiers. Introducing a secondary output unit that receives different…

Antibiotic resistance and population structure of cystic fibrosis Pseudomonas aeruginosa isolates from a Spanish multi-centre study.

PubMed

López-Causapé, Carla; de Dios-Caballero, Juan; Cobo, Marta; Escribano, Amparo; Asensio, Óscar; Oliver, Antonio; Del Campo, Rosa; Cantón, Rafael; Solé, Amparó; Cortell, Isidoro; Asensio, Oscar; García, Gloria; Martínez, María Teresa; Cols, María; Salcedo, Antonio; Vázquez, Carlos; Baranda, Félix; Girón, Rosa; Quintana, Esther; Delgado, Isabel; de Miguel, María Ángeles; García, Marta; Oliva, Concepción; Prados, María Concepción; Barrio, María Isabel; Pastor, María Dolores; Olveira, Casilda; de Gracia, Javier; Álvarez, Antonio; Escribano, Amparo; Castillo, Silvia; Figuerola, Joan; Togores, Bernat; Oliver, Antonio; López, Carla; de Dios Caballero, Juan; Tato, Marta; Máiz, Luis; Suárez, Lucrecia; Cantón, Rafael

2017-09-01

The first Spanish multi-centre study on the microbiology of cystic fibrosis (CF) was conducted from 2013 to 2014. The study involved 24 CF units from 17 hospitals, and recruited 341 patients. The aim of this study was to characterise Pseudomonas aeruginosa isolates, 79 of which were recovered from 75 (22%) patients. The study determined the population structure, antibiotic susceptibility profile and genetic background of the strains. Fifty-five percent of the isolates were multi-drug-resistant, and 16% were extensively-drug-resistant. Defective mutS and mutL genes were observed in mutator isolates (15.2%). Considerable genetic diversity was observed by pulsed-field gel electrophoresis (70 patterns) and multi-locus sequence typing (72 sequence types). International epidemic clones were not detected. Fifty-one new and 14 previously described array tube (AT) genotypes were detected by AT technology. This study found a genetically unrelated and highly diverse CF P. aeruginosa population in Spain, not represented by the epidemic clones widely distributed across Europe, with multiple combinations of virulence factors and high antimicrobial resistance rates (except for colistin). Copyright © 2017 Elsevier B.V. and International Society of Chemotherapy. All rights reserved.

Post interaural neural net-based vowel recognition

NASA Astrophysics Data System (ADS)

Jouny, Ismail I.

2001-10-01

Interaural head related transfer functions are used to process speech signatures prior to neural net based recognition. Data representing the head related transfer function of a dummy has been collected at MIT and made available on the Internet. This data is used to pre-process vowel signatures to mimic the effects of human ear on speech perception. Signatures representing various vowels of the English language are then presented to a multi-layer perceptron trained using the back propagation algorithm for recognition purposes. The focus in this paper is to assess the effects of human interaural system on vowel recognition performance particularly when using a classification system that mimics the human brain such as a neural net.

Inversion of Density Interfaces Using the Pseudo-Backpropagation Neural Network Method

NASA Astrophysics Data System (ADS)

Chen, Xiaohong; Du, Yukun; Liu, Zhan; Zhao, Wenju; Chen, Xiaocheng

2018-05-01

This paper presents a new pseudo-backpropagation (BP) neural network method that can invert multi-density interfaces at one time. The new method is based on the conventional forward modeling and inverse modeling theories in addition to conventional pseudo-BP neural network arithmetic. A 3D inversion model for gravity anomalies of multi-density interfaces using the pseudo-BP neural network method is constructed after analyzing the structure and function of the artificial neural network. The corresponding iterative inverse formula of the space field is presented at the same time. Based on trials of gravity anomalies and density noise, the influence of the two kinds of noise on the inverse result is discussed and the scale of noise requested for the stability of the arithmetic is analyzed. The effects of the initial model on the reduction of the ambiguity of the result and improvement of the precision of inversion are discussed. The correctness and validity of the method were verified by the 3D model of the three interfaces. 3D inversion was performed on the observed gravity anomaly data of the Okinawa trough using the program presented herein. The Tertiary basement and Moho depth were obtained from the inversion results, which also testify the adaptability of the method. This study has made a useful attempt for the inversion of gravity density interfaces.

Multi-Objective Reinforcement Learning-based Deep Neural Networks for Cognitive Space Communications

NASA Technical Reports Server (NTRS)

Ferreria, Paulo; Paffenroth, Randy; Wyglinski, Alexander M.; Hackett, Timothy; Bilen, Sven; Reinhart, Richard; Mortensen, Dale

2017-01-01

Future communication subsystems of space exploration missions can potentially benefit from software-defined radios (SDRs) controlled by machine learning algorithms. In this paper, we propose a novel hybrid radio resource allocation management control algorithm that integrates multi-objective reinforcement learning and deep artificial neural networks. The objective is to efficiently manage communications system resources by monitoring performance functions with common dependent variables that result in conflicting goals. The uncertainty in the performance of thousands of different possible combinations of radio parameters makes the trade-off between exploration and exploitation in reinforcement learning (RL) much more challenging for future critical space-based missions. Thus, the system should spend as little time as possible on exploring actions, and whenever it explores an action, it should perform at acceptable levels most of the time. The proposed approach enables on-line learning by interactions with the environment and restricts poor resource allocation performance through virtual environment exploration. Improvements in the multiobjective performance can be achieved via transmitter parameter adaptation on a packet-basis, with poorly predicted performance promptly resulting in rejected decisions. Simulations presented in this work considered the DVB-S2 standard adaptive transmitter parameters and additional ones expected to be present in future adaptive radio systems. Performance results are provided by analysis of the proposed hybrid algorithm when operating across a satellite communication channel from Earth to GEO orbit during clear sky conditions. The proposed approach constitutes part of the core cognitive engine proof-of-concept to be delivered to the NASA Glenn Research Center SCaN Testbed located onboard the International Space Station.

Multi-Objective Reinforcement Learning-Based Deep Neural Networks for Cognitive Space Communications

NASA Technical Reports Server (NTRS)

Ferreria, Paulo Victor R.; Paffenroth, Randy; Wyglinski, Alexander M.; Hackett, Timothy M.; Bilen, Sven G.; Reinhart, Richard C.; Mortensen, Dale J.

2017-01-01

Future communication subsystems of space exploration missions can potentially benefit from software-defined radios (SDRs) controlled by machine learning algorithms. In this paper, we propose a novel hybrid radio resource allocation management control algorithm that integrates multi-objective reinforcement learning and deep artificial neural networks. The objective is to efficiently manage communications system resources by monitoring performance functions with common dependent variables that result in conflicting goals. The uncertainty in the performance of thousands of different possible combinations of radio parameters makes the trade-off between exploration and exploitation in reinforcement learning (RL) much more challenging for future critical space-based missions. Thus, the system should spend as little time as possible on exploring actions, and whenever it explores an action, it should perform at acceptable levels most of the time. The proposed approach enables on-line learning by interactions with the environment and restricts poor resource allocation performance through virtual environment exploration. Improvements in the multiobjective performance can be achieved via transmitter parameter adaptation on a packet-basis, with poorly predicted performance promptly resulting in rejected decisions. Simulations presented in this work considered the DVB-S2 standard adaptive transmitter parameters and additional ones expected to be present in future adaptive radio systems. Performance results are provided by analysis of the proposed hybrid algorithm when operating across a satellite communication channel from Earth to GEO orbit during clear sky conditions. The proposed approach constitutes part of the core cognitive engine proof-of-concept to be delivered to the NASA Glenn Research Center SCaN Testbed located onboard the International Space Station.

Chornobyl, radiation, neural tube defects, and microcephaly.

PubMed

Wertelecki, Wladimir; Yevtushok, Lyubov; Kuznietsov, Illia; Komov, Oleksandr; Lapchenko, Serhii; Akhmedzanova, Diana; Ostapchuk, Lyubov

2018-06-13

Pregnant women residing in areas impacted by the Chornobyl ionizing radiation of the Rivne Province in Ukraine have persistent higher levels of incorporated cesium-137. In these areas the neural tube defects and microcephaly rates are significantly higher than in areas with lower maternal cesium-137 incorporated levels. In two Rivne counties with populations proximal to nuclear power plants the rates of neural tube defects and microcephaly are the highest in the province. The neural tube defects rates in Rivne are persistently among the highest in Europe. Copyright © 2018 Elsevier Masson SAS. All rights reserved.

A neural model of valuation and information virality

PubMed Central

Baek, Elisa C.; O’Donnell, Matthew Brook; Kim, Hyun Suk; Cappella, Joseph N.

2017-01-01

Information sharing is an integral part of human interaction that serves to build social relationships and affects attitudes and behaviors in individuals and large groups. We present a unifying neurocognitive framework of mechanisms underlying information sharing at scale (virality). We argue that expectations regarding self-related and social consequences of sharing (e.g., in the form of potential for self-enhancement or social approval) are integrated into a domain-general value signal that encodes the value of sharing a piece of information. This value signal translates into population-level virality. In two studies (n = 41 and 39 participants), we tested these hypotheses using functional neuroimaging. Neural activity in response to 80 New York Times articles was observed in theory-driven regions of interest associated with value, self, and social cognitions. This activity then was linked to objectively logged population-level data encompassing n = 117,611 internet shares of the articles. In both studies, activity in neural regions associated with self-related and social cognition was indirectly related to population-level sharing through increased neural activation in the brain's value system. Neural activity further predicted population-level outcomes over and above the variance explained by article characteristics and commonly used self-report measures of sharing intentions. This parsimonious framework may help advance theory, improve predictive models, and inform new approaches to effective intervention. More broadly, these data shed light on the core functions of sharing—to express ourselves in positive ways and to strengthen our social bonds. PMID:28242678

Realistic thermodynamic and statistical-mechanical measures for neural synchronization.

PubMed

Kim, Sang-Yoon; Lim, Woochang

2014-04-15

Synchronized brain rhythms, associated with diverse cognitive functions, have been observed in electrical recordings of brain activity. Neural synchronization may be well described by using the population-averaged global potential VG in computational neuroscience. The time-averaged fluctuation of VG plays the role of a "thermodynamic" order parameter O used for describing the synchrony-asynchrony transition in neural systems. Population spike synchronization may be well visualized in the raster plot of neural spikes. The degree of neural synchronization seen in the raster plot is well measured in terms of a "statistical-mechanical" spike-based measure Ms introduced by considering the occupation and the pacing patterns of spikes. The global potential VG is also used to give a reference global cycle for the calculation of Ms. Hence, VG becomes an important collective quantity because it is associated with calculation of both O and Ms. However, it is practically difficult to directly get VG in real experiments. To overcome this difficulty, instead of VG, we employ the instantaneous population spike rate (IPSR) which can be obtained in experiments, and develop realistic thermodynamic and statistical-mechanical measures, based on IPSR, to make practical characterization of the neural synchronization in both computational and experimental neuroscience. Particularly, more accurate characterization of weak sparse spike synchronization can be achieved in terms of realistic statistical-mechanical IPSR-based measure, in comparison with the conventional measure based on VG. Copyright © 2014. Published by Elsevier B.V.

Maximum entropy models as a tool for building precise neural controls.

PubMed

Savin, Cristina; Tkačik, Gašper

2017-10-01

Neural responses are highly structured, with population activity restricted to a small subset of the astronomical range of possible activity patterns. Characterizing these statistical regularities is important for understanding circuit computation, but challenging in practice. Here we review recent approaches based on the maximum entropy principle used for quantifying collective behavior in neural activity. We highlight recent models that capture population-level statistics of neural data, yielding insights into the organization of the neural code and its biological substrate. Furthermore, the MaxEnt framework provides a general recipe for constructing surrogate ensembles that preserve aspects of the data, but are otherwise maximally unstructured. This idea can be used to generate a hierarchy of controls against which rigorous statistical tests are possible. Copyright © 2017 Elsevier Ltd. All rights reserved.

ANNarchy: a code generation approach to neural simulations on parallel hardware

PubMed Central

Vitay, Julien; Dinkelbach, Helge Ü.; Hamker, Fred H.

2015-01-01

Many modern neural simulators focus on the simulation of networks of spiking neurons on parallel hardware. Another important framework in computational neuroscience, rate-coded neural networks, is mostly difficult or impossible to implement using these simulators. We present here the ANNarchy (Artificial Neural Networks architect) neural simulator, which allows to easily define and simulate rate-coded and spiking networks, as well as combinations of both. The interface in Python has been designed to be close to the PyNN interface, while the definition of neuron and synapse models can be specified using an equation-oriented mathematical description similar to the Brian neural simulator. This information is used to generate C++ code that will efficiently perform the simulation on the chosen parallel hardware (multi-core system or graphical processing unit). Several numerical methods are available to transform ordinary differential equations into an efficient C++code. We compare the parallel performance of the simulator to existing solutions. PMID:26283957

Signatures of criticality arise from random subsampling in simple population models.

PubMed

Nonnenmacher, Marcel; Behrens, Christian; Berens, Philipp; Bethge, Matthias; Macke, Jakob H

2017-10-01

The rise of large-scale recordings of neuronal activity has fueled the hope to gain new insights into the collective activity of neural ensembles. How can one link the statistics of neural population activity to underlying principles and theories? One attempt to interpret such data builds upon analogies to the behaviour of collective systems in statistical physics. Divergence of the specific heat-a measure of population statistics derived from thermodynamics-has been used to suggest that neural populations are optimized to operate at a "critical point". However, these findings have been challenged by theoretical studies which have shown that common inputs can lead to diverging specific heat. Here, we connect "signatures of criticality", and in particular the divergence of specific heat, back to statistics of neural population activity commonly studied in neural coding: firing rates and pairwise correlations. We show that the specific heat diverges whenever the average correlation strength does not depend on population size. This is necessarily true when data with correlations is randomly subsampled during the analysis process, irrespective of the detailed structure or origin of correlations. We also show how the characteristic shape of specific heat capacity curves depends on firing rates and correlations, using both analytically tractable models and numerical simulations of a canonical feed-forward population model. To analyze these simulations, we develop efficient methods for characterizing large-scale neural population activity with maximum entropy models. We find that, consistent with experimental findings, increases in firing rates and correlation directly lead to more pronounced signatures. Thus, previous reports of thermodynamical criticality in neural populations based on the analysis of specific heat can be explained by average firing rates and correlations, and are not indicative of an optimized coding strategy. We conclude that a reliable interpretation

Estimation of effective connectivity via data-driven neural modeling

PubMed Central

Freestone, Dean R.; Karoly, Philippa J.; Nešić, Dragan; Aram, Parham; Cook, Mark J.; Grayden, David B.

2014-01-01

This research introduces a new method for functional brain imaging via a process of model inversion. By estimating parameters of a computational model, we are able to track effective connectivity and mean membrane potential dynamics that cannot be directly measured using electrophysiological measurements alone. The ability to track the hidden aspects of neurophysiology will have a profound impact on the way we understand and treat epilepsy. For example, under the assumption the model captures the key features of the cortical circuits of interest, the framework will provide insights into seizure initiation and termination on a patient-specific basis. It will enable investigation into the effect a particular drug has on specific neural populations and connectivity structures using minimally invasive measurements. The method is based on approximating brain networks using an interconnected neural population model. The neural population model is based on a neural mass model that describes the functional activity of the brain, capturing the mesoscopic biophysics and anatomical structure. The model is made subject-specific by estimating the strength of intra-cortical connections within a region and inter-cortical connections between regions using a novel Kalman filtering method. We demonstrate through simulation how the framework can be used to track the mechanisms involved in seizure initiation and termination. PMID:25506315

Neural responses of rat cortical layers due to infrared neural modulation and photoablation of thalamocortical brain slices

NASA Astrophysics Data System (ADS)

Jenkins, J. Logan; Kao, Chris C.; Cayce, Jonathan M.; Mahadevan-Jansen, Anita; Jansen, E. Duco

2017-02-01

Infrared neural modulation (INM) is a label-free method for eliciting neural activity with high spatial selectivity in mammalian models. While there has been an emphasis on INM research towards applications in the peripheral nervous system and the central nervous system (CNS), the biophysical mechanisms by which INM occurs remains largely unresolved. In the rat CNS, INM has been shown to elicit and inhibit neural activity, evoke calcium signals that are dependent on glutamate transients and astrocytes, and modulate inhibitory GABA currents. So far, in vivo experiments have been restricted to layers I and II of the rat cortex which consists mainly of astrocytes, inhibitory neurons, and dendrites from deeper excitatory neurons owing to strong absorption of light in these layers. Deeper cortical layers (III-VI) have vastly different cell type composition, consisting predominantly of excitatory neurons which can be targeted for therapies such as deep brain stimulation. The neural responses to infrared light of deeper cortical cells have not been well defined. Acute thalamocortical brain slices will allow us to analyze the effects of INS on various components of the cortex, including different cortical layers and cell populations. In this study, we present the use of photoablation with an erbium:YAG laser to reduce the thickness of the dead cell zone near the cutting surface of brain slices. This technique will allow for more optical energy to reach living cells, which should contribute the successful transduction of pulsed infrared light to neural activity. In the future, INM-induced neural responses will lead to a finer characterization of the parameter space for the neuromodulation of different cortical cell types and may contribute to understanding the cell populations that are important for allowing optical stimulation of neurons in the CNS.

A novel method for 3D measurement of RFID multi-tag network based on matching vision and wavelet

NASA Astrophysics Data System (ADS)

Zhuang, Xiao; Yu, Xiaolei; Zhao, Zhimin; Wang, Donghua; Zhang, Wenjie; Liu, Zhenlu; Lu, Dongsheng; Dong, Dingbang

2018-07-01

In the field of radio frequency identification (RFID), the three-dimensional (3D) distribution of RFID multi-tag networks has a significant impact on their reading performance. At the same time, in order to realize the anti-collision of RFID multi-tag networks in practical engineering applications, the 3D distribution of RFID multi-tag networks must be measured. In this paper, a novel method for the 3D measurement of RFID multi-tag networks is proposed. A dual-CCD system (vertical and horizontal cameras) is used to obtain images of RFID multi-tag networks from different angles. Then, the wavelet threshold denoising method is used to remove noise in the obtained images. The template matching method is used to determine the two-dimensional coordinates and vertical coordinate of each tag. The 3D coordinates of each tag are obtained subsequently. Finally, a model of the nonlinear relation between the 3D coordinate distribution of the RFID multi-tag network and the corresponding reading distance is established using the wavelet neural network. The experiment results show that the average prediction relative error is 0.71% and the time cost is 2.17 s. The values of the average prediction relative error and time cost are smaller than those of the particle swarm optimization neural network and genetic algorithm–back propagation neural network. The time cost of the wavelet neural network is about 1% of that of the other two methods. The method proposed in this paper has a smaller relative error. The proposed method can improve the real-time performance of RFID multi-tag networks and the overall dynamic performance of multi-tag networks.

Airplane detection in remote sensing images using convolutional neural networks

NASA Astrophysics Data System (ADS)

Ouyang, Chao; Chen, Zhong; Zhang, Feng; Zhang, Yifei

2018-03-01

Airplane detection in remote sensing images remains a challenging problem and has also been taking a great interest to researchers. In this paper we propose an effective method to detect airplanes in remote sensing images using convolutional neural networks. Deep learning methods show greater advantages than the traditional methods with the rise of deep neural networks in target detection, and we give an explanation why this happens. To improve the performance on detection of airplane, we combine a region proposal algorithm with convolutional neural networks. And in the training phase, we divide the background into multi classes rather than one class, which can reduce false alarms. Our experimental results show that the proposed method is effective and robust in detecting airplane.

Efficient Evaluation Functions for Multi-Rover Systems

NASA Technical Reports Server (NTRS)

Agogino, Adrian; Tumer, Kagan

2004-01-01

Evolutionary computation can be a powerful tool in cresting a control policy for a single agent receiving local continuous input. This paper extends single-agent evolutionary computation to multi-agent systems, where a collection of agents strives to maximize a global fitness evaluation function that rates the performance of the entire system. This problem is solved in a distributed manner, where each agent evolves its own population of neural networks that are used as the control policies for the agent. Each agent evolves its population using its own agent-specific fitness evaluation function. We propose to create these agent-specific evaluation functions using the theory of collectives to avoid the coordination problem where each agent evolves a population that maximizes its own fitness function, yet the system has a whole achieves low values of the global fitness function. Instead we will ensure that each fitness evaluation function is both "aligned" with the global evaluation function and is "learnable," i.e., the agents can readily see how their behavior affects their evaluation function. We then show how these agent-specific evaluation functions outperform global evaluation methods by up to 600% in a domain where a set of rovers attempt to maximize the amount of information observed while navigating through a simulated environment.

Antibiotic resistance shaping multi-level population biology of bacteria

PubMed Central

Baquero, Fernando; Tedim, Ana P.; Coque, Teresa M.

2013-01-01

Antibiotics have natural functions, mostly involving cell-to-cell signaling networks. The anthropogenic production of antibiotics, and its release in the microbiosphere results in a disturbance of these networks, antibiotic resistance tending to preserve its integrity. The cost of such adaptation is the emergence and dissemination of antibiotic resistance genes, and of all genetic and cellular vehicles in which these genes are located. Selection of the combinations of the different evolutionary units (genes, integrons, transposons, plasmids, cells, communities and microbiomes, hosts) is highly asymmetrical. Each unit of selection is a self-interested entity, exploiting the higher hierarchical unit for its own benefit, but in doing so the higher hierarchical unit might acquire critical traits for its spread because of the exploitation of the lower hierarchical unit. This interactive trade-off shapes the population biology of antibiotic resistance, a composed-complex array of the independent “population biologies.” Antibiotics modify the abundance and the interactive field of each of these units. Antibiotics increase the number and evolvability of “clinical” antibiotic resistance genes, but probably also many other genes with different primary functions but with a resistance phenotype present in the environmental resistome. Antibiotics influence the abundance, modularity, and spread of integrons, transposons, and plasmids, mostly acting on structures present before the antibiotic era. Antibiotics enrich particular bacterial lineages and clones and contribute to local clonalization processes. Antibiotics amplify particular genetic exchange communities sharing antibiotic resistance genes and platforms within microbiomes. In particular human or animal hosts, the microbiomic composition might facilitate the interactions between evolutionary units involved in antibiotic resistance. The understanding of antibiotic resistance implies expanding our knowledge on multi

Aspiration dynamics of multi-player games in finite populations

PubMed Central

Du, Jinming; Wu, Bin; Altrock, Philipp M.; Wang, Long

2014-01-01

On studying strategy update rules in the framework of evolutionary game theory, one can differentiate between imitation processes and aspiration-driven dynamics. In the former case, individuals imitate the strategy of a more successful peer. In the latter case, individuals adjust their strategies based on a comparison of their pay-offs from the evolutionary game to a value they aspire, called the level of aspiration. Unlike imitation processes of pairwise comparison, aspiration-driven updates do not require additional information about the strategic environment and can thus be interpreted as being more spontaneous. Recent work has mainly focused on understanding how aspiration dynamics alter the evolutionary outcome in structured populations. However, the baseline case for understanding strategy selection is the well-mixed population case, which is still lacking sufficient understanding. We explore how aspiration-driven strategy-update dynamics under imperfect rationality influence the average abundance of a strategy in multi-player evolutionary games with two strategies. We analytically derive a condition under which a strategy is more abundant than the other in the weak selection limiting case. This approach has a long-standing history in evolutionary games and is mostly applied for its mathematical approachability. Hence, we also explore strong selection numerically, which shows that our weak selection condition is a robust predictor of the average abundance of a strategy. The condition turns out to differ from that of a wide class of imitation dynamics, as long as the game is not dyadic. Therefore, a strategy favoured under imitation dynamics can be disfavoured under aspiration dynamics. This does not require any population structure, and thus highlights the intrinsic difference between imitation and aspiration dynamics. PMID:24598208

Antibiotic resistance shaping multi-level population biology of bacteria.

PubMed

Baquero, Fernando; Tedim, Ana P; Coque, Teresa M

2013-01-01

Antibiotics have natural functions, mostly involving cell-to-cell signaling networks. The anthropogenic production of antibiotics, and its release in the microbiosphere results in a disturbance of these networks, antibiotic resistance tending to preserve its integrity. The cost of such adaptation is the emergence and dissemination of antibiotic resistance genes, and of all genetic and cellular vehicles in which these genes are located. Selection of the combinations of the different evolutionary units (genes, integrons, transposons, plasmids, cells, communities and microbiomes, hosts) is highly asymmetrical. Each unit of selection is a self-interested entity, exploiting the higher hierarchical unit for its own benefit, but in doing so the higher hierarchical unit might acquire critical traits for its spread because of the exploitation of the lower hierarchical unit. This interactive trade-off shapes the population biology of antibiotic resistance, a composed-complex array of the independent "population biologies." Antibiotics modify the abundance and the interactive field of each of these units. Antibiotics increase the number and evolvability of "clinical" antibiotic resistance genes, but probably also many other genes with different primary functions but with a resistance phenotype present in the environmental resistome. Antibiotics influence the abundance, modularity, and spread of integrons, transposons, and plasmids, mostly acting on structures present before the antibiotic era. Antibiotics enrich particular bacterial lineages and clones and contribute to local clonalization processes. Antibiotics amplify particular genetic exchange communities sharing antibiotic resistance genes and platforms within microbiomes. In particular human or animal hosts, the microbiomic composition might facilitate the interactions between evolutionary units involved in antibiotic resistance. The understanding of antibiotic resistance implies expanding our knowledge on multi

Aspiration dynamics of multi-player games in finite populations.

PubMed

Du, Jinming; Wu, Bin; Altrock, Philipp M; Wang, Long

2014-05-06

On studying strategy update rules in the framework of evolutionary game theory, one can differentiate between imitation processes and aspiration-driven dynamics. In the former case, individuals imitate the strategy of a more successful peer. In the latter case, individuals adjust their strategies based on a comparison of their pay-offs from the evolutionary game to a value they aspire, called the level of aspiration. Unlike imitation processes of pairwise comparison, aspiration-driven updates do not require additional information about the strategic environment and can thus be interpreted as being more spontaneous. Recent work has mainly focused on understanding how aspiration dynamics alter the evolutionary outcome in structured populations. However, the baseline case for understanding strategy selection is the well-mixed population case, which is still lacking sufficient understanding. We explore how aspiration-driven strategy-update dynamics under imperfect rationality influence the average abundance of a strategy in multi-player evolutionary games with two strategies. We analytically derive a condition under which a strategy is more abundant than the other in the weak selection limiting case. This approach has a long-standing history in evolutionary games and is mostly applied for its mathematical approachability. Hence, we also explore strong selection numerically, which shows that our weak selection condition is a robust predictor of the average abundance of a strategy. The condition turns out to differ from that of a wide class of imitation dynamics, as long as the game is not dyadic. Therefore, a strategy favoured under imitation dynamics can be disfavoured under aspiration dynamics. This does not require any population structure, and thus highlights the intrinsic difference between imitation and aspiration dynamics.

Hierarchical competitions subserving multi-attribute choice

PubMed Central

Hunt, Laurence T; Dolan, Raymond J; Behrens, Timothy EJ

2015-01-01

Valuation is a key tenet of decision neuroscience, where it is generally assumed that different attributes of competing options are assimilated into unitary values. Such values are central to current neural models of choice. By contrast, psychological studies emphasize complex interactions between choice and valuation. Principles of neuronal selection also suggest competitive inhibition may occur in early valuation stages, before option selection. Here, we show behavior in multi-attribute choice is best explained by a model involving competition at multiple levels of representation. This hierarchical model also explains neural signals in human brain regions previously linked to valuation, including striatum, parietal and prefrontal cortex, where activity represents competition within-attribute, competition between attributes, and option selection. This multi-layered inhibition framework challenges the assumption that option values are computed before choice. Instead our results indicate a canonical competition mechanism throughout all stages of a processing hierarchy, not simply at a final choice stage. PMID:25306549

Chronic kidney disease, cardiovascular disease and mortality: A prospective cohort study in a multi-ethnic Asian population.

PubMed

Lim, Cynthia C; Teo, Boon Wee; Ong, Peng Guan; Cheung, Carol Y; Lim, Su Chi; Chow, Khuan Yew; Meng, Chan Choon; Lee, Jeannette; Tai, E Shyong; Wong, Tien Y; Sabanayagam, Charumathi

2015-08-01

Few studies have examined the impact of chronic kidney disease (CKD) on adverse cardiovascular outcomes and deaths in Asian populations. We evaluated the associations of CKD with cardiovascular disease (CVD) and all-cause mortality in a multi-ethnic Asian population. Prospective cohort study of 7098 individuals who participated in two independent population-based studies involving Malay adults (n = 3148) and a multi-ethnic cohort of Chinese, Malay and Indian adults (n = 3950). CKD was assessed from CKD-EPI estimated glomerular filtration rate (eGFR) and urine albumin-to-creatinine ratio (UACR). Incident CVD (myocardial infarction, stroke and CVD mortality) and all-cause mortality were identified by linkage with national disease/death registries. Over a median follow-up of 4.3 years, 4.6% developed CVD and 6.1% died. Risks of both CVD and all-cause mortality increased with decreasing eGFR and increasing albuminuria (all p-trend <0.05). Adjusted hazard ratios (HR (95% confidence interval)) of CVD and all-cause mortality were: 1.54 (1.05-2.27) and 2.21 (1.67-2.92) comparing eGFR <45 vs ≥60; 2.81 (1.49-5.29) and 2.34 (1.28-4.28) comparing UACR ≥300 vs <30. The association between eGFR <60 and all-cause mortality was stronger among those with diabetes (p-interaction = 0.02). PAR of incident CVD was greater among those with UACR ≥300 (12.9%) and that of all-cause mortality greater among those with eGFR <45 (16.5%). In multi-ethnic Asian adults, lower eGFR and higher albuminuria were independently associated with incident CVD and all-cause mortality. These findings extend previously reported similar associations in Western populations to Asians and emphasize the need for early detection of CKD and intervention to prevent adverse outcomes. © The European Society of Cardiology 2014.

Neural Mechanism Underling Comprehension of Narrative Speech and Its Heritability: Study in a Large Population.

PubMed

Babajani-Feremi, Abbas

2017-09-01

Comprehension of narratives constitutes a fundamental part of our everyday life experience. Although the neural mechanism of auditory narrative comprehension has been investigated in some studies, the neural correlates underlying this mechanism and its heritability remain poorly understood. We investigated comprehension of naturalistic speech in a large, healthy adult population (n = 429; 176/253 M/F; 22-36 years of age) consisting of 192 twin pairs (49 monozygotic and 47 dizygotic pairs) and 237 of their siblings. We used high quality functional MRI datasets from the Human Connectome Project (HCP) in which a story-based paradigm was utilized for the auditory narrative comprehension. Our results revealed that narrative comprehension was associated with activations of the classical language regions including superior temporal gyrus (STG), middle temporal gyrus (MTG), and inferior frontal gyrus (IFG) in both hemispheres, though STG and MTG were activated symmetrically and activation in IFG were left-lateralized. Our results further showed that the narrative comprehension was associated with activations in areas beyond the classical language regions, e.g. medial superior frontal gyrus (SFGmed), middle frontal gyrus (MFG), and supplementary motor area (SMA). Of subcortical structures, only the hippocampus was involved. The results of heritability analysis revealed that the oral reading recognition and picture vocabulary comprehension were significantly heritable (h 2  > 0.56, p < 10 - 13 ). In addition, the extent of activation of five areas in the left hemisphere, i.e. STG, IFG pars opercularis, SFGmed, SMA, and precuneus, and one area in the right hemisphere, i.e. MFG, were significantly heritable (h 2  > 0.33, p < 0.0004). The current study, to the best of our knowledge, is the first to investigate auditory narrative comprehension and its heritability in a large healthy population. Referring to the excellent quality of the HCP data, our

LavaNet—Neural network development environment in a general mine planning package

NASA Astrophysics Data System (ADS)

Kapageridis, Ioannis Konstantinou; Triantafyllou, A. G.

2011-04-01

LavaNet is a series of scripts written in Perl that gives access to a neural network simulation environment inside a general mine planning package. A well known and a very popular neural network development environment, the Stuttgart Neural Network Simulator, is used as the base for the development of neural networks. LavaNet runs inside VULCAN™—a complete mine planning package with advanced database, modelling and visualisation capabilities. LavaNet is taking advantage of VULCAN's Perl based scripting environment, Lava, to bring all the benefits of neural network development and application to geologists, mining engineers and other users of the specific mine planning package. LavaNet enables easy development of neural network training data sets using information from any of the data and model structures available, such as block models and drillhole databases. Neural networks can be trained inside VULCAN™ and the results be used to generate new models that can be visualised in 3D. Direct comparison of developed neural network models with conventional and geostatistical techniques is now possible within the same mine planning software package. LavaNet supports Radial Basis Function networks, Multi-Layer Perceptrons and Self-Organised Maps.

Distributed adaptive neural network control for a class of heterogeneous nonlinear multi-agent systems subject to actuation failures

NASA Astrophysics Data System (ADS)

Cui, Bing; Zhao, Chunhui; Ma, Tiedong; Feng, Chi

2017-02-01

In this paper, the cooperative adaptive consensus tracking problem for heterogeneous nonlinear multi-agent systems on directed graph is addressed. Each follower is modelled as a general nonlinear system with the unknown and nonidentical nonlinear dynamics, disturbances and actuator failures. Cooperative fault tolerant neural network tracking controllers with online adaptive learning features are proposed to guarantee that all agents synchronise to the trajectory of one leader with bounded adjustable synchronisation errors. With the help of linear quadratic regulator-based optimal design, a graph-dependent Lyapunov proof provides error bounds that depend on the graph topology, one virtual matrix and some design parameters. Of particular interest is that if the control gain is selected appropriately, the proposed control scheme can be implemented in a unified framework no matter whether there are faults or not. Furthermore, the fault detection and isolation are not needed to implement. Finally, a simulation is given to verify the effectiveness of the proposed method.

Comparison of Gender Differences in Intracerebral Hemorrhage in a Multi-Ethnic Asian Population.

PubMed

Hsieh, Justin T; Ang, Beng Ti; Ng, Yew Poh; Allen, John C; King, Nicolas K K

2016-01-01

Intracerebral hemorrhage (ICH) accounts for 10-15% of all first time strokes and with incidence twice as high in the Asian compared to Western population. This study aims to investigate gender differences in ICH patient outcomes in a multi-ethnic Asian population. Data for 1,192 patients admitted for ICH were collected over a four-year period. Multivariate logistic regression was used to identify independent predictors and odds ratios were computed for 30-day mortality and Glasgow Outcome Scale (GOS) comparing males and females. Males suffered ICH at a younger age than females (62.2 ± 13.2 years vs. 66.3 ± 15.3 years; P<0.001). The occurrence of ICH was higher among males than females at all ages until 80 years old, beyond which the trend was reversed. Females exhibited increased severity on admission as measured by Glasgow Coma Scale compared to males (10.9 ± 4.03 vs. 11.4 ± 4.04; P = 0.030). No difference was found in 30-day mortality between females and males (F: 30.5% [155/508] vs. M: 27.0% [186/688]), with unadjusted and adjusted odds ratio (F/M) of 1.19 (P = 0.188) and 1.21 (P = 0.300). At discharge, there was a non-statistically significant but potentially clinically relevant morbidity difference between the genders as measured by GOS (dichotomized GOS of 4-5: F: 23.7% [119/503] vs. M: 28.7% [194/677]), with unadjusted and adjusted odds ratio (F/M) of 0.77 (P = 0.055) and 0.87 (P = 0.434). In our multi-ethnic Asian population, males developed ICH at a younger age and were more susceptible to ICH than women at all ages other than the beyond 80-year old age group. In contrast to the Western population, neurological status of female ICH patients at admission was poorer and their 30-day mortality was not reduced. Although the study was not powered to detect significance, female showed a trend toward worse 30-day morbidity at discharge.

Neural decoding with kernel-based metric learning.

PubMed

Brockmeier, Austin J; Choi, John S; Kriminger, Evan G; Francis, Joseph T; Principe, Jose C

2014-06-01

In studies of the nervous system, the choice of metric for the neural responses is a pivotal assumption. For instance, a well-suited distance metric enables us to gauge the similarity of neural responses to various stimuli and assess the variability of responses to a repeated stimulus-exploratory steps in understanding how the stimuli are encoded neurally. Here we introduce an approach where the metric is tuned for a particular neural decoding task. Neural spike train metrics have been used to quantify the information content carried by the timing of action potentials. While a number of metrics for individual neurons exist, a method to optimally combine single-neuron metrics into multineuron, or population-based, metrics is lacking. We pose the problem of optimizing multineuron metrics and other metrics using centered alignment, a kernel-based dependence measure. The approach is demonstrated on invasively recorded neural data consisting of both spike trains and local field potentials. The experimental paradigm consists of decoding the location of tactile stimulation on the forepaws of anesthetized rats. We show that the optimized metrics highlight the distinguishing dimensions of the neural response, significantly increase the decoding accuracy, and improve nonlinear dimensionality reduction methods for exploratory neural analysis.

A 3D convolutional neural network approach to land cover classification using LiDAR and multi-temporal Landsat imagery

NASA Astrophysics Data System (ADS)

Xu, Z.; Guan, K.; Peng, B.; Casler, N. P.; Wang, S. W.

2017-12-01

Landscape has complex three-dimensional features. These 3D features are difficult to extract using conventional methods. Small-footprint LiDAR provides an ideal way for capturing these features. Existing approaches, however, have been relegated to raster or metric-based (two-dimensional) feature extraction from the upper or bottom layer, and thus are not suitable for resolving morphological and intensity features that could be important to fine-scale land cover mapping. Therefore, this research combines airborne LiDAR and multi-temporal Landsat imagery to classify land cover types of Williamson County, Illinois that has diverse and mixed landscape features. Specifically, we applied a 3D convolutional neural network (CNN) method to extract features from LiDAR point clouds by (1) creating occupancy grid, intensity grid at 1-meter resolution, and then (2) normalizing and incorporating data into a 3D CNN feature extractor for many epochs of learning. The learned features (e.g., morphological features, intensity features, etc) were combined with multi-temporal spectral data to enhance the performance of land cover classification based on a Support Vector Machine classifier. We used photo interpretation for training and testing data generation. The classification results show that our approach outperforms traditional methods using LiDAR derived feature maps, and promises to serve as an effective methodology for creating high-quality land cover maps through fusion of complementary types of remote sensing data.

Scalable training of artificial neural networks with adaptive sparse connectivity inspired by network science.

PubMed

Mocanu, Decebal Constantin; Mocanu, Elena; Stone, Peter; Nguyen, Phuong H; Gibescu, Madeleine; Liotta, Antonio

2018-06-19

Through the success of deep learning in various domains, artificial neural networks are currently among the most used artificial intelligence methods. Taking inspiration from the network properties of biological neural networks (e.g. sparsity, scale-freeness), we argue that (contrary to general practice) artificial neural networks, too, should not have fully-connected layers. Here we propose sparse evolutionary training of artificial neural networks, an algorithm which evolves an initial sparse topology (Erdős-Rényi random graph) of two consecutive layers of neurons into a scale-free topology, during learning. Our method replaces artificial neural networks fully-connected layers with sparse ones before training, reducing quadratically the number of parameters, with no decrease in accuracy. We demonstrate our claims on restricted Boltzmann machines, multi-layer perceptrons, and convolutional neural networks for unsupervised and supervised learning on 15 datasets. Our approach has the potential to enable artificial neural networks to scale up beyond what is currently possible.

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

NASA Technical Reports Server (NTRS)

van den Bergh, Jarrett; Schutz, Joey; Li, Alan; Chirayath, Ved

2017-01-01

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Nets convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign. Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users input against pre-classified coral imagery to gauge their accuracy and utilize in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

NASA Astrophysics Data System (ADS)

van den Bergh, J.; Schutz, J.; Chirayath, V.; Li, A.

2017-12-01

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Net's convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign.Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users' input against pre-classified coral imagery to gauge their accuracy and utilizes in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

A Multi-Scale Distribution Model for Non-Equilibrium Populations Suggests Resource Limitation in an Endangered Rodent

PubMed Central

Bean, William T.; Stafford, Robert; Butterfield, H. Scott; Brashares, Justin S.

2014-01-01

Species distributions are known to be limited by biotic and abiotic factors at multiple temporal and spatial scales. Species distribution models, however, frequently assume a population at equilibrium in both time and space. Studies of habitat selection have repeatedly shown the difficulty of estimating resource selection if the scale or extent of analysis is incorrect. Here, we present a multi-step approach to estimate the realized and potential distribution of the endangered giant kangaroo rat. First, we estimate the potential distribution by modeling suitability at a range-wide scale using static bioclimatic variables. We then examine annual changes in extent at a population-level. We define “available” habitat based on the total suitable potential distribution at the range-wide scale. Then, within the available habitat, model changes in population extent driven by multiple measures of resource availability. By modeling distributions for a population with robust estimates of population extent through time, and ecologically relevant predictor variables, we improved the predictive ability of SDMs, as well as revealed an unanticipated relationship between population extent and precipitation at multiple scales. At a range-wide scale, the best model indicated the giant kangaroo rat was limited to areas that received little to no precipitation in the summer months. In contrast, the best model for shorter time scales showed a positive relation with resource abundance, driven by precipitation, in the current and previous year. These results suggest that the distribution of the giant kangaroo rat was limited to the wettest parts of the drier areas within the study region. This multi-step approach reinforces the differing relationship species may have with environmental variables at different scales, provides a novel method for defining “available” habitat in habitat selection studies, and suggests a way to create distribution models at spatial and temporal scales

[The mechanism and function of hippocampal neural oscillation].

PubMed

Lu, Ning; Xing, Dan-Qin; Sheng, Tao; Lu, Wei

2017-10-25

Neural oscillation is rhythmic or repetitive neural activity in the central nervous system that is usually generated by oscillatory activity of neuronal ensembles, reflecting regular and synchronized activities within these cell populations. According to several oscillatory bands covering frequencies from approximately 0.5 Hz to >100 Hz, neural oscillations are usually classified as delta oscillation (0.5-3 Hz), theta oscillation (4-12 Hz), beta oscillation (12-30 Hz), gamma oscillation (30-100 Hz) and sharp-wave ripples (>100 Hz ripples superimposed on 0.01-3 Hz sharp waves). Neural oscillation in different frequencies can be detected in different brain regions of human and animal during perception, motion and sleep, and plays an essential role in cognition, learning and memory process. In this review, we summarize recent findings on neural oscillations in hippocampus, as well as the mechanism and function of hippocampal theta oscillation, gamma oscillation and sharp-wave ripples. This review may yield new insights into the functions of neural oscillation in general.

[Measurement and performance analysis of functional neural network].

PubMed

Li, Shan; Liu, Xinyu; Chen, Yan; Wan, Hong

2018-04-01

The measurement of network is one of the important researches in resolving neuronal population information processing mechanism using complex network theory. For the quantitative measurement problem of functional neural network, the relation between the measure indexes, i.e. the clustering coefficient, the global efficiency, the characteristic path length and the transitivity, and the network topology was analyzed. Then, the spike-based functional neural network was established and the simulation results showed that the measured network could represent the original neural connections among neurons. On the basis of the former work, the coding of functional neural network in nidopallium caudolaterale (NCL) about pigeon's motion behaviors was studied. We found that the NCL functional neural network effectively encoded the motion behaviors of the pigeon, and there were significant differences in four indexes among the left-turning, the forward and the right-turning. Overall, the establishment method of spike-based functional neural network is available and it is an effective tool to parse the brain information processing mechanism.

Development of teeth in chick embryos after mouse neural crest transplantations.

PubMed

Mitsiadis, Thimios A; Chéraud, Yvonnick; Sharpe, Paul; Fontaine-Pérus, Josiane

2003-05-27

Teeth were lost in birds 70-80 million years ago. Current thinking holds that it is the avian cranial neural crest-derived mesenchyme that has lost odontogenic capacity, whereas the oral epithelium retains the signaling properties required to induce odontogenesis. To investigate the odontogenic capacity of ectomesenchyme, we have used neural tube transplantations from mice to chick embryos to replace the chick neural crest cell populations with mouse neural crest cells. The mouse/chick chimeras obtained show evidence of tooth formation showing that avian oral epithelium is able to induce a nonavian developmental program in mouse neural crest-derived mesenchymal cells.

Effects of Spearfishing on Reef Fish Populations in a Multi-Use Conservation Area

PubMed Central

Frisch, Ashley J.; Cole, Andrew J.; Hobbs, Jean-Paul A.; Rizzari, Justin R.; Munkres, Katherine P.

2012-01-01

Although spearfishing is a popular method of capturing fish, its ecological effects on fish populations are poorly understood, which makes it difficult to assess the legitimacy and desirability of spearfishing in multi-use marine reserves. Recent management changes within the Great Barrier Reef Marine Park (GBRMP) fortuitously created a unique scenario by which to quantify the effects of spearfishing on fish populations. As such, we employed underwater visual surveys and a before-after-control-impact experimental design to investigate the effects of spearfishing on the density and size structure of target and non-target fishes in a multi-use conservation park zone (CPZ) within the GBRMP. Three years after spearfishing was first allowed in the CPZ, there was a 54% reduction in density and a 27% reduction in mean size of coral trout (Plectropomus spp.), the primary target species. These changes were attributed to spearfishing because benthic habitat characteristics and the density of non-target fishes were stable through time, and the density and mean size of coral trout in a nearby control zone (where spearfishing was prohibited) remained unchanged. We conclude that spearfishing, like other forms of fishing, can have rapid and substantial negative effects on target fish populations. Careful management of spearfishing is therefore needed to ensure that conservation obligations are achieved and that fishery resources are harvested sustainably. This is particularly important both for the GBRMP, due to its extraordinarily high conservation value and world heritage status, and for tropical island nations where people depend on spearfishing for food and income. To minimize the effects of spearfishing on target species and to enhance protection of functionally important fishes (herbivores), we recommend that fishery managers adjust output controls such as size- and catch-limits, rather than prohibit spearfishing altogether. This will preserve the cultural and social

Developing a hippocampal neural prosthetic to facilitate human memory encoding and recall.

PubMed

Hampson, Robert E; Song, Dong; Robinson, Brian S; Fetterhoff, Dustin; Dakos, Alexander S; Roeder, Brent M; She, Xiwei; Wicks, Robert T; Witcher, Mark R; Couture, Daniel E; Laxton, Adrian W; Munger-Clary, Heidi; Popli, Gautam; Sollman, Myriam J; Whitlow, Christopher T; Marmarelis, Vasilis Z; Berger, Theodore W; Deadwyler, Sam A

2018-06-01

We demonstrate here the first successful implementation in humans of a proof-of-concept system for restoring and improving memory function via facilitation of memory encoding using the patient's own hippocampal spatiotemporal neural codes for memory. Memory in humans is subject to disruption by drugs, disease and brain injury, yet previous attempts to restore or rescue memory function in humans typically involved only nonspecific, modulation of brain areas and neural systems related to memory retrieval. We have constructed a model of processes by which the hippocampus encodes memory items via spatiotemporal firing of neural ensembles that underlie the successful encoding of short-term memory. A nonlinear multi-input, multi-output (MIMO) model of hippocampal CA3 and CA1 neural firing is computed that predicts activation patterns of CA1 neurons during the encoding (sample) phase of a delayed match-to-sample (DMS) human short-term memory task. MIMO model-derived electrical stimulation delivered to the same CA1 locations during the sample phase of DMS trials facilitated short-term/working memory by 37% during the task. Longer term memory retention was also tested in the same human subjects with a delayed recognition (DR) task that utilized images from the DMS task, along with images that were not from the task. Across the subjects, the stimulated trials exhibited significant improvement (35%) in both short-term and long-term retention of visual information. These results demonstrate the facilitation of memory encoding which is an important feature for the construction of an implantable neural prosthetic to improve human memory.

Developing a hippocampal neural prosthetic to facilitate human memory encoding and recall

NASA Astrophysics Data System (ADS)

Hampson, Robert E.; Song, Dong; Robinson, Brian S.; Fetterhoff, Dustin; Dakos, Alexander S.; Roeder, Brent M.; She, Xiwei; Wicks, Robert T.; Witcher, Mark R.; Couture, Daniel E.; Laxton, Adrian W.; Munger-Clary, Heidi; Popli, Gautam; Sollman, Myriam J.; Whitlow, Christopher T.; Marmarelis, Vasilis Z.; Berger, Theodore W.; Deadwyler, Sam A.

2018-06-01

Objective. We demonstrate here the first successful implementation in humans of a proof-of-concept system for restoring and improving memory function via facilitation of memory encoding using the patient’s own hippocampal spatiotemporal neural codes for memory. Memory in humans is subject to disruption by drugs, disease and brain injury, yet previous attempts to restore or rescue memory function in humans typically involved only nonspecific, modulation of brain areas and neural systems related to memory retrieval. Approach. We have constructed a model of processes by which the hippocampus encodes memory items via spatiotemporal firing of neural ensembles that underlie the successful encoding of short-term memory. A nonlinear multi-input, multi-output (MIMO) model of hippocampal CA3 and CA1 neural firing is computed that predicts activation patterns of CA1 neurons during the encoding (sample) phase of a delayed match-to-sample (DMS) human short-term memory task. Main results. MIMO model-derived electrical stimulation delivered to the same CA1 locations during the sample phase of DMS trials facilitated short-term/working memory by 37% during the task. Longer term memory retention was also tested in the same human subjects with a delayed recognition (DR) task that utilized images from the DMS task, along with images that were not from the task. Across the subjects, the stimulated trials exhibited significant improvement (35%) in both short-term and long-term retention of visual information. Significance. These results demonstrate the facilitation of memory encoding which is an important feature for the construction of an implantable neural prosthetic to improve human memory.

Using deep recurrent neural network for direct beam solar irradiance cloud screening

NASA Astrophysics Data System (ADS)

Chen, Maosi; Davis, John M.; Liu, Chaoshun; Sun, Zhibin; Zempila, Melina Maria; Gao, Wei

2017-09-01

Cloud screening is an essential procedure for in-situ calibration and atmospheric properties retrieval on (UV-)MultiFilter Rotating Shadowband Radiometer [(UV-)MFRSR]. Previous study has explored a cloud screening algorithm for direct-beam (UV-)MFRSR voltage measurements based on the stability assumption on a long time period (typically a half day or a whole day). To design such an algorithm requires in-depth understanding of radiative transfer and delicate data manipulation. Recent rapid developments on deep neural network and computation hardware have opened a window for modeling complicated End-to-End systems with a standardized strategy. In this study, a multi-layer dynamic bidirectional recurrent neural network is built for determining the cloudiness on each time point with a 17-year training dataset and tested with another 1-year dataset. The dataset is the daily 3-minute cosine corrected voltages, airmasses, and the corresponding cloud/clear-sky labels at two stations of the USDA UV-B Monitoring and Research Program. The results show that the optimized neural network model (3-layer, 250 hidden units, and 80 epochs of training) has an overall test accuracy of 97.87% (97.56% for the Oklahoma site and 98.16% for the Hawaii site). Generally, the neural network model grasps the key concept of the original model to use data in the entire day rather than short nearby measurements to perform cloud screening. A scrutiny of the logits layer suggests that the neural network model automatically learns a way to calculate a quantity similar to total optical depth and finds an appropriate threshold for cloud screening.

Neural Cell Chip Based Electrochemical Detection of Nanotoxicity

PubMed Central

Kafi, Md. Abdul; Cho, Hyeon-Yeol; Choi, Jeong Woo

2015-01-01

Development of a rapid, sensitive and cost-effective method for toxicity assessment of commonly used nanoparticles is urgently needed for the sustainable development of nanotechnology. A neural cell with high sensitivity and conductivity has become a potential candidate for a cell chip to investigate toxicity of environmental influences. A neural cell immobilized on a conductive surface has become a potential tool for the assessment of nanotoxicity based on electrochemical methods. The effective electrochemical monitoring largely depends on the adequate attachment of a neural cell on the chip surfaces. Recently, establishment of integrin receptor specific ligand molecules arginine-glycine-aspartic acid (RGD) or its several modifications RGD-Multi Armed Peptide terminated with cysteine (RGD-MAP-C), C(RGD)4 ensure farm attachment of neural cell on the electrode surfaces either in their two dimensional (dot) or three dimensional (rod or pillar) like nano-scale arrangement. A three dimensional RGD modified electrode surface has been proven to be more suitable for cell adhesion, proliferation, differentiation as well as electrochemical measurement. This review discusses fabrication as well as electrochemical measurements of neural cell chip with particular emphasis on their use for nanotoxicity assessments sequentially since inception to date. Successful monitoring of quantum dot (QD), graphene oxide (GO) and cosmetic compound toxicity using the newly developed neural cell chip were discussed here as a case study. This review recommended that a neural cell chip established on a nanostructured ligand modified conductive surface can be a potential tool for the toxicity assessments of newly developed nanomaterials prior to their use on biology or biomedical technologies. PMID:28347059

The mechanics of state dependent neural correlations

PubMed Central

Doiron, Brent; Litwin-Kumar, Ashok; Rosenbaum, Robert; Ocker, Gabriel K.; Josić, Krešimir

2016-01-01

Simultaneous recordings from large neural populations are becoming increasingly common. An important feature of the population activity are the trial-to-trial correlated fluctuations of the spike train outputs of recorded neuron pairs. Like the firing rate of single neurons, correlated activity can be modulated by a number of factors, from changes in arousal and attentional state to learning and task engagement. However, the network mechanisms that underlie these changes are not fully understood. We review recent theoretical results that identify three separate biophysical mechanisms that modulate spike train correlations: changes in input correlations, internal fluctuations, and the transfer function of single neurons. We first examine these mechanisms in feedforward pathways, and then show how the same approach can explain the modulation of correlations in recurrent networks. Such mechanistic constraints on the modulation of population activity will be important in statistical analyses of high dimensional neural data. PMID:26906505

Licit prescription drug use in a Swedish population according to age, gender and socioeconomic status after adjusting for level of multi-morbidity

PubMed Central

2012-01-01

Background There is a great variability in licit prescription drug use in the population and among patients. Factors other than purely medical ones have proven to be of importance for the prescribing of licit drugs. For example, individuals with a high age, female gender and low socioeconomic status are more likely to use licit prescription drugs. However, these results have not been adjusted for multi-morbidity level. In this study we investigate the odds of using licit prescription drugs among individuals in the population and the rate of licit prescription drug use among patients depending on gender, age and socioeconomic status after adjustment for multi-morbidity level. Methods The study was carried out on the total population aged 20 years or older in Östergötland county with about 400 000 inhabitants in year 2006. The Johns Hopkins ACG Case-mix was used as a proxy for the individual level of multi-morbidity in the population to which we have related the odds ratio for individuals and incidence rate ratio (IRR) for patients of using licit prescription drugs, defined daily doses (DDDs) and total costs of licit prescription drugs after adjusting for age, gender and socioeconomic factors (educational and income level). Results After adjustment for multi-morbidity level male individuals had less than half the odds of using licit prescription drugs (OR 0.41 (95% CI 0.40-0.42)) compared to female individuals. Among the patients, males had higher total costs (IRR 1.14 (95% CI 1.13-1.15)). Individuals above 80 years had nine times the odds of using licit prescription drugs (OR 9.09 (95% CI 8.33-10.00)) despite adjustment for multi-morbidity. Patients in the highest education and income level had the lowest DDDs (IRR 0.78 (95% CI 0.76-0.80), IRR 0.73 (95% CI 0.71-0.74)) after adjustment for multi-morbidity level. Conclusions This paper shows that there is a great variability in licit prescription drug use associated with gender, age and socioeconomic status

Macroscopic neural mass model constructed from a current-based network model of spiking neurons.

PubMed

Umehara, Hiroaki; Okada, Masato; Teramae, Jun-Nosuke; Naruse, Yasushi

2017-02-01

Neural mass models (NMMs) are efficient frameworks for describing macroscopic cortical dynamics including electroencephalogram and magnetoencephalogram signals. Originally, these models were formulated on an empirical basis of synaptic dynamics with relatively long time constants. By clarifying the relations between NMMs and the dynamics of microscopic structures such as neurons and synapses, we can better understand cortical and neural mechanisms from a multi-scale perspective. In a previous study, the NMMs were analytically derived by averaging the equations of synaptic dynamics over the neurons in the population and further averaging the equations of the membrane-potential dynamics. However, the averaging of synaptic current assumes that the neuron membrane potentials are nearly time invariant and that they remain at sub-threshold levels to retain the conductance-based model. This approximation limits the NMM to the non-firing state. In the present study, we newly propose a derivation of a NMM by alternatively approximating the synaptic current which is assumed to be independent of the membrane potential, thus adopting a current-based model. Our proposed model releases the constraint of the nearly constant membrane potential. We confirm that the obtained model is reducible to the previous model in the non-firing situation and that it reproduces the temporal mean values and relative power spectrum densities of the average membrane potentials for the spiking neurons. It is further ensured that the existing NMM properly models the averaged dynamics over individual neurons even if they are spiking in the populations.

An Improved Cloud Classification Algorithm for China's FY-2C Multi-Channel Images Using Artificial Neural Network.

PubMed

Liu, Yu; Xia, Jun; Shi, Chun-Xiang; Hong, Yang

2009-01-01

The crowning objective of this research was to identify a better cloud classification method to upgrade the current window-based clustering algorithm used operationally for China's first operational geostationary meteorological satellite FengYun-2C (FY-2C) data. First, the capabilities of six widely-used Artificial Neural Network (ANN) methods are analyzed, together with the comparison of two other methods: Principal Component Analysis (PCA) and a Support Vector Machine (SVM), using 2864 cloud samples manually collected by meteorologists in June, July, and August in 2007 from three FY-2C channel (IR1, 10.3-11.3 μm; IR2, 11.5-12.5 μm and WV 6.3-7.6 μm) imagery. The result shows that: (1) ANN approaches, in general, outperformed the PCA and the SVM given sufficient training samples and (2) among the six ANN networks, higher cloud classification accuracy was obtained with the Self-Organizing Map (SOM) and Probabilistic Neural Network (PNN). Second, to compare the ANN methods to the present FY-2C operational algorithm, this study implemented SOM, one of the best ANN network identified from this study, as an automated cloud classification system for the FY-2C multi-channel data. It shows that SOM method has improved the results greatly not only in pixel-level accuracy but also in cloud patch-level classification by more accurately identifying cloud types such as cumulonimbus, cirrus and clouds in high latitude. Findings of this study suggest that the ANN-based classifiers, in particular the SOM, can be potentially used as an improved Automated Cloud Classification Algorithm to upgrade the current window-based clustering method for the FY-2C operational products.

An oil fraction neural sensor developed using electrical capacitance tomography sensor data.

PubMed

Zainal-Mokhtar, Khursiah; Mohamad-Saleh, Junita

2013-08-26

This paper presents novel research on the development of a generic intelligent oil fraction sensor based on Electrical Capacitance Tomography (ECT) data. An artificial Neural Network (ANN) has been employed as the intelligent system to sense and estimate oil fractions from the cross-sections of two-component flows comprising oil and gas in a pipeline. Previous works only focused on estimating the oil fraction in the pipeline based on fixed ECT sensor parameters. With fixed ECT design sensors, an oil fraction neural sensor can be trained to deal with ECT data based on the particular sensor parameters, hence the neural sensor is not generic. This work focuses on development of a generic neural oil fraction sensor based on training a Multi-Layer Perceptron (MLP) ANN with various ECT sensor parameters. On average, the proposed oil fraction neural sensor has shown to be able to give a mean absolute error of 3.05% for various ECT sensor sizes.

Application of neural models as controllers in mobile robot velocity control loop

NASA Astrophysics Data System (ADS)

Cerkala, Jakub; Jadlovska, Anna

2017-01-01

This paper presents the application of an inverse neural models used as controllers in comparison to classical PI controllers for velocity tracking control task used in two-wheel, differentially driven mobile robot. The PI controller synthesis is based on linear approximation of actuators with equivalent load. In order to obtain relevant datasets for training of feed-forward multi-layer perceptron based neural network used as neural model, the mathematical model of mobile robot, that combines its kinematic and dynamic properties such as chassis dimensions, center of gravity offset, friction and actuator parameters is used. Neural models are trained off-line to act as an inverse dynamics of DC motors with particular load using data collected in simulation experiment for motor input voltage step changes within bounded operating area. The performances of PI controllers versus inverse neural models in mobile robot internal velocity control loops are demonstrated and compared in simulation experiment of navigation control task for line segment motion in plane.

An Oil Fraction Neural Sensor Developed Using Electrical capacitance Tomography Sensor Data

PubMed Central

Zainal-Mokhtar, Khursiah; Mohamad-Saleh, Junita

2013-01-01

This paper presents novel research on the development of a generic intelligent oil fraction sensor based on Electrical capacitance Tomography (ECT) data. An artificial Neural Network (ANN) has been employed as the intelligent system to sense and estimate oil fractions from the cross-sections of two-component flows comprising oil and gas in a pipeline. Previous works only focused on estimating the oil fraction in the pipeline based on fixed ECT sensor parameters. With fixed ECT design sensors, an oil fraction neural sensor can be trained to deal with ECT data based on the particular sensor parameters, hence the neural sensor is not generic. This work focuses on development of a generic neural oil fraction sensor based on training a Multi-Layer Perceptron (MLP) ANN with various ECT sensor parameters. On average, the proposed oil fraction neural sensor has shown to be able to give a mean absolute error of 3.05% for various ECT sensor sizes. PMID:24064598

Cross-domain and multi-task transfer learning of deep convolutional neural network for breast cancer diagnosis in digital breast tomosynthesis

NASA Astrophysics Data System (ADS)

Samala, Ravi K.; Chan, Heang-Ping; Hadjiiski, Lubomir; Helvie, Mark A.; Richter, Caleb; Cha, Kenny

2018-02-01

We propose a cross-domain, multi-task transfer learning framework to transfer knowledge learned from non-medical images by a deep convolutional neural network (DCNN) to medical image recognition task while improving the generalization by multi-task learning of auxiliary tasks. A first stage cross-domain transfer learning was initiated from ImageNet trained DCNN to mammography trained DCNN. 19,632 regions-of-interest (ROI) from 2,454 mass lesions were collected from two imaging modalities: digitized-screen film mammography (SFM) and full-field digital mammography (DM), and split into training and test sets. In the multi-task transfer learning, the DCNN learned the mass classification task simultaneously from the training set of SFM and DM. The best transfer network for mammography was selected from three transfer networks with different number of convolutional layers frozen. The performance of single-task and multitask transfer learning on an independent SFM test set in terms of the area under the receiver operating characteristic curve (AUC) was 0.78+/-0.02 and 0.82+/-0.02, respectively. In the second stage cross-domain transfer learning, a set of 12,680 ROIs from 317 mass lesions on DBT were split into validation and independent test sets. We first studied the data requirements for the first stage mammography trained DCNN by varying the mammography training data from 1% to 100% and evaluated its learning on the DBT validation set in inference mode. We found that the entire available mammography set provided the best generalization. The DBT validation set was then used to train only the last four fully connected layers, resulting in an AUC of 0.90+/-0.04 on the independent DBT test set.

The optimization of force inputs for active structural acoustic control using a neural network

NASA Technical Reports Server (NTRS)

Cabell, R. H.; Lester, H. C.; Silcox, R. J.

1992-01-01

This paper investigates the use of a neural network to determine which force actuators, of a multi-actuator array, are best activated in order to achieve structural-acoustic control. The concept is demonstrated using a cylinder/cavity model on which the control forces, produced by piezoelectric actuators, are applied with the objective of reducing the interior noise. A two-layer neural network is employed and the back propagation solution is compared with the results calculated by a conventional, least-squares optimization analysis. The ability of the neural network to accurately and efficiently control actuator activation for interior noise reduction is demonstrated.

Polyhydroxyalkanoate/carbon nanotube nanocomposites: flexible electrically conducting elastomers for neural applications.

PubMed

Vallejo-Giraldo, Catalina; Pugliese, Eugenia; Larrañaga, Aitor; Fernandez-Yague, Marc A; Britton, James J; Trotier, Alexandre; Tadayyon, Ghazal; Kelly, Adriona; Rago, Ilaria; Sarasua, Jose-Ramon; Dowd, Eilís; Quinlan, Leo R; Pandit, Abhay; Biggs, Manus Jp

2016-10-01

Medium chain length-polyhydroxyalkanoate/multi-walled carbon nanotube (MWCNTs) nanocomposites with a range of mechanical and electrochemical properties were fabricated via assisted dispersion and solvent casting, and their suitability as neural interface biomaterials was investigated. Mechanical and electrical properties of medium chain length-polyhydroxyalkanoate/MWCNTs nanocomposite films were evaluated by tensile test and electrical impedance spectroscopy, respectively. Primary rat mesencephalic cells were seeded on the composites and quantitative immunostaining of relevant neural biomarkers, and electrical stimulation studies were performed. Incorporation of MWCNTs to the polymeric matrix modulated the mechanical and electrical properties of resulting composites, and promoted differential cell viability, morphology and function as a function of MWCNT concentration. This study demonstrates the feasibility of a green thermoplastic MWCNTs nanocomposite for potential use in neural interfacing applications.

Towards multifocal ultrasonic neural stimulation: pattern generation algorithms

NASA Astrophysics Data System (ADS)

Hertzberg, Yoni; Naor, Omer; Volovick, Alexander; Shoham, Shy

2010-10-01

Focused ultrasound (FUS) waves directed onto neural structures have been shown to dynamically modulate neural activity and excitability, opening up a range of possible systems and applications where the non-invasiveness, safety, mm-range resolution and other characteristics of FUS are advantageous. As in other neuro-stimulation and modulation modalities, the highly distributed and parallel nature of neural systems and neural information processing call for the development of appropriately patterned stimulation strategies which could simultaneously address multiple sites in flexible patterns. Here, we study the generation of sparse multi-focal ultrasonic distributions using phase-only modulation in ultrasonic phased arrays. We analyse the relative performance of an existing algorithm for generating multifocal ultrasonic distributions and new algorithms that we adapt from the field of optical digital holography, and find that generally the weighted Gerchberg-Saxton algorithm leads to overall superior efficiency and uniformity in the focal spots, without significantly increasing the computational burden. By combining phased-array FUS and magnetic-resonance thermometry we experimentally demonstrate the simultaneous generation of tightly focused multifocal distributions in a tissue phantom, a first step towards patterned FUS neuro-modulation systems and devices.

Analog hardware for learning neural networks

NASA Technical Reports Server (NTRS)

Eberhardt, Silvio P. (Inventor)

1991-01-01

This is a recurrent or feedforward analog neural network processor having a multi-level neuron array and a synaptic matrix for storing weighted analog values of synaptic connection strengths which is characterized by temporarily changing one connection strength at a time to determine its effect on system output relative to the desired target. That connection strength is then adjusted based on the effect, whereby the processor is taught the correct response to training examples connection by connection.

Efficient Cancer Detection Using Multiple Neural Networks.

PubMed

Shell, John; Gregory, William D

2017-01-01

The inspection of live excised tissue specimens to ascertain malignancy is a challenging task in dermatopathology and generally in histopathology. We introduce a portable desktop prototype device that provides highly accurate neural network classification of malignant and benign tissue. The handheld device collects 47 impedance data samples from 1 Hz to 32 MHz via tetrapolar blackened platinum electrodes. The data analysis was implemented with six different backpropagation neural networks (BNN). A data set consisting of 180 malignant and 180 benign breast tissue data files in an approved IRB study at the Aurora Medical Center, Milwaukee, WI, USA, were utilized as a neural network input. The BNN structure consisted of a multi-tiered consensus approach autonomously selecting four of six neural networks to determine a malignant or benign classification. The BNN analysis was then compared with the histology results with consistent sensitivity of 100% and a specificity of 100%. This implementation successfully relied solely on statistical variation between the benign and malignant impedance data and intricate neural network configuration. This device and BNN implementation provides a novel approach that could be a valuable tool to augment current medical practice assessment of the health of breast, squamous, and basal cell carcinoma and other excised tissue without requisite tissue specimen expertise. It has the potential to provide clinical management personnel with a fast non-invasive accurate assessment of biopsied or sectioned excised tissue in various clinical settings.

Efficient Cancer Detection Using Multiple Neural Networks

PubMed Central

Gregory, William D.

2017-01-01

The inspection of live excised tissue specimens to ascertain malignancy is a challenging task in dermatopathology and generally in histopathology. We introduce a portable desktop prototype device that provides highly accurate neural network classification of malignant and benign tissue. The handheld device collects 47 impedance data samples from 1 Hz to 32 MHz via tetrapolar blackened platinum electrodes. The data analysis was implemented with six different backpropagation neural networks (BNN). A data set consisting of 180 malignant and 180 benign breast tissue data files in an approved IRB study at the Aurora Medical Center, Milwaukee, WI, USA, were utilized as a neural network input. The BNN structure consisted of a multi-tiered consensus approach autonomously selecting four of six neural networks to determine a malignant or benign classification. The BNN analysis was then compared with the histology results with consistent sensitivity of 100% and a specificity of 100%. This implementation successfully relied solely on statistical variation between the benign and malignant impedance data and intricate neural network configuration. This device and BNN implementation provides a novel approach that could be a valuable tool to augment current medical practice assessment of the health of breast, squamous, and basal cell carcinoma and other excised tissue without requisite tissue specimen expertise. It has the potential to provide clinical management personnel with a fast non-invasive accurate assessment of biopsied or sectioned excised tissue in various clinical settings. PMID:29282435

Selective Roles of Normal and Mutant Huntingtin in Neural Induction and Early Neurogenesis

PubMed Central

Nguyen, Giang D.; Gokhan, Solen; Molero, Aldrin E.; Mehler, Mark F.

2013-01-01

Huntington's disease (HD) is a neurodegenerative disorder caused by abnormal polyglutamine expansion in the amino-terminal end of the huntingtin protein (Htt) and characterized by progressive striatal and cortical pathology. Previous reports have shown that Htt is essential for embryogenesis, and a recent study by our group revealed that the pathogenic form of Htt (mHtt) causes impairments in multiple stages of striatal development. In this study, we have examined whether HD-associated striatal developmental deficits are reflective of earlier maturational alterations occurring at the time of neurulation by assessing differential roles of Htt and mHtt during neural induction and early neurogenesis using an in vitro mouse embryonic stem cell (ESC) clonal assay system. We demonstrated that the loss of Htt in ESCs (KO ESCs) severely disrupts the specification of primitive and definitive neural stem cells (pNSCs, dNSCs, respectively) during the process of neural induction. In addition, clonally derived KO pNSCs and dNSCs displayed impaired proliferative potential, enhanced cell death and altered multi-lineage potential. Conversely, as observed in HD knock-in ESCs (Q111 ESCs), mHtt enhanced the number and size of pNSC clones, which exhibited enhanced proliferative potential and precocious neuronal differentiation. The transition from Q111 pNSCs to fibroblast growth factor 2 (FGF2)-responsive dNSCs was marked by potentiation in the number of dNSCs and altered proliferative potential. The multi-lineage potential of Q111 dNSCs was also enhanced with precocious neurogenesis and oligodendrocyte progenitor elaboration. The generation of Q111 epidermal growth factor (EGF)-responsive dNSCs was also compromised, whereas their multi-lineage potential was unaltered. These abnormalities in neural induction were associated with differential alterations in the expression profiles of Notch, Hes1 and Hes5. These cumulative observations indicate that Htt is required for multiple stages

Neural Correlates and Mechanisms of Spatial Release From Masking: Single-Unit and Population Responses in the Inferior Colliculus

PubMed Central

Lane, Courtney C.; Delgutte, Bertrand

2007-01-01

Spatial release from masking (SRM), a factor in listening in noisy environments, is the improvement in auditory signal detection obtained when a signal is separated in space from a masker. To study the neural mechanisms of SRM, we recorded from single units in the inferior colliculus (IC) of barbiturate-anesthetized cats, focusing on low-frequency neurons sensitive to interaural time differences. The stimulus was a broadband chirp train with a 40-Hz repetition rate in continuous broadband noise, and the unit responses were measured for several signal and masker (virtual) locations. Masked thresholds (the lowest signal-to-noise ratio, SNR, for which the signal could be detected for 75% of the stimulus presentations) changed systematically with signal and masker location. Single-unit thresholds did not necessarily improve with signal and masker separation; instead, they tended to reflect the units’ azimuth preference. Both how the signal was detected (through a rate increase or decrease) and how the noise masked the signal response (suppressive or excitatory masking) changed with signal and masker azimuth, consistent with a cross-correlator model of binaural processing. However, additional processing, perhaps related to the signal’s amplitude modulation rate, appeared to influence the units’ responses. The population masked thresholds (the most sensitive unit’s threshold at each signal and masker location) did improve with signal and masker separation as a result of the variety of azimuth preferences in our unit sample. The population thresholds were similar to human behavioral thresholds in both SNR value and shape, indicating that these units may provide a neural substrate for low-frequency SRM. PMID:15857966

Feasibility study for future implantable neural-silicon interface devices.

PubMed

Al-Armaghany, Allann; Yu, Bo; Mak, Terrence; Tong, Kin-Fai; Sun, Yihe

2011-01-01

The emerging neural-silicon interface devices bridge nerve systems with artificial systems and play a key role in neuro-prostheses and neuro-rehabilitation applications. Integrating neural signal collection, processing and transmission on a single device will make clinical applications more practical and feasible. This paper focuses on the wireless antenna part and real-time neural signal analysis part of implantable brain-machine interface (BMI) devices. We propose to use millimeter-wave for wireless connections between different areas of a brain. Various antenna, including microstrip patch, monopole antenna and substrate integrated waveguide antenna are considered for the intra-cortical proximity communication. A Hebbian eigenfilter based method is proposed for multi-channel neuronal spike sorting. Folding and parallel design techniques are employed to explore various structures and make a trade-off between area and power consumption. Field programmable logic arrays (FPGAs) are used to evaluate various structures.

The origin and evolution of the neural crest

PubMed Central

Donoghue, Philip C. J.; Graham, Anthony; Kelsh, Robert N.

2009-01-01

Summary Many of the features that distinguish the vertebrates from other chordates are derived from the neural crest, and it has long been argued that the emergence of this multipotent embryonic population was a key innovation underpinning vertebrate evolution. More recently, however, a number of studies have suggested that the evolution of the neural crest was less sudden than previously believed. This has exposed the fact that neural crest, as evidenced by its repertoire of derivative cell types, has evolved through vertebrate evolution. In this light, attempts to derive a typological definition of neural crest, in terms of molecular signatures or networks, are unfounded. We propose a less restrictive, embryological definition of this cell type that facilitates, rather than precludes, investigating the evolution of neural crest. While the evolutionary origin of neural crest has attracted much attention, its subsequent evolution has received almost no attention and yet it is more readily open to experimental investigation and has greater relevance to understanding vertebrate evolution. Finally, we provide a brief outline of how the evolutionary emergence of neural crest potentiality may have proceeded, and how it may be investigated. PMID:18478530

Neural crest stem cell multipotency requires Foxd3 to maintain neural potential and repress mesenchymal fates.

PubMed

Mundell, Nathan A; Labosky, Patricia A

2011-02-01

Neural crest (NC) progenitors generate a wide array of cell types, yet molecules controlling NC multipotency and self-renewal and factors mediating cell-intrinsic distinctions between multipotent versus fate-restricted progenitors are poorly understood. Our earlier work demonstrated that Foxd3 is required for maintenance of NC progenitors in the embryo. Here, we show that Foxd3 mediates a fate restriction choice for multipotent NC progenitors with loss of Foxd3 biasing NC toward a mesenchymal fate. Neural derivatives of NC were lost in Foxd3 mutant mouse embryos, whereas abnormally fated NC-derived vascular smooth muscle cells were ectopically located in the aorta. Cranial NC defects were associated with precocious differentiation towards osteoblast and chondrocyte cell fates, and individual mutant NC from different anteroposterior regions underwent fate changes, losing neural and increasing myofibroblast potential. Our results demonstrate that neural potential can be separated from NC multipotency by the action of a single gene, and establish novel parallels between NC and other progenitor populations that depend on this functionally conserved stem cell protein to regulate self-renewal and multipotency.

Inference in the brain: Statistics flowing in redundant population codes

PubMed Central

Pitkow, Xaq; Angelaki, Dora E

2017-01-01

It is widely believed that the brain performs approximate probabilistic inference to estimate causal variables in the world from ambiguous sensory data. To understand these computations, we need to analyze how information is represented and transformed by the actions of nonlinear recurrent neural networks. We propose that these probabilistic computations function by a message-passing algorithm operating at the level of redundant neural populations. To explain this framework, we review its underlying concepts, including graphical models, sufficient statistics, and message-passing, and then describe how these concepts could be implemented by recurrently connected probabilistic population codes. The relevant information flow in these networks will be most interpretable at the population level, particularly for redundant neural codes. We therefore outline a general approach to identify the essential features of a neural message-passing algorithm. Finally, we argue that to reveal the most important aspects of these neural computations, we must study large-scale activity patterns during moderately complex, naturalistic behaviors. PMID:28595050

Characterization of Early Cortical Neural Network Development in Multiwell Microelectrode Array Plates

EPA Science Inventory

We examined the development of neural network activity using microelectrode array (MEA) recordings made in multi-well MEA plates (mwMEAs) over the first 12 days in vitro (DIV). In primary cortical cultures made from postnatal rats, action potential spiking activity was essentiall...

Unfolding the neutron spectrum of a NE213 scintillator using artificial neural networks.

PubMed

Sharghi Ido, A; Bonyadi, M R; Etaati, G R; Shahriari, M

2009-10-01

Artificial neural networks technology has been applied to unfold the neutron spectra from the pulse height distribution measured with NE213 liquid scintillator. Here, both the single and multi-layer perceptron neural network models have been implemented to unfold the neutron spectrum from an Am-Be neutron source. The activation function and the connectivity of the neurons have been investigated and the results have been analyzed in terms of the network's performance. The simulation results show that the neural network that utilizes the Satlins transfer function has the best performance. In addition, omitting the bias connection of the neurons improve the performance of the network. Also, the SCINFUL code is used for generating the response functions in the training phase of the process. Finally, the results of the neural network simulation have been compared with those of the FORIST unfolding code for both (241)Am-Be and (252)Cf neutron sources. The results of neural network are in good agreement with FORIST code.

Collaborative identification method for sea battlefield target based on deep convolutional neural networks

NASA Astrophysics Data System (ADS)

Zheng, Guangdi; Pan, Mingbo; Liu, Wei; Wu, Xuetong

2018-03-01

The target identification of the sea battlefield is the prerequisite for the judgment of the enemy in the modern naval battle. In this paper, a collaborative identification method based on convolution neural network is proposed to identify the typical targets of sea battlefields. Different from the traditional single-input/single-output identification method, the proposed method constructs a multi-input/single-output co-identification architecture based on optimized convolution neural network and weighted D-S evidence theory. The simulation results show that

Neural networks for link prediction in realistic biomedical graphs: a multi-dimensional evaluation of graph embedding-based approaches.

PubMed

Crichton, Gamal; Guo, Yufan; Pyysalo, Sampo; Korhonen, Anna

2018-05-21

Link prediction in biomedical graphs has several important applications including predicting Drug-Target Interactions (DTI), Protein-Protein Interaction (PPI) prediction and Literature-Based Discovery (LBD). It can be done using a classifier to output the probability of link formation between nodes. Recently several works have used neural networks to create node representations which allow rich inputs to neural classifiers. Preliminary works were done on this and report promising results. However they did not use realistic settings like time-slicing, evaluate performances with comprehensive metrics or explain when or why neural network methods outperform. We investigated how inputs from four node representation algorithms affect performance of a neural link predictor on random- and time-sliced biomedical graphs of real-world sizes (∼ 6 million edges) containing information relevant to DTI, PPI and LBD. We compared the performance of the neural link predictor to those of established baselines and report performance across five metrics. In random- and time-sliced experiments when the neural network methods were able to learn good node representations and there was a negligible amount of disconnected nodes, those approaches outperformed the baselines. In the smallest graph (∼ 15,000 edges) and in larger graphs with approximately 14% disconnected nodes, baselines such as Common Neighbours proved a justifiable choice for link prediction. At low recall levels (∼ 0.3) the approaches were mostly equal, but at higher recall levels across all nodes and average performance at individual nodes, neural network approaches were superior. Analysis showed that neural network methods performed well on links between nodes with no previous common neighbours; potentially the most interesting links. Additionally, while neural network methods benefit from large amounts of data, they require considerable amounts of computational resources to utilise them. Our results indicate

Implementing a Bayes Filter in a Neural Circuit: The Case of Unknown Stimulus Dynamics.

PubMed

Sokoloski, Sacha

2017-09-01

In order to interact intelligently with objects in the world, animals must first transform neural population responses into estimates of the dynamic, unknown stimuli that caused them. The Bayesian solution to this problem is known as a Bayes filter, which applies Bayes' rule to combine population responses with the predictions of an internal model. The internal model of the Bayes filter is based on the true stimulus dynamics, and in this note, we present a method for training a theoretical neural circuit to approximately implement a Bayes filter when the stimulus dynamics are unknown. To do this we use the inferential properties of linear probabilistic population codes to compute Bayes' rule and train a neural network to compute approximate predictions by the method of maximum likelihood. In particular, we perform stochastic gradient descent on the negative log-likelihood of the neural network parameters with a novel approximation of the gradient. We demonstrate our methods on a finite-state, a linear, and a nonlinear filtering problem and show how the hidden layer of the neural network develops tuning curves consistent with findings in experimental neuroscience.

Public perceptions and attitudes toward thalassaemia: Influencing factors in a multi-racial population.

PubMed

Wong, Li Ping; George, Elizabeth; Tan, Jin-Ai Mary Anne

2011-03-30

Thalassaemia is a common public health problem in Malaysia and about 4.5 to 6% of the Malays and Chinese are carriers of this genetic disorder. The major forms of thalassaemia result in death in utero of affected foetuses (α-thalassaemia) or life-long blood transfusions for survival in β-thalassaemia. This study, the first nationwide population based survey of thalassaemia in Malaysia, aimed to determine differences in public awareness, perceptions and attitudes toward thalassaemia in the multi-racial population in Malaysia. A cross-sectional computer-assisted telephone interview survey of a representative sample of multi-racial Malaysians aged 18 years and above was conducted between July and December 2009. Of a total of 3723 responding households, 2846 (76.4%) have heard of thalassaemia. Mean knowledge score was 11.85 (SD ± 4.03), out of a maximum of 21, with higher scores indicating better knowledge. Statistically significant differences (P < 0.05) in total knowledge score by age groups, education attainment, employment status, and average household income were observed. Although the majority expressed very positive attitudes toward screening for thalassaemia, only 13.6% of married participants interviewed have been screened for thalassaemia. The majority (63.4%) were unsupportive of selective termination of foetuses diagnosed with thalassaemia major. Study shows that carrier and premarital screening programs for thalassaemia may be more effective and culturally acceptable in the reduction of pregnancies with thalassaemia major. The findings provide insights into culturally congruent educational interventions to reach out diverse socio-demographic and ethnic communities to increase knowledge and cultivate positive attitudes toward prevention of thalassaemia.

Simultaneous surface and depth neural activity recording with graphene transistor-based dual-modality probes.

PubMed

Du, Mingde; Xu, Xianchen; Yang, Long; Guo, Yichuan; Guan, Shouliang; Shi, Jidong; Wang, Jinfen; Fang, Ying

2018-05-15

Subdural surface and penetrating depth probes are widely applied to record neural activities from the cortical surface and intracortical locations of the brain, respectively. Simultaneous surface and depth neural activity recording is essential to understand the linkage between the two modalities. Here, we develop flexible dual-modality neural probes based on graphene transistors. The neural probes exhibit stable electrical performance even under 90° bending because of the excellent mechanical properties of graphene, and thus allow multi-site recording from the subdural surface of rat cortex. In addition, finite element analysis was carried out to investigate the mechanical interactions between probe and cortex tissue during intracortical implantation. Based on the simulation results, a sharp tip angle of π/6 was chosen to facilitate tissue penetration of the neural probes. Accordingly, the graphene transistor-based dual-modality neural probes have been successfully applied for simultaneous surface and depth recording of epileptiform activity of rat brain in vivo. Our results show that graphene transistor-based dual-modality neural probes can serve as a facile and versatile tool to study tempo-spatial patterns of neural activities. Copyright © 2018 Elsevier B.V. All rights reserved.

Fractionating the neural correlates of individual working memory components underlying arithmetic problem solving skills in children

PubMed Central

Metcalfe, Arron W. S.; Ashkenazi, Sarit; Rosenberg-Lee, Miriam; Menon, Vinod

2013-01-01

Baddeley and Hitch’s multi-component working memory (WM) model has played an enduring and influential role in our understanding of cognitive abilities. Very little is known, however, about the neural basis of this multi-component WM model and the differential role each component plays in mediating arithmetic problem solving abilities in children. Here, we investigate the neural basis of the central executive (CE), phonological (PL) and visuo-spatial (VS) components of WM during a demanding mental arithmetic task in 7–9 year old children (N=74). The VS component was the strongest predictor of math ability in children and was associated with increased arithmetic complexity-related responses in left dorsolateral and right ventrolateral prefrontal cortices as well as bilateral intra-parietal sulcus and supramarginal gyrus in posterior parietal cortex. Critically, VS, CE and PL abilities were associated with largely distinct patterns of brain response. Overlap between VS and CE components was observed in left supramarginal gyrus and no overlap was observed between VS and PL components. Our findings point to a central role of visuo-spatial WM during arithmetic problem-solving in young grade-school children and highlight the usefulness of the multi-component Baddeley and Hitch WM model in fractionating the neural correlates of arithmetic problem solving during development. PMID:24212504

Meninges harbor cells expressing neural precursor markers during development and adulthood.

PubMed

Bifari, Francesco; Berton, Valeria; Pino, Annachiara; Kusalo, Marijana; Malpeli, Giorgio; Di Chio, Marzia; Bersan, Emanuela; Amato, Eliana; Scarpa, Aldo; Krampera, Mauro; Fumagalli, Guido; Decimo, Ilaria

2015-01-01

Brain and skull developments are tightly synchronized, allowing the cranial bones to dynamically adapt to the brain shape. At the brain-skull interface, meninges produce the trophic signals necessary for normal corticogenesis and bone development. Meninges harbor different cell populations, including cells forming the endosteum of the cranial vault. Recently, we and other groups have described the presence in meninges of a cell population endowed with neural differentiation potential in vitro and, after transplantation, in vivo. However, whether meninges may be a niche for neural progenitor cells during embryonic development and in adulthood remains to be determined. In this work we provide the first description of the distribution of neural precursor markers in rat meninges during development up to adulthood. We conclude that meninges share common properties with the classical neural stem cell niche, as they: (i) are a highly proliferating tissue; (ii) host cells expressing neural precursor markers such as nestin, vimentin, Sox2 and doublecortin; and (iii) are enriched in extracellular matrix components (e.g., fractones) known to bind and concentrate growth factors. This study underlines the importance of meninges as a potential niche for endogenous precursor cells during development and in adulthood.

Meninges harbor cells expressing neural precursor markers during development and adulthood

PubMed Central

Bifari, Francesco; Berton, Valeria; Pino, Annachiara; Kusalo, Marijana; Malpeli, Giorgio; Di Chio, Marzia; Bersan, Emanuela; Amato, Eliana; Scarpa, Aldo; Krampera, Mauro; Fumagalli, Guido; Decimo, Ilaria

2015-01-01

Brain and skull developments are tightly synchronized, allowing the cranial bones to dynamically adapt to the brain shape. At the brain-skull interface, meninges produce the trophic signals necessary for normal corticogenesis and bone development. Meninges harbor different cell populations, including cells forming the endosteum of the cranial vault. Recently, we and other groups have described the presence in meninges of a cell population endowed with neural differentiation potential in vitro and, after transplantation, in vivo. However, whether meninges may be a niche for neural progenitor cells during embryonic development and in adulthood remains to be determined. In this work we provide the first description of the distribution of neural precursor markers in rat meninges during development up to adulthood. We conclude that meninges share common properties with the classical neural stem cell niche, as they: (i) are a highly proliferating tissue; (ii) host cells expressing neural precursor markers such as nestin, vimentin, Sox2 and doublecortin; and (iii) are enriched in extracellular matrix components (e.g., fractones) known to bind and concentrate growth factors. This study underlines the importance of meninges as a potential niche for endogenous precursor cells during development and in adulthood. PMID:26483637

Response variance in functional maps: neural darwinism revisited.

PubMed

Takahashi, Hirokazu; Yokota, Ryo; Kanzaki, Ryohei

2013-01-01

The mechanisms by which functional maps and map plasticity contribute to cortical computation remain controversial. Recent studies have revisited the theory of neural Darwinism to interpret the learning-induced map plasticity and neuronal heterogeneity observed in the cortex. Here, we hypothesize that the Darwinian principle provides a substrate to explain the relationship between neuron heterogeneity and cortical functional maps. We demonstrate in the rat auditory cortex that the degree of response variance is closely correlated with the size of its representational area. Further, we show that the response variance within a given population is altered through training. These results suggest that larger representational areas may help to accommodate heterogeneous populations of neurons. Thus, functional maps and map plasticity are likely to play essential roles in Darwinian computation, serving as effective, but not absolutely necessary, structures to generate diverse response properties within a neural population.

Response Variance in Functional Maps: Neural Darwinism Revisited

PubMed Central

Takahashi, Hirokazu; Yokota, Ryo; Kanzaki, Ryohei

2013-01-01

The mechanisms by which functional maps and map plasticity contribute to cortical computation remain controversial. Recent studies have revisited the theory of neural Darwinism to interpret the learning-induced map plasticity and neuronal heterogeneity observed in the cortex. Here, we hypothesize that the Darwinian principle provides a substrate to explain the relationship between neuron heterogeneity and cortical functional maps. We demonstrate in the rat auditory cortex that the degree of response variance is closely correlated with the size of its representational area. Further, we show that the response variance within a given population is altered through training. These results suggest that larger representational areas may help to accommodate heterogeneous populations of neurons. Thus, functional maps and map plasticity are likely to play essential roles in Darwinian computation, serving as effective, but not absolutely necessary, structures to generate diverse response properties within a neural population. PMID:23874733

Cosmic-ray discrimination capabilities of /ΔE-/E silicon nuclear telescopes using neural networks

NASA Astrophysics Data System (ADS)

Ambriola, M.; Bellotti, R.; Cafagna, F.; Castellano, M.; Ciacio, F.; Circella, M.; Marzo, C. N. D.; Montaruli, T.

2000-02-01

An isotope classifier of cosmic-ray events collected by space detectors has been implemented using a multi-layer perceptron neural architecture. In order to handle a great number of different isotopes a modular architecture of the ``mixture of experts'' type is proposed. The performance of this classifier has been tested on simulated data and has been compared with a ``classical'' classifying procedure. The quantitative comparison with traditional techniques shows that the neural approach has classification performances comparable - within /1% - with that of the classical one, with efficiency of the order of /98%. A possible hardware implementation of such a kind of neural architecture in future space missions is considered.

Localized states in an unbounded neural field equation with smooth firing rate function: a multi-parameter analysis.

PubMed

Faye, Grégory; Rankin, James; Chossat, Pascal

2013-05-01

The existence of spatially localized solutions in neural networks is an important topic in neuroscience as these solutions are considered to characterize working (short-term) memory. We work with an unbounded neural network represented by the neural field equation with smooth firing rate function and a wizard hat spatial connectivity. Noting that stationary solutions of our neural field equation are equivalent to homoclinic orbits in a related fourth order ordinary differential equation, we apply normal form theory for a reversible Hopf bifurcation to prove the existence of localized solutions; further, we present results concerning their stability. Numerical continuation is used to compute branches of localized solution that exhibit snaking-type behaviour. We describe in terms of three parameters the exact regions for which localized solutions persist.

Neural network controller development for a magnetically suspended flywheel energy storage system

NASA Technical Reports Server (NTRS)

Fittro, Roger L.; Pang, Da-Chen; Anand, Davinder K.

1994-01-01

A neural network controller has been developed to accommodate disturbances and nonlinearities and improve the robustness of a magnetically suspended flywheel energy storage system. The controller is trained using the back propagation-through-time technique incorporated with a time-averaging scheme. The resulting nonlinear neural network controller improves system performance by adapting flywheel stiffness and damping based on operating speed. In addition, a hybrid multi-layered neural network controller is developed off-line which is capable of improving system performance even further. All of the research presented in this paper was implemented via a magnetic bearing computer simulation. However, careful attention was paid to developing a practical methodology which will make future application to the actual bearing system fairly straightforward.

Bacterial recombination promotes the evolution of multi-drug-resistance in functionally diverse populations

PubMed Central

Perron, Gabriel G.; Lee, Alexander E. G.; Wang, Yun; Huang, Wei E.; Barraclough, Timothy G.

2012-01-01

Bacterial recombination is believed to be a major factor explaining the prevalence of multi-drug-resistance (MDR) among pathogenic bacteria. Despite extensive evidence for exchange of resistance genes from retrospective sequence analyses, experimental evidence for the evolutionary benefits of bacterial recombination is scarce. We compared the evolution of MDR between populations of Acinetobacter baylyi in which we manipulated both the recombination rate and the initial diversity of strains with resistance to single drugs. In populations lacking recombination, the initial presence of multiple strains resistant to different antibiotics inhibits the evolution of MDR. However, in populations with recombination, the inhibitory effect of standing diversity is alleviated and MDR evolves rapidly. Moreover, only the presence of DNA harbouring resistance genes promotes the evolution of resistance, ruling out other proposed benefits for recombination. Together, these results provide direct evidence for the fitness benefits of bacterial recombination and show that this occurs by mitigation of functional interference between genotypes resistant to single antibiotics. Although analogous to previously described mechanisms of clonal interference among alternative beneficial mutations, our results actually highlight a different mechanism by which interactions among co-occurring strains determine the benefits of recombination for bacterial evolution. PMID:22048956

An Improved Cloud Classification Algorithm for China’s FY-2C Multi-Channel Images Using Artificial Neural Network

PubMed Central

Liu, Yu; Xia, Jun; Shi, Chun-Xiang; Hong, Yang

2009-01-01

The crowning objective of this research was to identify a better cloud classification method to upgrade the current window-based clustering algorithm used operationally for China’s first operational geostationary meteorological satellite FengYun-2C (FY-2C) data. First, the capabilities of six widely-used Artificial Neural Network (ANN) methods are analyzed, together with the comparison of two other methods: Principal Component Analysis (PCA) and a Support Vector Machine (SVM), using 2864 cloud samples manually collected by meteorologists in June, July, and August in 2007 from three FY-2C channel (IR1, 10.3–11.3 μm; IR2, 11.5–12.5 μm and WV 6.3–7.6 μm) imagery. The result shows that: (1) ANN approaches, in general, outperformed the PCA and the SVM given sufficient training samples and (2) among the six ANN networks, higher cloud classification accuracy was obtained with the Self-Organizing Map (SOM) and Probabilistic Neural Network (PNN). Second, to compare the ANN methods to the present FY-2C operational algorithm, this study implemented SOM, one of the best ANN network identified from this study, as an automated cloud classification system for the FY-2C multi-channel data. It shows that SOM method has improved the results greatly not only in pixel-level accuracy but also in cloud patch-level classification by more accurately identifying cloud types such as cumulonimbus, cirrus and clouds in high latitude. Findings of this study suggest that the ANN-based classifiers, in particular the SOM, can be potentially used as an improved Automated Cloud Classification Algorithm to upgrade the current window-based clustering method for the FY-2C operational products. PMID:22346714

A Multi-channel Semicircular Canal Neural Prosthesis Using Electrical Stimulation to Restore 3D Vestibular Sensation

PubMed Central

Della Santina, Charles C.; Migliaccio, Americo A.; Patel, Amit H.

2009-01-01

Bilateral loss of vestibular sensation can be disabling. Those afflicted suffer illusory visual field movement during head movements, chronic disequilibrium and postural instability due to failure of vestibulo-ocular and vestibulo-spinal reflexes. A neural prosthesis that emulates the normal transduction of head rotation by semicircular canals could significantly improve quality of life for these patients. Like the 3 semicircular canals in a normal ear, such a device should at least transduce 3 orthogonal (or linearly separable) components of head rotation into activity on corresponding ampullary branches of the vestibular nerve. We describe the design, circuit performance and in vivo application of a head-mounted, semi-implantable multi-channel vestibular prosthesis that encodes head movement in 3 dimensions as pulse-frequency-modulated electrical stimulation of 3 or more ampullary nerves. In chinchillas treated with intratympanic gentamicin to ablate vestibular sensation bilaterally, prosthetic stimuli elicited a partly compensatory angular vestibulo-ocular reflex in multiple planes. Minimizing misalignment between the axis of eye and head rotation, apparently caused by current spread beyond each electrode’s targeted nerve branch, emerged as a key challenge. Increasing stimulation selectivity via improvements in electrode design, surgical technique and stimulus protocol will likely be required to restore AVOR function over the full range of normal behavior. PMID:17554821

Study on the multi-sensors monitoring and information fusion technology of dangerous cargo container

NASA Astrophysics Data System (ADS)

Xu, Shibo; Zhang, Shuhui; Cao, Wensheng

2017-10-01

In this paper, monitoring system of dangerous cargo container based on multi-sensors is presented. In order to improve monitoring accuracy, multi-sensors will be applied inside of dangerous cargo container. Multi-sensors information fusion solution of monitoring dangerous cargo container is put forward, and information pre-processing, the fusion algorithm of homogenous sensors and information fusion based on BP neural network are illustrated, applying multi-sensors in the field of container monitoring has some novelty.

Application of Artificial Neural Networks to the Development of Improved Multi-Sensor Retrievals of Near-Surface Air Temperature and Humidity Over Ocean

NASA Technical Reports Server (NTRS)

Roberts, J. Brent; Robertson, Franklin R.; Clayson, Carol Anne

2012-01-01

Improved estimates of near-surface air temperature and air humidity are critical to the development of more accurate turbulent surface heat fluxes over the ocean. Recent progress in retrieving these parameters has been made through the application of artificial neural networks (ANN) and the use of multi-sensor passive microwave observations. Details are provided on the development of an improved retrieval algorithm that applies the nonlinear statistical ANN methodology to a set of observations from the Advanced Microwave Scanning Radiometer (AMSR-E) and the Advanced Microwave Sounding Unit (AMSU-A) that are currently available from the NASA AQUA satellite platform. Statistical inversion techniques require an adequate training dataset to properly capture embedded physical relationships. The development of multiple training datasets containing only in-situ observations, only synthetic observations produced using the Community Radiative Transfer Model (CRTM), or a mixture of each is discussed. An intercomparison of results using each training dataset is provided to highlight the relative advantages and disadvantages of each methodology. Particular emphasis will be placed on the development of retrievals in cloudy versus clear-sky conditions. Near-surface air temperature and humidity retrievals using the multi-sensor ANN algorithms are compared to previous linear and non-linear retrieval schemes.

Psychological and Neural Contributions to Appetite Self-Regulation

PubMed Central

Stoeckel, Luke E.; Birch, Leann L.; Heatherton, Todd; Mann, Traci; Hunter, Christine; Czajkowski, Susan; Onken, Lisa; Berger, Paige K.; Savage, Cary R.

2017-01-01

Objective Review the state-of-the-science on psychological and neural contributions to appetite self-regulation in the context of obesity. Methods Three content areas (neural systems and cognitive functions; parenting and early childhood development; and goal setting and goal striving) served as examples of different perspectives on the psychological and neural factors that contribute to appetite dysregulation in the context of obesity. Talks were initially delivered at a workshop consisting of experts in these three content areas and then content areas were further developed through a review of the literature. Results Self-regulation of appetite involves a complex interaction between multiple domains, including cognitive, neural, social, and goal-directed behaviors and decision-making. Self-regulation failures can results from any of these factors, and the resulting implications for obesity should be considered in light of each domain. In some cases, self-regulation appears to be amenable to intervention; however, this does not appear to be universally true, which has implications for both prevention and intervention efforts. Conclusions Appetite regulation is a complex, multi-factorial construct. When considering its role in the obesity epidemic, it is advisable to consider these various contributions together to best inform prevention and treatment efforts. PMID:28229541

A label distance maximum-based classifier for multi-label learning.

PubMed

Liu, Xiaoli; Bao, Hang; Zhao, Dazhe; Cao, Peng

2015-01-01

Multi-label classification is useful in many bioinformatics tasks such as gene function prediction and protein site localization. This paper presents an improved neural network algorithm, Max Label Distance Back Propagation Algorithm for Multi-Label Classification. The method was formulated by modifying the total error function of the standard BP by adding a penalty term, which was realized by maximizing the distance between the positive and negative labels. Extensive experiments were conducted to compare this method against state-of-the-art multi-label methods on three popular bioinformatic benchmark datasets. The results illustrated that this proposed method is more effective for bioinformatic multi-label classification compared to commonly used techniques.

A novel neural-wavelet approach for process diagnostics and complex system modeling

NASA Astrophysics Data System (ADS)

Gao, Rong

Neural networks have been effective in several engineering applications because of their learning abilities and robustness. However certain shortcomings, such as slow convergence and local minima, are always associated with neural networks, especially neural networks applied to highly nonlinear and non-stationary problems. These problems can be effectively alleviated by integrating a new powerful tool, wavelets, into conventional neural networks. The multi-resolution analysis and feature localization capabilities of the wavelet transform offer neural networks new possibilities for learning. A neural wavelet network approach developed in this thesis enjoys fast convergence rate with little possibility to be caught at a local minimum. It combines the localization properties of wavelets with the learning abilities of neural networks. Two different testbeds are used for testing the efficiency of the new approach. The first is magnetic flowmeter-based process diagnostics: here we extend previous work, which has demonstrated that wavelet groups contain process information, to more general process diagnostics. A loop at Applied Intelligent Systems Lab (AISL) is used for collecting and analyzing data through the neural-wavelet approach. The research is important for thermal-hydraulic processes in nuclear and other engineering fields. The neural-wavelet approach developed is also tested with data from the electric power grid. More specifically, the neural-wavelet approach is used for performing short-term and mid-term prediction of power load demand. In addition, the feasibility of determining the type of load using the proposed neural wavelet approach is also examined. The notion of cross scale product has been developed as an expedient yet reliable discriminator of loads. Theoretical issues involved in the integration of wavelets and neural networks are discussed and future work outlined.

Integrated Photonic Neural Probes for Patterned Brain Stimulation

DTIC Science & Technology

2017-08-14

two -photon imaging Task 3.2: In vivo demonstration of remote optical stimulation using photonic probes and multi -site electrical recording...have patterned nine e-pixels. We can individually address each e-pixel by tuning the color of the input light to the AWG. Figure (8) shows two ...Report: Integrated Photonic Neural Probes for Patterned Brain Stimulation The views , opinions and/or findings contained in this report are those of the

Predicting local field potentials with recurrent neural networks.

PubMed

Kim, Louis; Harer, Jacob; Rangamani, Akshay; Moran, James; Parks, Philip D; Widge, Alik; Eskandar, Emad; Dougherty, Darin; Chin, Sang Peter

2016-08-01

We present a Recurrent Neural Network using LSTM (Long Short Term Memory) that is capable of modeling and predicting Local Field Potentials. We train and test the network on real data recorded from epilepsy patients. We construct networks that predict multi-channel LFPs for 1, 10, and 100 milliseconds forward in time. Our results show that prediction using LSTM outperforms regression when predicting 10 and 100 millisecond forward in time.

A stem cell medium containing neural stimulating factor induces a pancreatic cancer stem-like cell-enriched population

PubMed Central

WATANABE, YUSAKU; YOSHIMURA, KIYOSHI; YOSHIKAWA, KOICHI; TSUNEDOMI, RYOICHI; SHINDO, YOSHITARO; MATSUKUMA, SOU; MAEDA, NORIKO; KANEKIYO, SHINSUKE; SUZUKI, NOBUAKI; KURAMASU, ATSUO; SONODA, KOUHEI; TAMADA, KOJI; KOBAYASHI, SEI; SAYA, HIDEYUKI; HAZAMA, SHOICHI; OKA, MASAAKI

2014-01-01

Cancer stem cells (CSCs) have been studied for their self-renewal capacity and pluripotency, as well as their resistance to anticancer therapy and their ability to metastasize to distant organs. CSCs are difficult to study because their population is quite low in tumor specimens. To overcome this problem, we established a culture method to induce a pancreatic cancer stem-like cell (P-CSLC)-enriched population from human pancreatic cancer cell lines. Human pancreatic cancer cell lines established at our department were cultured in CSC-inducing media containing epidermal growth factor (EGF), basic fibroblast growth factor (bFGF), leukemia inhibitory factor (LIF), neural cell survivor factor-1 (NSF-1), and N-acetylcysteine. Sphere cells were obtained and then transferred to a laminin-coated dish and cultured for approximately two months. The surface markers, gene expression, aldehyde dehydrogenase (ALDH) activity, cell cycle, and tumorigenicity of these induced cells were examined for their stem cell-like characteristics. The population of these induced cells expanded within a few months. The ratio of CD24high, CD44high, epithelial specific antigen (ESA) high, and CD44variant (CD44v) high cells in the induced cells was greatly enriched. The induced cells stayed in the G0/G1 phase and demonstrated mesenchymal and stemness properties. The induced cells had high tumorigenic potential. Thus, we established a culture method to induce a P-CSLCenriched population from human pancreatic cancer cell lines. The CSLC population was enriched approximately 100-fold with this method. Our culture method may contribute to the precise analysis of CSCs and thus support the establishment of CSC-targeting therapy. PMID:25118635

Path synthesis of four-bar mechanisms using synergy of polynomial neural network and Stackelberg game theory

NASA Astrophysics Data System (ADS)

Ahmadi, Bahman; Nariman-zadeh, Nader; Jamali, Ali

2017-06-01

In this article, a novel approach based on game theory is presented for multi-objective optimal synthesis of four-bar mechanisms. The multi-objective optimization problem is modelled as a Stackelberg game. The more important objective function, tracking error, is considered as the leader, and the other objective function, deviation of the transmission angle from 90° (TA), is considered as the follower. In a new approach, a group method of data handling (GMDH)-type neural network is also utilized to construct an approximate model for the rational reaction set (RRS) of the follower. Using the proposed game-theoretic approach, the multi-objective optimal synthesis of a four-bar mechanism is then cast into a single-objective optimal synthesis using the leader variables and the obtained RRS of the follower. The superiority of using the synergy game-theoretic method of Stackelberg with a GMDH-type neural network is demonstrated for two case studies on the synthesis of four-bar mechanisms.

Epigenetic Marks Define the Lineage and Differentiation Potential of Two Distinct Neural Crest-Derived Intermediate Odontogenic Progenitor Populations

PubMed Central

Gopinathan, Gokul; Kolokythas, Antonia

2013-01-01

Epigenetic mechanisms, such as histone modifications, play an active role in the differentiation and lineage commitment of mesenchymal stem cells. In the present study, epigenetic states and differentiation profiles of two odontogenic neural crest-derived intermediate progenitor populations were compared: dental pulp (DP) and dental follicle (DF). ChIP on chip assays revealed substantial H3K27me3-mediated repression of odontoblast lineage genes DSPP and dentin matrix protein 1 (DMP1) in DF cells, but not in DP cells. Mineralization inductive conditions caused steep increases of mineralization and patterning gene expression levels in DP cells when compared to DF cells. In contrast, mineralization induction resulted in a highly dynamic histone modification response in DF cells, while there was only a subdued effect in DP cells. Both DF and DP progenitors featured H3K4me3-active marks on the promoters of early mineralization genes RUNX2, MSX2, and DLX5, while OSX, IBSP, and BGLAP promoters were enriched for H3K9me3 or H3K27me3. Compared to DF cells, DP cells expressed higher levels of three pluripotency-associated genes, OCT4, NANOG, and SOX2. Finally, gene ontology comparison of bivalent marks unique for DP and DF cells highlighted cell–cell attachment genes in DP cells and neurogenesis genes in DF cells. In conclusion, the present study indicates that the DF intermediate odontogenic neural crest lineage is distinguished from its DP counterpart by epigenetic repression of DSPP and DMP1 genes and through dynamic histone enrichment responses to mineralization induction. Findings presented here highlight the crucial role of epigenetic regulatory mechanisms in the terminal differentiation of odontogenic neural crest lineages. PMID:23379639

Contribution of Common PCSK1 Genetic Variants to Obesity in 8,359 Subjects from Multi-Ethnic American Population

PubMed Central

Choquet, Hélène; Kasberger, Jay; Hamidovic, Ajna; Jorgenson, Eric

2013-01-01

Common PCSK1 variants (notably rs6232 and rs6235) have been shown to be associated with obesity in European, Asian and Mexican populations. To determine whether common PCSK1 variants contribute to obesity in American population, we conducted association analyses in 8,359 subjects using two multi-ethnic American studies: the Coronary Artery Risk Development in Young Adults (CARDIA) study and the Multi-Ethnic Study of Atherosclerosis (MESA). By evaluating the contribution of rs6232 and rs6235 in each ethnic group, we found that in European-American subjects from CARDIA, only rs6232 was associated with BMI (P = 0.006) and obesity (P = 0.018) but also increased the obesity incidence during the 20 years of follow-up (HR = 1.53 [1.07–2.19], P = 0.019). Alternatively, in African-American subjects from CARDIA, rs6235 was associated with BMI (P = 0.028) and obesity (P = 0.018). Further, by combining the two case-control ethnic groups from the CARDIA study in a meta-analysis, association between rs6235 and obesity risk remained significant (OR = 1.23 [1.05–1.45], P = 9.5×10−3). However, neither rs6232 nor rs6235 was associated with BMI or obesity in the MESA study. Interestingly, rs6232 was associated with BMI (P = 4.2×10−3) and obesity (P = 3.4×10−3) in the younger European-American group combining samples from the both studies [less than median age (53 years)], but not among the older age group (P = 0.756 and P = 0.935 for BMI and obesity, respectively). By combining all the case-control ethnic groups from CARDIA and MESA in a meta-analysis, we found no significant association for the both variants and obesity risk. Finally, by exploring the full PCSK1 locus, we observed that no variant remained significant after correction for multiple testing. These results indicate that common PCSK1 variants (notably rs6232 and rs6235) contribute modestly to obesity in multi-ethnic American population. Further, these results

Contribution of common PCSK1 genetic variants to obesity in 8,359 subjects from multi-ethnic American population.

PubMed

Choquet, Hélène; Kasberger, Jay; Hamidovic, Ajna; Jorgenson, Eric

2013-01-01

Common PCSK1 variants (notably rs6232 and rs6235) have been shown to be associated with obesity in European, Asian and Mexican populations. To determine whether common PCSK1 variants contribute to obesity in American population, we conducted association analyses in 8,359 subjects using two multi-ethnic American studies: the Coronary Artery Risk Development in Young Adults (CARDIA) study and the Multi-Ethnic Study of Atherosclerosis (MESA). By evaluating the contribution of rs6232 and rs6235 in each ethnic group, we found that in European-American subjects from CARDIA, only rs6232 was associated with BMI (P = 0.006) and obesity (P = 0.018) but also increased the obesity incidence during the 20 years of follow-up (HR = 1.53 [1.07-2.19], P = 0.019). Alternatively, in African-American subjects from CARDIA, rs6235 was associated with BMI (P = 0.028) and obesity (P = 0.018). Further, by combining the two case-control ethnic groups from the CARDIA study in a meta-analysis, association between rs6235 and obesity risk remained significant (OR = 1.23 [1.05-1.45], P = 9.5×10(-3)). However, neither rs6232 nor rs6235 was associated with BMI or obesity in the MESA study. Interestingly, rs6232 was associated with BMI (P = 4.2×10(-3)) and obesity (P = 3.4×10(-3)) in the younger European-American group combining samples from the both studies [less than median age (53 years)], but not among the older age group (P = 0.756 and P = 0.935 for BMI and obesity, respectively). By combining all the case-control ethnic groups from CARDIA and MESA in a meta-analysis, we found no significant association for the both variants and obesity risk. Finally, by exploring the full PCSK1 locus, we observed that no variant remained significant after correction for multiple testing. These results indicate that common PCSK1 variants (notably rs6232 and rs6235) contribute modestly to obesity in multi-ethnic American population. Further, these results

Temporal neural networks and transient analysis of complex engineering systems

NASA Astrophysics Data System (ADS)

Uluyol, Onder

A theory is introduced for a multi-layered Local Output Gamma Feedback (LOGF) neural network within the paradigm of Locally-Recurrent Globally-Feedforward neural networks. It is developed for the identification, prediction, and control tasks of spatio-temporal systems and allows for the presentation of different time scales through incorporation of a gamma memory. It is initially applied to the tasks of sunspot and Mackey-Glass series prediction as benchmarks, then it is extended to the task of power level control of a nuclear reactor at different fuel cycle conditions. The developed LOGF neuron model can also be viewed as a Transformed Input and State (TIS) Gamma memory for neural network architectures for temporal processing. The novel LOGF neuron model extends the static neuron model by incorporating into it a short-term memory structure in the form of a digital gamma filter. A feedforward neural network made up of LOGF neurons can thus be used to model dynamic systems. A learning algorithm based upon the Backpropagation-Through-Time (BTT) approach is derived. It is applicable for training a general L-layer LOGF neural network. The spatial and temporal weights and parameters of the network are iteratively optimized for a given problem using the derived learning algorithm.

Retrieval of cloud properties from POLDER-3 data using the neural network approach

NASA Astrophysics Data System (ADS)

Di Noia, A.; Hasekamp, O. P.

2017-12-01

Satellite multi-angle spectroplarimetry is a useful technique for observing the microphysical properties of clouds and aerosols. Most of the algorithms for the retrieval of cloud and aerosol properties from satellite measurements require multiple calls to radiative transfer models, which make the retrieval computationally expensive. A traditional alternative to these schemes is represented by lookup-tables (LUTs), where the retrieval is performed by choosing, within a predefined database of combinations of clouds or aerosol properties, the combination that best fits the measurements. LUT retrievals are quicker than full-physics, iterative retrievals, but their accuracy is limited by the number of entries stored in the LUT. Another retrieval method capable of producing very quick retrievals without a big sacrifice in accuracy is the neural network method. Neural network methods are routinely applied to several types of satellite measurements, but their application to multi-angle spectropolarimetric data is still in its early stage, because of the difficulty of accounting for the angular variability of the measurements in the training process. We have recently developed a neural network scheme for the retrieval of cloud properties from POLDER-3 data. The neural network retrieval is trained using synthetic measurements performed for realistic combinations of cloud properties and measurement angles, and is able to process an entire orbit in about 20 seconds. Comparisons of the retrieved cloud properties with Moderate Resolution Imaging Spectroradiometer (MODIS) gridded products during one year show encouraging retrieval performance for cloud optical thickness and effective radius. A discussion of the setup of the neural network and of the validation results will be the main topic of our presentation.

Holographic imaging and photostimulation of neural activity.

PubMed

Yang, Weijian; Yuste, Rafael

2018-06-01

Optical imaging methods are powerful tools in neuroscience as they can systematically monitor the activity of neuronal populations with high spatiotemporal resolution using calcium or voltage indicators. Moreover, caged compounds and optogenetic actuators enable to optically manipulate neural activity. Among optical methods, computer-generated holography offers an enormous flexibility to sculpt the excitation light in three-dimensions (3D), particularly when combined with two-photon light sources. By projecting holographic light patterns on the sample, the activity of multiple neurons across a 3D brain volume can be simultaneously imaged or optically manipulated with single-cell precision. This flexibility makes two-photon holographic microscopy an ideal all-optical platform to simultaneously read and write activity in neuronal populations in vivo in 3D, a critical ability to dissect the function of neural circuits. Copyright © 2018 Elsevier Ltd. All rights reserved.

Describing complex cells in primary visual cortex: a comparison of context and multi-filter LN models.

PubMed

Westö, Johan; May, Patrick J C

2018-05-02

Receptive field (RF) models are an important tool for deciphering neural responses to sensory stimuli. The two currently popular RF models are multi-filter linear-nonlinear (LN) models and context models. Models are, however, never correct and they rely on assumptions to keep them simple enough to be interpretable. As a consequence, different models describe different stimulus-response mappings, which may or may not be good approximations of real neural behavior. In the current study, we take up two tasks: First, we introduce new ways to estimate context models with realistic nonlinearities, that is, with logistic and exponential functions. Second, we evaluate context models and multi-filter LN models in terms of how well they describe recorded data from complex cells in cat primary visual cortex. Our results, based on single-spike information and correlation coefficients, indicate that context models outperform corresponding multi-filter LN models of equal complexity (measured in terms of number of parameters), with the best increase in performance being achieved by the novel context models. Consequently, our results suggest that the multi-filter LN-model framework is suboptimal for describing the behavior of complex cells: the context-model framework is clearly superior while still providing interpretable quantizations of neural behavior.

Neural Generalized Predictive Control: A Newton-Raphson Implementation

NASA Technical Reports Server (NTRS)

Soloway, Donald; Haley, Pamela J.

1997-01-01

An efficient implementation of Generalized Predictive Control using a multi-layer feedforward neural network as the plant's nonlinear model is presented. In using Newton-Raphson as the optimization algorithm, the number of iterations needed for convergence is significantly reduced from other techniques. The main cost of the Newton-Raphson algorithm is in the calculation of the Hessian, but even with this overhead the low iteration numbers make Newton-Raphson faster than other techniques and a viable algorithm for real-time control. This paper presents a detailed derivation of the Neural Generalized Predictive Control algorithm with Newton-Raphson as the minimization algorithm. Simulation results show convergence to a good solution within two iterations and timing data show that real-time control is possible. Comments about the algorithm's implementation are also included.

Multi-scale analysis of neural activity in humans: Implications for micro-scale electrocorticography.

PubMed

Kellis, Spencer; Sorensen, Larry; Darvas, Felix; Sayres, Conor; O'Neill, Kevin; Brown, Richard B; House, Paul; Ojemann, Jeff; Greger, Bradley

2016-01-01

Electrocorticography grids have been used to study and diagnose neural pathophysiology for over 50 years, and recently have been used for various neural prosthetic applications. Here we provide evidence that micro-scale electrodes are better suited for studying cortical pathology and function, and for implementing neural prostheses. This work compares dynamics in space, time, and frequency of cortical field potentials recorded by three types of electrodes: electrocorticographic (ECoG) electrodes, non-penetrating micro-ECoG (μECoG) electrodes that use microelectrodes and have tighter interelectrode spacing; and penetrating microelectrodes (MEA) that penetrate the cortex to record single- or multiunit activity (SUA or MUA) and local field potentials (LFP). While the finest spatial scales are found in LFPs recorded intracortically, we found that LFP recorded from μECoG electrodes demonstrate scales of linear similarity (i.e., correlation, coherence, and phase) closer to the intracortical electrodes than the clinical ECoG electrodes. We conclude that LFPs can be recorded intracortically and epicortically at finer scales than clinical ECoG electrodes are capable of capturing. Recorded with appropriately scaled electrodes and grids, field potentials expose a more detailed representation of cortical network activity, enabling advanced analyses of cortical pathology and demanding applications such as brain-computer interfaces. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Propagating waves can explain irregular neural dynamics.

PubMed

Keane, Adam; Gong, Pulin

2015-01-28

Cortical neurons in vivo fire quite irregularly. Previous studies about the origin of such irregular neural dynamics have given rise to two major models: a balanced excitation and inhibition model, and a model of highly synchronized synaptic inputs. To elucidate the network mechanisms underlying synchronized synaptic inputs and account for irregular neural dynamics, we investigate a spatially extended, conductance-based spiking neural network model. We show that propagating wave patterns with complex dynamics emerge from the network model. These waves sweep past neurons, to which they provide highly synchronized synaptic inputs. On the other hand, these patterns only emerge from the network with balanced excitation and inhibition; our model therefore reconciles the two major models of irregular neural dynamics. We further demonstrate that the collective dynamics of propagating wave patterns provides a mechanistic explanation for a range of irregular neural dynamics, including the variability of spike timing, slow firing rate fluctuations, and correlated membrane potential fluctuations. In addition, in our model, the distributions of synaptic conductance and membrane potential are non-Gaussian, consistent with recent experimental data obtained using whole-cell recordings. Our work therefore relates the propagating waves that have been widely observed in the brain to irregular neural dynamics. These results demonstrate that neural firing activity, although appearing highly disordered at the single-neuron level, can form dynamical coherent structures, such as propagating waves at the population level. Copyright © 2015 the authors 0270-6474/15/351591-15$15.00/0.

Closing the Loop for Memory Prostheses: Detecting the Role of Hippocampal Neural Ensembles Using Nonlinear Models

PubMed Central

Hampson, Robert E.; Song, Dong; Chan, Rosa H.M.; Sweatt, Andrew J.; Riley, Mitchell R.; Goonawardena, Anushka V.; Marmarelis, Vasilis Z.; Gerhardt, Greg A.; Berger, Theodore W.; Deadwyler, Sam A.

2012-01-01

A major factor involved in providing closed loop feedback for control of neural function is to understand how neural ensembles encode online information critical to the final behavioral endpoint. This issue was directly assessed in rats performing a short-term delay memory task in which successful encoding of task information is dependent upon specific spatiotemporal firing patterns recorded from ensembles of CA3 and CA1 hippocampal neurons. Such patterns, extracted by a specially designed nonlinear multi-input multi-output (MIMO) nonlinear mathematical model, were used to predict successful performance online via a closed loop paradigm which regulated trial difficulty (time of retention) as a function of the “strength” of stimulus encoding. The significance of the MIMO model as a neural prosthesis has been demonstrated by substituting trains of electrical stimulation pulses to mimic these same ensemble firing patterns. This feature was used repeatedly to vary “normal” encoding as a means of understanding how neural ensembles can be “tuned” to mimic the inherent process of selecting codes of different strength and functional specificity. The capacity to enhance and tune hippocampal encoding via MIMO model detection and insertion of critical ensemble firing patterns shown here provides the basis for possible extension to other disrupted brain circuitry. PMID:22498704

Validation study of the Leeds Dyspepsia Questionnaire in a multi-ethnic Asian population.

PubMed

Mahadeva, Sanjiv; Chan, Wah-Kheong; Mohazmi, Mohammed; Sujarita, Ramanujam; Goh, Khean-Lee

2011-11-01

Outcome measures for clinical trials in dyspepsia require an assessment of symptom response. There is a lack of validated instruments assessing dyspepsia symptoms in the Asian region. We aimed to translate and validate the Leeds Dyspepsia Questionnaire (LDQ) in a multi-ethnic Asian population. A Malay and culturally adapted English version of the LDQ were developed according to established protocols. Psychometric evaluation was performed by assessing the validity, internal consistency, test-retest reliability and responsiveness of the instruments in both primary and secondary care patients. Between April and September 2010, both Malay (n=166) and Malaysian English (n=154) versions were assessed in primary and secondary care patients. Both language versions were found to be reliable (internal consistency was 0.80 and 0.74 (Cronbach's α) for Malay and English, respectively; spearman's correlation coefficient for test-retest reliability was 0.98 for both versions), valid (area under receiver operating curve for accuracy of diagnosing dyspepsia was 0.71 and 0.77 for Malay and English versions, respectively), discriminative (median LDQ score discriminated between primary and secondary care patients in Malay (11.0 vs 20.0, P<0.0001) and English (10.0 vs 14.0, P=0.001), and responsive (median LDQ score reduced after treatment in Malay (17.0 to 14.0, P=0.08) and English (18.0 to 11.0, P=0.008) to dyspepsia. The Malaysian versions of the LDQ are valid, reliable and responsive instruments for assessing symptoms in a multi-ethnic Asian population with dyspepsia. © 2011 Journal of Gastroenterology and Hepatology Foundation and Blackwell Publishing Asia Pty Ltd.

Public perceptions and attitudes toward thalassaemia: Influencing factors in a multi-racial population

PubMed Central

2011-01-01

Background Thalassaemia is a common public health problem in Malaysia and about 4.5 to 6% of the Malays and Chinese are carriers of this genetic disorder. The major forms of thalassaemia result in death in utero of affected foetuses (α-thalassaemia) or life-long blood transfusions for survival in β-thalassaemia. This study, the first nationwide population based survey of thalassaemia in Malaysia, aimed to determine differences in public awareness, perceptions and attitudes toward thalassaemia in the multi-racial population in Malaysia. Methods A cross-sectional computer-assisted telephone interview survey of a representative sample of multi-racial Malaysians aged 18 years and above was conducted between July and December 2009. Results Of a total of 3723 responding households, 2846 (76.4%) have heard of thalassaemia. Mean knowledge score was 11.85 (SD ± 4.03), out of a maximum of 21, with higher scores indicating better knowledge. Statistically significant differences (P < 0.05) in total knowledge score by age groups, education attainment, employment status, and average household income were observed. Although the majority expressed very positive attitudes toward screening for thalassaemia, only 13.6% of married participants interviewed have been screened for thalassaemia. The majority (63.4%) were unsupportive of selective termination of foetuses diagnosed with thalassaemia major. Conclusion Study shows that carrier and premarital screening programs for thalassaemia may be more effective and culturally acceptable in the reduction of pregnancies with thalassaemia major. The findings provide insights into culturally congruent educational interventions to reach out diverse socio-demographic and ethnic communities to increase knowledge and cultivate positive attitudes toward prevention of thalassaemia. PMID:21447191

Variable synaptic strengths controls the firing rate distribution in feedforward neural networks.

PubMed

Ly, Cheng; Marsat, Gary

2018-02-01

Heterogeneity of firing rate statistics is known to have severe consequences on neural coding. Recent experimental recordings in weakly electric fish indicate that the distribution-width of superficial pyramidal cell firing rates (trial- and time-averaged) in the electrosensory lateral line lobe (ELL) depends on the stimulus, and also that network inputs can mediate changes in the firing rate distribution across the population. We previously developed theoretical methods to understand how two attributes (synaptic and intrinsic heterogeneity) interact and alter the firing rate distribution in a population of integrate-and-fire neurons with random recurrent coupling. Inspired by our experimental data, we extend these theoretical results to a delayed feedforward spiking network that qualitatively capture the changes of firing rate heterogeneity observed in in-vivo recordings. We demonstrate how heterogeneous neural attributes alter firing rate heterogeneity, accounting for the effect with various sensory stimuli. The model predicts how the strength of the effective network connectivity is related to intrinsic heterogeneity in such delayed feedforward networks: the strength of the feedforward input is positively correlated with excitability (threshold value for spiking) when firing rate heterogeneity is low and is negatively correlated with excitability with high firing rate heterogeneity. We also show how our theory can be used to predict effective neural architecture. We demonstrate that neural attributes do not interact in a simple manner but rather in a complex stimulus-dependent fashion to control neural heterogeneity and discuss how it can ultimately shape population codes.

Human Neural Cell-Based Biosensor

DTIC Science & Technology

2011-03-11

following areas: (1) neural progenitor isolation from induced pluripotent stem cells , (2) directed differentiation of progenitors into dopaminergic...from induced pluripotent stem cells , (2) directed differentiation of progenitors into dopaminergic neurons, motoneurons and astrocytes using defined...progenitors from mixed populations, such as induced pluripotent stem cells (iPSCs). We also developed lentiviral based methods to generate iPSCs in

Cracking the Neural Code for Sensory Perception by Combining Statistics, Intervention, and Behavior.

PubMed

Panzeri, Stefano; Harvey, Christopher D; Piasini, Eugenio; Latham, Peter E; Fellin, Tommaso

2017-02-08

The two basic processes underlying perceptual decisions-how neural responses encode stimuli, and how they inform behavioral choices-have mainly been studied separately. Thus, although many spatiotemporal features of neural population activity, or "neural codes," have been shown to carry sensory information, it is often unknown whether the brain uses these features for perception. To address this issue, we propose a new framework centered on redefining the neural code as the neural features that carry sensory information used by the animal to drive appropriate behavior; that is, the features that have an intersection between sensory and choice information. We show how this framework leads to a new statistical analysis of neural activity recorded during behavior that can identify such neural codes, and we discuss how to combine intersection-based analysis of neural recordings with intervention on neural activity to determine definitively whether specific neural activity features are involved in a task. Copyright © 2017 Elsevier Inc. All rights reserved.

Retinal Vein Occlusion in a Multi-Ethnic Asian Population: The Singapore Epidemiology of Eye Disease Study.

PubMed

Koh, Victor; Cheung, Carol Y; Li, Xiang; Tian, Dechao; Wang, Jie Jin; Mitchell, Paul; Cheng, Ching-Yu; Wong, Tien Y

2016-01-01

To describe the prevalence of retinal vein occlusion (RVO) and its risk factors in a multi-ethnic Asian population. This population-based study of 10,033 participants (75.7% response rate) included Chinese, Indian and Malay persons aged 40 years and older. A comprehensive ophthalmic examination, standardized interviews and laboratory blood tests were performed. Digital fundus photographs were assessed for presence of RVO following the definitions used in the Blue Mountains Eye Study. Regression analysis models were constructed to study the relationship between ocular and systemic factors and RVO. Age-specific prevalence rates of RVO were applied to project the number of people affected in Asia from 2013 to 2040. The overall crude prevalence of RVO was 0.72% (n = 71; 95% confidence interval, CI, 0.54-0.87%). The crude prevalence of RVO was similar in Chinese, Indian and Malay participants (p = 0.865). In multivariable regression models, significant risk factors of RVO included increased age (odds ratio, OR, 1.03, 95% CI 1.01-1.06), hypertension (OR 3.65, 95% CI 1.61-8.31), increased serum creatinine (OR 1.04, 95% CI 1.01-1.06, per 10 mmol/L increase), history of heart attack (OR 2.25, 95% CI 1.11-4.54) and increased total cholesterol (OR 1.31, 95% CI 1.07-1.59, per 1 mmol/L increase). None of the ocular parameters were associated with RVO. RVO is estimated to affect up to 16 and 21 million people in Asia by 2020 and 2040, respectively. RVO was detected in 0.72% of a multi-ethnic Asian population aged 40-80 years in Singapore. The significant systemic risk factors of RVO are consistent with studies in white populations.

A neural network approach for enhancing information extraction from multispectral image data

USGS Publications Warehouse

Liu, J.; Shao, G.; Zhu, H.; Liu, S.

2005-01-01

A back-propagation artificial neural network (ANN) was applied to classify multispectral remote sensing imagery data. The classification procedure included four steps: (i) noisy training that adds minor random variations to the sampling data to make the data more representative and to reduce the training sample size; (ii) iterative or multi-tier classification that reclassifies the unclassified pixels by making a subset of training samples from the original training set, which means the neural model can focus on fewer classes; (iii) spectral channel selection based on neural network weights that can distinguish the relative importance of each channel in the classification process to simplify the ANN model; and (iv) voting rules that adjust the accuracy of classification and produce outputs of different confidence levels. The Purdue Forest, located west of Purdue University, West Lafayette, Indiana, was chosen as the test site. The 1992 Landsat thematic mapper imagery was used as the input data. High-quality airborne photographs of the same Lime period were used for the ground truth. A total of 11 land use and land cover classes were defined, including water, broadleaved forest, coniferous forest, young forest, urban and road, and six types of cropland-grassland. The experiment, indicated that the back-propagation neural network application was satisfactory in distinguishing different land cover types at US Geological Survey levels II-III. The single-tier classification reached an overall accuracy of 85%. and the multi-tier classification an overall accuracy of 95%. For the whole test, region, the final output of this study reached an overall accuracy of 87%. ?? 2005 CASI.

Neural network approach for the calculation of potential coefficients in quantum mechanics

NASA Astrophysics Data System (ADS)

Ossandón, Sebastián; Reyes, Camilo; Cumsille, Patricio; Reyes, Carlos M.

2017-05-01

A numerical method based on artificial neural networks is used to solve the inverse Schrödinger equation for a multi-parameter class of potentials. First, the finite element method was used to solve repeatedly the direct problem for different parametrizations of the chosen potential function. Then, using the attainable eigenvalues as a training set of the direct radial basis neural network a map of new eigenvalues was obtained. This relationship was later inverted and refined by training an inverse radial basis neural network, allowing the calculation of the unknown parameters and therefore estimating the potential function. Three numerical examples are presented in order to prove the effectiveness of the method. The results show that the method proposed has the advantage to use less computational resources without a significant accuracy loss.

Neural mechanisms of movement planning: motor cortex and beyond.

PubMed

Svoboda, Karel; Li, Nuo

2018-04-01

Neurons in motor cortex and connected brain regions fire in anticipation of specific movements, long before movement occurs. This neural activity reflects internal processes by which the brain plans and executes volitional movements. The study of motor planning offers an opportunity to understand how the structure and dynamics of neural circuits support persistent internal states and how these states influence behavior. Recent advances in large-scale neural recordings are beginning to decipher the relationship of the dynamics of populations of neurons during motor planning and movements. New behavioral tasks in rodents, together with quantified perturbations, link dynamics in specific nodes of neural circuits to behavior. These studies reveal a neural network distributed across multiple brain regions that collectively supports motor planning. We review recent advances and highlight areas where further work is needed to achieve a deeper understanding of the mechanisms underlying motor planning and related cognitive processes. Copyright © 2017. Published by Elsevier Ltd.

Mapping of neuron soma size as an effective approach to delineate differences between neural populations.

PubMed

Lingley, Alexander J; Bowdridge, Joshua C; Farivar, Reza; Duffy, Kevin R

2018-04-30

A single histological marker applied to a slice of tissue often reveals myriad cytoarchitectonic characteristics that can obscure differences between neuron populations targeted for study. Isolation and measurement of a single feature from the tissue is possible through a variety of approaches, however, visualizing the data numerically or through graphs alone can preclude being able to identify important features and effects that are not obvious from direct observation of the tissue. We demonstrate an efficient, effective, and robust approach to quantify and visualize cytoarchitectural features in histologically prepared brain sections. We demonstrate that this approach is able to reveal small differences between populations of neurons that might otherwise have gone undiscovered. We used stereological methods to record the cross-sectional soma area and in situ position of neurons within sections of the cat, monkey, and human visual system. The two-dimensional coordinate of every measured cell was used to produce a scatter plot that recapitulated the natural spatial distribution of cells, and each point in the plot was color-coded according to its respective soma area. The final graphic display was a multi-dimensional map of neuron soma size that revealed subtle differences across neuron aggregations, permitted delineation of regional boundaries, and identified small differences between populations of neurons modified by a period of sensory deprivation. This approach to collecting and displaying cytoarchitectonic data is simple, efficient, and provides a means of investigating small differences between neuron populations. Copyright © 2018. Published by Elsevier B.V.

Neural tissue engineering: Bioresponsive nanoscaffolds using engineered self-assembling peptides.

PubMed

Koss, K M; Unsworth, L D

2016-10-15

Rescuing or repairing neural tissues is of utmost importance to the patient's quality of life after an injury. To remedy this, many novel biomaterials are being developed that are, ideally, non-invasive and directly facilitate neural wound healing. As such, this review surveys the recent approaches and applications of self-assembling peptides and peptide amphiphiles, for building multi-faceted nanoscaffolds for direct application to neural injury. Specifically, methods enabling cellular interactions with the nanoscaffold and controlling the release of bioactive molecules from the nanoscaffold for the express purpose of directing endogenous cells in damaged or diseased neural tissues is presented. An extensive overview of recently derived self-assembling peptide-based materials and their use as neural nanoscaffolds is presented. In addition, an overview of potential bioactive peptides and ligands that could be used to direct behaviour of endogenous cells are categorized with their biological effects. Finally, a number of neurotrophic and anti-inflammatory drugs are described and discussed. Smaller therapeutic molecules are emphasized, as they are thought to be able to have less potential effect on the overall peptide self-assembly mechanism. Options for potential nanoscaffolds and drug delivery systems are suggested. Self-assembling nanoscaffolds have many inherent properties making them amenable to tissue engineering applications: ease of synthesis, ease of customization with bioactive moieties, and amenable for in situ nanoscaffold formation. The combination of the existing knowledge on bioactive motifs for neural engineering and the self-assembling propensity of peptides is discussed in specific reference to neural tissue engineering. Copyright © 2016. Published by Elsevier Ltd.

Corrected Position Estimation in PET Detector Modules With Multi-Anode PMTs Using Neural Networks

NASA Astrophysics Data System (ADS)

Aliaga, R. J.; Martinez, J. D.; Gadea, R.; Sebastia, A.; Benlloch, J. M.; Sanchez, F.; Pavon, N.; Lerche, Ch.

2006-06-01

This paper studies the use of Neural Networks (NNs) for estimating the position of impinging photons in gamma ray detector modules for PET cameras based on continuous scintillators and Multi-Anode Photomultiplier Tubes (MA-PMTs). The detector under study is composed of a 49/spl times/49/spl times/10 mm/sup 3/ continuous slab of LSO coupled to a flat panel H8500 MA-PMT. Four digitized signals from a charge division circuit, which collects currents from the 8/spl times/8 anode matrix of the photomultiplier, are used as inputs to the NN, thus reducing drastically the number of electronic channels required. We have simulated the computation of the position for 511 keV gamma photons impacting perpendicularly to the detector surface. Thus, we have performed a thorough analysis of the NN architecture and training procedures in order to achieve the best results in terms of spatial resolution and bias correction. Results obtained using GEANT4 simulation toolkit show a resolution of 1.3 mm/1.9 mm FWHM at the center/edge of the detector and less than 1 mm of systematic error in the position near the edges of the scintillator. The results confirm that NNs can partially model and correct the non-uniform detector response using only the position-weighted signals from a simple 2D DPC circuit. Linearity degradation for oblique incidence is also investigated. Finally, the NN can be implemented in hardware for parallel real time corrected Line-of-Response (LOR) estimation. Results on resources occupancy and throughput in FPGA are presented.

Analysis of Neural Stem Cells from Human Cortical Brain Structures In Vitro.

PubMed

Aleksandrova, M A; Poltavtseva, R A; Marei, M V; Sukhikh, G T

2016-05-01

Comparative immunohistochemical analysis of the neocortex from human fetuses showed that neural stem and progenitor cells are present in the brain throughout the gestation period, at least from week 8 through 26. At the same time, neural stem cells from the first and second trimester fetuses differed by the distribution, morphology, growth, and quantity. Immunocytochemical analysis of neural stem cells derived from fetuses at different gestation terms and cultured under different conditions showed their differentiation capacity. Detailed analysis of neural stem cell populations derived from fetuses on gestation weeks 8-9, 18-20, and 26 expressing Lex/SSEA1 was performed.

Improved head direction command classification using an optimised Bayesian neural network.

PubMed

Nguyen, Son T; Nguyen, Hung T; Taylor, Philip B; Middleton, James

2006-01-01

Assistive technologies have recently emerged to improve the quality of life of severely disabled people by enhancing their independence in daily activities. Since many of those individuals have limited or non-existing control from the neck downward, alternative hands-free input modalities have become very important for these people to access assistive devices. In hands-free control, head movement has been proved to be a very effective user interface as it can provide a comfortable, reliable and natural way to access the device. Recently, neural networks have been shown to be useful not only for real-time pattern recognition but also for creating user-adaptive models. Since multi-layer perceptron neural networks trained using standard back-propagation may cause poor generalisation, the Bayesian technique has been proposed to improve the generalisation and robustness of these networks. This paper describes the use of Bayesian neural networks in developing a hands-free wheelchair control system. The experimental results show that with the optimised architecture, classification Bayesian neural networks can detect head commands of wheelchair users accurately irrespective to their levels of injuries.

Estimation of continuous multi-DOF finger joint kinematics from surface EMG using a multi-output Gaussian Process.

PubMed

Ngeo, Jimson; Tamei, Tomoya; Shibata, Tomohiro

2014-01-01

Surface electromyographic (EMG) signals have often been used in estimating upper and lower limb dynamics and kinematics for the purpose of controlling robotic devices such as robot prosthesis and finger exoskeletons. However, in estimating multiple and a high number of degrees-of-freedom (DOF) kinematics from EMG, output DOFs are usually estimated independently. In this study, we estimate finger joint kinematics from EMG signals using a multi-output convolved Gaussian Process (Multi-output Full GP) that considers dependencies between outputs. We show that estimation of finger joints from muscle activation inputs can be improved by using a regression model that considers inherent coupling or correlation within the hand and finger joints. We also provide a comparison of estimation performance between different regression methods, such as Artificial Neural Networks (ANN) which is used by many of the related studies. We show that using a multi-output GP gives improved estimation compared to multi-output ANN and even dedicated or independent regression models.

Fractionating the neural correlates of individual working memory components underlying arithmetic problem solving skills in children.

PubMed

Metcalfe, Arron W S; Ashkenazi, Sarit; Rosenberg-Lee, Miriam; Menon, Vinod

2013-10-01

Baddeley and Hitch's multi-component working memory (WM) model has played an enduring and influential role in our understanding of cognitive abilities. Very little is known, however, about the neural basis of this multi-component WM model and the differential role each component plays in mediating arithmetic problem solving abilities in children. Here, we investigate the neural basis of the central executive (CE), phonological (PL) and visuo-spatial (VS) components of WM during a demanding mental arithmetic task in 7-9 year old children (N=74). The VS component was the strongest predictor of math ability in children and was associated with increased arithmetic complexity-related responses in left dorsolateral and right ventrolateral prefrontal cortices as well as bilateral intra-parietal sulcus and supramarginal gyrus in posterior parietal cortex. Critically, VS, CE and PL abilities were associated with largely distinct patterns of brain response. Overlap between VS and CE components was observed in left supramarginal gyrus and no overlap was observed between VS and PL components. Our findings point to a central role of visuo-spatial WM during arithmetic problem-solving in young grade-school children and highlight the usefulness of the multi-component Baddeley and Hitch WM model in fractionating the neural correlates of arithmetic problem solving during development. Copyright © 2013 Elsevier Ltd. All rights reserved.

An architecture for designing fuzzy logic controllers using neural networks

NASA Technical Reports Server (NTRS)

Berenji, Hamid R.

1991-01-01

Described here is an architecture for designing fuzzy controllers through a hierarchical process of control rule acquisition and by using special classes of neural network learning techniques. A new method for learning to refine a fuzzy logic controller is introduced. A reinforcement learning technique is used in conjunction with a multi-layer neural network model of a fuzzy controller. The model learns by updating its prediction of the plant's behavior and is related to the Sutton's Temporal Difference (TD) method. The method proposed here has the advantage of using the control knowledge of an experienced operator and fine-tuning it through the process of learning. The approach is applied to a cart-pole balancing system.

Resting-state brain activity in the motor cortex reflects task-induced activity: A multi-voxel pattern analysis.

PubMed

Kusano, Toshiki; Kurashige, Hiroki; Nambu, Isao; Moriguchi, Yoshiya; Hanakawa, Takashi; Wada, Yasuhiro; Osu, Rieko

2015-08-01

It has been suggested that resting-state brain activity reflects task-induced brain activity patterns. In this study, we examined whether neural representations of specific movements can be observed in the resting-state brain activity patterns of motor areas. First, we defined two regions of interest (ROIs) to examine brain activity associated with two different behavioral tasks. Using multi-voxel pattern analysis with regularized logistic regression, we designed a decoder to detect voxel-level neural representations corresponding to the tasks in each ROI. Next, we applied the decoder to resting-state brain activity. We found that the decoder discriminated resting-state neural activity with accuracy comparable to that associated with task-induced neural activity. The distribution of learned weighted parameters for each ROI was similar for resting-state and task-induced activities. Large weighted parameters were mainly located on conjunctive areas. Moreover, the accuracy of detection was higher than that for a decoder whose weights were randomly shuffled, indicating that the resting-state brain activity includes multi-voxel patterns similar to the neural representation for the tasks. Therefore, these results suggest that the neural representation of resting-state brain activity is more finely organized and more complex than conventionally considered.

DataHigh: graphical user interface for visualizing and interacting with high-dimensional neural activity.

PubMed

Cowley, Benjamin R; Kaufman, Matthew T; Churchland, Mark M; Ryu, Stephen I; Shenoy, Krishna V; Yu, Byron M

2012-01-01

The activity of tens to hundreds of neurons can be succinctly summarized by a smaller number of latent variables extracted using dimensionality reduction methods. These latent variables define a reduced-dimensional space in which we can study how population activity varies over time, across trials, and across experimental conditions. Ideally, we would like to visualize the population activity directly in the reduced-dimensional space, whose optimal dimensionality (as determined from the data) is typically greater than 3. However, direct plotting can only provide a 2D or 3D view. To address this limitation, we developed a Matlab graphical user interface (GUI) that allows the user to quickly navigate through a continuum of different 2D projections of the reduced-dimensional space. To demonstrate the utility and versatility of this GUI, we applied it to visualize population activity recorded in premotor and motor cortices during reaching tasks. Examples include single-trial population activity recorded using a multi-electrode array, as well as trial-averaged population activity recorded sequentially using single electrodes. Because any single 2D projection may provide a misleading impression of the data, being able to see a large number of 2D projections is critical for intuition-and hypothesis-building during exploratory data analysis. The GUI includes a suite of additional interactive tools, including playing out population activity timecourses as a movie and displaying summary statistics, such as covariance ellipses and average timecourses. The use of visualization tools like the GUI developed here, in tandem with dimensionality reduction methods, has the potential to further our understanding of neural population activity.

Neural Network Machine Learning and Dimension Reduction for Data Visualization

NASA Technical Reports Server (NTRS)

Liles, Charles A.

2014-01-01

Neural network machine learning in computer science is a continuously developing field of study. Although neural network models have been developed which can accurately predict a numeric value or nominal classification, a general purpose method for constructing neural network architecture has yet to be developed. Computer scientists are often forced to rely on a trial-and-error process of developing and improving accurate neural network models. In many cases, models are constructed from a large number of input parameters. Understanding which input parameters have the greatest impact on the prediction of the model is often difficult to surmise, especially when the number of input variables is very high. This challenge is often labeled the "curse of dimensionality" in scientific fields. However, techniques exist for reducing the dimensionality of problems to just two dimensions. Once a problem's dimensions have been mapped to two dimensions, it can be easily plotted and understood by humans. The ability to visualize a multi-dimensional dataset can provide a means of identifying which input variables have the highest effect on determining a nominal or numeric output. Identifying these variables can provide a better means of training neural network models; models can be more easily and quickly trained using only input variables which appear to affect the outcome variable. The purpose of this project is to explore varying means of training neural networks and to utilize dimensional reduction for visualizing and understanding complex datasets.

Optimized star sensors laboratory calibration method using a regularization neural network.

PubMed

Zhang, Chengfen; Niu, Yanxiong; Zhang, Hao; Lu, Jiazhen

2018-02-10

High-precision ground calibration is essential to ensure the performance of star sensors. However, the complex distortion and multi-error coupling have brought great difficulties to traditional calibration methods, especially for large field of view (FOV) star sensors. Although increasing the complexity of models is an effective way to improve the calibration accuracy, it significantly increases the demand for calibration data. In order to achieve high-precision calibration of star sensors with large FOV, a novel laboratory calibration method based on a regularization neural network is proposed. A multi-layer structure neural network is designed to represent the mapping of the star vector and the corresponding star point coordinate directly. To ensure the generalization performance of the network, regularization strategies are incorporated into the net structure and the training algorithm. Simulation and experiment results demonstrate that the proposed method can achieve high precision with less calibration data and without any other priori information. Compared with traditional methods, the calibration error of the star sensor decreased by about 30%. The proposed method can satisfy the precision requirement for large FOV star sensors.

Identifying bilingual semantic neural representations across languages

PubMed Central

Buchweitz, Augusto; Shinkareva, Svetlana V.; Mason, Robert A.; Mitchell, Tom M.; Just, Marcel Adam

2015-01-01

The goal of the study was to identify the neural representation of a noun's meaning in one language based on the neural representation of that same noun in another language. Machine learning methods were used to train classifiers to identify which individual noun bilingual participants were thinking about in one language based solely on their brain activation in the other language. The study shows reliable (p < .05) pattern-based classification accuracies for the classification of brain activity for nouns across languages. It also shows that the stable voxels used to classify the brain activation were located in areas associated with encoding information about semantic dimensions of the words in the study. The identification of the semantic trace of individual nouns from the pattern of cortical activity demonstrates the existence of a multi-voxel pattern of activation across the cortex for a single noun common to both languages in bilinguals. PMID:21978845

Central neural pathways for thermoregulation

PubMed Central

Morrison, Shaun F.; Nakamura, Kazuhiro

2010-01-01

Central neural circuits orchestrate a homeostatic repertoire to maintain body temperature during environmental temperature challenges and to alter body temperature during the inflammatory response. This review summarizes the functional organization of the neural pathways through which cutaneous thermal receptors alter thermoregulatory effectors: the cutaneous circulation for heat loss, the brown adipose tissue, skeletal muscle and heart for thermogenesis and species-dependent mechanisms (sweating, panting and saliva spreading) for evaporative heat loss. These effectors are regulated by parallel but distinct, effector-specific neural pathways that share a common peripheral thermal sensory input. The thermal afferent circuits include cutaneous thermal receptors, spinal dorsal horn neurons and lateral parabrachial nucleus neurons projecting to the preoptic area to influence warm-sensitive, inhibitory output neurons which control thermogenesis-promoting neurons in the dorsomedial hypothalamus that project to premotor neurons in the rostral ventromedial medulla, including the raphe pallidus, that descend to provide the excitation necessary to drive thermogenic thermal effectors. A distinct population of warm-sensitive preoptic neurons controls heat loss through an inhibitory input to raphe pallidus neurons controlling cutaneous vasoconstriction. PMID:21196160

Central neural pathways for thermoregulation.

PubMed

Morrison, Shaun F; Nakamura, Kazuhiro

2011-01-01

Central neural circuits orchestrate a homeostatic repertoire to maintain body temperature during environmental temperature challenges and to alter body temperature during the inflammatory response. This review summarizes the functional organization of the neural pathways through which cutaneous thermal receptors alter thermoregulatory effectors: the cutaneous circulation for heat loss, the brown adipose tissue, skeletal muscle and heart for thermogenesis and species-dependent mechanisms (sweating, panting and saliva spreading) for evaporative heat loss. These effectors are regulated by parallel but distinct, effector-specific neural pathways that share a common peripheral thermal sensory input. The thermal afferent circuits include cutaneous thermal receptors, spinal dorsal horn neurons and lateral parabrachial nucleus neurons projecting to the preoptic area to influence warm-sensitive, inhibitory output neurons which control thermogenesis-promoting neurons in the dorsomedial hypothalamus that project to premotor neurons in the rostral ventromedial medulla, including the raphe pallidus, that descend to provide the excitation necessary to drive thermogenic thermal effectors. A distinct population of warm-sensitive preoptic neurons controls heat loss through an inhibitory input to raphe pallidus neurons controlling cutaneous vasoconstriction.

Neural reactivation reveals mechanisms for updating memory

PubMed Central

Kuhl, Brice A.; Bainbridge, Wilma A.; Chun, Marvin M.

2012-01-01

Our ability to remember new information is often compromised by competition from prior learning, leading to many instances of forgetting. One of the challenges in studying why these lapses occur and how they can be prevented is that it is methodologically difficult to ‘see’ competition between memories as it occurs. Here, we used multi-voxel pattern analysis of human fMRI data to measure the neural reactivation of both older (competing) and newer (target) memories during individual attempts to retrieve newer memories. Of central interest was (a) whether older memories were reactivated during retrieval of newer memories, (b) how reactivation of older memories related to retrieval performance, and (c) whether neural mechanisms engaged during the encoding of newer memories were predictive of neural competition experienced during retrieval. Our results indicate that older and newer visual memories were often simultaneously reactivated in ventral temporal cortex—even when target memories were successfully retrieved. Importantly, stronger reactivation of older memories was associated with less accurate retrieval of newer memories, slower mnemonic decisions, and increased activity in anterior cingulate cortex. Finally, greater activity in the inferior frontal gyrus during the encoding of newer memories (memory updating) predicted lower competition in ventral temporal cortex during subsequent retrieval. Together, these results provide novel insight into how older memories compete with newer memories and specify neural mechanisms that allow competition to be overcome and memories to be updated. PMID:22399768

Deep multi-scale location-aware 3D convolutional neural networks for automated detection of lacunes of presumed vascular origin.

PubMed

Ghafoorian, Mohsen; Karssemeijer, Nico; Heskes, Tom; Bergkamp, Mayra; Wissink, Joost; Obels, Jiri; Keizer, Karlijn; de Leeuw, Frank-Erik; Ginneken, Bram van; Marchiori, Elena; Platel, Bram

2017-01-01

Lacunes of presumed vascular origin (lacunes) are associated with an increased risk of stroke, gait impairment, and dementia and are a primary imaging feature of the small vessel disease. Quantification of lacunes may be of great importance to elucidate the mechanisms behind neuro-degenerative disorders and is recommended as part of study standards for small vessel disease research. However, due to the different appearance of lacunes in various brain regions and the existence of other similar-looking structures, such as perivascular spaces, manual annotation is a difficult, elaborative and subjective task, which can potentially be greatly improved by reliable and consistent computer-aided detection (CAD) routines. In this paper, we propose an automated two-stage method using deep convolutional neural networks (CNN). We show that this method has good performance and can considerably benefit readers. We first use a fully convolutional neural network to detect initial candidates. In the second step, we employ a 3D CNN as a false positive reduction tool. As the location information is important to the analysis of candidate structures, we further equip the network with contextual information using multi-scale analysis and integration of explicit location features. We trained, validated and tested our networks on a large dataset of 1075 cases obtained from two different studies. Subsequently, we conducted an observer study with four trained observers and compared our method with them using a free-response operating characteristic analysis. Shown on a test set of 111 cases, the resulting CAD system exhibits performance similar to the trained human observers and achieves a sensitivity of 0.974 with 0.13 false positives per slice. A feasibility study also showed that a trained human observer would considerably benefit once aided by the CAD system.

Wireless multi-channel single unit recording in freely moving and vocalizing primates

PubMed Central

Roy, Sabyasachi; Wang, Xiaoqin

2011-01-01

The ability to record well-isolated action potentials from individual neurons in naturally behaving animals is crucial for understanding neural mechanisms underlying natural behaviors. Traditional neurophysiology techniques, however, require the animal to be restrained which often restricts natural behavior. An example is the common marmoset (Callithrix jacchus), a highly vocal New World primate species, used in our laboratory to study the neural correlates of vocal production and sensory feedback. When restrained by traditional neurophysiological techniques marmoset vocal behavior is severely inhibited. Tethered recording systems, while proven effective in rodents pose limitations in arboreal animals such as the marmoset that typically roam in a three-dimensional environment. To overcome these obstacles, we have developed a wireless neural recording technique that is capable of collecting single-unit data from chronically implanted multi-electrodes in freely moving marmosets. A lightweight, low power and low noise wireless transmitter (headstage) is attached to a multi-electrode array placed in the premotor cortex of the marmoset. The wireless headstage is capable of transmitting 15 channels of neural data with signal-to-noise ratio (SNR) comparable to a tethered system. To minimize radio-frequency (RF) and electro-magnetic interference (EMI), the experiments were conducted within a custom designed RF/EMI and acoustically shielded chamber. The individual electrodes of the multi-electrode array were periodically advanced to densely sample the cortical layers. We recorded single-unit data over a period of several months from the frontal cortex of two marmosets. These recordings demonstrate the feasibility of using our wireless recording method to study single neuron activity in freely roaming primates. PMID:21933683

Synchronization in neural nets

NASA Technical Reports Server (NTRS)

Vidal, Jacques J.; Haggerty, John

1988-01-01

The paper presents an artificial neural network concept (the Synchronizable Oscillator Networks) where the instants of individual firings in the form of point processes constitute the only form of information transmitted between joining neurons. In the model, neurons fire spontaneously and regularly in the absence of perturbation. When interaction is present, the scheduled firings are advanced or delayed by the firing of neighboring neurons. Networks of such neurons become global oscillators which exhibit multiple synchronizing attractors. From arbitrary initial states, energy minimization learning procedures can make the network converge to oscillatory modes that satisfy multi-dimensional constraints. Such networks can directly represent routing and scheduling problems that consist of ordering sequences of events.

Incremental evolution of the neural crest, neural crest cells and neural crest-derived skeletal tissues

PubMed Central

Hall, Brian K; Gillis, J Andrew

2013-01-01

Urochordates (ascidians) have recently supplanted cephalochordates (amphioxus) as the extant sister taxon of vertebrates. Given that urochordates possess migratory cells that have been classified as ‘neural crest-like’– and that cephalochordates lack such cells – this phylogenetic hypothesis may have significant implications with respect to the origin of the neural crest and neural crest-derived skeletal tissues in vertebrates. We present an overview of the genes and gene regulatory network associated with specification of the neural crest in vertebrates. We then use these molecular data – alongside cell behaviour, cell fate and embryonic context – to assess putative antecedents (latent homologues) of the neural crest or neural crest cells in ascidians and cephalochordates. Ascidian migratory mesenchymal cells – non-pigment-forming trunk lateral line cells and pigment-forming ‘neural crest-like cells’ (NCLC) – are unlikely latent neural crest cell homologues. Rather, Snail-expressing cells at the neural plate of border of urochordates and cephalochordates likely represent the extent of neural crest elaboration in non-vertebrate chordates. We also review evidence for the evolutionary origin of two neural crest-derived skeletal tissues – cartilage and dentine. Dentine is a bona fide vertebrate novelty, and dentine-secreting odontoblasts represent a cell type that is exclusively derived from the neural crest. Cartilage, on the other hand, likely has a much deeper origin within the Metazoa. The mesodermally derived cellular cartilages of some protostome invertebrates are much more similar to vertebrate cartilage than is the acellular ‘cartilage-like’ tissue in cephalochordate pharyngeal arches. Cartilage, therefore, is not a vertebrate novelty, and a well-developed chondrogenic program was most likely co-opted from mesoderm to the neural crest along the vertebrate stem. We conclude that the neural crest is a vertebrate novelty, but that neural

Encapsulating Elastically Stretchable Neural Interfaces: Yield, Resolution, and Recording/Stimulation of Neural Activity

PubMed Central

Morrison, Barclay; Goletiani, Cezar; Yu, Zhe; Wagner, Sigurd

2013-01-01

A high resolution elastically stretchable microelectrode array (SMEA) to interface with neural tissue is described. The SMEA consists of an elastomeric substrate, such as poly(dimethylsiloxane) (PDMS), elastically stretchable gold conductors, and an electrically insulating encapsulating layer in which contact holes are opened. We demonstrate the feasibility of producing contact holes with 40 µm × 40 µm openings, show why the adhesion of the encapsulation layer to the underlying silicone substrate is weakened during contact hole fabrication, and provide remedies. These improvements result in greatly increased fabrication yield and reproducibility. An SMEA with 28 microelectrodes was fabricated. The contact holes (100 µm × 100 µm) in the encapsulation layer are only ~10% the size of the previous generation, allowing a larger number of microelectrodes per unit area, thus affording the capability to interface with a smaller neural population per electrode. This new SMEA is used to record spontaneous and evoked activity in organotypic hippocampal tissue slices at 0% strain before stretching, at 5 % and 10 % equibiaxial strain, and again at 0% strain after relaxation. The noise of the recordings increases with increasing strain. The frequency of spontaneous neural activity also increases when the SMEA is stretched. Upon relaxation, the noise returns to pre-stretch levels, while the frequency of neural activity remains elevated. Stimulus-response curves at each strain level are measured. The SMEA shows excellent biocompatibility for at least two weeks. PMID:24093006

A wireless transmission neural interface system for unconstrained non-human primates.

PubMed

Fernandez-Leon, Jose A; Parajuli, Arun; Franklin, Robert; Sorenson, Michael; Felleman, Daniel J; Hansen, Bryan J; Hu, Ming; Dragoi, Valentin

2015-10-01

Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications. To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from the neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency-shift key-modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3 V batteries for 2 h of operation. We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely moving animals can capture phenomena that are absent in the traditional head-fixed paradigm. We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates, which can potentially move systems neuroscience to a new direction by allowing one to record neural signals while animals interact with their environment.

A wireless transmission neural interface system for unconstrained non-human primates

PubMed Central

Fernandez-Leon, Jose A.; Parajuli, Arun; Franklin, Robert; Sorenson, Michael; Felleman, Daniel J.; Hansen, Bryan J.; Hu, Ming; Dragoi, Valentin

2018-01-01

Objective Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications. Approach To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency shift key modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3-V batteries for 2 hours of operation. Main results We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely-moving animals can capture phenomena that are absent in the traditional head-fixed paradigm. Significance We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates which can potentially move systems neuroscience to a new direction by allowing to record neural signals while animals interact with their environment. PMID

A wireless transmission neural interface system for unconstrained non-human primates

NASA Astrophysics Data System (ADS)

Fernandez-Leon, Jose A.; Parajuli, Arun; Franklin, Robert; Sorenson, Michael; Felleman, Daniel J.; Hansen, Bryan J.; Hu, Ming; Dragoi, Valentin

2015-10-01

Objective. Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications. Approach. To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from the neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency-shift key-modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3 V batteries for 2 h of operation. Main results. We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely moving animals can capture phenomena that are absent in the traditional head-fixed paradigm. Significance. We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates, which can potentially move systems neuroscience to a new direction by allowing one to record neural signals while animals interact with their environment.

Brain tumor segmentation in multi-spectral MRI using convolutional neural networks (CNN).

PubMed

Iqbal, Sajid; Ghani, M Usman; Saba, Tanzila; Rehman, Amjad

2018-04-01

A tumor could be found in any area of the brain and could be of any size, shape, and contrast. There may exist multiple tumors of different types in a human brain at the same time. Accurate tumor area segmentation is considered primary step for treatment of brain tumors. Deep Learning is a set of promising techniques that could provide better results as compared to nondeep learning techniques for segmenting timorous part inside a brain. This article presents a deep convolutional neural network (CNN) to segment brain tumors in MRIs. The proposed network uses BRATS segmentation challenge dataset which is composed of images obtained through four different modalities. Accordingly, we present an extended version of existing network to solve segmentation problem. The network architecture consists of multiple neural network layers connected in sequential order with the feeding of Convolutional feature maps at the peer level. Experimental results on BRATS 2015 benchmark data thus show the usability of the proposed approach and its superiority over the other approaches in this area of research. © 2018 Wiley Periodicals, Inc.

Convergence analysis of sliding mode trajectories in multi-objective neural networks learning.

PubMed

Costa, Marcelo Azevedo; Braga, Antonio Padua; de Menezes, Benjamin Rodrigues

2012-09-01

The Pareto-optimality concept is used in this paper in order to represent a constrained set of solutions that are able to trade-off the two main objective functions involved in neural networks supervised learning: data-set error and network complexity. The neural network is described as a dynamic system having error and complexity as its state variables and learning is presented as a process of controlling a learning trajectory in the resulting state space. In order to control the trajectories, sliding mode dynamics is imposed to the network. It is shown that arbitrary learning trajectories can be achieved by maintaining the sliding mode gains within their convergence intervals. Formal proofs of convergence conditions are therefore presented. The concept of trajectory learning presented in this paper goes further beyond the selection of a final state in the Pareto set, since it can be reached through different trajectories and states in the trajectory can be assessed individually against an additional objective function. Copyright © 2012 Elsevier Ltd. All rights reserved.

Neural coordination during reach-to-grasp

PubMed Central

Vaidya, Mukta; Kording, Konrad; Saleh, Maryam; Takahashi, Kazutaka

2015-01-01

When reaching to grasp, we coordinate how we preshape the hand with how we move it. To ask how motor cortical neurons participate in this coordination, we examined the interactions between reach- and grasp-related neuronal ensembles while monkeys reached to grasp a variety of different objects in different locations. By describing the dynamics of these two ensembles as trajectories in a low-dimensional state space, we examined their coupling in time. We found evidence for temporal compensation across many different reach-to-grasp conditions such that if one neural trajectory led in time the other tended to catch up, reducing the asynchrony between the trajectories. Granger causality revealed bidirectional interactions between reach and grasp neural trajectories beyond that which could be attributed to the joint kinematics that were consistently stronger in the grasp-to-reach direction. Characterizing cortical coordination dynamics provides a new framework for understanding the functional interactions between neural populations. PMID:26224773

Sub-Volumetric Classification and Visualization of Emphysema Using a Multi-Threshold Method and Neural Network

NASA Astrophysics Data System (ADS)

Tan, Kok Liang; Tanaka, Toshiyuki; Nakamura, Hidetoshi; Shirahata, Toru; Sugiura, Hiroaki

Chronic Obstructive Pulmonary Disease is a disease in which the airways and tiny air sacs (alveoli) inside the lung are partially obstructed or destroyed. Emphysema is what occurs as more and more of the walls between air sacs get destroyed. The goal of this paper is to produce a more practical emphysema-quantification algorithm that has higher correlation with the parameters of pulmonary function tests compared to classical methods. The use of the threshold range from approximately -900 Hounsfield Unit to -990 Hounsfield Unit for extracting emphysema from CT has been reported in many papers. From our experiments, we realize that a threshold which is optimal for a particular CT data set might not be optimal for other CT data sets due to the subtle radiographic variations in the CT images. Consequently, we propose a multi-threshold method that utilizes ten thresholds between and including -900 Hounsfield Unit and -990 Hounsfield Unit for identifying the different potential emphysematous regions in the lung. Subsequently, we divide the lung into eight sub-volumes. From each sub-volume, we calculate the ratio of the voxels with the intensity below a certain threshold. The respective ratios of the voxels below the ten thresholds are employed as the features for classifying the sub-volumes into four emphysema severity classes. Neural network is used as the classifier. The neural network is trained using 80 training sub-volumes. The performance of the classifier is assessed by classifying 248 test sub-volumes of the lung obtained from 31 subjects. Actual diagnoses of the sub-volumes are hand-annotated and consensus-classified by radiologists. The four-class classification accuracy of the proposed method is 89.82%. The sub-volumetric classification results produced in this study encompass not only the information of emphysema severity but also the distribution of emphysema severity from the top to the bottom of the lung. We hypothesize that besides emphysema severity, the

Generation of diverse neural cell types through direct conversion

PubMed Central

Petersen, Gayle F; Strappe, Padraig M

2016-01-01

A characteristic of neurological disorders is the loss of critical populations of cells that the body is unable to replace, thus there has been much interest in identifying methods of generating clinically relevant numbers of cells to replace those that have been damaged or lost. The process of neural direct conversion, in which cells of one lineage are converted into cells of a neural lineage without first inducing pluripotency, shows great potential, with evidence of the generation of a range of functional neural cell types both in vitro and in vivo, through viral and non-viral delivery of exogenous factors, as well as chemical induction methods. Induced neural cells have been proposed as an attractive alternative to neural cells derived from embryonic or induced pluripotent stem cells, with prospective roles in the investigation of neurological disorders, including neurodegenerative disease modelling, drug screening, and cellular replacement for regenerative medicine applications, however further investigations into improving the efficacy and safety of these methods need to be performed before neural direct conversion becomes a clinically viable option. In this review, we describe the generation of diverse neural cell types via direct conversion of somatic cells, with comparison against stem cell-based approaches, as well as discussion of their potential research and clinical applications. PMID:26981169

Near-Death Experiences in a Multi-religious Hospital Population in Sri Lanka.

PubMed

Chandradasa, Miyuru; Wijesinghe, Chamara; Kuruppuarachchi, K A L A; Perera, Mahendra

2017-07-01

Near-death experiences (NDEs) are a wide range of experiences that occur in association with impending death. There are no published studies on NDEs in general hospital populations, and studies have been mainly conducted on critically ill patients. We assessed the prevalence of NDEs and its associations in a multi-religious population in a general hospital in Sri Lanka. A randomised sample of patients admitted to the Colombo North Teaching Hospital was assessed using the Greyson NDE scale and clinical assessment. Out of total 826 participants, NDEs were described by 3%. Compared to the NDE-negative participants, the NDE-positive group had a significantly higher mean for age and a ratio of men. Women reported deeper NDEs. Patients of theistic religions (Christianity, Islam and Hinduism) reported significantly more NDEs compared to patients from the non-theistic religious group (Buddhism). NDE-positive patient group had significantly higher reporting of a feeling 'that they are about to die', the presence of loss of consciousness and a higher percentage of internal medical patients. This is the first time that NDEs are assessed in a general hospital population and NDEs being reported from Sri Lanka. We also note for the first time that persons with theistic religious beliefs reported more NDEs than those with non-theistic religious beliefs. Medical professionals need to be aware of these phenomena to be able to give an empathic hearing to patients who have NDE.

Multi-Sensor Data Fusion Identification for Shearer Cutting Conditions Based on Parallel Quasi-Newton Neural Networks and the Dempster-Shafer Theory

PubMed Central

Si, Lei; Wang, Zhongbin; Liu, Xinhua; Tan, Chao; Xu, Jing; Zheng, Kehong

2015-01-01

In order to efficiently and accurately identify the cutting condition of a shearer, this paper proposed an intelligent multi-sensor data fusion identification method using the parallel quasi-Newton neural network (PQN-NN) and the Dempster-Shafer (DS) theory. The vibration acceleration signals and current signal of six cutting conditions were collected from a self-designed experimental system and some special state features were extracted from the intrinsic mode functions (IMFs) based on the ensemble empirical mode decomposition (EEMD). In the experiment, three classifiers were trained and tested by the selected features of the measured data, and the DS theory was used to combine the identification results of three single classifiers. Furthermore, some comparisons with other methods were carried out. The experimental results indicate that the proposed method performs with higher detection accuracy and credibility than the competing algorithms. Finally, an industrial application example in the fully mechanized coal mining face was demonstrated to specify the effect of the proposed system. PMID:26580620

Multi-Sensor Data Fusion Identification for Shearer Cutting Conditions Based on Parallel Quasi-Newton Neural Networks and the Dempster-Shafer Theory.

PubMed

Si, Lei; Wang, Zhongbin; Liu, Xinhua; Tan, Chao; Xu, Jing; Zheng, Kehong

2015-11-13

In order to efficiently and accurately identify the cutting condition of a shearer, this paper proposed an intelligent multi-sensor data fusion identification method using the parallel quasi-Newton neural network (PQN-NN) and the Dempster-Shafer (DS) theory. The vibration acceleration signals and current signal of six cutting conditions were collected from a self-designed experimental system and some special state features were extracted from the intrinsic mode functions (IMFs) based on the ensemble empirical mode decomposition (EEMD). In the experiment, three classifiers were trained and tested by the selected features of the measured data, and the DS theory was used to combine the identification results of three single classifiers. Furthermore, some comparisons with other methods were carried out. The experimental results indicate that the proposed method performs with higher detection accuracy and credibility than the competing algorithms. Finally, an industrial application example in the fully mechanized coal mining face was demonstrated to specify the effect of the proposed system.

Generating description with multi-feature fusion and saliency maps of image

NASA Astrophysics Data System (ADS)

Liu, Lisha; Ding, Yuxuan; Tian, Chunna; Yuan, Bo

2018-04-01

Generating description for an image can be regard as visual understanding. It is across artificial intelligence, machine learning, natural language processing and many other areas. In this paper, we present a model that generates description for images based on RNN (recurrent neural network) with object attention and multi-feature of images. The deep recurrent neural networks have excellent performance in machine translation, so we use it to generate natural sentence description for images. The proposed method uses single CNN (convolution neural network) that is trained on ImageNet to extract image features. But we think it can not adequately contain the content in images, it may only focus on the object area of image. So we add scene information to image feature using CNN which is trained on Places205. Experiments show that model with multi-feature extracted by two CNNs perform better than which with a single feature. In addition, we make saliency weights on images to emphasize the salient objects in images. We evaluate our model on MSCOCO based on public metrics, and the results show that our model performs better than several state-of-the-art methods.

Conducting Polymers for Neural Prosthetic and Neural Interface Applications

PubMed Central

2015-01-01

Neural interfacing devices are an artificial mechanism for restoring or supplementing the function of the nervous system lost as a result of injury or disease. Conducting polymers (CPs) are gaining significant attention due to their capacity to meet the performance criteria of a number of neuronal therapies including recording and stimulating neural activity, the regeneration of neural tissue and the delivery of bioactive molecules for mediating device-tissue interactions. CPs form a flexible platform technology that enables the development of tailored materials for a range of neuronal diagnostic and treatment therapies. In this review the application of CPs for neural prostheses and other neural interfacing devices are discussed, with a specific focus on neural recording, neural stimulation, neural regeneration, and therapeutic drug delivery. PMID:26414302

Backstepping Design of Adaptive Neural Fault-Tolerant Control for MIMO Nonlinear Systems.

PubMed

Gao, Hui; Song, Yongduan; Wen, Changyun

In this paper, an adaptive controller is developed for a class of multi-input and multioutput nonlinear systems with neural networks (NNs) used as a modeling tool. It is shown that all the signals in the closed-loop system with the proposed adaptive neural controller are globally uniformly bounded for any external input in . In our control design, the upper bound of the NN modeling error and the gains of external disturbance are characterized by unknown upper bounds, which is more rational to establish the stability in the adaptive NN control. Filter-based modification terms are used in the update laws of unknown parameters to improve the transient performance. Finally, fault-tolerant control is developed to accommodate actuator failure. An illustrative example applying the adaptive controller to control a rigid robot arm shows the validation of the proposed controller.In this paper, an adaptive controller is developed for a class of multi-input and multioutput nonlinear systems with neural networks (NNs) used as a modeling tool. It is shown that all the signals in the closed-loop system with the proposed adaptive neural controller are globally uniformly bounded for any external input in . In our control design, the upper bound of the NN modeling error and the gains of external disturbance are characterized by unknown upper bounds, which is more rational to establish the stability in the adaptive NN control. Filter-based modification terms are used in the update laws of unknown parameters to improve the transient performance. Finally, fault-tolerant control is developed to accommodate actuator failure. An illustrative example applying the adaptive controller to control a rigid robot arm shows the validation of the proposed controller.

Review: the role of neural crest cells in the endocrine system.

PubMed

Adams, Meghan Sara; Bronner-Fraser, Marianne

2009-01-01

The neural crest is a pluripotent population of cells that arises at the junction of the neural tube and the dorsal ectoderm. These highly migratory cells form diverse derivatives including neurons and glia of the sensory, sympathetic, and enteric nervous systems, melanocytes, and the bones, cartilage, and connective tissues of the face. The neural crest has long been associated with the endocrine system, although not always correctly. According to current understanding, neural crest cells give rise to the chromaffin cells of the adrenal medulla, chief cells of the extra-adrenal paraganglia, and thyroid C cells. The endocrine tumors that correspond to these cell types are pheochromocytomas, extra-adrenal paragangliomas, and medullary thyroid carcinomas. Although controversies concerning embryological origin appear to have mostly been resolved, questions persist concerning the pathobiology of each tumor type and its basis in neural crest embryology. Here we present a brief history of the work on neural crest development, both in general and in application to the endocrine system. In particular, we present findings related to the plasticity and pluripotency of neural crest cells as well as a discussion of several different neural crest tumors in the endocrine system.

Flexible microelectrode array for interfacing with the surface of neural ganglia

NASA Astrophysics Data System (ADS)

Sperry, Zachariah J.; Na, Kyounghwan; Parizi, Saman S.; Chiel, Hillel J.; Seymour, John; Yoon, Euisik; Bruns, Tim M.

2018-06-01

Objective. The dorsal root ganglia (DRG) are promising nerve structures for sensory neural interfaces because they provide centralized access to primary afferent cell bodies and spinal reflex circuitry. In order to harness this potential, new electrode technologies are needed which take advantage of the unique properties of DRG, specifically the high density of neural cell bodies at the dorsal surface. Here we report initial in vivo results from the development of a flexible non-penetrating polyimide electrode array interfacing with the surface of ganglia. Approach. Multiple layouts of a 64-channel iridium electrode (420 µm2) array were tested, with pitch as small as 25 µm. The buccal ganglia of invertebrate sea slug Aplysia californica were used to develop handling and recording techniques with ganglionic surface electrode arrays (GSEAs). We also demonstrated the GSEA’s capability to record single- and multi-unit activity from feline lumbosacral DRG related to a variety of sensory inputs, including cutaneous brushing, joint flexion, and bladder pressure. Main results. We recorded action potentials from a variety of Aplysia neurons activated by nerve stimulation, and units were observed firing simultaneously on closely spaced electrode sites. We also recorded single- and multi-unit activity associated with sensory inputs from feline DRG. We utilized spatial oversampling of action potentials on closely-spaced electrode sites to estimate the location of neural sources at between 25 µm and 107 µm below the DRG surface. We also used the high spatial sampling to demonstrate a possible spatial sensory map of one feline’s DRG. We obtained activation of sensory fibers with low-amplitude stimulation through individual or groups of GSEA electrode sites. Significance. Overall, the GSEA has been shown to provide a variety of information types from ganglia neurons and to have significant potential as a tool for neural mapping and interfacing.

The Impact Analysis of Psychological Reliability of Population Pilot Study for Selection of Particular Reliable Multi-Choice Item Test in Foreign Language Research Work

ERIC Educational Resources Information Center

Fazeli, Seyed Hossein

2010-01-01

The purpose of research described in the current study is the psychological reliability, its importance, application, and more to investigate on the impact analysis of psychological reliability of population pilot study for selection of particular reliable multi-choice item test in foreign language research work. The population for subject…

Perceptual suppression revealed by adaptive multi-scale entropy analysis of local field potential in monkey visual cortex.

PubMed

Hu, Meng; Liang, Hualou

2013-04-01

Generalized flash suppression (GFS), in which a salient visual stimulus can be rendered invisible despite continuous retinal input, provides a rare opportunity to directly study the neural mechanism of visual perception. Previous work based on linear methods, such as spectral analysis, on local field potential (LFP) during GFS has shown that the LFP power at distinctive frequency bands are differentially modulated by perceptual suppression. Yet, the linear method alone may be insufficient for the full assessment of neural dynamic due to the fundamentally nonlinear nature of neural signals. In this study, we set forth to analyze the LFP data collected from multiple visual areas in V1, V2 and V4 of macaque monkeys while performing the GFS task using a nonlinear method - adaptive multi-scale entropy (AME) - to reveal the neural dynamic of perceptual suppression. In addition, we propose a new cross-entropy measure at multiple scales, namely adaptive multi-scale cross-entropy (AMCE), to assess the nonlinear functional connectivity between two cortical areas. We show that: (1) multi-scale entropy exhibits percept-related changes in all three areas, with higher entropy observed during perceptual suppression; (2) the magnitude of the perception-related entropy changes increases systematically over successive hierarchical stages (i.e. from lower areas V1 to V2, up to higher area V4); and (3) cross-entropy between any two cortical areas reveals higher degree of asynchrony or dissimilarity during perceptual suppression, indicating a decreased functional connectivity between cortical areas. These results, taken together, suggest that perceptual suppression is related to a reduced functional connectivity and increased uncertainty of neural responses, and the modulation of perceptual suppression is more effective at higher visual cortical areas. AME is demonstrated to be a useful technique in revealing the underlying dynamic of nonlinear/nonstationary neural signal.

Deconstruction of a neural circuit for hunger.

PubMed

Atasoy, Deniz; Betley, J Nicholas; Su, Helen H; Sternson, Scott M

2012-08-09

Hunger is a complex behavioural state that elicits intense food seeking and consumption. These behaviours are rapidly recapitulated by activation of starvation-sensitive AGRP neurons, which present an entry point for reverse-engineering neural circuits for hunger. Here we mapped synaptic interactions of AGRP neurons with multiple cell populations in mice and probed the contribution of these distinct circuits to feeding behaviour using optogenetic and pharmacogenetic techniques. An inhibitory circuit with paraventricular hypothalamus (PVH) neurons substantially accounted for acute AGRP neuron-evoked eating, whereas two other prominent circuits were insufficient. Within the PVH, we found that AGRP neurons target and inhibit oxytocin neurons, a small population that is selectively lost in Prader-Willi syndrome, a condition involving insatiable hunger. By developing strategies for evaluating molecularly defined circuits, we show that AGRP neuron suppression of oxytocin neurons is critical for evoked feeding. These experiments reveal a new neural circuit that regulates hunger state and pathways associated with overeating disorders.

Deconstruction of a neural circuit for hunger

PubMed Central

Atasoy, Deniz; Betley, J. Nicholas; Su, Helen H.; Sternson, Scott M.

2012-01-01

Hunger is a complex behavioural state that elicits intense food seeking and consumption. These behaviours are rapidly recapitulated by activation of starvation-sensitive AGRP neurons, which present an entry point for reverse-engineering neural circuits for hunger. We mapped synaptic interactions of AGRP neurons with multiple cell populations and probed the contribution of these distinct circuits to feeding behaviour using optogenetic and pharmacogenetic techniques. An inhibitory circuit with paraventricular hypothalamus (PVH) neurons substantially accounted for acute AGRP neuron-evoked eating, whereas two other prominent circuits were insufficient. Within the PVH, we found that AGRP neurons target and inhibit oxytocin neurons, a small population that is selectively lost in Prader-Willi syndrome, a condition involving insatiable hunger. By developing strategies for evaluating molecularly-defined circuits, we show that AGRP neuron suppression of oxytocin neurons is critical for evoked feeding. These experiments reveal a new neural circuit that regulates hunger state and pathways associated with overeating disorders. PMID:22801496

A neural network device for on-line particle identification in cosmic ray experiments

NASA Astrophysics Data System (ADS)

Scrimaglio, R.; Finetti, N.; D'Altorio, L.; Rantucci, E.; Raso, M.; Segreto, E.; Tassoni, A.; Cardarilli, G. C.

2004-05-01

On-line particle identification is one of the main goals of many experiments in space both for rare event studies and for optimizing measurements along the orbital trajectory. Neural networks can be a useful tool for signal processing and real time data analysis in such experiments. In this document we report on the performances of a programmable neural device which was developed in VLSI analog/digital technology. Neurons and synapses were accomplished by making use of Operational Transconductance Amplifier (OTA) structures. In this paper we report on the results of measurements performed in order to verify the agreement of the characteristic curves of each elementary cell with simulations and on the device performances obtained by implementing simple neural structures on the VLSI chip. A feed-forward neural network (Multi-Layer Perceptron, MLP) was implemented on the VLSI chip and trained to identify particles by processing the signals of two-dimensional position-sensitive Si detectors. The radiation monitoring device consisted of three double-sided silicon strip detectors. From the analysis of a set of simulated data it was found that the MLP implemented on the neural device gave results comparable with those obtained with the standard method of analysis confirming that the implemented neural network could be employed for real time particle identification.

Modelling collective cell migration of neural crest

PubMed Central

Szabó, András; Mayor, Roberto

2016-01-01

Collective cell migration has emerged in the recent decade as an important phenomenon in cell and developmental biology and can be defined as the coordinated and cooperative movement of groups of cells. Most studies concentrate on tightly connected epithelial tissues, even though collective migration does not require a constant physical contact. Movement of mesenchymal cells is more independent, making their emergent collective behaviour less intuitive and therefore lending importance to computational modelling. Here we focus on such modelling efforts that aim to understand the collective migration of neural crest cells, a mesenchymal embryonic population that migrates large distances as a group during early vertebrate development. By comparing different models of neural crest migration, we emphasize the similarity and complementary nature of these approaches and suggest a future direction for the field. The principles derived from neural crest modelling could aid understanding the collective migration of other mesenchymal cell types. PMID:27085004

[Application of artificial neural networks on the prediction of surface ozone concentrations].

PubMed

Shen, Lu-Lu; Wang, Yu-Xuan; Duan, Lei

2011-08-01

Ozone is an important secondary air pollutant in the lower atmosphere. In order to predict the hourly maximum ozone one day in advance based on the meteorological variables for the Wanqingsha site in Guangzhou, Guangdong province, a neural network model (Multi-Layer Perceptron) and a multiple linear regression model were used and compared. Model inputs are meteorological parameters (wind speed, wind direction, air temperature, relative humidity, barometric pressure and solar radiation) of the next day and hourly maximum ozone concentration of the previous day. The OBS (optimal brain surgeon) was adopted to prune the neutral work, to reduce its complexity and to improve its generalization ability. We find that the pruned neural network has the capacity to predict the peak ozone, with an agreement index of 92.3%, the root mean square error of 0.0428 mg/m3, the R-square of 0.737 and the success index of threshold exceedance 77.0% (the threshold O3 mixing ratio of 0.20 mg/m3). When the neural classifier was added to the neural network model, the success index of threshold exceedance increased to 83.6%. Through comparison of the performance indices between the multiple linear regression model and the neural network model, we conclud that that neural network is a better choice to predict peak ozone from meteorological forecast, which may be applied to practical prediction of ozone concentration.

Influence of neural adaptation on dynamics and equilibrium state of neural activities in a ring neural network

NASA Astrophysics Data System (ADS)

Takiyama, Ken

2017-12-01

How neural adaptation affects neural information processing (i.e. the dynamics and equilibrium state of neural activities) is a central question in computational neuroscience. In my previous works, I analytically clarified the dynamics and equilibrium state of neural activities in a ring-type neural network model that is widely used to model the visual cortex, motor cortex, and several other brain regions. The neural dynamics and the equilibrium state in the neural network model corresponded to a Bayesian computation and statistically optimal multiple information integration, respectively, under a biologically inspired condition. These results were revealed in an analytically tractable manner; however, adaptation effects were not considered. Here, I analytically reveal how the dynamics and equilibrium state of neural activities in a ring neural network are influenced by spike-frequency adaptation (SFA). SFA is an adaptation that causes gradual inhibition of neural activity when a sustained stimulus is applied, and the strength of this inhibition depends on neural activities. I reveal that SFA plays three roles: (1) SFA amplifies the influence of external input in neural dynamics; (2) SFA allows the history of the external input to affect neural dynamics; and (3) the equilibrium state corresponds to the statistically optimal multiple information integration independent of the existence of SFA. In addition, the equilibrium state in a ring neural network model corresponds to the statistically optimal integration of multiple information sources under biologically inspired conditions, independent of the existence of SFA.

Real-Time Identification of Smoldering and Flaming Combustion Phases in Forest Using a Wireless Sensor Network-Based Multi-Sensor System and Artificial Neural Network.

PubMed

Yan, Xiaofei; Cheng, Hong; Zhao, Yandong; Yu, Wenhua; Huang, Huan; Zheng, Xiaoliang

2016-08-04

Diverse sensing techniques have been developed and combined with machine learning method for forest fire detection, but none of them referred to identifying smoldering and flaming combustion phases. This study attempts to real-time identify different combustion phases using a developed wireless sensor network (WSN)-based multi-sensor system and artificial neural network (ANN). Sensors (CO, CO₂, smoke, air temperature and relative humidity) were integrated into one node of WSN. An experiment was conducted using burning materials from residual of forest to test responses of each node under no, smoldering-dominated and flaming-dominated combustion conditions. The results showed that the five sensors have reasonable responses to artificial forest fire. To reduce cost of the nodes, smoke, CO₂ and temperature sensors were chiefly selected through correlation analysis. For achieving higher identification rate, an ANN model was built and trained with inputs of four sensor groups: smoke; smoke and CO₂; smoke and temperature; smoke, CO₂ and temperature. The model test results showed that multi-sensor input yielded higher predicting accuracy (≥82.5%) than single-sensor input (50.9%-92.5%). Based on these, it is possible to reduce the cost with a relatively high fire identification rate and potential application of the system can be tested in future under real forest condition.

Are great apes able to reason from multi-item samples to populations of food items?

PubMed

Eckert, Johanna; Rakoczy, Hannes; Call, Josep

2017-10-01

Inductive learning from limited observations is a cognitive capacity of fundamental importance. In humans, it is underwritten by our intuitive statistics, the ability to draw systematic inferences from populations to randomly drawn samples and vice versa. According to recent research in cognitive development, human intuitive statistics develops early in infancy. Recent work in comparative psychology has produced first evidence for analogous cognitive capacities in great apes who flexibly drew inferences from populations to samples. In the present study, we investigated whether great apes (Pongo abelii, Pan troglodytes, Pan paniscus, Gorilla gorilla) also draw inductive inferences in the opposite direction, from samples to populations. In two experiments, apes saw an experimenter randomly drawing one multi-item sample from each of two populations of food items. The populations differed in their proportion of preferred to neutral items (24:6 vs. 6:24) but apes saw only the distribution of food items in the samples that reflected the distribution of the respective populations (e.g., 4:1 vs. 1:4). Based on this observation they were then allowed to choose between the two populations. Results show that apes seemed to make inferences from samples to populations and thus chose the population from which the more favorable (4:1) sample was drawn in Experiment 1. In this experiment, the more attractive sample not only contained proportionally but also absolutely more preferred food items than the less attractive sample. Experiment 2, however, revealed that when absolute and relative frequencies were disentangled, apes performed at chance level. Whether these limitations in apes' performance reflect true limits of cognitive competence or merely performance limitations due to accessory task demands is still an open question. © 2017 Wiley Periodicals, Inc.

A novel application of artificial neural network for wind speed estimation

NASA Astrophysics Data System (ADS)

Fang, Da; Wang, Jianzhou

2017-05-01

Providing accurate multi-steps wind speed estimation models has increasing significance, because of the important technical and economic impacts of wind speed on power grid security and environment benefits. In this study, the combined strategies for wind speed forecasting are proposed based on an intelligent data processing system using artificial neural network (ANN). Generalized regression neural network and Elman neural network are employed to form two hybrid models. The approach employs one of ANN to model the samples achieving data denoising and assimilation and apply the other to predict wind speed using the pre-processed samples. The proposed method is demonstrated in terms of the predicting improvements of the hybrid models compared with single ANN and the typical forecasting method. To give sufficient cases for the study, four observation sites with monthly average wind speed of four given years in Western China were used to test the models. Multiple evaluation methods demonstrated that the proposed method provides a promising alternative technique in monthly average wind speed estimation.

Application of convolutional artificial neural networks to echocardiograms for differentiating congenital heart diseases in a pediatric population

NASA Astrophysics Data System (ADS)

Perrin, Douglas P.; Bueno, Alejandra; Rodriguez, Andrea; Marx, Gerald R.; del Nido, Pedro J.

2017-03-01

In this paper we describe a pilot study, where machine learning methods are used to differentiate between congenital heart diseases. Our approach was to apply convolutional neural networks (CNNs) to echocardiographic images from five different pediatric populations: normal, coarctation of the aorta (CoA), hypoplastic left heart syndrome (HLHS), transposition of the great arteries (TGA), and single ventricle (SV). We used a single network topology that was trained in a pairwise fashion in order to evaluate the potential to differentiate between patient populations. In total we used 59,151 echo frames drawn from 1,666 clinical sequences. Approximately 80% of the data was used for training, and the remainder for validation. Data was split at sequence boundaries to avoid having related images in the training and validation sets. While training was done with echo images/frames, evaluation was performed for both single frame discrimination as well as sequence discrimination (by majority voting). In total 10 networks were generated and evaluated. Unlike other domains where this network topology has been used, in ultrasound there is low visual variation between classes. This work shows the potential for CNNs to be applied to this low-variation domain of medical imaging for disease discrimination.

Regional application of multi-layer artificial neural networks in 3-D ionosphere tomography

NASA Astrophysics Data System (ADS)

Ghaffari Razin, Mir Reza; Voosoghi, Behzad

2016-08-01

Tomography is a very cost-effective method to study physical properties of the ionosphere. In this paper, residual minimization training neural network (RMTNN) is used in voxel-based tomography to reconstruct of 3-D ionosphere electron density with high spatial resolution. For numerical experiments, observations collected at 37 GPS stations from Iranian permanent GPS network (IPGN) are used. A smoothed TEC approach was used for absolute STEC recovery. To improve the vertical resolution, empirical orthogonal functions (EOFs) obtained from international reference ionosphere 2012 (IRI-2012) used as object function in training neural network. Ionosonde observations is used for validate reliability of the proposed method. Minimum relative error for RMTNN is 1.64% and maximum relative error is 15.61%. Also root mean square error (RMSE) of 0.17 × 1011 (electrons/m3) is computed for RMTNN which is less than RMSE of IRI2012. The results show that RMTNN has higher accuracy and compiles speed than other ionosphere reconstruction methods.

Vector neural network signal integration for radar application

NASA Astrophysics Data System (ADS)

Bierman, Gregory S.

1994-07-01

The Litton Data Systems Vector Neural Network (VNN) is a unique multi-scan integration algorithm currently in development. The target of interest is a low-flying cruise missile. Current tactical radar cannot detect and track the missile in ground clutter at tactically useful ranges. The VNN solves this problem by integrating the energy from multiple frames to effectively increase the target's signal-to-noise ratio. The implementation plan is addressing the APG-63 radar. Real-time results will be available by March 1994.

Daily Reservoir Inflow Forecasting using Deep Learning with Downscaled Multi-General Circulation Models (GCMs) Platform

NASA Astrophysics Data System (ADS)

Li, D.; Fang, N. Z.

2017-12-01

Dallas-Fort Worth Metroplex (DFW) has a population of over 7 million depending on many water supply reservoirs. The reservoir inflow plays a vital role in water supply decision making process and long-term strategic planning for the region. This paper demonstrates a method of utilizing deep learning algorithms and multi-general circulation model (GCM) platform to forecast reservoir inflow for three reservoirs within the DFW: Eagle Mountain Lake, Lake Benbrook and Lake Arlington. Ensemble empirical mode decomposition was firstly employed to extract the features, which were then represented by the deep belief networks (DBNs). The first 75 years of the historical data (1940 -2015) were used to train the model, while the last 2 years of the data (2016-2017) were used for the model validation. The weights of each DBN gained from the training process were then applied to establish a neural network (NN) that was able to forecast reservoir inflow. Feature predictors used for the forecasting model were generated from weather forecast results of the downscaled multi-GCM platform for the North Texas region. By comparing root mean square error (RMSE) and mean bias error (MBE) with the observed data, the authors found that the deep learning with downscaled multi-GCM platform is an effective approach in the reservoir inflow forecasting.

Joint multiple fully connected convolutional neural network with extreme learning machine for hepatocellular carcinoma nuclei grading.

PubMed

Li, Siqi; Jiang, Huiyan; Pang, Wenbo

2017-05-01

Accurate cell grading of cancerous tissue pathological image is of great importance in medical diagnosis and treatment. This paper proposes a joint multiple fully connected convolutional neural network with extreme learning machine (MFC-CNN-ELM) architecture for hepatocellular carcinoma (HCC) nuclei grading. First, in preprocessing stage, each grayscale image patch with the fixed size is obtained using center-proliferation segmentation (CPS) method and the corresponding labels are marked under the guidance of three pathologists. Next, a multiple fully connected convolutional neural network (MFC-CNN) is designed to extract the multi-form feature vectors of each input image automatically, which considers multi-scale contextual information of deep layer maps sufficiently. After that, a convolutional neural network extreme learning machine (CNN-ELM) model is proposed to grade HCC nuclei. Finally, a back propagation (BP) algorithm, which contains a new up-sample method, is utilized to train MFC-CNN-ELM architecture. The experiment comparison results demonstrate that our proposed MFC-CNN-ELM has superior performance compared with related works for HCC nuclei grading. Meanwhile, external validation using ICPR 2014 HEp-2 cell dataset shows the good generalization of our MFC-CNN-ELM architecture. Copyright © 2017 Elsevier Ltd. All rights reserved.

Progenitors of the protochordate ocellus as an evolutionary origin of the neural crest

PubMed Central

2013-01-01

The neural crest represents a highly multipotent population of embryonic stem cells found only in vertebrate embryos. Acquisition of the neural crest during the evolution of vertebrates was a great advantage, providing Chordata animals with the first cellular cartilage, bone, dentition, advanced nervous system and other innovations. Today not much is known about the evolutionary origin of neural crest cells. Here we propose a novel scenario in which the neural crest originates from neuroectodermal progenitors of the pigmented ocelli in Amphioxus-like animals. We suggest that because of changes in photoreception needs, these multipotent progenitors of photoreceptors gained the ability to migrate outside of the central nervous system and subsequently started to give rise to neural, glial and pigmented progeny at the periphery. PMID:23575111

Neural dynamics based on the recognition of neural fingerprints

PubMed Central

Carrillo-Medina, José Luis; Latorre, Roberto

2015-01-01

Experimental evidence has revealed the existence of characteristic spiking features in different neural signals, e.g., individual neural signatures identifying the emitter or functional signatures characterizing specific tasks. These neural fingerprints may play a critical role in neural information processing, since they allow receptors to discriminate or contextualize incoming stimuli. This could be a powerful strategy for neural systems that greatly enhances the encoding and processing capacity of these networks. Nevertheless, the study of information processing based on the identification of specific neural fingerprints has attracted little attention. In this work, we study (i) the emerging collective dynamics of a network of neurons that communicate with each other by exchange of neural fingerprints and (ii) the influence of the network topology on the self-organizing properties within the network. Complex collective dynamics emerge in the network in the presence of stimuli. Predefined inputs, i.e., specific neural fingerprints, are detected and encoded into coexisting patterns of activity that propagate throughout the network with different spatial organization. The patterns evoked by a stimulus can survive after the stimulation is over, which provides memory mechanisms to the network. The results presented in this paper suggest that neural information processing based on neural fingerprints can be a plausible, flexible, and powerful strategy. PMID:25852531

A dynamic neural field model of temporal order judgments.

PubMed

Hecht, Lauren N; Spencer, John P; Vecera, Shaun P

2015-12-01

Temporal ordering of events is biased, or influenced, by perceptual organization-figure-ground organization-and by spatial attention. For example, within a region assigned figural status or at an attended location, onset events are processed earlier (Lester, Hecht, & Vecera, 2009; Shore, Spence, & Klein, 2001), and offset events are processed for longer durations (Hecht & Vecera, 2011; Rolke, Ulrich, & Bausenhart, 2006). Here, we present an extension of a dynamic field model of change detection (Johnson, Spencer, Luck, & Schöner, 2009; Johnson, Spencer, & Schöner, 2009) that accounts for both the onset and offset performance for figural and attended regions. The model posits that neural populations processing the figure are more active, resulting in a peak of activation that quickly builds toward a detection threshold when the onset of a target is presented. This same enhanced activation for some neural populations is maintained when a present target is removed, creating delays in the perception of the target's offset. We discuss the broader implications of this model, including insights regarding how neural activation can be generated in response to the disappearance of information. (c) 2015 APA, all rights reserved).

Computational modeling of spiking neural network with learning rules from STDP and intrinsic plasticity

NASA Astrophysics Data System (ADS)

Li, Xiumin; Wang, Wei; Xue, Fangzheng; Song, Yongduan

2018-02-01

Recently there has been continuously increasing interest in building up computational models of spiking neural networks (SNN), such as the Liquid State Machine (LSM). The biologically inspired self-organized neural networks with neural plasticity can enhance the capability of computational performance, with the characteristic features of dynamical memory and recurrent connection cycles which distinguish them from the more widely used feedforward neural networks. Despite a variety of computational models for brain-like learning and information processing have been proposed, the modeling of self-organized neural networks with multi-neural plasticity is still an important open challenge. The main difficulties lie in the interplay among different forms of neural plasticity rules and understanding how structures and dynamics of neural networks shape the computational performance. In this paper, we propose a novel approach to develop the models of LSM with a biologically inspired self-organizing network based on two neural plasticity learning rules. The connectivity among excitatory neurons is adapted by spike-timing-dependent plasticity (STDP) learning; meanwhile, the degrees of neuronal excitability are regulated to maintain a moderate average activity level by another learning rule: intrinsic plasticity (IP). Our study shows that LSM with STDP+IP performs better than LSM with a random SNN or SNN obtained by STDP alone. The noticeable improvement with the proposed method is due to the better reflected competition among different neurons in the developed SNN model, as well as the more effectively encoded and processed relevant dynamic information with its learning and self-organizing mechanism. This result gives insights to the optimization of computational models of spiking neural networks with neural plasticity.

Homeostatic Scaling of Excitability in Recurrent Neural Networks

PubMed Central

Remme, Michiel W. H.; Wadman, Wytse J.

2012-01-01

Neurons adjust their intrinsic excitability when experiencing a persistent change in synaptic drive. This process can prevent neural activity from moving into either a quiescent state or a saturated state in the face of ongoing plasticity, and is thought to promote stability of the network in which neurons reside. However, most neurons are embedded in recurrent networks, which require a delicate balance between excitation and inhibition to maintain network stability. This balance could be disrupted when neurons independently adjust their intrinsic excitability. Here, we study the functioning of activity-dependent homeostatic scaling of intrinsic excitability (HSE) in a recurrent neural network. Using both simulations of a recurrent network consisting of excitatory and inhibitory neurons that implement HSE, and a mean-field description of adapting excitatory and inhibitory populations, we show that the stability of such adapting networks critically depends on the relationship between the adaptation time scales of both neuron populations. In a stable adapting network, HSE can keep all neurons functioning within their dynamic range, while the network is undergoing several (patho)physiologically relevant types of plasticity, such as persistent changes in external drive, changes in connection strengths, or the loss of inhibitory cells from the network. However, HSE cannot prevent the unstable network dynamics that result when, due to such plasticity, recurrent excitation in the network becomes too strong compared to feedback inhibition. This suggests that keeping a neural network in a stable and functional state requires the coordination of distinct homeostatic mechanisms that operate not only by adjusting neural excitability, but also by controlling network connectivity. PMID:22570604

DataHigh: Graphical user interface for visualizing and interacting with high-dimensional neural activity

PubMed Central

Cowley, Benjamin R.; Kaufman, Matthew T.; Churchland, Mark M.; Ryu, Stephen I.; Shenoy, Krishna V.; Yu, Byron M.

2013-01-01

The activity of tens to hundreds of neurons can be succinctly summarized by a smaller number of latent variables extracted using dimensionality reduction methods. These latent variables define a reduced-dimensional space in which we can study how population activity varies over time, across trials, and across experimental conditions. Ideally, we would like to visualize the population activity directly in the reduced-dimensional space, whose optimal dimensionality (as determined from the data) is typically greater than 3. However, direct plotting can only provide a 2D or 3D view. To address this limitation, we developed a Matlab graphical user interface (GUI) that allows the user to quickly navigate through a continuum of different 2D projections of the reduced-dimensional space. To demonstrate the utility and versatility of this GUI, we applied it to visualize population activity recorded in premotor and motor cortices during reaching tasks. Examples include single-trial population activity recorded using a multi-electrode array, as well as trial-averaged population activity recorded sequentially using single electrodes. Because any single 2D projection may provide a misleading impression of the data, being able to see a large number of 2D projections is critical for intuition- and hypothesis-building during exploratory data analysis. The GUI includes a suite of additional interactive tools, including playing out population activity timecourses as a movie and displaying summary statistics, such as covariance ellipses and average timecourses. The use of visualization tools like the GUI developed here, in tandem with dimensionality reduction methods, has the potential to further our understanding of neural population activity. PMID:23366954

Analysis and Modeling of DIII-D Experiments With OMFIT and Neural Networks

NASA Astrophysics Data System (ADS)

Meneghini, O.; Luna, C.; Smith, S. P.; Lao, L. L.; GA Theory Team

2013-10-01

The OMFIT integrated modeling framework is designed to facilitate experimental data analysis and enable integrated simulations. This talk introduces this framework and presents a selection of its applications to the DIII-D experiment. Examples include kinetic equilibrium reconstruction analysis; evaluation of MHD stability in the core and in the edge; and self-consistent predictive steady-state transport modeling. The OMFIT framework also provides the platform for an innovative approach based on neural networks to predict electron and ion energy fluxes. In our study a multi-layer feed-forward back-propagation neural network is built and trained over a database of DIII-D data. It is found that given the same parameters that the highest fidelity models use, the neural network model is able to predict to a large degree the heat transport profiles observed in the DIII-D experiments. Once the network is built, the numerical cost of evaluating the transport coefficients is virtually nonexistent, thus making the neural network model particularly well suited for plasma control and quick exploration of operational scenarios. The implementation of the neural network model and benchmark with experimental results and gyro-kinetic models will be discussed. Work supported in part by the US DOE under DE-FG02-95ER54309.

Application of Artificial Neural Network to Predict the use of Runway at Juanda International Airport

NASA Astrophysics Data System (ADS)

Putra, J. C. P.; Safrilah

2017-06-01

Artificial neural network approaches are useful to solve many complicated problems. It solves a number of problems in various areas such as engineering, medicine, business, manufacturing, etc. This paper presents an application of artificial neural network to predict a runway capacity at Juanda International Airport. An artificial neural network model of backpropagation and multi-layer perceptron is adopted to this research to learning process of runway capacity at Juanda International Airport. The results indicate that the training data is successfully recognizing the certain pattern of runway use at Juanda International Airport. Whereas, testing data indicate vice versa. Finally, it can be concluded that the approach of uniformity data and network architecture is the critical part to determine the accuracy of prediction results.

Pathobiology and genetics of neural tube defects.

PubMed

Finnell, Richard H; Gould, Amy; Spiegelstein, Ofer

2003-01-01

Neural tube defects (NTDs), including spina bifida and anencephaly, are common congenital malformations that occur when the neural tube fails to achieve proper closure during early embryogenesis. Based on epidemiological and clinical data obtained over the last few decades, it is apparent that these multifactorial defects have a significant genetic component to their etiology that interacts with specific environmental risk factors. The purpose of this review article is to synthesize the existing literature on the genetic factors contributing to NTD risk. To date, there is evidence that closure of the mammalian neural tube initiates and fuses intermittently at four discrete locations. Disruption of this process at any of these four sites may lead to an NTD, possibly arising through closure site-specific genetic mechanisms. Candidate genes involved in neural tube closure include genes of the folate metabolic pathway, as well as those involved in folate transport. Although extensive efforts have focused on elucidating the genetic risk factors contributing to the etiology of NTDs, the population burden for these malformations remains unknown. One group at high risk for having children with NTDs is epileptic women receiving antiepileptic medications during pregnancy. Efforts to better understand the genetic factors that may contribute to their heightened risk, as well as the pathogenesis of neural tube closure defects, are reviewed herein.

Neural Alterations in Acquired Age-Related Hearing Loss

PubMed Central

Mudar, Raksha A.; Husain, Fatima T.

2016-01-01

Hearing loss is one of the most prevalent chronic health conditions in older adults. Growing evidence suggests that hearing loss is associated with reduced cognitive functioning and incident dementia. In this mini-review, we briefly examine literature on anatomical and functional alterations in the brains of adults with acquired age-associated hearing loss, which may underlie the cognitive consequences observed in this population, focusing on studies that have used structural and functional magnetic resonance imaging, diffusion tensor imaging, and event-related electroencephalography. We discuss structural and functional alterations observed in the temporal and frontal cortices and the limbic system. These neural alterations are discussed in the context of common cause, information-degradation, and sensory-deprivation hypotheses, and we suggest possible rehabilitation strategies. Although, we are beginning to learn more about changes in neural architecture and functionality related to age-associated hearing loss, much work remains to be done. Understanding the neural alterations will provide objective markers for early identification of neural consequences of age-associated hearing loss and for evaluating benefits of intervention approaches. PMID:27313556

Generalized Predictive and Neural Generalized Predictive Control of Aerospace Systems

NASA Technical Reports Server (NTRS)

Kelkar, Atul G.

2000-01-01

The research work presented in this thesis addresses the problem of robust control of uncertain linear and nonlinear systems using Neural network-based Generalized Predictive Control (NGPC) methodology. A brief overview of predictive control and its comparison with Linear Quadratic (LQ) control is given to emphasize advantages and drawbacks of predictive control methods. It is shown that the Generalized Predictive Control (GPC) methodology overcomes the drawbacks associated with traditional LQ control as well as conventional predictive control methods. It is shown that in spite of the model-based nature of GPC it has good robustness properties being special case of receding horizon control. The conditions for choosing tuning parameters for GPC to ensure closed-loop stability are derived. A neural network-based GPC architecture is proposed for the control of linear and nonlinear uncertain systems. A methodology to account for parametric uncertainty in the system is proposed using on-line training capability of multi-layer neural network. Several simulation examples and results from real-time experiments are given to demonstrate the effectiveness of the proposed methodology.