The Influence of Temporal Resolution Power and Working Memory Capacity on Psychometric Intelligence

ERIC Educational Resources Information Center

Troche, Stefan J.; Rammsayer, Thomas H.

2009-01-01

According to the temporal resolution power (TRP) hypothesis, higher TRP as reflected by better performance on psychophysical timing tasks accounts for faster speed of information processing and increased efficiency of information processing leading to better performance on tests of psychometric intelligence. An alternative explanation of…

Disambiguating past events: Accurate source memory for time and context depends on different retrieval processes.

PubMed

Persson, Bjorn M; Ainge, James A; O'Connor, Akira R

2016-07-01

Current animal models of episodic memory are usually based on demonstrating integrated memory for what happened, where it happened, and when an event took place. These models aim to capture the testable features of the definition of human episodic memory which stresses the temporal component of the memory as a unique piece of source information that allows us to disambiguate one memory from another. Recently though, it has been suggested that a more accurate model of human episodic memory would include contextual rather than temporal source information, as humans' memory for time is relatively poor. Here, two experiments were carried out investigating human memory for temporal and contextual source information, along with the underlying dual process retrieval processes, using an immersive virtual environment paired with a 'Remember-Know' memory task. Experiment 1 (n=28) showed that contextual information could only be retrieved accurately using recollection, while temporal information could be retrieved using either recollection or familiarity. Experiment 2 (n=24), which used a more difficult task, resulting in reduced item recognition rates and therefore less potential for contamination by ceiling effects, replicated the pattern of results from Experiment 1. Dual process theory predicts that it should only be possible to retrieve source context from an event using recollection, and our results are consistent with this prediction. That temporal information can be retrieved using familiarity alone suggests that it may be incorrect to view temporal context as analogous to other typically used source contexts. This latter finding supports the alternative proposal that time since presentation may simply be reflected in the strength of memory trace at retrieval - a measure ideally suited to trace strength interrogation using familiarity, as is typically conceptualised within the dual process framework. Copyright © 2016 Elsevier Inc. All rights reserved.

Stimulus-response correspondence effect as a function of temporal overlap between relevant and irrelevant information processing.

PubMed

Wang, Dong-Yuan Debbie; Richard, F Dan; Ray, Brittany

2016-01-01

The stimulus-response correspondence (SRC) effect refers to advantages in performance when stimulus and response correspond in dimensions or features, even if the common features are irrelevant to the task. Previous research indicated that the SRC effect depends on the temporal course of stimulus information processing. The current study investigated how the temporal overlap between relevant and irrelevant stimulus processing influences the SRC effect. In this experiment, the irrelevant stimulus (a previously associated tone) preceded the relevant stimulus (a coloured rectangle). The irrelevant and relevant stimuli onset asynchrony was varied to manipulate the temporal overlap between the irrelevant and relevant stimuli processing. Results indicated that the SRC effect size varied as a quadratic function of the temporal overlap between the relevant stimulus and irrelevant stimulus. This finding extends previous experimental observations that the SRC effect size varies in an increasing or decreasing function with reaction time. The current study demonstrated a quadratic function between effect size and the temporal overlap.

Human Performance on the Temporal Bisection Task

ERIC Educational Resources Information Center

Kopec, Charles D.; Brody, Carlos D.

2010-01-01

The perception and processing of temporal information are tasks the brain must continuously perform. These include measuring the duration of stimuli, storing duration information in memory, recalling such memories, and comparing two durations. How the brain accomplishes these tasks, however, is still open for debate. The temporal bisection task,…

Temporal Processing Capacity in High-Level Visual Cortex Is Domain Specific.

PubMed

Stigliani, Anthony; Weiner, Kevin S; Grill-Spector, Kalanit

2015-09-09

Prevailing hierarchical models propose that temporal processing capacity--the amount of information that a brain region processes in a unit time--decreases at higher stages in the ventral stream regardless of domain. However, it is unknown if temporal processing capacities are domain general or domain specific in human high-level visual cortex. Using a novel fMRI paradigm, we measured temporal capacities of functional regions in high-level visual cortex. Contrary to hierarchical models, our data reveal domain-specific processing capacities as follows: (1) regions processing information from different domains have differential temporal capacities within each stage of the visual hierarchy and (2) domain-specific regions display the same temporal capacity regardless of their position in the processing hierarchy. In general, character-selective regions have the lowest capacity, face- and place-selective regions have an intermediate capacity, and body-selective regions have the highest capacity. Notably, domain-specific temporal processing capacities are not apparent in V1 and have perceptual implications. Behavioral testing revealed that the encoding capacity of body images is higher than that of characters, faces, and places, and there is a correspondence between peak encoding rates and cortical capacities for characters and bodies. The present evidence supports a model in which the natural statistics of temporal information in the visual world may affect domain-specific temporal processing and encoding capacities. These findings suggest that the functional organization of high-level visual cortex may be constrained by temporal characteristics of stimuli in the natural world, and this temporal capacity is a characteristic of domain-specific networks in high-level visual cortex. Significance statement: Visual stimuli bombard us at different rates every day. For example, words and scenes are typically stationary and vary at slow rates. In contrast, bodies are dynamic and typically change at faster rates. Using a novel fMRI paradigm, we measured temporal processing capacities of functional regions in human high-level visual cortex. Contrary to prevailing theories, we find that different regions have different processing capacities, which have behavioral implications. In general, character-selective regions have the lowest capacity, face- and place-selective regions have an intermediate capacity, and body-selective regions have the highest capacity. These results suggest that temporal processing capacity is a characteristic of domain-specific networks in high-level visual cortex and contributes to the segregation of cortical regions. Copyright © 2015 the authors 0270-6474/15/3512412-13$15.00/0.

Information Processing Limitations as Revealed by Temporal Discrimination

ERIC Educational Resources Information Center

Lavoie, Philippe; Grondin, Simon

2004-01-01

Information processing limit is a fundamental issue in cognitive psychology. One particular way of studying it is to adopt a temporal span perspective. In this experiment, Weber fractions based on thresholds for duration discrimination are used for adopting this perspective. The results showed that, contrary to the constant predicted by Weber's…

Coding of auditory temporal and pitch information by hippocampal individual cells and cell assemblies in the rat.

PubMed

Sakurai, Y

2002-01-01

This study reports how hippocampal individual cells and cell assemblies cooperate for neural coding of pitch and temporal information in memory processes for auditory stimuli. Each rat performed two tasks, one requiring discrimination of auditory pitch (high or low) and the other requiring discrimination of their duration (long or short). Some CA1 and CA3 complex-spike neurons showed task-related differential activity between the high and low tones in only the pitch-discrimination task. However, without exception, neurons which showed task-related differential activity between the long and short tones in the duration-discrimination task were always task-related neurons in the pitch-discrimination task. These results suggest that temporal information (long or short), in contrast to pitch information (high or low), cannot be coded independently by specific neurons. The results also indicate that the two different behavioral tasks cannot be fully differentiated by the task-related single neurons alone and suggest a model of cell-assembly coding of the tasks. Cross-correlation analysis among activities of simultaneously recorded multiple neurons supported the suggested cell-assembly model.Considering those results, this study concludes that dual coding by hippocampal single neurons and cell assemblies is working in memory processing of pitch and temporal information of auditory stimuli. The single neurons encode both auditory pitches and their temporal lengths and the cell assemblies encode types of tasks (contexts or situations) in which the pitch and the temporal information are processed.

Temporal Processing Ability Is Related to Ear-Asymmetry for Detecting Time Cues in Sound: A Mismatch Negativity (MMN) Study

ERIC Educational Resources Information Center

Todd, Juanita; Finch, Brayden; Smith, Ellen; Budd, Timothy W.; Schall, Ulrich

2011-01-01

Temporal and spectral sound information is processed asymmetrically in the brain with the left-hemisphere showing an advantage for processing the former and the right-hemisphere for the latter. Using monaural sound presentation we demonstrate a context and ability dependent ear-asymmetry in brain measures of temporal change detection. Our measure…

Temporal and Causal Reasoning in Deaf and Hearing Novice Readers

ERIC Educational Resources Information Center

Sullivan, Susan; Oakhill, Jane; Arfé, Barbara; Boureux, Magali

2014-01-01

Temporal and causal information in text are crucial in helping the reader form a coherent representation of a narrative. Deaf novice readers are generally poor at processing linguistic markers of causal/temporal information (i.e., connectives), but what is unclear is whether this is indicative of a more general deficit in reasoning about…

Dynamics of processing invisible faces in the brain: automatic neural encoding of facial expression information.

PubMed

Jiang, Yi; Shannon, Robert W; Vizueta, Nathalie; Bernat, Edward M; Patrick, Christopher J; He, Sheng

2009-02-01

The fusiform face area (FFA) and the superior temporal sulcus (STS) are suggested to process facial identity and facial expression information respectively. We recently demonstrated a functional dissociation between the FFA and the STS as well as correlated sensitivity of the STS and the amygdala to facial expressions using an interocular suppression paradigm [Jiang, Y., He, S., 2006. Cortical responses to invisible faces: dissociating subsystems for facial-information processing. Curr. Biol. 16, 2023-2029.]. In the current event-related brain potential (ERP) study, we investigated the temporal dynamics of facial information processing. Observers viewed neutral, fearful, and scrambled face stimuli, either visibly or rendered invisible through interocular suppression. Relative to scrambled face stimuli, intact visible faces elicited larger positive P1 (110-130 ms) and larger negative N1 or N170 (160-180 ms) potentials at posterior occipital and bilateral occipito-temporal regions respectively, with the N170 amplitude significantly greater for fearful than neutral faces. Invisible intact faces generated a stronger signal than scrambled faces at 140-200 ms over posterior occipital areas whereas invisible fearful faces (compared to neutral and scrambled faces) elicited a significantly larger negative deflection starting at 220 ms along the STS. These results provide further evidence for cortical processing of facial information without awareness and elucidate the temporal sequence of automatic facial expression information extraction.

Temporally selective attention modulates early perceptual processing: event-related potential evidence.

PubMed

Sanders, Lisa D; Astheimer, Lori B

2008-05-01

Some of the most important information we encounter changes so rapidly that our perceptual systems cannot process all of it in detail. Spatially selective attention is critical for perception when more information than can be processed in detail is presented simultaneously at distinct locations. When presented with complex, rapidly changing information, listeners may need to selectively attend to specific times rather than to locations. We present evidence that listeners can direct selective attention to time points that differ by as little as 500 msec, and that doing so improves target detection, affects baseline neural activity preceding stimulus presentation, and modulates auditory evoked potentials at a perceptually early stage. These data demonstrate that attentional modulation of early perceptual processing is temporally precise and that listeners can flexibly allocate temporally selective attention over short intervals, making it a viable mechanism for preferentially processing the most relevant segments in rapidly changing streams.

Inhibition, Reinforcement Sensitivity and Temporal Information Processing in ADHD and ADHD+ODD: Evidence of a Separate Entity?

ERIC Educational Resources Information Center

Luman, Marjolein; van Noesel, Steffen J. P.; Papanikolau, Alky; Van Oostenbruggen-Scheffer, Janneke; Veugelers, Diane; Sergeant, Joseph A.; Oosterlaan, Jaap

2009-01-01

This study compared children with ADHD-only, ADHD+ODD and normal controls (age 8-12) on three key neurocognitive functions: response inhibition, reinforcement sensitivity, and temporal information processing. The goal was twofold: (a) to investigate neurocognitive impairments in children with ADHD-only and children with ADHD+ODD, and (b) to test…

Spatial and temporal order memory in Korsakoff patients.

PubMed

Postma, Albert; Van Asselen, Marieke; Keuper, Olga; Wester, Arie J; Kessels, Roy P C

2006-05-01

This study directly compared how well Korsakoff patients can process spatial and temporal order information in memory under conditions that included presentation of only a single feature (i.e., temporal or spatial information), combined spatiotemporal presentation, and combined spatiotemporal order recall. Korsakoff patients were found to suffer comparable spatial and temporal order recall deficits. Of interest, recall of a single feature was the same when only spatial or temporal information was presented compared to conditions that included combined spatiotemporal, presentation and recall. In contrast, control participants performed worse when they have to recall both spatial and temporal order compared to when they have to recall only one of these features. These findings together indicate that spatial and temporal information are not automatically integrated. Korsakoff patients have profound problems in coding the feature at hand. Moreover, their lower recall of both features at the same time suggests that Korsakoff patients are impaired in binding different contextual attributes together in memory.

Receptive amusia: evidence for cross-hemispheric neural networks underlying music processing strategies.

PubMed

Schuppert, M; Münte, T F; Wieringa, B M; Altenmüller, E

2000-03-01

Perceptual musical functions were investigated in patients suffering from unilateral cerebrovascular cortical lesions. Using MIDI (Musical Instrument Digital Interface) technique, a standardized short test battery was established that covers local (analytical) as well as global perceptual mechanisms. These represent the principal cognitive strategies in melodic and temporal musical information processing (local, interval and rhythm; global, contour and metre). Of the participating brain-damaged patients, a total of 69% presented with post-lesional impairments in music perception. Left-hemisphere-damaged patients showed significant deficits in the discrimination of local as well as global structures in both melodic and temporal information processing. Right-hemisphere-damaged patients also revealed an overall impairment of music perception, reaching significance in the temporal conditions. Detailed analysis outlined a hierarchical organization, with an initial right-hemisphere recognition of contour and metre followed by identification of interval and rhythm via left-hemisphere subsystems. Patterns of dissociated and associated melodic and temporal deficits indicate autonomous, yet partially integrated neural subsystems underlying the processing of melodic and temporal stimuli. In conclusion, these data contradict a strong hemispheric specificity for music perception, but indicate cross-hemisphere, fragmented neural substrates underlying local and global musical information processing in the melodic and temporal dimensions. Due to the diverse profiles of neuropsychological deficits revealed in earlier investigations as well as in this study, individual aspects of musicality and musical behaviour very likely contribute to the definite formation of these widely distributed neural networks.

The Construct of the Multisensory Temporal Binding Window and its Dysregulation in Developmental Disabilities

PubMed Central

Wallace, Mark T.; Stevenson, Ryan A.

2014-01-01

Behavior, perception and cognition are strongly shaped by the synthesis of information across the different sensory modalities. Such multisensory integration often results in performance and perceptual benefits that reflect the additional information conferred by having cues from multiple senses providing redundant or complementary information. The spatial and temporal relationships of these cues provide powerful statistical information about how these cues should be integrated or “bound” in order to create a unified perceptual representation. Much recent work has examined the temporal factors that are integral in multisensory processing, with many focused on the construct of the multisensory temporal binding window – the epoch of time within which stimuli from different modalities is likely to be integrated and perceptually bound. Emerging evidence suggests that this temporal window is altered in a series of neurodevelopmental disorders, including autism, dyslexia and schizophrenia. In addition to their role in sensory processing, these deficits in multisensory temporal function may play an important role in the perceptual and cognitive weaknesses that characterize these clinical disorders. Within this context, focus on improving the acuity of multisensory temporal function may have important implications for the amelioration of the “higher-order” deficits that serve as the defining features of these disorders. PMID:25128432

Expectation, information processing, and subjective duration.

PubMed

Simchy-Gross, Rhimmon; Margulis, Elizabeth Hellmuth

2018-01-01

In research on psychological time, it is important to examine the subjective duration of entire stimulus sequences, such as those produced by music (Teki, Frontiers in Neuroscience, 10, 2016). Yet research on the temporal oddball illusion (according to which oddball stimuli seem longer than standard stimuli of the same duration) has examined only the subjective duration of single events contained within sequences, not the subjective duration of sequences themselves. Does the finding that oddballs seem longer than standards translate to entire sequences, such that entire sequences that contain oddballs seem longer than those that do not? Is this potential translation influenced by the mode of information processing-whether people are engaged in direct or indirect temporal processing? Two experiments aimed to answer both questions using different manipulations of information processing. In both experiments, musical sequences either did or did not contain oddballs (auditory sliding tones). To manipulate information processing, we varied the task (Experiment 1), the sequence event structure (Experiments 1 and 2), and the sequence familiarity (Experiment 2) independently within subjects. Overall, in both experiments, the sequences that contained oddballs seemed shorter than those that did not when people were engaged in direct temporal processing, but longer when people were engaged in indirect temporal processing. These findings support the dual-process contingency model of time estimation (Zakay, Attention, Perception & Psychophysics, 54, 656-664, 1993). Theoretical implications for attention-based and memory-based models of time estimation, the pacemaker accumulator and coding efficiency hypotheses of time perception, and dynamic attending theory are discussed.

Processing temporal agreement in a tenseless language: an ERP study of Mandarin Chinese.

PubMed

Qiu, Yinchen; Zhou, Xiaolin

2012-03-29

Human languages are equipped with an impressive repertoire of time-encoding devices which vary significantly across different cultures. Previous research on temporal processing has focused on morphosyntactic processes in Indo-European languages. This study investigated the neural correlates of temporal processing in Mandarin Chinese, a language that is not morphologically marked for tense. In a sentence acceptability judgment task, we manipulated the agreement between semantically enriched temporal adverbs or a highly grammaticalized aspectual particle (-guo) and temporal noun phrases. Disagreement of both the temporal adverbs and the aspectual particle elicited a centro-parietal P600 effect in event-related potentials (ERPs) whereas only disagreeing temporal adverbs evoked an additional broadly distributed N400 effect. Moreover, a sustained negativity effect was observed on both the words following the critical ones and the last words in sentences with temporal disagreement. These results reveal both commonalities and differences between Chinese and Indo-European languages in temporal agreement processing. In particular, we demonstrate that temporal reference in Chinese relies on both lexical semantics and morphosyntactic processes and that the level of grammaticalization of linguistic devices representing similar temporal information is reflected in differential ERP responses. Copyright © 2012 Elsevier B.V. All rights reserved.

Tomography and Purification of the Temporal-Mode Structure of Quantum Light

NASA Astrophysics Data System (ADS)

Ansari, Vahid; Donohue, John M.; Allgaier, Markus; Sansoni, Linda; Brecht, Benjamin; Roslund, Jonathan; Treps, Nicolas; Harder, Georg; Silberhorn, Christine

2018-05-01

High-dimensional quantum information processing promises capabilities beyond the current state of the art, but addressing individual information-carrying modes presents a significant experimental challenge. Here we demonstrate effective high-dimensional operations in the time-frequency domain of nonclassical light. We generate heralded photons with tailored temporal-mode structures through the pulse shaping of a broadband parametric down-conversion pump. We then implement a quantum pulse gate, enabled by dispersion-engineered sum-frequency generation, to project onto programmable temporal modes, reconstructing the quantum state in seven dimensions. We also manipulate the time-frequency structure by selectively removing temporal modes, explicitly demonstrating the effectiveness of engineered nonlinear processes for the mode-selective manipulation of quantum states.

Distinct Brain Mechanisms Support Spatial vs. Temporal Filtering of Nociceptive Information

PubMed Central

Nahman-Averbuch, H.; Martucci, K.T.; Granovsky, Y.; Weissman-Fogel, I.; Yarnitsky, D.; Coghill, R. C.

2014-01-01

The role of endogenous analgesic mechanisms has largely been viewed in the context of gain modulation during nociceptive processing. However, these analgesic mechanisms may play critical roles in the extraction and subsequent utilization of information related to spatial and temporal features of nociceptive input. To date, it remains unknown if spatial and temporal filtering of nociceptive information is supported by similar analgesic mechanisms. To address this question, human volunteers were recruited to assess brain activation with functional MRI during conditioned pain modulation (CPM) and offset analgesia (OA). CPM provides one paradigm for assessing spatial filtering of nociceptive information while OA provides a paradigm for assessing temporal filtering of nociceptive information. CPM and OA both produced statistically significant reductions in pain intensity. However, the magnitude of pain reduction elicited by CPM was not correlated with that elicited by OA across different individuals. Different patterns of brain activation were consistent with the psychophysical findings. CPM elicited widespread reductions in regions engaged in nociceptive processing such as the thalamus, insula and SII. OA produced reduced activity in SI, but was associated with greater activation in the anterior insula, dorso-lateral prefrontal cortex, intra-parietal sulcus, and inferior parietal lobule relative to CPM. In the brainstem, CPM consistently produced reductions in activity while OA produced increases in activity. Conjunction analysis confirmed that CPM related activity did not overlap with that of OA. Thus, dissociable mechanisms support inhibitory processes engaged during spatial vs. temporal filtering of nociceptive information. PMID:25047783

Elaborative rehearsal of nontemporal information interferes with temporal processing of durations in the range of seconds but not milliseconds.

PubMed

Rammsayer, Thomas; Ulrich, Rolf

2011-05-01

The distinct timing hypothesis suggests a sensory mechanism for processing of durations in the range of milliseconds and a cognitively controlled mechanism for processing of longer durations. To test this hypothesis, we employed a dual-task approach to investigate the effects of maintenance and elaborative rehearsal on temporal processing of brief and long durations. Unlike mere maintenance rehearsal, elaborative rehearsal as a secondary task involved transfer of information from working to long-term memory and elaboration of information to enhance storage in long-term memory. Duration discrimination of brief intervals was not affected by a secondary cognitive task that required either maintenance or elaborative rehearsal. Concurrent elaborative rehearsal, however, impaired discrimination of longer durations as compared to maintenance rehearsal and a control condition with no secondary task. These findings endorse the distinct timing hypothesis and are in line with the notion that executive functions, such as continuous memory updating and active transfer of information into long-term memory interfere with temporal processing of durations in the second, but not in the millisecond range. 2011 Elsevier B.V. All rights reserved.

Functional anatomy of temporal organisation and domain-specificity of episodic memory retrieval.

PubMed

Kwok, Sze Chai; Shallice, Tim; Macaluso, Emiliano

2012-10-01

Episodic memory provides information about the "when" of events as well as "what" and "where" they happened. Using functional imaging, we investigated the domain specificity of retrieval-related processes following encoding of complex, naturalistic events. Subjects watched a 42-min TV episode, and 24h later, made discriminative choices of scenes from the clip during fMRI. Subjects were presented with two scenes and required to either choose the scene that happened earlier in the film (Temporal), or the scene with a correct spatial arrangement (Spatial), or the scene that had been shown (Object). We identified a retrieval network comprising the precuneus, lateral and dorsal parietal cortex, middle frontal and medial temporal areas. The precuneus and angular gyrus are associated with temporal retrieval, with precuneal activity correlating negatively with temporal distance between two happenings at encoding. A dorsal fronto-parietal network engages during spatial retrieval, while antero-medial temporal regions activate during object-related retrieval. We propose that access to episodic memory traces involves different processes depending on task requirements. These include memory-searching within an organised knowledge structure in the precuneus (Temporal task), online maintenance of spatial information in dorsal fronto-parietal cortices (Spatial task) and combining scene-related spatial and non-spatial information in the hippocampus (Object task). Our findings support the proposal of process-specific dissociations of retrieval. Copyright © 2012 Elsevier Ltd. All rights reserved.

Functional anatomy of temporal organisation and domain-specificity of episodic memory retrieval

PubMed Central

Kwok, Sze Chai; Shallice, Tim; Macaluso, Emiliano

2013-01-01

Episodic memory provides information about the “when” of events as well as “what” and “where” they happened. Using functional imaging, we investigated the domain specificity of retrieval-related processes following encoding of complex, naturalistic events. Subjects watched a 42-min TV episode, and 24 h later, made discriminative choices of scenes from the clip during fMRI. Subjects were presented with two scenes and required to either choose the scene that happened earlier in the film (Temporal), or the scene with a correct spatial arrangement (Spatial), or the scene that had been shown (Object). We identified a retrieval network comprising the precuneus, lateral and dorsal parietal cortex, middle frontal and medial temporal areas. The precuneus and angular gyrus are associated with temporal retrieval, with precuneal activity correlating negatively with temporal distance between two happenings at encoding. A dorsal fronto-parietal network engages during spatial retrieval, while antero-medial temporal regions activate during object-related retrieval. We propose that access to episodic memory traces involves different processes depending on task requirements. These include memory-searching within an organised knowledge structure in the precuneus (Temporal task), online maintenance of spatial information in dorsal fronto-parietal cortices (Spatial task) and combining scene-related spatial and non-spatial information in the hippocampus (Object task). Our findings support the proposal of process-specific dissociations of retrieval. PMID:22877840

Neural network for processing both spatial and temporal data with time based back-propagation

NASA Technical Reports Server (NTRS)

Villarreal, James A. (Inventor); Shelton, Robert O. (Inventor)

1993-01-01

Neural networks are computing systems modeled after the paradigm of the biological brain. For years, researchers using various forms of neural networks have attempted to model the brain's information processing and decision-making capabilities. Neural network algorithms have impressively demonstrated the capability of modeling spatial information. On the other hand, the application of parallel distributed models to the processing of temporal data has been severely restricted. The invention introduces a novel technique which adds the dimension of time to the well known back-propagation neural network algorithm. In the space-time neural network disclosed herein, the synaptic weights between two artificial neurons (processing elements) are replaced with an adaptable-adjustable filter. Instead of a single synaptic weight, the invention provides a plurality of weights representing not only association, but also temporal dependencies. In this case, the synaptic weights are the coefficients to the adaptable digital filters. Novelty is believed to lie in the disclosure of a processing element and a network of the processing elements which are capable of processing temporal as well as spacial data.

Spatio-temporal models of mental processes from fMRI.

PubMed

Janoos, Firdaus; Machiraju, Raghu; Singh, Shantanu; Morocz, Istvan Ákos

2011-07-15

Understanding the highly complex, spatially distributed and temporally organized phenomena entailed by mental processes using functional MRI is an important research problem in cognitive and clinical neuroscience. Conventional analysis methods focus on the spatial dimension of the data discarding the information about brain function contained in the temporal dimension. This paper presents a fully spatio-temporal multivariate analysis method using a state-space model (SSM) for brain function that yields not only spatial maps of activity but also its temporal structure along with spatially varying estimates of the hemodynamic response. Efficient algorithms for estimating the parameters along with quantitative validations are given. A novel low-dimensional feature-space for representing the data, based on a formal definition of functional similarity, is derived. Quantitative validation of the model and the estimation algorithms is provided with a simulation study. Using a real fMRI study for mental arithmetic, the ability of this neurophysiologically inspired model to represent the spatio-temporal information corresponding to mental processes is demonstrated. Moreover, by comparing the models across multiple subjects, natural patterns in mental processes organized according to different mental abilities are revealed. Copyright © 2011 Elsevier Inc. All rights reserved.

Formally grounding spatio-temporal thinking.

PubMed

Klippel, Alexander; Wallgrün, Jan Oliver; Yang, Jinlong; Li, Rui; Dylla, Frank

2012-08-01

To navigate through daily life, humans use their ability to conceptualize spatio-temporal information, which ultimately leads to a system of categories. Likewise, the spatial sciences rely heavily on conceptualization and categorization as means to create knowledge when they process spatio-temporal data. In the spatial sciences and in related branches of artificial intelligence, an approach has been developed for processing spatio-temporal data on the level of coarse categories: qualitative spatio-temporal representation and reasoning (QSTR). Calculi developed in QSTR allow for the meaningful processing of and reasoning with spatio-temporal information. While qualitative calculi are widely acknowledged in the cognitive sciences, there is little behavioral assessment whether these calculi are indeed cognitively adequate. This is an astonishing conundrum given that these calculi are ubiquitous, are often intended to improve processes at the human-machine interface, and are on several occasions claimed to be cognitively adequate. We have systematically evaluated several approaches to formally characterize spatial relations from a cognitive-behavioral perspective for both static and dynamically changing spatial relations. This contribution will detail our framework, which is addressing the question how formal characterization of space can help us understand how people think with, in, and about space.

A unified framework for the functional organization of the medial temporal lobes and the phenomenology of episodic memory.

PubMed

Ranganath, Charan

2010-11-01

There is currently an intense debate about the nature of recognition memory and about the roles of medial temporal lobe subregions in recognition memory processes. At a larger level, this debate has been about whether it is appropriate to propose unified theories to explain memory at neural, functional, and phenomenological levels of analysis. Here, I review findings from physiology, functional imaging, and lesion studies in humans, monkeys, and rodents relevant to the roles of medial temporal lobe subregions in recognition memory, as well as in short-term memory and perception. The results from these studies are consistent with the idea that there is functional heterogeneity in the medial temporal lobes, although the differences among medial temporal lobe subregions do not precisely correspond to different types of memory tasks, cognitive processes, or states of awareness. Instead, the evidence is consistent with the idea that medial temporal lobe subregions differ in terms of the kind of information they process and represent, and that these regions collectively support episodic memory by binding item and context information. © 2010 Wiley-Liss, Inc.

Temporal Processing Dysfunction in Schizophrenia

ERIC Educational Resources Information Center

Carroll, Christine A.; Boggs, Jennifer; O'Donnell, Brian F.; Shekhar, Anantha; Hetrick, William P.

2008-01-01

Schizophrenia may be associated with a fundamental disturbance in the temporal coordination of information processing in the brain, leading to classic symptoms of schizophrenia such as thought disorder and disorganized and contextually inappropriate behavior. Despite the growing interest and centrality of time-dependent conceptualizations of the…

Isolating Exogenous and Endogenous Modes of Temporal Attention

ERIC Educational Resources Information Center

Lawrence, Michael A.; Klein, Raymond M.

2013-01-01

The differential allocation of information processing resources over time, here termed "temporal attention," may be achieved by relatively automatic "exogenous" or controlled "endogenous" mechanisms. Over 100 years of research has confounded these theoretically distinct dimensions of temporal attention. The current…

Signal digitizing system and method based on amplitude-to-time optical mapping

DOEpatents

Chou, Jason; Bennett, Corey V; Hernandez, Vince

2015-01-13

A signal digitizing system and method based on analog-to-time optical mapping, optically maps amplitude information of an analog signal of interest first into wavelength information using an amplitude tunable filter (ATF) to impress spectral changes induced by the amplitude of the analog signal onto a carrier signal, i.e. a train of optical pulses, and next from wavelength information to temporal information using a dispersive element so that temporal information representing the amplitude information is encoded in the time domain in the carrier signal. Optical-to-electrical conversion of the optical pulses into voltage waveforms and subsequently digitizing the voltage waveforms into a digital image enables the temporal information to be resolved and quantized in the time domain. The digital image may them be digital signal processed to digitally reconstruct the analog signal based on the temporal information with high fidelity.

Temporal Processing in the Olfactory System: Can We See a Smell?

PubMed Central

Gire, David H.; Restrepo, Diego; Sejnowski, Terrence J.; Greer, Charles; De Carlos, Juan A.; Lopez-Mascaraque, Laura

2013-01-01

Sensory processing circuits in the visual and olfactory systems receive input from complex, rapidly changing environments. Although patterns of light and plumes of odor create different distributions of activity in the retina and olfactory bulb, both structures use what appears on the surface similar temporal coding strategies to convey information to higher areas in the brain. We compare temporal coding in the early stages of the olfactory and visual systems, highlighting recent progress in understanding the role of time in olfactory coding during active sensing by behaving animals. We also examine studies that address the divergent circuit mechanisms that generate temporal codes in the two systems, and find that they provide physiological information directly related to functional questions raised by neuroanatomical studies of Ramon y Cajal over a century ago. Consideration of differences in neural activity in sensory systems contributes to generating new approaches to understand signal processing. PMID:23664611

Temporal interference with frequency-controllable long photons from independent cold atomic sources

NASA Astrophysics Data System (ADS)

Qian, Peng; Gu, Zhenjie; Wen, Rong; Zhang, Weiping; Chen, J. F.

2018-01-01

The interference of single photons from independent sources is an essential tool in quantum information processing. However, the interfering of photons with long temporal states in a time-resolved manner has rarely been studied. This is because without transmitting spectral filters or coupling to a cavity mode single photons generated in traditional nonlinear crystals suffer from a short temporal profile below 1 ns. With spectral correlation maintained in the biphotons generated from spontaneous four-wave mixing process in cold atom clouds, here we demonstrate the temporal interference of two frequency-tunable long photons from two independent cold atomic sources. We observe and analyze the interference of frequency-mismatched photons, where the phenomenon of the quantum beat at megahertz separation is displayed. Our paper provides more details for the quantum beat of two independent narrow-band single photons, which may find potential application in frequency-encoded photonic qubits in quantum information processing.

Distinct brain mechanisms support spatial vs temporal filtering of nociceptive information.

PubMed

Nahman-Averbuch, Hadas; Martucci, Katherine T; Granovsky, Yelena; Weissman-Fogel, Irit; Yarnitsky, David; Coghill, Robert C

2014-12-01

The role of endogenous analgesic mechanisms has largely been viewed in the context of gain modulation during nociceptive processing. However, these analgesic mechanisms may play critical roles in the extraction and subsequent utilization of information related to spatial and temporal features of nociceptive input. To date, it remains unknown if spatial and temporal filtering of nociceptive information is supported by similar analgesic mechanisms. To address this question, human volunteers were recruited to assess brain activation with functional magnetic resonance imaging during conditioned pain modulation (CPM) and offset analgesia (OA). CPM provides one paradigm for assessing spatial filtering of nociceptive information while OA provides a paradigm for assessing temporal filtering of nociceptive information. CPM and OA both produced statistically significant reductions in pain intensity. However, the magnitude of pain reduction elicited by CPM was not correlated with that elicited by OA across different individuals. Different patterns of brain activation were consistent with the psychophysical findings. CPM elicited widespread reductions in regions engaged in nociceptive processing such as the thalamus, insula, and secondary somatosensory cortex. OA produced reduced activity in the primary somatosensory cortex but was associated with greater activation in the anterior insula, dorsolateral prefrontal cortex, intraparietal sulcus, and inferior parietal lobule relative to CPM. In the brain stem, CPM consistently produced reductions in activity, while OA produced increases in activity. Conjunction analysis confirmed that CPM-related activity did not overlap with that of OA. Thus, dissociable mechanisms support inhibitory processes engaged during spatial vs temporal filtering of nociceptive information. Copyright © 2014 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

Processing of speech temporal and spectral information by users of auditory brainstem implants and cochlear implants.

PubMed

Azadpour, Mahan; McKay, Colette M

2014-01-01

Auditory brainstem implants (ABI) use the same processing strategy as was developed for cochlear implants (CI). However, the cochlear nucleus (CN), the stimulation site of ABIs, is anatomically and physiologically more complex than the auditory nerve and consists of neurons with differing roles in auditory processing. The aim of this study was to evaluate the hypotheses that ABI users are less able than CI users to access speech spectro-temporal information delivered by the existing strategies and that the sites stimulated by different locations of CI and ABI electrode arrays differ in encoding of temporal patterns in the stimulation. Six CI users and four ABI users of Nucleus implants with ACE processing strategy participated in this study. Closed-set perception of aCa syllables (16 consonants) and bVd words (11 vowels) was evaluated via experimental processing strategies that activated one, two, or four of the electrodes of the array in a CIS manner as well as subjects' clinical strategies. Three single-channel strategies presented the overall temporal envelope variations of the signal on a single-implant electrode located at the high-, medium-, and low-frequency regions of the array. Implantees' ability to discriminate within electrode temporal patterns of stimulation for phoneme perception and their ability to make use of spectral information presented by increased number of active electrodes were assessed in the single- and multiple-channel strategies, respectively. Overall percentages and information transmission of phonetic features were obtained for each experimental program. Phoneme perception performance of three ABI users was within the range of CI users in most of the experimental strategies and improved as the number of active electrodes increased. One ABI user performed close to chance with all the single and multiple electrode strategies. There was no significant difference between apical, basal, and middle CI electrodes in transmitting speech temporal information, except a trend that the voicing feature was the least transmitted by the basal electrode. A similar electrode-location pattern could be observed in most ABI subjects. Although the number of tested ABI subjects was small, their wide range of phoneme perception performance was consistent with previous reports of overall speech perception in ABI patients. The better-performing ABI user participants had access to speech temporal and spectral information that was comparable to that of average CI user. The poor-performing ABI user did not have access to within-channel speech temporal information and did not benefit from an increased number of spectral channels. The within-subject variability between different ABI electrodes was less than the variability across users in transmission of speech temporal information. The difference in the performance of ABI users could be related to the location of their electrode array on the CN, anatomy, and physiology of their CN or the damage to their auditory brainstem due to tumor or surgery.

An fMRI Study of Episodic Memory: Retrieval of Object, Spatial, and Temporal Information

PubMed Central

Hayes, Scott M.; Ryan, Lee; Schnyer, David M.; Nadel, Lynn

2011-01-01

Sixteen participants viewed a videotaped tour of 4 houses, highlighting a series of objects and their spatial locations. Participants were tested for memory of object, spatial, and temporal order information while undergoing functional Magnetic Resonance Imaging. Preferential activation was observed in right parahippocampal gyrus during the retrieval of spatial location information. Retrieval of contextual information (spatial location and temporal order) was associated with activation in right dorsolateral prefrontal cortex. In bilateral posterior parietal regions, greater activation was associated with processing of visual scenes, regardless of the memory judgment. These findings support current theories positing roles for frontal and medial temporal regions during episodic retrieval and suggest a specific role for the hippocampal complex in the retrieval of spatial location information PMID:15506871

Auditory temporal processing in patients with temporal lobe epilepsy.

PubMed

Lavasani, Azam Navaei; Mohammadkhani, Ghassem; Motamedi, Mahmoud; Karimi, Leyla Jalilvand; Jalaei, Shohreh; Shojaei, Fereshteh Sadat; Danesh, Ali; Azimi, Hadi

2016-07-01

Auditory temporal processing is the main feature of speech processing ability. Patients with temporal lobe epilepsy, despite their normal hearing sensitivity, may present speech recognition disorders. The present study was carried out to evaluate the auditory temporal processing in patients with unilateral TLE. The present study was carried out on 25 patients with epilepsy: 11 patients with right temporal lobe epilepsy and 14 with left temporal lobe epilepsy with a mean age of 31.1years and 18 control participants with a mean age of 29.4years. The two experimental and control groups were evaluated via gap-in-noise and duration pattern sequence tests. One-way ANOVA was run to analyze the data. The mean of the threshold of the GIN test in the control group was observed to be better than that in participants with LTLE and RTLE. Also, it was observed that the percentage of correct responses on the DPS test in the control group and in participants with RTLE was better than that in participants with LTLE. Patients with TLE have difficulties in temporal processing. Difficulties are more significant in patients with LTLE, likely because the left temporal lobe is specialized for the processing of temporal information. Copyright © 2016 Elsevier Inc. All rights reserved.

Time perception impairs sensory-motor integration in Parkinson’s disease

PubMed Central

2013-01-01

It is well known that perception and estimation of time are fundamental for the relationship between humans and their environment. However, this temporal information processing is inefficient in patients with Parkinson’ disease (PD), resulting in temporal judgment deficits. In general, the pathophysiology of PD has been described as a dysfunction in the basal ganglia, which is a multisensory integration station. Thus, a deficit in the sensorimotor integration process could explain many of the Parkinson symptoms, such as changes in time perception. This physiological distortion may be better understood if we analyze the neurobiological model of interval timing, expressed within the conceptual framework of a traditional information-processing model called “Scalar Expectancy Theory”. Therefore, in this review we discuss the pathophysiology and sensorimotor integration process in PD, the theories and neural basic mechanisms involved in temporal processing, and the main clinical findings about the impact of time perception in PD. PMID:24131660

More Than Meets the Eye: The Merging of Perceptual and Conceptual Knowledge in the Anterior Temporal Face Area

PubMed Central

Collins, Jessica A.; Koski, Jessica E.; Olson, Ingrid R.

2016-01-01

An emerging body of research has supported the existence of a small face sensitive region in the ventral anterior temporal lobe (ATL), referred to here as the “anterior temporal face area”. The contribution of this region in the greater face-processing network remains poorly understood. The goal of the present study was to test the relative sensitivity of this region to perceptual as well as conceptual information about people and objects. We contrasted the sensitivity of this region to that of two highly-studied face-sensitive regions, the fusiform face area (FFA) and the occipital face area (OFA), as well as a control region in early visual cortex (EVC). Our findings revealed that multivoxel activity patterns in the anterior temporal face area contain information about facial identity, as well as conceptual attributes such as one’s occupation. The sensitivity of this region to the conceptual attributes of people was greater than that of posterior face processing regions. In addition, the anterior temporal face area overlaps with voxels that contain information about the conceptual attributes of concrete objects, supporting a generalized role of the ventral ATLs in the identification and conceptual processing of multiple stimulus classes. PMID:27199711

Temporal Processing in the Visual Cortex of the Awake and Anesthetized Rat.

PubMed

Aasebø, Ida E J; Lepperød, Mikkel E; Stavrinou, Maria; Nøkkevangen, Sandra; Einevoll, Gaute; Hafting, Torkel; Fyhn, Marianne

2017-01-01

The activity pattern and temporal dynamics within and between neuron ensembles are essential features of information processing and believed to be profoundly affected by anesthesia. Much of our general understanding of sensory information processing, including computational models aimed at mathematically simulating sensory information processing, rely on parameters derived from recordings conducted on animals under anesthesia. Due to the high variety of neuronal subtypes in the brain, population-based estimates of the impact of anesthesia may conceal unit- or ensemble-specific effects of the transition between states. Using chronically implanted tetrodes into primary visual cortex (V1) of rats, we conducted extracellular recordings of single units and followed the same cell ensembles in the awake and anesthetized states. We found that the transition from wakefulness to anesthesia involves unpredictable changes in temporal response characteristics. The latency of single-unit responses to visual stimulation was delayed in anesthesia, with large individual variations between units. Pair-wise correlations between units increased under anesthesia, indicating more synchronized activity. Further, the units within an ensemble show reproducible temporal activity patterns in response to visual stimuli that is changed between states, suggesting state-dependent sequences of activity. The current dataset, with recordings from the same neural ensembles across states, is well suited for validating and testing computational network models. This can lead to testable predictions, bring a deeper understanding of the experimental findings and improve models of neural information processing. Here, we exemplify such a workflow using a Brunel network model.

Temporal Processing in the Visual Cortex of the Awake and Anesthetized Rat

PubMed Central

Aasebø, Ida E. J.; Stavrinou, Maria; Nøkkevangen, Sandra; Einevoll, Gaute

2017-01-01

Abstract The activity pattern and temporal dynamics within and between neuron ensembles are essential features of information processing and believed to be profoundly affected by anesthesia. Much of our general understanding of sensory information processing, including computational models aimed at mathematically simulating sensory information processing, rely on parameters derived from recordings conducted on animals under anesthesia. Due to the high variety of neuronal subtypes in the brain, population-based estimates of the impact of anesthesia may conceal unit- or ensemble-specific effects of the transition between states. Using chronically implanted tetrodes into primary visual cortex (V1) of rats, we conducted extracellular recordings of single units and followed the same cell ensembles in the awake and anesthetized states. We found that the transition from wakefulness to anesthesia involves unpredictable changes in temporal response characteristics. The latency of single-unit responses to visual stimulation was delayed in anesthesia, with large individual variations between units. Pair-wise correlations between units increased under anesthesia, indicating more synchronized activity. Further, the units within an ensemble show reproducible temporal activity patterns in response to visual stimuli that is changed between states, suggesting state-dependent sequences of activity. The current dataset, with recordings from the same neural ensembles across states, is well suited for validating and testing computational network models. This can lead to testable predictions, bring a deeper understanding of the experimental findings and improve models of neural information processing. Here, we exemplify such a workflow using a Brunel network model. PMID:28791331

Hearing shapes our perception of time: temporal discrimination of tactile stimuli in deaf people.

PubMed

Bolognini, Nadia; Cecchetto, Carlo; Geraci, Carlo; Maravita, Angelo; Pascual-Leone, Alvaro; Papagno, Costanza

2012-02-01

Confronted with the loss of one type of sensory input, we compensate using information conveyed by other senses. However, losing one type of sensory information at specific developmental times may lead to deficits across all sensory modalities. We addressed the effect of auditory deprivation on the development of tactile abilities, taking into account changes occurring at the behavioral and cortical level. Congenitally deaf and hearing individuals performed two tactile tasks, the first requiring the discrimination of the temporal duration of touches and the second requiring the discrimination of their spatial length. Compared with hearing individuals, deaf individuals were impaired only in tactile temporal processing. To explore the neural substrate of this difference, we ran a TMS experiment. In deaf individuals, the auditory association cortex was involved in temporal and spatial tactile processing, with the same chronometry as the primary somatosensory cortex. In hearing participants, the involvement of auditory association cortex occurred at a later stage and selectively for temporal discrimination. The different chronometry in the recruitment of the auditory cortex in deaf individuals correlated with the tactile temporal impairment. Thus, early hearing experience seems to be crucial to develop an efficient temporal processing across modalities, suggesting that plasticity does not necessarily result in behavioral compensation.

Congenital amusia: a cognitive disorder limited to resolved harmonics and with no peripheral basis.

PubMed

Cousineau, Marion; Oxenham, Andrew J; Peretz, Isabelle

2015-01-01

Pitch plays a fundamental role in audition, from speech and music perception to auditory scene analysis. Congenital amusia is a neurogenetic disorder that appears to affect primarily pitch and melody perception. Pitch is normally conveyed by the spectro-temporal fine structure of low harmonics, but some pitch information is available in the temporal envelope produced by the interactions of higher harmonics. Using 10 amusic subjects and 10 matched controls, we tested the hypothesis that amusics suffer exclusively from impaired processing of spectro-temporal fine structure. We also tested whether the inability of amusics to process acoustic temporal fine structure extends beyond pitch by measuring sensitivity to interaural time differences, which also rely on temporal fine structure. Further tests were carried out on basic intensity and spectral resolution. As expected, pitch perception based on spectro-temporal fine structure was impaired in amusics; however, no significant deficits were observed in amusics' ability to perceive the pitch conveyed via temporal-envelope cues. Sensitivity to interaural time differences was also not significantly different between the amusic and control groups, ruling out deficits in the peripheral coding of temporal fine structure. Finally, no significant differences in intensity or spectral resolution were found between the amusic and control groups. The results demonstrate a pitch-specific deficit in fine spectro-temporal information processing in amusia that seems unrelated to temporal or spectral coding in the auditory periphery. These results are consistent with the view that there are distinct mechanisms dedicated to processing resolved and unresolved harmonics in the general population, the former being altered in congenital amusia while the latter is spared. Copyright © 2014 Elsevier Ltd. All rights reserved.

Cortical Neural Computation by Discrete Results Hypothesis

PubMed Central

Castejon, Carlos; Nuñez, Angel

2016-01-01

One of the most challenging problems we face in neuroscience is to understand how the cortex performs computations. There is increasing evidence that the power of the cortical processing is produced by populations of neurons forming dynamic neuronal ensembles. Theoretical proposals and multineuronal experimental studies have revealed that ensembles of neurons can form emergent functional units. However, how these ensembles are implicated in cortical computations is still a mystery. Although cell ensembles have been associated with brain rhythms, the functional interaction remains largely unclear. It is still unknown how spatially distributed neuronal activity can be temporally integrated to contribute to cortical computations. A theoretical explanation integrating spatial and temporal aspects of cortical processing is still lacking. In this Hypothesis and Theory article, we propose a new functional theoretical framework to explain the computational roles of these ensembles in cortical processing. We suggest that complex neural computations underlying cortical processing could be temporally discrete and that sensory information would need to be quantized to be computed by the cerebral cortex. Accordingly, we propose that cortical processing is produced by the computation of discrete spatio-temporal functional units that we have called “Discrete Results” (Discrete Results Hypothesis). This hypothesis represents a novel functional mechanism by which information processing is computed in the cortex. Furthermore, we propose that precise dynamic sequences of “Discrete Results” is the mechanism used by the cortex to extract, code, memorize and transmit neural information. The novel “Discrete Results” concept has the ability to match the spatial and temporal aspects of cortical processing. We discuss the possible neural underpinnings of these functional computational units and describe the empirical evidence supporting our hypothesis. We propose that fast-spiking (FS) interneuron may be a key element in our hypothesis providing the basis for this computation. PMID:27807408

Cortical Neural Computation by Discrete Results Hypothesis.

PubMed

Castejon, Carlos; Nuñez, Angel

2016-01-01

One of the most challenging problems we face in neuroscience is to understand how the cortex performs computations. There is increasing evidence that the power of the cortical processing is produced by populations of neurons forming dynamic neuronal ensembles. Theoretical proposals and multineuronal experimental studies have revealed that ensembles of neurons can form emergent functional units. However, how these ensembles are implicated in cortical computations is still a mystery. Although cell ensembles have been associated with brain rhythms, the functional interaction remains largely unclear. It is still unknown how spatially distributed neuronal activity can be temporally integrated to contribute to cortical computations. A theoretical explanation integrating spatial and temporal aspects of cortical processing is still lacking. In this Hypothesis and Theory article, we propose a new functional theoretical framework to explain the computational roles of these ensembles in cortical processing. We suggest that complex neural computations underlying cortical processing could be temporally discrete and that sensory information would need to be quantized to be computed by the cerebral cortex. Accordingly, we propose that cortical processing is produced by the computation of discrete spatio-temporal functional units that we have called "Discrete Results" (Discrete Results Hypothesis). This hypothesis represents a novel functional mechanism by which information processing is computed in the cortex. Furthermore, we propose that precise dynamic sequences of "Discrete Results" is the mechanism used by the cortex to extract, code, memorize and transmit neural information. The novel "Discrete Results" concept has the ability to match the spatial and temporal aspects of cortical processing. We discuss the possible neural underpinnings of these functional computational units and describe the empirical evidence supporting our hypothesis. We propose that fast-spiking (FS) interneuron may be a key element in our hypothesis providing the basis for this computation.

A dissociation between selective attention and conscious awareness in the representation of temporal order information.

PubMed

Eimer, Martin; Grubert, Anna

2015-09-01

Previous electrophysiological studies have shown that attentional selection processes are highly sensitive to the temporal order of task-relevant visual events. When two successively presented colour-defined target stimuli are separated by a stimulus onset asynchrony (SOA) of only 10 ms, the onset latencies of N2pc components to these stimuli (which reflect their attentional selection) precisely match their objective temporal separation. We tested whether such small onset differences are accessible to conscious awareness by instructing participants to report the category (letter or digit) of the first of two target-colour items that were separated by an SOA of 10, 20, or 30 ms. Performance was at chance level for the 10 ms SOA, demonstrating that temporal order information which is available to attentional control processes cannot be utilized for conscious temporal order judgments. These results provide new evidence that selective attention and conscious awareness are functionally separable, and support the hypothesis that attention and awareness operate at different stages of cognitive processing. Copyright © 2015 Elsevier Inc. All rights reserved.

The role of temporal structure in the investigation of sensory memory, auditory scene analysis, and speech perception: a healthy-aging perspective.

PubMed

Rimmele, Johanna Maria; Sussman, Elyse; Poeppel, David

2015-02-01

Listening situations with multiple talkers or background noise are common in everyday communication and are particularly demanding for older adults. Here we review current research on auditory perception in aging individuals in order to gain insights into the challenges of listening under noisy conditions. Informationally rich temporal structure in auditory signals--over a range of time scales from milliseconds to seconds--renders temporal processing central to perception in the auditory domain. We discuss the role of temporal structure in auditory processing, in particular from a perspective relevant for hearing in background noise, and focusing on sensory memory, auditory scene analysis, and speech perception. Interestingly, these auditory processes, usually studied in an independent manner, show considerable overlap of processing time scales, even though each has its own 'privileged' temporal regimes. By integrating perspectives on temporal structure processing in these three areas of investigation, we aim to highlight similarities typically not recognized. Copyright © 2014 Elsevier B.V. All rights reserved.

The role of temporal structure in the investigation of sensory memory, auditory scene analysis, and speech perception: A healthy-aging perspective

PubMed Central

Rimmele, Johanna Maria; Sussman, Elyse; Poeppel, David

2014-01-01

Listening situations with multiple talkers or background noise are common in everyday communication and are particularly demanding for older adults. Here we review current research on auditory perception in aging individuals in order to gain insights into the challenges of listening under noisy conditions. Informationally rich temporal structure in auditory signals - over a range of time scales from milliseconds to seconds - renders temporal processing central to perception in the auditory domain. We discuss the role of temporal structure in auditory processing, in particular from a perspective relevant for hearing in background noise, and focusing on sensory memory, auditory scene analysis, and speech perception. Interestingly, these auditory processes, usually studied in an independent manner, show considerable overlap of processing time scales, even though each has its own ‚privileged‘ temporal regimes. By integrating perspectives on temporal structure processing in these three areas of investigation, we aim to highlight similarities typically not recognized. PMID:24956028

Adaptation to Cognitive Context and Item Information in the Medial Temporal Lobes

ERIC Educational Resources Information Center

Diana, Rachel A.; Yonelinas, Andrew P.; Ranganath, Charan

2012-01-01

The medial temporal lobes (MTL) play an essential role in episodic memory, and accumulating evidence indicates that two MTL subregions--the perirhinal (PRc) and parahippocampal (PHc) cortices--might have different functions. According to the binding of item and context theory ( [16] and [21]), PRc is involved in processing item information, the…

Dynamic Encoding of Face Information in the Human Fusiform Gyrus

PubMed Central

Ghuman, Avniel Singh; Brunet, Nicolas M.; Li, Yuanning; Konecky, Roma O.; Pyles, John A.; Walls, Shawn A.; Destefino, Vincent; Wang, Wei; Richardson, R. Mark

2014-01-01

Humans’ ability to rapidly and accurately detect, identify, and classify faces under variable conditions derives from a network of brain regions highly tuned to face information. The fusiform face area (FFA) is thought to be a computational hub for face processing, however temporal dynamics of face information processing in FFA remains unclear. Here we use multivariate pattern classification to decode the temporal dynamics of expression-invariant face information processing using electrodes placed directly upon FFA in humans. Early FFA activity (50-75 ms) contained information regarding whether participants were viewing a face. Activity between 200-500 ms contained expression-invariant information about which of 70 faces participants were viewing along with the individual differences in facial features and their configurations. Long-lasting (500+ ms) broadband gamma frequency activity predicted task performance. These results elucidate the dynamic computational role FFA plays in multiple face processing stages and indicate what information is used in performing these visual analyses. PMID:25482825

Dynamic encoding of face information in the human fusiform gyrus.

PubMed

Ghuman, Avniel Singh; Brunet, Nicolas M; Li, Yuanning; Konecky, Roma O; Pyles, John A; Walls, Shawn A; Destefino, Vincent; Wang, Wei; Richardson, R Mark

2014-12-08

Humans' ability to rapidly and accurately detect, identify and classify faces under variable conditions derives from a network of brain regions highly tuned to face information. The fusiform face area (FFA) is thought to be a computational hub for face processing; however, temporal dynamics of face information processing in FFA remains unclear. Here we use multivariate pattern classification to decode the temporal dynamics of expression-invariant face information processing using electrodes placed directly on FFA in humans. Early FFA activity (50-75 ms) contained information regarding whether participants were viewing a face. Activity between 200 and 500 ms contained expression-invariant information about which of 70 faces participants were viewing along with the individual differences in facial features and their configurations. Long-lasting (500+ms) broadband gamma frequency activity predicted task performance. These results elucidate the dynamic computational role FFA plays in multiple face processing stages and indicate what information is used in performing these visual analyses.

Effects of sensorineural hearing loss on temporal coding of narrowband and broadband signals in the auditory periphery

PubMed Central

Henry, Kenneth S.; Heinz, Michael G.

2013-01-01

People with sensorineural hearing loss have substantial difficulty understanding speech under degraded listening conditions. Behavioral studies suggest that this difficulty may be caused by changes in auditory processing of the rapidly-varying temporal fine structure (TFS) of acoustic signals. In this paper, we review the presently known effects of sensorineural hearing loss on processing of TFS and slower envelope modulations in the peripheral auditory system of mammals. Cochlear damage has relatively subtle effects on phase locking by auditory-nerve fibers to the temporal structure of narrowband signals under quiet conditions. In background noise, however, sensorineural loss does substantially reduce phase locking to the TFS of pure-tone stimuli. For auditory processing of broadband stimuli, sensorineural hearing loss has been shown to severely alter the neural representation of temporal information along the tonotopic axis of the cochlea. Notably, auditory-nerve fibers innervating the high-frequency part of the cochlea grow increasingly responsive to low-frequency TFS information and less responsive to temporal information near their characteristic frequency (CF). Cochlear damage also increases the correlation of the response to TFS across fibers of varying CF, decreases the traveling-wave delay between TFS responses of fibers with different CFs, and can increase the range of temporal modulation frequencies encoded in the periphery for broadband sounds. Weaker neural coding of temporal structure in background noise and degraded coding of broadband signals along the tonotopic axis of the cochlea are expected to contribute considerably to speech perception problems in people with sensorineural hearing loss. PMID:23376018

Temporal processing asymmetries between the cerebral hemispheres: evidence and implications.

PubMed

Nicholls, M E

1996-07-01

This paper reviews a large body of research which has investigated the capacities of the cerebral hemispheres to process temporal information. This research includes clinical, non-clinical, and electrophysiological experimentation. On the whole, the research supports the notion of a left hemisphere advantage for temporal resolution. The existence of such an asymmetry demonstrates that cerebral lateralisation is not limited to the higher-order functions such as language. The capacity for the resolution of fine temporal events appears to play an important role in other left hemisphere functions which require a rapid sequential processor. The functions that are facilitated by such a processor include verbal, textual, and fine movement skills. The co-development of these functions with an efficient temporal processor can be accounted for with reference to a number of evolutionary scenarios. Physiological evidence favours a temporal processing mechanism located within the left temporal cortex. The function of this mechanism may be described in terms of intermittency or travelling moment models of temporal processing. The travelling moment model provides the most plausible account of the asymmetry.

Abnormal early dynamic individual patterns of functional networks in low gamma band for depression recognition.

PubMed

Bi, Kun; Chattun, Mahammad Ridwan; Liu, Xiaoxue; Wang, Qiang; Tian, Shui; Zhang, Siqi; Lu, Qing; Yao, Zhijian

2018-06-13

The functional networks are associated with emotional processing in depression. The mapping of dynamic spatio-temporal brain networks is used to explore individual performance during early negative emotional processing. However, the dysfunctions of functional networks in low gamma band and their discriminative potentialities during early period of emotional face processing remain to be explored. Functional brain networks were constructed from the MEG recordings of 54 depressed patients and 54 controls in low gamma band (30-48 Hz). Dynamic connectivity regression (DCR) algorithm analyzed the individual change points of time series in response to emotional stimuli and constructed individualized spatio-temporal patterns. The nodal characteristics of patterns were calculated and fed into support vector machine (SVM). Performance of the classification algorithm in low gamma band was validated by dynamic topological characteristics of individual patterns in comparison to alpha and beta band. The best discrimination accuracy of individual spatio-temporal patterns was 91.01% in low gamma band. Individual temporal patterns had better results compared to group-averaged temporal patterns in all bands. The most important discriminative networks included affective network (AN) and fronto-parietal network (FPN) in low gamma band. The sample size is relatively small. High gamma band was not considered. The abnormal dynamic functional networks in low gamma band during early emotion processing enabled depression recognition. The individual information processing is crucial in the discovery of abnormal spatio-temporal patterns in depression during early negative emotional processing. Individual spatio-temporal patterns may reflect the real dynamic function of subjects while group-averaged data may neglect some individual information. Copyright © 2018. Published by Elsevier B.V.

Use of Co-occurrences for Temporal Expressions Annotation

NASA Astrophysics Data System (ADS)

Craveiro, Olga; Macedo, Joaquim; Madeira, Henrique

The annotation or extraction of temporal information from text documents is becoming increasingly important in many natural language processing applications such as text summarization, information retrieval, question answering, etc.. This paper presents an original method for easy recognition of temporal expressions in text documents. The method creates semantically classified temporal patterns, using word co-occurrences obtained from training corpora and a pre-defined seed keywords set, derived from the used language temporal references. A participation on a Portuguese named entity evaluation contest showed promising effectiveness and efficiency results. This approach can be adapted to recognize other type of expressions or languages, within other contexts, by defining the suitable word sets and training corpora.

Auditory Temporal Information Processing in Preschool Children at Family Risk for Dyslexia: Relations with Phonological Abilities and Developing Literacy Skills

ERIC Educational Resources Information Center

Boets, Bart; Wouters, Jan; van Wieringen, Astrid; Ghesquiere, Pol

2006-01-01

In this project, the hypothesis of an auditory temporal processing deficit in dyslexia was tested by examining auditory processing in relation to phonological skills in two contrasting groups of five-year-old preschool children, a familial high risk and a familial low risk group. Participants were individually matched for gender, age, non-verbal…

Temporal grouping effects in musical short-term memory.

PubMed

Gorin, Simon; Mengal, Pierre; Majerus, Steve

2018-07-01

Recent theoretical accounts of verbal and visuo-spatial short-term memory (STM) have proposed the existence of domain-general mechanisms for the maintenance of serial order information. These accounts are based on the observation of similar behavioural effects across several modalities, such as temporal grouping effects. Across two experiments, the present study aimed at extending these findings, by exploring a STM modality that has received little interest so far, STM for musical information. Given its inherent rhythmic, temporal and serial organisation, the musical domain is of interest for investigating serial order STM processes such as temporal grouping. In Experiment 1, the data did not allow to determine the presence or the absence of temporal grouping effects. In Experiment 2, we observed that temporal grouping of tone sequences during encoding improves short-term recognition for serially presented probe tones. Furthermore, the serial position curves included micro-primacy and micro-recency effects, which are the hallmark characteristic of temporal grouping. Our results suggest that the encoding of serial order information in musical STM may be supported by temporal positional coding mechanisms similar to those reported in the verbal domain.

Auditory perception of temporal order in centenarians in comparison with young and elderly subjects.

PubMed

Kołodziejczyk, Iwona; Szelsg, Elzbieta

2008-01-01

Temporal information processing controls many aspects of human mental activity and may be assessed by examining perception of temporal order in the tens of milliseconds time range. Although existing studies suggest an age-related decline in mental abilities, the data on the deterioration of temporal order perception seems inconsistent. Moreover, any evidence on subjects aged over 70 years is lacking. The present experiment aimed to extend the existing data to extremely old people. Temporal order judgment (TOJ) for auditory stimuli was tested across the life span of approx. 80 years, i.e. in young (mean age 22 years) elderly (66 years) and very old (101 years) subjects. Age-related deterioration of performance was observed, with slight changes in elderly subjects and significant deterioration in centenarians which was more distinct in women than in men. The results confirm age-related decrease in temporal resolution which may be explained by slowing of information processing or of a hypothetical internal-timing mechanism. These effects may be influenced by different strategies used in particular age groups.

How can knowledge discovery methods uncover spatio-temporal patterns in environmental data?

NASA Astrophysics Data System (ADS)

Wachowicz, Monica

2000-04-01

This paper proposes the integration of KDD, GVis and STDB as a long-term strategy, which will allow users to apply knowledge discovery methods for uncovering spatio-temporal patterns in environmental data. The main goal is to combine innovative techniques and associated tools for exploring very large environmental data sets in order to arrive at valid, novel, potentially useful, and ultimately understandable spatio-temporal patterns. The GeoInsight approach is described using the principles and key developments in the research domains of KDD, GVis, and STDB. The GeoInsight approach aims at the integration of these research domains in order to provide tools for performing information retrieval, exploration, analysis, and visualization. The result is a knowledge-based design, which involves visual thinking (perceptual-cognitive process) and automated information processing (computer-analytical process).

Designing for Temporal Awareness: The Role of Temporality in Time-Critical Medical Teamwork

PubMed Central

Kusunoki, Diana S.; Sarcevic, Aleksandra

2016-01-01

This paper describes the role of temporal information in emergency medical teamwork and how time-based features can be designed to support the temporal awareness of clinicians in this fast-paced and dynamic environment. Engagement in iterative design activities with clinicians over the course of two years revealed a strong need for time-based features and mechanisms, including timestamps for tasks based on absolute time and automatic stopclocks measuring time by counting up since task performance. We describe in detail the aspects of temporal awareness central to clinicians’ awareness needs and then provide examples of how we addressed these needs through the design of a shared information display. As an outcome of this process, we define four types of time representation techniques to facilitate the design of time-based features: (1) timestamps based on absolute time, (2) timestamps relative to the process start time, (3) time since task performance, and (4) time until the next required task. PMID:27478880

Temporal information entropy of the Blood-Oxygenation Level-Dependent signals increases in the activated human primary visual cortex

NASA Astrophysics Data System (ADS)

DiNuzzo, Mauro; Mascali, Daniele; Moraschi, Marta; Bussu, Giorgia; Maraviglia, Bruno; Mangia, Silvia; Giove, Federico

2017-02-01

Time-domain analysis of blood-oxygenation level-dependent (BOLD) signals allows the identification of clusters of voxels responding to photic stimulation in primary visual cortex (V1). However, the characterization of information encoding into temporal properties of the BOLD signals of an activated cluster is poorly investigated. Here, we used Shannon entropy to determine spatial and temporal information encoding in the BOLD signal within the most strongly activated area of the human visual cortex during a hemifield photic stimulation. We determined the distribution profile of BOLD signals during epochs at rest and under stimulation within small (19-121 voxels) clusters designed to include only voxels driven by the stimulus as highly and uniformly as possible. We found consistent and significant increases (2-4% on average) in temporal information entropy during activation in contralateral but not ipsilateral V1, which was mirrored by an expected loss of spatial information entropy. These opposite changes coexisted with increases in both spatial and temporal mutual information (i.e. dependence) in contralateral V1. Thus, we showed that the first cortical stage of visual processing is characterized by a specific spatiotemporal rearrangement of intracluster BOLD responses. Our results indicate that while in the space domain BOLD maps may be incapable of capturing the functional specialization of small neuronal populations due to relatively low spatial resolution, some information encoding may still be revealed in the temporal domain by an increase of temporal information entropy.

Temporal tuning in the bat auditory cortex is sharper when studied with natural echolocation sequences.

PubMed

Beetz, M Jerome; Hechavarría, Julio C; Kössl, Manfred

2016-06-30

Precise temporal coding is necessary for proper acoustic analysis. However, at cortical level, forward suppression appears to limit the ability of neurons to extract temporal information from natural sound sequences. Here we studied how temporal processing can be maintained in the bats' cortex in the presence of suppression evoked by natural echolocation streams that are relevant to the bats' behavior. We show that cortical neurons tuned to target-distance actually profit from forward suppression induced by natural echolocation sequences. These neurons can more precisely extract target distance information when they are stimulated with natural echolocation sequences than during stimulation with isolated call-echo pairs. We conclude that forward suppression does for time domain tuning what lateral inhibition does for selectivity forms such as auditory frequency tuning and visual orientation tuning. When talking about cortical processing, suppression should be seen as a mechanistic tool rather than a limiting element.

A possible role for a paralemniscal auditory pathway in the coding of slow temporal information

PubMed Central

Abrams, Daniel A.; Nicol, Trent; Zecker, Steven; Kraus, Nina

2010-01-01

Low frequency temporal information present in speech is critical for normal perception, however the neural mechanism underlying the differentiation of slow rates in acoustic signals is not known. Data from the rat trigeminal system suggest that the paralemniscal pathway may be specifically tuned to code low-frequency temporal information. We tested whether this phenomenon occurs in the auditory system by measuring the representation of temporal rate in lemniscal and paralemniscal auditory thalamus and cortex in guinea pig. Similar to the trigeminal system, responses measured in auditory thalamus indicate that slow rates are differentially represented in a paralemniscal pathway. In cortex, both lemniscal and paralemniscal neurons indicated sensitivity to slow rates. We speculate that a paralemniscal pathway in the auditory system may be specifically tuned to code low frequency temporal information present in acoustic signals. These data suggest that somatosensory and auditory modalities have parallel sub-cortical pathways that separately process slow rates and the spatial representation of the sensory periphery. PMID:21094680

The Evaluation of a Temporal Reasoning System in Processing Clinical Discharge Summaries

PubMed Central

Zhou, Li; Parsons, Simon; Hripcsak, George

2008-01-01

Context TimeText is a temporal reasoning system designed to represent, extract, and reason about temporal information in clinical text. Objective To measure the accuracy of the TimeText for processing clinical discharge summaries. Design Six physicians with biomedical informatics training served as domain experts. Twenty discharge summaries were randomly selected for the evaluation. For each of the first 14 reports, 5 to 8 clinically important medical events were chosen. The temporal reasoning system generated temporal relations about the endpoints (start or finish) of pairs of medical events. Two experts (subjects) manually generated temporal relations for these medical events. The system and expert-generated results were assessed by four other experts (raters). All of the twenty discharge summaries were used to assess the system’s accuracy in answering time-oriented clinical questions. For each report, five to ten clinically plausible temporal questions about events were generated. Two experts generated answers to the questions to serve as the gold standard. We wrote queries to retrieve answers from system’s output. Measurements Correctness of generated temporal relations, recall of clinically important relations, and accuracy in answering temporal questions. Results The raters determined that 97% of subjects’ 295 generated temporal relations were correct and that 96.5% of the system’s 995 generated temporal relations were correct. The system captured 79% of 307 temporal relations determined to be clinically important by the subjects and raters. The system answered 84% of the temporal questions correctly. Conclusion The system encoded the majority of information identified by experts, and was able to answer simple temporal questions. PMID:17947618

Spatio-temporal dynamics in the origin of genetic information

NASA Astrophysics Data System (ADS)

Kim, Pan-Jun; Jeong, Hawoong

2005-04-01

We study evolutionary processes induced by spatio-temporal dynamics in prebiotic evolution. Using numerical simulations, we demonstrate that hypercycles emerge from complex interaction structures in multispecies systems. In this work, we also find that ‘hypercycle hybrid’ protects the hypercycle from its environment during the growth process. There is little selective advantage for one hypercycle to maintain coexistence with others. This brings the possibility of the outcompetition between hypercycles resulting in the negative effect on information diversity. To enrich the information in hypercycles, symbiosis with parasites is suggested. It is shown that symbiosis with parasites can play an important role in the prebiotic immunology.

Temporal predictive mechanisms modulate motor reaction time during initiation and inhibition of speech and hand movement.

PubMed

Johari, Karim; Behroozmand, Roozbeh

2017-08-01

Skilled movement is mediated by motor commands executed with extremely fine temporal precision. The question of how the brain incorporates temporal information to perform motor actions has remained unanswered. This study investigated the effect of stimulus temporal predictability on response timing of speech and hand movement. Subjects performed a randomized vowel vocalization or button press task in two counterbalanced blocks in response to temporally-predictable and unpredictable visual cues. Results indicated that speech and hand reaction time was decreased for predictable compared with unpredictable stimuli. This finding suggests that a temporal predictive code is established to capture temporal dynamics of sensory cues in order to produce faster movements in responses to predictable stimuli. In addition, results revealed a main effect of modality, indicating faster hand movement compared with speech. We suggest that this effect is accounted for by the inherent complexity of speech production compared with hand movement. Lastly, we found that movement inhibition was faster than initiation for both hand and speech, suggesting that movement initiation requires a longer processing time to coordinate activities across multiple regions in the brain. These findings provide new insights into the mechanisms of temporal information processing during initiation and inhibition of speech and hand movement. Copyright © 2017 Elsevier B.V. All rights reserved.

The effects of valence and arousal on the neural activity leading to subsequent memory.

PubMed

Mickley Steinmetz, Katherine R; Kensinger, Elizabeth A

2009-11-01

This study examined how valence and arousal affect the processes linked to subsequent memory for emotional information. While undergoing an fMRI scan, participants viewed neutral pictures and emotional pictures varying by valence and arousal. After the scan, participants performed a recognition test. Subsequent memory for negative or high arousal information was associated with occipital and temporal activity, whereas memory for positive or low arousal information was associated with frontal activity. Regression analyses confirmed that for negative or high arousal items, temporal lobe activity was the strongest predictor of later memory whereas for positive or low arousal items, frontal activity corresponded most strongly with later memory. These results suggest that the types of encoding processes relating to memory (e.g., sensory vs. elaborative processing) can differ based on the affective qualities of emotional information.

The effects of valence and arousal on the neural activity leading to subsequent memory

PubMed Central

Mickley Steinmetz, Katherine R.; Kensinger, Elizabeth A.

2010-01-01

This study examined how valence and arousal affect the processes linked to subsequent memory for emotional information. While undergoing an fMRI scan, participants viewed neutral pictures and emotional pictures varying by valence and arousal. After the scan, participants performed a recognition test. Subsequent memory for negative or high arousal information was associated with occipital and temporal activity, while memory for positive or low arousal information was associated with frontal activity. Regression analyses confirmed that for negative or high arousal items, temporal lobe activity was the strongest predictor of later memory whereas for positive or low arousal items, frontal activity corresponded most strongly with later memory. These results suggest that the types of encoding processes relating to memory (e.g., sensory vs. elaborative processing) can differ based on the affective qualities of emotional information. PMID:19674398

Is conscious perception a series of discrete temporal frames?

PubMed

White, Peter A

2018-04-01

This paper reviews proposals that conscious perception consists, in whole or part, of successive discrete temporal frames on the sub-second time scale, each frame containing information registered as simultaneous or static. Although the idea of discrete frames in conscious perception cannot be regarded as falsified, there are many problems. Evidence does not consistently support any proposed duration or range of durations for frames. EEG waveforms provide evidence of periodicity in brain activity, but not necessarily in conscious perception. Temporal properties of perceptual processes are flexible in response to competing processing demands, which is hard to reconcile with the relative inflexibility of regular frames. There are also problems concerning the definition of frames, the need for informational connections between frames, the means by which boundaries between frames are established, and the apparent requirement for a storage buffer for information awaiting entry to the next frame. Copyright © 2018 Elsevier Inc. All rights reserved.

GRASS GIS: The first Open Source Temporal GIS

NASA Astrophysics Data System (ADS)

Gebbert, Sören; Leppelt, Thomas

2015-04-01

GRASS GIS is a full featured, general purpose Open Source geographic information system (GIS) with raster, 3D raster and vector processing support[1]. Recently, time was introduced as a new dimension that transformed GRASS GIS into the first Open Source temporal GIS with comprehensive spatio-temporal analysis, processing and visualization capabilities[2]. New spatio-temporal data types were introduced in GRASS GIS version 7, to manage raster, 3D raster and vector time series. These new data types are called space time datasets. They are designed to efficiently handle hundreds of thousands of time stamped raster, 3D raster and vector map layers of any size. Time stamps can be defined as time intervals or time instances in Gregorian calendar time or relative time. Space time datasets are simplifying the processing and analysis of large time series in GRASS GIS, since these new data types are used as input and output parameter in temporal modules. The handling of space time datasets is therefore equal to the handling of raster, 3D raster and vector map layers in GRASS GIS. A new dedicated Python library, the GRASS GIS Temporal Framework, was designed to implement the spatio-temporal data types and their management. The framework provides the functionality to efficiently handle hundreds of thousands of time stamped map layers and their spatio-temporal topological relations. The framework supports reasoning based on the temporal granularity of space time datasets as well as their temporal topology. It was designed in conjunction with the PyGRASS [3] library to support parallel processing of large datasets, that has a long tradition in GRASS GIS [4,5]. We will present a subset of more than 40 temporal modules that were implemented based on the GRASS GIS Temporal Framework, PyGRASS and the GRASS GIS Python scripting library. These modules provide a comprehensive temporal GIS tool set. The functionality range from space time dataset and time stamped map layer management over temporal aggregation, temporal accumulation, spatio-temporal statistics, spatio-temporal sampling, temporal algebra, temporal topology analysis, time series animation and temporal topology visualization to time series import and export capabilities with support for NetCDF and VTK data formats. We will present several temporal modules that support parallel processing of raster and 3D raster time series. [1] GRASS GIS Open Source Approaches in Spatial Data Handling In Open Source Approaches in Spatial Data Handling, Vol. 2 (2008), pp. 171-199, doi:10.1007/978-3-540-74831-19 by M. Neteler, D. Beaudette, P. Cavallini, L. Lami, J. Cepicky edited by G. Brent Hall, Michael G. Leahy [2] Gebbert, S., Pebesma, E., 2014. A temporal GIS for field based environmental modeling. Environ. Model. Softw. 53, 1-12. [3] Zambelli, P., Gebbert, S., Ciolli, M., 2013. Pygrass: An Object Oriented Python Application Programming Interface (API) for Geographic Resources Analysis Support System (GRASS) Geographic Information System (GIS). ISPRS Intl Journal of Geo-Information 2, 201-219. [4] Löwe, P., Klump, J., Thaler, J. (2012): The FOSS GIS Workbench on the GFZ Load Sharing Facility compute cluster, (Geophysical Research Abstracts Vol. 14, EGU2012-4491, 2012), General Assembly European Geosciences Union (Vienna, Austria 2012). [5] Akhter, S., Aida, K., Chemin, Y., 2010. "GRASS GIS on High Performance Computing with MPI, OpenMP and Ninf-G Programming Framework". ISPRS Conference, Kyoto, 9-12 August 2010

Levels of word processing and incidental memory: dissociable mechanisms in the temporal lobe.

PubMed

Castillo, E M; Simos, P G; Davis, R N; Breier, J; Fitzgerald, M E; Papanicolaou, A C

2001-11-16

Word recall is facilitated when deep (e.g. semantic) processing is applied during encoding. This fact raises the question of the existence of specific brain mechanisms supporting different levels of information processing that can modulate incidental memory performance. In this study we obtained spatiotemporal brain activation profiles, using magnetic source imaging, from 10 adult volunteers as they performed a shallow (phonological) processing task and a deep (semantic) processing task. When phonological analysis of the word stimuli into their constituent phonemes was required, activation was largely restricted to the posterior portion of the left superior temporal gyrus (area 22). Conversely, when access to lexical/semantic representations was required, activation was found predominantly in the left middle temporal gyrus and medial temporal cortex. The differential engagement of each mechanism during word encoding was associated with dramatic changes in subsequent incidental memory performance.

Learning about Spatial and Temporal Scale: Current Research, Psychological Processes, and Classroom Implications

ERIC Educational Resources Information Center

Cheek, Kim A.; LaDue, Nicole D.; Shipley, Thomas F.

2017-01-01

Geoscientists analyze and integrate spatial and temporal information at a range of scales to understand Earth processes. Despite this, the concept of scale is ill defined and taught unevenly across the K-16 continuum. This literature review focuses on two meanings of scale: one as the magnitude of the extent of a dimension and the other as a…

Sound envelope processing in the developing human brain: A MEG study.

PubMed

Tang, Huizhen; Brock, Jon; Johnson, Blake W

2016-02-01

This study investigated auditory cortical processing of linguistically-relevant temporal modulations in the developing brains of young children. Auditory envelope following responses to white noise amplitude modulated at rates of 1-80 Hz in healthy children (aged 3-5 years) and adults were recorded using a paediatric magnetoencephalography (MEG) system and a conventional MEG system, respectively. For children, there were envelope following responses to slow modulations but no significant responses to rates higher than about 25 Hz, whereas adults showed significant envelope following responses to almost the entire range of stimulus rates. Our results show that the auditory cortex of preschool-aged children has a sharply limited capacity to process rapid amplitude modulations in sounds, as compared to the auditory cortex of adults. These neurophysiological results are consistent with previous psychophysical evidence for a protracted maturational time course for auditory temporal processing. The findings are also in good agreement with current linguistic theories that posit a perceptual bias for low frequency temporal information in speech during language acquisition. These insights also have clinical relevance for our understanding of language disorders that are associated with difficulties in processing temporal information in speech. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Temporal allocation of attention toward threat in individuals with posttraumatic stress symptoms.

PubMed

Amir, Nader; Taylor, Charles T; Bomyea, Jessica A; Badour, Christal L

2009-12-01

Research suggests that individuals with posttraumatic stress disorder (PTSD) selectively attend to threat-relevant information. However, little is known about how initial detection of threat influences the processing of subsequently encountered stimuli. To address this issue, we used a rapid serial visual presentation paradigm (RSVP; Raymond, J. E., Shapiro, K. L., & Arnell, K. M. (1992). Temporary suppression of visual processing in an RSVP task: An attentional blink? Journal of Experimental Psychology: Human Perception and Performance, 18, 849-860) to examine temporal allocation of attention to threat-related and neutral stimuli in individuals with PTSD symptoms (PTS), traumatized individuals without PTSD symptoms (TC), and non-anxious controls (NAC). Participants were asked to identify one or two targets in an RSVP stream. Typically processing of the first target decreases accuracy of identifying the second target as a function of the temporal lag between targets. Results revealed that the PTS group was significantly more accurate in detecting a neutral target when it was presented 300 or 500ms after threat-related stimuli compared to when the target followed neutral stimuli. These results suggest that individuals with PTSD may process trauma-relevant information more rapidly and efficiently than benign information.

Memory for Faces Dissociates from Memory for Location Following Anterior Temporal Lobectomy

ERIC Educational Resources Information Center

Chiaravalloti, Nancy D.; Glosser, Guila

2004-01-01

It has been suggested that the right and left mesial temporal lobes are specialized for processing different types of information for long-term memory (LTM). Although findings have been consistent in regard to the dominant role of the left mesial temporal lobe (MTL) in verbal memory, the role of the right MTL in non-verbal memory remains…

Temporally flexible feedback signal to foveal cortex for peripheral object recognition

PubMed Central

Fan, Xiaoxu; Wang, Lan; Shao, Hanyu; Kersten, Daniel; He, Sheng

2016-01-01

Recent studies have shown that information from peripherally presented images is present in the human foveal retinotopic cortex, presumably because of feedback signals. We investigated this potential feedback signal by presenting noise in fovea at different object–noise stimulus onset asynchronies (SOAs), whereas subjects performed a discrimination task on peripheral objects. Results revealed a selective impairment of performance when foveal noise was presented at 250-ms SOA, but only for tasks that required comparing objects’ spatial details, suggesting a task- and stimulus-dependent foveal processing mechanism. Critically, the temporal window of foveal processing was shifted when mental rotation was required for the peripheral objects, indicating that the foveal retinotopic processing is not automatically engaged at a fixed time following peripheral stimulation; rather, it occurs at a stage when detailed information is required. Moreover, fMRI measurements using multivoxel pattern analysis showed that both image and object category-relevant information of peripheral objects was represented in the foveal cortex. Taken together, our results support the hypothesis of a temporally flexible feedback signal to the foveal retinotopic cortex when discriminating objects in the visual periphery. PMID:27671651

Face processing regions are sensitive to distinct aspects of temporal sequence in facial dynamics.

PubMed

Reinl, Maren; Bartels, Andreas

2014-11-15

Facial movement conveys important information for social interactions, yet its neural processing is poorly understood. Computational models propose that shape- and temporal sequence sensitive mechanisms interact in processing dynamic faces. While face processing regions are known to respond to facial movement, their sensitivity to particular temporal sequences has barely been studied. Here we used fMRI to examine the sensitivity of human face-processing regions to two aspects of directionality in facial movement trajectories. We presented genuine movie recordings of increasing and decreasing fear expressions, each of which were played in natural or reversed frame order. This two-by-two factorial design matched low-level visual properties, static content and motion energy within each factor, emotion-direction (increasing or decreasing emotion) and timeline (natural versus artificial). The results showed sensitivity for emotion-direction in FFA, which was timeline-dependent as it only occurred within the natural frame order, and sensitivity to timeline in the STS, which was emotion-direction-dependent as it only occurred for decreased fear. The occipital face area (OFA) was sensitive to the factor timeline. These findings reveal interacting temporal sequence sensitive mechanisms that are responsive to both ecological meaning and to prototypical unfolding of facial dynamics. These mechanisms are temporally directional, provide socially relevant information regarding emotional state or naturalness of behavior, and agree with predictions from modeling and predictive coding theory. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Localized analysis of paint-coat drying using dynamic speckle interferometry

NASA Astrophysics Data System (ADS)

Sierra-Sosa, Daniel; Tebaldi, Myrian; Grumel, Eduardo; Rabal, Hector; Elmaghraby, Adel

2018-07-01

The paint-coating is part of several industrial processes, including the automotive industry, architectural coatings, machinery and appliances. These paint-coatings must comply with high quality standards, for this reason evaluation techniques from paint-coatings are in constant development. One important factor from the paint-coating process is the drying, as it has influence on the quality of final results. In this work we present an assessment technique based on the optical dynamic speckle interferometry, this technique allows for the temporal activity evaluation of the paint-coating drying process, providing localized information from drying. This localized information is relevant in order to address the drying homogeneity, optimal drying, and quality control. The technique relies in the definition of a new temporal history of the speckle patterns to obtain the local activity; this information is then clustered to provide a convenient indicative of different drying process stages. The experimental results presented were validated using the gravimetric drying curves

Decoding the time-course of object recognition in the human brain: From visual features to categorical decisions.

PubMed

Contini, Erika W; Wardle, Susan G; Carlson, Thomas A

2017-10-01

Visual object recognition is a complex, dynamic process. Multivariate pattern analysis methods, such as decoding, have begun to reveal how the brain processes complex visual information. Recently, temporal decoding methods for EEG and MEG have offered the potential to evaluate the temporal dynamics of object recognition. Here we review the contribution of M/EEG time-series decoding methods to understanding visual object recognition in the human brain. Consistent with the current understanding of the visual processing hierarchy, low-level visual features dominate decodable object representations early in the time-course, with more abstract representations related to object category emerging later. A key finding is that the time-course of object processing is highly dynamic and rapidly evolving, with limited temporal generalisation of decodable information. Several studies have examined the emergence of object category structure, and we consider to what degree category decoding can be explained by sensitivity to low-level visual features. Finally, we evaluate recent work attempting to link human behaviour to the neural time-course of object processing. Copyright © 2017 Elsevier Ltd. All rights reserved.

Functionally integrated neural processing of linguistic and talker information: An event-related fMRI and ERP study.

PubMed

Zhang, Caicai; Pugh, Kenneth R; Mencl, W Einar; Molfese, Peter J; Frost, Stephen J; Magnuson, James S; Peng, Gang; Wang, William S-Y

2016-01-01

Speech signals contain information of both linguistic content and a talker's voice. Conventionally, linguistic and talker processing are thought to be mediated by distinct neural systems in the left and right hemispheres respectively, but there is growing evidence that linguistic and talker processing interact in many ways. Previous studies suggest that talker-related vocal tract changes are processed integrally with phonetic changes in the bilateral posterior superior temporal gyrus/superior temporal sulcus (STG/STS), because the vocal tract parameter influences the perception of phonetic information. It is yet unclear whether the bilateral STG is also activated by the integral processing of another parameter - pitch, which influences the perception of lexical tone information and is related to talker differences in tone languages. In this study, we conducted separate functional magnetic resonance imaging (fMRI) and event-related potential (ERP) experiments to examine the spatial and temporal loci of interactions of lexical tone and talker-related pitch processing in Cantonese. We found that the STG was activated bilaterally during the processing of talker changes when listeners attended to lexical tone changes in the stimuli and during the processing of lexical tone changes when listeners attended to talker changes, suggesting that lexical tone and talker processing are functionally integrated in the bilateral STG. It extends the previous study, providing evidence for a general neural mechanism of integral phonetic and talker processing in the bilateral STG. The ERP results show interactions of lexical tone and talker processing 500-800ms after auditory word onset (a simultaneous posterior P3b and a frontal negativity). Moreover, there is some asymmetry in the interaction, such that unattended talker changes affect linguistic processing more than vice versa, which may be related to the ambiguity that talker changes cause in speech perception and/or attention bias to talker changes. Our findings have implications for understanding the neural encoding of linguistic and talker information. Copyright © 2015 Elsevier Inc. All rights reserved.

The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure

PubMed Central

Stacey, Paula C.; Kitterick, Pádraig T.; Morris, Saffron D.; Sumner, Christian J.

2017-01-01

Understanding what is said in demanding listening situations is assisted greatly by looking at the face of a talker. Previous studies have observed that normal-hearing listeners can benefit from this visual information when a talker's voice is presented in background noise. These benefits have also been observed in quiet listening conditions in cochlear-implant users, whose device does not convey the informative temporal fine structure cues in speech, and when normal-hearing individuals listen to speech processed to remove these informative temporal fine structure cues. The current study (1) characterised the benefits of visual information when listening in background noise; and (2) used sine-wave vocoding to compare the size of the visual benefit when speech is presented with or without informative temporal fine structure. The accuracy with which normal-hearing individuals reported words in spoken sentences was assessed across three experiments. The availability of visual information and informative temporal fine structure cues was varied within and across the experiments. The results showed that visual benefit was observed using open- and closed-set tests of speech perception. The size of the benefit increased when informative temporal fine structure cues were removed. This finding suggests that visual information may play an important role in the ability of cochlear-implant users to understand speech in many everyday situations. Models of audio-visual integration were able to account for the additional benefit of visual information when speech was degraded and suggested that auditory and visual information was being integrated in a similar way in all conditions. The modelling results were consistent with the notion that audio-visual benefit is derived from the optimal combination of auditory and visual sensory cues. PMID:27085797

Temporal trade-offs in psychophysics.

PubMed

Barack, David L; Gold, Joshua I

2016-04-01

Psychophysical techniques typically assume straightforward relationships between manipulations of real-world events, their effects on the brain, and behavioral reports of those effects. However, these relationships can be influenced by many complex, strategic factors that contribute to task performance. Here we discuss several of these factors that share two key features. First, they involve subjects making flexible use of time to process information. Second, this flexibility can reflect the rational regulation of information-processing trade-offs that can play prominent roles in particular temporal epochs: sensitivity to stability versus change for past information, speed versus accuracy for current information, and exploitation versus exploration for future goals. Understanding how subjects manage these trade-offs can be used to help design and interpret psychophysical studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Chronotron: A Neuron That Learns to Fire Temporally Precise Spike Patterns

PubMed Central

Florian, Răzvan V.

2012-01-01

In many cases, neurons process information carried by the precise timings of spikes. Here we show how neurons can learn to generate specific temporally precise output spikes in response to input patterns of spikes having precise timings, thus processing and memorizing information that is entirely temporally coded, both as input and as output. We introduce two new supervised learning rules for spiking neurons with temporal coding of information (chronotrons), one that provides high memory capacity (E-learning), and one that has a higher biological plausibility (I-learning). With I-learning, the neuron learns to fire the target spike trains through synaptic changes that are proportional to the synaptic currents at the timings of real and target output spikes. We study these learning rules in computer simulations where we train integrate-and-fire neurons. Both learning rules allow neurons to fire at the desired timings, with sub-millisecond precision. We show how chronotrons can learn to classify their inputs, by firing identical, temporally precise spike trains for different inputs belonging to the same class. When the input is noisy, the classification also leads to noise reduction. We compute lower bounds for the memory capacity of chronotrons and explore the influence of various parameters on chronotrons' performance. The chronotrons can model neurons that encode information in the time of the first spike relative to the onset of salient stimuli or neurons in oscillatory networks that encode information in the phases of spikes relative to the background oscillation. Our results show that firing one spike per cycle optimizes memory capacity in neurons encoding information in the phase of firing relative to a background rhythm. PMID:22879876

Neural microgenesis of personally familiar face recognition

PubMed Central

Ramon, Meike; Vizioli, Luca; Liu-Shuang, Joan; Rossion, Bruno

2015-01-01

Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network. PMID:26283361

Neural microgenesis of personally familiar face recognition.

PubMed

Ramon, Meike; Vizioli, Luca; Liu-Shuang, Joan; Rossion, Bruno

2015-09-01

Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network.

Semantic integration of differently asynchronous audio-visual information in videos of real-world events in cognitive processing: an ERP study.

PubMed

Liu, Baolin; Wu, Guangning; Wang, Zhongning; Ji, Xiang

2011-07-01

In the real world, some of the auditory and visual information received by the human brain are temporally asynchronous. How is such information integrated in cognitive processing in the brain? In this paper, we aimed to study the semantic integration of differently asynchronous audio-visual information in cognitive processing using ERP (event-related potential) method. Subjects were presented with videos of real world events, in which the auditory and visual information are temporally asynchronous. When the critical action was prior to the sound, sounds incongruous with the preceding critical actions elicited a N400 effect when compared to congruous condition. This result demonstrates that semantic contextual integration indexed by N400 also applies to cognitive processing of multisensory information. In addition, the N400 effect is early in latency when contrasted with other visually induced N400 studies. It is shown that cross modal information is facilitated in time when contrasted with visual information in isolation. When the sound was prior to the critical action, a larger late positive wave was observed under the incongruous condition compared to congruous condition. P600 might represent a reanalysis process, in which the mismatch between the critical action and the preceding sound was evaluated. It is shown that environmental sound may affect the cognitive processing of a visual event. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Temporal factors affecting somatosensory–auditory interactions in speech processing

PubMed Central

Ito, Takayuki; Gracco, Vincent L.; Ostry, David J.

2014-01-01

Speech perception is known to rely on both auditory and visual information. However, sound-specific somatosensory input has been shown also to influence speech perceptual processing (Ito et al., 2009). In the present study, we addressed further the relationship between somatosensory information and speech perceptual processing by addressing the hypothesis that the temporal relationship between orofacial movement and sound processing contributes to somatosensory–auditory interaction in speech perception. We examined the changes in event-related potentials (ERPs) in response to multisensory synchronous (simultaneous) and asynchronous (90 ms lag and lead) somatosensory and auditory stimulation compared to individual unisensory auditory and somatosensory stimulation alone. We used a robotic device to apply facial skin somatosensory deformations that were similar in timing and duration to those experienced in speech production. Following synchronous multisensory stimulation the amplitude of the ERP was reliably different from the two unisensory potentials. More importantly, the magnitude of the ERP difference varied as a function of the relative timing of the somatosensory–auditory stimulation. Event-related activity change due to stimulus timing was seen between 160 and 220 ms following somatosensory onset, mostly around the parietal area. The results demonstrate a dynamic modulation of somatosensory–auditory convergence and suggest the contribution of somatosensory information for speech processing process is dependent on the specific temporal order of sensory inputs in speech production. PMID:25452733

Dissociation between melodic and rhythmic processing during piano performance from musical scores.

PubMed

Bengtsson, Sara L; Ullén, Fredrik

2006-03-01

When performing or perceiving music, we experience the melodic (spatial) and rhythmic aspects as a unified whole. Moreover, the motor program theory stipulates that the relative timing and the serial order of the movement are invariant features of a motor program. Still, clinical and psychophysical observations suggest independent processing of these two aspects, in both production and perception. Here, we used functional magnetic resonance imaging to dissociate between brain areas processing the melodic and the rhythmic aspects during piano playing from musical scores. This behavior requires that the pianist decodes two types of information from the score in order to produce the desired piece of music. The spatial location of a note head determines which piano key to strike, and the various features of the note, such as the stem and flags determine the timing of each key stroke. We found that the medial occipital lobe, the superior temporal lobe, the rostral cingulate cortex, the putamen and the cerebellum process the melodic information, whereas the lateral occipital and the inferior temporal cortex, the left supramarginal gyrus, the left inferior and ventral frontal gyri, the caudate nucleus, and the cerebellum process the rhythmic information. Thus, we suggest a dissociate involvement of the dorsal visual stream in the spatial pitch processing and the ventral visual stream in temporal movement preparation. We propose that this dissociate organization may be important for fast learning and flexibility in motor control.

Spike count, spike timing and temporal information in the cortex of awake, freely moving rats

PubMed Central

Scaglione, Alessandro; Foffani, Guglielmo; Moxon, Karen A.

2014-01-01

Objective Sensory processing of peripheral information is not stationary but is, in general, a dynamic process related to the behavioral state of the animal. Yet the link between the state of the behavior and the encoding properties of neurons is unclear. This report investigates the impact of the behavioral state on the encoding mechanisms used by cortical neurons for both detection and discrimination of somatosensory stimuli in awake, freely moving, rats. Approach Neuronal activity was recorded from the primary somatosensory cortex of five rats under two different behavioral states (quiet vs. whisking) while electrical stimulation of increasing stimulus strength was delivered to the mystacial pad. Information theoretical measures were then used to measure the contribution of different encoding mechanisms to the information carried by neurons in response to the whisker stimulation. Main Results We found that the behavioral state of the animal modulated the total amount of information conveyed by neurons and that the timing of individual spikes increased the information compared to the total count of spikes alone. However, the temporal information, i.e. information exclusively related to when the spikes occur, was not modulated by behavioral state. Significance We conclude that information about somatosensory stimuli is modulated by the behavior of the animal and this modulation is mainly expressed in the spike count while the temporal information is more robust to changes in behavioral state. PMID:25024291

The auditory basis of language impairments: temporal processing versus processing efficiency hypotheses.

PubMed

Hartley, Douglas E H; Hill, Penny R; Moore, David R

2003-12-01

Claims have been made that language-impaired children have deficits processing rapidly presented or brief sensory information. These claims, known as the 'temporal processing hypothesis', are supported by demonstrations that language-impaired children have excess backward masking (BM). One explanation for these results is that BM is developmentally delayed in these children. However, little was known about how BM normally develops. Recently, we assessed BM in normally developing 6- and 8-year-old children and adults. Results showed that BM thresholds continue to improve over a comparatively protracted period (>10 years old). We also analysed reported deficits in BM in language-impaired and younger children, in terms of a model of temporal resolution. This analysis suggests that poor processing efficiency, rather than deficits in temporal resolution, can account for these results. This 'processing efficiency hypothesis' was recently tested in our laboratory. This experiment measured BM as a function of delays between the tone and the noise in children and adults. Results supported the processing efficiency hypothesis, and suggested that reduced processing efficiency alone could account for differences between adults and children. These findings provide a new perspective on the mechanisms underlying communication disorders, and imply that remediation strategies should be directed towards improving processing efficiency, not temporal resolution.

Enhancement of temporal periodicity cues in cochlear implants: Effects on prosodic perception and vowel identification

NASA Astrophysics Data System (ADS)

Green, Tim; Faulkner, Andrew; Rosen, Stuart; Macherey, Olivier

2005-07-01

Standard continuous interleaved sampling processing, and a modified processing strategy designed to enhance temporal cues to voice pitch, were compared on tests of intonation perception, and vowel perception, both in implant users and in acoustic simulations. In standard processing, 400 Hz low-pass envelopes modulated either pulse trains (implant users) or noise carriers (simulations). In the modified strategy, slow-rate envelope modulations, which convey dynamic spectral variation crucial for speech understanding, were extracted by low-pass filtering (32 Hz). In addition, during voiced speech, higher-rate temporal modulation in each channel was provided by 100% amplitude-modulation by a sawtooth-like wave form whose periodicity followed the fundamental frequency (F0) of the input. Channel levels were determined by the product of the lower- and higher-rate modulation components. Both in acoustic simulations and in implant users, the ability to use intonation information to identify sentences as question or statement was significantly better with modified processing. However, while there was no difference in vowel recognition in the acoustic simulation, implant users performed worse with modified processing both in vowel recognition and in formant frequency discrimination. It appears that, while enhancing pitch perception, modified processing harmed the transmission of spectral information.

Abnormal neural hierarchy in processing of verbal information in patients with schizophrenia.

PubMed

Lerner, Yulia; Bleich-Cohen, Maya; Solnik-Knirsh, Shimrit; Yogev-Seligmann, Galit; Eisenstein, Tamir; Madah, Waheed; Shamir, Alon; Hendler, Talma; Kremer, Ilana

2018-01-01

Previous research indicates abnormal comprehension of verbal information in patients with schizophrenia. Yet the neural mechanism underlying the breakdown of verbal information processing in schizophrenia is poorly understood. Imaging studies in healthy populations have shown a network of brain areas involved in hierarchical processing of verbal information over time. Here, we identified critical aspects of this hierarchy, examining patients with schizophrenia. Using functional magnetic resonance imaging, we examined various levels of information comprehension elicited by naturally presented verbal stimuli; from a set of randomly shuffled words to an intact story. Specifically, patients with first episode schizophrenia ( N  = 15), their non-manifesting siblings ( N  = 14) and healthy controls ( N  = 15) listened to a narrated story and randomly scrambled versions of it. To quantify the degree of dissimilarity between the groups, we adopted an inter-subject correlation (inter-SC) approach, which estimates differences in synchronization of neural responses within and between groups. The temporal topography found in healthy and siblings groups were consistent with our previous findings - high synchronization in responses from early sensory toward high order perceptual and cognitive areas. In patients with schizophrenia, stimuli with short and intermediate temporal scales evoked a typical pattern of reliable responses, whereas story condition (long temporal scale) revealed robust and widespread disruption of the inter-SCs. In addition, the more similar the neural activity of patients with schizophrenia was to the average response in the healthy group, the less severe the positive symptoms of the patients. Our findings suggest that system-level neural indication of abnormal verbal information processing in schizophrenia reflects disease manifestations.

Revisiting place and temporal theories of pitch

PubMed Central

2014-01-01

The nature of pitch and its neural coding have been studied for over a century. A popular debate has revolved around the question of whether pitch is coded via “place” cues in the cochlea, or via timing cues in the auditory nerve. In the most recent incarnation of this debate, the role of temporal fine structure has been emphasized in conveying important pitch and speech information, particularly because the lack of temporal fine structure coding in cochlear implants might explain some of the difficulties faced by cochlear implant users in perceiving music and pitch contours in speech. In addition, some studies have postulated that hearing-impaired listeners may have a specific deficit related to processing temporal fine structure. This article reviews some of the recent literature surrounding the debate, and argues that much of the recent evidence suggesting the importance of temporal fine structure processing can also be accounted for using spectral (place) or temporal-envelope cues. PMID:25364292

Time reversal of arbitrary photonic temporal modes via nonlinear optical frequency conversion

NASA Astrophysics Data System (ADS)

Raymer, Michael G.; Reddy, Dileep V.; van Enk, Steven J.; McKinstrie, Colin J.

2018-05-01

Single-photon wave packets can carry quantum information between nodes of a quantum network. An important general operation in photon-based quantum information systems is ‘blind’ reversal of a photon’s temporal wave packet envelope, that is, the ability to reverse an envelope without knowing the temporal state of the photon. We present an all-optical means for doing so, using nonlinear-optical frequency conversion driven by a short pump pulse. The process used may be sum-frequency generation or four-wave Bragg scattering. This scheme allows for quantum operations such as a temporal-mode parity sorter. We also verify that the scheme works for arbitrary states (not only single-photon ones) of an unknown wave packet.

The Relation of Information Processing Behavior to Concept Formation.

ERIC Educational Resources Information Center

Trinder, John; Richman, Charles L.

This report investigates those factors, necessary for, or facilitative of, stimulus organization. Part I considers three experimentally controlled factors: (1) stimuli; (2) responses; and (3) temporal organization of stimuli. The results revealed that temporal specing accounted for different findings. When the intertrial interval (ITI) was present…

Concurrent temporal channels for auditory processing: Oscillatory neural entrainment reveals segregation of function at different scales

PubMed Central

Tian, Xing; Rowland, Jess; Poeppel, David

2017-01-01

Natural sounds convey perceptually relevant information over multiple timescales, and the necessary extraction of multi-timescale information requires the auditory system to work over distinct ranges. The simplest hypothesis suggests that temporal modulations are encoded in an equivalent manner within a reasonable intermediate range. We show that the human auditory system selectively and preferentially tracks acoustic dynamics concurrently at 2 timescales corresponding to the neurophysiological theta band (4–7 Hz) and gamma band ranges (31–45 Hz) but, contrary to expectation, not at the timescale corresponding to alpha (8–12 Hz), which has also been found to be related to auditory perception. Listeners heard synthetic acoustic stimuli with temporally modulated structures at 3 timescales (approximately 190-, approximately 100-, and approximately 30-ms modulation periods) and identified the stimuli while undergoing magnetoencephalography recording. There was strong intertrial phase coherence in the theta band for stimuli of all modulation rates and in the gamma band for stimuli with corresponding modulation rates. The alpha band did not respond in a similar manner. Classification analyses also revealed that oscillatory phase reliably tracked temporal dynamics but not equivalently across rates. Finally, mutual information analyses quantifying the relation between phase and cochlear-scaled correlations also showed preferential processing in 2 distinct regimes, with the alpha range again yielding different patterns. The results support the hypothesis that the human auditory system employs (at least) a 2-timescale processing mode, in which lower and higher perceptual sampling scales are segregated by an intermediate temporal regime in the alpha band that likely reflects different underlying computations. PMID:29095816

Temporal context processing within hippocampal subfields.

PubMed

Wang, Fang; Diana, Rachel A

2016-07-01

The episodic memory system can differentiate similar events based on the temporal information associated with the events. Temporal context, which is at least partially determined by the events that precede or follow the critical event, may be a cue to differentiate events. The purpose of the present study is to investigate whether the hippocampal dentate gyrus (DG)/CA3 and CA1 subfields are sensitive to changes in temporal context and, if so, whether the subregions show a linear or threshold-like response to similar temporal contexts. Participants incidentally encoded a series of object picture triplets and 20 of them were included in final analyses. The third picture in each triplet was operationally defined as the target and the first two pictures served as temporal context for the target picture. Each target picture was presented twice with temporal context manipulated to be either repeated, high similarity, low similarity, or new on the second presentation. We extracted beta parameters for the repeated target as a function of the type of temporal context. We expected to see repetition suppression, a reduction in the beta values, in response to repetition of the target. If temporal context information is included in the representation of the target within a given region, this repetition suppression should be greater for target images that were preceded by their original context than for target images preceded by a new context. Neuroimaging results showed that CA1, but not DG/CA3, modifies the target's representation based on its temporal context. Right CA1 did not distinguish high similarity temporal context from repeated context but did distinguish low similarity temporal context from repeated context. These results indicate that CA1 is sensitive to temporal context and suggest that it does not differentiate between a substantially similar temporal context and an identical temporal context. In contrast, DG/CA3 does not appear to process temporal context as defined in the current experiment. Copyright © 2016 Elsevier Inc. All rights reserved.

Competing streams at the cocktail party: Exploring the mechanisms of attention and temporal integration

PubMed Central

Xiang, Juanjuan; Simon, Jonathan; Elhilali, Mounya

2010-01-01

Processing of complex acoustic scenes depends critically on the temporal integration of sensory information as sounds evolve naturally over time. It has been previously speculated that this process is guided by both innate mechanisms of temporal processing in the auditory system, as well as top-down mechanisms of attention, and possibly other schema-based processes. In an effort to unravel the neural underpinnings of these processes and their role in scene analysis, we combine Magnetoencephalography (MEG) with behavioral measures in humans in the context of polyrhythmic tone sequences. While maintaining unchanged sensory input, we manipulate subjects’ attention to one of two competing rhythmic streams in the same sequence. The results reveal that the neural representation of the attended rhythm is significantly enhanced both in its steady-state power and spatial phase coherence relative to its unattended state, closely correlating with its perceptual detectability for each listener. Interestingly, the data reveals a differential efficiency of rhythmic rates of the order of few hertz during the streaming process, closely following known neural and behavioral measures of temporal modulation sensitivity in the auditory system. These findings establish a direct link between known temporal modulation tuning in the auditory system (particularly at the level of auditory cortex) and the temporal integration of perceptual features in a complex acoustic scene, while mediated by processes of attention. PMID:20826671

Processing Stages Underlying Word Recognition in the Anteroventral Temporal Lobe

PubMed Central

Halgren, Eric; Wang, Chunmao; Schomer, Donald L.; Knake, Susanne; Marinkovic, Ksenija; Wu, Julian; Ulbert, Istvan

2006-01-01

The anteroventral temporal lobe integrates visual, lexical, semantic and mnestic aspects of word-processing, through its reciprocal connections with the ventral visual stream, language areas, and the hippocampal formation. We used linear microelectrode arrays to probe population synaptic currents and neuronal firing in different cortical layers of the anteroventral temporal lobe, during semantic judgments with implicit priming, and overt word recognition. Since different extrinsic and associative inputs preferentially target different cortical layers, this method can help reveal the sequence and nature of local processing stages at a higher resolution than was previously possible. The initial response in inferotemporal and perirhinal cortices is a brief current sink beginning at ~120ms, and peaking at ~170ms. Localization of this initial sink to middle layers suggests that it represents feedforward input from lower visual areas, and simultaneously increased firing implies that it represents excitatory synaptic currents. Until ~800ms, the main focus of transmembrane current sinks alternates between middle and superficial layers, with the superficial focus becoming increasingly dominant after ~550ms. Since superficial layers are the target of local and feedback associative inputs, this suggests an alternation in predominant synaptic input between feedforward and feedback modes. Word repetition does not affect the initial perirhinal and inferotemporal middle layer sink, but does decrease later activity. Entorhinal activity begins later (~200ms), with greater apparent excitatory postsynaptic currents and multiunit activity in neocortically-projecting than hippocampal-projecting layers. In contrast to perirhinal and entorhinal responses, entorhinal responses are larger to repeated words during memory retrieval. These results identify a sequence of physiological activation, beginning with a sharp activation from lower level visual areas carrying specific information to middle layers. This is followed by feedback and associative interactions involving upper cortical layers, which are abbreviated to repeated words. Following bottom-up and associative stages, top-down recollective processes may be driven by entorhinal cortex. Word processing involves a systematic sequence of fast feedforward information transfer from visual areas to anteroventral temporal cortex, followed by prolonged interactions of this feedforward information with local associations, and feedback mnestic information from the medial temporal lobe. PMID:16488158

Expansion and Compression of Time Correlate with Information Processing in an Enumeration Task.

PubMed

Wutz, Andreas; Shukla, Anuj; Bapi, Raju S; Melcher, David

2015-01-01

Perception of temporal duration is subjective and is influenced by factors such as attention and context. For example, unexpected or emotional events are often experienced as if time subjectively expands, suggesting that the amount of information processed in a unit of time can be increased. Time dilation effects have been measured with an oddball paradigm in which an infrequent stimulus is perceived to last longer than standard stimuli in the rest of the sequence. Likewise, time compression for the oddball occurs when the duration of the standard items is relatively brief. Here, we investigated whether the amount of information processing changes when time is perceived as distorted. On each trial, an oddball stimulus of varying numerosity (1-14 items) and duration was presented along with standard items that were either short (70 ms) or long (1050 ms). Observers were instructed to count the number of dots within the oddball stimulus and to judge its relative duration with respect to the standards on that trial. Consistent with previous results, oddballs were reliably perceived as temporally distorted: expanded for longer standard stimuli blocks and compressed for shorter standards. The occurrence of these distortions of time perception correlated with perceptual processing; i.e. enumeration accuracy increased when time was perceived as expanded and decreased with temporal compression. These results suggest that subjective time distortions are not epiphenomenal, but reflect real changes in sensory processing. Such short-term plasticity in information processing rate could be evolutionarily advantageous in optimizing perception and action during critical moments.

Attentional blink in young people with high-functioning autism and Asperger's disorder.

PubMed

Rinehart, Nicole; Tonge, Bruce; Brereton, Avril; Bradshaw, John

2010-01-01

The aim of the study was to examine the temporal characteristics of information processing in individuals with high-functioning autism and Asperger's disorder using a rapid serial visual presentation paradigm. The results clearly showed that such people demonstrate an attentional blink of similar magnitude to comparison groups. This supports the proposition that the social processing difficulties experienced by these individuals are not underpinned by a basic temporal-cognitive processing deficit, which is consistent with Minshew's complex information processing theory. This is the second study to show that automatic inhibitory processes are intact in both autism and Asperger's disorder, which appears to distinguish these disorders from some other frontostriatal disorders. The finding that individuals with autism were generally poorer than the comparison group at detecting black Xs, while being as good in responding to white letters, was accounted for in the context of a potential dual-task processing difficulty or visual search superiority.

A common perceptual temporal limit of binding synchronous inputs across different sensory attributes and modalities.

PubMed

Fujisaki, Waka; Nishida, Shin'ya

2010-08-07

The human brain processes different aspects of the surrounding environment through multiple sensory modalities, and each modality can be subdivided into multiple attribute-specific channels. When the brain rebinds sensory content information ('what') across different channels, temporal coincidence ('when') along with spatial coincidence ('where') provides a critical clue. It however remains unknown whether neural mechanisms for binding synchronous attributes are specific to each attribute combination, or universal and central. In human psychophysical experiments, we examined how combinations of visual, auditory and tactile attributes affect the temporal frequency limit of synchrony-based binding. The results indicated that the upper limits of cross-attribute binding were lower than those of within-attribute binding, and surprisingly similar for any combination of visual, auditory and tactile attributes (2-3 Hz). They are unlikely to be the limits for judging synchrony, since the temporal limit of a cross-attribute synchrony judgement was higher and varied with the modality combination (4-9 Hz). These findings suggest that cross-attribute temporal binding is mediated by a slow central process that combines separately processed 'what' and 'when' properties of a single event. While the synchrony performance reflects temporal bottlenecks existing in 'when' processing, the binding performance reflects the central temporal limit of integrating 'when' and 'what' properties.

Rapid visual grouping and figure-ground processing using temporally structured displays.

PubMed

Cheadle, Samuel; Usher, Marius; Müller, Hermann J

2010-08-23

We examine the time course of visual grouping and figure-ground processing. Figure (contour) and ground (random-texture) elements were flickered with different phases (i.e., contour and background are alternated), requiring the observer to group information within a pre-specified time window. It was found this grouping has a high temporal resolution: less than 20ms for smooth contours, and less than 50ms for line conjunctions with sharp angles. Furthermore, the grouping process takes place without an explicit knowledge of the phase of the elements, and it requires a cumulative build-up of information. The results are discussed in relation to the neural mechanism for visual grouping and figure-ground segregation. Copyright 2010 Elsevier Ltd. All rights reserved.

Musical intervention enhances infants’ neural processing of temporal structure in music and speech

PubMed Central

Zhao, T. Christina; Kuhl, Patricia K.

2016-01-01

Individuals with music training in early childhood show enhanced processing of musical sounds, an effect that generalizes to speech processing. However, the conclusions drawn from previous studies are limited due to the possible confounds of predisposition and other factors affecting musicians and nonmusicians. We used a randomized design to test the effects of a laboratory-controlled music intervention on young infants’ neural processing of music and speech. Nine-month-old infants were randomly assigned to music (intervention) or play (control) activities for 12 sessions. The intervention targeted temporal structure learning using triple meter in music (e.g., waltz), which is difficult for infants, and it incorporated key characteristics of typical infant music classes to maximize learning (e.g., multimodal, social, and repetitive experiences). Controls had similar multimodal, social, repetitive play, but without music. Upon completion, infants’ neural processing of temporal structure was tested in both music (tones in triple meter) and speech (foreign syllable structure). Infants’ neural processing was quantified by the mismatch response (MMR) measured with a traditional oddball paradigm using magnetoencephalography (MEG). The intervention group exhibited significantly larger MMRs in response to music temporal structure violations in both auditory and prefrontal cortical regions. Identical results were obtained for temporal structure changes in speech. The intervention thus enhanced temporal structure processing not only in music, but also in speech, at 9 mo of age. We argue that the intervention enhanced infants’ ability to extract temporal structure information and to predict future events in time, a skill affecting both music and speech processing. PMID:27114512

Musical intervention enhances infants' neural processing of temporal structure in music and speech.

PubMed

Zhao, T Christina; Kuhl, Patricia K

2016-05-10

Individuals with music training in early childhood show enhanced processing of musical sounds, an effect that generalizes to speech processing. However, the conclusions drawn from previous studies are limited due to the possible confounds of predisposition and other factors affecting musicians and nonmusicians. We used a randomized design to test the effects of a laboratory-controlled music intervention on young infants' neural processing of music and speech. Nine-month-old infants were randomly assigned to music (intervention) or play (control) activities for 12 sessions. The intervention targeted temporal structure learning using triple meter in music (e.g., waltz), which is difficult for infants, and it incorporated key characteristics of typical infant music classes to maximize learning (e.g., multimodal, social, and repetitive experiences). Controls had similar multimodal, social, repetitive play, but without music. Upon completion, infants' neural processing of temporal structure was tested in both music (tones in triple meter) and speech (foreign syllable structure). Infants' neural processing was quantified by the mismatch response (MMR) measured with a traditional oddball paradigm using magnetoencephalography (MEG). The intervention group exhibited significantly larger MMRs in response to music temporal structure violations in both auditory and prefrontal cortical regions. Identical results were obtained for temporal structure changes in speech. The intervention thus enhanced temporal structure processing not only in music, but also in speech, at 9 mo of age. We argue that the intervention enhanced infants' ability to extract temporal structure information and to predict future events in time, a skill affecting both music and speech processing.

Behavioral training enhances cortical temporal processing in neonatally deafened juvenile cats

PubMed Central

Vollmer, Maike; Raggio, Marcia W.; Schreiner, Christoph E.

2011-01-01

Deaf humans implanted with a cochlear prosthesis depend largely on temporal cues for speech recognition because spectral information processing is severely impaired. Training with a cochlear prosthesis is typically required before speech perception shows improvement, suggesting that relevant experience modifies temporal processing in the central auditory system. We tested this hypothesis in neonatally deafened cats by comparing temporal processing in the primary auditory cortex (AI) of cats that received only chronic passive intracochlear electric stimulation (ICES) with cats that were also trained with ICES to detect temporally challenging trains of electric pulses. After months of chronic passive stimulation and several weeks of detection training in behaviorally trained cats, multineuronal AI responses evoked by temporally modulated ICES were recorded in anesthetized animals. The stimulus repetition rates that produced the maximum number of phase-locked spikes (best repetition rate) and 50% cutoff rate were significantly higher in behaviorally trained cats than the corresponding rates in cats that received only chronic passive ICES. Behavioral training restored neuronal temporal following ability to levels comparable with those recorded in naïve prior normal-hearing adult deafened animals. Importantly, best repetitition rates and cutoff rates were highest for neuronal clusters activated by the electrode configuration used in behavioral training. These results suggest that neuroplasticity in the AI is induced by behavioral training and perceptual learning in animals deprived of ordinary auditory experience during development and indicate that behavioral training can ameliorate or restore temporal processing in the AI of profoundly deaf animals. PMID:21543753

Temporal Organization of Sound Information in Auditory Memory.

PubMed

Song, Kun; Luo, Huan

2017-01-01

Memory is a constructive and organizational process. Instead of being stored with all the fine details, external information is reorganized and structured at certain spatiotemporal scales. It is well acknowledged that time plays a central role in audition by segmenting sound inputs into temporal chunks of appropriate length. However, it remains largely unknown whether critical temporal structures exist to mediate sound representation in auditory memory. To address the issue, here we designed an auditory memory transferring study, by combining a previously developed unsupervised white noise memory paradigm with a reversed sound manipulation method. Specifically, we systematically measured the memory transferring from a random white noise sound to its locally temporal reversed version on various temporal scales in seven experiments. We demonstrate a U-shape memory-transferring pattern with the minimum value around temporal scale of 200 ms. Furthermore, neither auditory perceptual similarity nor physical similarity as a function of the manipulating temporal scale can account for the memory-transferring results. Our results suggest that sounds are not stored with all the fine spectrotemporal details but are organized and structured at discrete temporal chunks in long-term auditory memory representation.

Temporal Integration and Inferences About Televised Social Behavior.

ERIC Educational Resources Information Center

Collins, W. Andrew

This paper discusses research on age related aspects of children's processing and comprehension of the narrative content of family oriented television programs. In one study, the temporal integration necessary to make inferences about audiovisually presented information was examined in 254 second, fifth and eighth grade children. Subjects were…

Spatio-temporal dynamics of processing non-symbolic number: An ERP source localization study

PubMed Central

Hyde, Daniel C.; Spelke, Elizabeth S.

2013-01-01

Coordinated studies with adults, infants, and nonhuman animals provide evidence for two distinct systems of non-verbal number representation. The ‘parallel individuation’ system selects and retains information about 1–3 individual entities and the ‘numerical magnitude’ system establishes representations of the approximate cardinal value of a group. Recent ERP work has demonstrated that these systems reliably evoke functionally and temporally distinct patterns of brain response that correspond to established behavioral signatures. However, relatively little is known about the neural generators of these ERP signatures. To address this question, we targeted known ERP signatures of these systems, by contrasting processing of small versus large non-symbolic numbers, and used a source localization algorithm (LORETA) to identify their cortical origins. Early processing of small numbers, showing the signature effects of parallel individuation on the N1 (∼150 ms), was localized primarily to extrastriate visual regions. In contrast, qualitatively and temporally distinct processing of large numbers, showing the signatures of approximate number representation on the mid-latency P2p (∼200–250 ms), was localized primarily to right intraparietal regions. In comparison, mid-latency small number processing was localized to the right temporal-parietal junction and left-lateralized intraparietal regions. These results add spatial information to the emerging ERP literature documenting the process by which we represent number. Furthermore, these results substantiate recent claims that early attentional processes determine whether a collection of objects will be represented through parallel individuation or as an approximate numerical magnitude by providing evidence that downstream processing diverges to distinct cortical regions. PMID:21830257

Gender-specific effects of emotional modulation on visual temporal order thresholds.

PubMed

Liang, Wei; Zhang, Jiyuan; Bao, Yan

2015-09-01

Emotions affect temporal information processing in the low-frequency time window of a few seconds, but little is known about their effect in the high-frequency domain of some tens of milliseconds. The present study aims to investigate whether negative and positive emotional states influence the ability to discriminate the temporal order of visual stimuli, and whether gender plays a role in temporal processing. Due to the hemispheric lateralization of emotion, a hemispheric asymmetry between the left and the right visual field might be expected. Using a block design, subjects were primed with neutral, negative and positive emotional pictures before performing temporal order judgment tasks. Results showed that male subjects exhibited similarly reduced order thresholds under negative and positive emotional states, while female subjects demonstrated increased threshold under positive emotional state and reduced threshold under negative emotional state. Besides, emotions influenced female subjects more intensely than male subjects, and no hemispheric lateralization was observed. These observations indicate an influence of emotional states on temporal order processing of visual stimuli, and they suggest a gender difference, which is possibly associated with a different emotional stability.

Reference frames for spatial frequency in face representation differ in the temporal visual cortex and amygdala.

PubMed

Inagaki, Mikio; Fujita, Ichiro

2011-07-13

Social communication in nonhuman primates and humans is strongly affected by facial information from other individuals. Many cortical and subcortical brain areas are known to be involved in processing facial information. However, how the neural representation of faces differs across different brain areas remains unclear. Here, we demonstrate that the reference frame for spatial frequency (SF) tuning of face-responsive neurons differs in the temporal visual cortex and amygdala in monkeys. Consistent with psychophysical properties for face recognition, temporal cortex neurons were tuned to image-based SFs (cycles/image) and showed viewing distance-invariant representation of face patterns. On the other hand, many amygdala neurons were influenced by retina-based SFs (cycles/degree), a characteristic that is useful for social distance computation. The two brain areas also differed in the luminance contrast sensitivity of face-responsive neurons; amygdala neurons sharply reduced their responses to low luminance contrast images, while temporal cortex neurons maintained the level of their responses. From these results, we conclude that different types of visual processing in the temporal visual cortex and the amygdala contribute to the construction of the neural representations of faces.

Brain signal complexity rises with repetition suppression in visual learning.

PubMed

Lafontaine, Marc Philippe; Lacourse, Karine; Lina, Jean-Marc; McIntosh, Anthony R; Gosselin, Frédéric; Théoret, Hugo; Lippé, Sarah

2016-06-21

Neuronal activity associated with visual processing of an unfamiliar face gradually diminishes when it is viewed repeatedly. This process, known as repetition suppression (RS), is involved in the acquisition of familiarity. Current models suggest that RS results from interactions between visual information processing areas located in the occipito-temporal cortex and higher order areas, such as the dorsolateral prefrontal cortex (DLPFC). Brain signal complexity, which reflects information dynamics of cortical networks, has been shown to increase as unfamiliar faces become familiar. However, the complementarity of RS and increases in brain signal complexity have yet to be demonstrated within the same measurements. We hypothesized that RS and brain signal complexity increase occur simultaneously during learning of unfamiliar faces. Further, we expected alteration of DLPFC function by transcranial direct current stimulation (tDCS) to modulate RS and brain signal complexity over the occipito-temporal cortex. Participants underwent three tDCS conditions in random order: right anodal/left cathodal, right cathodal/left anodal and sham. Following tDCS, participants learned unfamiliar faces, while an electroencephalogram (EEG) was recorded. Results revealed RS over occipito-temporal electrode sites during learning, reflected by a decrease in signal energy, a measure of amplitude. Simultaneously, as signal energy decreased, brain signal complexity, as estimated with multiscale entropy (MSE), increased. In addition, prefrontal tDCS modulated brain signal complexity over the right occipito-temporal cortex during the first presentation of faces. These results suggest that although RS may reflect a brain mechanism essential to learning, complementary processes reflected by increases in brain signal complexity, may be instrumental in the acquisition of novel visual information. Such processes likely involve long-range coordinated activity between prefrontal and lower order visual areas. Copyright © 2016 IBRO. Published by Elsevier Ltd. All rights reserved.

Octopus Cells in the Posteroventral Cochlear Nucleus Provide the Main Excitatory Input to the Superior Paraolivary Nucleus

PubMed Central

Felix II, Richard A.; Gourévitch, Boris; Gómez-Álvarez, Marcelo; Leijon, Sara C. M.; Saldaña, Enrique; Magnusson, Anna K.

2017-01-01

Auditory streaming enables perception and interpretation of complex acoustic environments that contain competing sound sources. At early stages of central processing, sounds are segregated into separate streams representing attributes that later merge into acoustic objects. Streaming of temporal cues is critical for perceiving vocal communication, such as human speech, but our understanding of circuits that underlie this process is lacking, particularly at subcortical levels. The superior paraolivary nucleus (SPON), a prominent group of inhibitory neurons in the mammalian brainstem, has been implicated in processing temporal information needed for the segmentation of ongoing complex sounds into discrete events. The SPON requires temporally precise and robust excitatory input(s) to convey information about the steep rise in sound amplitude that marks the onset of voiced sound elements. Unfortunately, the sources of excitation to the SPON and the impact of these inputs on the behavior of SPON neurons have yet to be resolved. Using anatomical tract tracing and immunohistochemistry, we identified octopus cells in the contralateral cochlear nucleus (CN) as the primary source of excitatory input to the SPON. Cluster analysis of miniature excitatory events also indicated that the majority of SPON neurons receive one type of excitatory input. Precise octopus cell-driven onset spiking coupled with transient offset spiking make SPON responses well-suited to signal transitions in sound energy contained in vocalizations. Targets of octopus cell projections, including the SPON, are strongly implicated in the processing of temporal sound features, which suggests a common pathway that conveys information critical for perception of complex natural sounds. PMID:28620283

High-Speed Photonic Reservoir Computing Using a Time-Delay-Based Architecture: Million Words per Second Classification

NASA Astrophysics Data System (ADS)

Larger, Laurent; Baylón-Fuentes, Antonio; Martinenghi, Romain; Udaltsov, Vladimir S.; Chembo, Yanne K.; Jacquot, Maxime

2017-01-01

Reservoir computing, originally referred to as an echo state network or a liquid state machine, is a brain-inspired paradigm for processing temporal information. It involves learning a "read-out" interpretation for nonlinear transients developed by high-dimensional dynamics when the latter is excited by the information signal to be processed. This novel computational paradigm is derived from recurrent neural network and machine learning techniques. It has recently been implemented in photonic hardware for a dynamical system, which opens the path to ultrafast brain-inspired computing. We report on a novel implementation involving an electro-optic phase-delay dynamics designed with off-the-shelf optoelectronic telecom devices, thus providing the targeted wide bandwidth. Computational efficiency is demonstrated experimentally with speech-recognition tasks. State-of-the-art speed performances reach one million words per second, with very low word error rate. Additionally, to record speed processing, our investigations have revealed computing-efficiency improvements through yet-unexplored temporal-information-processing techniques, such as simultaneous multisample injection and pitched sampling at the read-out compared to information "write-in".

Human performance on the temporal bisection task.

PubMed

Kopec, Charles D; Brody, Carlos D

2010-12-01

The perception and processing of temporal information are tasks the brain must continuously perform. These include measuring the duration of stimuli, storing duration information in memory, recalling such memories, and comparing two durations. How the brain accomplishes these tasks, however, is still open for debate. The temporal bisection task, which requires subjects to compare temporal stimuli to durations held in memory, is perfectly suited to address these questions. Here we perform a meta-analysis of human performance on the temporal bisection task collected from 148 experiments spread across 18 independent studies. With this expanded data set we are able to show that human performance on this task contains a number of significant peculiarities, which in total no single model yet proposed has been able to explain. Here we present a simple 2-step decision model that is capable of explaining all the idiosyncrasies seen in the data. Copyright © 2010 Elsevier Inc. All rights reserved.

Temporal compression in episodic memory for real-life events.

PubMed

Jeunehomme, Olivier; Folville, Adrien; Stawarczyk, David; Van der Linden, Martial; D'Argembeau, Arnaud

2018-07-01

Remembering an event typically takes less time than experiencing it, suggesting that episodic memory represents past experience in a temporally compressed way. Little is known, however, about how the continuous flow of real-life events is summarised in memory. Here we investigated the nature and determinants of temporal compression by directly comparing memory contents with the objective timing of events as measured by a wearable camera. We found that episodic memories consist of a succession of moments of prior experience that represent events with varying compression rates, such that the density of retrieved information is modulated by goal processing and perceptual changes. Furthermore, the results showed that temporal compression rates remain relatively stable over one week and increase after a one-month delay, particularly for goal-related events. These data shed new light on temporal compression in episodic memory and suggest that compression rates are adaptively modulated to maintain current goal-relevant information.

Visual pattern recognition based on spatio-temporal patterns of retinal ganglion cells’ activities

PubMed Central

Jing, Wei; Liu, Wen-Zhong; Gong, Xin-Wei; Gong, Hai-Qing

2010-01-01

Neural information is processed based on integrated activities of relevant neurons. Concerted population activity is one of the important ways for retinal ganglion cells to efficiently organize and process visual information. In the present study, the spike activities of bullfrog retinal ganglion cells in response to three different visual patterns (checker-board, vertical gratings and horizontal gratings) were recorded using multi-electrode arrays. A measurement of subsequence distribution discrepancy (MSDD) was applied to identify the spatio-temporal patterns of retinal ganglion cells’ activities in response to different stimulation patterns. The results show that the population activity patterns were different in response to different stimulation patterns, such difference in activity pattern was consistently detectable even when visual adaptation occurred during repeated experimental trials. Therefore, the stimulus pattern can be reliably discriminated according to the spatio-temporal pattern of the neuronal activities calculated using the MSDD algorithm. PMID:21886670

Critical role for cochlear hair cell BK channels for coding the temporal structure and dynamic range of auditory information for central auditory processing

PubMed Central

Kurt, Simone; Sausbier, Matthias; Rüttiger, Lukas; Brandt, Niels; Moeller, Christoph K.; Kindler, Jennifer; Sausbier, Ulrike; Zimmermann, Ulrike; van Straaten, Harald; Neuhuber, Winfried; Engel, Jutta; Knipper, Marlies; Ruth, Peter; Schulze, Holger

2012-01-01

Large conductance, voltage- and Ca2+-activated K+ (BK) channels in inner hair cells (IHCs) of the cochlea are essential for hearing. However, germline deletion of BKα, the pore-forming subunit KCNMA1 of the BK channel, surprisingly did not affect hearing thresholds in the first postnatal weeks, even though altered IHC membrane time constants, decreased IHC receptor potential alternating current/direct current ratio, and impaired spike timing of auditory fibers were reported in these mice. To investigate the role of IHC BK channels for central auditory processing, we generated a conditional mouse model with hair cell-specific deletion of BKα from postnatal day 10 onward. This had an unexpected effect on temporal coding in the central auditory system: neuronal single and multiunit responses in the inferior colliculus showed higher excitability and greater precision of temporal coding that may be linked to the improved discrimination of temporally modulated sounds observed in behavioral training. The higher precision of temporal coding, however, was restricted to slower modulations of sound and reduced stimulus-driven activity. This suggests a diminished dynamic range of stimulus coding that is expected to impair signal detection in noise. Thus, BK channels in IHCs are crucial for central coding of the temporal fine structure of sound and for detection of signals in a noisy environment.—Kurt, S., Sausbier, M., Rüttiger, L., Brandt, N., Moeller, C. K., Kindler, J., Sausbier, U., Zimmermann, U., van Straaten, H., Neuhuber, W., Engel, J., Knipper, M., Ruth, P., Schulze, H. Critical role for cochlear hair cell BK channels for coding the temporal structure and dynamic range of auditory information for central auditory processing. PMID:22691916

Spatio-temporal processing of tactile stimuli in autistic children

PubMed Central

Wada, Makoto; Suzuki, Mayuko; Takaki, Akiko; Miyao, Masutomo; Spence, Charles; Kansaku, Kenji

2014-01-01

Altered multisensory integration has been reported in autism; however, little is known concerning how the autistic brain processes spatio-temporal information concerning tactile stimuli. We report a study in which a crossed-hands illusion was investigated in autistic children. Neurotypical individuals often experience a subjective reversal of temporal order judgments when their hands are stimulated while crossed, and the illusion is known to be acquired in early childhood. However, under those conditions where the somatotopic representation is given priority over the actual spatial location of the hands, such reversals may not occur. Here, we showed that a significantly smaller illusory reversal was demonstrated in autistic children than in neurotypical children. Furthermore, in an additional experiment, the young boys who had higher Autism Spectrum Quotient (AQ) scores generally showed a smaller crossed hands deficit. These results suggest that rudimentary spatio-temporal processing of tactile stimuli exists in autistic children, and the altered processing may interfere with the development of an external frame of reference in real-life situations. PMID:25100146

Performance-informed EEG analysis reveals mixed evidence for EEG signatures unique to the processing of time.

PubMed

Schlichting, Nadine; de Jong, Ritske; van Rijn, Hedderik

2018-06-20

Certain EEG components (e.g., the contingent negative variation, CNV, or beta oscillations) have been linked to the perception of temporal magnitudes specifically. However, it is as of yet unclear whether these EEG components are really unique to time perception or reflect the perception of magnitudes in general. In the current study we recorded EEG while participants had to make judgments about duration (time condition) or numerosity (number condition) in a comparison task. This design allowed us to directly compare EEG signals between the processing of time and number. Stimuli consisted of a series of blue dots appearing and disappearing dynamically on a black screen. Each stimulus was characterized by its duration and the total number of dots that it consisted of. Because it is known that tasks like these elicit perceptual interference effects that we used a maximum-likelihood estimation (MLE) procedure to determine, for each participant and dimension separately, to what extent time and numerosity information were taken into account when making a judgement in an extensive post hoc analysis. This approach enabled us to capture individual differences in behavioral performance and, based on the MLE estimates, to select a subset of participants who suppressed task-irrelevant information. Even for this subset of participants, who showed no or only small interference effects and thus were thought to truly process temporal information in the time condition and numerosity information in the number condition, we found CNV patterns in the time-domain EEG signals for both tasks that was more pronounced in the time-task. We found no substantial evidence for differences between the processing of temporal and numerical information in the time-frequency domain.

Medial Temporal Lobe Structures Contribute to On-Line Processing

ERIC Educational Resources Information Center

Warren, David

2009-01-01

For the last five decades, the medial temporal lobes have been generally understood to facilitate enduring representation of certain kinds of information. In particular, knowledge about the relations among items and concepts appears to rely on that region of the brain. Recent results suggest that those same structures also play a subtle role in…

How Semantic and Episodic Memory Contribute to Autobiographical Memory. Commentary on Burt

ERIC Educational Resources Information Center

Tendolkar, Indira

2008-01-01

In his article, Chris Burt focuses on the relationship between time and autobiographical memory. The question Burt puts forward is whether temporal markers in reports on autobiographic memories reflect specific temporal information or result from rather complex cognitive processing of time-relevant knowledge. The aspect of time is inherent to the…

Medial Temporal Lobe Activity during Source Retrieval Reflects Information Type, Not Memory Strength

ERIC Educational Resources Information Center

Diana, Rachel A.; Yonelinas, Andrew P.; Ranganath, Charan

2010-01-01

The medial temporal lobes (MTLs) are critical for episodic memory but the functions of MTL subregions are controversial. According to memory strength theory, MTL subregions collectively support declarative memory in a graded manner. In contrast, other theories assert that MTL subregions support functionally distinct processes. For instance, one…

Comodulation Masking Release (CMR) in Children and the Influence of Reading Status

ERIC Educational Resources Information Center

Zettler, Cynthia M.; Sevcik, Rose A.; Morris, Robin D.; Clarkson, Marsha G.

2008-01-01

Purpose: Research suggests that children with reading disabilities (RD) have difficulty processing temporal and spectral components of sounds. Comodulation masking release (CMR) measures a listener's ability to use temporal and spectral information in noise to identify a signal. The purpose of this study was to determine whether children with RD…

Spatial and temporal ecology of eastern spadefoot toads on a Florida landscape

Treesearch

Cathryn H. Greenberg; George W. Tanner

2005-01-01

Effective amphibian conservation must consider population and landscape processes, but information at multiple scales is rare. We explore spatial and temporal patterns of breeding and recruitment by eastern spadefoot toads (Scaphiopus holbrookii), using nine years of data from continuous monitoring with drift fences and pitfall traps at eight...

Learning Pitch with STDP: A Computational Model of Place and Temporal Pitch Perception Using Spiking Neural Networks.

PubMed

Erfanian Saeedi, Nafise; Blamey, Peter J; Burkitt, Anthony N; Grayden, David B

2016-04-01

Pitch perception is important for understanding speech prosody, music perception, recognizing tones in tonal languages, and perceiving speech in noisy environments. The two principal pitch perception theories consider the place of maximum neural excitation along the auditory nerve and the temporal pattern of the auditory neurons' action potentials (spikes) as pitch cues. This paper describes a biophysical mechanism by which fine-structure temporal information can be extracted from the spikes generated at the auditory periphery. Deriving meaningful pitch-related information from spike times requires neural structures specialized in capturing synchronous or correlated activity from amongst neural events. The emergence of such pitch-processing neural mechanisms is described through a computational model of auditory processing. Simulation results show that a correlation-based, unsupervised, spike-based form of Hebbian learning can explain the development of neural structures required for recognizing the pitch of simple and complex tones, with or without the fundamental frequency. The temporal code is robust to variations in the spectral shape of the signal and thus can explain the phenomenon of pitch constancy.

Learning Pitch with STDP: A Computational Model of Place and Temporal Pitch Perception Using Spiking Neural Networks

PubMed Central

Erfanian Saeedi, Nafise; Blamey, Peter J.; Burkitt, Anthony N.; Grayden, David B.

2016-01-01

Pitch perception is important for understanding speech prosody, music perception, recognizing tones in tonal languages, and perceiving speech in noisy environments. The two principal pitch perception theories consider the place of maximum neural excitation along the auditory nerve and the temporal pattern of the auditory neurons’ action potentials (spikes) as pitch cues. This paper describes a biophysical mechanism by which fine-structure temporal information can be extracted from the spikes generated at the auditory periphery. Deriving meaningful pitch-related information from spike times requires neural structures specialized in capturing synchronous or correlated activity from amongst neural events. The emergence of such pitch-processing neural mechanisms is described through a computational model of auditory processing. Simulation results show that a correlation-based, unsupervised, spike-based form of Hebbian learning can explain the development of neural structures required for recognizing the pitch of simple and complex tones, with or without the fundamental frequency. The temporal code is robust to variations in the spectral shape of the signal and thus can explain the phenomenon of pitch constancy. PMID:27049657

Metabolic rate and body size are linked with perception of temporal information☆

PubMed Central

Healy, Kevin; McNally, Luke; Ruxton, Graeme D.; Cooper, Natalie; Jackson, Andrew L.

2013-01-01

Body size and metabolic rate both fundamentally constrain how species interact with their environment, and hence ultimately affect their niche. While many mechanisms leading to these constraints have been explored, their effects on the resolution at which temporal information is perceived have been largely overlooked. The visual system acts as a gateway to the dynamic environment and the relative resolution at which organisms are able to acquire and process visual information is likely to restrict their ability to interact with events around them. As both smaller size and higher metabolic rates should facilitate rapid behavioural responses, we hypothesized that these traits would favour perception of temporal change over finer timescales. Using critical flicker fusion frequency, the lowest frequency of flashing at which a flickering light source is perceived as constant, as a measure of the maximum rate of temporal information processing in the visual system, we carried out a phylogenetic comparative analysis of a wide range of vertebrates that supported this hypothesis. Our results have implications for the evolution of signalling systems and predator–prey interactions, and, combined with the strong influence that both body mass and metabolism have on a species' ecological niche, suggest that time perception may constitute an important and overlooked dimension of niche differentiation. PMID:24109147

What the Human Brain Likes About Facial Motion

PubMed Central

Schultz, Johannes; Brockhaus, Matthias; Bülthoff, Heinrich H.; Pilz, Karin S.

2013-01-01

Facial motion carries essential information about other people's emotions and intentions. Most previous studies have suggested that facial motion is mainly processed in the superior temporal sulcus (STS), but several recent studies have also shown involvement of ventral temporal face-sensitive regions. Up to now, it is not known whether the increased response to facial motion is due to an increased amount of static information in the stimulus, to the deformation of the face over time, or to increased attentional demands. We presented nonrigidly moving faces and control stimuli to participants performing a demanding task unrelated to the face stimuli. We manipulated the amount of static information by using movies with different frame rates. The fluidity of the motion was manipulated by presenting movies with frames either in the order in which they were recorded or in scrambled order. Results confirm higher activation for moving compared with static faces in STS and under certain conditions in ventral temporal face-sensitive regions. Activation was maximal at a frame rate of 12.5 Hz and smaller for scrambled movies. These results indicate that both the amount of static information and the fluid facial motion per se are important factors for the processing of dynamic faces. PMID:22535907

Temporal reasoning over clinical text: the state of the art

PubMed Central

Sun, Weiyi; Rumshisky, Anna; Uzuner, Ozlem

2013-01-01

Objectives To provide an overview of the problem of temporal reasoning over clinical text and to summarize the state of the art in clinical natural language processing for this task. Target audience This overview targets medical informatics researchers who are unfamiliar with the problems and applications of temporal reasoning over clinical text. Scope We review the major applications of text-based temporal reasoning, describe the challenges for software systems handling temporal information in clinical text, and give an overview of the state of the art. Finally, we present some perspectives on future research directions that emerged during the recent community-wide challenge on text-based temporal reasoning in the clinical domain. PMID:23676245

Self-Organization of Spatio-Temporal Hierarchy via Learning of Dynamic Visual Image Patterns on Action Sequences

PubMed Central

Jung, Minju; Hwang, Jungsik; Tani, Jun

2015-01-01

It is well known that the visual cortex efficiently processes high-dimensional spatial information by using a hierarchical structure. Recently, computational models that were inspired by the spatial hierarchy of the visual cortex have shown remarkable performance in image recognition. Up to now, however, most biological and computational modeling studies have mainly focused on the spatial domain and do not discuss temporal domain processing of the visual cortex. Several studies on the visual cortex and other brain areas associated with motor control support that the brain also uses its hierarchical structure as a processing mechanism for temporal information. Based on the success of previous computational models using spatial hierarchy and temporal hierarchy observed in the brain, the current report introduces a novel neural network model for the recognition of dynamic visual image patterns based solely on the learning of exemplars. This model is characterized by the application of both spatial and temporal constraints on local neural activities, resulting in the self-organization of a spatio-temporal hierarchy necessary for the recognition of complex dynamic visual image patterns. The evaluation with the Weizmann dataset in recognition of a set of prototypical human movement patterns showed that the proposed model is significantly robust in recognizing dynamically occluded visual patterns compared to other baseline models. Furthermore, an evaluation test for the recognition of concatenated sequences of those prototypical movement patterns indicated that the model is endowed with a remarkable capability for the contextual recognition of long-range dynamic visual image patterns. PMID:26147887

Self-Organization of Spatio-Temporal Hierarchy via Learning of Dynamic Visual Image Patterns on Action Sequences.

PubMed

Jung, Minju; Hwang, Jungsik; Tani, Jun

2015-01-01

It is well known that the visual cortex efficiently processes high-dimensional spatial information by using a hierarchical structure. Recently, computational models that were inspired by the spatial hierarchy of the visual cortex have shown remarkable performance in image recognition. Up to now, however, most biological and computational modeling studies have mainly focused on the spatial domain and do not discuss temporal domain processing of the visual cortex. Several studies on the visual cortex and other brain areas associated with motor control support that the brain also uses its hierarchical structure as a processing mechanism for temporal information. Based on the success of previous computational models using spatial hierarchy and temporal hierarchy observed in the brain, the current report introduces a novel neural network model for the recognition of dynamic visual image patterns based solely on the learning of exemplars. This model is characterized by the application of both spatial and temporal constraints on local neural activities, resulting in the self-organization of a spatio-temporal hierarchy necessary for the recognition of complex dynamic visual image patterns. The evaluation with the Weizmann dataset in recognition of a set of prototypical human movement patterns showed that the proposed model is significantly robust in recognizing dynamically occluded visual patterns compared to other baseline models. Furthermore, an evaluation test for the recognition of concatenated sequences of those prototypical movement patterns indicated that the model is endowed with a remarkable capability for the contextual recognition of long-range dynamic visual image patterns.

Temporal and spectral manipulations of correlated photons using a time lens

NASA Astrophysics Data System (ADS)

Mittal, Sunil; Orre, Venkata Vikram; Restelli, Alessandro; Salem, Reza; Goldschmidt, Elizabeth A.; Hafezi, Mohammad

2017-10-01

A common challenge in quantum information processing with photons is the limited ability to manipulate and measure correlated states. An example is the inability to measure picosecond-scale temporal correlations of a multiphoton state, given state-of-the-art detectors have a temporal resolution of about 100 ps. Here, we demonstrate temporal magnification of time-bin-entangled two-photon states using a time lens and measure their temporal correlation function, which is otherwise not accessible because of the limited temporal resolution of single-photon detectors. Furthermore, we show that the time lens maps temporal correlations of photons to frequency correlations and could be used to manipulate frequency-bin-entangled photons. This demonstration opens a new avenue to manipulate and analyze spectral and temporal wave functions of many-photon states.

Encoding model of temporal processing in human visual cortex.

PubMed

Stigliani, Anthony; Jeska, Brianna; Grill-Spector, Kalanit

2017-12-19

How is temporal information processed in human visual cortex? Visual input is relayed to V1 through segregated transient and sustained channels in the retina and lateral geniculate nucleus (LGN). However, there is intense debate as to how sustained and transient temporal channels contribute to visual processing beyond V1. The prevailing view associates transient processing predominately with motion-sensitive regions and sustained processing with ventral stream regions, while the opposing view suggests that both temporal channels contribute to neural processing beyond V1. Using fMRI, we measured cortical responses to time-varying stimuli and then implemented a two temporal channel-encoding model to evaluate the contributions of each channel. Different from the general linear model of fMRI that predicts responses directly from the stimulus, the encoding approach first models neural responses to the stimulus from which fMRI responses are derived. This encoding approach not only predicts cortical responses to time-varying stimuli from milliseconds to seconds but also, reveals differential contributions of temporal channels across visual cortex. Consistent with the prevailing view, motion-sensitive regions and adjacent lateral occipitotemporal regions are dominated by transient responses. However, ventral occipitotemporal regions are driven by both sustained and transient channels, with transient responses exceeding the sustained. These findings propose a rethinking of temporal processing in the ventral stream and suggest that transient processing may contribute to rapid extraction of the content of the visual input. Importantly, our encoding approach has vast implications, because it can be applied with fMRI to decipher neural computations in millisecond resolution in any part of the brain. Copyright © 2017 the Author(s). Published by PNAS.

Temporal windows in visual processing: "prestimulus brain state" and "poststimulus phase reset" segregate visual transients on different temporal scales.

PubMed

Wutz, Andreas; Weisz, Nathan; Braun, Christoph; Melcher, David

2014-01-22

Dynamic vision requires both stability of the current perceptual representation and sensitivity to the accumulation of sensory evidence over time. Here we study the electrophysiological signatures of this intricate balance between temporal segregation and integration in vision. Within a forward masking paradigm with short and long stimulus onset asynchronies (SOA), we manipulated the temporal overlap of the visual persistence of two successive transients. Human observers enumerated the items presented in the second target display as a measure of the informational capacity read-out from this partly temporally integrated visual percept. We observed higher β-power immediately before mask display onset in incorrect trials, in which enumeration failed due to stronger integration of mask and target visual information. This effect was timescale specific, distinguishing between segregation and integration of visual transients that were distant in time (long SOA). Conversely, for short SOA trials, mask onset evoked a stronger visual response when mask and targets were correctly segregated in time. Examination of the target-related response profile revealed the importance of an evoked α-phase reset for the segregation of those rapid visual transients. Investigating this precise mapping of the temporal relationships of visual signals onto electrophysiological responses highlights how the stream of visual information is carved up into discrete temporal windows that mediate between segregated and integrated percepts. Fragmenting the stream of visual information provides a means to stabilize perceptual events within one instant in time.

Behavioural and brain responses related to Internet search and memory.

PubMed

Dong, Guangheng; Potenza, Marc N

2015-10-01

The ready availability of data via searches on the Internet has changed how many people seek and perhaps store and recall information, although the brain mechanisms underlying these processes are not well understood. This study investigated brain mechanisms underlying Internet-based vs. non-Internet-based searching. The results showed that Internet searching was associated with lower accuracy in recalling information as compared with traditional book searching. During functional magnetic resonance imaging, Internet searching was associated with less regional brain activation in the left ventral stream, the association area of the temporal-parietal-occipital cortices, and the middle frontal cortex. When comparing novel items with remembered trials, Internet-based searching was associated with higher brain activation in the right orbitofrontal cortex and lower brain activation in the right middle temporal gyrus when facing those novel trials. Brain activations in the middle temporal gyrus were inversely correlated with response times, and brain activations in the orbitofrontal cortex were positively correlated with self-reported search impulses. Taken together, the results suggest that, although Internet-based searching may have facilitated the information-acquisition process, this process may have been performed more hastily and be more prone to difficulties in recollection. In addition, people appear less confident in recalling information learned through Internet searching and that recent Internet searching may promote motivation to use the Internet. © 2015 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Information Security Scheme Based on Computational Temporal Ghost Imaging.

PubMed

Jiang, Shan; Wang, Yurong; Long, Tao; Meng, Xiangfeng; Yang, Xiulun; Shu, Rong; Sun, Baoqing

2017-08-09

An information security scheme based on computational temporal ghost imaging is proposed. A sequence of independent 2D random binary patterns are used as encryption key to multiply with the 1D data stream. The cipher text is obtained by summing the weighted encryption key. The decryption process can be realized by correlation measurement between the encrypted information and the encryption key. Due to the instinct high-level randomness of the key, the security of this method is greatly guaranteed. The feasibility of this method and robustness against both occlusion and additional noise attacks are discussed with simulation, respectively.

A common perceptual temporal limit of binding synchronous inputs across different sensory attributes and modalities

PubMed Central

Fujisaki, Waka; Nishida, Shin'ya

2010-01-01

The human brain processes different aspects of the surrounding environment through multiple sensory modalities, and each modality can be subdivided into multiple attribute-specific channels. When the brain rebinds sensory content information (‘what’) across different channels, temporal coincidence (‘when’) along with spatial coincidence (‘where’) provides a critical clue. It however remains unknown whether neural mechanisms for binding synchronous attributes are specific to each attribute combination, or universal and central. In human psychophysical experiments, we examined how combinations of visual, auditory and tactile attributes affect the temporal frequency limit of synchrony-based binding. The results indicated that the upper limits of cross-attribute binding were lower than those of within-attribute binding, and surprisingly similar for any combination of visual, auditory and tactile attributes (2–3 Hz). They are unlikely to be the limits for judging synchrony, since the temporal limit of a cross-attribute synchrony judgement was higher and varied with the modality combination (4–9 Hz). These findings suggest that cross-attribute temporal binding is mediated by a slow central process that combines separately processed ‘what’ and ‘when’ properties of a single event. While the synchrony performance reflects temporal bottlenecks existing in ‘when’ processing, the binding performance reflects the central temporal limit of integrating ‘when’ and ‘what’ properties. PMID:20335212

The spatial and temporal organization of ubiquitin networks

PubMed Central

Grabbe, Caroline; Husnjak, Koraljka; Dikic, Ivan

2013-01-01

In the past decade, the diversity of signals generated by the ubiquitin system has emerged as a dominant regulator of biological processes and propagation of information in the eukaryotic cell. A wealth of information has been gained about the crucial role of spatial and temporal regulation of ubiquitin species of different lengths and linkages in the nuclear factor-κB (NF-κB) pathway, endocytic trafficking, protein degradation and DNA repair. This spatiotemporal regulation is achieved through sophisticated mechanisms of compartmentalization and sequential series of ubiquitylation events and signal decoding, which control diverse biological processes not only in the cell but also during the development of tissues and entire organisms. PMID:21448225

Can rhythmic auditory cuing remediate language-related deficits in Parkinson's disease?

PubMed

Kotz, Sonja A; Gunter, Thomas C

2015-03-01

Neurodegenerative changes of the basal ganglia in idiopathic Parkinson's disease (IPD) lead to motor deficits as well as general cognitive decline. Given these impairments, the question arises as to whether motor and nonmotor deficits can be ameliorated similarly. We reason that a domain-general sensorimotor circuit involved in temporal processing may support the remediation of such deficits. Following findings that auditory cuing benefits gait kinematics, we explored whether reported language-processing deficits in IPD can also be remediated via auditory cuing. During continuous EEG measurement, an individual diagnosed with IPD heard two types of temporally predictable but metrically different auditory beat-based cues: a march, which metrically aligned with the speech accent structure, a waltz that did not metrically align, or no cue before listening to naturally spoken sentences that were either grammatically well formed or were semantically or syntactically incorrect. Results confirmed that only the cuing with a march led to improved computation of syntactic and semantic information. We infer that a marching rhythm may lead to a stronger engagement of the cerebello-thalamo-cortical circuit that compensates dysfunctional striato-cortical timing. Reinforcing temporal realignment, in turn, may lead to the timely processing of linguistic information embedded in the temporally variable speech signal. © 2014 New York Academy of Sciences.

Semantic and syntactic interoperability in online processing of big Earth observation data.

PubMed

Sudmanns, Martin; Tiede, Dirk; Lang, Stefan; Baraldi, Andrea

2018-01-01

The challenge of enabling syntactic and semantic interoperability for comprehensive and reproducible online processing of big Earth observation (EO) data is still unsolved. Supporting both types of interoperability is one of the requirements to efficiently extract valuable information from the large amount of available multi-temporal gridded data sets. The proposed system wraps world models, (semantic interoperability) into OGC Web Processing Services (syntactic interoperability) for semantic online analyses. World models describe spatio-temporal entities and their relationships in a formal way. The proposed system serves as enabler for (1) technical interoperability using a standardised interface to be used by all types of clients and (2) allowing experts from different domains to develop complex analyses together as collaborative effort. Users are connecting the world models online to the data, which are maintained in a centralised storage as 3D spatio-temporal data cubes. It allows also non-experts to extract valuable information from EO data because data management, low-level interactions or specific software issues can be ignored. We discuss the concept of the proposed system, provide a technical implementation example and describe three use cases for extracting changes from EO images and demonstrate the usability also for non-EO, gridded, multi-temporal data sets (CORINE land cover).

Semantic and syntactic interoperability in online processing of big Earth observation data

PubMed Central

Sudmanns, Martin; Tiede, Dirk; Lang, Stefan; Baraldi, Andrea

2018-01-01

ABSTRACT The challenge of enabling syntactic and semantic interoperability for comprehensive and reproducible online processing of big Earth observation (EO) data is still unsolved. Supporting both types of interoperability is one of the requirements to efficiently extract valuable information from the large amount of available multi-temporal gridded data sets. The proposed system wraps world models, (semantic interoperability) into OGC Web Processing Services (syntactic interoperability) for semantic online analyses. World models describe spatio-temporal entities and their relationships in a formal way. The proposed system serves as enabler for (1) technical interoperability using a standardised interface to be used by all types of clients and (2) allowing experts from different domains to develop complex analyses together as collaborative effort. Users are connecting the world models online to the data, which are maintained in a centralised storage as 3D spatio-temporal data cubes. It allows also non-experts to extract valuable information from EO data because data management, low-level interactions or specific software issues can be ignored. We discuss the concept of the proposed system, provide a technical implementation example and describe three use cases for extracting changes from EO images and demonstrate the usability also for non-EO, gridded, multi-temporal data sets (CORINE land cover). PMID:29387171

Spatiotemporal Processing in Crossmodal Interactions for Perception of the External World: A Review

PubMed Central

Hidaka, Souta; Teramoto, Wataru; Sugita, Yoichi

2015-01-01

Research regarding crossmodal interactions has garnered much interest in the last few decades. A variety of studies have demonstrated that multisensory information (vision, audition, tactile sensation, and so on) can perceptually interact with each other in the spatial and temporal domains. Findings regarding crossmodal interactions in the spatiotemporal domain (i.e., motion processing) have also been reported, with updates in the last few years. In this review, we summarize past and recent findings on spatiotemporal processing in crossmodal interactions regarding perception of the external world. A traditional view regarding crossmodal interactions holds that vision is superior to audition in spatial processing, but audition is dominant over vision in temporal processing. Similarly, vision is considered to have dominant effects over the other sensory modalities (i.e., visual capture) in spatiotemporal processing. However, recent findings demonstrate that sound could have a driving effect on visual motion perception. Moreover, studies regarding perceptual associative learning reported that, after association is established between a sound sequence without spatial information and visual motion information, the sound sequence could trigger visual motion perception. Other sensory information, such as motor action or smell, has also exhibited similar driving effects on visual motion perception. Additionally, recent brain imaging studies demonstrate that similar activation patterns could be observed in several brain areas, including the motion processing areas, between spatiotemporal information from different sensory modalities. Based on these findings, we suggest that multimodal information could mutually interact in spatiotemporal processing in the percept of the external world and that common perceptual and neural underlying mechanisms would exist for spatiotemporal processing. PMID:26733827

Interhemispheric coupling between the posterior sylvian regions impacts successful auditory temporal order judgment.

PubMed

Bernasconi, Fosco; Grivel, Jeremy; Murray, Micah M; Spierer, Lucas

2010-07-01

Accurate perception of the temporal order of sensory events is a prerequisite in numerous functions ranging from language comprehension to motor coordination. We investigated the spatio-temporal brain dynamics of auditory temporal order judgment (aTOJ) using electrical neuroimaging analyses of auditory evoked potentials (AEPs) recorded while participants completed a near-threshold task requiring spatial discrimination of left-right and right-left sound sequences. AEPs to sound pairs modulated topographically as a function of aTOJ accuracy over the 39-77ms post-stimulus period, indicating the engagement of distinct configurations of brain networks during early auditory processing stages. Source estimations revealed that accurate and inaccurate performance were linked to bilateral posterior sylvian regions activity (PSR). However, activity within left, but not right, PSR predicted behavioral performance suggesting that left PSR activity during early encoding phases of pairs of auditory spatial stimuli appears critical for the perception of their order of occurrence. Correlation analyses of source estimations further revealed that activity between left and right PSR was significantly correlated in the inaccurate but not accurate condition, indicating that aTOJ accuracy depends on the functional decoupling between homotopic PSR areas. These results support a model of temporal order processing wherein behaviorally relevant temporal information--i.e. a temporal 'stamp'--is extracted within the early stages of cortical processes within left PSR but critically modulated by inputs from right PSR. We discuss our results with regard to current models of temporal of temporal order processing, namely gating and latency mechanisms. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Surfing a spike wave down the ventral stream.

PubMed

VanRullen, Rufin; Thorpe, Simon J

2002-10-01

Numerous theories of neural processing, often motivated by experimental observations, have explored the computational properties of neural codes based on the absolute or relative timing of spikes in spike trains. Spiking neuron models and theories however, as well as their experimental counterparts, have generally been limited to the simulation or observation of isolated neurons, isolated spike trains, or reduced neural populations. Such theories would therefore seem inappropriate to capture the properties of a neural code relying on temporal spike patterns distributed across large neuronal populations. Here we report a range of computer simulations and theoretical considerations that were designed to explore the possibilities of one such code and its relevance for visual processing. In a unified framework where the relation between stimulus saliency and spike relative timing plays the central role, we describe how the ventral stream of the visual system could process natural input scenes and extract meaningful information, both rapidly and reliably. The first wave of spikes generated in the retina in response to a visual stimulation carries information explicitly in its spatio-temporal structure: the most salient information is represented by the first spikes over the population. This spike wave, propagating through a hierarchy of visual areas, is regenerated at each processing stage, where its temporal structure can be modified by (i). the selectivity of the cortical neurons, (ii). lateral interactions and (iii). top-down attentional influences from higher order cortical areas. The resulting model could account for the remarkable efficiency and rapidity of processing observed in the primate visual system.

Conceptual knowledge in the interpretation of idioms.

PubMed

Nayak, N P; Gibbs, R W

1990-09-01

The authors examined how people determine the contextual appropriateness of idioms. In Experiment 1, idioms referring to the same temporal stage of a conceptual prototype were judged to be more similar in meaning than idioms referring to different temporal stages. In Experiment 2, idioms in a prototypical temporal sequence were more meaningful than idioms in sentences that violated the temporal sequence. In Experiment 3, idioms referring to the same stage of a conceptual prototype were differentiable on the basis of conceptual information. The conceptual coherence between idioms and contexts facilitated the processing speed of idioms in Experiment 4. Experiment 5 showed that speakers can recover the underlying conceptual metaphors that link an idiom to its figurative meaning. Experiment 6 showed that the metaphoric information reflected in the lexical makeup of idioms also determined the metaphoric appropriateness of idioms in certain contexts.

Listeners modulate temporally selective attention during natural speech processing

PubMed Central

Astheimer, Lori B.; Sanders, Lisa D.

2009-01-01

Spatially selective attention allows for the preferential processing of relevant stimuli when more information than can be processed in detail is presented simultaneously at distinct locations. Temporally selective attention may serve a similar function during speech perception by allowing listeners to allocate attentional resources to time windows that contain highly relevant acoustic information. To test this hypothesis, event-related potentials were compared in response to attention probes presented in six conditions during a narrative: concurrently with word onsets, beginning 50 and 100 ms before and after word onsets, and at random control intervals. Times for probe presentation were selected such that the acoustic environments of the narrative were matched for all conditions. Linguistic attention probes presented at and immediately following word onsets elicited larger amplitude N1s than control probes over medial and anterior regions. These results indicate that native speakers selectively process sounds presented at specific times during normal speech perception. PMID:18395316

Cognitive abilities required in time judgment depending on the temporal tasks used: A comparison of children and adults.

PubMed

Droit-Volet, S; Wearden, J H; Zélanti, P S

2015-01-01

The aim of this study was to examine age-related differences in time judgments during childhood as a function of the temporal task used. Children aged 5 and 8 years, as well as adults, were submitted to 3 temporal tasks (bisection, generalization and reproduction) with short (0.4/0.8 s) and long durations (8/16 s). Furthermore, their cognitive capacities in terms of working memory, attentional control, and processing speed were assessed by a wide battery of neuropsychological tests. The results showed that the age-related differences in time judgment were greater in the reproduction task than in the temporal discrimination tasks. This task was indeed more demanding in terms of working memory and information processing speed. In addition, the bisection task appeared to be easier for children than the generalization task, whereas these 2 tasks were similar for the adults, although the generalization task required more attention to be paid to the processing of durations. Our study thus demonstrates that it is important to understand the different cognitive processes involved in time judgment as a function of the temporal tasks used before venturing to draw conclusions about the development of time perception capabilities.

[False recognition of faces associated with fronto-temporal dementia with prosopagnosia].

PubMed

Verstichel, P

2005-09-01

The association of prosopagnosia and false recognition of faces is unusual and contributes to our understanding of the generation of facial familiarity. A 67-year-old man with a left prefrontal traumatic lesion, developed a temporal variety of fronto-temporal dementia (semantic dementia) with amyotrophic lateral sclerosis. Cerebral imagery demonstrated a bilateral, temporal anterior atrophy predominating in the right hemisphere. The main cognitive signs consisted in severe difficulties to recognize faces of familiar people (prosopagnosia), associated with systematic false recognition of unfamiliar people. Neuropsychological testing indicated that the prosopagnosia probably resulted from the association of an associative/mnemonic mechanism (inability to activate the Face Recognition Units (FRU) from the visual input) and a semantic mechanism (degradation of semantic/biographical information or deconnexion between FRU and this information). At the early stage of the disease, the patient could activate residual semantic information about individuals from their names, but after a 4-year course, he failed to do so. This worsening could be attributed to the extension of the degenerative lesions to the left temporal lobe. Familiar and unfamiliar faces triggered a marked feeling of knowing. False recognition concerned all the unfamiliar faces, and the patient claimed spontaneously that they corresponded to actors, but he could not provide any additional information about their specific identities. The coexistence of prosopagnosia and false recognition suggests the existence of different interconnected systems processing face recognition, one intended to identification of individuals, and the other producing the sense of familiarity. Dysfunctions at different stages of one or the other of these two processes could result in distortions in the feeling of knowing. From this case and others reported in literature, we propose to complete the classical model of face processing by adding a pathway linked to limbic system and frontal structures. This later pathway could normally emit signals for familiarity, essentially autonomic, in response to the familiar faces. These signals, primitively unconscious, secondly reach consciousness and are then integrated by a central supervisor system which evaluates and verifies identity-specific biographical information in order to make a decision about the sense of familiarity.

Network modulation during complex syntactic processing

PubMed Central

den Ouden, Dirk-Bart; Saur, Dorothee; Mader, Wolfgang; Schelter, Björn; Lukic, Sladjana; Wali, Eisha; Timmer, Jens; Thompson, Cynthia K.

2011-01-01

Complex sentence processing is supported by a left-lateralized neural network including inferior frontal cortex and posterior superior temporal cortex. This study investigates the pattern of connectivity and information flow within this network. We used fMRI BOLD data derived from 12 healthy participants reported in an earlier study (Thompson, C. K., Den Ouden, D. B., Bonakdarpour, B., Garibaldi, K., & Parrish, T. B. (2010b). Neural plasticity and treatment-induced recovery of sentence processing in agrammatism. Neuropsychologia, 48(11), 3211-3227) to identify activation peaks associated with object-cleft over syntactically less complex subject-cleft processing. Directed Partial Correlation Analysis was conducted on time series extracted from participant-specific activation peaks and showed evidence of functional connectivity between four regions, linearly between premotor cortex, inferior frontal gyrus, posterior superior temporal sulcus and anterior middle temporal gyrus. This pattern served as the basis for Dynamic Causal Modeling of networks with a driving input to posterior superior temporal cortex, which likely supports thematic role assignment, and networks with a driving input to inferior frontal cortex, a core region associated with syntactic computation. The optimal model was determined through both frequentist and Bayesian model selection and turned out to reflect a network with a primary drive from inferior frontal cortex and modulation of the connection between inferior frontal and posterior superior temporal cortex by complex sentence processing. The winning model also showed a substantive role for a feedback mechanism from posterior superior temporal cortex back to inferior frontal cortex. We suggest that complex syntactic processing is driven by word-order analysis, supported by inferior frontal cortex, in an interactive relation with posterior superior temporal cortex, which supports verb argument structure processing. PMID:21820518

Hearing and seeing meaning in speech and gesture: insights from brain and behaviour

PubMed Central

Özyürek, Aslı

2014-01-01

As we speak, we use not only the arbitrary form–meaning mappings of the speech channel but also motivated form–meaning correspondences, i.e. iconic gestures that accompany speech (e.g. inverted V-shaped hand wiggling across gesture space to demonstrate walking). This article reviews what we know about processing of semantic information from speech and iconic gestures in spoken languages during comprehension of such composite utterances. Several studies have shown that comprehension of iconic gestures involves brain activations known to be involved in semantic processing of speech: i.e. modulation of the electrophysiological recording component N400, which is sensitive to the ease of semantic integration of a word to previous context, and recruitment of the left-lateralized frontal–posterior temporal network (left inferior frontal gyrus (IFG), medial temporal gyrus (MTG) and superior temporal gyrus/sulcus (STG/S)). Furthermore, we integrate the information coming from both channels recruiting brain areas such as left IFG, posterior superior temporal sulcus (STS)/MTG and even motor cortex. Finally, this integration is flexible: the temporal synchrony between the iconic gesture and the speech segment, as well as the perceived communicative intent of the speaker, modulate the integration process. Whether these findings are special to gestures or are shared with actions or other visual accompaniments to speech (e.g. lips) or other visual symbols such as pictures are discussed, as well as the implications for a multimodal view of language. PMID:25092664

Hearing and seeing meaning in speech and gesture: insights from brain and behaviour.

PubMed

Özyürek, Aslı

2014-09-19

As we speak, we use not only the arbitrary form-meaning mappings of the speech channel but also motivated form-meaning correspondences, i.e. iconic gestures that accompany speech (e.g. inverted V-shaped hand wiggling across gesture space to demonstrate walking). This article reviews what we know about processing of semantic information from speech and iconic gestures in spoken languages during comprehension of such composite utterances. Several studies have shown that comprehension of iconic gestures involves brain activations known to be involved in semantic processing of speech: i.e. modulation of the electrophysiological recording component N400, which is sensitive to the ease of semantic integration of a word to previous context, and recruitment of the left-lateralized frontal-posterior temporal network (left inferior frontal gyrus (IFG), medial temporal gyrus (MTG) and superior temporal gyrus/sulcus (STG/S)). Furthermore, we integrate the information coming from both channels recruiting brain areas such as left IFG, posterior superior temporal sulcus (STS)/MTG and even motor cortex. Finally, this integration is flexible: the temporal synchrony between the iconic gesture and the speech segment, as well as the perceived communicative intent of the speaker, modulate the integration process. Whether these findings are special to gestures or are shared with actions or other visual accompaniments to speech (e.g. lips) or other visual symbols such as pictures are discussed, as well as the implications for a multimodal view of language. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

Domain-specific perceptual causality in children depends on the spatio-temporal configuration, not motion onset

PubMed Central

Schlottmann, Anne; Cole, Katy; Watts, Rhianna; White, Marina

2013-01-01

Humans, even babies, perceive causality when one shape moves briefly and linearly after another. Motion timing is crucial in this and causal impressions disappear with short delays between motions. However, the role of temporal information is more complex: it is both a cue to causality and a factor that constrains processing. It affects ability to distinguish causality from non-causality, and social from mechanical causality. Here we study both issues with 3- to 7-year-olds and adults who saw two computer-animated squares and chose if a picture of mechanical, social or non-causality fit each event best. Prior work fit with the standard view that early in development, the distinction between the social and physical domains depends mainly on whether or not the agents make contact, and that this reflects concern with domain-specific motion onset, in particular, whether the motion is self-initiated or not. The present experiments challenge both parts of this position. In Experiments 1 and 2, we showed that not just spatial, but also animacy and temporal information affect how children distinguish between physical and social causality. In Experiments 3 and 4 we showed that children do not seem to use spatio-temporal information in perceptual causality to make inferences about self- or other-initiated motion onset. Overall, spatial contact may be developmentally primary in domain-specific perceptual causality in that it is processed easily and is dominant over competing cues, but it is not the only cue used early on and it is not used to infer motion onset. Instead, domain-specific causal impressions may be automatic reactions to specific perceptual configurations, with a complex role for temporal information. PMID:23874308

Verbal Memory Compensation: Application to Left and Right Temporal Lobe Epileptic Patients

ERIC Educational Resources Information Center

Bresson, Christel; Lespinet-Najib, Veronique; Rougier, Alain; Claverie, Bernard; N'Kaoua, Bernard

2007-01-01

This study investigates the compensatory impact of cognitive aids on left and right temporal lobe epileptic patients suffering from verbal memory disorders, who were candidates for surgery. Cognitive aids are defined in the levels-of-processing framework and deal with the depth of encoding, the elaboration of information, and the use of retrieval…

The Representation of Information about Faces in the Temporal and Frontal Lobes

ERIC Educational Resources Information Center

Rolls, Edmund T.

2007-01-01

Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size and view of faces and objects, and that these neurons show rapid processing and rapid learning. Which face or object is present is encoded using a distributed…

Contributions of Low and High Spatial Frequency Processing to Impaired Object Recognition Circuitry in Schizophrenia

PubMed Central

Calderone, Daniel J.; Hoptman, Matthew J.; Martínez, Antígona; Nair-Collins, Sangeeta; Mauro, Cristina J.; Bar, Moshe; Javitt, Daniel C.; Butler, Pamela D.

2013-01-01

Patients with schizophrenia exhibit cognitive and sensory impairment, and object recognition deficits have been linked to sensory deficits. The “frame and fill” model of object recognition posits that low spatial frequency (LSF) information rapidly reaches the prefrontal cortex (PFC) and creates a general shape of an object that feeds back to the ventral temporal cortex to assist object recognition. Visual dysfunction findings in schizophrenia suggest a preferential loss of LSF information. This study used functional magnetic resonance imaging (fMRI) and resting state functional connectivity (RSFC) to investigate the contribution of visual deficits to impaired object “framing” circuitry in schizophrenia. Participants were shown object stimuli that were intact or contained only LSF or high spatial frequency (HSF) information. For controls, fMRI revealed preferential activation to LSF information in precuneus, superior temporal, and medial and dorsolateral PFC areas, whereas patients showed a preference for HSF information or no preference. RSFC revealed a lack of connectivity between early visual areas and PFC for patients. These results demonstrate impaired processing of LSF information during object recognition in schizophrenia, with patients instead displaying increased processing of HSF information. This is consistent with findings of a preference for local over global visual information in schizophrenia. PMID:22735157

Investigating the dimension of time: findings from a modified grounded theory study about clients' experiences and descriptions of temporality or time within music therapy.

PubMed

Daveson, Barbara; O'Callaghan, Clare

2011-01-01

Many references to time or temporality are located within music therapy literature, however little research has been completed regarding this phenomenon. Findings from a modified grounded theory study about clients' experiences and descriptions of time within the context of music therapy are presented here. The study was informed by the constructivist-interpretive paradigm and a grounded-descriptive statement finding resulted. A 2-staged research methodology was used, comprising a deductive-inductive content analysis of information from the public domain, followed by data-mining of information from a minimum of 160 clients and analysis of data from at least 43 of these 160 clients. Information regarding memory experiences, the duration of music therapy effects, recall and retrieval, and experiences of time are identified. Implications for practice are emphasized, in particular the following is stressed (a) the importance of time orientation and temporal connectedness in relation to identity development, (b) temporal strategies within music experience to assist integration, recall, and retrieval of information, and (c) the importance of and the elements involved in time modification. New explanations for music therapy phenomena are shared, and areas for research highlighted. Benefits of using time dynamically to aid therapeutic process are proposed, and it is concluded that temporal experience within the context of music therapy is important in relation to both practice and research.

Processing short-term and long-term information with a combination of polynomial approximation techniques and time-delay neural networks.

PubMed

Fuchs, Erich; Gruber, Christian; Reitmaier, Tobias; Sick, Bernhard

2009-09-01

Neural networks are often used to process temporal information, i.e., any kind of information related to time series. In many cases, time series contain short-term and long-term trends or behavior. This paper presents a new approach to capture temporal information with various reference periods simultaneously. A least squares approximation of the time series with orthogonal polynomials will be used to describe short-term trends contained in a signal (average, increase, curvature, etc.). Long-term behavior will be modeled with the tapped delay lines of a time-delay neural network (TDNN). This network takes the coefficients of the orthogonal expansion of the approximating polynomial as inputs such considering short-term and long-term information efficiently. The advantages of the method will be demonstrated by means of artificial data and two real-world application examples, the prediction of the user number in a computer network and online tool wear classification in turning.

Demultiplexing of photonic temporal modes by a linear system

NASA Astrophysics Data System (ADS)

Xu, Shuang; Shen, H. Z.; Yi, X. X.

2018-03-01

Temporally and spatially overlapping but field-orthogonal photonic temporal modes (TMs) that intrinsically span a high-dimensional Hilbert space are recently suggested as a promising means of encoding information on photons. Presently, the realization of photonic TM technology, particularly to retrieve the information it carries, i.e., demultiplexing of photonic TMs, is mostly dependent on nonlinear medium and frequency conversion. Meanwhile, its miniaturization, simplification, and optimization remain the focus of research. In this paper, we propose a scheme of TM demultiplexing using linear systems consisting of resonators with linear couplings. Specifically, we examine a unidirectional array of identical resonators with short environment correlations. For both situations with and without tunable couplers, propagation formulas are derived to demonstrate photonic TM demultiplexing capabilities. The proposed scheme, being entirely feasible with current technologies, might find potential applications in quantum information processing.

Temporally selective attention supports speech processing in 3- to 5-year-old children.

PubMed

Astheimer, Lori B; Sanders, Lisa D

2012-01-01

Recent event-related potential (ERP) evidence demonstrates that adults employ temporally selective attention to preferentially process the initial portions of words in continuous speech. Doing so is an effective listening strategy since word-initial segments are highly informative. Although the development of this process remains unexplored, directing attention to word onsets may be important for speech processing in young children who would otherwise be overwhelmed by the rapidly changing acoustic signals that constitute speech. We examined the use of temporally selective attention in 3- to 5-year-old children listening to stories by comparing ERPs elicited by attention probes presented at four acoustically matched times relative to word onsets: concurrently with a word onset, 100 ms before, 100 ms after, and at random control times. By 80 ms, probes presented at and after word onsets elicited a larger negativity than probes presented before word onsets or at control times. The latency and distribution of this effect is similar to temporally and spatially selective attention effects measured in adults and, despite differences in polarity, spatially selective attention effects measured in children. These results indicate that, like adults, preschool aged children modulate temporally selective attention to preferentially process the initial portions of words in continuous speech. Copyright © 2011 Elsevier Ltd. All rights reserved.

Temporal order processing of syllables in the left parietal lobe.

PubMed

Moser, Dana; Baker, Julie M; Sanchez, Carmen E; Rorden, Chris; Fridriksson, Julius

2009-10-07

Speech processing requires the temporal parsing of syllable order. Individuals suffering from posterior left hemisphere brain injury often exhibit temporal processing deficits as well as language deficits. Although the right posterior inferior parietal lobe has been implicated in temporal order judgments (TOJs) of visual information, there is limited evidence to support the role of the left inferior parietal lobe (IPL) in processing syllable order. The purpose of this study was to examine whether the left inferior parietal lobe is recruited during temporal order judgments of speech stimuli. Functional magnetic resonance imaging data were collected on 14 normal participants while they completed the following forced-choice tasks: (1) syllable order of multisyllabic pseudowords, (2) syllable identification of single syllables, and (3) gender identification of both multisyllabic and monosyllabic speech stimuli. Results revealed increased neural recruitment in the left inferior parietal lobe when participants made judgments about syllable order compared with both syllable identification and gender identification. These findings suggest that the left inferior parietal lobe plays an important role in processing syllable order and support the hypothesized role of this region as an interface between auditory speech and the articulatory code. Furthermore, a breakdown in this interface may explain some components of the speech deficits observed after posterior damage to the left hemisphere.

Temporal Order Processing of Syllables in the Left Parietal Lobe

PubMed Central

Baker, Julie M.; Sanchez, Carmen E.; Rorden, Chris; Fridriksson, Julius

2009-01-01

Speech processing requires the temporal parsing of syllable order. Individuals suffering from posterior left hemisphere brain injury often exhibit temporal processing deficits as well as language deficits. Although the right posterior inferior parietal lobe has been implicated in temporal order judgments (TOJs) of visual information, there is limited evidence to support the role of the left inferior parietal lobe (IPL) in processing syllable order. The purpose of this study was to examine whether the left inferior parietal lobe is recruited during temporal order judgments of speech stimuli. Functional magnetic resonance imaging data were collected on 14 normal participants while they completed the following forced-choice tasks: (1) syllable order of multisyllabic pseudowords, (2) syllable identification of single syllables, and (3) gender identification of both multisyllabic and monosyllabic speech stimuli. Results revealed increased neural recruitment in the left inferior parietal lobe when participants made judgments about syllable order compared with both syllable identification and gender identification. These findings suggest that the left inferior parietal lobe plays an important role in processing syllable order and support the hypothesized role of this region as an interface between auditory speech and the articulatory code. Furthermore, a breakdown in this interface may explain some components of the speech deficits observed after posterior damage to the left hemisphere. PMID:19812331

Time-Warp–Invariant Neuronal Processing

PubMed Central

Gütig, Robert; Sompolinsky, Haim

2009-01-01

Fluctuations in the temporal durations of sensory signals constitute a major source of variability within natural stimulus ensembles. The neuronal mechanisms through which sensory systems can stabilize perception against such fluctuations are largely unknown. An intriguing instantiation of such robustness occurs in human speech perception, which relies critically on temporal acoustic cues that are embedded in signals with highly variable duration. Across different instances of natural speech, auditory cues can undergo temporal warping that ranges from 2-fold compression to 2-fold dilation without significant perceptual impairment. Here, we report that time-warp–invariant neuronal processing can be subserved by the shunting action of synaptic conductances that automatically rescales the effective integration time of postsynaptic neurons. We propose a novel spike-based learning rule for synaptic conductances that adjusts the degree of synaptic shunting to the temporal processing requirements of a given task. Applying this general biophysical mechanism to the example of speech processing, we propose a neuronal network model for time-warp–invariant word discrimination and demonstrate its excellent performance on a standard benchmark speech-recognition task. Our results demonstrate the important functional role of synaptic conductances in spike-based neuronal information processing and learning. The biophysics of temporal integration at neuronal membranes can endow sensory pathways with powerful time-warp–invariant computational capabilities. PMID:19582146

Exploring the structure and function of temporal networks with dynamic graphlets

PubMed Central

Hulovatyy, Y.; Chen, H.; Milenković, T.

2015-01-01

Motivation: With increasing availability of temporal real-world networks, how to efficiently study these data? One can model a temporal network as a single aggregate static network, or as a series of time-specific snapshots, each being an aggregate static network over the corresponding time window. Then, one can use established methods for static analysis on the resulting aggregate network(s), but losing in the process valuable temporal information either completely, or at the interface between different snapshots, respectively. Here, we develop a novel approach for studying a temporal network more explicitly, by capturing inter-snapshot relationships. Results: We base our methodology on well-established graphlets (subgraphs), which have been proven in numerous contexts in static network research. We develop new theory to allow for graphlet-based analyses of temporal networks. Our new notion of dynamic graphlets is different from existing dynamic network approaches that are based on temporal motifs (statistically significant subgraphs). The latter have limitations: their results depend on the choice of a null network model that is required to evaluate the significance of a subgraph, and choosing a good null model is non-trivial. Our dynamic graphlets overcome the limitations of the temporal motifs. Also, when we aim to characterize the structure and function of an entire temporal network or of individual nodes, our dynamic graphlets outperform the static graphlets. Clearly, accounting for temporal information helps. We apply dynamic graphlets to temporal age-specific molecular network data to deepen our limited knowledge about human aging. Availability and implementation: http://www.nd.edu/∼cone/DG. Contact: tmilenko@nd.edu Supplementary information: Supplementary data are available at Bioinformatics online. PMID:26072480

PANTHER. Pattern ANalytics To support High-performance Exploitation and Reasoning.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Czuchlewski, Kristina Rodriguez; Hart, William E.

Sandia has approached the analysis of big datasets with an integrated methodology that uses computer science, image processing, and human factors to exploit critical patterns and relationships in large datasets despite the variety and rapidity of information. The work is part of a three-year LDRD Grand Challenge called PANTHER (Pattern ANalytics To support High-performance Exploitation and Reasoning). To maximize data analysis capability, Sandia pursued scientific advances across three key technical domains: (1) geospatial-temporal feature extraction via image segmentation and classification; (2) geospatial-temporal analysis capabilities tailored to identify and process new signatures more efficiently; and (3) domain- relevant models of humanmore » perception and cognition informing the design of analytic systems. Our integrated results include advances in geographical information systems (GIS) in which we discover activity patterns in noisy, spatial-temporal datasets using geospatial-temporal semantic graphs. We employed computational geometry and machine learning to allow us to extract and predict spatial-temporal patterns and outliers from large aircraft and maritime trajectory datasets. We automatically extracted static and ephemeral features from real, noisy synthetic aperture radar imagery for ingestion into a geospatial-temporal semantic graph. We worked with analysts and investigated analytic workflows to (1) determine how experiential knowledge evolves and is deployed in high-demand, high-throughput visual search workflows, and (2) better understand visual search performance and attention. Through PANTHER, Sandia's fundamental rethinking of key aspects of geospatial data analysis permits the extraction of much richer information from large amounts of data. The project results enable analysts to examine mountains of historical and current data that would otherwise go untouched, while also gaining meaningful, measurable, and defensible insights into overlooked relationships and patterns. The capability is directly relevant to the nation's nonproliferation remote-sensing activities and has broad national security applications for military and intelligence- gathering organizations.« less

Temporal pattern processing in songbirds.

PubMed

Comins, Jordan A; Gentner, Timothy Q

2014-10-01

Understanding how the brain perceives, organizes and uses patterned information is directly related to the neurobiology of language. Given the present limitations, such knowledge at the scale of neurons, neural circuits and neural populations can only come from non-human models, focusing on shared capacities that are relevant to language processing. Here we review recent advances in the behavioral and neural basis of temporal pattern processing of natural auditory communication signals in songbirds, focusing on European starlings. We suggest a general inhibitory circuit for contextual modulation that can act to control sensory representations based on patterning rules. Copyright © 2014. Published by Elsevier Ltd.

FIBRE AND INTEGRATED OPTICS. OPTICAL PROCESSING OF INFORMATION: Method for optical data processing based on a two-pulse photon echo

NASA Astrophysics Data System (ADS)

Zakharov, S. M.; Manykin, Eduard A.

1995-02-01

The principles of optical processing based on dynamic spatial—temporal properties of two-pulse photon echo signals are considered. The properties of a resonant medium as an on-line filter of temporal and spatial frequencies are discussed. These properties are due to the sensitivity of such a medium to the Fourier spectrum of the second exiting pulse. Degeneracy of quantum resonant systems, demonstrated by the coherent response dependence on the square of the amplitude of the second pulse, can be used for 'simultaneous' correlation processing of optical 'signals'. Various methods for the processing of the Fourier optical image are discussed.

Multivoxel pattern similarity suggests the integration of temporal duration in hippocampal event sequence representations.

PubMed

Thavabalasingam, Sathesan; O'Neil, Edward B; Lee, Andy C H

2018-05-22

Recent rodent work suggests the hippocampus may provide a temporal representation of event sequences, in which the order of events and the interval durations between them are encoded. There is, however, limited human evidence for the latter, in particular whether the hippocampus processes duration information pertaining to the passage of time rather than qualitative or quantitative changes in event content. We scanned participants while they made match-mismatch judgements on each trial between a study sequence of events and a subsequent test sequence. Participants explicitly remembered event order or interval duration information (Experiment 1), or monitored order only, with duration being manipulated implicitly (Experiment 2). Hippocampal study-test pattern similarity was significantly reduced by changes to order or duration in mismatch trials, even when duration was processed implicitly. Our findings suggest the human hippocampus processes short intervals within sequences and support the idea that duration information is integrated into hippocampal mnemonic representations. Copyright © 2018 Elsevier Inc. All rights reserved.

Does Temporal Integration of Face Parts Reflect Holistic Processing?

PubMed Central

Cheung, Olivia S.; Richler, Jennifer J.; Phillips, W. Stewart; Gauthier, Isabel

2011-01-01

We examined whether temporal integration of face parts reflects holistic processing or response interference. Participants learned to name two faces “Fred” and two “Bob”. At test, top and bottom halves of different faces formed composites and were presented briefly separated in time. Replicating prior findings (Singer & Sheinberg, 2006), naming of the target halves for aligned composites was slowed when the irrelevant halves were from faces with a different name compared to that from the original face. However, no interference was observed when the irrelevant halves had identical names as the target halves but came from different learned faces, arguing against a true holistic effect. Instead, response interference was obtained when the target halves briefly preceded the irrelevant halves. Experiment 2 confirmed a double-dissociation between holistic processing vs. response interference for intact faces vs. temporally separated face halves, suggesting that simultaneous presentation of facial information is critical for holistic processing. PMID:21327378

Spatial temporal clustering for hotspot using kulldorff scan statistic method (KSS): A case in Riau Province

NASA Astrophysics Data System (ADS)

Hudjimartsu, S. A.; Djatna, T.; Ambarwari, A.; Apriliantono

2017-01-01

The forest fires in Indonesia occurs frequently in the dry season. Almost all the causes of forest fires are caused by the human activity itself. The impact of forest fires is the loss of biodiversity, pollution hazard and harm the economy of surrounding communities. To prevent fires required the method, one of them with spatial temporal clustering. Spatial temporal clustering formed grouping data so that the results of these groupings can be used as initial information on fire prevention. To analyze the fires, used hotspot data as early indicator of fire spot. Hotspot data consists of spatial and temporal dimensions can be processed using the Spatial Temporal Clustering with Kulldorff Scan Statistic (KSS). The result of this research is to the effectiveness of KSS method to cluster spatial hotspot in a case within Riau Province and produces two types of clusters, most cluster and secondary cluster. This cluster can be used as an early fire warning information.

Transcranial Direct Current Stimulation Effects on Semantic Processing in Healthy Individuals.

PubMed

Joyal, Marilyne; Fecteau, Shirley

2016-01-01

Semantic processing allows us to use conceptual knowledge about the world. It has been associated with a large distributed neural network that includes the frontal, temporal and parietal cortices. Recent studies using transcranial direct current stimulation (tDCS) also contributed at investigating semantic processing. The goal of this article was to review studies investigating semantic processing in healthy individuals with tDCS and discuss findings from these studies in line with neuroimaging results. Based on functional magnetic resonance imaging studies assessing semantic processing, we predicted that tDCS applied over the inferior frontal gyrus, middle temporal gyrus, and posterior parietal cortex will impact semantic processing. We conducted a search on Pubmed and selected 27 articles in which tDCS was used to modulate semantic processing in healthy subjects. We analysed each article according to these criteria: demographic information, experimental outcomes assessing semantic processing, study design, and effects of tDCS on semantic processes. From the 27 reviewed studies, 8 found main effects of stimulation. In addition to these 8 studies, 17 studies reported an interaction between stimulus types and stimulation conditions (e.g. incoherent functional, but not instrumental, actions were processed faster when anodal tDCS was applied over the posterior parietal cortex as compared to sham tDCS). Results suggest that regions in the frontal, temporal, and parietal cortices are involved in semantic processing. tDCS can modulate some aspects of semantic processing and provide information on the functional roles of brain regions involved in this cognitive process. Copyright © 2016 Elsevier Inc. All rights reserved.

Decoding Face Information in Time, Frequency and Space from Direct Intracranial Recordings of the Human Brain

PubMed Central

Oya, Hiroyuki; Howard, Matthew A.; Adolphs, Ralph

2008-01-01

Faces are processed by a neural system with distributed anatomical components, but the roles of these components remain unclear. A dominant theory of face perception postulates independent representations of invariant aspects of faces (e.g., identity) in ventral temporal cortex including the fusiform gyrus, and changeable aspects of faces (e.g., emotion) in lateral temporal cortex including the superior temporal sulcus. Here we recorded neuronal activity directly from the cortical surface in 9 neurosurgical subjects undergoing epilepsy monitoring while they viewed static and dynamic facial expressions. Applying novel decoding analyses to the power spectrogram of electrocorticograms (ECoG) from over 100 contacts in ventral and lateral temporal cortex, we found better representation of both invariant and changeable aspects of faces in ventral than lateral temporal cortex. Critical information for discriminating faces from geometric patterns was carried by power modulations between 50 to 150 Hz. For both static and dynamic face stimuli, we obtained a higher decoding performance in ventral than lateral temporal cortex. For discriminating fearful from happy expressions, critical information was carried by power modulation between 60–150 Hz and below 30 Hz, and again better decoded in ventral than lateral temporal cortex. Task-relevant attention improved decoding accuracy more than10% across a wide frequency range in ventral but not at all in lateral temporal cortex. Spatial searchlight decoding showed that decoding performance was highest around the middle fusiform gyrus. Finally, we found that the right hemisphere, in general, showed superior decoding to the left hemisphere. Taken together, our results challenge the dominant model for independent face representation of invariant and changeable aspects: information about both face attributes was better decoded from a single region in the middle fusiform gyrus. PMID:19065268

The signer and the sign: cortical correlates of person identity and language processing from point-light displays.

PubMed

Campbell, Ruth; Capek, Cheryl M; Gazarian, Karine; MacSweeney, Mairéad; Woll, Bencie; David, Anthony S; McGuire, Philip K; Brammer, Michael J

2011-09-01

In this study, the first to explore the cortical correlates of signed language (SL) processing under point-light display conditions, the observer identified either a signer or a lexical sign from a display in which different signers were seen producing a number of different individual signs. Many of the regions activated by point-light under these conditions replicated those previously reported for full-image displays, including regions within the inferior temporal cortex that are specialised for face and body-part identification, although such body parts were invisible in the display. Right frontal regions were also recruited - a pattern not usually seen in full-image SL processing. This activation may reflect the recruitment of information about person identity from the reduced display. A direct comparison of identify-signer and identify-sign conditions showed these tasks relied to a different extent on the posterior inferior regions. Signer identification elicited greater activation than sign identification in (bilateral) inferior temporal gyri (BA 37/19), fusiform gyri (BA 37), middle and posterior portions of the middle temporal gyri (BAs 37 and 19), and superior temporal gyri (BA 22 and 42). Right inferior frontal cortex was a further focus of differential activation (signer>sign). These findings suggest that the neural systems supporting point-light displays for the processing of SL rely on a cortical network including areas of the inferior temporal cortex specialized for face and body identification. While this might be predicted from other studies of whole body point-light actions (Vaina, Solomon, Chowdhury, Sinha, & Belliveau, 2001) it is not predicted from the perspective of spoken language processing, where voice characteristics and speech content recruit distinct cortical regions (Stevens, 2004) in addition to a common network. In this respect, our findings contrast with studies of voice/speech recognition (Von Kriegstein, Kleinschmidt, Sterzer, & Giraud, 2005). Inferior temporal regions associated with the visual recognition of a person appear to be required during SL processing, for both carrier and content information. Crown Copyright © 2011. Published by Elsevier Ltd. All rights reserved.

Combining Temporal and Spectral Information with Spatial Mapping to Identify Differences between Phonological and Semantic Networks: A Magnetoencephalographic Approach.

PubMed

McNab, Fiona; Hillebrand, Arjan; Swithenby, Stephen J; Rippon, Gina

2012-01-01

Early, lesion-based models of language processing suggested that semantic and phonological processes are associated with distinct temporal and parietal regions respectively, with frontal areas more indirectly involved. Contemporary spatial brain mapping techniques have not supported such clear-cut segregation, with strong evidence of activation in left temporal areas by both processes and disputed evidence of involvement of frontal areas in both processes. We suggest that combining spatial information with temporal and spectral data may allow a closer scrutiny of the differential involvement of closely overlapping cortical areas in language processing. Using beamforming techniques to analyze magnetoencephalography data, we localized the neuronal substrates underlying primed responses to nouns requiring either phonological or semantic processing, and examined the associated measures of time and frequency in those areas where activation was common to both tasks. Power changes in the beta (14-30 Hz) and gamma (30-50 Hz) frequency bands were analyzed in pre-selected time windows of 350-550 and 500-700 ms In left temporal regions, both tasks elicited power changes in the same time window (350-550 ms), but with different spectral characteristics, low beta (14-20 Hz) for the phonological task and high beta (20-30 Hz) for the semantic task. In frontal areas (BA10), both tasks elicited power changes in the gamma band (30-50 Hz), but in different time windows, 500-700 ms for the phonological task and 350-550 ms for the semantic task. In the left inferior parietal area (BA40), both tasks elicited changes in the 20-30 Hz beta frequency band but in different time windows, 350-550 ms for the phonological task and 500-700 ms for the semantic task. Our findings suggest that, where spatial measures may indicate overlapping areas of involvement, additional beamforming techniques can demonstrate differential activation in time and frequency domains.

The effect of compression speed on intelligibility: simulated hearing-aid processing with and without original temporal fine structure information.

PubMed

Hopkins, Kathryn; King, Andrew; Moore, Brian C J

2012-09-01

Hearing aids use amplitude compression to compensate for the effects of loudness recruitment. The compression speed that gives the best speech intelligibility varies among individuals. Moore [(2008). Trends Amplif. 12, 300-315] suggested that an individual's sensitivity to temporal fine structure (TFS) information may affect which compression speed gives most benefit. This hypothesis was tested using normal-hearing listeners with a simulated hearing loss. Sentences in a competing talker background were processed using multi-channel fast or slow compression followed by a simulation of threshold elevation and loudness recruitment. Signals were either tone vocoded with 1-ERB(N)-wide channels (where ERB(N) is the bandwidth of normal auditory filters) to remove the original TFS information, or not processed further. In a second experiment, signals were vocoded with either 1 - or 2-ERB(N)-wide channels, to test whether the available spectral detail affects the optimal compression speed. Intelligibility was significantly better for fast than slow compression regardless of vocoder channel bandwidth. The results suggest that the availability of original TFS or detailed spectral information does not affect the optimal compression speed. This conclusion is tentative, since while the vocoder processing removed the original TFS information, listeners may have used the altered TFS in the vocoded signals.

Temporal-pattern recognition by single neurons in a sensory pathway devoted to social communication behavior

PubMed Central

Carlson, Bruce A.

2010-01-01

Sensory systems often encode stimulus information into the temporal pattern of action potential activity. However, little is known about how the information contained within these patterns is extracted by postsynaptic neurons. Similar to temporal coding by sensory neurons, social information in mormyrid fish is encoded into the temporal patterning of an electric organ discharge (EOD). In the current study, sensitivity to temporal patterns of electrosensory stimuli was found to arise within the midbrain posterior exterolateral nucleus (ELp). Whole-cell patch recordings from ELp neurons in vivo revealed three patterns of interpulse interval (IPI) tuning: low-pass neurons tuned to long intervals, high-pass neurons tuned to short intervals and band-pass neurons tuned to intermediate intervals. Many neurons within each class also responded preferentially to either increasing or decreasing IPIs. Playback of electric signaling patterns recorded from freely behaving fish revealed that the IPI and direction tuning of ELp neurons resulted in selective responses to particular social communication displays characterized by distinct IPI patterns. The postsynaptic potential responses of many neurons indicated a combination of excitatory and inhibitory synaptic input, and the IPI tuning of ELp neurons was directly related to rate-dependent changes in the direction and amplitude of postsynaptic potentials. These results suggest that differences in the dynamics of short-term synaptic plasticity in excitatory and inhibitory pathways may tune central sensory neurons to particular temporal patterns of presynaptic activity. This may represent a general mechanism for the processing of behaviorally-relevant stimulus information encoded into temporal patterns of activity by sensory neurons. PMID:19641105

Temporal-pattern recognition by single neurons in a sensory pathway devoted to social communication behavior.

PubMed

Carlson, Bruce A

2009-07-29

Sensory systems often encode stimulus information into the temporal pattern of action potential activity. However, little is known about how the information contained within these patterns is extracted by postsynaptic neurons. Similar to temporal coding by sensory neurons, social information in mormyrid fish is encoded into the temporal patterning of an electric organ discharge. In the current study, sensitivity to temporal patterns of electrosensory stimuli was found to arise within the midbrain posterior exterolateral nucleus (ELp). Whole-cell patch recordings from ELp neurons in vivo revealed three patterns of interpulse interval (IPI) tuning: low-pass neurons tuned to long intervals, high-pass neurons tuned to short intervals, and bandpass neurons tuned to intermediate intervals. Many neurons within each class also responded preferentially to either increasing or decreasing IPIs. Playback of electric signaling patterns recorded from freely behaving fish revealed that the IPI and direction tuning of ELp neurons resulted in selective responses to particular social communication displays characterized by distinct IPI patterns. The postsynaptic potential responses of many neurons indicated a combination of excitatory and inhibitory synaptic input, and the IPI tuning of ELp neurons was directly related to rate-dependent changes in the direction and amplitude of postsynaptic potentials. These results suggest that differences in the dynamics of short-term synaptic plasticity in excitatory and inhibitory pathways may tune central sensory neurons to particular temporal patterns of presynaptic activity. This may represent a general mechanism for the processing of behaviorally relevant stimulus information encoded into temporal patterns of activity by sensory neurons.

Small target detection using bilateral filter and temporal cross product in infrared images

NASA Astrophysics Data System (ADS)

Bae, Tae-Wuk

2011-09-01

We introduce a spatial and temporal target detection method using spatial bilateral filter (BF) and temporal cross product (TCP) of temporal pixels in infrared (IR) image sequences. At first, the TCP is presented to extract the characteristics of temporal pixels by using temporal profile in respective spatial coordinates of pixels. The TCP represents the cross product values by the gray level distance vector of a current temporal pixel and the adjacent temporal pixel, as well as the horizontal distance vector of the current temporal pixel and a temporal pixel corresponding to potential target center. The summation of TCP values of temporal pixels in spatial coordinates makes the temporal target image (TTI), which represents the temporal target information of temporal pixels in spatial coordinates. And then the proposed BF filter is used to extract the spatial target information. In order to predict background without targets, the proposed BF filter uses standard deviations obtained by an exponential mapping of the TCP value corresponding to the coordinate of a pixel processed spatially. The spatial target image (STI) is made by subtracting the predicted image from the original image. Thus, the spatial and temporal target image (STTI) is achieved by multiplying the STI and the TTI, and then targets finally are detected in STTI. In experimental result, the receiver operating characteristics (ROC) curves were computed experimentally to compare the objective performance. From the results, the proposed algorithm shows better discrimination of target and clutters and lower false alarm rates than the existing target detection methods.

Exploring the Roles of Spectral Detail and Intonation Contour in Speech Intelligibility: An fMRI Study

PubMed Central

Kyong, Jeong S.; Scott, Sophie K.; Rosen, Stuart; Howe, Timothy B.; Agnew, Zarinah K.; McGettigan, Carolyn

2014-01-01

The melodic contour of speech forms an important perceptual aspect of tonal and nontonal languages and an important limiting factor on the intelligibility of speech heard through a cochlear implant. Previous work exploring the neural correlates of speech comprehension identified a left-dominant pathway in the temporal lobes supporting the extraction of an intelligible linguistic message, whereas the right anterior temporal lobe showed an overall preference for signals clearly conveying dynamic pitch information. The current study combined modulations of overall intelligibility (through vocoding and spectral inversion) with a manipulation of pitch contour (normal vs. falling) to investigate the processing of spoken sentences in functional MRI. Our overall findings replicate and extend those of Scott et al., whereas greater sentence intelligibility was predominately associated with increased activity in the left STS, the greatest response to normal sentence melody was found right superior temporal gyrus. These data suggest a spatial distinction between brain areas associated with intelligibility and those involved in the processing of dynamic pitch information in speech. By including a set of complexity-matched unintelligible conditions created by spectral inversion, this is additionally the first study reporting a fully factorial exploration of spectrotemporal complexity and spectral inversion as they relate to the neural processing of speech intelligibility. Perhaps surprisingly, there was no evidence for an interaction between the two factors—we discuss the implications for the processing of sound and speech in the dorsolateral temporal lobes. PMID:24568205

Only time will tell - why temporal information is essential for our neuroscientific understanding of semantics.

PubMed

Hauk, Olaf

2016-08-01

Theoretical developments about the nature of semantic representations and processes should be accompanied by a discussion of how these theories can be validated on the basis of empirical data. Here, I elaborate on the link between theory and empirical research, highlighting the need for temporal information in order to distinguish fundamental aspects of semantics. The generic point that fast cognitive processes demand fast measurement techniques has been made many times before, although arguably more often in the psychophysiological community than in the metabolic neuroimaging community. Many reviews on the neuroscience of semantics mostly or even exclusively focus on metabolic neuroimaging data. Following an analysis of semantics in terms of the representations and processes involved, I argue that fundamental theoretical debates about the neuroscience of semantics can only be concluded on the basis of data with sufficient temporal resolution. Any "semantic effect" may result from a conflation of long-term memory representations, retrieval and working memory processes, mental imagery, and episodic memory. This poses challenges for all neuroimaging modalities, but especially for those with low temporal resolution. It also throws doubt on the usefulness of contrasts between meaningful and meaningless stimuli, which may differ on a number of semantic and non-semantic dimensions. I will discuss the consequences of this analysis for research on the role of convergence zones or hubs and distributed modal brain networks, top-down modulation of task and context as well as interactivity between levels of the processing hierarchy, for example in the framework of predictive coding.

Cross-language differences in the brain network subserving intelligible speech.

PubMed

Ge, Jianqiao; Peng, Gang; Lyu, Bingjiang; Wang, Yi; Zhuo, Yan; Niu, Zhendong; Tan, Li Hai; Leff, Alexander P; Gao, Jia-Hong

2015-03-10

How is language processed in the brain by native speakers of different languages? Is there one brain system for all languages or are different languages subserved by different brain systems? The first view emphasizes commonality, whereas the second emphasizes specificity. We investigated the cortical dynamics involved in processing two very diverse languages: a tonal language (Chinese) and a nontonal language (English). We used functional MRI and dynamic causal modeling analysis to compute and compare brain network models exhaustively with all possible connections among nodes of language regions in temporal and frontal cortex and found that the information flow from the posterior to anterior portions of the temporal cortex was commonly shared by Chinese and English speakers during speech comprehension, whereas the inferior frontal gyrus received neural signals from the left posterior portion of the temporal cortex in English speakers and from the bilateral anterior portion of the temporal cortex in Chinese speakers. Our results revealed that, although speech processing is largely carried out in the common left hemisphere classical language areas (Broca's and Wernicke's areas) and anterior temporal cortex, speech comprehension across different language groups depends on how these brain regions interact with each other. Moreover, the right anterior temporal cortex, which is crucial for tone processing, is equally important as its left homolog, the left anterior temporal cortex, in modulating the cortical dynamics in tone language comprehension. The current study pinpoints the importance of the bilateral anterior temporal cortex in language comprehension that is downplayed or even ignored by popular contemporary models of speech comprehension.

Cross-language differences in the brain network subserving intelligible speech

PubMed Central

Ge, Jianqiao; Peng, Gang; Lyu, Bingjiang; Wang, Yi; Zhuo, Yan; Niu, Zhendong; Tan, Li Hai; Leff, Alexander P.; Gao, Jia-Hong

2015-01-01

How is language processed in the brain by native speakers of different languages? Is there one brain system for all languages or are different languages subserved by different brain systems? The first view emphasizes commonality, whereas the second emphasizes specificity. We investigated the cortical dynamics involved in processing two very diverse languages: a tonal language (Chinese) and a nontonal language (English). We used functional MRI and dynamic causal modeling analysis to compute and compare brain network models exhaustively with all possible connections among nodes of language regions in temporal and frontal cortex and found that the information flow from the posterior to anterior portions of the temporal cortex was commonly shared by Chinese and English speakers during speech comprehension, whereas the inferior frontal gyrus received neural signals from the left posterior portion of the temporal cortex in English speakers and from the bilateral anterior portion of the temporal cortex in Chinese speakers. Our results revealed that, although speech processing is largely carried out in the common left hemisphere classical language areas (Broca’s and Wernicke’s areas) and anterior temporal cortex, speech comprehension across different language groups depends on how these brain regions interact with each other. Moreover, the right anterior temporal cortex, which is crucial for tone processing, is equally important as its left homolog, the left anterior temporal cortex, in modulating the cortical dynamics in tone language comprehension. The current study pinpoints the importance of the bilateral anterior temporal cortex in language comprehension that is downplayed or even ignored by popular contemporary models of speech comprehension. PMID:25713366

Neural pathway in the right hemisphere underlies verbal insight problem solving.

PubMed

Zhao, Q; Zhou, Z; Xu, H; Fan, W; Han, L

2014-01-03

Verbal insight problem solving means to break mental sets, to select the novel semantic information and to form novel, task-related associations. Although previous studies have identified the brain regions associated with these key processes, the interaction among these regions during insight is still unclear. In the present study, we explored the functional connectivity between the key regions during solving Chinese 'chengyu' riddles by using event-related functional magnetic resonance imaging. Results showed that both insight and noninsight solutions activated the bilateral inferior frontal gyri, middle temporal gyri and hippocampi, and these regions constituted a frontal to temporal to hippocampal neural pathway. Compared with noninsight solution, insight solution had a stronger functional connectivity between the inferior frontal gyrus and middle temporal gyrus in the right hemisphere. Our study reveals the neural pathway of information processing during verbal insight problem solving, and supports the right-hemisphere advantage theory of insight. Copyright © 2013 IBRO. Published by Elsevier Ltd. All rights reserved.

The cerebellum predicts the temporal consequences of observed motor acts.

PubMed

Avanzino, Laura; Bove, Marco; Pelosin, Elisa; Ogliastro, Carla; Lagravinese, Giovanna; Martino, Davide

2015-01-01

It is increasingly clear that we extract patterns of temporal regularity between events to optimize information processing. The ability to extract temporal patterns and regularity of events is referred as temporal expectation. Temporal expectation activates the same cerebral network usually engaged in action selection, comprising cerebellum. However, it is unclear whether the cerebellum is directly involved in temporal expectation, when timing information is processed to make predictions on the outcome of a motor act. Healthy volunteers received one session of either active (inhibitory, 1 Hz) or sham repetitive transcranial magnetic stimulation covering the right lateral cerebellum prior the execution of a temporal expectation task. Subjects were asked to predict the end of a visually perceived human body motion (right hand handwriting) and of an inanimate object motion (a moving circle reaching a target). Videos representing movements were shown in full; the actual tasks consisted of watching the same videos, but interrupted after a variable interval from its onset by a dark interval of variable duration. During the 'dark' interval, subjects were asked to indicate when the movement represented in the video reached its end by clicking on the spacebar of the keyboard. Performance on the timing task was analyzed measuring the absolute value of timing error, the coefficient of variability and the percentage of anticipation responses. The active group exhibited greater absolute timing error compared with the sham group only in the human body motion task. Our findings suggest that the cerebellum is engaged in cognitive and perceptual domains that are strictly connected to motor control.

Articulatory movements modulate auditory responses to speech

PubMed Central

Agnew, Z.K.; McGettigan, C.; Banks, B.; Scott, S.K.

2013-01-01

Production of actions is highly dependent on concurrent sensory information. In speech production, for example, movement of the articulators is guided by both auditory and somatosensory input. It has been demonstrated in non-human primates that self-produced vocalizations and those of others are differentially processed in the temporal cortex. The aim of the current study was to investigate how auditory and motor responses differ for self-produced and externally produced speech. Using functional neuroimaging, subjects were asked to produce sentences aloud, to silently mouth while listening to a different speaker producing the same sentence, to passively listen to sentences being read aloud, or to read sentences silently. We show that that separate regions of the superior temporal cortex display distinct response profiles to speaking aloud, mouthing while listening, and passive listening. Responses in anterior superior temporal cortices in both hemispheres are greater for passive listening compared with both mouthing while listening, and speaking aloud. This is the first demonstration that articulation, whether or not it has auditory consequences, modulates responses of the dorsolateral temporal cortex. In contrast posterior regions of the superior temporal cortex are recruited during both articulation conditions. In dorsal regions of the posterior superior temporal gyrus, responses to mouthing and reading aloud were equivalent, and in more ventral posterior superior temporal sulcus, responses were greater for reading aloud compared with mouthing while listening. These data demonstrate an anterior–posterior division of superior temporal regions where anterior fields are suppressed during motor output, potentially for the purpose of enhanced detection of the speech of others. We suggest posterior fields are engaged in auditory processing for the guidance of articulation by auditory information. PMID:22982103

Coding Strategies and Implementations of Compressive Sensing

NASA Astrophysics Data System (ADS)

Tsai, Tsung-Han

This dissertation studies the coding strategies of computational imaging to overcome the limitation of conventional sensing techniques. The information capacity of conventional sensing is limited by the physical properties of optics, such as aperture size, detector pixels, quantum efficiency, and sampling rate. These parameters determine the spatial, depth, spectral, temporal, and polarization sensitivity of each imager. To increase sensitivity in any dimension can significantly compromise the others. This research implements various coding strategies subject to optical multidimensional imaging and acoustic sensing in order to extend their sensing abilities. The proposed coding strategies combine hardware modification and signal processing to exploiting bandwidth and sensitivity from conventional sensors. We discuss the hardware architecture, compression strategies, sensing process modeling, and reconstruction algorithm of each sensing system. Optical multidimensional imaging measures three or more dimensional information of the optical signal. Traditional multidimensional imagers acquire extra dimensional information at the cost of degrading temporal or spatial resolution. Compressive multidimensional imaging multiplexes the transverse spatial, spectral, temporal, and polarization information on a two-dimensional (2D) detector. The corresponding spectral, temporal and polarization coding strategies adapt optics, electronic devices, and designed modulation techniques for multiplex measurement. This computational imaging technique provides multispectral, temporal super-resolution, and polarization imaging abilities with minimal loss in spatial resolution and noise level while maintaining or gaining higher temporal resolution. The experimental results prove that the appropriate coding strategies may improve hundreds times more sensing capacity. Human auditory system has the astonishing ability in localizing, tracking, and filtering the selected sound sources or information from a noisy environment. Using engineering efforts to accomplish the same task usually requires multiple detectors, advanced computational algorithms, or artificial intelligence systems. Compressive acoustic sensing incorporates acoustic metamaterials in compressive sensing theory to emulate the abilities of sound localization and selective attention. This research investigates and optimizes the sensing capacity and the spatial sensitivity of the acoustic sensor. The well-modeled acoustic sensor allows localizing multiple speakers in both stationary and dynamic auditory scene; and distinguishing mixed conversations from independent sources with high audio recognition rate.

Whisper: Tracing the Spatiotemporal Process of Information Diffusion in Real Time.

PubMed

Cao, Nan; Lin, Yu-Ru; Sun, Xiaohua; Lazer, D; Liu, Shixia; Qu, Huamin

2012-12-01

When and where is an idea dispersed? Social media, like Twitter, has been increasingly used for exchanging information, opinions and emotions about events that are happening across the world. Here we propose a novel visualization design, "Whisper", for tracing the process of information diffusion in social media in real time. Our design highlights three major characteristics of diffusion processes in social media: the temporal trend, social-spatial extent, and community response of a topic of interest. Such social, spatiotemporal processes are conveyed based on a sunflower metaphor whose seeds are often dispersed far away. In Whisper, we summarize the collective responses of communities on a given topic based on how tweets were retweeted by groups of users, through representing the sentiments extracted from the tweets, and tracing the pathways of retweets on a spatial hierarchical layout. We use an efficient flux line-drawing algorithm to trace multiple pathways so the temporal and spatial patterns can be identified even for a bursty event. A focused diffusion series highlights key roles such as opinion leaders in the diffusion process. We demonstrate how our design facilitates the understanding of when and where a piece of information is dispersed and what are the social responses of the crowd, for large-scale events including political campaigns and natural disasters. Initial feedback from domain experts suggests promising use for today's information consumption and dispersion in the wild.

EliXR-TIME: A Temporal Knowledge Representation for Clinical Research Eligibility Criteria.

PubMed

Boland, Mary Regina; Tu, Samson W; Carini, Simona; Sim, Ida; Weng, Chunhua

2012-01-01

Effective clinical text processing requires accurate extraction and representation of temporal expressions. Multiple temporal information extraction models were developed but a similar need for extracting temporal expressions in eligibility criteria (e.g., for eligibility determination) remains. We identified the temporal knowledge representation requirements of eligibility criteria by reviewing 100 temporal criteria. We developed EliXR-TIME, a frame-based representation designed to support semantic annotation for temporal expressions in eligibility criteria by reusing applicable classes from well-known clinical temporal knowledge representations. We used EliXR-TIME to analyze a training set of 50 new temporal eligibility criteria. We evaluated EliXR-TIME using an additional random sample of 20 eligibility criteria with temporal expressions that have no overlap with the training data, yielding 92.7% (76 / 82) inter-coder agreement on sentence chunking and 72% (72 / 100) agreement on semantic annotation. We conclude that this knowledge representation can facilitate semantic annotation of the temporal expressions in eligibility criteria.

On the road to national mapping and attribution of the processes underlying U.S

Treesearch

Karen Schleeweis; Gretchen G. Moisen; Todd A. Schroeder; Chris Toney; Elizabeth A. Freeman

2015-01-01

Questions regarding the impact of natural and anthropogenic forest change events (temporary and persisting) on energy, water and nutrient cycling, forest sustainability and resilience, and ecosystem services call for a full suite of information on the spatial and temporal trends of forest dynamics. Temporal and spatial patterns of change along with their magnitude and...

Binding of Sights and Sounds: Age-Related Changes in Multisensory Temporal Processing

ERIC Educational Resources Information Center

Hillock, Andrea R.; Powers, Albert R.; Wallace, Mark T.

2011-01-01

We live in a multisensory world and one of the challenges the brain is faced with is deciding what information belongs together. Our ability to make assumptions about the relatedness of multisensory stimuli is partly based on their temporal and spatial relationships. Stimuli that are proximal in time and space are likely to be bound together by…

Automatic Activation of Phonological Templates for Native but Not Nonnative Phonemes: An Investigation of the Temporal Dynamics of Mu Activation

ERIC Educational Resources Information Center

Santos-Oliveira, Daniela Cristina

2017-01-01

Models of speech perception suggest a dorsal stream connecting the temporal and inferior parietal lobe with the inferior frontal gyrus. This stream is thought to involve an auditory motor loop that translates acoustic information into motor/articulatory commands and is further influenced by decision making processes that involve maintenance of…

Development and modulation of intrinsic membrane properties control the temporal precision of auditory brain stem neurons.

PubMed

Franzen, Delwen L; Gleiss, Sarah A; Berger, Christina; Kümpfbeck, Franziska S; Ammer, Julian J; Felmy, Felix

2015-01-15

Passive and active membrane properties determine the voltage responses of neurons. Within the auditory brain stem, refinements in these intrinsic properties during late postnatal development usually generate short integration times and precise action-potential generation. This developmentally acquired temporal precision is crucial for auditory signal processing. How the interactions of these intrinsic properties develop in concert to enable auditory neurons to transfer information with high temporal precision has not yet been elucidated in detail. Here, we show how the developmental interaction of intrinsic membrane parameters generates high firing precision. We performed in vitro recordings from neurons of postnatal days 9-28 in the ventral nucleus of the lateral lemniscus of Mongolian gerbils, an auditory brain stem structure that converts excitatory to inhibitory information with high temporal precision. During this developmental period, the input resistance and capacitance decrease, and action potentials acquire faster kinetics and enhanced precision. Depending on the stimulation time course, the input resistance and capacitance contribute differentially to action-potential thresholds. The decrease in input resistance, however, is sufficient to explain the enhanced action-potential precision. Alterations in passive membrane properties also interact with a developmental change in potassium currents to generate the emergence of the mature firing pattern, characteristic of coincidence-detector neurons. Cholinergic receptor-mediated depolarizations further modulate this intrinsic excitability profile by eliciting changes in the threshold and firing pattern, irrespective of the developmental stage. Thus our findings reveal how intrinsic membrane properties interact developmentally to promote temporally precise information processing. Copyright © 2015 the American Physiological Society.

Spectral and temporal resolutions of information-bearing acoustic changes for understanding vocoded sentencesa)

PubMed Central

Stilp, Christian E.; Goupell, Matthew J.

2015-01-01

Short-time spectral changes in the speech signal are important for understanding noise-vocoded sentences. These information-bearing acoustic changes, measured using cochlea-scaled entropy in cochlear implant simulations [CSECI; Stilp et al. (2013). J. Acoust. Soc. Am. 133(2), EL136–EL141; Stilp (2014). J. Acoust. Soc. Am. 135(3), 1518–1529], may offer better understanding of speech perception by cochlear implant (CI) users. However, perceptual importance of CSECI for normal-hearing listeners was tested at only one spectral resolution and one temporal resolution, limiting generalizability of results to CI users. Here, experiments investigated the importance of these informational changes for understanding noise-vocoded sentences at different spectral resolutions (4–24 spectral channels; Experiment 1), temporal resolutions (4–64 Hz cutoff for low-pass filters that extracted amplitude envelopes; Experiment 2), or when both parameters varied (6–12 channels, 8–32 Hz; Experiment 3). Sentence intelligibility was reduced more by replacing high-CSECI intervals with noise than replacing low-CSECI intervals, but only when sentences had sufficient spectral and/or temporal resolution. High-CSECI intervals were more important for speech understanding as spectral resolution worsened and temporal resolution improved. Trade-offs between CSECI and intermediate spectral and temporal resolutions were minimal. These results suggest that signal processing strategies that emphasize information-bearing acoustic changes in speech may improve speech perception for CI users. PMID:25698018

Exploring the roles of spectral detail and intonation contour in speech intelligibility: an FMRI study.

PubMed

Kyong, Jeong S; Scott, Sophie K; Rosen, Stuart; Howe, Timothy B; Agnew, Zarinah K; McGettigan, Carolyn

2014-08-01

The melodic contour of speech forms an important perceptual aspect of tonal and nontonal languages and an important limiting factor on the intelligibility of speech heard through a cochlear implant. Previous work exploring the neural correlates of speech comprehension identified a left-dominant pathway in the temporal lobes supporting the extraction of an intelligible linguistic message, whereas the right anterior temporal lobe showed an overall preference for signals clearly conveying dynamic pitch information [Johnsrude, I. S., Penhune, V. B., & Zatorre, R. J. Functional specificity in the right human auditory cortex for perceiving pitch direction. Brain, 123, 155-163, 2000; Scott, S. K., Blank, C. C., Rosen, S., & Wise, R. J. Identification of a pathway for intelligible speech in the left temporal lobe. Brain, 123, 2400-2406, 2000]. The current study combined modulations of overall intelligibility (through vocoding and spectral inversion) with a manipulation of pitch contour (normal vs. falling) to investigate the processing of spoken sentences in functional MRI. Our overall findings replicate and extend those of Scott et al. [Scott, S. K., Blank, C. C., Rosen, S., & Wise, R. J. Identification of a pathway for intelligible speech in the left temporal lobe. Brain, 123, 2400-2406, 2000], where greater sentence intelligibility was predominately associated with increased activity in the left STS, and the greatest response to normal sentence melody was found in right superior temporal gyrus. These data suggest a spatial distinction between brain areas associated with intelligibility and those involved in the processing of dynamic pitch information in speech. By including a set of complexity-matched unintelligible conditions created by spectral inversion, this is additionally the first study reporting a fully factorial exploration of spectrotemporal complexity and spectral inversion as they relate to the neural processing of speech intelligibility. Perhaps surprisingly, there was little evidence for an interaction between the two factors-we discuss the implications for the processing of sound and speech in the dorsolateral temporal lobes.

Use of soil moisture dynamics and patterns at different spatio-temporal scales for the investigation of subsurface flow processes

NASA Astrophysics Data System (ADS)

Blume, T.; Zehe, E.; Bronstert, A.

2009-07-01

Spatial patterns as well as temporal dynamics of soil moisture have a major influence on runoff generation. The investigation of these dynamics and patterns can thus yield valuable information on hydrological processes, especially in data scarce or previously ungauged catchments. The combination of spatially scarce but temporally high resolution soil moisture profiles with episodic and thus temporally scarce moisture profiles at additional locations provides information on spatial as well as temporal patterns of soil moisture at the hillslope transect scale. This approach is better suited to difficult terrain (dense forest, steep slopes) than geophysical techniques and at the same time less cost-intensive than a high resolution grid of continuously measuring sensors. Rainfall simulation experiments with dye tracers while continuously monitoring soil moisture response allows for visualization of flow processes in the unsaturated zone at these locations. Data was analyzed at different spacio-temporal scales using various graphical methods, such as space-time colour maps (for the event and plot scale) and binary indicator maps (for the long-term and hillslope scale). Annual dynamics of soil moisture and decimeter-scale variability were also investigated. The proposed approach proved to be successful in the investigation of flow processes in the unsaturated zone and showed the importance of preferential flow in the Malalcahuello Catchment, a data-scarce catchment in the Andes of Southern Chile. Fast response times of stream flow indicate that preferential flow observed at the plot scale might also be of importance at the hillslope or catchment scale. Flow patterns were highly variable in space but persistent in time. The most likely explanation for preferential flow in this catchment is a combination of hydrophobicity, small scale heterogeneity in rainfall due to redistribution in the canopy and strong gradients in unsaturated conductivities leading to self-reinforcing flow paths.

Encoding of Natural Sounds at Multiple Spectral and Temporal Resolutions in the Human Auditory Cortex

PubMed Central

Santoro, Roberta; Moerel, Michelle; De Martino, Federico; Goebel, Rainer; Ugurbil, Kamil; Yacoub, Essa; Formisano, Elia

2014-01-01

Functional neuroimaging research provides detailed observations of the response patterns that natural sounds (e.g. human voices and speech, animal cries, environmental sounds) evoke in the human brain. The computational and representational mechanisms underlying these observations, however, remain largely unknown. Here we combine high spatial resolution (3 and 7 Tesla) functional magnetic resonance imaging (fMRI) with computational modeling to reveal how natural sounds are represented in the human brain. We compare competing models of sound representations and select the model that most accurately predicts fMRI response patterns to natural sounds. Our results show that the cortical encoding of natural sounds entails the formation of multiple representations of sound spectrograms with different degrees of spectral and temporal resolution. The cortex derives these multi-resolution representations through frequency-specific neural processing channels and through the combined analysis of the spectral and temporal modulations in the spectrogram. Furthermore, our findings suggest that a spectral-temporal resolution trade-off may govern the modulation tuning of neuronal populations throughout the auditory cortex. Specifically, our fMRI results suggest that neuronal populations in posterior/dorsal auditory regions preferably encode coarse spectral information with high temporal precision. Vice-versa, neuronal populations in anterior/ventral auditory regions preferably encode fine-grained spectral information with low temporal precision. We propose that such a multi-resolution analysis may be crucially relevant for flexible and behaviorally-relevant sound processing and may constitute one of the computational underpinnings of functional specialization in auditory cortex. PMID:24391486

Dynamic semantic cognition: Characterising coherent and controlled conceptual retrieval through time using magnetoencephalography and chronometric transcranial magnetic stimulation.

PubMed

Teige, Catarina; Mollo, Giovanna; Millman, Rebecca; Savill, Nicola; Smallwood, Jonathan; Cornelissen, Piers L; Jefferies, Elizabeth

2018-06-01

Distinct neural processes are thought to support the retrieval of semantic information that is (i) coherent with strongly-encoded aspects of knowledge, and (ii) non-dominant yet relevant for the current task or context. While the brain regions that support readily coherent and more controlled patterns of semantic retrieval are relatively well-characterised, the temporal dynamics of these processes are not well-understood. This study used magnetoencephalography (MEG) and dual-pulse chronometric transcranial magnetic stimulation (cTMS) in two separate experiments to examine temporal dynamics during the retrieval of strong and weak associations. MEG results revealed a dissociation within left temporal cortex: anterior temporal lobe (ATL) showed greater oscillatory response for strong than weak associations, while posterior middle temporal gyrus (pMTG) showed the reverse pattern. Left inferior frontal gyrus (IFG), a site associated with semantic control and retrieval, showed both patterns at different time points. In the cTMS experiment, stimulation of ATL at ∼150 msec disrupted the efficient retrieval of strong associations, indicating a necessary role for ATL in coherent conceptual activations. Stimulation of pMTG at the onset of the second word disrupted the retrieval of weak associations, suggesting this site may maintain information about semantic context from the first word, allowing efficient engagement of semantic control. Together these studies provide converging evidence for a functional dissociation within the temporal lobe, across both tasks and time. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Temporal lobe abnormalities in semantic processing by criminal psychopaths as revealed by functional magnetic resonance imaging.

PubMed

Kiehl, Kent A; Smith, Andra M; Mendrek, Adrianna; Forster, Bruce B; Hare, Robert D; Liddle, Peter F

2004-04-30

We tested the hypothesis that psychopathy is associated with abnormalities in semantic processing of linguistic information. Functional magnetic resonance imaging (fMRI) was used to elucidate and characterize the neural architecture underlying lexico-semantic processes in criminal psychopathic individuals and in a group of matched control participants. Participants performed a lexical decision task in which blocks of linguistic stimuli alternated with a resting baseline condition. In each lexical decision block, the stimuli were either concrete words and pseudowords or abstract words and pseudowords. Consistent with our hypothesis, psychopathic individuals, relative to controls, showed poorer behavioral performance for processing abstract words. Analysis of the fMRI data for both groups indicated that processing of word stimuli, compared with the resting baseline condition, was associated with neural activation in bilateral fusiform gyrus, anterior cingulate, left middle temporal gyrus, right posterior superior temporal gyrus, and left and right inferior frontal gyrus. Analyses confirmed our prediction that psychopathic individuals would fail to show the appropriate neural differentiation between abstract and concrete stimuli in the right anterior temporal gyrus and surrounding cortex. The results are consistent with other studies of semantic processing in psychopathy and support the theory that psychopathy is associated with right hemisphere abnormalities for processing conceptually abstract material.

Temporal lobe abnormalities in semantic processing by criminal psychopaths as revealed by functional magnetic resonance imaging.

PubMed

Kiehl, Kent A; Smith, Andra M; Mendrek, Adrianna; Forster, Bruce B; Hare, Robert D; Liddle, Peter F

2004-01-15

We tested the hypothesis that psychopathy is associated with abnormalities in semantic processing of linguistic information. Functional magnetic resonance imaging (fMRI) was used to elucidate and characterize the neural architecture underlying lexico-semantic processes in criminal psychopathic individuals and in a group of matched control participants. Participants performed a lexical decision task in which blocks of linguistic stimuli alternated with a resting baseline condition. In each lexical decision block, the stimuli were either concrete words and pseudowords or abstract words and pseudowords. Consistent with our hypothesis, psychopathic individuals, relative to controls, showed poorer behavioral performance for processing abstract words. Analysis of the fMRI data for both groups indicated that processing of word stimuli, compared with the resting baseline condition, was associated with neural activation in bilateral fusiform gyrus, anterior cingulate, left middle temporal gyrus, right posterior superior temporal gyrus, and left and right inferior frontal gyrus. Analyses confirmed our prediction that psychopathic individuals would fail to show the appropriate neural differentiation between abstract and concrete stimuli in the right anterior temporal gyrus and surrounding cortex. The results are consistent with other studies of semantic processing in psychopathy and support the theory that psychopathy is associated with right hemisphere abnormalities for processing conceptually abstract material.

Learning of spatio-temporal codes in a coupled oscillator system.

PubMed

Orosz, Gábor; Ashwin, Peter; Townley, Stuart

2009-07-01

In this paper, we consider a learning strategy that allows one to transmit information between two coupled phase oscillator systems (called teaching and learning systems) via frequency adaptation. The dynamics of these systems can be modeled with reference to a number of partially synchronized cluster states and transitions between them. Forcing the teaching system by steady but spatially nonhomogeneous inputs produces cyclic sequences of transitions between the cluster states, that is, information about inputs is encoded via a "winnerless competition" process into spatio-temporal codes. The large variety of codes can be learned by the learning system that adapts its frequencies to those of the teaching system. We visualize the dynamics using "weighted order parameters (WOPs)" that are analogous to "local field potentials" in neural systems. Since spatio-temporal coding is a mechanism that appears in olfactory systems, the developed learning rules may help to extract information from these neural ensembles.

Modern temporal network theory: a colloquium

NASA Astrophysics Data System (ADS)

Holme, Petter

2015-09-01

The power of any kind of network approach lies in the ability to simplify a complex system so that one can better understand its function as a whole. Sometimes it is beneficial, however, to include more information than in a simple graph of only nodes and links. Adding information about times of interactions can make predictions and mechanistic understanding more accurate. The drawback, however, is that there are not so many methods available, partly because temporal networks is a relatively young field, partly because it is more difficult to develop such methods compared to for static networks. In this colloquium, we review the methods to analyze and model temporal networks and processes taking place on them, focusing mainly on the last three years. This includes the spreading of infectious disease, opinions, rumors, in social networks; information packets in computer networks; various types of signaling in biology, and more. We also discuss future directions.

Time to rethink the neural mechanisms of learning and memory

PubMed Central

Gallistel, Charles R.; Balsam, Peter D

2014-01-01

Most studies in the neurobiology of learning assume that the underlying learning process is a pairing – dependent change in synaptic strength that requires repeated experience of events presented in close temporal contiguity. However, much learning is rapid and does not depend on temporal contiguity which has never been precisely defined. These points are well illustrated by studies showing that temporal relationships between events are rapidly learned-even over long delays- and this knowledge governs the form and timing of behavior. The speed with which anticipatory responses emerge in conditioning paradigms is determined by the information that cues provide about the timing of rewards. The challenge for understanding the neurobiology of learning is to understand the mechanisms in the nervous system that encode information from even a single experience, the nature of the memory mechanisms that can encode quantities such as time, and how the brain can flexibly perform computations based on this information. PMID:24309167

Temporal context memory in high-functioning autism.

PubMed

Gras-Vincendon, Agnès; Mottron, Laurent; Salamé, Pierre; Bursztejn, Claude; Danion, Jean-Marie

2007-11-01

Episodic memory, i.e. memory for specific episodes situated in space and time, seems impaired in individuals with autism. According to weak central coherence theory, individuals with autism have general difficulty connecting contextual and item information which then impairs their capacity to memorize information in context. This study investigated temporal context memory for visual information in individuals with autism. Eighteen adolescents and adults with high-functioning autism (HFA) or Asperger syndrome (AS) and age- and IQ-matched typically developing participants were tested using a recency judgement task. The performance of the autistic group did not differ from that of the control group, nor did the performance between the AS and HFA groups. We conclude that autism in high-functioning individuals does not impair temporal context memory as assessed on this task. We suggest that individuals with autism are as efficient on this task as typically developing subjects because contextual memory performance here involves more automatic than organizational processing.

Emotional intelligence moderates the relationship between regional gray matter volume in the bilateral temporal pole and critical thinking disposition.

PubMed

Yao, Xiaonan; Yuan, Shuge; Yang, Wenjing; Chen, Qunlin; Wei, Dongtao; Hou, Yuling; Zhang, Lijie; Qiu, Jiang; Yang, Dong

2018-04-01

Critical thinking enables people to form sound beliefs and provides a basis for emotional life. Research has indicated that individuals with better critical thinking disposition can better recognize and regulate their emotions, though the neuroanatomical mechanisms involved in this process remain to be elucidated. Further, the influence of emotional intelligence on the relationship between brain structure and critical thinking disposition has not been examined. The present study utilized voxel-based morphometry (VBM) to investigate the neural structures underlying critical thinking disposition in a large sample of college students (N = 296). Regional gray matter volume (rGMV) in the bilateral temporal pole, which reflects an individual's ability to process social and emotional information, was negatively correlated with critical thinking disposition. In addition, rGMV in bilateral para hippocampal regions -regions involved in contextual association/emotional regulation-exhibited negative correlation with critical thinking disposition. Further analysis revealed that emotional intelligence moderated the relationship between rGMV of the temporal pole and critical thinking disposition. Specifically, critical thinking disposition was associated with decreased GMV of the temporal pole for individuals who have relatively higher emotional intelligence rather than lower emotional intelligence. The results of the present study indicate that people who have higher emotional intelligence exhibit more effective and automatic processing of emotional information and tend to be strong critical thinkers.

Perception of temporally modified speech in auditory neuropathy.

PubMed

Hassan, Dalia Mohamed

2011-01-01

Disrupted auditory nerve activity in auditory neuropathy (AN) significantly impairs the sequential processing of auditory information, resulting in poor speech perception. This study investigated the ability of AN subjects to perceive temporally modified consonant-vowel (CV) pairs and shed light on their phonological awareness skills. Four Arabic CV pairs were selected: /ki/-/gi/, /to/-/do/, /si/-/sti/ and /so/-/zo/. The formant transitions in consonants and the pauses between CV pairs were prolonged. Rhyming, segmentation and blending skills were tested using words at a natural rate of speech and with prolongation of the speech stream. Fourteen adult AN subjects were compared to a matched group of cochlear-impaired patients in their perception of acoustically processed speech. The AN group distinguished the CV pairs at a low speech rate, in particular with modification of the consonant duration. Phonological awareness skills deteriorated in adult AN subjects but improved with prolongation of the speech inter-syllabic time interval. A rehabilitation program for AN should consider temporal modification of speech, training for auditory temporal processing and the use of devices with innovative signal processing schemes. Verbal modifications as well as visual imaging appear to be promising compensatory strategies for remediating the affected phonological processing skills.

Visual processing of music notation: a study of event-related potentials.

PubMed

Lee, Horng-Yih; Wang, Yu-Sin

2011-04-01

In reading music, the acquisition of pitch information depends mostly on the spatial position of notes, hence more spatial processing, whereas the acquisition of temporal information depends mostly on the visual features of notes and object recognition. This study used both electrophysiological and behavioral methods to compare the processing of pitch and duration in reading single musical notes. It was observed that in the early stage of note reading, identification of pitch could elicit greater N1 and N2 amplitude than identification of duration at the parietal lobe electrodes. In the later stages of note reading, identifying pitch elicited a greater negative slow wave at parietal electrodes than did identifying note duration. The sustained contribution of parietal processes for pitch suggests that the dorsal pathway is essential for pitch processing. However, the duration task did not elicit greater amplitude of any early ERP components than the pitch task at temporal electrodes. Accordingly, a double dissociation, suggesting involvement of the dorsal visual stream, was not observed in spatial pitch processing and ventral visual stream in processing of note durations.

Impaired encoding of rapid pitch information underlies perception and memory deficits in congenital amusia.

PubMed

Albouy, Philippe; Cousineau, Marion; Caclin, Anne; Tillmann, Barbara; Peretz, Isabelle

2016-01-06

Recent theories suggest that the basis of neurodevelopmental auditory disorders such as dyslexia or specific language impairment might be a low-level sensory dysfunction. In the present study we test this hypothesis in congenital amusia, a neurodevelopmental disorder characterized by severe deficits in the processing of pitch-based material. We manipulated the temporal characteristics of auditory stimuli and investigated the influence of the time given to encode pitch information on participants' performance in discrimination and short-term memory. Our results show that amusics' performance in such tasks scales with the duration available to encode acoustic information. This suggests that in auditory neuro-developmental disorders, abnormalities in early steps of the auditory processing can underlie the high-level deficits (here musical disabilities). Observing that the slowing down of temporal dynamics improves amusics' pitch abilities allows considering this approach as a potential tool for remediation in developmental auditory disorders.

Time Allocation in Social Networks: Correlation Between Social Structure and Human Communication Dynamics

NASA Astrophysics Data System (ADS)

Miritello, Giovanna; Lara, Rubén; Moro, Esteban

Recent research has shown the deep impact of the dynamics of human interactions (or temporal social networks) on the spreading of information, opinion formation, etc. In general, the bursty nature of human interactions lowers the interaction between people to the extent that both the speed and reach of information diffusion are diminished. Using a large database of 20 million users of mobile phone calls we show evidence this effect is not homogeneous in the social network but in fact, there is a large correlation between this effect and the social topological structure around a given individual. In particular, we show that social relations of hubs in a network are relatively weaker from the dynamical point than those that are poorer connected in the information diffusion process. Our results show the importance of the temporal patterns of communication when analyzing and modeling dynamical process on social networks.

Temporal processing dysfunction in schizophrenia.

PubMed

Carroll, Christine A; Boggs, Jennifer; O'Donnell, Brian F; Shekhar, Anantha; Hetrick, William P

2008-07-01

Schizophrenia may be associated with a fundamental disturbance in the temporal coordination of information processing in the brain, leading to classic symptoms of schizophrenia such as thought disorder and disorganized and contextually inappropriate behavior. Despite the growing interest and centrality of time-dependent conceptualizations of the pathophysiology of schizophrenia, there remains a paucity of research directly examining overt timing performance in the disorder. Accordingly, the present study investigated timing in schizophrenia using a well-established task of time perception. Twenty-three individuals with schizophrenia and 22 non-psychiatric control participants completed a temporal bisection task, which required participants to make temporal judgments about auditory and visually presented durations ranging from 300 to 600 ms. Both schizophrenia and control groups displayed greater visual compared to auditory timing variability, with no difference between groups in the visual modality. However, individuals with schizophrenia exhibited less temporal precision than controls in the perception of auditory durations. These findings correlated with parameter estimates obtained from a quantitative model of time estimation, and provide evidence of a fundamental deficit in temporal auditory precision in schizophrenia.

Information processing in the CNS: a supramolecular chemistry?

PubMed

Tozzi, Arturo

2015-10-01

How does central nervous system process information? Current theories are based on two tenets: (a) information is transmitted by action potentials, the language by which neurons communicate with each other-and (b) homogeneous neuronal assemblies of cortical circuits operate on these neuronal messages where the operations are characterized by the intrinsic connectivity among neuronal populations. In this view, the size and time course of any spike is stereotypic and the information is restricted to the temporal sequence of the spikes; namely, the "neural code". However, an increasing amount of novel data point towards an alternative hypothesis: (a) the role of neural code in information processing is overemphasized. Instead of simply passing messages, action potentials play a role in dynamic coordination at multiple spatial and temporal scales, establishing network interactions across several levels of a hierarchical modular architecture, modulating and regulating the propagation of neuronal messages. (b) Information is processed at all levels of neuronal infrastructure from macromolecules to population dynamics. For example, intra-neuronal (changes in protein conformation, concentration and synthesis) and extra-neuronal factors (extracellular proteolysis, substrate patterning, myelin plasticity, microbes, metabolic status) can have a profound effect on neuronal computations. This means molecular message passing may have cognitive connotations. This essay introduces the concept of "supramolecular chemistry", involving the storage of information at the molecular level and its retrieval, transfer and processing at the supramolecular level, through transitory non-covalent molecular processes that are self-organized, self-assembled and dynamic. Finally, we note that the cortex comprises extremely heterogeneous cells, with distinct regional variations, macromolecular assembly, receptor repertoire and intrinsic microcircuitry. This suggests that every neuron (or group of neurons) embodies different molecular information that hands an operational effect on neuronal computation.

Temporal coding of reward-guided choice in the posterior parietal cortex

PubMed Central

Hawellek, David J.; Wong, Yan T.; Pesaran, Bijan

2016-01-01

Making a decision involves computations across distributed cortical and subcortical networks. How such distributed processing is performed remains unclear. We test how the encoding of choice in a key decision-making node, the posterior parietal cortex (PPC), depends on the temporal structure of the surrounding population activity. We recorded spiking and local field potential (LFP) activity in the PPC while two rhesus macaques performed a decision-making task. We quantified the mutual information that neurons carried about an upcoming choice and its dependence on LFP activity. The spiking of PPC neurons was correlated with LFP phases at three distinct time scales in the theta, beta, and gamma frequency bands. Importantly, activity at these time scales encoded upcoming decisions differently. Choice information contained in neural firing varied with the phase of beta and gamma activity. For gamma activity, maximum choice information occurred at the same phase as the maximum spike count. However, for beta activity, choice information and spike count were greatest at different phases. In contrast, theta activity did not modulate the encoding properties of PPC units directly but was correlated with beta and gamma activity through cross-frequency coupling. We propose that the relative timing of local spiking and choice information reveals temporal reference frames for computations in either local or large-scale decision networks. Differences between the timing of task information and activity patterns may be a general signature of distributed processing across large-scale networks. PMID:27821752

Encoding of Spatio-Temporal Input Characteristics by a CA1 Pyramidal Neuron Model

PubMed Central

Pissadaki, Eleftheria Kyriaki; Sidiropoulou, Kyriaki; Reczko, Martin; Poirazi, Panayiota

2010-01-01

The in vivo activity of CA1 pyramidal neurons alternates between regular spiking and bursting, but how these changes affect information processing remains unclear. Using a detailed CA1 pyramidal neuron model, we investigate how timing and spatial arrangement variations in synaptic inputs to the distal and proximal dendritic layers influence the information content of model responses. We find that the temporal delay between activation of the two layers acts as a switch between excitability modes: short delays induce bursting while long delays decrease firing. For long delays, the average firing frequency of the model response discriminates spatially clustered from diffused inputs to the distal dendritic tree. For short delays, the onset latency and inter-spike-interval succession of model responses can accurately classify input signals as temporally close or distant and spatially clustered or diffused across different stimulation protocols. These findings suggest that a CA1 pyramidal neuron may be capable of encoding and transmitting presynaptic spatiotemporal information about the activity of the entorhinal cortex-hippocampal network to higher brain regions via the selective use of either a temporal or a rate code. PMID:21187899

Multimodal integration of fMRI and EEG data for high spatial and temporal resolution analysis of brain networks

PubMed Central

Mantini, D.; Marzetti, L.; Corbetta, M.; Romani, G.L.; Del Gratta, C.

2017-01-01

Two major non-invasive brain mapping techniques, electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), have complementary advantages with regard to their spatial and temporal resolution. We propose an approach based on the integration of EEG and fMRI, enabling the EEG temporal dynamics of information processing to be characterized within spatially well-defined fMRI large-scale networks. First, the fMRI data are decomposed into networks by means of spatial independent component analysis (sICA), and those associated with intrinsic activity and/or responding to task performance are selected using information from the related time-courses. Next, the EEG data over all sensors are averaged with respect to event timing, thus calculating event-related potentials (ERPs). The ERPs are subjected to temporal ICA (tICA), and the resulting components are localized with the weighted minimum norm (WMNLS) algorithm using the task-related fMRI networks as priors. Finally, the temporal contribution of each ERP component in the areas belonging to the fMRI large-scale networks is estimated. The proposed approach has been evaluated on visual target detection data. Our results confirm that two different components, commonly observed in EEG when presenting novel and salient stimuli respectively, are related to the neuronal activation in large-scale networks, operating at different latencies and associated with different functional processes. PMID:20052528

Bayesian inference for the spatio-temporal invasion of alien species.

PubMed

Cook, Alex; Marion, Glenn; Butler, Adam; Gibson, Gavin

2007-08-01

In this paper we develop a Bayesian approach to parameter estimation in a stochastic spatio-temporal model of the spread of invasive species across a landscape. To date, statistical techniques, such as logistic and autologistic regression, have outstripped stochastic spatio-temporal models in their ability to handle large numbers of covariates. Here we seek to address this problem by making use of a range of covariates describing the bio-geographical features of the landscape. Relative to regression techniques, stochastic spatio-temporal models are more transparent in their representation of biological processes. They also explicitly model temporal change, and therefore do not require the assumption that the species' distribution (or other spatial pattern) has already reached equilibrium as is often the case with standard statistical approaches. In order to illustrate the use of such techniques we apply them to the analysis of data detailing the spread of an invasive plant, Heracleum mantegazzianum, across Britain in the 20th Century using geo-referenced covariate information describing local temperature, elevation and habitat type. The use of Markov chain Monte Carlo sampling within a Bayesian framework facilitates statistical assessments of differences in the suitability of different habitat classes for H. mantegazzianum, and enables predictions of future spread to account for parametric uncertainty and system variability. Our results show that ignoring such covariate information may lead to biased estimates of key processes and implausible predictions of future distributions.

The modulation of EEG variability between internally- and externally-driven cognitive states varies with maturation and task performance

PubMed Central

Willatt, Stephanie E.; Cortese, Filomeno; Protzner, Andrea B.

2017-01-01

Increasing evidence suggests that brain signal variability is an important measure of brain function reflecting information processing capacity and functional integrity. In this study, we examined how maturation from childhood to adulthood affects the magnitude and spatial extent of state-to-state transitions in brain signal variability, and how this relates to cognitive performance. We looked at variability changes between resting-state and task (a symbol-matching task with three levels of difficulty), and within trial (fixation, post-stimulus, and post-response). We calculated variability with multiscale entropy (MSE), and additionally examined spectral power density (SPD) from electroencephalography (EEG) in children aged 8–14, and in adults aged 18–33. Our results suggest that maturation is characterized by increased local information processing (higher MSE at fine temporal scales) and decreased long-range interactions with other neural populations (lower MSE at coarse temporal scales). Children show MSE changes that are similar in magnitude, but greater in spatial extent when transitioning between internally- and externally-driven brain states. Additionally, we found that in children, greater changes in task difficulty were associated with greater magnitude of modulation in MSE. Our results suggest that the interplay between maturational and state-to-state changes in brain signal variability manifest across different spatial and temporal scales, and influence information processing capacity in the brain. PMID:28750035

Spatial hearing benefits demonstrated with presentation of acoustic temporal fine structure cues in bilateral cochlear implant listeners.

PubMed

Churchill, Tyler H; Kan, Alan; Goupell, Matthew J; Litovsky, Ruth Y

2014-09-01

Most contemporary cochlear implant (CI) processing strategies discard acoustic temporal fine structure (TFS) information, and this may contribute to the observed deficits in bilateral CI listeners' ability to localize sounds when compared to normal hearing listeners. Additionally, for best speech envelope representation, most contemporary speech processing strategies use high-rate carriers (≥900 Hz) that exceed the limit for interaural pulse timing to provide useful binaural information. Many bilateral CI listeners are sensitive to interaural time differences (ITDs) in low-rate (<300 Hz) constant-amplitude pulse trains. This study explored the trade-off between superior speech temporal envelope representation with high-rate carriers and binaural pulse timing sensitivity with low-rate carriers. The effects of carrier pulse rate and pulse timing on ITD discrimination, ITD lateralization, and speech recognition in quiet were examined in eight bilateral CI listeners. Stimuli consisted of speech tokens processed at different electrical stimulation rates, and pulse timings that either preserved or did not preserve acoustic TFS cues. Results showed that CI listeners were able to use low-rate pulse timing cues derived from acoustic TFS when presented redundantly on multiple electrodes for ITD discrimination and lateralization of speech stimuli.

On the Processing of Semantic Aspects of Experience in the Anterior Medial Temporal Lobe: An Event-Related fMRI Study

ERIC Educational Resources Information Center

Meyer, Patric; Mecklinger, Axel; Friederici, Angela D.

2010-01-01

Recognition memory based on familiarity judgments is a form of declarative memory that has been repeatedly associated with the anterior medial temporal lobe. It has been argued that this region sustains familiarity-based recognition not only by retrieving item-specific information but also by coding for those semantic aspects of an event that…

Quantum-like model of processing of information in the brain based on classical electromagnetic field.

PubMed

Khrennikov, Andrei

2011-09-01

We propose a model of quantum-like (QL) processing of mental information. This model is based on quantum information theory. However, in contrast to models of "quantum physical brain" reducing mental activity (at least at the highest level) to quantum physical phenomena in the brain, our model matches well with the basic neuronal paradigm of the cognitive science. QL information processing is based (surprisingly) on classical electromagnetic signals induced by joint activity of neurons. This novel approach to quantum information is based on representation of quantum mechanics as a version of classical signal theory which was recently elaborated by the author. The brain uses the QL representation (QLR) for working with abstract concepts; concrete images are described by classical information theory. Two processes, classical and QL, are performed parallely. Moreover, information is actively transmitted from one representation to another. A QL concept given in our model by a density operator can generate a variety of concrete images given by temporal realizations of the corresponding (Gaussian) random signal. This signal has the covariance operator coinciding with the density operator encoding the abstract concept under consideration. The presence of various temporal scales in the brain plays the crucial role in creation of QLR in the brain. Moreover, in our model electromagnetic noise produced by neurons is a source of superstrong QL correlations between processes in different spatial domains in the brain; the binding problem is solved on the QL level, but with the aid of the classical background fluctuations. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Maturation of Rapid Auditory Temporal Processing and Subsequent Nonword Repetition Performance in Children

ERIC Educational Resources Information Center

Fox, Allison M.; Reid, Corinne L.; Anderson, Mike; Richardson, Cassandra; Bishop, Dorothy V. M.

2012-01-01

According to the rapid auditory processing theory, the ability to parse incoming auditory information underpins learning of oral and written language. There is wide variation in this low-level perceptual ability, which appears to follow a protracted developmental course. We studied the development of rapid auditory processing using event-related…

Application research on temporal GIS in the transportation information management system

NASA Astrophysics Data System (ADS)

Wang, Wei; Qin, Qianqing; Wang, Chao

2006-10-01

The application, development and key matters of applying spatio-temporal GIS to traffic information management system are discussed in this paper by introducing the development of spatio-temporal database, current models of spatio-temporal data, traits of traffic information management system. This paper proposes a method of organizing spatio-temporal data taking road object changes into consideration, and describes its data structure in 3 aspects, including structure of spatio-temporal object, organizing method spatio-temporal data and storage means of spatio-temporal data. Trying to manage types of spatio-temporal data involved in traffic system, such as road information, river information, railway information, social and economical data, and etc, uniformly, efficiently and with low redundancy.

Rapid Motion Adaptation Reveals the Temporal Dynamics of Spatiotemporal Correlation between ON and OFF Pathways

PubMed Central

Oluk, Can; Pavan, Andrea; Kafaligonul, Hulusi

2016-01-01

At the early stages of visual processing, information is processed by two major thalamic pathways encoding brightness increments (ON) and decrements (OFF). Accumulating evidence suggests that these pathways interact and merge as early as in primary visual cortex. Using regular and reverse-phi motion in a rapid adaptation paradigm, we investigated the temporal dynamics of within and across pathway mechanisms for motion processing. When the adaptation duration was short (188 ms), reverse-phi and regular motion led to similar adaptation effects, suggesting that the information from the two pathways are combined efficiently at early-stages of motion processing. However, as the adaption duration was increased to 752 ms, reverse-phi and regular motion showed distinct adaptation effects depending on the test pattern used, either engaging spatiotemporal correlation between the same or opposite contrast polarities. Overall, these findings indicate that spatiotemporal correlation within and across ON-OFF pathways for motion processing can be selectively adapted, and support those models that integrate within and across pathway mechanisms for motion processing. PMID:27667401

Is the Brain a Quantum Computer?

ERIC Educational Resources Information Center

Litt, Abninder; Eliasmith, Chris; Kroon, Frederick W.; Weinstein, Steven; Thagard, Paul

2006-01-01

We argue that computation via quantum mechanical processes is irrelevant to explaining how brains produce thought, contrary to the ongoing speculations of many theorists. First, quantum effects do not have the temporal properties required for neural information processing. Second, there are substantial physical obstacles to any organic…

Spatio-Temporal Process Variability in Watershed Scale Wetland Restoration Planning

NASA Astrophysics Data System (ADS)

Evenson, G. R.

2012-12-01

Watershed scale restoration decision making processes are increasingly informed by quantitative methodologies providing site-specific restoration recommendations - sometimes referred to as "systematic planning." The more advanced of these methodologies are characterized by a coupling of search algorithms and ecological models to discover restoration plans that optimize environmental outcomes. Yet while these methods have exhibited clear utility as decision support toolsets, they may be critiqued for flawed evaluations of spatio-temporally variable processes fundamental to watershed scale restoration. Hydrologic and non-hydrologic mediated process connectivity along with post-restoration habitat dynamics, for example, are commonly ignored yet known to appreciably affect restoration outcomes. This talk will present a methodology to evaluate such spatio-temporally complex processes in the production of watershed scale wetland restoration plans. Using the Tuscarawas Watershed in Eastern Ohio as a case study, a genetic algorithm will be coupled with the Soil and Water Assessment Tool (SWAT) to reveal optimal wetland restoration plans as measured by their capacity to maximize nutrient reductions. Then, a so-called "graphical" representation of the optimization problem will be implemented in-parallel to promote hydrologic and non-hydrologic mediated connectivity amongst existing wetlands and sites selected for restoration. Further, various search algorithm mechanisms will be discussed as a means of accounting for temporal complexities such as post-restoration habitat dynamics. Finally, generalized patterns of restoration plan optimality will be discussed as an alternative and possibly superior decision support toolset given the complexity and stochastic nature of spatio-temporal process variability.

Information entropy to measure the spatial and temporal complexity of solute transport in heterogeneous porous media

NASA Astrophysics Data System (ADS)

Li, Weiyao; Huang, Guanhua; Xiong, Yunwu

2016-04-01

The complexity of the spatial structure of porous media, randomness of groundwater recharge and discharge (rainfall, runoff, etc.) has led to groundwater movement complexity, physical and chemical interaction between groundwater and porous media cause solute transport in the medium more complicated. An appropriate method to describe the complexity of features is essential when study on solute transport and conversion in porous media. Information entropy could measure uncertainty and disorder, therefore we attempted to investigate complexity, explore the contact between the information entropy and complexity of solute transport in heterogeneous porous media using information entropy theory. Based on Markov theory, two-dimensional stochastic field of hydraulic conductivity (K) was generated by transition probability. Flow and solute transport model were established under four conditions (instantaneous point source, continuous point source, instantaneous line source and continuous line source). The spatial and temporal complexity of solute transport process was characterized and evaluated using spatial moment and information entropy. Results indicated that the entropy increased as the increase of complexity of solute transport process. For the point source, the one-dimensional entropy of solute concentration increased at first and then decreased along X and Y directions. As time increased, entropy peak value basically unchanged, peak position migrated along the flow direction (X direction) and approximately coincided with the centroid position. With the increase of time, spatial variability and complexity of solute concentration increase, which result in the increases of the second-order spatial moment and the two-dimensional entropy. Information entropy of line source was higher than point source. Solute entropy obtained from continuous input was higher than instantaneous input. Due to the increase of average length of lithoface, media continuity increased, flow and solute transport complexity weakened, and the corresponding information entropy also decreased. Longitudinal macro dispersivity declined slightly at early time then rose. Solute spatial and temporal distribution had significant impacts on the information entropy. Information entropy could reflect the change of solute distribution. Information entropy appears a tool to characterize the spatial and temporal complexity of solute migration and provides a reference for future research.

Spatio-temporal Dynamics of Audiovisual Speech Processing

PubMed Central

Bernstein, Lynne E.; Auer, Edward T.; Wagner, Michael; Ponton, Curtis W.

2007-01-01

The cortical processing of auditory-alone, visual-alone, and audiovisual speech information is temporally and spatially distributed, and functional magnetic resonance imaging (fMRI) cannot adequately resolve its temporal dynamics. In order to investigate a hypothesized spatio-temporal organization for audiovisual speech processing circuits, event-related potentials (ERPs) were recorded using electroencephalography (EEG). Stimuli were congruent audiovisual /bα/, incongruent auditory /bα/ synchronized with visual /gα/, auditory-only /bα/, and visual-only /bα/ and /gα/. Current density reconstructions (CDRs) of the ERP data were computed across the latency interval of 50-250 milliseconds. The CDRs demonstrated complex spatio-temporal activation patterns that differed across stimulus conditions. The hypothesized circuit that was investigated here comprised initial integration of audiovisual speech by the middle superior temporal sulcus (STS), followed by recruitment of the intraparietal sulcus (IPS), followed by activation of Broca's area (Miller and d'Esposito, 2005). The importance of spatio-temporally sensitive measures in evaluating processing pathways was demonstrated. Results showed, strikingly, early (< 100 msec) and simultaneous activations in areas of the supramarginal and angular gyrus (SMG/AG), the IPS, the inferior frontal gyrus, and the dorsolateral prefrontal cortex. Also, emergent left hemisphere SMG/AG activation, not predicted based on the unisensory stimulus conditions was observed at approximately 160 to 220 msec. The STS was neither the earliest nor most prominent activation site, although it is frequently considered the sine qua non of audiovisual speech integration. As discussed here, the relatively late activity of the SMG/AG solely under audiovisual conditions is a possible candidate audiovisual speech integration response. PMID:17920933

Strategies for tonal and atonal musical interpretation in blind and normally sighted children: an fMRI study.

PubMed

Guerrero Arenas, Coral; Hidalgo Tobón, Silvia S; Dies Suarez, Pilar; Barragán Pérez, Eduardo; Castro Sierra, Eduardo; García, Julio; de Celis Alonso, Benito

2016-04-01

Early childhood is known to be a period when cortical plasticity phenomena are at a maximum. Music is a stimulus known to modulate these mechanisms. On the other hand, neurological impairments like blindness are also known to affect cortical plasticity. Here, we address how tonal and atonal musical stimuli are processed in control and blind young children. We aimed to understand the differences between the two groups when processing this physiological information. Atonal stimuli produced larger activations in cerebellum, fusiform, and temporal lobe structures than tonal. In contrast, tonal stimuli induced larger frontal lobe representations than atonal. Control participants presented large activations in cerebellum, fusiform, and temporal lobe. A correlation/connectivity study showed that the blind group incorporated larger amounts of perceptual information (somatosensory and motor) into tonal processing through the function of the anterior prefrontal cortex (APC). They also used the visual cortex in conjunction with the Wernicke's area to process this information. In contrast, controls processed sound with perceptual stimuli from auditory cortex structures (including Wernicke's area). In this case, information was processed through the dorsal posterior cingulate cortex and not the APC. The orbitofrontal cortex also played a key role for atonal interpretation in this group. Wernicke's area, known to be involved in speech, was heavily involved for both groups and all stimuli. The two groups presented clear differences in strategies for music processing, with very different recruitment of brain regions.

Querying temporal clinical databases on granular trends.

PubMed

Combi, Carlo; Pozzi, Giuseppe; Rossato, Rosalba

2012-04-01

This paper focuses on the identification of temporal trends involving different granularities in clinical databases, where data are temporal in nature: for example, while follow-up visit data are usually stored at the granularity of working days, queries on these data could require to consider trends either at the granularity of months ("find patients who had an increase of systolic blood pressure within a single month") or at the granularity of weeks ("find patients who had steady states of diastolic blood pressure for more than 3 weeks"). Representing and reasoning properly on temporal clinical data at different granularities are important both to guarantee the efficacy and the quality of care processes and to detect emergency situations. Temporal sequences of data acquired during a care process provide a significant source of information not only to search for a particular value or an event at a specific time, but also to detect some clinically-relevant patterns for temporal data. We propose a general framework for the description and management of temporal trends by considering specific temporal features with respect to the chosen time granularity. Temporal aspects of data are considered within temporal relational databases, first formally by using a temporal extension of the relational calculus, and then by showing how to map these relational expressions to plain SQL queries. Throughout the paper we consider the clinical domain of hemodialysis, where several parameters are periodically sampled during every session. Copyright © 2011 Elsevier Inc. All rights reserved.

Atypical neural synchronization to speech envelope modulations in dyslexia.

PubMed

De Vos, Astrid; Vanvooren, Sophie; Vanderauwera, Jolijn; Ghesquière, Pol; Wouters, Jan

2017-01-01

A fundamental deficit in the synchronization of neural oscillations to temporal information in speech could underlie phonological processing problems in dyslexia. In this study, the hypothesis of a neural synchronization impairment is investigated more specifically as a function of different neural oscillatory bands and temporal information rates in speech. Auditory steady-state responses to 4, 10, 20 and 40Hz modulations were recorded in normal reading and dyslexic adolescents to measure neural synchronization of theta, alpha, beta and low-gamma oscillations to syllabic and phonemic rate information. In comparison to normal readers, dyslexic readers showed reduced non-synchronized theta activity, reduced synchronized alpha activity and enhanced synchronized beta activity. Positive correlations between alpha synchronization and phonological skills were found in normal readers, but were absent in dyslexic readers. In contrast, dyslexic readers exhibited positive correlations between beta synchronization and phonological skills. Together, these results suggest that auditory neural synchronization of alpha and beta oscillations is atypical in dyslexia, indicating deviant neural processing of both syllabic and phonemic rate information. Impaired synchronization of alpha oscillations in particular demonstrated to be the most prominent neural anomaly possibly hampering speech and phonological processing in dyslexic readers. Copyright © 2016 Elsevier Inc. All rights reserved.

Application of Deep Learning of Multi-Temporal SENTINEL-1 Images for the Classification of Coastal Vegetation Zone of the Danube Delta

NASA Astrophysics Data System (ADS)

Niculescu, S.; Ienco, D.; Hanganu, J.

2018-04-01

Land cover is a fundamental variable for regional planning, as well as for the study and understanding of the environment. This work propose a multi-temporal approach relying on a fusion of radar multi-sensor data and information collected by the latest sensor (Sentinel-1) with a view to obtaining better results than traditional image processing techniques. The Danube Delta is the site for this work. The spatial approach relies on new spatial analysis technologies and methodologies: Deep Learning of multi-temporal Sentinel-1. We propose a deep learning network for image classification which exploits the multi-temporal characteristic of Sentinel-1 data. The model we employ is a Gated Recurrent Unit (GRU) Network, a recurrent neural network that explicitly takes into account the time dimension via a gated mechanism to perform the final prediction. The main quality of the GRU network is its ability to consider only the important part of the information coming from the temporal data discarding the irrelevant information via a forgetting mechanism. We propose to use such network structure to classify a series of images Sentinel-1 (20 Sentinel-1 images acquired between 9.10.2014 and 01.04.2016). The results are compared with results of the classification of Random Forest.

Differential roles of right temporal cortex and Broca's area in pitch processing: evidence from music and Mandarin.

PubMed

Nan, Yun; Friederici, Angela D

2013-09-01

Superior temporal and inferior frontal cortices are involved in the processing of pitch information in the domain of language and music. Here, we used fMRI to test the particular roles of these brain regions in the neural implementation of pitch in music and in tone language (Mandarin) with a group of Mandarin speaking musicians whose pertaining experiences in pitch are similar across domains. Our findings demonstrate that the neural network for pitch processing includes the pars triangularis of Broca's area and the right superior temporal gyrus (STG) across domains. Within this network, pitch sensitive activation in Broca's area is tightly linked to the behavioral performance of pitch congruity judgment, thereby reflecting controlled processes. Activation in the right STG is independent of performance and more sensitive to pitch congruity in music than in tone language, suggesting a domain-specific modulation of the perceptual processes. These observations provide a first glimpse at the cortical pitch processing network shared across domains. Copyright © 2012 Wiley Periodicals, Inc., a Wiley company.

Temporal auditory aspects in children with poor school performance and associated factors.

PubMed

Rezende, Bárbara Antunes; Lemos, Stela Maris Aguiar; Medeiros, Adriane Mesquita de

2016-01-01

To investigate the auditory temporal aspects in children with poor school performance aged 7-12 years and their association with behavioral aspects, health perception, school and health profiles, and sociodemographic factors. This is an observational, analytical, transversal study including 89 children with poor school performance aged 7-12 years enrolled in the municipal public schools of a municipality in Minas Gerais state, participants of Specialized Educational Assistance. The first stage of the study was conducted with the subjects' parents aiming to collect information on sociodemographic aspects, health profile, and educational records. In addition, the parents responded to the Strengths and Difficulties Questionnaire (SDQ). The second stage was conducted with the children in order to investigate their health self-perception and analyze the auditory assessment, which consisted of meatoscopy, Transient Otoacoustic Emissions, and tests that evaluated the aspects of simple auditory temporal ordering and auditory temporal resolution. Tests assessing the temporal aspects of auditory temporal processing were considered as response variables, and the explanatory variables were grouped for univariate and multivariate logistic regression analyses. The level of significance was set at 5%. Significant statistical correlation was found between the auditory temporal aspects and the variables age, gender, presence of repetition, and health self-perception. Children with poor school performance presented changes in the auditory temporal aspects. The temporal abilities assessed suggest association with different factors such as maturational process, health self-perception, and school records.

Common Ground: An Interactive Visual Exploration and Discovery for Complex Health Data

DTIC Science & Technology

2015-04-01

working with Intermountain Healthcare on a new rich dataset extracted directly from medical notes using natural language processing ( NLP ) algorithms...probabilities based on a state- of-the-art NLP classifiers. At that stage the data did not include geographic information or temporal information but we

Spatiotemporal dynamics of processing nonsymbolic number: an event-related potential source localization study.

PubMed

Hyde, Daniel C; Spelke, Elizabeth S

2012-09-01

Coordinated studies with adults, infants, and nonhuman animals provide evidence for two distinct systems of nonverbal number representation. The "parallel individuation" (PI) system selects and retains information about one to three individual entities and the "numerical magnitude" system establishes representations of the approximate cardinal value of a group. Recent event-related potential (ERP) work has demonstrated that these systems reliably evoke functionally and temporally distinct patterns of brain response that correspond to established behavioral signatures. However, relatively little is known about the neural generators of these ERP signatures. To address this question, we targeted known ERP signatures of these systems, by contrasting processing of small versus large nonsymbolic numbers, and used a source localization algorithm (LORETA) to identify their cortical origins. Early processing of small numbers, showing the signature effects of PI on the N1 (∼150 ms), was localized primarily to extrastriate visual regions. In contrast, qualitatively and temporally distinct processing of large numbers, showing the signatures of approximate number representation on the mid-latency P2p (∼200-250 ms), was localized primarily to right intraparietal regions. In comparison, mid-latency small number processing was localized to the right temporal-parietal junction and left-lateralized intraparietal regions. These results add spatial information to the emerging ERP literature documenting the process by which we represent number. Furthermore, these results substantiate recent claims that early attentional processes determine whether a collection of objects will be represented through PI or as an approximate numerical magnitude by providing evidence that downstream processing diverges to distinct cortical regions. Copyright © 2011 Wiley Periodicals, Inc.

Crossmodal association of auditory and visual material properties in infants.

PubMed

Ujiie, Yuta; Yamashita, Wakayo; Fujisaki, Waka; Kanazawa, So; Yamaguchi, Masami K

2018-06-18

The human perceptual system enables us to extract visual properties of an object's material from auditory information. In monkeys, the neural basis underlying such multisensory association develops through experience of exposure to a material; material information could be processed in the posterior inferior temporal cortex, progressively from the high-order visual areas. In humans, however, the development of this neural representation remains poorly understood. Here, we demonstrated for the first time the presence of a mapping of the auditory material property with visual material ("Metal" and "Wood") in the right temporal region in preverbal 4- to 8-month-old infants, using near-infrared spectroscopy (NIRS). Furthermore, we found that infants acquired the audio-visual mapping for a property of the "Metal" material later than for the "Wood" material, since infants form the visual property of "Metal" material after approximately 6 months of age. These findings indicate that multisensory processing of material information induces the activation of brain areas related to sound symbolism. Our findings also indicate that the material's familiarity might facilitate the development of multisensory processing during the first year of life.

Distinct neural substrates for semantic knowledge and naming in the temporoparietal network.

PubMed

Gesierich, Benno; Jovicich, Jorge; Riello, Marianna; Adriani, Michela; Monti, Alessia; Brentari, Valentina; Robinson, Simon D; Wilson, Stephen M; Fairhall, Scott L; Gorno-Tempini, Maria Luisa

2012-10-01

Patients with anterior temporal lobe (ATL) lesions show semantic and lexical retrieval deficits, and the differential role of this area in the 2 processes is debated. Functional neuroimaging in healthy individuals has not clarified the matter because semantic and lexical processes usually occur simultaneously and automatically. Furthermore, the ATL is a region challenging for functional magnetic resonance imaging (fMRI) due to susceptibility artifacts, especially at high fields. In this study, we established an optimized ATL-sensitive fMRI acquisition protocol at 4 T and applied an event-related paradigm to study the identification (i.e., association of semantic biographical information) of celebrities, with and without the ability to retrieve their proper names. While semantic processing reliably activated the ATL, only more posterior areas in the left temporal and temporal-parietal junction were significantly modulated by covert lexical retrieval. These results suggest that within a temporoparietal network, the ATL is relatively more important for semantic processing, and posterior language regions are relatively more important for lexical retrieval.

Alpha band event-related desynchronization underlying social situational context processing during irony comprehension: A magnetoencephalography source localization study.

PubMed

Akimoto, Yoritaka; Takahashi, Hidetoshi; Gunji, Atsuko; Kaneko, Yuu; Asano, Michiko; Matsuo, Junko; Ota, Miho; Kunugi, Hiroshi; Hanakawa, Takashi; Mazuka, Reiko; Kamio, Yoko

2017-12-01

Irony comprehension requires integration of social contextual information. Previous studies have investigated temporal aspects of irony processing and its neural substrates using psychological/electroencephalogram or functional magnetic resonance imaging methods, but have not clarified the temporospatial neural mechanisms of irony comprehension. Therefore, we used magnetoencephalography to investigate the neural generators of alpha-band (8-13Hz) event-related desynchronization (ERD) occurring from 600 to 900ms following the onset of a critical sentence at which social situational contexts activated ironic representation. We found that the right anterior temporal lobe, which is involved in processing social knowledge and evaluating others' intentions, exhibited stronger alpha ERD following an ironic statement than following a literal statement. We also found that alpha power in the left anterior temporal lobe correlated with the participants' communication abilities. These results elucidate the temporospatial neural mechanisms of language comprehension in social contexts, including non-literal processing. Copyright © 2017 Elsevier Inc. All rights reserved.

Spatial and temporal variation in evacuee risk perception throughout the evacuation and return-entry process.

PubMed

Siebeneck, Laura K; Cova, Thomas J

2012-09-01

Developing effective evacuation and return-entry plans requires understanding the spatial and temporal dimensions of risk perception experienced by evacuees throughout a disaster event. Using data gathered from the 2008 Cedar Rapids, Iowa Flood, this article explores how risk perception and location influence evacuee behavior during the evacuation and return-entry process. Three themes are discussed: (1) the spatial and temporal characteristics of risk perception throughout the evacuation and return-entry process, (2) the relationship between risk perception and household compliance with return-entry orders, and (3) the role social influences have on the timing of the return by households. The results indicate that geographic location and spatial variation of risk influenced household risk perception and compliance with return-entry plans. In addition, sociodemographic characteristics influenced the timing and characteristics of the return groups. The findings of this study advance knowledge of evacuee behavior throughout a disaster and can inform strategies used by emergency managers throughout the evacuation and return-entry process. © 2012 Society for Risk Analysis.

Hierarchical Processing of Auditory Objects in Humans

PubMed Central

Kumar, Sukhbinder; Stephan, Klaas E; Warren, Jason D; Friston, Karl J; Griffiths, Timothy D

2007-01-01

This work examines the computational architecture used by the brain during the analysis of the spectral envelope of sounds, an important acoustic feature for defining auditory objects. Dynamic causal modelling and Bayesian model selection were used to evaluate a family of 16 network models explaining functional magnetic resonance imaging responses in the right temporal lobe during spectral envelope analysis. The models encode different hypotheses about the effective connectivity between Heschl's Gyrus (HG), containing the primary auditory cortex, planum temporale (PT), and superior temporal sulcus (STS), and the modulation of that coupling during spectral envelope analysis. In particular, we aimed to determine whether information processing during spectral envelope analysis takes place in a serial or parallel fashion. The analysis provides strong support for a serial architecture with connections from HG to PT and from PT to STS and an increase of the HG to PT connection during spectral envelope analysis. The work supports a computational model of auditory object processing, based on the abstraction of spectro-temporal “templates” in the PT before further analysis of the abstracted form in anterior temporal lobe areas. PMID:17542641

A glimpsing account of the role of temporal fine structure information in speech recognition.

PubMed

Apoux, Frédéric; Healy, Eric W

2013-01-01

Many behavioral studies have reported a significant decrease in intelligibility when the temporal fine structure (TFS) of a sound mixture is replaced with noise or tones (i.e., vocoder processing). This finding has led to the conclusion that TFS information is critical for speech recognition in noise. How the normal -auditory system takes advantage of the original TFS, however, remains unclear. Three -experiments on the role of TFS in noise are described. All three experiments measured speech recognition in various backgrounds while manipulating the envelope, TFS, or both. One experiment tested the hypothesis that vocoder processing may artificially increase the apparent importance of TFS cues. Another experiment evaluated the relative contribution of the target and masker TFS by disturbing only the TFS of the target or that of the masker. Finally, a last experiment evaluated the -relative contribution of envelope and TFS information. In contrast to previous -studies, however, the original envelope and TFS were both preserved - to some extent - in all conditions. Overall, the experiments indicate a limited influence of TFS and suggest that little speech information is extracted from the TFS. Concomitantly, these experiments confirm that most speech information is carried by the temporal envelope in real-world conditions. When interpreted within the framework of the glimpsing model, the results of these experiments suggest that TFS is primarily used as a grouping cue to select the time-frequency regions -corresponding to the target speech signal.

Felder-Soloman's Index of Learning Styles: internal consistency, temporal stability, and factor structure.

PubMed

Hosford, Charles C; Siders, William A

2010-10-01

Strategies to facilitate learning include using knowledge of students' learning style preferences to inform students and their teachers. Aims of this study were to evaluate the factor structure, internal consistency, and temporal stability of medical student responses to the Index of Learning Styles (ILS) and determine its appropriateness as an instrument for medical education. The ILS assesses preferences on four dimensions: sensing/intuitive information perceiving, visual/verbal information receiving, active/reflective information processing, and sequential/global information understanding. Students entering the 2002-2007 classes completed the ILS; some completed the ILS again after 2 and 4 years. Analyses of responses supported the ILS's intended structure and moderate reliability. Students had moderate preferences for sensing and visual learning. This study provides evidence supporting the appropriateness of the ILS for assessing learning style preferences in medical students.

Intelligent approach for analysis of respiratory signals and oxygen saturation in the sleep apnea/hypopnea syndrome.

PubMed

Moret-Bonillo, Vicente; Alvarez-Estévez, Diego; Fernández-Leal, Angel; Hernández-Pereira, Elena

2014-01-01

This work deals with the development of an intelligent approach for clinical decision making in the diagnosis of the Sleep Apnea/Hypopnea Syndrome, SAHS, from the analysis of respiratory signals and oxygen saturation in arterial blood, SaO2. In order to accomplish the task the proposed approach makes use of different artificial intelligence techniques and reasoning processes being able to deal with imprecise data. These reasoning processes are based on fuzzy logic and on temporal analysis of the information. The developed approach also takes into account the possibility of artifacts in the monitored signals. Detection and characterization of signal artifacts allows detection of false positives. Identification of relevant diagnostic patterns and temporal correlation of events is performed through the implementation of temporal constraints.

Towards a functional organization of episodic memory in the medial temporal lobe

PubMed Central

Eichenbaum, Howard; Sauvage, Magdalena; Fortin, Norbert; Komorowski, Robert; Lipton, Paul

2011-01-01

Here we describe a model of medial temporal lobe organization in which parallel “what” and “where” processing streams converge within the hippocampus to represent events in the spatio-temporal context in which they occurred; this circuitry also mediates the retrieval of context from event cues and vice versa, which are prototypes of episodic recall. Evidence from studies in animals are reviewed in support of this model, including experiments that distinguish characteristics of episodic recollection from familiarity, neuropsychological and recording studies that have identified a key role for the hippocampus in recollection and in associating events with the context in which they occurred, and distinct roles for parahippocampal region areas in separate “what” and “where” information processing that contributes to recollective and episodic memory. PMID:21810443

Towards a functional organization of episodic memory in the medial temporal lobe.

PubMed

Eichenbaum, Howard; Sauvage, Magdalena; Fortin, Norbert; Komorowski, Robert; Lipton, Paul

2012-08-01

Here we describe a model of medial temporal lobe organization in which parallel "what" and "where" processing streams converge within the hippocampus to represent events in the spatio-temporal context in which they occurred; this circuitry also mediates the retrieval of context from event cues and vice versa, which are prototypes of episodic recall. Evidence from studies in animals are reviewed in support of this model, including experiments that distinguish characteristics of episodic recollection from familiarity, neuropsychological and recording studies that have identified a key role for the hippocampus in recollection and in associating events with the context in which they occurred, and distinct roles for parahippocampal region areas in separate "what" and "where" information processing that contributes to recollective and episodic memory. Copyright © 2011 Elsevier Ltd. All rights reserved.

Intelligent Approach for Analysis of Respiratory Signals and Oxygen Saturation in the Sleep Apnea/Hypopnea Syndrome

PubMed Central

Moret-Bonillo, Vicente; Alvarez-Estévez, Diego; Fernández-Leal, Angel; Hernández-Pereira, Elena

2014-01-01

This work deals with the development of an intelligent approach for clinical decision making in the diagnosis of the Sleep Apnea/Hypopnea Syndrome, SAHS, from the analysis of respiratory signals and oxygen saturation in arterial blood, SaO2. In order to accomplish the task the proposed approach makes use of different artificial intelligence techniques and reasoning processes being able to deal with imprecise data. These reasoning processes are based on fuzzy logic and on temporal analysis of the information. The developed approach also takes into account the possibility of artifacts in the monitored signals. Detection and characterization of signal artifacts allows detection of false positives. Identification of relevant diagnostic patterns and temporal correlation of events is performed through the implementation of temporal constraints. PMID:25035712

Deep recurrent neural network reveals a hierarchy of process memory during dynamic natural vision.

PubMed

Shi, Junxing; Wen, Haiguang; Zhang, Yizhen; Han, Kuan; Liu, Zhongming

2018-05-01

The human visual cortex extracts both spatial and temporal visual features to support perception and guide behavior. Deep convolutional neural networks (CNNs) provide a computational framework to model cortical representation and organization for spatial visual processing, but unable to explain how the brain processes temporal information. To overcome this limitation, we extended a CNN by adding recurrent connections to different layers of the CNN to allow spatial representations to be remembered and accumulated over time. The extended model, or the recurrent neural network (RNN), embodied a hierarchical and distributed model of process memory as an integral part of visual processing. Unlike the CNN, the RNN learned spatiotemporal features from videos to enable action recognition. The RNN better predicted cortical responses to natural movie stimuli than the CNN, at all visual areas, especially those along the dorsal stream. As a fully observable model of visual processing, the RNN also revealed a cortical hierarchy of temporal receptive window, dynamics of process memory, and spatiotemporal representations. These results support the hypothesis of process memory, and demonstrate the potential of using the RNN for in-depth computational understanding of dynamic natural vision. © 2018 Wiley Periodicals, Inc.

Event-related potentials in response to violations of content and temporal event knowledge.

PubMed

Drummer, Janna; van der Meer, Elke; Schaadt, Gesa

2016-01-08

Scripts that store knowledge of everyday events are fundamentally important for managing daily routines. Content event knowledge (i.e., knowledge about which events belong to a script) and temporal event knowledge (i.e., knowledge about the chronological order of events in a script) constitute qualitatively different forms of knowledge. However, there is limited information about each distinct process and the time course involved in accessing content and temporal event knowledge. Therefore, we analyzed event-related potentials (ERPs) in response to either correctly presented event sequences or event sequences that contained a content or temporal error. We found an N400, which was followed by a posteriorly distributed P600 in response to content errors in event sequences. By contrast, we did not find an N400 but an anteriorly distributed P600 in response to temporal errors in event sequences. Thus, the N400 seems to be elicited as a response to a general mismatch between an event and the established event model. We assume that the expectancy violation of content event knowledge, as indicated by the N400, induces the collapse of the established event model, a process indicated by the posterior P600. The expectancy violation of temporal event knowledge is assumed to induce an attempt to reorganize the event model in working memory, a process indicated by the frontal P600. Copyright © 2015 Elsevier Ltd. All rights reserved.

The role of spectral and temporal cues in voice gender discrimination by normal-hearing listeners and cochlear implant users.

PubMed

Fu, Qian-Jie; Chinchilla, Sherol; Galvin, John J

2004-09-01

The present study investigated the relative importance of temporal and spectral cues in voice gender discrimination and vowel recognition by normal-hearing subjects listening to an acoustic simulation of cochlear implant speech processing and by cochlear implant users. In the simulation, the number of speech processing channels ranged from 4 to 32, thereby varying the spectral resolution; the cutoff frequencies of the channels' envelope filters ranged from 20 to 320 Hz, thereby manipulating the available temporal cues. For normal-hearing subjects, results showed that both voice gender discrimination and vowel recognition scores improved as the number of spectral channels was increased. When only 4 spectral channels were available, voice gender discrimination significantly improved as the envelope filter cutoff frequency was increased from 20 to 320 Hz. For all spectral conditions, increasing the amount of temporal information had no significant effect on vowel recognition. Both voice gender discrimination and vowel recognition scores were highly variable among implant users. The performance of cochlear implant listeners was similar to that of normal-hearing subjects listening to comparable speech processing (4-8 spectral channels). The results suggest that both spectral and temporal cues contribute to voice gender discrimination and that temporal cues are especially important for cochlear implant users to identify the voice gender when there is reduced spectral resolution.

Extraction of temporal information in functional MRI

NASA Astrophysics Data System (ADS)

Singh, M.; Sungkarat, W.; Jeong, Jeong-Won; Zhou, Yongxia

2002-10-01

The temporal resolution of functional MRI (fMRI) is limited by the shape of the haemodynamic response function (hrf) and the vascular architecture underlying the activated regions. Typically, the temporal resolution of fMRI is on the order of 1 s. We have developed a new data processing approach to extract temporal information on a pixel-by-pixel basis at the level of 100 ms from fMRI data. Instead of correlating or fitting the time-course of each pixel to a single reference function, which is the common practice in fMRI, we correlate each pixel's time-course to a series of reference functions that are shifted with respect to each other by 100 ms. The reference function yielding the highest correlation coefficient for a pixel is then used as a time marker for that pixel. A Monte Carlo simulation and experimental study of this approach were performed to estimate the temporal resolution as a function of signal-to-noise ratio (SNR) in the time-course of a pixel. Assuming a known and stationary hrf, the simulation and experimental studies suggest a lower limit in the temporal resolution of approximately 100 ms at an SNR of 3. The multireference function approach was also applied to extract timing information from an event-related motor movement study where the subjects flexed a finger on cue. The event was repeated 19 times with the event's presentation staggered to yield an approximately 100-ms temporal sampling of the haemodynamic response over the entire presentation cycle. The timing differences among different regions of the brain activated by the motor task were clearly visualized and quantified by this method. The results suggest that it is possible to achieve a temporal resolution of /spl sim/200 ms in practice with this approach.

It takes two-coincidence coding within the dual olfactory pathway of the honeybee.

PubMed

Brill, Martin F; Meyer, Anneke; Rössler, Wolfgang

2015-01-01

To rapidly process biologically relevant stimuli, sensory systems have developed a broad variety of coding mechanisms like parallel processing and coincidence detection. Parallel processing (e.g., in the visual system), increases both computational capacity and processing speed by simultaneously coding different aspects of the same stimulus. Coincidence detection is an efficient way to integrate information from different sources. Coincidence has been shown to promote associative learning and memory or stimulus feature detection (e.g., in auditory delay lines). Within the dual olfactory pathway of the honeybee both of these mechanisms might be implemented by uniglomerular projection neurons (PNs) that transfer information from the primary olfactory centers, the antennal lobe (AL), to a multimodal integration center, the mushroom body (MB). PNs from anatomically distinct tracts respond to the same stimulus space, but have different physiological properties, characteristics that are prerequisites for parallel processing of different stimulus aspects. However, the PN pathways also display mirror-imaged like anatomical trajectories that resemble neuronal coincidence detectors as known from auditory delay lines. To investigate temporal processing of olfactory information, we recorded PN odor responses simultaneously from both tracts and measured coincident activity of PNs within and between tracts. Our results show that coincidence levels are different within each of the two tracts. Coincidence also occurs between tracts, but to a minor extent compared to coincidence within tracts. Taken together our findings support the relevance of spike timing in coding of olfactory information (temporal code).

Single-trial EEG-informed fMRI reveals spatial dependency of BOLD signal on early and late IC-ERP amplitudes during face recognition.

PubMed

Wirsich, Jonathan; Bénar, Christian; Ranjeva, Jean-Philippe; Descoins, Médéric; Soulier, Elisabeth; Le Troter, Arnaud; Confort-Gouny, Sylviane; Liégeois-Chauvel, Catherine; Guye, Maxime

2014-10-15

Simultaneous EEG-fMRI has opened up new avenues for improving the spatio-temporal resolution of functional brain studies. However, this method usually suffers from poor EEG quality, especially for evoked potentials (ERPs), due to specific artifacts. As such, the use of EEG-informed fMRI analysis in the context of cognitive studies has particularly focused on optimizing narrow ERP time windows of interest, which ignores the rich diverse temporal information of the EEG signal. Here, we propose to use simultaneous EEG-fMRI to investigate the neural cascade occurring during face recognition in 14 healthy volunteers by using the successive ERP peaks recorded during the cognitive part of this process. N170, N400 and P600 peaks, commonly associated with face recognition, were successfully and reproducibly identified for each trial and each subject by using a group independent component analysis (ICA). For the first time we use this group ICA to extract several independent components (IC) corresponding to the sequence of activation and used single-trial peaks as modulation parameters in a general linear model (GLM) of fMRI data. We obtained an occipital-temporal-frontal stream of BOLD signal modulation, in accordance with the three successive IC-ERPs providing an unprecedented spatio-temporal characterization of the whole cognitive process as defined by BOLD signal modulation. By using this approach, the pattern of EEG-informed BOLD modulation provided improved characterization of the network involved than the fMRI-only analysis or the source reconstruction of the three ERPs; the latter techniques showing only two regions in common localized in the occipital lobe. Copyright © 2014 Elsevier Inc. All rights reserved.

Combining Temporal and Spectral Information with Spatial Mapping to Identify Differences between Phonological and Semantic Networks: A Magnetoencephalographic Approach

PubMed Central

McNab, Fiona; Hillebrand, Arjan; Swithenby, Stephen J.; Rippon, Gina

2012-01-01

Early, lesion-based models of language processing suggested that semantic and phonological processes are associated with distinct temporal and parietal regions respectively, with frontal areas more indirectly involved. Contemporary spatial brain mapping techniques have not supported such clear-cut segregation, with strong evidence of activation in left temporal areas by both processes and disputed evidence of involvement of frontal areas in both processes. We suggest that combining spatial information with temporal and spectral data may allow a closer scrutiny of the differential involvement of closely overlapping cortical areas in language processing. Using beamforming techniques to analyze magnetoencephalography data, we localized the neuronal substrates underlying primed responses to nouns requiring either phonological or semantic processing, and examined the associated measures of time and frequency in those areas where activation was common to both tasks. Power changes in the beta (14–30 Hz) and gamma (30–50 Hz) frequency bands were analyzed in pre-selected time windows of 350–550 and 500–700 ms In left temporal regions, both tasks elicited power changes in the same time window (350–550 ms), but with different spectral characteristics, low beta (14–20 Hz) for the phonological task and high beta (20–30 Hz) for the semantic task. In frontal areas (BA10), both tasks elicited power changes in the gamma band (30–50 Hz), but in different time windows, 500–700 ms for the phonological task and 350–550 ms for the semantic task. In the left inferior parietal area (BA40), both tasks elicited changes in the 20–30 Hz beta frequency band but in different time windows, 350–550 ms for the phonological task and 500–700 ms for the semantic task. Our findings suggest that, where spatial measures may indicate overlapping areas of involvement, additional beamforming techniques can demonstrate differential activation in time and frequency domains. PMID:22908001

Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension.

PubMed

Brodbeck, Christian; Presacco, Alessandro; Simon, Jonathan Z

2018-05-15

Human experience often involves continuous sensory information that unfolds over time. This is true in particular for speech comprehension, where continuous acoustic signals are processed over seconds or even minutes. We show that brain responses to such continuous stimuli can be investigated in detail, for magnetoencephalography (MEG) data, by combining linear kernel estimation with minimum norm source localization. Previous research has shown that the requirement to average data over many trials can be overcome by modeling the brain response as a linear convolution of the stimulus and a kernel, or response function, and estimating a kernel that predicts the response from the stimulus. However, such analysis has been typically restricted to sensor space. Here we demonstrate that this analysis can also be performed in neural source space. We first computed distributed minimum norm current source estimates for continuous MEG recordings, and then computed response functions for the current estimate at each source element, using the boosting algorithm with cross-validation. Permutation tests can then assess the significance of individual predictor variables, as well as features of the corresponding spatio-temporal response functions. We demonstrate the viability of this technique by computing spatio-temporal response functions for speech stimuli, using predictor variables reflecting acoustic, lexical and semantic processing. Results indicate that processes related to comprehension of continuous speech can be differentiated anatomically as well as temporally: acoustic information engaged auditory cortex at short latencies, followed by responses over the central sulcus and inferior frontal gyrus, possibly related to somatosensory/motor cortex involvement in speech perception; lexical frequency was associated with a left-lateralized response in auditory cortex and subsequent bilateral frontal activity; and semantic composition was associated with bilateral temporal and frontal brain activity. We conclude that this technique can be used to study the neural processing of continuous stimuli in time and anatomical space with the millisecond temporal resolution of MEG. This suggests new avenues for analyzing neural processing of naturalistic stimuli, without the necessity of averaging over artificially short or truncated stimuli. Copyright © 2018 Elsevier Inc. All rights reserved.

Process-based modeling of temperature and water profiles in the seedling recruitment zone: Part I. Model validation

USDA-ARS?s Scientific Manuscript database

Process-based modeling provides detailed spatial and temporal information of the soil environment in the shallow seedling recruitment zone across field topography where measurements of soil temperature and water may not sufficiently describe the zone. Hourly temperature and water profiles within the...

Premotor neural correlates of predictive motor timing for speech production and hand movement: evidence for a temporal predictive code in the motor system.

PubMed

Johari, Karim; Behroozmand, Roozbeh

2017-05-01

The predictive coding model suggests that neural processing of sensory information is facilitated for temporally-predictable stimuli. This study investigated how temporal processing of visually-presented sensory cues modulates movement reaction time and neural activities in speech and hand motor systems. Event-related potentials (ERPs) were recorded in 13 subjects while they were visually-cued to prepare to produce a steady vocalization of a vowel sound or press a button in a randomized order, and to initiate the cued movement following the onset of a go signal on the screen. Experiment was conducted in two counterbalanced blocks in which the time interval between visual cue and go signal was temporally-predictable (fixed delay at 1000 ms) or unpredictable (variable between 1000 and 2000 ms). Results of the behavioral response analysis indicated that movement reaction time was significantly decreased for temporally-predictable stimuli in both speech and hand modalities. We identified premotor ERP activities with a left-lateralized parietal distribution for hand and a frontocentral distribution for speech that were significantly suppressed in response to temporally-predictable compared with unpredictable stimuli. The premotor ERPs were elicited approximately -100 ms before movement and were significantly correlated with speech and hand motor reaction times only in response to temporally-predictable stimuli. These findings suggest that the motor system establishes a predictive code to facilitate movement in response to temporally-predictable sensory stimuli. Our data suggest that the premotor ERP activities are robust neurophysiological biomarkers of such predictive coding mechanisms. These findings provide novel insights into the temporal processing mechanisms of speech and hand motor systems.

Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory

PubMed Central

Kuhl, Brice A.; Rissman, Jesse; Wagner, Anthony D.

2012-01-01

Successful encoding of episodic memories is thought to depend on contributions from prefrontal and temporal lobe structures. Neural processes that contribute to successful encoding have been extensively explored through univariate analyses of neuroimaging data that compare mean activity levels elicited during the encoding of events that are subsequently remembered vs. those subsequently forgotten. Here, we applied pattern classification to fMRI data to assess the degree to which distributed patterns of activity within prefrontal and temporal lobe structures elicited during the encoding of word-image pairs were diagnostic of the visual category (Face or Scene) of the encoded image. We then assessed whether representation of category information was predictive of subsequent memory. Classification analyses indicated that temporal lobe structures contained information robustly diagnostic of visual category. Information in prefrontal cortex was less diagnostic of visual category, but was nonetheless associated with highly reliable classifier-based evidence for category representation. Critically, trials associated with greater classifier-based estimates of category representation in temporal and prefrontal regions were associated with a higher probability of subsequent remembering. Finally, consideration of trial-by-trial variance in classifier-based measures of category representation revealed positive correlations between prefrontal and temporal lobe representations, with the strength of these correlations varying as a function of the category of image being encoded. Together, these results indicate that multi-voxel representations of encoded information can provide unique insights into how visual experiences are transformed into episodic memories. PMID:21925190

A scheme for recording a fast process at nanosecond scale by using digital holographic interferometry with continuous wave laser

NASA Astrophysics Data System (ADS)

Wang, Jun; Zhao, Jianlin; Di, Jianglei; Jiang, Biqiang

2015-04-01

A scheme for recording fast process at nanosecond scale by using digital holographic interferometry with continuous wave (CW) laser is described and demonstrated experimentally, which employs delayed-time fibers and angular multiplexing technique and can realize the variable temporal resolution at nanosecond scale and different measured depths of object field at certain temporal resolution. The actual delay-time is controlled by two delayed-time fibers with different lengths. The object field information in two different states can be simultaneously recorded in a composite hologram. This scheme is also suitable for recording fast process at picosecond scale, by using an electro-optic modulator.

Temporal Precision of Neuronal Information in a Rapid Perceptual Judgment

PubMed Central

Ghose, Geoffrey M.; Harrison, Ian T.

2009-01-01

In many situations, such as pedestrians crossing a busy street or prey evading predators, rapid decisions based on limited perceptual information are critical for survival. The brevity of these perceptual judgments constrains how neuronal signals are integrated or pooled over time because the underlying sequence of processes, from sensation to perceptual evaluation to motor planning and execution, all occur within several hundred milliseconds. Because most previous physiological studies of these processes have relied on tasks requiring considerably longer temporal integration, the neuronal basis of such rapid decisions remains largely unexplored. In this study, we examine the temporal precision of neuronal activity associated with a rapid perceptual judgment. We find that the activity of individual neurons over tens of milliseconds can reliably convey information about sensory events and was well correlated with the animals' judgments. There was a strong correlation between sensory reliability and the correlation with behavioral choice, suggesting that rapid decisions were preferentially based on the most reliable sensory signals. We also find that a simple model in which the responses of a small number of individual neurons (<5) are summed can completely explain behavioral performance. These results suggest that neuronal circuits are sufficiently precise to allow for cognitive decisions to be based on small numbers of action potentials from highly reliable neurons. PMID:19109454

Perspectives on why digital ecologies matter: combining population genetics and ecologically informed agent-based models with GIS for managing dipteran livestock pests.

PubMed

Peck, Steven L

2014-10-01

It is becoming clear that handling the inherent complexity found in ecological systems is an essential task for finding ways to control insect pests of tropical livestock such as tsetse flies, and old and new world screwworms. In particular, challenging multivalent management programs, such as Area Wide Integrated Pest Management (AW-IPM), face daunting problems of complexity at multiple spatial scales, ranging from landscape level processes to those of smaller scales such as the parasite loads of individual animals. Daunting temporal challenges also await resolution, such as matching management time frames to those found on ecological and even evolutionary temporal scales. How does one deal with representing processes with models that involve multiple spatial and temporal scales? Agent-based models (ABM), combined with geographic information systems (GIS), may allow for understanding, predicting and managing pest control efforts in livestock pests. This paper argues that by incorporating digital ecologies in our management efforts clearer and more informed decisions can be made. I also point out the power of these models in making better predictions in order to anticipate the range of outcomes possible or likely. Copyright © 2014 International Atomic Energy Agency 2014. Published by Elsevier B.V. All rights reserved.

Temporal precision of neuronal information in a rapid perceptual judgment.

PubMed

Ghose, Geoffrey M; Harrison, Ian T

2009-03-01

In many situations, such as pedestrians crossing a busy street or prey evading predators, rapid decisions based on limited perceptual information are critical for survival. The brevity of these perceptual judgments constrains how neuronal signals are integrated or pooled over time because the underlying sequence of processes, from sensation to perceptual evaluation to motor planning and execution, all occur within several hundred milliseconds. Because most previous physiological studies of these processes have relied on tasks requiring considerably longer temporal integration, the neuronal basis of such rapid decisions remains largely unexplored. In this study, we examine the temporal precision of neuronal activity associated with a rapid perceptual judgment. We find that the activity of individual neurons over tens of milliseconds can reliably convey information about sensory events and was well correlated with the animals' judgments. There was a strong correlation between sensory reliability and the correlation with behavioral choice, suggesting that rapid decisions were preferentially based on the most reliable sensory signals. We also find that a simple model in which the responses of a small number of individual neurons (<5) are summed can completely explain behavioral performance. These results suggest that neuronal circuits are sufficiently precise to allow for cognitive decisions to be based on small numbers of action potentials from highly reliable neurons.

Neuromorphic infrared focal plane performs sensor fusion on-plane local-contrast-enhancement spatial and temporal filtering

NASA Astrophysics Data System (ADS)

Massie, Mark A.; Woolaway, James T., II; Curzan, Jon P.; McCarley, Paul L.

1993-08-01

An infrared focal plane has been simulated, designed and fabricated which mimics the form and function of the vertebrate retina. The `Neuromorphic' focal plane has the capability of performing pixel-based sensor fusion and real-time local contrast enhancement, much like the response of the human eye. The device makes use of an indium antimonide detector array with a 3 - 5 micrometers spectral response, and a switched capacitor resistive network to compute a real-time 2D spatial average. This device permits the summation of other sensor outputs to be combined on-chip with the infrared detections of the focal plane itself. The resulting real-time analog processed information thus represents the combined information of many sensors with the advantage that analog spatial and temporal signal processing is performed at the focal plane. A Gaussian subtraction method is used to produce the pixel output which when displayed produces an image with enhanced edges, representing spatial and temporal derivatives in the scene. The spatial and temporal responses of the device are tunable during operation, permitting the operator to `peak up' the response of the array to spatial and temporally varying signals. Such an array adapts to ambient illumination conditions without loss of detection performance. This paper reviews the Neuromorphic infrared focal plane from initial operational simulations to detailed design characteristics, and concludes with a presentation of preliminary operational data for the device as well as videotaped imagery.

Temporal processing of speech in a time-feature space

NASA Astrophysics Data System (ADS)

Avendano, Carlos

1997-09-01

The performance of speech communication systems often degrades under realistic environmental conditions. Adverse environmental factors include additive noise sources, room reverberation, and transmission channel distortions. This work studies the processing of speech in the temporal-feature or modulation spectrum domain, aiming for alleviation of the effects of such disturbances. Speech reflects the geometry of the vocal organs, and the linguistically dominant component is in the shape of the vocal tract. At any given point in time, the shape of the vocal tract is reflected in the short-time spectral envelope of the speech signal. The rate of change of the vocal tract shape appears to be important for the identification of linguistic components. This rate of change, or the rate of change of the short-time spectral envelope can be described by the modulation spectrum, i.e. the spectrum of the time trajectories described by the short-time spectral envelope. For a wide range of frequency bands, the modulation spectrum of speech exhibits a maximum at about 4 Hz, the average syllabic rate. Disturbances often have modulation frequency components outside the speech range, and could in principle be attenuated without significantly affecting the range with relevant linguistic information. Early efforts for exploiting the modulation spectrum domain (temporal processing), such as the dynamic cepstrum or the RASTA processing, used ad hoc designed processing and appear to be suboptimal. As a major contribution, in this dissertation we aim for a systematic data-driven design of temporal processing. First we analytically derive and discuss some properties and merits of temporal processing for speech signals. We attempt to formalize the concept and provide a theoretical background which has been lacking in the field. In the experimental part we apply temporal processing to a number of problems including adaptive noise reduction in cellular telephone environments, reduction of reverberation for speech enhancement, and improvements on automatic recognition of speech degraded by linear distortions and reverberation.

Time to rethink the neural mechanisms of learning and memory.

PubMed

Gallistel, Charles R; Balsam, Peter D

2014-02-01

Most studies in the neurobiology of learning assume that the underlying learning process is a pairing - dependent change in synaptic strength that requires repeated experience of events presented in close temporal contiguity. However, much learning is rapid and does not depend on temporal contiguity, which has never been precisely defined. These points are well illustrated by studies showing that the temporal relations between events are rapidly learned- even over long delays- and that this knowledge governs the form and timing of behavior. The speed with which anticipatory responses emerge in conditioning paradigms is determined by the information that cues provide about the timing of rewards. The challenge for understanding the neurobiology of learning is to understand the mechanisms in the nervous system that encode information from even a single experience, the nature of the memory mechanisms that can encode quantities such as time, and how the brain can flexibly perform computations based on this information. Copyright © 2013 Elsevier Inc. All rights reserved.

What Is an Arteriovenous Malformation (AVM)?

MedlinePlus

... sensory information, such as interpretation of pain and temperature, light touch, vibration and more. The temporal lobe functions to process things related to hearing, memory, learning and receptive speech. The occipital lobe functions to ...

Effects of Emotional Valence and Arousal on Time Perception

PubMed Central

Van Volkinburg, Heather; Balsam, Peter

2016-01-01

We examined the influence of emotional arousal and valence on estimating time intervals. A reproduction task was used in which images from the International Affective Picture System served as the stimuli to be timed. Experiment 1 assessed the effects of positive and negative valence at a moderate arousal level and Experiment 2 replicated Experiment 1 with the addition of a high arousal condition. Overestimation increased as a function of arousal during encoding of times regardless of valence. For images presented during reproduction, overestimation occurred at the moderate arousal level for positive and negative valence but underestimation occurred in the negative valence high arousal condition. The overestimation of time intervals produced by emotional arousal during encoding and during reproduction suggests that emotional stimuli affect temporal information processing in a qualitatively different way during different phases of temporal information processing. PMID:27110491

The right parietal cortex and time perception: back to Critchley and the Zeitraffer phenomenon.

PubMed

Alexander, Iona; Cowey, Alan; Walsh, Vincent

2005-05-01

We investigated the involvement of the posterior parietal cortex in time perception by temporarily disrupting normal functioning in this region, in subjects making prospective judgements of time or pitch. Disruption of the right posterior parietal cortex significantly slowed reaction times when making time, but not pitch, judgements. Similar interference with the left parietal cortex and control stimulation over the vertex did not significantly change performance on either pitch or time tasks. The results show that the information processing necessary for temporal judgements involves the parietal cortex, probably to optimise spatiotemporal accuracy in voluntary action. The results are in agreement with a recent neuroimaging study and are discussed with regard to a psychological model of temporal processing and a recent proposal that time is part of a parietal cortex system for encoding magnitude information relevant for action.

Stress time-dependently influences the acquisition and retrieval of unrelated information by producing a memory of its own.

PubMed

Cadle, Chelsea E; Zoladz, Phillip R

2015-01-01

Stress induces several temporally guided "waves" of psychobiological responses that differentially influence learning and memory. One way to understand how the temporal dynamics of stress influence these cognitive processes is to consider stress, itself, as a learning experience that influences additional learning and memory. Indeed, research has shown that stress results in electrophysiological and biochemical activity that is remarkably similar to the activity observed as a result of learning. In this review, we will present the idea that when a stressful episode immediately precedes or follows learning, such learning is enhanced because the learned information becomes a part of the stress context and is tagged by the emotional memory being formed. In contrast, when a stressful episode is temporally separated from learning or is experienced prior to retrieval, such learning or memory is impaired because the learning or memory is experienced outside the context of the stress episode or subsequent to a saturation of synaptic plasticity, which renders the retrieval of information improbable. The temporal dynamics of emotional memory formation, along with the neurobiological correlates of the stress response, are discussed to support these hypotheses.

Use of soil moisture dynamics and patterns for the investigation of runoff generation processes with emphasis on preferential flow

NASA Astrophysics Data System (ADS)

Blume, T.; Zehe, E.; Bronstert, A.

2007-08-01

Spatial patterns as well as temporal dynamics of soil moisture have a major influence on runoff generation. The investigation of these dynamics and patterns can thus yield valuable information on hydrological processes, especially in data scarce or previously ungauged catchments. The combination of spatially scarce but temporally high resolution soil moisture profiles with episodic and thus temporally scarce moisture profiles at additional locations provides information on spatial as well as temporal patterns of soil moisture at the hillslope transect scale. This approach is better suited to difficult terrain (dense forest, steep slopes) than geophysical techniques and at the same time less cost-intensive than a high resolution grid of continuously measuring sensors. Rainfall simulation experiments with dye tracers while continuously monitoring soil moisture response allows for visualization of flow processes in the unsaturated zone at these locations. Data was analyzed at different spacio-temporal scales using various graphical methods, such as space-time colour maps (for the event and plot scale) and indicator maps (for the long-term and hillslope scale). Annual dynamics of soil moisture and decimeter-scale variability were also investigated. The proposed approach proved to be successful in the investigation of flow processes in the unsaturated zone and showed the importance of preferential flow in the Malalcahuello Catchment, a data-scarce catchment in the Andes of Southern Chile. Fast response times of stream flow indicate that preferential flow observed at the plot scale might also be of importance at the hillslope or catchment scale. Flow patterns were highly variable in space but persistent in time. The most likely explanation for preferential flow in this catchment is a combination of hydrophobicity, small scale heterogeneity in rainfall due to redistribution in the canopy and strong gradients in unsaturated conductivities leading to self-reinforcing flow paths.

Remote-Sensing Time Series Analysis, a Vegetation Monitoring Tool

NASA Technical Reports Server (NTRS)

McKellip, Rodney; Prados, Donald; Ryan, Robert; Ross, Kenton; Spruce, Joseph; Gasser, Gerald; Greer, Randall

2008-01-01

The Time Series Product Tool (TSPT) is software, developed in MATLAB , which creates and displays high signal-to- noise Vegetation Indices imagery and other higher-level products derived from remotely sensed data. This tool enables automated, rapid, large-scale regional surveillance of crops, forests, and other vegetation. TSPT temporally processes high-revisit-rate satellite imagery produced by the Moderate Resolution Imaging Spectroradiometer (MODIS) and by other remote-sensing systems. Although MODIS imagery is acquired daily, cloudiness and other sources of noise can greatly reduce the effective temporal resolution. To improve cloud statistics, the TSPT combines MODIS data from multiple satellites (Aqua and Terra). The TSPT produces MODIS products as single time-frame and multitemporal change images, as time-series plots at a selected location, or as temporally processed image videos. Using the TSPT program, MODIS metadata is used to remove and/or correct bad and suspect data. Bad pixel removal, multiple satellite data fusion, and temporal processing techniques create high-quality plots and animated image video sequences that depict changes in vegetation greenness. This tool provides several temporal processing options not found in other comparable imaging software tools. Because the framework to generate and use other algorithms is established, small modifications to this tool will enable the use of a large range of remotely sensed data types. An effective remote-sensing crop monitoring system must be able to detect subtle changes in plant health in the earliest stages, before the effects of a disease outbreak or other adverse environmental conditions can become widespread and devastating. The integration of the time series analysis tool with ground-based information, soil types, crop types, meteorological data, and crop growth models in a Geographic Information System, could provide the foundation for a large-area crop-surveillance system that could identify a variety of plant phenomena and improve monitoring capabilities.

Dissociation and Convergence of the Dorsal and Ventral Visual Streams in the Human Prefrontal Cortex

PubMed Central

Takahashi, Emi; Ohki, Kenichi; Kim, Dae-Shik

2012-01-01

Visual information is largely processed through two pathways in the primate brain: an object pathway from the primary visual cortex to the temporal cortex (ventral stream) and a spatial pathway to the parietal cortex (dorsal stream). Whether and to what extent dissociation exists in the human prefrontal cortex (PFC) has long been debated. We examined anatomical connections from functionally defined areas in the temporal and parietal cortices to the PFC, using noninvasive functional and diffusion-weighted magnetic resonance imaging. The right inferior frontal gyrus (IFG) received converging input from both streams, while the right superior frontal gyrus received input only from the dorsal stream. Interstream functional connectivity to the IFG was dynamically recruited only when both object and spatial information were processed. These results suggest that the human PFC receives dissociated and converging visual pathways, and that the right IFG region serves as an integrator of the two types of information. PMID:23063444

Prediction and constraint in audiovisual speech perception

PubMed Central

Peelle, Jonathan E.; Sommers, Mitchell S.

2015-01-01

During face-to-face conversational speech listeners must efficiently process a rapid and complex stream of multisensory information. Visual speech can serve as a critical complement to auditory information because it provides cues to both the timing of the incoming acoustic signal (the amplitude envelope, influencing attention and perceptual sensitivity) and its content (place and manner of articulation, constraining lexical selection). Here we review behavioral and neurophysiological evidence regarding listeners' use of visual speech information. Multisensory integration of audiovisual speech cues improves recognition accuracy, particularly for speech in noise. Even when speech is intelligible based solely on auditory information, adding visual information may reduce the cognitive demands placed on listeners through increasing precision of prediction. Electrophysiological studies demonstrate oscillatory cortical entrainment to speech in auditory cortex is enhanced when visual speech is present, increasing sensitivity to important acoustic cues. Neuroimaging studies also suggest increased activity in auditory cortex when congruent visual information is available, but additionally emphasize the involvement of heteromodal regions of posterior superior temporal sulcus as playing a role in integrative processing. We interpret these findings in a framework of temporally-focused lexical competition in which visual speech information affects auditory processing to increase sensitivity to auditory information through an early integration mechanism, and a late integration stage that incorporates specific information about a speaker's articulators to constrain the number of possible candidates in a spoken utterance. Ultimately it is words compatible with both auditory and visual information that most strongly determine successful speech perception during everyday listening. Thus, audiovisual speech perception is accomplished through multiple stages of integration, supported by distinct neuroanatomical mechanisms. PMID:25890390

A Fuzzy Cognitive Model of aeolian instability across the South Texas Sandsheet

NASA Astrophysics Data System (ADS)

Houser, C.; Bishop, M. P.; Barrineau, C. P.

2014-12-01

Characterization of aeolian systems is complicated by rapidly changing surface-process regimes, spatio-temporal scale dependencies, and subjective interpretation of imagery and spatial data. This paper describes the development and application of analytical reasoning to quantify instability of an aeolian environment using scale-dependent information coupled with conceptual knowledge of process and feedback mechanisms. Specifically, a simple Fuzzy Cognitive Model (FCM) for aeolian landscape instability was developed that represents conceptual knowledge of key biophysical processes and feedbacks. Model inputs include satellite-derived surface biophysical and geomorphometric parameters. FCMs are a knowledge-based Artificial Intelligence (AI) technique that merges fuzzy logic and neural computing in which knowledge or concepts are structured as a web of relationships that is similar to both human reasoning and the human decision-making process. Given simple process-form relationships, the analytical reasoning model is able to map the influence of land management practices and the geomorphology of the inherited surface on aeolian instability within the South Texas Sandsheet. Results suggest that FCMs can be used to formalize process-form relationships and information integration analogous to human cognition with future iterations accounting for the spatial interactions and temporal lags across the sand sheets.

Temporal Resolution Needed for Auditory Communication: Measurement With Mosaic Speech

PubMed Central

Nakajima, Yoshitaka; Matsuda, Mizuki; Ueda, Kazuo; Remijn, Gerard B.

2018-01-01

Temporal resolution needed for Japanese speech communication was measured. A new experimental paradigm that can reflect the spectro-temporal resolution necessary for healthy listeners to perceive speech is introduced. As a first step, we report listeners' intelligibility scores of Japanese speech with a systematically degraded temporal resolution, so-called “mosaic speech”: speech mosaicized in the coordinates of time and frequency. The results of two experiments show that mosaic speech cut into short static segments was almost perfectly intelligible with a temporal resolution of 40 ms or finer. Intelligibility dropped for a temporal resolution of 80 ms, but was still around 50%-correct level. The data are in line with previous results showing that speech signals separated into short temporal segments of <100 ms can be remarkably robust in terms of linguistic-content perception against drastic manipulations in each segment, such as partial signal omission or temporal reversal. The human perceptual system thus can extract meaning from unexpectedly rough temporal information in speech. The process resembles that of the visual system stringing together static movie frames of ~40 ms into vivid motion. PMID:29740295

Video quality assessment using motion-compensated temporal filtering and manifold feature similarity

PubMed Central

Yu, Mei; Jiang, Gangyi; Shao, Feng; Peng, Zongju

2017-01-01

Well-performed Video quality assessment (VQA) method should be consistent with human visual systems for better prediction accuracy. In this paper, we propose a VQA method using motion-compensated temporal filtering (MCTF) and manifold feature similarity. To be more specific, a group of frames (GoF) is first decomposed into a temporal high-pass component (HPC) and a temporal low-pass component (LPC) by MCTF. Following this, manifold feature learning (MFL) and phase congruency (PC) are used to predict the quality of temporal LPC and temporal HPC respectively. The quality measures of the LPC and the HPC are then combined as GoF quality. A temporal pooling strategy is subsequently used to integrate GoF qualities into an overall video quality. The proposed VQA method appropriately processes temporal information in video by MCTF and temporal pooling strategy, and simulate human visual perception by MFL. Experiments on publicly available video quality database showed that in comparison with several state-of-the-art VQA methods, the proposed VQA method achieves better consistency with subjective video quality and can predict video quality more accurately. PMID:28445489

Processing of Natural Echolocation Sequences in the Inferior Colliculus of Seba’s Fruit Eating Bat, Carollia perspicillata

PubMed Central

Kordes, Sebastian; Kössl, Manfred

2017-01-01

Abstract For the purpose of orientation, echolocating bats emit highly repetitive and spatially directed sonar calls. Echoes arising from call reflections are used to create an acoustic image of the environment. The inferior colliculus (IC) represents an important auditory stage for initial processing of echolocation signals. The present study addresses the following questions: (1) how does the temporal context of an echolocation sequence mimicking an approach flight of an animal affect neuronal processing of distance information to echo delays? (2) how does the IC process complex echolocation sequences containing echo information from multiple objects (multiobject sequence)? Here, we conducted neurophysiological recordings from the IC of ketamine-anaesthetized bats of the species Carollia perspicillata and compared the results from the IC with the ones from the auditory cortex (AC). Neuronal responses to an echolocation sequence was suppressed when compared to the responses to temporally isolated and randomized segments of the sequence. The neuronal suppression was weaker in the IC than in the AC. In contrast to the cortex, the time course of the acoustic events is reflected by IC activity. In the IC, suppression sharpens the neuronal tuning to specific call-echo elements and increases the signal-to-noise ratio in the units’ responses. When presenting multiple-object sequences, despite collicular suppression, the neurons responded to each object-specific echo. The latter allows parallel processing of multiple echolocation streams at the IC level. Altogether, our data suggests that temporally-precise neuronal responses in the IC could allow fast and parallel processing of multiple acoustic streams. PMID:29242823

The costs of emotional attention: affective processing inhibits subsequent lexico-semantic analysis.

PubMed

Ihssen, Niklas; Heim, Sabine; Keil, Andreas

2007-12-01

The human brain has evolved to process motivationally relevant information in an optimized manner. The perceptual benefit for emotionally arousing material, termed motivated attention, is indexed by electrocortical amplification at various levels of stimulus analysis. An outstanding issue, particularly on a neuronal level, refers to whether and how perceptual enhancement for arousing signals translates into modified processing of information presented in temporal or spatial proximity to the affective cue. The present studies aimed to examine facilitation and interference effects of task-irrelevant emotional pictures on subsequent word identification. In the context of forced-choice lexical decision tasks, pictures varying in hedonic valence and emotional arousal preceded word/ pseudoword targets. Across measures and experiments, high-arousing compared to low-arousing pictures were associated with impaired processing of word targets. Arousing pleasant and unpleasant pictures prolonged word reaction times irrespective of stimulus-onset asynchrony (80 msec, 200 msec, 440 msec) and salient semantic category differences (e.g., erotica vs. mutilation pictures). On a neuronal level, interference was reflected in reduced N1 responses (204-264 msec) to both target types. Paralleling behavioral effects, suppression of the late positivity (404-704 msec) was more pronounced for word compared to pseudoword targets. Regional source modeling indicated that early reduction effects originated from inhibited cortical activity in posterior areas of the left inferior temporal cortex associated with orthographic processing. Modeling of later reduction effects argues for interference in distributed semantic networks comprising left anterior temporal and parietal sources. Thus, affective processing interferes with subsequent lexico-semantic analysis along the ventral stream.

Processing of Natural Echolocation Sequences in the Inferior Colliculus of Seba's Fruit Eating Bat, Carollia perspicillata.

PubMed

Beetz, M Jerome; Kordes, Sebastian; García-Rosales, Francisco; Kössl, Manfred; Hechavarría, Julio C

2017-01-01

For the purpose of orientation, echolocating bats emit highly repetitive and spatially directed sonar calls. Echoes arising from call reflections are used to create an acoustic image of the environment. The inferior colliculus (IC) represents an important auditory stage for initial processing of echolocation signals. The present study addresses the following questions: (1) how does the temporal context of an echolocation sequence mimicking an approach flight of an animal affect neuronal processing of distance information to echo delays? (2) how does the IC process complex echolocation sequences containing echo information from multiple objects (multiobject sequence)? Here, we conducted neurophysiological recordings from the IC of ketamine-anaesthetized bats of the species Carollia perspicillata and compared the results from the IC with the ones from the auditory cortex (AC). Neuronal responses to an echolocation sequence was suppressed when compared to the responses to temporally isolated and randomized segments of the sequence. The neuronal suppression was weaker in the IC than in the AC. In contrast to the cortex, the time course of the acoustic events is reflected by IC activity. In the IC, suppression sharpens the neuronal tuning to specific call-echo elements and increases the signal-to-noise ratio in the units' responses. When presenting multiple-object sequences, despite collicular suppression, the neurons responded to each object-specific echo. The latter allows parallel processing of multiple echolocation streams at the IC level. Altogether, our data suggests that temporally-precise neuronal responses in the IC could allow fast and parallel processing of multiple acoustic streams.

Age-Related Neural Oscillation Patterns During the Processing of Temporally Manipulated Speech.

PubMed

Rufener, Katharina S; Oechslin, Mathias S; Wöstmann, Malte; Dellwo, Volker; Meyer, Martin

2016-05-01

This EEG-study aims to investigate age-related differences in the neural oscillation patterns during the processing of temporally modulated speech. Viewing from a lifespan perspective, we recorded the electroencephalogram (EEG) data of three age samples: young adults, middle-aged adults and older adults. Stimuli consisted of temporally degraded sentences in Swedish-a language unfamiliar to all participants. We found age-related differences in phonetic pattern matching when participants were presented with envelope-degraded sentences, whereas no such age-effect was observed in the processing of fine-structure-degraded sentences. Irrespective of age, during speech processing the EEG data revealed a relationship between envelope information and the theta band (4-8 Hz) activity. Additionally, an association between fine-structure information and the gamma band (30-48 Hz) activity was found. No interaction, however, was found between acoustic manipulation of stimuli and age. Importantly, our main finding was paralleled by an overall enhanced power in older adults in high frequencies (gamma: 30-48 Hz). This occurred irrespective of condition. For the most part, this result is in line with the Asymmetric Sampling in Time framework (Poeppel in Speech Commun 41:245-255, 2003), which assumes an isomorphic correspondence between frequency modulations in neurophysiological patterns and acoustic oscillations in spoken language. We conclude that speech-specific neural networks show strong stability over adulthood, despite initial processes of cortical degeneration indicated by enhanced gamma power. The results of our study therefore confirm the concept that sensory and cognitive processes undergo multidirectional trajectories within the context of healthy aging.

Toward a clinic of temporality?

PubMed

Rivasseau Jonveaux, Thérèse; Batt, Martine; Trognon, Alain

2017-12-01

The discovery of time cells has expanded our knowledge in the field of spatial and temporal information coding and the key role of the hippocampus. The internal clock model complemented with the attentional gate model allows a more in-depth understanding of the perception of time. The motor representation of duration is ensured by the basal ganglia, while the cerebellum synchronizes short duration for the movement. The right prefrontal cortex seemingly intervenes in the handling of temporal information in working memory. The temporal lobe ensures the comparison of durations, especially the right lobe for the reference durations and the medial lobe for the reproduction of durations in episodic memory. During normal aging, the hypothesis of slowing of the temporal processor is evoked when noting the perception of the acceleration of the passage of time that seemingly occurs with advancing age. The various studies pertaining specifically to time cognition, albeit heterogeneous in terms of methodology, attest to the wide-ranging disturbances of this cognitive field during the course of numerous disorders, whether psychiatric - depression and schizophrenia notably - or neurological. Hence, perturbations in temporality are observed in focal brain lesions and in subcortical disorders, such as Parkinson's disease or Huntington's chorea. Alzheimer's disease represents a particularly fertile field of exploration with regard to time cognition and temporality. The objectified deconstruction of temporal experience provides insights into the very processes of temporality and their nature: episodic, semantic and procedural. In addition to exploration based on elementary stimuli, one should also consider the time lived, i.e. that of the subject, to better understand cognition as it relates to time. While the temporal dimension permeates the whole cognitive field, it remains largely neglected: integration of a genuine time cognition and temporality clinic in daily practice remains to be implemented.

Dynamic decomposition of spatiotemporal neural signals

PubMed Central

2017-01-01

Neural signals are characterized by rich temporal and spatiotemporal dynamics that reflect the organization of cortical networks. Theoretical research has shown how neural networks can operate at different dynamic ranges that correspond to specific types of information processing. Here we present a data analysis framework that uses a linearized model of these dynamic states in order to decompose the measured neural signal into a series of components that capture both rhythmic and non-rhythmic neural activity. The method is based on stochastic differential equations and Gaussian process regression. Through computer simulations and analysis of magnetoencephalographic data, we demonstrate the efficacy of the method in identifying meaningful modulations of oscillatory signals corrupted by structured temporal and spatiotemporal noise. These results suggest that the method is particularly suitable for the analysis and interpretation of complex temporal and spatiotemporal neural signals. PMID:28558039

Composing lexical versus functional adjectives: Evidence for uniformity in the left temporal lobe.

PubMed

Zhang, Linmin; Pylkkänen, Liina

2018-04-24

Featural information (e.g., color or shape) allows interlocutors to focus their attention on the specific items under discussion from the vast set of possibilities in the environment. Intriguingly, when they are used to modify and restrict nouns, adjectives can either carry featural information themselves (e.g., green car) or retrieve featural information from the context (e.g., somebody points at a car and claims that she has the same car or a different car). Do the processing of same/different car and green car share neural correlates? For the composition of nouns with feature-carrying adjectives, prior work revealed early compositional effects (roughly 200 ms after noun onset) in the left anterior temporal lobe. However, although we know that such effects do not extend to cases of numeral quantification, which add no conceptual features to the noun (e.g., two boats), we do not know whether they extend to functional adjectives that themselves introduce no features, but instead reference features in the context. To address this question, we measured magnetoencephalography (MEG) during the processing of five types of noun phrases (NPs): same NPs (e.g., same star), different NPs (e.g., different star), color NPs (e.g., green star), comparative NPs (e.g., larger star), and another NPs (e.g., another star). Our main finding was that between 185 to 240 ms after noun onset, same and different NPs patterned with the color NPs in their elicited left temporal lobe activity, and same NPs even trended toward higher amplitudes than the color NPs. This shows that the mechanism driving combinatory effects in the left temporal cortex does not require the input words to directly name conceptual features, as long as the words reference featural information in the context, and that overlapping neural correlates underlie the composition of featural information from both linguistic and nonlinguistic sources.

Normal voice processing after posterior superior temporal sulcus lesion.

PubMed

Jiahui, Guo; Garrido, Lúcia; Liu, Ran R; Susilo, Tirta; Barton, Jason J S; Duchaine, Bradley

2017-10-01

The right posterior superior temporal sulcus (pSTS) shows a strong response to voices, but the cognitive processes generating this response are unclear. One possibility is that this activity reflects basic voice processing. However, several fMRI and magnetoencephalography findings suggest instead that pSTS serves as an integrative hub that combines voice and face information. Here we investigate whether right pSTS contributes to basic voice processing by testing Faith, a patient whose right pSTS was resected, with eight behavioral tasks assessing voice identity perception and recognition, voice sex perception, and voice expression perception. Faith performed normally on all the tasks. Her normal performance indicates right pSTS is not necessary for intact voice recognition and suggests that pSTS activations to voices reflect higher-level processes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Spatial Frequency Priming of Scene Perception in Adolescents with and without ASD

ERIC Educational Resources Information Center

Vanmarcke, Steven; Noens, Ilse; Steyaert, Jean; Wagemans, Johan

2017-01-01

While most typically developing (TD) participants have a coarse-to-fine processing style, people with autism spectrum disorder (ASD) seem to be less globally and more locally biased when processing visual information. The stimulus-specific spatial frequency content might be directly relevant to determine this temporal hierarchy of visual…

Time Is Precious: Variable- and Event-Centred Approaches to Process Analysis in CSCL Research

ERIC Educational Resources Information Center

Reimann, Peter

2009-01-01

Although temporality is a key characteristic of the core concepts of CSCL--interaction, communication, learning, knowledge building, technology use--and although CSCL researchers have privileged access to process data, the theoretical constructs and methods employed in research practice frequently neglect to make full use of information relating…

Time Processing Impairments in Preschoolers at Risk of Developing Difficulties in Mathematics

ERIC Educational Resources Information Center

Tobia, Valentina; Rinaldi, Luca; Marzocchi, Gian Marco

2018-01-01

The occurrence of time processing problems in individuals with Development Dyscalculia (DD) has favored the view of a general magnitude system devoted to both numerical and temporal information. Yet, this scenario has been partially challenged by studies indicating that time difficulties can be attributed to poor calculation or counting skills,…

Ocular-Motor Function and Information Processing: Implications for the Reading Process.

ERIC Educational Resources Information Center

Leisman, Gerald; Schwartz, Joddy

This paper discusses the dichotomy between continually moving eyes and the lack of blurred visual experience. A discontinuous model of visual perception is proposed, with the discontinuities being phase and temporally related to saccadic eye movements. It is further proposed that deviant duration and angular velocity characteristics of saccades in…

Cortical activation during Braille reading is influenced by early visual experience in subjects with severe visual disability: a correlational fMRI study.

PubMed

Melzer, P; Morgan, V L; Pickens, D R; Price, R R; Wall, R S; Ebner, F F

2001-11-01

Functional magnetic resonance imaging was performed on blind adults resting and reading Braille. The strongest activation was found in primary somatic sensory/motor cortex on both cortical hemispheres. Additional foci of activation were situated in the parietal, temporal, and occipital lobes where visual information is processed in sighted persons. The regions were differentiated most in the correlation of their time courses of activation with resting and reading. Differences in magnitude and expanse of activation were substantially less significant. Among the traditionally visual areas, the strength of correlation was greatest in posterior parietal cortex and moderate in occipitotemporal, lateral occipital, and primary visual cortex. It was low in secondary visual cortex as well as in dorsal and ventral inferior temporal cortex and posterior middle temporal cortex. Visual experience increased the strength of correlation in all regions except dorsal inferior temporal and posterior parietal cortex. The greatest statistically significant increase, i.e., approximately 30%, was in ventral inferior temporal and posterior middle temporal cortex. In these regions, words are analyzed semantically, which may be facilitated by visual experience. In contrast, visual experience resulted in a slight, insignificant diminution of the strength of correlation in dorsal inferior temporal cortex where language is analyzed phonetically. These findings affirm that posterior temporal regions are engaged in the processing of written language. Moreover, they suggest that this function is modified by early visual experience. Furthermore, visual experience significantly strengthened the correlation of activation and Braille reading in occipital regions traditionally involved in the processing of visual features and object recognition suggesting a role for visual imagery. Copyright 2001 Wiley-Liss, Inc.

Brain connectivity analysis from EEG signals using stable phase-synchronized states during face perception tasks

NASA Astrophysics Data System (ADS)

Jamal, Wasifa; Das, Saptarshi; Maharatna, Koushik; Pan, Indranil; Kuyucu, Doga

2015-09-01

Degree of phase synchronization between different Electroencephalogram (EEG) channels is known to be the manifestation of the underlying mechanism of information coupling between different brain regions. In this paper, we apply a continuous wavelet transform (CWT) based analysis technique on EEG data, captured during face perception tasks, to explore the temporal evolution of phase synchronization, from the onset of a stimulus. Our explorations show that there exists a small set (typically 3-5) of unique synchronized patterns or synchrostates, each of which are stable of the order of milliseconds. Particularly, in the beta (β) band, which has been reported to be associated with visual processing task, the number of such stable states has been found to be three consistently. During processing of the stimulus, the switching between these states occurs abruptly but the switching characteristic follows a well-behaved and repeatable sequence. This is observed in a single subject analysis as well as a multiple-subject group-analysis in adults during face perception. We also show that although these patterns remain topographically similar for the general category of face perception task, the sequence of their occurrence and their temporal stability varies markedly between different face perception scenarios (stimuli) indicating toward different dynamical characteristics for information processing, which is stimulus-specific in nature. Subsequently, we translated these stable states into brain complex networks and derived informative network measures for characterizing the degree of segregated processing and information integration in those synchrostates, leading to a new methodology for characterizing information processing in human brain. The proposed methodology of modeling the functional brain connectivity through the synchrostates may be viewed as a new way of quantitative characterization of the cognitive ability of the subject, stimuli and information integration/segregation capability.

Temporal lobe epilepsy surgery: what do patients want to know?

PubMed

Choi, Hyunmi; Pargeon, Kim; Bausell, Rebecca; Wong, John B; Mendiratta, Anil; Bakken, Suzanne

2011-11-01

Patients with pharmacoresistant temporal lobe epilepsy (TLE) contemplating brain surgery must make a complex treatment decision involving trade-offs. Patient decision aids, containing information on the risks and benefits of treatment interventions, increase patient knowledge and facilitate shared decision making between patients and physicians. We conducted five focus groups to describe the information patients need to make informed decisions about TLE surgery. Twenty patients who had undergone TLE surgery described the information used in their decision-making process, and evaluated the potential for a patient decision aid to assist other patients who are considering surgery. Thematic analysis revealed information needs that were both experiential (i.e., learning about other patients' experiences through testimonials) and factual (i.e., individualized statistical information). Patients also made suggestions on how this information should be delivered to patients. These data will accelerate the development of a patient decision aid designed to assist TLE patients in their decision making about epilepsy surgery. Copyright © 2011 Elsevier Inc. All rights reserved.

Linking temporal medical records using non-protected health information data.

PubMed

Bonomi, Luca; Jiang, Xiaoqian

2017-01-01

Modern medical research relies on multi-institutional collaborations which enhance the knowledge discovery and data reuse. While these collaborations allow researchers to perform analytics otherwise impossible on individual datasets, they often pose significant challenges in the data integration process. Due to the lack of a unique identifier, data integration solutions often have to rely on patient's protected health information (PHI). In many situations, such information cannot leave the institutions or must be strictly protected. Furthermore, the presence of noisy values for these attributes may result in poor overall utility. While much research has been done to address these challenges, most of the current solutions are designed for a static setting without considering the temporal information of the data (e.g. EHR). In this work, we propose a novel approach that uses non-PHI for linking patient longitudinal data. Specifically, our technique captures the diagnosis dependencies using patterns which are shown to provide important indications for linking patient records. Our solution can be used as a standalone technique to perform temporal record linkage using non-protected health information data or it can be combined with Privacy Preserving Record Linkage solutions (PPRL) when protected health information is available. In this case, our approach can solve ambiguities in results. Experimental evaluations on real datasets demonstrate the effectiveness of our technique.

Preserving information in neural transmission.

PubMed

Sincich, Lawrence C; Horton, Jonathan C; Sharpee, Tatyana O

2009-05-13

Along most neural pathways, the spike trains transmitted from one neuron to the next are altered. In the process, neurons can either achieve a more efficient stimulus representation, or extract some biologically important stimulus parameter, or succeed at both. We recorded the inputs from single retinal ganglion cells and the outputs from connected lateral geniculate neurons in the macaque to examine how visual signals are relayed from retina to cortex. We found that geniculate neurons re-encoded multiple temporal stimulus features to yield output spikes that carried more information about stimuli than was available in each input spike. The coding transformation of some relay neurons occurred with no decrement in information rate, despite output spike rates that averaged half the input spike rates. This preservation of transmitted information was achieved by the short-term summation of inputs that geniculate neurons require to spike. A reduced model of the retinal and geniculate visual responses, based on two stimulus features and their associated nonlinearities, could account for >85% of the total information available in the spike trains and the preserved information transmission. These results apply to neurons operating on a single time-varying input, suggesting that synaptic temporal integration can alter the temporal receptive field properties to create a more efficient representation of visual signals in the thalamus than the retina.

Temporal associations for spatial events: the role of the dentate gyrus.

PubMed

Morris, Andrea M; Curtis, Brian J; Churchwell, John C; Maasberg, David W; Kesner, Raymond P

2013-11-01

Previous research suggests that the dorsal dentate gyrus (DG) hippocampal subregion mediates spatial processing functions. However, a novel role for the DG in temporal processing for spatial information has begun to emerge based on the development of a computational model of neurogenesis. According to this model, adult born granule cells in the DG contribute to a temporal associative integration process for events presented closer in time. Currently, there is a paucity of behavioral evidence to support the temporal integration theory. Therefore, we developed a novel behavioral paradigm to investigate the role of the dDG in temporal integration for proximal and distal spatial events. Male Long-Evans rats were randomly assigned to a control group or to receive bilateral intracranial infusions of colchicine into the dDG. Following recovery from surgery, each rat was tested on a cued-recall of sequence paradigm. In this task, animals were allowed to explore identical objects placed in designated spatial locations on a cheeseboard maze across 2 days (e.g., Day 1: A and B; Day 2: C and D). One week later, animals were given a brief cue (A or C) followed by a preference test between spatial location B and D. Control animals had a significant preference for the spatial location previously paired with the cue (the temporal associate) whereas dDG lesioned animals failed to show a preference. These findings suggest that selective colchicine-induced dDG lesions are capable of disrupting the formation of temporal associations between spatial events presented close in time. Copyright © 2013 Elsevier B.V. All rights reserved.

Roles of ON Cone Bipolar Cell Subtypes in Temporal Coding in the Mouse Retina

PubMed Central

Fyk-Kolodziej, Bozena; Cohn, Jesse

2014-01-01

In the visual system, diverse image processing starts with bipolar cells, which are the second-order neurons of the retina. Thirteen subtypes of bipolar cells have been identified, which are thought to encode different features of image signaling and to initiate distinct signal-processing streams. Although morphologically identified, the functional roles of each bipolar cell subtype in visual signal encoding are not fully understood. Here, we investigated how ON cone bipolar cells of the mouse retina encode diverse temporal image signaling. We recorded bipolar cell voltage changes in response to two different input functions: sinusoidal light and step light stimuli. Temporal tuning in ON cone bipolar cells was diverse and occurred in a subtype-dependent manner. Subtypes 5s and 8 exhibited low-pass filtering property in response to a sinusoidal light stimulus, and responded with sustained fashion to step-light stimulation. Conversely, subtypes 5f, 6, 7, and XBC exhibited bandpass filtering property in response to sinusoidal light stimuli, and responded transiently to step-light stimuli. In particular, subtypes 7 and XBC were high-temporal tuning cells. We recorded responses in different ways to further examine the underlying mechanisms of temporal tuning. Current injection evoked low-pass filtering, whereas light responses in voltage-clamp mode produced bandpass filtering in all ON bipolar cells. These findings suggest that cone photoreceptor inputs shape bandpass filtering in bipolar cells, whereas intrinsic properties of bipolar cells shape low-pass filtering. Together, our results demonstrate that ON bipolar cells encode diverse temporal image signaling in a subtype-dependent manner to initiate temporal visual information-processing pathways. PMID:24966376

Simultaneous chromatic and luminance human electroretinogram responses.

PubMed

Parry, Neil R A; Murray, Ian J; Panorgias, Athanasios; McKeefry, Declan J; Lee, Barry B; Kremers, Jan

2012-07-01

The parallel processing of information forms an important organisational principle of the primate visual system. Here we describe experiments which use a novel chromatic–achromatic temporal compound stimulus to simultaneously identify colour and luminance specific signals in the human electroretinogram (ERG). Luminance and chromatic components are separated in the stimulus; the luminance modulation has twice the temporal frequency of the chromatic modulation. ERGs were recorded from four trichromatic and two dichromatic subjects (1 deuteranope and 1 protanope). At isoluminance, the fundamental (first harmonic) response was elicited by the chromatic component in the stimulus. The trichromatic ERGs possessed low-pass temporal tuning characteristics, reflecting the activity of parvocellular post-receptoral mechanisms. There was very little first harmonic response in the dichromats' ERGs. The second harmonic response was elicited by the luminance modulation in the compound stimulus and showed, in all subjects, band-pass temporal tuning characteristic of magnocellular activity. Thus it is possible to concurrently elicit ERG responses from the human retina which reflect processing in both chromatic and luminance pathways. As well as providing a clear demonstration of the parallel nature of chromatic and luminance processing in the human retina, the differences that exist between ERGs from trichromatic and dichromatic subjects point to the existence of interactions between afferent post-receptoral pathways that are in operation from the earliest stages of visual processing.

Multiscale analysis of information dynamics for linear multivariate processes.

PubMed

Faes, Luca; Montalto, Alessandro; Stramaglia, Sebastiano; Nollo, Giandomenico; Marinazzo, Daniele

2016-08-01

In the study of complex physical and physiological systems represented by multivariate time series, an issue of great interest is the description of the system dynamics over a range of different temporal scales. While information-theoretic approaches to the multiscale analysis of complex dynamics are being increasingly used, the theoretical properties of the applied measures are poorly understood. This study introduces for the first time a framework for the analytical computation of information dynamics for linear multivariate stochastic processes explored at different time scales. After showing that the multiscale processing of a vector autoregressive (VAR) process introduces a moving average (MA) component, we describe how to represent the resulting VARMA process using statespace (SS) models and how to exploit the SS model parameters to compute analytical measures of information storage and information transfer for the original and rescaled processes. The framework is then used to quantify multiscale information dynamics for simulated unidirectionally and bidirectionally coupled VAR processes, showing that rescaling may lead to insightful patterns of information storage and transfer but also to potentially misleading behaviors.

Temporal patterns of mental model convergence: implications for distributed teams interacting in electronic collaboration spaces.

PubMed

McComb, Sara; Kennedy, Deanna; Perryman, Rebecca; Warner, Norman; Letsky, Michael

2010-04-01

Our objective is to capture temporal patterns in mental model convergence processes and differences in these patterns between distributed teams using an electronic collaboration space and face-to-face teams with no interface. Distributed teams, as sociotechnical systems, collaborate via technology to work on their task. The way in which they process information to inform their mental models may be examined via team communication and may unfold differently than it does in face-to-face teams. We conducted our analysis on 32 three-member teams working on a planning task. Half of the teams worked as distributed teams in an electronic collaboration space, and the other half worked face-to-face without an interface. Using event history analysis, we found temporal interdependencies among the initial convergence points of the multiple mental models we examined. Furthermore, the timing of mental model convergence and the onset of task work discussions were related to team performance. Differences existed in the temporal patterns of convergence and task work discussions across conditions. Distributed teams interacting via an electronic interface and face-to-face teams with no interface converged on multiple mental models, but their communication patterns differed. In particular, distributed teams with an electronic interface required less overall communication, converged on all mental models later in their life cycles, and exhibited more linear cognitive processes than did face-to-face teams interacting verbally. Managers need unique strategies for facilitating communication and mental model convergence depending on teams' degrees of collocation and access to an interface, which in turn will enhance team performance.

Evaluation of spatio-temporal Bayesian models for the spread of infectious diseases in oil palm.

PubMed

Denis, Marie; Cochard, Benoît; Syahputra, Indra; de Franqueville, Hubert; Tisné, Sébastien

2018-02-01

In the field of epidemiology, studies are often focused on mapping diseases in relation to time and space. Hierarchical modeling is a common flexible and effective tool for modeling problems related to disease spread. In the context of oil palm plantations infected by the fungal pathogen Ganoderma boninense, we propose and compare two spatio-temporal hierarchical Bayesian models addressing the lack of information on propagation modes and transmission vectors. We investigate two alternative process models to study the unobserved mechanism driving the infection process. The models help gain insight into the spatio-temporal dynamic of the infection by identifying a genetic component in the disease spread and by highlighting a spatial component acting at the end of the experiment. In this challenging context, we propose models that provide assumptions on the unobserved mechanism driving the infection process while making short-term predictions using ready-to-use software. Copyright © 2018 Elsevier Ltd. All rights reserved.

Needs Assessment for the Use of NASA Remote Sensing Data in the Development and Implementation of Estuarine and Coastal Water Quality Standards

NASA Technical Reports Server (NTRS)

Spiering, Bruce; Underwood, Lauren; Ellis, Chris; Lehrter, John; Hagy, Jim; Schaeffer, Blake

2010-01-01

The goals of the project are to provide information from satellite remote sensing to support numeric nutrient criteria development and to determine data processing methods and data quality requirements to support nutrient criteria development and implementation. The approach is to identify water quality indicators that are used by decision makers to assess water quality and that are related to optical properties of the water; to develop remotely sensed data products based on algorithms relating remote sensing imagery to field-based observations of indicator values; to develop methods to assess estuarine water quality, including trends, spatial and temporal variability, and seasonality; and to develop tools to assist in the development and implementation of estuarine and coastal nutrient criteria. Additional slides present process, criteria development, typical data sources and analyses for criteria process, the power of remote sensing data for the process, examples from Pensacola Bay, spatial and temporal variability, pixel matchups, remote sensing validation, remote sensing in coastal waters, requirements for remotely sensed data products, and needs assessment. An additional presentation examines group engagement and information collection. Topics include needs assessment purpose and objectives, understanding water quality decision making, determining information requirements, and next steps.

Dynamic state estimation based on Poisson spike trains—towards a theory of optimal encoding

NASA Astrophysics Data System (ADS)

Susemihl, Alex; Meir, Ron; Opper, Manfred

2013-03-01

Neurons in the nervous system convey information to higher brain regions by the generation of spike trains. An important question in the field of computational neuroscience is how these sensory neurons encode environmental information in a way which may be simply analyzed by subsequent systems. Many aspects of the form and function of the nervous system have been understood using the concepts of optimal population coding. Most studies, however, have neglected the aspect of temporal coding. Here we address this shortcoming through a filtering theory of inhomogeneous Poisson processes. We derive exact relations for the minimal mean squared error of the optimal Bayesian filter and, by optimizing the encoder, obtain optimal codes for populations of neurons. We also show that a class of non-Markovian, smooth stimuli are amenable to the same treatment, and provide results for the filtering and prediction error which hold for a general class of stochastic processes. This sets a sound mathematical framework for a population coding theory that takes temporal aspects into account. It also formalizes a number of studies which discussed temporal aspects of coding using time-window paradigms, by stating them in terms of correlation times and firing rates. We propose that this kind of analysis allows for a systematic study of temporal coding and will bring further insights into the nature of the neural code.

What can neuromorphic event-driven precise timing add to spike-based pattern recognition?

PubMed

Akolkar, Himanshu; Meyer, Cedric; Clady, Zavier; Marre, Olivier; Bartolozzi, Chiara; Panzeri, Stefano; Benosman, Ryad

2015-03-01

This letter introduces a study to precisely measure what an increase in spike timing precision can add to spike-driven pattern recognition algorithms. The concept of generating spikes from images by converting gray levels into spike timings is currently at the basis of almost every spike-based modeling of biological visual systems. The use of images naturally leads to generating incorrect artificial and redundant spike timings and, more important, also contradicts biological findings indicating that visual processing is massively parallel, asynchronous with high temporal resolution. A new concept for acquiring visual information through pixel-individual asynchronous level-crossing sampling has been proposed in a recent generation of asynchronous neuromorphic visual sensors. Unlike conventional cameras, these sensors acquire data not at fixed points in time for the entire array but at fixed amplitude changes of their input, resulting optimally sparse in space and time-pixel individually and precisely timed only if new, (previously unknown) information is available (event based). This letter uses the high temporal resolution spiking output of neuromorphic event-based visual sensors to show that lowering time precision degrades performance on several recognition tasks specifically when reaching the conventional range of machine vision acquisition frequencies (30-60 Hz). The use of information theory to characterize separability between classes for each temporal resolution shows that high temporal acquisition provides up to 70% more information that conventional spikes generated from frame-based acquisition as used in standard artificial vision, thus drastically increasing the separability between classes of objects. Experiments on real data show that the amount of information loss is correlated with temporal precision. Our information-theoretic study highlights the potentials of neuromorphic asynchronous visual sensors for both practical applications and theoretical investigations. Moreover, it suggests that representing visual information as a precise sequence of spike times as reported in the retina offers considerable advantages for neuro-inspired visual computations.

Bayesian spatio-temporal modeling of particulate matter concentrations in Peninsular Malaysia

NASA Astrophysics Data System (ADS)

Manga, Edna; Awang, Norhashidah

2016-06-01

This article presents an application of a Bayesian spatio-temporal Gaussian process (GP) model on particulate matter concentrations from Peninsular Malaysia. We analyze daily PM10 concentration levels from 35 monitoring sites in June and July 2011. The spatiotemporal model set in a Bayesian hierarchical framework allows for inclusion of informative covariates, meteorological variables and spatiotemporal interactions. Posterior density estimates of the model parameters are obtained by Markov chain Monte Carlo methods. Preliminary data analysis indicate information on PM10 levels at sites classified as industrial locations could explain part of the space time variations. We include the site-type indicator in our modeling efforts. Results of the parameter estimates for the fitted GP model show significant spatio-temporal structure and positive effect of the location-type explanatory variable. We also compute some validation criteria for the out of sample sites that show the adequacy of the model for predicting PM10 at unmonitored sites.

Abstract Linguistic Structure Correlates with Temporal Activity during Naturalistic Comprehension

PubMed Central

Brennan, Jonathan R.; Stabler, Edward P.; Van Wagenen, Sarah E.; Luh, Wen-Ming; Hale, John T.

2016-01-01

Neurolinguistic accounts of sentence comprehension identify a network of relevant brain regions, but do not detail the information flowing through them. We investigate syntactic information. Does brain activity implicate a computation over hierarchical grammars or does it simply reflect linear order, as in a Markov chain? To address this question, we quantify the cognitive states implied by alternative parsing models. We compare processing-complexity predictions from these states against fMRI timecourses from regions that have been implicated in sentence comprehension. We find that hierarchical grammars independently predict timecourses from left anterior and posterior temporal lobe. Markov models are predictive in these regions and across a broader network that includes the inferior frontal gyrus. These results suggest that while linear effects are wide-spread across the language network, certain areas in the left temporal lobe deal with abstract, hierarchical syntactic representations. PMID:27208858

Quantum-enabled temporal and spectral mode conversion of microwave signals

PubMed Central

Andrews, R. W.; Reed, A. P.; Cicak, K.; Teufel, J. D.; Lehnert, K. W.

2015-01-01

Electromagnetic waves are ideal candidates for transmitting information in a quantum network as they can be routed rapidly and efficiently between locations using optical fibres or microwave cables. Yet linking quantum-enabled devices with cables has proved difficult because most cavity or circuit quantum electrodynamics systems used in quantum information processing can only absorb and emit signals with a specific frequency and temporal envelope. Here we show that the temporal and spectral content of microwave-frequency electromagnetic signals can be arbitrarily manipulated with a flexible aluminium drumhead embedded in a microwave circuit. The aluminium drumhead simultaneously forms a mechanical oscillator and a tunable capacitor. This device offers a way to build quantum microwave networks using separate and otherwise mismatched components. Furthermore, it will enable the preparation of non-classical states of motion by capturing non-classical microwave signals prepared by the most coherent circuit quantum electrodynamics systems. PMID:26617386

Face-elicited ERPs and affective attitude: brain electric microstate and tomography analyses.

PubMed

Pizzagalli, D; Lehmann, D; Koenig, T; Regard, M; Pascual-Marqui, R D

2000-03-01

Although behavioral studies have demonstrated that normative affective traits modulate the processing of facial and emotionally charged stimuli, direct electrophysiological evidence for this modulation is still lacking. Event-related potential (ERP) data associated with personal, traitlike approach- or withdrawal-related attitude (assessed post-recording and 14 months later) were investigated in 18 subjects during task-free (i.e. unrequested, spontaneous) emotional evaluation of faces. Temporal and spatial aspects of 27 channel ERP were analyzed with microstate analysis and low resolution electromagnetic tomography (LORETA), a new method to compute 3 dimensional cortical current density implemented in the Talairach brain atlas. Microstate analysis showed group differences 132-196 and 196-272 ms poststimulus, with right-shifted electric gravity centers for subjects with negative affective attitude. During these (over subjects reliably identifiable) personality-modulated, face-elicited microstates, LORETA revealed activation of bilateral occipito-temporal regions, reportedly associated with facial configuration extraction processes. Negative compared to positive affective attitude showed higher activity right temporal; positive compared to negative attitude showed higher activity left temporo-parieto-occipital. These temporal and spatial aspects suggest that the subject groups differed in brain activity at early, automatic, stimulus-related face processing steps when structural face encoding (configuration extraction) occurs. In sum, the brain functional microstates associated with affect-related personality features modulate brain mechanisms during face processing already at early information processing stages.

Motor expertise modulates the unconscious processing of human body postures.

PubMed

Güldenpenning, Iris; Koester, Dirk; Kunde, Wilfried; Weigelt, Matthias; Schack, Thomas

2011-09-01

Little is known about the cognitive background of unconscious visuomotor control of complex sports movements. Therefore, we investigated the extent to which novices and skilled high-jump athletes are able to identify visually presented body postures of the high jump unconsciously. We also asked whether or not the manner of processing differs (qualitatively or quantitatively) between these groups as a function of their motor expertise. A priming experiment with not consciously perceivable stimuli was designed to determine whether subliminal priming of movement phases (same vs. different movement phases) or temporal order (i.e. natural vs. reversed movement order) affects target processing. Participants had to decide which phase of the high jump (approach vs. flight phase) a target photograph was taken from. We found a main effect of temporal order for skilled athletes, that is, faster reaction times for prime-target pairs that reflected the natural movement order as opposed to the reversed movement order. This result indicates that temporal-order information pertaining to the domain of expertise plays a critical role in athletes' perceptual capacities. For novices, data analyses revealed an interaction between temporal order and movement phases. That is, only the reversed movement order of flight-approach pictures increased processing time. Taken together, the results suggest that the structure of cognitive movement representation modulates unconscious processing of movement pictures and points to a functional role of motor representations in visual perception.

Age Differences in Recall and Information Processing in Verbal and Spatial Learning.

ERIC Educational Resources Information Center

Mungas, Dan; And Others

1991-01-01

Three age groups of 24 people each completed verbal word list tasks and spatial learning tasks 5 times each. Significant age differences were found for total recall and type of task. Younger subjects showed increased levels of clustering--organizing information according to semantic or spatial clusters. Age was not related to temporal order of…

Endogenous BDNF Is Required for Long-Term Memory Formation in the Rat Parietal Cortex

ERIC Educational Resources Information Center

Alonso, Mariana; Bekinschtein, Pedro, Cammarota, Martin; Vianna, Monica R. M.; Izquierdo, Ivan; Medina, Jorge H.

2005-01-01

Information storage in the brain is a temporally graded process involving different memory phases as well as different structures in the mammalian brain. Cortical plasticity seems to be essential to store stable long-term memories, although little information is available at the moment regarding molecular and cellular events supporting memory…

SEAC4RS Data and Information Page

Atmospheric Science Data Center

2015-07-01

... deep convection throughout the troposphere; to determine the evolution of gases and aerosols in deep convective outflow and the implications ... influence of biomass burning and pollution, their temporal evolution, and ultimately, impacts on meteorological processes which can, in ...

Period Concatenation Underlies Interactions between Gamma and Beta Rhythms in Neocortex

PubMed Central

Roopun, Anita K.; Kramer, Mark A.; Carracedo, Lucy M.; Kaiser, Marcus; Davies, Ceri H.; Traub, Roger D.; Kopell, Nancy J.; Whittington, Miles A.

2008-01-01

The neocortex generates rhythmic electrical activity over a frequency range covering many decades. Specific cognitive and motor states are associated with oscillations in discrete frequency bands within this range, but it is not known whether interactions and transitions between distinct frequencies are of functional importance. When coexpressed rhythms have frequencies that differ by a factor of two or more interactions can be seen in terms of phase synchronization. Larger frequency differences can result in interactions in the form of nesting of faster frequencies within slower ones by a process of amplitude modulation. It is not known how coexpressed rhythms, whose frequencies differ by less than a factor of two may interact. Here we show that two frequencies (gamma – 40 Hz and beta2 – 25 Hz), coexpressed in superficial and deep cortical laminae with low temporal interaction, can combine to generate a third frequency (beta1 – 15 Hz) showing strong temporal interaction. The process occurs via period concatenation, with basic rhythm-generating microcircuits underlying gamma and beta2 rhythms forming the building blocks of the beta1 rhythm by a process of addition. The mean ratio of adjacent frequency components was a constant – approximately the golden mean – which served to both minimize temporal interactions, and permit multiple transitions, between frequencies. The resulting temporal landscape may provide a framework for multiplexing – parallel information processing on multiple temporal scales. PMID:18946516

Comparing ICD9-encoded diagnoses and NLP-processed discharge summaries for clinical trials pre-screening: a case study.

PubMed

Li, Li; Chase, Herbert S; Patel, Chintan O; Friedman, Carol; Weng, Chunhua

2008-11-06

The prevalence of electronic medical record (EMR) systems has made mass-screening for clinical trials viable through secondary uses of clinical data, which often exist in both structured and free text formats. The tradeoffs of using information in either data format for clinical trials screening are understudied. This paper compares the results of clinical trial eligibility queries over ICD9-encoded diagnoses and NLP-processed textual discharge summaries. The strengths and weaknesses of both data sources are summarized along the following dimensions: information completeness, expressiveness, code granularity, and accuracy of temporal information. We conclude that NLP-processed patient reports supplement important information for eligibility screening and should be used in combination with structured data.

Possible Quantum Absorber Effects in Cortical Synchronization

NASA Astrophysics Data System (ADS)

Kämpf, Uwe

The Wheeler-Feynman transactional "absorber" approach was proposed originally to account for anomalous resonance coupling between spatio-temporally distant measurement partners in entangled quantum states of so-called Einstein-Podolsky-Rosen paradoxes, e.g. of spatio-temporal non-locality, quantum teleportation, etc. Applied to quantum brain dynamics, however, this view provides an anticipative resonance coupling model for aspects of cortical synchronization and recurrent visual action control. It is proposed to consider the registered activation patterns of neuronal loops in so-called synfire chains not as a result of retarded brain communication processes, but rather as surface effects of a system of standing waves generated in the depth of visual processing. According to this view, they arise from a counterbalance between the actual input's delayed bottom-up data streams and top-down recurrent information-processing of advanced anticipative signals in a Wheeler-Feynman-type absorber mode. In the framework of a "time-loop" model, findings about mirror neurons in the brain cortex are suggested to be at least partially associated with temporal rather than spatial mirror functions of visual processing, similar to phase conjugate adaptive resonance-coupling in nonlinear optics.

Functional organization of the face-sensitive areas in human occipital-temporal cortex.

PubMed

Shao, Hanyu; Weng, Xuchu; He, Sheng

2017-08-15

Human occipital-temporal cortex features several areas sensitive to faces, presumably forming the biological substrate for face perception. To date, there are piecemeal insights regarding the functional organization of these regions. They have come, however, from studies that are far from homogeneous with regard to the regions involved, the experimental design, and the data analysis approach. In order to provide an overall view of the functional organization of the face-sensitive areas, it is necessary to conduct a comprehensive study that taps into the pivotal functional properties of all the face-sensitive areas, within the context of the same experimental design, and uses multiple data analysis approaches. In this study, we identified the most robustly activated face-sensitive areas in bilateral occipital-temporal cortices (i.e., AFP, aFFA, pFFA, OFA, pcSTS, pSTS) and systemically compared their regionally averaged activation and multivoxel activation patterns to 96 images from 16 object categories, including faces and non-faces. This condition-rich and single-image analysis approach critically samples the functional properties of a brain region, allowing us to test how two basic functional properties, namely face-category selectivity and face-exemplar sensitivity are distributed among these regions. Moreover, by examining the correlational structure of neural responses to the 96 images, we characterize their interactions in the greater face-processing network. We found that (1) r-pFFA showed the highest face-category selectivity, followed by l-pFFA, bilateral aFFA and OFA, and then bilateral pcSTS. In contrast, bilateral AFP and pSTS showed low face-category selectivity; (2) l-aFFA, l-pcSTS and bilateral AFP showed evidence of face-exemplar sensitivity; (3) r-OFA showed high overall response similarities with bilateral LOC and r-pFFA, suggesting it might be a transitional stage between general and face-selective information processing; (4) r-aFFA showed high face-selective response similarity with r-pFFA and r-OFA, indicating it was specifically involved in processing face information. Results also reveal two properties of these face sensitive regions across the two hemispheres: (1) the averaged left intra-hemispheric response similarity for the images was lower than the averaged right intra-hemispheric and the inter-hemispheric response similarity, implying convergence of face processing towards the right hemisphere, and (2) the response similarities between homologous regions in the two hemispheres decreased as information processing proceeded from the early, more posterior, processing stage (OFA), indicating an increasing degree of hemispheric specialization and right hemisphere bias for face information processing. This study contributes to an emerging picture of how faces are processed within the occipital and temporal cortex. Copyright © 2017 Elsevier Inc. All rights reserved.

HIS Design: Big Data that Supports Hydrologic Modeling from Continental to Hillslope Scales

NASA Astrophysics Data System (ADS)

Rasmussen, T. C.; Deemy, J. B.; Younger, S. E.; Kirk, S. E.; Brockman, L. E.

2016-12-01

Analogous to Google Maps, hydrologic data, information, and knowledge resolve differently depending upon the spatial and temporal scales of interest. We show how a multi-scale hydrologic information system (HIS) can be designed and populated for a broad range of spatial (e.g., hillslope, local, regional, continental) and temporal (e.g., current, recent, historic, geologic) scales. Surface and subsurface hydrologic and transport processes are assumed to be scale-dependent, requiring unique governing equations and parameters at each scale. This robust and flexible framework is designed to meet the inventory, monitoring, and management needs of multiple federal agencies (i.e., Forest Service, National Park Service, Fish and Wildlife Service, National Wildlife Reserves). Multi-scale HIS examples are provided using Geographic Information Systems (GIS) for the Southeastern US.

'Right Now, Sophie (∗)Swims in the Pool?!': Brain Potentials of Grammatical Aspect Processing.

PubMed

Flecken, Monique; Walbert, Kelly; Dijkstra, Ton

2015-01-01

We investigated whether brain potentials of grammatical aspect processing resemble semantic or morpho-syntactic processing, or whether they instead are characterized by an entirely distinct pattern in the same individuals. We studied aspect from the perspective of agreement between the temporal information in the context (temporal adverbials, e.g., Right now) and a morpho-syntactic marker of grammatical aspect (e.g., progressive is swimming). Participants read questions providing a temporal context that was progressive (What is Sophie doing in the pool right now?) or habitual (What does Sophie do in the pool every Monday?). Following a lead-in sentence context such as Right now, Sophie…, we measured event-related brain potentials (ERPs) time-locked to verb phrases in four different conditions, e.g., (a) is swimming (control); (b) (∗)is cooking (semantic violation); (c) (∗)are swimming (morpho-syntactic violation); or (d)?swims (aspect mismatch); …in the pool." The collected ERPs show typical N400 and P600 effects for semantics and morpho-syntax, while aspect processing elicited an Early Negativity (250-350 ms). The aspect-related Negativity was short-lived and had a central scalp distribution with an anterior onset. This differentiates it not only from the semantic N400 effect, but also from the typical LAN (Left Anterior Negativity), that is frequently reported for various types of agreement processing. Moreover, aspect processing did not show a clear P600 modulation. We argue that the specific context for each item in this experiment provided a trigger for agreement checking with temporal information encoded on the verb, i.e., morphological aspect marking. The aspect-related Negativity obtained for aspect agreement mismatches reflects a violated expectation concerning verbal inflection (in the example above, the expected verb phrase was Sophie is X-ing rather than Sophie X-s in condition d). The absence of an additional P600 for aspect processing suggests that the mismatch did not require additional reintegration or processing costs. This is consistent with participants' post hoc grammaticality judgements of the same sentences, which overall show a high acceptability of aspect mismatch sentences.

The right hemisphere's contribution to discourse processing: A study in temporal lobe epilepsy.

PubMed

Lomlomdjian, Carolina; Múnera, Claudia P; Low, Daniel M; Terpiluk, Verónica; Solís, Patricia; Abusamra, Valeria; Kochen, Silvia

2017-08-01

Discourse skills - in which the right hemisphere has an important role - enables verbal communication by selecting contextually relevant information and integrating it coherently to infer the correct meaning. However, language research in epilepsy has focused on single word analysis related mainly to left hemisphere processing. The purpose of this study was to investigate discourse abilities in patients with right lateralized medial temporal lobe epilepsy (RTLE) by comparing their performance to that of patients with left temporal lobe epilepsy (LTLE). 74 pharmacoresistant temporal lobe epilepsy (TLE) patients were evaluated: 34 with RTLE and 40 with LTLE. Subjects underwent a battery of tests that measure comprehension and production of conversational and narrative discourse. Disease related variables and general neuropsychological data were evaluated. The RTLE group presented deficits in interictal conversational and narrative discourse, with a disintegrated speech, lack of categorization and misinterpretation of social meaning. LTLE group, on the other hand, showed a tendency to lower performance in logical-temporal sequencing. RTLE patients showed discourse deficits which have been described in right hemisphere damaged patients due to other etiologies. Medial and anterior temporal lobe structures appear to link semantic, world knowledge, and social cognition associated areas to construct a contextually related coherent meaning. Copyright © 2017 Elsevier Inc. All rights reserved.

Tropical land use land cover mapping in Pará (Brazil) using discriminative Markov random fields and multi-temporal TerraSAR-X data

NASA Astrophysics Data System (ADS)

Hagensieker, Ron; Roscher, Ribana; Rosentreter, Johannes; Jakimow, Benjamin; Waske, Björn

2017-12-01

Remote sensing satellite data offer the unique possibility to map land use land cover transformations by providing spatially explicit information. However, detection of short-term processes and land use patterns of high spatial-temporal variability is a challenging task. We present a novel framework using multi-temporal TerraSAR-X data and machine learning techniques, namely discriminative Markov random fields with spatio-temporal priors, and import vector machines, in order to advance the mapping of land cover characterized by short-term changes. Our study region covers a current deforestation frontier in the Brazilian state Pará with land cover dominated by primary forests, different types of pasture land and secondary vegetation, and land use dominated by short-term processes such as slash-and-burn activities. The data set comprises multi-temporal TerraSAR-X imagery acquired over the course of the 2014 dry season, as well as optical data (RapidEye, Landsat) for reference. Results show that land use land cover is reliably mapped, resulting in spatially adjusted overall accuracies of up to 79% in a five class setting, yet limitations for the differentiation of different pasture types remain. The proposed method is applicable on multi-temporal data sets, and constitutes a feasible approach to map land use land cover in regions that are affected by high-frequent temporal changes.

Effects of medial prefrontal cortex lesions in rats on the what-where-when memory of a fear conditioning event.

PubMed

Li, Jay-Shake; Hsiao, Kun-Yuan; Chen, Wei-Min

2011-03-17

Previous animal studies have defined the ability to remember the details of what, where, and when of an event as an episodic-like memory to be used to model episodic memory in humans. Numerous findings indicate that the hippocampal-frontal cortical circuitry plays a major part in its neural mechanism. Researchers have intensively studied roles of diverse hippocampus sub-regions using animal models. By contrast, the impact of prefrontal cortex lesions on episodic-like memory in animals is still unknown. Here we show that Wistar rats with bilateral medial prefrontal cortex lesions failed to use the temporal-contextual information to retrieve memory of a fear-conditioning event, indicating impairments in their episodic-like memory. Subsequent experiments excluded alternative interpretations that the manipulation impaired the fear-conditioning per se, or interfered with the sensory preconditioning process. We concluded that damages in this area might impair temporal information processing, or interfere with integrating temporal and contextual elements of fear-conditioning events to form a conjunctive entity. These findings can help understand how the medial prefrontal cortex contributes to episodic-like memory. Copyright © 2010 Elsevier B.V. All rights reserved.

Intracranial Cortical Responses during Visual–Tactile Integration in Humans

PubMed Central

Quinn, Brian T.; Carlson, Chad; Doyle, Werner; Cash, Sydney S.; Devinsky, Orrin; Spence, Charles; Halgren, Eric

2014-01-01

Sensory integration of touch and sight is crucial to perceiving and navigating the environment. While recent evidence from other sensory modality combinations suggests that low-level sensory areas integrate multisensory information at early processing stages, little is known about how the brain combines visual and tactile information. We investigated the dynamics of multisensory integration between vision and touch using the high spatial and temporal resolution of intracranial electrocorticography in humans. We present a novel, two-step metric for defining multisensory integration. The first step compares the sum of the unisensory responses to the bimodal response as multisensory responses. The second step eliminates the possibility that double addition of sensory responses could be misinterpreted as interactions. Using these criteria, averaged local field potentials and high-gamma-band power demonstrate a functional processing cascade whereby sensory integration occurs late, both anatomically and temporally, in the temporo–parieto–occipital junction (TPOJ) and dorsolateral prefrontal cortex. Results further suggest two neurophysiologically distinct and temporally separated integration mechanisms in TPOJ, while providing direct evidence for local suppression as a dominant mechanism for synthesizing visual and tactile input. These results tend to support earlier concepts of multisensory integration as relatively late and centered in tertiary multimodal association cortices. PMID:24381279

[The role of temporal fine structure in tone recognition and music perception].

PubMed

Zhou, Q; Gu, X; Liu, B

2017-11-07

The sound signal can be decomposed into temporal envelope and temporal fine structure information. The temporal envelope information is crucial for speech perception in quiet environment, and the temporal fine structure information plays an important role in speech perception in noise, Mandarin tone recognition and music perception, especially the pitch and melody perception.

Eye’m talking to you: speakers’ gaze direction modulates co-speech gesture processing in the right MTG

PubMed Central

Toni, Ivan; Hagoort, Peter; Kelly, Spencer D.; Özyürek, Aslı

2015-01-01

Recipients process information from speech and co-speech gestures, but it is currently unknown how this processing is influenced by the presence of other important social cues, especially gaze direction, a marker of communicative intent. Such cues may modulate neural activity in regions associated either with the processing of ostensive cues, such as eye gaze, or with the processing of semantic information, provided by speech and gesture. Participants were scanned (fMRI) while taking part in triadic communication involving two recipients and a speaker. The speaker uttered sentences that were and were not accompanied by complementary iconic gestures. Crucially, the speaker alternated her gaze direction, thus creating two recipient roles: addressed (direct gaze) vs unaddressed (averted gaze) recipient. The comprehension of Speech&Gesture relative to SpeechOnly utterances recruited middle occipital, middle temporal and inferior frontal gyri, bilaterally. The calcarine sulcus and posterior cingulate cortex were sensitive to differences between direct and averted gaze. Most importantly, Speech&Gesture utterances, but not SpeechOnly utterances, produced additional activity in the right middle temporal gyrus when participants were addressed. Marking communicative intent with gaze direction modulates the processing of speech–gesture utterances in cerebral areas typically associated with the semantic processing of multi-modal communicative acts. PMID:24652857

The Temporal Pole Top-Down Modulates the Ventral Visual Stream During Social Cognition.

PubMed

Pehrs, Corinna; Zaki, Jamil; Schlochtermeier, Lorna H; Jacobs, Arthur M; Kuchinke, Lars; Koelsch, Stefan

2017-01-01

The temporal pole (TP) has been associated with diverse functions of social cognition and emotion processing. Although the underlying mechanism remains elusive, one possibility is that TP acts as domain-general hub integrating socioemotional information. To test this, 26 participants were presented with 60 empathy-evoking film clips during fMRI scanning. The film clips were preceded by a linguistic sad or neutral context and half of the clips were accompanied by sad music. In line with its hypothesized role, TP was involved in the processing of sad context and furthermore tracked participants' empathic concern. To examine the neuromodulatory impact of TP, we applied nonlinear dynamic causal modeling to a multisensory integration network from previous work consisting of superior temporal gyrus (STG), fusiform gyrus (FG), and amygdala, which was extended by an additional node in the TP. Bayesian model comparison revealed a gating of STG and TP on fusiform-amygdalar coupling and an increase of TP to FG connectivity during the integration of contextual information. Moreover, these backward projections were strengthened by emotional music. The findings indicate that during social cognition, TP integrates information from different modalities and top-down modulates lower-level perceptual areas in the ventral visual stream as a function of integration demands. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Temporal consistent depth map upscaling for 3DTV

NASA Astrophysics Data System (ADS)

Schwarz, Sebastian; Sjöström, Mârten; Olsson, Roger

2014-03-01

The ongoing success of three-dimensional (3D) cinema fuels increasing efforts to spread the commercial success of 3D to new markets. The possibilities of a convincing 3D experience at home, such as three-dimensional television (3DTV), has generated a great deal of interest within the research and standardization community. A central issue for 3DTV is the creation and representation of 3D content. Acquiring scene depth information is a fundamental task in computer vision, yet complex and error-prone. Dedicated range sensors, such as the Time­ of-Flight camera (ToF), can simplify the scene depth capture process and overcome shortcomings of traditional solutions, such as active or passive stereo analysis. Admittedly, currently available ToF sensors deliver only a limited spatial resolution. However, sophisticated depth upscaling approaches use texture information to match depth and video resolution. At Electronic Imaging 2012 we proposed an upscaling routine based on error energy minimization, weighted with edge information from an accompanying video source. In this article we develop our algorithm further. By adding temporal consistency constraints to the upscaling process, we reduce disturbing depth jumps and flickering artifacts in the final 3DTV content. Temporal consistency in depth maps enhances the 3D experience, leading to a wider acceptance of 3D media content. More content in better quality can boost the commercial success of 3DTV.

Environmental monitoring and assessment of landscape dynamics in southern coast of the Caspian Sea through intensity analysis and imprecise land-use data.

PubMed

Hasani, Mohammad; Sakieh, Yousef; Dezhkam, Sadeq; Ardakani, Tahereh; Salmanmahiny, Abdolrassoul

2017-04-01

A hierarchical intensity analysis of land-use change is applied to evaluate the dynamics of a coupled urban coastal system in Rasht County, Iran. Temporal land-use layers of 1987, 1999, and 2011 are employed, while spatial accuracy metrics are only available for 2011 data (overall accuracy of 94%). The errors in 1987 and 1999 layers are unknown, which can influence the accuracy of temporal change information. Such data were employed to examine the size and the type of errors that could justify deviations from uniform change intensities. Accordingly, errors comprising 3.31 and 7.47% of 1999 and 2011 maps, respectively, could explain all differences from uniform gains and errors including 5.21 and 1.81% of 1987 and 1999 maps, respectively, could explain all deviations from uniform losses. Additional historical information is also applied for uncertainty assessment and to separate probable map errors from actual land-use changes. In this regard, historical processes in Rasht County can explain different types of transition that are either consistent or inconsistent to known processes. The intensity analysis assisted in identification of systematic transitions and detection of competitive categories, which cannot be investigated through conventional change detection methods. Based on results, built-up area is the most active gaining category in the area and wetland category with less areal extent is more sensitive to intense land-use change processes. Uncertainty assessment results also indicated that there are no considerable classification errors in temporal land-use data and these imprecise layers can reliably provide implications for informed decision making.

Functional brain microstate predicts the outcome in a visuospatial working memory task.

PubMed

Muthukrishnan, Suriya-Prakash; Ahuja, Navdeep; Mehta, Nalin; Sharma, Ratna

2016-11-01

Humans have limited capacity of processing just up to 4 integrated items of information in the working memory. Thus, it is inevitable to commit more errors when challenged with high memory loads. However, the neural mechanisms that determine the accuracy of response at high memory loads still remain unclear. High temporal resolution of Electroencephalography (EEG) technique makes it the best tool to resolve the temporal dynamics of brain networks. EEG-defined microstate is the quasi-stable scalp electrical potential topography that represents the momentary functional state of brain. Thus, it has been possible to assess the information processing currently performed by the brain using EEG microstate analysis. We hypothesize that the EEG microstate preceding the trial could determine its outcome in a visuospatial working memory (VSWM) task. Twenty-four healthy participants performed a high memory load VSWM task, while their brain activity was recorded using EEG. Four microstate maps were found to represent the functional brain state prior to the trials in the VSWM task. One pre-trial microstate map was found to determine the accuracy of subsequent behavioural response. The intracranial generators of the pre-trial microstate map that determined the response accuracy were localized to the visuospatial processing areas at bilateral occipital, right temporal and limbic cortices. Our results imply that the behavioural outcome in a VSWM task could be determined by the intensity of activation of memory representations in the visuospatial processing brain regions prior to the trial. Copyright © 2016 Elsevier B.V. All rights reserved.

Ordered short-term memory differs in signers and speakers: Implications for models of short-term memory

PubMed Central

Bavelier, Daphne; Newport, Elissa L.; Hall, Matt; Supalla, Ted; Boutla, Mrim

2008-01-01

Capacity limits in linguistic short-term memory (STM) are typically measured with forward span tasks in which participants are asked to recall lists of words in the order presented. Using such tasks, native signers of American Sign Language (ASL) exhibit smaller spans than native speakers (Boutla, Supalla, Newport, & Bavelier, 2004). Here, we test the hypothesis that this population difference reflects differences in the way speakers and signers maintain temporal order information in short-term memory. We show that native signers differ from speakers on measures of short-term memory that require maintenance of temporal order of the tested materials, but not on those in which temporal order is not required. In addition, we show that, in a recall task with free order, bilingual subjects are more likely to recall in temporal order when using English than ASL. We conclude that speakers and signers do share common short-term memory processes. However, whereas short-term memory for spoken English is predominantly organized in terms of temporal order, we argue that this dimension does not play as great a role in signers’ short-term memory. Other factors that may affect STM processes in signers are discussed. PMID:18083155

[Brain Mechanisms for Measuring Time: Population Coding of Durations].

PubMed

Hayashi, Masamichi J

2016-11-01

Temporal processing is crucial in many aspects of our perception and action. While there is mounting evidence for the encoding mechanisms of spatial ("where") and identity ("what") information, those of temporal information ("when") remain largely unknown. Recent studies suggested that, similarly to the basic visual stimulus features such as orientation, motion direction, and numerical quantity, event durations are also represented by a population of neurons that are tuned for specific, preferred durations. This paper first reviews recent psychophysical studies on duration aftereffect. Changes in the three parameters (response gain, shift, and width of tuning curves) are then discussed that may need to be taken into account in the putative duration-channel model. Next, the potential neural basis of the duration channels is examined by overviewing recent neuroimaging and electrophysiological studies on time perception. Finally, this paper proposes a general neural basis of timing that commonly represents time-differences independent of stimulus types (e.g., a single duration v.s. multiple brief events). This extends the idea of the "when pathway" from the perception of temporal order to the general timing mechanisms for the perception of duration, temporal frequency, and synchrony.

Supervised Learning Based on Temporal Coding in Spiking Neural Networks.

PubMed

Mostafa, Hesham

2017-08-01

Gradient descent training techniques are remarkably successful in training analog-valued artificial neural networks (ANNs). Such training techniques, however, do not transfer easily to spiking networks due to the spike generation hard nonlinearity and the discrete nature of spike communication. We show that in a feedforward spiking network that uses a temporal coding scheme where information is encoded in spike times instead of spike rates, the network input-output relation is differentiable almost everywhere. Moreover, this relation is piecewise linear after a transformation of variables. Methods for training ANNs thus carry directly to the training of such spiking networks as we show when training on the permutation invariant MNIST task. In contrast to rate-based spiking networks that are often used to approximate the behavior of ANNs, the networks we present spike much more sparsely and their behavior cannot be directly approximated by conventional ANNs. Our results highlight a new approach for controlling the behavior of spiking networks with realistic temporal dynamics, opening up the potential for using these networks to process spike patterns with complex temporal information.

Prediction and constraint in audiovisual speech perception.

PubMed

Peelle, Jonathan E; Sommers, Mitchell S

2015-07-01

During face-to-face conversational speech listeners must efficiently process a rapid and complex stream of multisensory information. Visual speech can serve as a critical complement to auditory information because it provides cues to both the timing of the incoming acoustic signal (the amplitude envelope, influencing attention and perceptual sensitivity) and its content (place and manner of articulation, constraining lexical selection). Here we review behavioral and neurophysiological evidence regarding listeners' use of visual speech information. Multisensory integration of audiovisual speech cues improves recognition accuracy, particularly for speech in noise. Even when speech is intelligible based solely on auditory information, adding visual information may reduce the cognitive demands placed on listeners through increasing the precision of prediction. Electrophysiological studies demonstrate that oscillatory cortical entrainment to speech in auditory cortex is enhanced when visual speech is present, increasing sensitivity to important acoustic cues. Neuroimaging studies also suggest increased activity in auditory cortex when congruent visual information is available, but additionally emphasize the involvement of heteromodal regions of posterior superior temporal sulcus as playing a role in integrative processing. We interpret these findings in a framework of temporally-focused lexical competition in which visual speech information affects auditory processing to increase sensitivity to acoustic information through an early integration mechanism, and a late integration stage that incorporates specific information about a speaker's articulators to constrain the number of possible candidates in a spoken utterance. Ultimately it is words compatible with both auditory and visual information that most strongly determine successful speech perception during everyday listening. Thus, audiovisual speech perception is accomplished through multiple stages of integration, supported by distinct neuroanatomical mechanisms. Copyright © 2015 Elsevier Ltd. All rights reserved.

Temporal abstraction-based clinical phenotyping with Eureka!

PubMed

Post, Andrew R; Kurc, Tahsin; Willard, Richie; Rathod, Himanshu; Mansour, Michel; Pai, Akshatha Kalsanka; Torian, William M; Agravat, Sanjay; Sturm, Suzanne; Saltz, Joel H

2013-01-01

Temporal abstraction, a method for specifying and detecting temporal patterns in clinical databases, is very expressive and performs well, but it is difficult for clinical investigators and data analysts to understand. Such patterns are critical in phenotyping patients using their medical records in research and quality improvement. We have previously developed the Analytic Information Warehouse (AIW), which computes such phenotypes using temporal abstraction but requires software engineers to use. We have extended the AIW's web user interface, Eureka! Clinical Analytics, to support specifying phenotypes using an alternative model that we developed with clinical stakeholders. The software converts phenotypes from this model to that of temporal abstraction prior to data processing. The model can represent all phenotypes in a quality improvement project and a growing set of phenotypes in a multi-site research study. Phenotyping that is accessible to investigators and IT personnel may enable its broader adoption.

Temporal Context in Speech Processing and Attentional Stream Selection: A Behavioral and Neural Perspective

ERIC Educational Resources Information Center

Golumbic, Elana M. Zion; Poeppel, David; Schroeder, Charles E.

2012-01-01

The human capacity for processing speech is remarkable, especially given that information in speech unfolds over multiple time scales concurrently. Similarly notable is our ability to filter out of extraneous sounds and focus our attention on one conversation, epitomized by the "Cocktail Party" effect. Yet, the neural mechanisms underlying on-line…

Advanced Natural Language Processing and Temporal Mining for Clinical Discovery

ERIC Educational Resources Information Center

Mehrabi, Saeed

2016-01-01

There has been vast and growing amount of healthcare data especially with the rapid adoption of electronic health records (EHRs) as a result of the HITECH act of 2009. It is estimated that around 80% of the clinical information resides in the unstructured narrative of an EHR. Recently, natural language processing (NLP) techniques have offered…

The role of remote sensing in process‐scaling studies of managed forest ecosystems

Treesearch

Jeffrey G. Masek; Daniel J. Hayes; M. Joseph Hughes; Sean P. Healey; David P. Turner

2015-01-01

Sustaining forest resources requires a better understanding of forest ecosystem processes, and how management decisions and climate change may affect these processes in the future. While plot and inventory data provide our most detailed information on forest carbon, energy, and water cycling, applying this understanding to broader spatial and temporal domains...

The Perception of Dynamic and Static Facial Expressions of Happiness and Disgust Investigated by ERPs and fMRI Constrained Source Analysis

PubMed Central

Trautmann-Lengsfeld, Sina Alexa; Domínguez-Borràs, Judith; Escera, Carles; Herrmann, Manfred; Fehr, Thorsten

2013-01-01

A recent functional magnetic resonance imaging (fMRI) study by our group demonstrated that dynamic emotional faces are more accurately recognized and evoked more widespread patterns of hemodynamic brain responses than static emotional faces. Based on this experimental design, the present study aimed at investigating the spatio-temporal processing of static and dynamic emotional facial expressions in 19 healthy women by means of multi-channel electroencephalography (EEG), event-related potentials (ERP) and fMRI-constrained regional source analyses. ERP analysis showed an increased amplitude of the LPP (late posterior positivity) over centro-parietal regions for static facial expressions of disgust compared to neutral faces. In addition, the LPP was more widespread and temporally prolonged for dynamic compared to static faces of disgust and happiness. fMRI constrained source analysis on static emotional face stimuli indicated the spatio-temporal modulation of predominantly posterior regional brain activation related to the visual processing stream for both emotional valences when compared to the neutral condition in the fusiform gyrus. The spatio-temporal processing of dynamic stimuli yielded enhanced source activity for emotional compared to neutral conditions in temporal (e.g., fusiform gyrus), and frontal regions (e.g., ventromedial prefrontal cortex, medial and inferior frontal cortex) in early and again in later time windows. The present data support the view that dynamic facial displays trigger more information reflected in complex neural networks, in particular because of their changing features potentially triggering sustained activation related to a continuing evaluation of those faces. A combined fMRI and EEG approach thus provides an advanced insight to the spatio-temporal characteristics of emotional face processing, by also revealing additional neural generators, not identifiable by the only use of an fMRI approach. PMID:23818974

Separating stages of arithmetic verification: An ERP study with a novel paradigm.

PubMed

Avancini, Chiara; Soltész, Fruzsina; Szűcs, Dénes

2015-08-01

In studies of arithmetic verification, participants typically encounter two operands and they carry out an operation on these (e.g. adding them). Operands are followed by a proposed answer and participants decide whether this answer is correct or incorrect. However, interpretation of results is difficult because multiple parallel, temporally overlapping numerical and non-numerical processes of the human brain may contribute to task execution. In order to overcome this problem here we used a novel paradigm specifically designed to tease apart the overlapping cognitive processes active during arithmetic verification. Specifically, we aimed to separate effects related to detection of arithmetic correctness, detection of the violation of strategic expectations, detection of physical stimulus properties mismatch and numerical magnitude comparison (numerical distance effects). Arithmetic correctness, physical stimulus properties and magnitude information were not task-relevant properties of the stimuli. We distinguished between a series of temporally highly overlapping cognitive processes which in turn elicited overlapping ERP effects with distinct scalp topographies. We suggest that arithmetic verification relies on two major temporal phases which include parallel running processes. Our paradigm offers a new method for investigating specific arithmetic verification processes in detail. Copyright © 2015 Elsevier Ltd. All rights reserved.

Model-based vision for space applications

NASA Technical Reports Server (NTRS)

Chaconas, Karen; Nashman, Marilyn; Lumia, Ronald

1992-01-01

This paper describes a method for tracking moving image features by combining spatial and temporal edge information with model based feature information. The algorithm updates the two-dimensional position of object features by correlating predicted model features with current image data. The results of the correlation process are used to compute an updated model. The algorithm makes use of a high temporal sampling rate with respect to spatial changes of the image features and operates in a real-time multiprocessing environment. Preliminary results demonstrate successful tracking for image feature velocities between 1.1 and 4.5 pixels every image frame. This work has applications for docking, assembly, retrieval of floating objects and a host of other space-related tasks.

Saliency affects feedforward more than feedback processing in early visual cortex.

PubMed

Emmanouil, Tatiana Aloi; Avigan, Philip; Persuh, Marjan; Ro, Tony

2013-07-01

Early visual cortex activity is influenced by both bottom-up and top-down factors. To investigate the influences of bottom-up (saliency) and top-down (task) factors on different stages of visual processing, we used transcranial magnetic stimulation (TMS) of areas V1/V2 to induce visual suppression at varying temporal intervals. Subjects were asked to detect and discriminate the color or the orientation of briefly-presented small lines that varied on color saliency based on color contrast with the surround. Regardless of task, color saliency modulated the magnitude of TMS-induced visual suppression, especially at earlier temporal processing intervals that reflect the feedforward stage of visual processing in V1/V2. In a second experiment we found that our color saliency effects were also influenced by an inherent advantage of the color red relative to other hues and that color discrimination difficulty did not affect visual suppression. These results support the notion that early visual processing is stimulus driven and that feedforward and feedback processing encode different types of information about visual scenes. They further suggest that certain hues can be prioritized over others within our visual systems by being more robustly represented during early temporal processing intervals. Copyright © 2013 Elsevier Ltd. All rights reserved.

Tracking individual action potentials throughout mammalian axonal arbors.

PubMed

Radivojevic, Milos; Franke, Felix; Altermatt, Michael; Müller, Jan; Hierlemann, Andreas; Bakkum, Douglas J

2017-10-09

Axons are neuronal processes specialized for conduction of action potentials (APs). The timing and temporal precision of APs when they reach each of the synapses are fundamentally important for information processing in the brain. Due to small diameters of axons, direct recording of single AP transmission is challenging. Consequently, most knowledge about axonal conductance derives from modeling studies or indirect measurements. We demonstrate a method to noninvasively and directly record individual APs propagating along millimeter-length axonal arbors in cortical cultures with hundreds of microelectrodes at microsecond temporal resolution. We find that cortical axons conduct single APs with high temporal precision (~100 µs arrival time jitter per mm length) and reliability: in more than 8,000,000 recorded APs, we did not observe any conduction or branch-point failures. Upon high-frequency stimulation at 100 Hz, successive became slower, and their arrival time precision decreased by 20% and 12% for the 100th AP, respectively.

Transition Characteristic Analysis of Traffic Evolution Process for Urban Traffic Network

PubMed Central

Chen, Hong; Li, Yang

2014-01-01

The characterization of the dynamics of traffic states remains fundamental to seeking for the solutions of diverse traffic problems. To gain more insights into traffic dynamics in the temporal domain, this paper explored temporal characteristics and distinct regularity in the traffic evolution process of urban traffic network. We defined traffic state pattern through clustering multidimensional traffic time series using self-organizing maps and construct a pattern transition network model that is appropriate for representing and analyzing the evolution progress. The methodology is illustrated by an application to data flow rate of multiple road sections from Network of Shenzhen's Nanshan District, China. Analysis and numerical results demonstrated that the methodology permits extracting many useful traffic transition characteristics including stability, preference, activity, and attractiveness. In addition, more information about the relationships between these characteristics was extracted, which should be helpful in understanding the complex behavior of the temporal evolution features of traffic patterns. PMID:24982969

Updating Landsat time series of surface-reflectance composites and forest change products with new observations

NASA Astrophysics Data System (ADS)

Hermosilla, Txomin; Wulder, Michael A.; White, Joanne C.; Coops, Nicholas C.; Hobart, Geordie W.

2017-12-01

The use of time series satellite data allows for the temporally dense, systematic, transparent, and synoptic capture of land dynamics over time. Subsequent to the opening of the Landsat archive, several time series approaches for characterizing landscape change have been developed, often representing a particular analytical time window. The information richness and widespread utility of these time series data have created a need to maintain the currency of time series information via the addition of new data, as it becomes available. When an existing time series is temporally extended, it is critical that previously generated change information remains consistent, thereby not altering reported change statistics or science outcomes based on that change information. In this research, we investigate the impacts and implications of adding additional years to an existing 29-year annual Landsat time series for forest change. To do so, we undertook a spatially explicit comparison of the 29 overlapping years of a time series representing 1984-2012, with a time series representing 1984-2016. Surface reflectance values, and presence, year, and type of change were compared. We found that the addition of years to extend the time series had minimal effect on the annual surface reflectance composites, with slight band-specific differences (r ≥ 0.1) in the final years of the original time series being updated. The area of stand replacing disturbances and determination of change year are virtually unchanged for the overlapping period between the two time-series products. Over the overlapping temporal period (1984-2012), the total area of change differs by 0.53%, equating to an annual difference in change area of 0.019%. Overall, the spatial and temporal agreement of the changes detected by both time series was 96%. Further, our findings suggest that the entire pre-existing historic time series does not need to be re-processed during the update process. Critically, given the time series change detection and update approach followed here, science outcomes or reports representing one temporal epoch can be considered stable and will not be altered when a time series is updated with newly available data.

What Is Spatio-Temporal Data Warehousing?

NASA Astrophysics Data System (ADS)

Vaisman, Alejandro; Zimányi, Esteban

In the last years, extending OLAP (On-Line Analytical Processing) systems with spatial and temporal features has attracted the attention of the GIS (Geographic Information Systems) and database communities. However, there is no a commonly agreed definition of what is a spatio-temporal data warehouse and what functionality such a data warehouse should support. Further, the solutions proposed in the literature vary considerably in the kind of data that can be represented as well as the kind of queries that can be expressed. In this paper we present a conceptual framework for defining spatio-temporal data warehouses using an extensible data type system. We also define a taxonomy of different classes of queries of increasing expressive power, and show how to express such queries using an extension of the tuple relational calculus with aggregated functions.

Conceptual Coordination Bridges Information Processing and Neurophysiology

NASA Technical Reports Server (NTRS)

Clancey, William J.; Norrig, Peter (Technical Monitor)

2000-01-01

Information processing theories of memory and skills can be reformulated in terms of how categories are physically and temporally related, a process called conceptual coordination. Dreaming can then be understood as a story understanding process in which two mechanisms found in everyday comprehension are missing: conceiving sequences (chunking categories in time as a categorization) and coordinating across modalities (e.g., relating the sound of a word and the image of its meaning). On this basis, we can readily identify isomorphisms between dream phenomenology and neurophysiology, and explain the function of dreaming as facilitating future coordination of sequential, cross-modal categorization (i.e., REM sleep lowers activation thresholds, "unlearning").

Process-based upscaling of surface-atmosphere exchange

NASA Astrophysics Data System (ADS)

Keenan, T. F.; Prentice, I. C.; Canadell, J.; Williams, C. A.; Wang, H.; Raupach, M. R.; Collatz, G. J.; Davis, T.; Stocker, B.; Evans, B. J.

2015-12-01

Empirical upscaling techniques such as machine learning and data-mining have proven invaluable tools for the global scaling of disparate observations of surface-atmosphere exchange, but are not based on a theoretical understanding of the key processes involved. This makes spatial and temporal extrapolation outside of the training domain difficult at best. There is therefore a clear need for the incorporation of knowledge of ecosystem function, in combination with the strength of data mining. Here, we present such an approach. We describe a novel diagnostic process-based model of global photosynthesis and ecosystem respiration, which is directly informed by a variety of global datasets relevant to ecosystem state and function. We use the model framework to estimate global carbon cycling both spatially and temporally, with a specific focus on the mechanisms responsible for long-term change. Our results show the importance of incorporating process knowledge into upscaling approaches, and highlight the effect of key processes on the terrestrial carbon cycle.

Flood extent and water level estimation from SAR using data-model integration

NASA Astrophysics Data System (ADS)

Ajadi, O. A.; Meyer, F. J.

2017-12-01

Synthetic Aperture Radar (SAR) images have long been recognized as a valuable data source for flood mapping. Compared to other sources, SAR's weather and illumination independence and large area coverage at high spatial resolution supports reliable, frequent, and detailed observations of developing flood events. Accordingly, SAR has the potential to greatly aid in the near real-time monitoring of natural hazards, such as flood detection, if combined with automated image processing. This research works towards increasing the reliability and temporal sampling of SAR-derived flood hazard information by integrating information from multiple SAR sensors and SAR modalities (images and Interferometric SAR (InSAR) coherence) and by combining SAR-derived change detection information with hydrologic and hydraulic flood forecast models. First, the combination of multi-temporal SAR intensity images and coherence information for generating flood extent maps is introduced. The application of least-squares estimation integrates flood information from multiple SAR sensors, thus increasing the temporal sampling. SAR-based flood extent information will be combined with a Digital Elevation Model (DEM) to reduce false alarms and to estimate water depth and flood volume. The SAR-based flood extent map is assimilated into the Hydrologic Engineering Center River Analysis System (Hec-RAS) model to aid in hydraulic model calibration. The developed technology is improving the accuracy of flood information by exploiting information from data and models. It also provides enhanced flood information to decision-makers supporting the response to flood extent and improving emergency relief efforts.

Computational Constraints in Cognitive Theories of Forgetting

PubMed Central

Ecker, Ullrich K. H.; Lewandowsky, Stephan

2012-01-01

This article highlights some of the benefits of computational modeling for theorizing in cognition. We demonstrate how computational models have been used recently to argue that (1) forgetting in short-term memory is based on interference not decay, (2) forgetting in list-learning paradigms is more parsimoniously explained by a temporal distinctiveness account than by various forms of consolidation, and (3) intrusion asymmetries that appear when information is learned in different contexts can be explained by temporal context reinstatement rather than labilization and reconsolidation processes. PMID:23091467

Computational constraints in cognitive theories of forgetting.

PubMed

Ecker, Ullrich K H; Lewandowsky, Stephan

2012-01-01

This article highlights some of the benefits of computational modeling for theorizing in cognition. We demonstrate how computational models have been used recently to argue that (1) forgetting in short-term memory is based on interference not decay, (2) forgetting in list-learning paradigms is more parsimoniously explained by a temporal distinctiveness account than by various forms of consolidation, and (3) intrusion asymmetries that appear when information is learned in different contexts can be explained by temporal context reinstatement rather than labilization and reconsolidation processes.

Somatosensory Temporal Discrimination Threshold Involves Inhibitory Mechanisms in the Primary Somatosensory Area.

PubMed

Rocchi, Lorenzo; Casula, Elias; Tocco, Pierluigi; Berardelli, Alfredo; Rothwell, John

2016-01-13

Somatosensory temporal discrimination threshold (STDT) is defined as the shortest time interval necessary for a pair of tactile stimuli to be perceived as separate. Although STDT is altered in several neurological disorders, its neural bases are not entirely clear. We used continuous theta burst stimulation (cTBS) to condition the excitability of the primary somatosensory cortex in healthy humans to examine its possible contribution to STDT. Excitability was assessed using the recovery cycle of the N20 component of somatosensory evoked potentials (SEP) and the area of high-frequency oscillations (HFO). cTBS increased STDT and reduced inhibition in the N20 recovery cycle at an interstimulus interval of 5 ms. It also reduced the amplitude of late HFO. All three effects were correlated. There was no effect of cTBS over the secondary somatosensory cortex on STDT, although it reduced the N120 component of the SEP. STDT is assessed conventionally with a simple ascending method. To increase insight into the effect of cTBS, we measured temporal discrimination with a psychophysical method. cTBS reduced the slope of the discrimination curve, consistent with a reduction of the quality of sensory information caused by an increase in noise. We hypothesize that cTBS reduces the effectiveness of inhibitory interactions normally used to sharpen temporal processing of sensory inputs. This reduction in discriminability of sensory input is equivalent to adding neural noise to the signal. Precise timing of sensory information is crucial for nearly every aspect of human perception and behavior. One way to assess the ability to analyze temporal information in the somatosensory domain is to measure the somatosensory temporal discrimination threshold (STDT), defined as the shortest time interval necessary for a pair of tactile stimuli to be perceived as separate. In this study, we found that STDT depends on inhibitory mechanisms within the primary somatosensory area (S1). This finding helps interpret the sensory processing deficits in neurological diseases, such as focal dystonia and Parkinson's disease, and possibly prompts future studies using neurostimulation techniques over S1 for therapeutic purposes in dystonic patients. Copyright © 2016 the authors 0270-6474/16/360325-11$15.00/0.

Information properties of morphologically complex words modulate brain activity during word reading

PubMed Central

Hultén, Annika; Lehtonen, Minna; Lagus, Krista; Salmelin, Riitta

2018-01-01

Abstract Neuroimaging studies of the reading process point to functionally distinct stages in word recognition. Yet, current understanding of the operations linked to those various stages is mainly descriptive in nature. Approaches developed in the field of computational linguistics may offer a more quantitative approach for understanding brain dynamics. Our aim was to evaluate whether a statistical model of morphology, with well‐defined computational principles, can capture the neural dynamics of reading, using the concept of surprisal from information theory as the common measure. The Morfessor model, created for unsupervised discovery of morphemes, is based on the minimum description length principle and attempts to find optimal units of representation for complex words. In a word recognition task, we correlated brain responses to word surprisal values derived from Morfessor and from other psycholinguistic variables that have been linked with various levels of linguistic abstraction. The magnetoencephalography data analysis focused on spatially, temporally and functionally distinct components of cortical activation observed in reading tasks. The early occipital and occipito‐temporal responses were correlated with parameters relating to visual complexity and orthographic properties, whereas the later bilateral superior temporal activation was correlated with whole‐word based and morphological models. The results show that the word processing costs estimated by the statistical Morfessor model are relevant for brain dynamics of reading during late processing stages. PMID:29524274

The medial temporal lobe-conduit of parallel connectivity: a model for attention, memory, and perception.

PubMed

Mozaffari, Brian

2014-01-01

Based on the notion that the brain is equipped with a hierarchical organization, which embodies environmental contingencies across many time scales, this paper suggests that the medial temporal lobe (MTL)-located deep in the hierarchy-serves as a bridge connecting supra- to infra-MTL levels. Bridging the upper and lower regions of the hierarchy provides a parallel architecture that optimizes information flow between upper and lower regions to aid attention, encoding, and processing of quick complex visual phenomenon. Bypassing intermediate hierarchy levels, information conveyed through the MTL "bridge" allows upper levels to make educated predictions about the prevailing context and accordingly select lower representations to increase the efficiency of predictive coding throughout the hierarchy. This selection or activation/deactivation is associated with endogenous attention. In the event that these "bridge" predictions are inaccurate, this architecture enables the rapid encoding of novel contingencies. A review of hierarchical models in relation to memory is provided along with a new theory, Medial-temporal-lobe Conduit for Parallel Connectivity (MCPC). In this scheme, consolidation is considered as a secondary process, occurring after a MTL-bridged connection, which eventually allows upper and lower levels to access each other directly. With repeated reactivations, as contingencies become consolidated, less MTL activity is predicted. Finally, MTL bridging may aid processing transient but structured perceptual events, by allowing communication between upper and lower levels without calling on intermediate levels of representation.

Information properties of morphologically complex words modulate brain activity during word reading.

PubMed

Hakala, Tero; Hultén, Annika; Lehtonen, Minna; Lagus, Krista; Salmelin, Riitta

2018-06-01

Neuroimaging studies of the reading process point to functionally distinct stages in word recognition. Yet, current understanding of the operations linked to those various stages is mainly descriptive in nature. Approaches developed in the field of computational linguistics may offer a more quantitative approach for understanding brain dynamics. Our aim was to evaluate whether a statistical model of morphology, with well-defined computational principles, can capture the neural dynamics of reading, using the concept of surprisal from information theory as the common measure. The Morfessor model, created for unsupervised discovery of morphemes, is based on the minimum description length principle and attempts to find optimal units of representation for complex words. In a word recognition task, we correlated brain responses to word surprisal values derived from Morfessor and from other psycholinguistic variables that have been linked with various levels of linguistic abstraction. The magnetoencephalography data analysis focused on spatially, temporally and functionally distinct components of cortical activation observed in reading tasks. The early occipital and occipito-temporal responses were correlated with parameters relating to visual complexity and orthographic properties, whereas the later bilateral superior temporal activation was correlated with whole-word based and morphological models. The results show that the word processing costs estimated by the statistical Morfessor model are relevant for brain dynamics of reading during late processing stages. © 2018 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Decoding semantic information from human electrocorticographic (ECoG) signals.

PubMed

Wang, Wei; Degenhart, Alan D; Sudre, Gustavo P; Pomerleau, Dean A; Tyler-Kabara, Elizabeth C

2011-01-01

This study examined the feasibility of decoding semantic information from human cortical activity. Four human subjects undergoing presurgical brain mapping and seizure foci localization participated in this study. Electrocorticographic (ECoG) signals were recorded while the subjects performed simple language tasks involving semantic information processing, such as a picture naming task where subjects named pictures of objects belonging to different semantic categories. Robust high-gamma band (60-120 Hz) activation was observed at the left inferior frontal gyrus (LIFG) and the posterior portion of the superior temporal gyrus (pSTG) with a temporal sequence corresponding to speech production and perception. Furthermore, Gaussian Naïve Bayes and Support Vector Machine classifiers, two commonly used machine learning algorithms for pattern recognition, were able to predict the semantic category of an object using cortical activity captured by ECoG electrodes covering the frontal, temporal and parietal cortices. These findings have implications for both basic neuroscience research and development of semantic-based brain-computer interface systems (BCI) that can help individuals with severe motor or communication disorders to express their intention and thoughts.

Accurate estimation of camera shot noise in the real-time

NASA Astrophysics Data System (ADS)

Cheremkhin, Pavel A.; Evtikhiev, Nikolay N.; Krasnov, Vitaly V.; Rodin, Vladislav G.; Starikov, Rostislav S.

2017-10-01

Nowadays digital cameras are essential parts of various technological processes and daily tasks. They are widely used in optics and photonics, astronomy, biology and other various fields of science and technology such as control systems and video-surveillance monitoring. One of the main information limitations of photo- and videocameras are noises of photosensor pixels. Camera's photosensor noise can be divided into random and pattern components. Temporal noise includes random noise component while spatial noise includes pattern noise component. Temporal noise can be divided into signal-dependent shot noise and signal-nondependent dark temporal noise. For measurement of camera noise characteristics, the most widely used methods are standards (for example, EMVA Standard 1288). It allows precise shot and dark temporal noise measurement but difficult in implementation and time-consuming. Earlier we proposed method for measurement of temporal noise of photo- and videocameras. It is based on the automatic segmentation of nonuniform targets (ASNT). Only two frames are sufficient for noise measurement with the modified method. In this paper, we registered frames and estimated shot and dark temporal noises of cameras consistently in the real-time. The modified ASNT method is used. Estimation was performed for the cameras: consumer photocamera Canon EOS 400D (CMOS, 10.1 MP, 12 bit ADC), scientific camera MegaPlus II ES11000 (CCD, 10.7 MP, 12 bit ADC), industrial camera PixeLink PL-B781F (CMOS, 6.6 MP, 10 bit ADC) and video-surveillance camera Watec LCL-902C (CCD, 0.47 MP, external 8 bit ADC). Experimental dependencies of temporal noise on signal value are in good agreement with fitted curves based on a Poisson distribution excluding areas near saturation. Time of registering and processing of frames used for temporal noise estimation was measured. Using standard computer, frames were registered and processed during a fraction of second to several seconds only. Also the accuracy of the obtained temporal noise values was estimated.

Visualization of Spatio-Temporal Relations in Movement Event Using Multi-View

NASA Astrophysics Data System (ADS)

Zheng, K.; Gu, D.; Fang, F.; Wang, Y.; Liu, H.; Zhao, W.; Zhang, M.; Li, Q.

2017-09-01

Spatio-temporal relations among movement events extracted from temporally varying trajectory data can provide useful information about the evolution of individual or collective movers, as well as their interactions with their spatial and temporal contexts. However, the pure statistical tools commonly used by analysts pose many difficulties, due to the large number of attributes embedded in multi-scale and multi-semantic trajectory data. The need for models that operate at multiple scales to search for relations at different locations within time and space, as well as intuitively interpret what these relations mean, also presents challenges. Since analysts do not know where or when these relevant spatio-temporal relations might emerge, these models must compute statistical summaries of multiple attributes at different granularities. In this paper, we propose a multi-view approach to visualize the spatio-temporal relations among movement events. We describe a method for visualizing movement events and spatio-temporal relations that uses multiple displays. A visual interface is presented, and the user can interactively select or filter spatial and temporal extents to guide the knowledge discovery process. We also demonstrate how this approach can help analysts to derive and explain the spatio-temporal relations of movement events from taxi trajectory data.

Brain reflections: A circuit-based framework for understanding information processing and cognitive control.

PubMed

Gratton, Gabriele

2018-03-01

Here, I propose a view of the architecture of the human information processing system, and of how it can be adapted to changing task demands (which is the hallmark of cognitive control). This view is informed by an interpretation of brain activity as reflecting the excitability level of neural representations, encoding not only stimuli and temporal contexts, but also action plans and task goals. The proposed cognitive architecture includes three types of circuits: open circuits, involved in feed-forward processing such as that connecting stimuli with responses and characterized by brief, transient brain activity; and two types of closed circuits, positive feedback circuits (characterized by sustained, high-frequency oscillatory activity), which help select and maintain representations, and negative feedback circuits (characterized by brief, low-frequency oscillatory bursts), which are instead associated with changes in representations. Feed-forward activity is primarily responsible for the spread of activation along the information processing system. Oscillatory activity, instead, controls this spread. Sustained oscillatory activity due to both local cortical circuits (gamma) and longer corticothalamic circuits (alpha and beta) allows for the selection of individuated representations. Through the interaction of these circuits, it also allows for the preservation of representations across different temporal spans (sensory and working memory) and their spread across the brain. In contrast, brief bursts of oscillatory activity, generated by novel and/or conflicting information, lead to the interruption of sustained oscillatory activity and promote the generation of new representations. I discuss how this framework can account for a number of psychological and behavioral phenomena. © 2017 Society for Psychophysiological Research.

Proportional spike-timing precision and firing reliability underlie efficient temporal processing of periodicity and envelope shape cues

PubMed Central

Zheng, Y.

2013-01-01

Temporal sound cues are essential for sound recognition, pitch, rhythm, and timbre perception, yet how auditory neurons encode such cues is subject of ongoing debate. Rate coding theories propose that temporal sound features are represented by rate tuned modulation filters. However, overwhelming evidence also suggests that precise spike timing is an essential attribute of the neural code. Here we demonstrate that single neurons in the auditory midbrain employ a proportional code in which spike-timing precision and firing reliability covary with the sound envelope cues to provide an efficient representation of the stimulus. Spike-timing precision varied systematically with the timescale and shape of the sound envelope and yet was largely independent of the sound modulation frequency, a prominent cue for pitch. In contrast, spike-count reliability was strongly affected by the modulation frequency. Spike-timing precision extends from sub-millisecond for brief transient sounds up to tens of milliseconds for sounds with slow-varying envelope. Information theoretic analysis further confirms that spike-timing precision depends strongly on the sound envelope shape, while firing reliability was strongly affected by the sound modulation frequency. Both the information efficiency and total information were limited by the firing reliability and spike-timing precision in a manner that reflected the sound structure. This result supports a temporal coding strategy in the auditory midbrain where proportional changes in spike-timing precision and firing reliability can efficiently signal shape and periodicity temporal cues. PMID:23636724

Neural activity in the medial temporal lobe reveals the fidelity of mental time travel.

PubMed

Kragel, James E; Morton, Neal W; Polyn, Sean M

2015-02-18

Neural circuitry in the medial temporal lobe (MTL) is critically involved in mental time travel, which involves the vivid retrieval of the details of past experience. Neuroscientific theories propose that the MTL supports memory of the past by retrieving previously encoded episodic information, as well as by reactivating a temporal code specifying the position of a particular event within an episode. However, the neural computations supporting these abilities are underspecified. To test hypotheses regarding the computational mechanisms supported by different MTL subregions during mental time travel, we developed a computational model that linked a blood oxygenation level-dependent signal to cognitive operations, allowing us to predict human performance in a memory search task. Activity in the posterior MTL, including parahippocampal cortex, reflected how strongly one reactivates the temporal context of a retrieved memory, allowing the model to predict whether the next memory will correspond to a nearby moment in the study episode. A signal in the anterior MTL, including perirhinal cortex, indicated the successful retrieval of list items, without providing information regarding temporal organization. A hippocampal signal reflected both processes, consistent with theories that this region binds item and context information together to form episodic memories. These findings provide evidence for modern theories that describe complementary roles of the hippocampus and surrounding parahippocampal and perirhinal cortices during the retrieval of episodic memories, shaping how humans revisit the past. Copyright © 2015 the authors 0270-6474/15/352914-13$15.00/0.

Temporal dynamics of encoding, storage and reallocation of visual working memory

PubMed Central

Bays, Paul M; Gorgoraptis, Nikos; Wee, Natalie; Marshall, Louise; Husain, Masud

2012-01-01

The process of encoding a visual scene into working memory has previously been studied using binary measures of recall. Here we examine the temporal evolution of memory resolution, based on observers’ ability to reproduce the orientations of objects presented in brief, masked displays. Recall precision was accurately described by the interaction of two independent constraints: an encoding limit that determines the maximum rate at which information can be transferred into memory, and a separate storage limit that determines the maximum fidelity with which information can be maintained. Recall variability decreased incrementally with time, consistent with a parallel encoding process in which visual information from multiple objects accumulates simultaneously in working memory. No evidence was observed for a limit on the number of items stored. Cueing one display item with a brief flash led to rapid development of a recall advantage for that item. This advantage was short-lived if the cue was simply a salient visual event, but was maintained if it indicated an object of particular relevance to the task. These cueing effects were observed even for items that had already been encoded into memory, indicating that limited memory resources can be rapidly reallocated to prioritize salient or goal-relevant information. PMID:21911739

People-selectivity, audiovisual integration and heteromodality in the superior temporal sulcus.

PubMed

Watson, Rebecca; Latinus, Marianne; Charest, Ian; Crabbe, Frances; Belin, Pascal

2014-01-01

The functional role of the superior temporal sulcus (STS) has been implicated in a number of studies, including those investigating face perception, voice perception, and face-voice integration. However, the nature of the STS preference for these 'social stimuli' remains unclear, as does the location within the STS for specific types of information processing. The aim of this study was to directly examine properties of the STS in terms of selective response to social stimuli. We used functional magnetic resonance imaging (fMRI) to scan participants whilst they were presented with auditory, visual, or audiovisual stimuli of people or objects, with the intention of localising areas preferring both faces and voices (i.e., 'people-selective' regions) and audiovisual regions designed to specifically integrate person-related information. Results highlighted a 'people-selective, heteromodal' region in the trunk of the right STS which was activated by both faces and voices, and a restricted portion of the right posterior STS (pSTS) with an integrative preference for information from people, as compared to objects. These results point towards the dedicated role of the STS as a 'social-information processing' centre. Copyright © 2013 Elsevier Ltd. All rights reserved.

On the use of EEG or MEG brain imaging tools in neuromarketing research.

PubMed

Vecchiato, Giovanni; Astolfi, Laura; De Vico Fallani, Fabrizio; Toppi, Jlenia; Aloise, Fabio; Bez, Francesco; Wei, Daming; Kong, Wanzeng; Dai, Jounging; Cincotti, Febo; Mattia, Donatella; Babiloni, Fabio

2011-01-01

Here we present an overview of some published papers of interest for the marketing research employing electroencephalogram (EEG) and magnetoencephalogram (MEG) methods. The interest for these methodologies relies in their high-temporal resolution as opposed to the investigation of such problem with the functional Magnetic Resonance Imaging (fMRI) methodology, also largely used in the marketing research. In addition, EEG and MEG technologies have greatly improved their spatial resolution in the last decades with the introduction of advanced signal processing methodologies. By presenting data gathered through MEG and high resolution EEG we will show which kind of information it is possible to gather with these methodologies while the persons are watching marketing relevant stimuli. Such information will be related to the memorization and pleasantness related to such stimuli. We noted that temporal and frequency patterns of brain signals are able to provide possible descriptors conveying information about the cognitive and emotional processes in subjects observing commercial advertisements. These information could be unobtainable through common tools used in standard marketing research. We also show an example of how an EEG methodology could be used to analyze cultural differences between fruition of video commercials of carbonated beverages in Western and Eastern countries.

On the Use of EEG or MEG Brain Imaging Tools in Neuromarketing Research

PubMed Central

Vecchiato, Giovanni; Astolfi, Laura; De Vico Fallani, Fabrizio; Toppi, Jlenia; Aloise, Fabio; Bez, Francesco; Wei, Daming; Kong, Wanzeng; Dai, Jounging; Cincotti, Febo; Mattia, Donatella; Babiloni, Fabio

2011-01-01

Here we present an overview of some published papers of interest for the marketing research employing electroencephalogram (EEG) and magnetoencephalogram (MEG) methods. The interest for these methodologies relies in their high-temporal resolution as opposed to the investigation of such problem with the functional Magnetic Resonance Imaging (fMRI) methodology, also largely used in the marketing research. In addition, EEG and MEG technologies have greatly improved their spatial resolution in the last decades with the introduction of advanced signal processing methodologies. By presenting data gathered through MEG and high resolution EEG we will show which kind of information it is possible to gather with these methodologies while the persons are watching marketing relevant stimuli. Such information will be related to the memorization and pleasantness related to such stimuli. We noted that temporal and frequency patterns of brain signals are able to provide possible descriptors conveying information about the cognitive and emotional processes in subjects observing commercial advertisements. These information could be unobtainable through common tools used in standard marketing research. We also show an example of how an EEG methodology could be used to analyze cultural differences between fruition of video commercials of carbonated beverages in Western and Eastern countries. PMID:21960996

Temporal dynamics of encoding, storage, and reallocation of visual working memory.

PubMed

Bays, Paul M; Gorgoraptis, Nikos; Wee, Natalie; Marshall, Louise; Husain, Masud

2011-09-12

The process of encoding a visual scene into working memory has previously been studied using binary measures of recall. Here, we examine the temporal evolution of memory resolution, based on observers' ability to reproduce the orientations of objects presented in brief, masked displays. Recall precision was accurately described by the interaction of two independent constraints: an encoding limit that determines the maximum rate at which information can be transferred into memory and a separate storage limit that determines the maximum fidelity with which information can be maintained. Recall variability decreased incrementally with time, consistent with a parallel encoding process in which visual information from multiple objects accumulates simultaneously in working memory. No evidence was observed for a limit on the number of items stored. Cuing one display item with a brief flash led to rapid development of a recall advantage for that item. This advantage was short-lived if the cue was simply a salient visual event but was maintained if it indicated an object of particular relevance to the task. These cuing effects were observed even for items that had already been encoded into memory, indicating that limited memory resources can be rapidly reallocated to prioritize salient or goal-relevant information.

Ozone Lidar Observations for Air Quality Studies

NASA Technical Reports Server (NTRS)

Wang, Lihua; Newchurch, Mike; Kuang, Shi; Burris, John F.; Huang, Guanyu; Pour-Biazar, Arastoo; Koshak, William; Follette-Cook, Melanie B.; Pickering, Kenneth E.; McGee, Thomas J.;

Information fusion via isocortex-based Area 37 modeling

NASA Astrophysics Data System (ADS)

Peterson, James K.

2004-08-01

A simplified model of information processing in the brain can be constructed using primary sensory input from two modalities (auditory and visual) and recurrent connections to the limbic subsystem. Information fusion would then occur in Area 37 of the temporal cortex. The creation of meta concepts from the low order primary inputs is managed by models of isocortex processing. Isocortex algorithms are used to model parietal (auditory), occipital (visual), temporal (polymodal fusion) cortex and the limbic system. Each of these four modules is constructed out of five cortical stacks in which each stack consists of three vertically oriented six layer isocortex models. The input to output training of each cortical model uses the OCOS (on center - off surround) and FFP (folded feedback pathway) circuitry of (Grossberg, 1) which is inherently a recurrent network type of learning characterized by the identification of perceptual groups. Models of this sort are thus closely related to cognitive models as it is difficult to divorce the sensory processing subsystems from the higher level processing in the associative cortex. The overall software architecture presented is biologically based and is presented as a potential architectural prototype for the development of novel sensory fusion strategies. The algorithms are motivated to some degree by specific data from projects on musical composition and autonomous fine art painting programs, but only in the sense that these projects use two specific types of auditory and visual cortex data. Hence, the architectures are presented for an artificial information processing system which utilizes two disparate sensory sources. The exact nature of the two primary sensory input streams is irrelevant.

CNTRO: A Semantic Web Ontology for Temporal Relation Inferencing in Clinical Narratives.

PubMed

Tao, Cui; Wei, Wei-Qi; Solbrig, Harold R; Savova, Guergana; Chute, Christopher G

2010-11-13

Using Semantic-Web specifications to represent temporal information in clinical narratives is an important step for temporal reasoning and answering time-oriented queries. Existing temporal models are either not compatible with the powerful reasoning tools developed for the Semantic Web, or designed only for structured clinical data and therefore are not ready to be applied on natural-language-based clinical narrative reports directly. We have developed a Semantic-Web ontology which is called Clinical Narrative Temporal Relation ontology. Using this ontology, temporal information in clinical narratives can be represented as RDF (Resource Description Framework) triples. More temporal information and relations can then be inferred by Semantic-Web based reasoning tools. Experimental results show that this ontology can represent temporal information in real clinical narratives successfully.

Information processing and dynamics in minimally cognitive agents.

PubMed

Beer, Randall D; Williams, Paul L

2015-01-01

There has been considerable debate in the literature about the relative merits of information processing versus dynamical approaches to understanding cognitive processes. In this article, we explore the relationship between these two styles of explanation using a model agent evolved to solve a relational categorization task. Specifically, we separately analyze the operation of this agent using the mathematical tools of information theory and dynamical systems theory. Information-theoretic analysis reveals how task-relevant information flows through the system to be combined into a categorization decision. Dynamical analysis reveals the key geometrical and temporal interrelationships underlying the categorization decision. Finally, we propose a framework for directly relating these two different styles of explanation and discuss the possible implications of our analysis for some of the ongoing debates in cognitive science. Copyright © 2014 Cognitive Science Society, Inc.

Temporal distance and person memory: thinking about the future changes memory for the past.

PubMed

Wyer, Natalie A; Perfect, Timothy J; Pahl, Sabine

2010-06-01

Psychological distance has been shown to influence how people construe an event such that greater distance produces high-level construal (characterized by global or holistic processing) and lesser distance produces low-level construal (characterized by detailed or feature-based processing). The present research tested the hypothesis that construal level has carryover effects on how information about an event is retrieved from memory. Two experiments manipulated temporal distance and found that greater distance (high-level construal) improves face recognition and increases retrieval of the abstract features of an event, whereas lesser distance (low-level construal) impairs face recognition and increases retrieval of the concrete details of an event. The findings have implications for transfer-inappropriate processing accounts of face recognition and event memory, and suggest potential applications in forensic settings.

The cortical language circuit: from auditory perception to sentence comprehension.

PubMed

Friederici, Angela D

2012-05-01

Over the years, a large body of work on the brain basis of language comprehension has accumulated, paving the way for the formulation of a comprehensive model. The model proposed here describes the functional neuroanatomy of the different processing steps from auditory perception to comprehension as located in different gray matter brain regions. It also specifies the information flow between these regions, taking into account white matter fiber tract connections. Bottom-up, input-driven processes proceeding from the auditory cortex to the anterior superior temporal cortex and from there to the prefrontal cortex, as well as top-down, controlled and predictive processes from the prefrontal cortex back to the temporal cortex are proposed to constitute the cortical language circuit. Copyright © 2012 Elsevier Ltd. All rights reserved.

Simultaneous chromatic and luminance human electroretinogram responses

PubMed Central

Parry, Neil R A; Murray, Ian J; Panorgias, Athanasios; McKeefry, Declan J; Lee, Barry B; Kremers, Jan

2012-01-01

The parallel processing of information forms an important organisational principle of the primate visual system. Here we describe experiments which use a novel chromatic–achromatic temporal compound stimulus to simultaneously identify colour and luminance specific signals in the human electroretinogram (ERG). Luminance and chromatic components are separated in the stimulus; the luminance modulation has twice the temporal frequency of the chromatic modulation. ERGs were recorded from four trichromatic and two dichromatic subjects (1 deuteranope and 1 protanope). At isoluminance, the fundamental (first harmonic) response was elicited by the chromatic component in the stimulus. The trichromatic ERGs possessed low-pass temporal tuning characteristics, reflecting the activity of parvocellular post-receptoral mechanisms. There was very little first harmonic response in the dichromats’ ERGs. The second harmonic response was elicited by the luminance modulation in the compound stimulus and showed, in all subjects, band-pass temporal tuning characteristic of magnocellular activity. Thus it is possible to concurrently elicit ERG responses from the human retina which reflect processing in both chromatic and luminance pathways. As well as providing a clear demonstration of the parallel nature of chromatic and luminance processing in the human retina, the differences that exist between ERGs from trichromatic and dichromatic subjects point to the existence of interactions between afferent post-receptoral pathways that are in operation from the earliest stages of visual processing. PMID:22586211

Phenological Parameters Estimation Tool

NASA Technical Reports Server (NTRS)

McKellip, Rodney D.; Ross, Kenton W.; Spruce, Joseph P.; Smoot, James C.; Ryan, Robert E.; Gasser, Gerald E.; Prados, Donald L.; Vaughan, Ronald D.

2010-01-01

The Phenological Parameters Estimation Tool (PPET) is a set of algorithms implemented in MATLAB that estimates key vegetative phenological parameters. For a given year, the PPET software package takes in temporally processed vegetation index data (3D spatio-temporal arrays) generated by the time series product tool (TSPT) and outputs spatial grids (2D arrays) of vegetation phenological parameters. As a precursor to PPET, the TSPT uses quality information for each pixel of each date to remove bad or suspect data, and then interpolates and digitally fills data voids in the time series to produce a continuous, smoothed vegetation index product. During processing, the TSPT displays NDVI (Normalized Difference Vegetation Index) time series plots and images from the temporally processed pixels. Both the TSPT and PPET currently use moderate resolution imaging spectroradiometer (MODIS) satellite multispectral data as a default, but each software package is modifiable and could be used with any high-temporal-rate remote sensing data collection system that is capable of producing vegetation indices. Raw MODIS data from the Aqua and Terra satellites is processed using the TSPT to generate a filtered time series data product. The PPET then uses the TSPT output to generate phenological parameters for desired locations. PPET output data tiles are mosaicked into a Conterminous United States (CONUS) data layer using ERDAS IMAGINE, or equivalent software package. Mosaics of the vegetation phenology data products are then reprojected to the desired map projection using ERDAS IMAGINE

Temporal data representation, normalization, extraction, and reasoning: A review from clinical domain

PubMed Central

Madkour, Mohcine; Benhaddou, Driss; Tao, Cui

2016-01-01

Background and Objective We live our lives by the calendar and the clock, but time is also an abstraction, even an illusion. The sense of time can be both domain-specific and complex, and is often left implicit, requiring significant domain knowledge to accurately recognize and harness. In the clinical domain, the momentum gained from recent advances in infrastructure and governance practices has enabled the collection of tremendous amount of data at each moment in time. Electronic Health Records (EHRs) have paved the way to making these data available for practitioners and researchers. However, temporal data representation, normalization, extraction and reasoning are very important in order to mine such massive data and therefore for constructing the clinical timeline. The objective of this work is to provide an overview of the problem of constructing a timeline at the clinical point of care and to summarize the state-of-the-art in processing temporal information of clinical narratives. Methods This review surveys the methods used in three important area: modeling and representing of time, Medical NLP methods for extracting time, and methods of time reasoning and processing. The review emphasis on the current existing gap between present methods and the semantic web technologies and catch up with the possible combinations. Results the main findings of this review is revealing the importance of time processing not only in constructing timelines and clinical decision support systems but also as a vital component of EHR data models and operations. Conclusions Extracting temporal information in clinical narratives is a challenging task. The inclusion of ontologies and semantic web will lead to better assessment of the annotation task and, together with medical NLP techniques, will help resolving granularity and co-reference resolution problems. PMID:27040831

Distinct and overlapping fMRI activation networks for processing of novel identities and locations of objects.

PubMed

Pihlajamäki, Maija; Tanila, Heikki; Könönen, Mervi; Hänninen, Tuomo; Aronen, Hannu J; Soininen, Hilkka

2005-10-01

The ventral visual stream processes information about the identity of objects ('what'), whereas the dorsal stream processes the spatial locations of objects ('where'). There is a corresponding, although disputed, distinction for the ventrolateral and dorsolateral prefrontal areas. Furthermore, there seems to be a distinction between the anterior and posterior medial temporal lobe (MTL) structures in the processing of novel items and new spatial arrangements, respectively. Functional differentiation of the intermediary mid-line cortical and temporal neocortical structures that communicate with the occipitotemporal, occipitoparietal, prefrontal, and MTL structures, however, is unclear. Therefore, in the present functional magnetic resonance imaging (fMRI) study, we examined whether the distinction among the MTL structures extends to these closely connected cortical areas. The most striking difference in the fMRI responses during visual presentation of changes in either items or their locations was the bilateral activation of the temporal lobe and ventrolateral prefrontal cortical areas for novel object identification in contrast to wide parietal and dorsolateral prefrontal activation for the novel locations of objects. An anterior-posterior distinction of fMRI responses similar to the MTL was observed in the cingulate/retrosplenial, and superior and middle temporal cortices. In addition to the distinct areas of activation, certain frontal, parietal, and temporo-occipital areas responded to both object and spatial novelty, suggesting a common attentional network for both types of changes in the visual environment. These findings offer new insights to the functional roles and intrinsic specialization of the cingulate/retrosplenial, and lateral temporal cortical areas in visuospatial cognition.

Spatio-temporal features for tracking and quadruped/biped discrimination

NASA Astrophysics Data System (ADS)

Rickman, Rick; Copsey, Keith; Bamber, David C.; Page, Scott F.

2012-05-01

Techniques such as SIFT and SURF facilitate efficient and robust image processing operations through the use of sparse and compact spatial feature descriptors and show much potential for defence and security applications. This paper considers the extension of such techniques to include information from the temporal domain, to improve utility in applications involving moving imagery within video data. In particular, the paper demonstrates how spatio-temporal descriptors can be used very effectively as the basis of a target tracking system and as target discriminators which can distinguish between bipeds and quadrupeds. Results using sequences of video imagery of walking humans and dogs are presented, and the relative merits of the approach are discussed.

Read My Lips: Brain Dynamics Associated with Audiovisual Integration and Deviance Detection.

PubMed

Tse, Chun-Yu; Gratton, Gabriele; Garnsey, Susan M; Novak, Michael A; Fabiani, Monica

2015-09-01

Information from different modalities is initially processed in different brain areas, yet real-world perception often requires the integration of multisensory signals into a single percept. An example is the McGurk effect, in which people viewing a speaker whose lip movements do not match the utterance perceive the spoken sounds incorrectly, hearing them as more similar to those signaled by the visual rather than the auditory input. This indicates that audiovisual integration is important for generating the phoneme percept. Here we asked when and where the audiovisual integration process occurs, providing spatial and temporal boundaries for the processes generating phoneme perception. Specifically, we wanted to separate audiovisual integration from other processes, such as simple deviance detection. Building on previous work employing ERPs, we used an oddball paradigm in which task-irrelevant audiovisually deviant stimuli were embedded in strings of non-deviant stimuli. We also recorded the event-related optical signal, an imaging method combining spatial and temporal resolution, to investigate the time course and neuroanatomical substrate of audiovisual integration. We found that audiovisual deviants elicit a short duration response in the middle/superior temporal gyrus, whereas audiovisual integration elicits a more extended response involving also inferior frontal and occipital regions. Interactions between audiovisual integration and deviance detection processes were observed in the posterior/superior temporal gyrus. These data suggest that dynamic interactions between inferior frontal cortex and sensory regions play a significant role in multimodal integration.

Mining and Integration of Environmental Data

NASA Astrophysics Data System (ADS)

Tran, V.; Hluchy, L.; Habala, O.; Ciglan, M.

2009-04-01

The project ADMIRE (Advanced Data Mining and Integration Research for Europe) is a 7th FP EU ICT project aims to deliver a consistent and easy-to-use technology for extracting information and knowledge. The project is motivated by the difficulty of extracting meaningful information by data mining combinations of data from multiple heterogeneous and distributed resources. It will also provide an abstract view of data mining and integration, which will give users and developers the power to cope with complexity and heterogeneity of services, data and processes. The data sets describing phenomena from domains like business, society, and environment often contain spatial and temporal dimensions. Integration of spatio-temporal data from different sources is a challenging task due to those dimensions. Different spatio-temporal data sets contain data at different resolutions (e.g. size of the spatial grid) and frequencies. This heterogeneity is the principal challenge of geo-spatial and temporal data sets integration - the integrated data set should hold homogeneous data of the same resolution and frequency. Thus, to integrate heterogeneous spatio-temporal data from distinct source, transformation of one or more data sets is necessary. Following transformation operation are required: • transformation to common spatial and temporal representation - (e.g. transformation to common coordinate system), • spatial and/or temporal aggregation - data from detailed data source are aggregated to match the resolution of other resources involved in the integration process, • spatial and/or temporal record decomposition - records from source with lower resolution data are decomposed to match the granularity of the other data source. This operation decreases data quality (e.g. transformation of data from 50km grid to 10 km grid) - data from lower resolution data set in the integrated schema are imprecise, but it allows us to preserve higher resolution data. We can decompose the spatio-temporal data integration to following phases: • pre-integration data processing - different data set can be physically stored in different formats (e.g. relational databases, text files); it might be necessary to pre-process the data sets to be integrated, • identification of transformation operations necessary to integrate data in spatio-temporal dimensions, • identification of transformation operations to be performed on non-spatio-temporal attributes and • output data schema and set generation - given prepared data and the set of transformation, operations, the final integrated schema is produces. Spatio-temporal dimension brings its specifics also to the problem of mining spatio-temporal data sets. Spatio-temporal relationships exist among records in (s-t) data sets and those relationships should be considered in mining operation. This means that when analyzing a record in spatio-temporal data set, the records in its spatial and/or temporal proximity should be taken into account. In addition, the relationships discovered in spatio-temporal data can be different when mining the same data on different scales (e.g. mining the same data sets on 50 km grid with daily data vs. 10 km grid with hourly data). To be able to do effective data mining, we first needed to gather a sufficient amount of environmental data covering similar area and time span. For this purpose we have engaged in cooperation with several organizations working in the environmental domain in Slovakia, some of which are also our partners from previous research efforts. The organizations which volunteered some of their data are the Slovak Hydro-meteorological Institute (SHMU), the Slovak Water Enterprise (SVP), the Soil Science and Conservation Institute (VUPOP), and the Institute of Hydrology of the Slovak Academy of Sciences (UHSAV). We have prepared scenarios from general meteorology, as well as specialized in hydrology and soil protection.

GIS-based analysis and modelling with empirical and remotely-sensed data on coastline advance and retreat

NASA Astrophysics Data System (ADS)

Ahmad, Sajid Rashid

With the understanding that far more research remains to be done on the development and use of innovative and functional geospatial techniques and procedures to investigate coastline changes this thesis focussed on the integration of remote sensing, geographical information systems (GIS) and modelling techniques to provide meaningful insights on the spatial and temporal dynamics of coastline changes. One of the unique strengths of this research was the parameterization of the GIS with long-term empirical and remote sensing data. Annual empirical data from 1941--2007 were analyzed by the GIS, and then modelled with statistical techniques. Data were also extracted from Landsat TM and ETM+ images. The band ratio method was used to extract the coastlines. Topographic maps were also used to extract digital map data. All data incorporated into ArcGIS 9.2 were analyzed with various modules, including Spatial Analyst, 3D Analyst, and Triangulated Irregular Networks. The Digital Shoreline Analysis System was used to analyze and predict rates of coastline change. GIS results showed the spatial locations along the coast that will either advance or retreat over time. The linear regression results highlighted temporal changes which are likely to occur along the coastline. Box-Jenkins modelling procedures were utilized to determine statistical models which best described the time series (1941--2007) of coastline change data. After several iterations and goodness-of-fit tests, second-order spatial cyclic autoregressive models, first-order autoregressive models and autoregressive moving average models were identified as being appropriate for describing the deterministic and random processes operating in Guyana's coastal system. The models highlighted not only cyclical patterns in advance and retreat of the coastline, but also the existence of short and long-term memory processes. Long-term memory processes could be associated with mudshoal propagation and stabilization while short-term memory processes were indicative of transitory hydrodynamic and other processes. An innovative framework for a spatio-temporal information-based system (STIBS) was developed. STIBS incorporated diverse datasets within a GIS, dynamic computer-based simulation models, and a spatial information query and graphical subsystem. Tests of the STIBS proved that it could be used to simulate and visualize temporal variability in shifting morphological states of the coastline.

Electrophysiological Indices of Memory for Temporal Order in Early Childhood: Implications for the Development of Recollection

ERIC Educational Resources Information Center

Riggins, Tracy; Miller, Neely C.; Bauer, Patricia J.; Georgieff, Michael K.; Nelson, Charles A.

2009-01-01

The ability to recall contextual details associated with an event begins to develop in the first year of life, yet adult levels of recall are not reached until early adolescence. Dual-process models of memory suggest that the distinct retrieval process that supports the recall of such contextual information is recollection. In the present…

Relative Recency Judgments in Learning Disabled Children: A Semi-Automatic Process.

ERIC Educational Resources Information Center

Stein, Debra K.; And Others

The ability of 20 learning disabled (LD) and 20 non-LD students (mean age of 9 years) to process temporal order information was assessed by employing a relative recency judgment task. Ss were administered lists composed of pictures of everyday objects and were then asked to indicate which item appeared latest on the list (that is, most recently).…

Replication and Pedagogy in the History of Psychology V: The Metronome and Wilhelm Wundt's Search for the Components of Consciousness

ERIC Educational Resources Information Center

Ayala, Christopher; Borawski, Steven; Miller, Jonathon

2008-01-01

Wilhelm Wundt (1832-1920) believed that consciousness was represented by the interconnection of psychical processes comprised of temporal elements and compounds. To explore these processes, Wundt used a metronome to measure the amount of information that passed into consciousness across time. The current project replicated some of his procedures,…

Selective spatial attention modulates bottom-up informational masking of speech

PubMed Central

Carlile, Simon; Corkhill, Caitlin

2015-01-01

To hear out a conversation against other talkers listeners overcome energetic and informational masking. Largely attributed to top-down processes, information masking has also been demonstrated using unintelligible speech and amplitude-modulated maskers suggesting bottom-up processes. We examined the role of speech-like amplitude modulations in information masking using a spatial masking release paradigm. Separating a target talker from two masker talkers produced a 20 dB improvement in speech reception threshold; 40% of which was attributed to a release from informational masking. When across frequency temporal modulations in the masker talkers are decorrelated the speech is unintelligible, although the within frequency modulation characteristics remains identical. Used as a masker as above, the information masking accounted for 37% of the spatial unmasking seen with this masker. This unintelligible and highly differentiable masker is unlikely to involve top-down processes. These data provides strong evidence of bottom-up masking involving speech-like, within-frequency modulations and that this, presumably low level process, can be modulated by selective spatial attention. PMID:25727100

Selective spatial attention modulates bottom-up informational masking of speech.

PubMed

Carlile, Simon; Corkhill, Caitlin

2015-03-02

To hear out a conversation against other talkers listeners overcome energetic and informational masking. Largely attributed to top-down processes, information masking has also been demonstrated using unintelligible speech and amplitude-modulated maskers suggesting bottom-up processes. We examined the role of speech-like amplitude modulations in information masking using a spatial masking release paradigm. Separating a target talker from two masker talkers produced a 20 dB improvement in speech reception threshold; 40% of which was attributed to a release from informational masking. When across frequency temporal modulations in the masker talkers are decorrelated the speech is unintelligible, although the within frequency modulation characteristics remains identical. Used as a masker as above, the information masking accounted for 37% of the spatial unmasking seen with this masker. This unintelligible and highly differentiable masker is unlikely to involve top-down processes. These data provides strong evidence of bottom-up masking involving speech-like, within-frequency modulations and that this, presumably low level process, can be modulated by selective spatial attention.

Studying frequency processing of the brain to enhance long-term memory and develop a human brain protocol.

PubMed

Friedrich, Wernher; Du, Shengzhi; Balt, Karlien

2015-01-01

The temporal lobe in conjunction with the hippocampus is responsible for memory processing. The gamma wave is involved with this process. To develop a human brain protocol, a better understanding of the relationship between gamma and long-term memory is vital. A more comprehensive understanding of the human brain and specific analogue waves it uses will support the development of a human brain protocol. Fifty-eight participants aged between 6 and 60 years participated in long-term memory experiments. It is envisaged that the brain could be stimulated through binaural beats (sound frequency) at 40 Hz (gamma) to enhance long-term memory capacity. EEG recordings have been transformed to sound and then to an information standard, namely ASCII. Statistical analysis showed a proportional relationship between long-term memory and gamma activity. Results from EEG recordings indicate a pattern. The pattern was obtained through the de-codification of an EEG recording to sound and then to ASCII. Stimulation of gamma should enhance long term memory capacity. More research is required to unlock the human brains' protocol key. This key will enable the processing of information directly to and from human memory via gamma, the hippocampus and the temporal lobe.

Music Perception in Dementia.

PubMed

Golden, Hannah L; Clark, Camilla N; Nicholas, Jennifer M; Cohen, Miriam H; Slattery, Catherine F; Paterson, Ross W; Foulkes, Alexander J M; Schott, Jonathan M; Mummery, Catherine J; Crutch, Sebastian J; Warren, Jason D

2017-01-01

Despite much recent interest in music and dementia, music perception has not been widely studied across dementia syndromes using an information processing approach. Here we addressed this issue in a cohort of 30 patients representing major dementia syndromes of typical Alzheimer's disease (AD, n = 16), logopenic aphasia (LPA, an Alzheimer variant syndrome; n = 5), and progressive nonfluent aphasia (PNFA; n = 9) in relation to 19 healthy age-matched individuals. We designed a novel neuropsychological battery to assess perception of musical patterns in the dimensions of pitch and temporal information (requiring detection of notes that deviated from the established pattern based on local or global sequence features) and musical scene analysis (requiring detection of a familiar tune within polyphonic harmony). Performance on these tests was referenced to generic auditory (timbral) deviance detection and recognition of familiar tunes and adjusted for general auditory working memory performance. Relative to healthy controls, patients with AD and LPA had group-level deficits of global pitch (melody contour) processing while patients with PNFA as a group had deficits of local (interval) as well as global pitch processing. There was substantial individual variation within syndromic groups. Taking working memory performance into account, no specific deficits of musical temporal processing, timbre processing, musical scene analysis, or tune recognition were identified. The findings suggest that particular aspects of music perception such as pitch pattern analysis may open a window on the processing of information streams in major dementia syndromes. The potential selectivity of musical deficits for particular dementia syndromes and particular dimensions of processing warrants further systematic investigation.

Role of consciousness in temporal integration of semantic information.

PubMed

Yang, Yung-Hao; Tien, Yung-Hsuan; Yang, Pei-Ling; Yeh, Su-Ling

2017-10-01

Previous studies found that word meaning can be processed unconsciously. Yet it remains unknown whether temporally segregated words can be integrated into a holistic meaningful phrase without consciousness. The first four experiments were designed to examine this by sequentially presenting the first three words of Chinese four-word idioms as prime to one eye and dynamic Mondrians to the other (i.e., the continuous flash suppression paradigm; CFS). An unmasked target word followed the three masked words in a lexical decision task. Results from such invisible (CFS) condition were compared with the visible condition where the preceding words were superimposed on the Mondrians and presented to both eyes. Lower performance in behavioral experiments and larger N400 event-related potentials (ERP) component for incongruent- than congruent-ending words were found in the visible condition. However, no such congruency effect was found in the invisible condition, even with enhanced statistical power and top-down attention, and with several potential confounding factors (contrast-dependent processing, long interval, no conscious training) excluded. Experiment 5 demonstrated that familiarity of word orientation without temporal integration can be processed unconsciously, excluding the possibility of general insensitivity of our paradigm. The overall result pattern therefore suggests that consciousness plays an important role in semantic temporal integration in the conditions we tested.

Deficient relational binding processes in adolescents with psychosis: evidence from impaired memory for source and temporal context.

PubMed

Doré, Marie-Claire; Caza, Nicole; Gingras, Nathalie; Rouleau, Nancie

2007-11-01

Findings from the literature consistently revealed episodic memory deficits in adolescents with psychosis. However, the nature of the dysfunction remains unclear. Based on a cognitive neuropsychological approach, a theoretically driven paradigm was used to generate valid interpretations about the underlying memory processes impaired in these patients. A total of 16 inpatient adolescents with psychosis and 19 individually matched controls were assessed using an experimental task designed to measure memory for source and temporal context of studied words. Retrospective confidence judgements for source and temporal context responses were also assessed. On word recognition, patients had more difficulty than controls discriminating target words from neutral distractors. In addition, patients identified both source and temporal context features of recognised items less often than controls. Confidence judgements analyses revealed that the difference between the proportions of correct and incorrect responses made with high confidence was lower in patients than in controls. In addition, the proportion of high-confident responses that were errors was higher in patients compared to controls. These findings suggest impaired relational binding processes in adolescents with psychosis, resulting in a difficulty to create unified memory representations. Our findings on retrospective confidence data point to impaired monitoring of retrieved information that may also impair memory performance in these individuals.

Channel noise-induced temporal coherence transitions and synchronization transitions in adaptive neuronal networks with time delay

NASA Astrophysics Data System (ADS)

Gong, Yubing; Xie, Huijuan

2017-09-01

Using spike-timing-dependent plasticity (STDP), we study the effect of channel noise on temporal coherence and synchronization of adaptive scale-free Hodgkin-Huxley neuronal networks with time delay. It is found that the spiking regularity and spatial synchronization of the neurons intermittently increase and decrease as channel noise intensity is varied, exhibiting transitions of temporal coherence and synchronization. Moreover, this phenomenon depends on time delay, STDP, and network average degree. As time delay increases, the phenomenon is weakened, however, there are optimal STDP and network average degree by which the phenomenon becomes strongest. These results show that channel noise can intermittently enhance the temporal coherence and synchronization of the delayed adaptive neuronal networks. These findings provide a new insight into channel noise for the information processing and transmission in neural systems.

Temporal differentiation and the optimization of system output

NASA Astrophysics Data System (ADS)

Tannenbaum, Emmanuel

2008-01-01

We develop two simplified dynamical models with which to explore the conditions under which temporal differentiation leads to increased system output. By temporal differentiation, we mean a division of labor whereby different subtasks associated with performing a given task are done at different times. The idea is that, by focusing on one particular set of subtasks at a time, it is possible to increase the efficiency with which each subtask is performed, thereby allowing for faster completion of the overall task. In the first model, we consider the filling and emptying of a tank in the presence of a time-varying resource profile. If a given resource is available, the tank may be filled at some rate rf . As long as the tank contains a resource, it may be emptied at a rate re , corresponding to processing into some product, which is either the final product of a process or an intermediate that is transported for further processing. Given a resource-availability profile over some time interval T , we develop an algorithm for determining the fill-empty profile that produces the maximum quantity of processed resource at the end of the time interval. We rigorously prove that the basic algorithm is one where the tank is filled when a resource is available and emptied when a resource is not available. In the second model, we consider a process whereby some resource is converted into some final product in a series of three agent-mediated steps. Temporal differentiation is incorporated by allowing the agents to oscillate between performing the first two steps and performing the last step. We find that temporal differentiation is favored when the number of agents is at intermediate values and when there are process intermediates that have long lifetimes compared to other characteristic time scales in the system. Based on these results, we speculate that temporal differentiation may provide an evolutionary basis for the emergence of phenomena such as sleep, distinct REM and non-REM sleep states, and circadian rhythms in general. The essential argument is that in sufficiently complex biological systems, a maximal amount of information and tasks can be processed and completed if the system follows a temporally differentiated “work plan,” whereby the system focuses on one or a few tasks at a time.

Making Temporal Search More Central in Spatial Data Infrastructures

NASA Astrophysics Data System (ADS)

Corti, P.; Lewis, B.

2017-10-01

A temporally enabled Spatial Data Infrastructure (SDI) is a framework of geospatial data, metadata, users, and tools intended to provide an efficient and flexible way to use spatial information which includes the historical dimension. One of the key software components of an SDI is the catalogue service which is needed to discover, query, and manage the metadata. A search engine is a software system capable of supporting fast and reliable search, which may use any means necessary to get users to the resources they need quickly and efficiently. These techniques may include features such as full text search, natural language processing, weighted results, temporal search based on enrichment, visualization of patterns in distributions of results in time and space using temporal and spatial faceting, and many others. In this paper we will focus on the temporal aspects of search which include temporal enrichment using a time miner - a software engine able to search for date components within a larger block of text, the storage of time ranges in the search engine, handling historical dates, and the use of temporal histograms in the user interface to display the temporal distribution of search results.

Multi-Temporal Land Cover Classification with Long Short-Term Memory Neural Networks

NASA Astrophysics Data System (ADS)

Rußwurm, M.; Körner, M.

2017-05-01

Land cover classification (LCC) is a central and wide field of research in earth observation and has already put forth a variety of classification techniques. Many approaches are based on classification techniques considering observation at certain points in time. However, some land cover classes, such as crops, change their spectral characteristics due to environmental influences and can thus not be monitored effectively with classical mono-temporal approaches. Nevertheless, these temporal observations should be utilized to benefit the classification process. After extensive research has been conducted on modeling temporal dynamics by spectro-temporal profiles using vegetation indices, we propose a deep learning approach to utilize these temporal characteristics for classification tasks. In this work, we show how long short-term memory (LSTM) neural networks can be employed for crop identification purposes with SENTINEL 2A observations from large study areas and label information provided by local authorities. We compare these temporal neural network models, i.e., LSTM and recurrent neural network (RNN), with a classical non-temporal convolutional neural network (CNN) model and an additional support vector machine (SVM) baseline. With our rather straightforward LSTM variant, we exceeded state-of-the-art classification performance, thus opening promising potential for further research.

Developmental changes in brain regions involved in phonological and orthographic processing during spoken language processing

PubMed Central

Cone, Nadia E.; Burman, Douglas D.; Bitan, Tali; Bolger, Donald J.; Booth, James R.

2008-01-01

Developmental differences in brain activation of 9- to 15-year-old children were examined during an auditory rhyme decision task to spoken words using functional magnetic resonance imaging (fMRI). As a group, children showed activation in left superior/middle temporal gyri (BA 22, 21), right middle temporal gyrus (BA 21), dorsal (BA 45, pars opercularis) and ventral (BA 46, pars triangularis) aspects of left inferior frontal gyrus, and left fusiform gyrus (BA 37). There was a developmental increase in activation in left middle temporal gyrus (BA 22) across all lexical conditions, suggesting that automatic semantic processing increases with age regardless of task demands. Activation in left dorsal inferior frontal gyrus also showed developmental increases for the conflicting (e.g. PINT-MINT) compared to the non-conflicting (e.g. PRESS-LIST) non-rhyming conditions, indicating that this area becomes increasingly involved in strategic phonological processing in the face of conflicting orthographic and phonological representations. Left inferior temporal/fusiform gyrus (BA 37) activation was also greater for the conflicting (e.g. PINT-MINT) condition, and a developmental increase was found in the positive relationship between individuals' reaction time and activation in left lingual/fusiform gyrus (BA 18) in this condition, indicating an age-related increase in the association between longer reaction times and greater visual-orthographic processing in this conflicting condition. These results suggest that orthographic processing is automatically engaged by children in a task that does not require access to orthographic information for correct performance, especially when orthographic and phonological representations conflict, and especially for longer response latencies in older children. PMID:18413290

Electrophysiological models of neural processing.

PubMed

Nelson, Mark E

2011-01-01

The brain is an amazing information processing system that allows organisms to adaptively monitor and control complex dynamic interactions with their environment across multiple spatial and temporal scales. Mathematical modeling and computer simulation techniques have become essential tools in understanding diverse aspects of neural processing ranging from sub-millisecond temporal coding in the sound localization circuity of barn owls to long-term memory storage and retrieval in humans that can span decades. The processing capabilities of individual neurons lie at the core of these models, with the emphasis shifting upward and downward across different levels of biological organization depending on the nature of the questions being addressed. This review provides an introduction to the techniques for constructing biophysically based models of individual neurons and local networks. Topics include Hodgkin-Huxley-type models of macroscopic membrane currents, Markov models of individual ion-channel currents, compartmental models of neuronal morphology, and network models involving synaptic interactions among multiple neurons.

Application-ready expedited MODIS data for operational land surface monitoring of vegetation condition

USGS Publications Warehouse

Brown, Jesslyn; Howard, Daniel M.; Wylie, Bruce K.; Friesz, Aaron M.; Ji, Lei; Gacke, Carolyn

2015-01-01

Monitoring systems benefit from high temporal frequency image data collected from the Moderate Resolution Imaging Spectroradiometer (MODIS) system. Because of near-daily global coverage, MODIS data are beneficial to applications that require timely information about vegetation condition related to drought, flooding, or fire danger. Rapid satellite data streams in operational applications have clear benefits for monitoring vegetation, especially when information can be delivered as fast as changing surface conditions. An “expedited” processing system called “eMODIS” operated by the U.S. Geological Survey provides rapid MODIS surface reflectance data to operational applications in less than 24 h offering tailored, consistently-processed information products that complement standard MODIS products. We assessed eMODIS quality and consistency by comparing to standard MODIS data. Only land data with known high quality were analyzed in a central U.S. study area. When compared to standard MODIS (MOD/MYD09Q1), the eMODIS Normalized Difference Vegetation Index (NDVI) maintained a strong, significant relationship to standard MODIS NDVI, whether from morning (Terra) or afternoon (Aqua) orbits. The Aqua eMODIS data were more prone to noise than the Terra data, likely due to differences in the internal cloud mask used in MOD/MYD09Q1 or compositing rules. Post-processing temporal smoothing decreased noise in eMODIS data.

A fast BK-type KCa current acts as a postsynaptic modulator of temporal selectivity for communication signals.

PubMed

Kohashi, Tsunehiko; Carlson, Bruce A

2014-01-01

Temporal patterns of spiking often convey behaviorally relevant information. Various synaptic mechanisms and intrinsic membrane properties can influence neuronal selectivity to temporal patterns of input. However, little is known about how synaptic mechanisms and intrinsic properties together determine the temporal selectivity of neuronal output. We tackled this question by recording from midbrain electrosensory neurons in mormyrid fish, in which the processing of temporal intervals between communication signals can be studied in a reduced in vitro preparation. Mormyrids communicate by varying interpulse intervals (IPIs) between electric pulses. Within the midbrain posterior exterolateral nucleus (ELp), the temporal patterns of afferent spike trains are filtered to establish single-neuron IPI tuning. We performed whole-cell recording from ELp neurons in a whole-brain preparation and examined the relationship between intrinsic excitability and IPI tuning. We found that spike frequency adaptation of ELp neurons was highly variable. Postsynaptic potentials (PSPs) of strongly adapting (phasic) neurons were more sharply tuned to IPIs than weakly adapting (tonic) neurons. Further, the synaptic filtering of IPIs by tonic neurons was more faithfully converted into variation in spiking output, particularly at short IPIs. Pharmacological manipulation under current- and voltage-clamp revealed that tonic firing is mediated by a fast, large-conductance Ca(2+)-activated K(+) (KCa) current (BK) that speeds up action potential repolarization. These results suggest that BK currents can shape the temporal filtering of sensory inputs by modifying both synaptic responses and PSP-to-spike conversion. Slow SK-type KCa currents have previously been implicated in temporal processing. Thus, both fast and slow KCa currents can fine-tune temporal selectivity.

Integrating speech in time depends on temporal expectancies and attention.

PubMed

Scharinger, Mathias; Steinberg, Johanna; Tavano, Alessandro

2017-08-01

Sensory information that unfolds in time, such as in speech perception, relies on efficient chunking mechanisms in order to yield optimally-sized units for further processing. Whether or not two successive acoustic events receive a one-unit or a two-unit interpretation seems to depend on the fit between their temporal extent and a stipulated temporal window of integration. However, there is ongoing debate on how flexible this temporal window of integration should be, especially for the processing of speech sounds. Furthermore, there is no direct evidence of whether attention may modulate the temporal constraints on the integration window. For this reason, we here examine how different word durations, which lead to different temporal separations of sound onsets, interact with attention. In an Electroencephalography (EEG) study, participants actively and passively listened to words where word-final consonants were occasionally omitted. Words had either a natural duration or were artificially prolonged in order to increase the separation of speech sound onsets. Omission responses to incomplete speech input, originating in left temporal cortex, decreased when the critical speech sound was separated from previous sounds by more than 250 msec, i.e., when the separation was larger than the stipulated temporal window of integration (125-150 msec). Attention, on the other hand, only increased omission responses for stimuli with natural durations. We complemented the event-related potential (ERP) analyses by a frequency-domain analysis on the stimulus presentation rate. Notably, the power of stimulation frequency showed the same duration and attention effects than the omission responses. We interpret these findings on the background of existing research on temporal integration windows and further suggest that our findings may be accounted for within the framework of predictive coding. Copyright © 2017 Elsevier Ltd. All rights reserved.

Normalized value coding explains dynamic adaptation in the human valuation process.

PubMed

Khaw, Mel W; Glimcher, Paul W; Louie, Kenway

2017-11-28

The notion of subjective value is central to choice theories in ecology, economics, and psychology, serving as an integrated decision variable by which options are compared. Subjective value is often assumed to be an absolute quantity, determined in a static manner by the properties of an individual option. Recent neurobiological studies, however, have shown that neural value coding dynamically adapts to the statistics of the recent reward environment, introducing an intrinsic temporal context dependence into the neural representation of value. Whether valuation exhibits this kind of dynamic adaptation at the behavioral level is unknown. Here, we show that the valuation process in human subjects adapts to the history of previous values, with current valuations varying inversely with the average value of recently observed items. The dynamics of this adaptive valuation are captured by divisive normalization, linking these temporal context effects to spatial context effects in decision making as well as spatial and temporal context effects in perception. These findings suggest that adaptation is a universal feature of neural information processing and offer a unifying explanation for contextual phenomena in fields ranging from visual psychophysics to economic choice.

Auditory processing efficiency deficits in children with developmental language impairments

NASA Astrophysics Data System (ADS)

Hartley, Douglas E. H.; Moore, David R.

2002-12-01

The ``temporal processing hypothesis'' suggests that individuals with specific language impairments (SLIs) and dyslexia have severe deficits in processing rapidly presented or brief sensory information, both within the auditory and visual domains. This hypothesis has been supported through evidence that language-impaired individuals have excess auditory backward masking. This paper presents an analysis of masking results from several studies in terms of a model of temporal resolution. Results from this modeling suggest that the masking results can be better explained by an ``auditory efficiency'' hypothesis. If impaired or immature listeners have a normal temporal window, but require a higher signal-to-noise level (poor processing efficiency), this hypothesis predicts the observed small deficits in the simultaneous masking task, and the much larger deficits in backward and forward masking tasks amongst those listeners. The difference in performance on these masking tasks is predictable from the compressive nonlinearity of the basilar membrane. The model also correctly predicts that backward masking (i) is more prone to training effects, (ii) has greater inter- and intrasubject variability, and (iii) increases less with masker level than do other masking tasks. These findings provide a new perspective on the mechanisms underlying communication disorders and auditory masking.

Temporal Information Partitioning Networks (TIPNets): A process network approach to infer ecohydrologic shifts

NASA Astrophysics Data System (ADS)

Goodwell, Allison E.; Kumar, Praveen

2017-07-01

In an ecohydrologic system, components of atmospheric, vegetation, and root-soil subsystems participate in forcing and feedback interactions at varying time scales and intensities. The structure of this network of complex interactions varies in terms of connectivity, strength, and time scale due to perturbations or changing conditions such as rainfall, drought, or land use. However, characterization of these interactions is difficult due to multivariate and weak dependencies in the presence of noise, nonlinearities, and limited data. We introduce a framework for Temporal Information Partitioning Networks (TIPNets), in which time-series variables are viewed as nodes, and lagged multivariate mutual information measures are links. These links are partitioned into synergistic, unique, and redundant information components, where synergy is information provided only jointly, unique information is only provided by a single source, and redundancy is overlapping information. We construct TIPNets from 1 min weather station data over several hour time windows. From a comparison of dry, wet, and rainy conditions, we find that information strengths increase when solar radiation and surface moisture are present, and surface moisture and wind variability are redundant and synergistic influences, respectively. Over a growing season, network trends reveal patterns that vary with vegetation and rainfall patterns. The framework presented here enables us to interpret process connectivity in a multivariate context, which can lead to better inference of behavioral shifts due to perturbations in ecohydrologic systems. This work contributes to more holistic characterizations of system behavior, and can benefit a wide variety of studies of complex systems.

Superior Temporal Sulcus Disconnectivity During Processing of Metaphoric Gestures in Schizophrenia

PubMed Central

Straube, Benjamin; Green, Antonia; Sass, Katharina; Kircher, Tilo

2014-01-01

The left superior temporal sulcus (STS) plays an important role in integrating audiovisual information and is functionally connected to disparate regions of the brain. For the integration of gesture information in an abstract sentence context (metaphoric gestures), intact connectivity between the left STS and the inferior frontal gyrus (IFG) should be important. Patients with schizophrenia have problems with the processing of metaphors (concretism) and show aberrant structural connectivity of long fiber bundles. Thus, we tested the hypothesis that patients with schizophrenia differ in the functional connectivity of the left STS to the IFG for the processing of metaphoric gestures. During functional magnetic resonance imaging data acquisition, 16 patients with schizophrenia (P) and a healthy control group (C) were shown videos of an actor performing gestures in a concrete (iconic, IC) and abstract (metaphoric, MP) sentence context. A psychophysiological interaction analysis based on the seed region from a previous analysis in the left STS was performed. In both groups we found common positive connectivity for IC and MP of the STS seed region to the left middle temporal gyrus (MTG) and left ventral IFG. The interaction of group (C>P) and gesture condition (MP>IC) revealed effects in the connectivity to the bilateral IFG and the left MTG with patients exhibiting lower connectivity for the MP condition. In schizophrenia the left STS is misconnected to the IFG, particularly during the processing of MP gestures. Dysfunctional integration of gestures in an abstract sentence context might be the basis of certain interpersonal communication problems in the patients. PMID:23956120

Influence of branding on preference-based decision making.

PubMed

Philiastides, Marios G; Ratcliff, Roger

2013-07-01

Branding has become one of the most important determinants of consumer choices. Intriguingly, the psychological mechanisms of how branding influences decision making remain elusive. In the research reported here, we used a preference-based decision-making task and computational modeling to identify which internal components of processing are affected by branding. We found that a process of noisy temporal integration of subjective value information can model preference-based choices reliably and that branding biases are explained by changes in the rate of the integration process itself. This result suggests that branding information and subjective preference are integrated into a single source of evidence in the decision-making process, thereby altering choice behavior.

The third-stimulus temporal discrimination threshold: focusing on the temporal processing of sensory input within primary somatosensory cortex.

PubMed

Leodori, Giorgio; Formica, Alessandra; Zhu, Xiaoying; Conte, Antonella; Belvisi, Daniele; Cruccu, Giorgio; Hallett, Mark; Berardelli, Alfredo

2017-10-01

The somatosensory temporal discrimination threshold (STDT) has been used in recent years to investigate time processing of sensory information, but little is known about the physiological correlates of somatosensory temporal discrimination. The objective of this study was to investigate whether the time interval required to discriminate between two stimuli varies according to the number of stimuli in the task. We used the third-stimulus temporal discrimination threshold (ThirdDT), defined as the shortest time interval at which an individual distinguishes a third stimulus following a pair of stimuli delivered at the STDT. The STDT and ThirdDT were assessed in 31 healthy subjects. In a subgroup of 10 subjects, we evaluated the effects of the stimuli intensity on the ThirdDT. In a subgroup of 16 subjects, we evaluated the effects of S1 continuous theta-burst stimulation (S1-cTBS) on the STDT and ThirdDT. Results show that ThirdDT is shorter than STDT. We found a positive correlation between STDT and ThirdDT values. As long as the stimulus intensity was within the perceivable and painless range, it did not affect ThirdDT values. S1-cTBS significantly affected both STDT and ThirdDT, although the latter was affected to a greater extent and for a longer period of time. We conclude that the interval needed to discriminate between time-separated tactile stimuli is related to the number of stimuli used in the task. STDT and ThirdDT are encoded in S1, probably by a shared tactile temporal encoding mechanism whose performance rapidly changes during the perception process. ThirdDT is a new method to measure somatosensory temporal discrimination. NEW & NOTEWORTHY To investigate whether the time interval required to discriminate between stimuli varies according to changes in the stimulation pattern, we used the third-stimulus temporal discrimination threshold (ThirdDT). We found that the somatosensory temporal discrimination acuity varies according to the number of stimuli in the task. The ThirdDT is a new method to measure somatosensory temporal discrimination and a possible index of inhibitory activity at the S1 level. Copyright © 2017 the American Physiological Society.

A Search for Temporal Changes on Pluto and Charon

NASA Astrophysics Data System (ADS)

Hofgartner, Jason D.; Buratti, Bonnie J.; Devins, Spencer; Beyer, Ross A.; Schenk, Paul M.; Stern, S. Alan; Weaver, Harold A.; Olkin, Catherine; Cheng, Andrew F.; Ennico, Kimberly; Lauer, Tod R.; Spencer, John R.; Young, Leslie; New Horizons Science Team

2017-10-01

A search for temporal changes on Pluto and Charon was motivated by (1) the discovery of young surfaces in the Pluto system that imply ongoing or recent geologic activity, (2) the detection of active plumes on Triton during the Voyager 2 flyby, and (3) the abundant and detailed information that observing geologic processes in action provides about the processes. A thorough search for temporal changes using New Horizons images was completed. Images that covered the same region were blinked and manually inspected for any differences in appearance. The search included full-disk images such that all illuminated regions of both bodies were investigated and also higher resolution images such that parts of the encounter hemispheres were investigated at finer spatial scales. Changes of appearance between different images were observed but in all cases were attributed to variability of the imaging parameters (especially geometry) or artifacts. No differences of appearance that are strongly indicative of a temporal change were found on the surface or in the atmosphere of either Pluto or Charon. Limits on temporal changes as a function of spatial scale and temporal interval during the New Horizons encounter are determined. The longest time interval constraint is one Pluto/Charon rotation period (~6.4 Earth days). Contrast reversal and high-phase bright features that change in appearance with solar phase angle are identified. The change of appearance of these features is most likely due to the change in phase angle rather than a temporal change. Had active plumes analogous to the plumes discovered on Triton been present on the encounter hemispheres of either Pluto or Charon, they would have been detected. Several dark streak features that may be deposits from past plumes are identified. The absence of active plumes may be due to temporal variability or because the process that generates Triton’s plumes does not occur on Pluto.

The neural bases of spatial frequency processing during scene perception

PubMed Central

Kauffmann, Louise; Ramanoël, Stephen; Peyrin, Carole

2014-01-01

Theories on visual perception agree that scenes are processed in terms of spatial frequencies. Low spatial frequencies (LSF) carry coarse information whereas high spatial frequencies (HSF) carry fine details of the scene. However, how and where spatial frequencies are processed within the brain remain unresolved questions. The present review addresses these issues and aims to identify the cerebral regions differentially involved in low and high spatial frequency processing, and to clarify their attributes during scene perception. Results from a number of behavioral and neuroimaging studies suggest that spatial frequency processing is lateralized in both hemispheres, with the right and left hemispheres predominantly involved in the categorization of LSF and HSF scenes, respectively. There is also evidence that spatial frequency processing is retinotopically mapped in the visual cortex. HSF scenes (as opposed to LSF) activate occipital areas in relation to foveal representations, while categorization of LSF scenes (as opposed to HSF) activates occipital areas in relation to more peripheral representations. Concomitantly, a number of studies have demonstrated that LSF information may reach high-order areas rapidly, allowing an initial coarse parsing of the visual scene, which could then be sent back through feedback into the occipito-temporal cortex to guide finer HSF-based analysis. Finally, the review addresses spatial frequency processing within scene-selective regions areas of the occipito-temporal cortex. PMID:24847226

The overlapping relationship between emotion perception and theory of mind.

PubMed

Mitchell, Rachel L C; Phillips, Louise H

2015-04-01

Socio-cognitive skills are crucial for successful interpersonal interactions. Two particularly important socio-cognitive processes are emotion perception (EP) and theory of mind (ToM), but agreement is lacking on terminology and conceptual links between these constructs. Here we seek to clarify the relationship between the two at multiple levels, from concept to neuroanatomy. EP is often regarded as a low-level perceptual process necessary to decode affective cues, while ToM is usually seen as a higher-level cognitive process involving mental state deduction. In information processing models, EP tends to precede ToM. At the neuroanatomical level, lesion study data suggest that EP and ToM are both right-hemisphere based, but there is also evidence that ToM requires temporal-cingulate networks, whereas EP requires partially separable regions linked to distinct emotions. Common regions identified in fMRI studies of EP and ToM have included medial prefrontal cortex and temporal lobe areas, but differences emerge depending on the perceptual, cognitive and emotional demands of the EP and ToM tasks. For the future, clarity of definition of EP and ToM will be paramount to produce distinct task manipulations and inform models of socio-cognitive processing. Copyright © 2015 Elsevier Ltd. All rights reserved.

Time-Frequency Approach for Stochastic Signal Detection

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ghosh, Ripul; Akula, Aparna; Kumar, Satish

2011-10-20

The detection of events in a stochastic signal has been a subject of great interest. One of the oldest signal processing technique, Fourier Transform of a signal contains information regarding frequency content, but it cannot resolve the exact onset of changes in the frequency, all temporal information is contained in the phase of the transform. On the other hand, Spectrogram is better able to resolve temporal evolution of frequency content, but has a trade-off in time resolution versus frequency resolution in accordance with the uncertainty principle. Therefore, time-frequency representations are considered for energetic characterisation of the non-stationary signals. Wigner Villemore » Distribution (WVD) is the most prominent quadratic time-frequency signal representation and used for analysing frequency variations in signals.WVD allows for instantaneous frequency estimation at each data point, for a typical temporal resolution of fractions of a second. This paper through simulations describes the way time frequency models are applied for the detection of event in a stochastic signal.« less

Time-Frequency Approach for Stochastic Signal Detection

NASA Astrophysics Data System (ADS)

Ghosh, Ripul; Akula, Aparna; Kumar, Satish; Sardana, H. K.

2011-10-01

The detection of events in a stochastic signal has been a subject of great interest. One of the oldest signal processing technique, Fourier Transform of a signal contains information regarding frequency content, but it cannot resolve the exact onset of changes in the frequency, all temporal information is contained in the phase of the transform. On the other hand, Spectrogram is better able to resolve temporal evolution of frequency content, but has a trade-off in time resolution versus frequency resolution in accordance with the uncertainty principle. Therefore, time-frequency representations are considered for energetic characterisation of the non-stationary signals. Wigner Ville Distribution (WVD) is the most prominent quadratic time-frequency signal representation and used for analysing frequency variations in signals.WVD allows for instantaneous frequency estimation at each data point, for a typical temporal resolution of fractions of a second. This paper through simulations describes the way time frequency models are applied for the detection of event in a stochastic signal.

Short temporal asynchrony disrupts visual object recognition

PubMed Central

Singer, Jedediah M.; Kreiman, Gabriel

2014-01-01

Humans can recognize objects and scenes in a small fraction of a second. The cascade of signals underlying rapid recognition might be disrupted by temporally jittering different parts of complex objects. Here we investigated the time course over which shape information can be integrated to allow for recognition of complex objects. We presented fragments of object images in an asynchronous fashion and behaviorally evaluated categorization performance. We observed that visual recognition was significantly disrupted by asynchronies of approximately 30 ms, suggesting that spatiotemporal integration begins to break down with even small deviations from simultaneity. However, moderate temporal asynchrony did not completely obliterate recognition; in fact, integration of visual shape information persisted even with an asynchrony of 100 ms. We describe the data with a concise model based on the dynamic reduction of uncertainty about what image was presented. These results emphasize the importance of timing in visual processing and provide strong constraints for the development of dynamical models of visual shape recognition. PMID:24819738

Complex temporal topic evolution modelling using the Kullback-Leibler divergence and the Bhattacharyya distance.

PubMed

Andrei, Victor; Arandjelović, Ognjen

2016-12-01

The rapidly expanding corpus of medical research literature presents major challenges in the understanding of previous work, the extraction of maximum information from collected data, and the identification of promising research directions. We present a case for the use of advanced machine learning techniques as an aide in this task and introduce a novel methodology that is shown to be capable of extracting meaningful information from large longitudinal corpora and of tracking complex temporal changes within it. Our framework is based on (i) the discretization of time into epochs, (ii) epoch-wise topic discovery using a hierarchical Dirichlet process-based model, and (iii) a temporal similarity graph which allows for the modelling of complex topic changes. More specifically, this is the first work that discusses and distinguishes between two groups of particularly challenging topic evolution phenomena: topic splitting and speciation and topic convergence and merging, in addition to the more widely recognized emergence and disappearance and gradual evolution. The proposed framework is evaluated on a public medical literature corpus.

The evolution of meaning: spatio-temporal dynamics of visual object recognition.

PubMed

Clarke, Alex; Taylor, Kirsten I; Tyler, Lorraine K

2011-08-01

Research on the spatio-temporal dynamics of visual object recognition suggests a recurrent, interactive model whereby an initial feedforward sweep through the ventral stream to prefrontal cortex is followed by recurrent interactions. However, critical questions remain regarding the factors that mediate the degree of recurrent interactions necessary for meaningful object recognition. The novel prediction we test here is that recurrent interactivity is driven by increasing semantic integration demands as defined by the complexity of semantic information required by the task and driven by the stimuli. To test this prediction, we recorded magnetoencephalography data while participants named living and nonliving objects during two naming tasks. We found that the spatio-temporal dynamics of neural activity were modulated by the level of semantic integration required. Specifically, source reconstructed time courses and phase synchronization measures showed increased recurrent interactions as a function of semantic integration demands. These findings demonstrate that the cortical dynamics of object processing are modulated by the complexity of semantic information required from the visual input.

A dynamic spatio-temporal model for spatial data

USGS Publications Warehouse

Hefley, Trevor J.; Hooten, Mevin B.; Hanks, Ephraim M.; Russell, Robin; Walsh, Daniel P.

2017-01-01

Analyzing spatial data often requires modeling dependencies created by a dynamic spatio-temporal data generating process. In many applications, a generalized linear mixed model (GLMM) is used with a random effect to account for spatial dependence and to provide optimal spatial predictions. Location-specific covariates are often included as fixed effects in a GLMM and may be collinear with the spatial random effect, which can negatively affect inference. We propose a dynamic approach to account for spatial dependence that incorporates scientific knowledge of the spatio-temporal data generating process. Our approach relies on a dynamic spatio-temporal model that explicitly incorporates location-specific covariates. We illustrate our approach with a spatially varying ecological diffusion model implemented using a computationally efficient homogenization technique. We apply our model to understand individual-level and location-specific risk factors associated with chronic wasting disease in white-tailed deer from Wisconsin, USA and estimate the location the disease was first introduced. We compare our approach to several existing methods that are commonly used in spatial statistics. Our spatio-temporal approach resulted in a higher predictive accuracy when compared to methods based on optimal spatial prediction, obviated confounding among the spatially indexed covariates and the spatial random effect, and provided additional information that will be important for containing disease outbreaks.

Enhancing molecular logic through modulation of temporal and spatial constraints with quantum dot-based systems that use fluorescent (Förster) resonance energy transfer

NASA Astrophysics Data System (ADS)

Claussen, Jonathan C.; Algar, W. Russ; Hildebrandt, Niko; Susumu, Kimihiro; Ancona, Mario G.; Medintz, Igor L.

2013-10-01

Luminescent semiconductor nanocrystals or quantum dots (QDs) contain favorable photonic properties (e.g., resistance to photobleaching, size-tunable PL, and large effective Stokes shifts) that make them well-suited for fluorescence (Förster) resonance energy transfer (FRET) based applications including monitoring proteolytic activity, elucidating the effects of nanoparticles-mediated drug delivery, and analyzing the spatial and temporal dynamics of cellular biochemical processes. Herein, we demonstrate how unique considerations of temporal and spatial constraints can be used in conjunction with QD-FRET systems to open up new avenues of scientific discovery in information processing and molecular logic circuitry. For example, by conjugating both long lifetime luminescent terbium(III) complexes (Tb) and fluorescent dyes (A647) to a single QD, we can create multiple FRET lanes that change temporally as the QD acts as both an acceptor and donor at distinct time intervals. Such temporal FRET modulation creates multi-step FRET cascades that produce a wealth of unique photoluminescence (PL) spectra that are well-suited for the construction of a photonic alphabet and photonic logic circuits. These research advances in bio-based molecular logic open the door to future applications including multiplexed biosensing and drug delivery for disease diagnostics and treatment.

An Overview of the Runtime Verification Tool Java PathExplorer

NASA Technical Reports Server (NTRS)

Havelund, Klaus; Rosu, Grigore; Clancy, Daniel (Technical Monitor)

2002-01-01

We present an overview of the Java PathExplorer runtime verification tool, in short referred to as JPAX. JPAX can monitor the execution of a Java program and check that it conforms with a set of user provided properties formulated in temporal logic. JPAX can in addition analyze the program for concurrency errors such as deadlocks and data races. The concurrency analysis requires no user provided specification. The tool facilitates automated instrumentation of a program's bytecode, which when executed will emit an event stream, the execution trace, to an observer. The observer dispatches the incoming event stream to a set of observer processes, each performing a specialized analysis, such as the temporal logic verification, the deadlock analysis and the data race analysis. Temporal logic specifications can be formulated by the user in the Maude rewriting logic, where Maude is a high-speed rewriting system for equational logic, but here extended with executable temporal logic. The Maude rewriting engine is then activated as an event driven monitoring process. Alternatively, temporal specifications can be translated into efficient automata, which check the event stream. JPAX can be used during program testing to gain increased information about program executions, and can potentially furthermore be applied during operation to survey safety critical systems.

A neural circuit transforming temporal periodicity information into a rate-based representation in the mammalian auditory system.

PubMed

Dicke, Ulrike; Ewert, Stephan D; Dau, Torsten; Kollmeier, Birger

2007-01-01

Periodic amplitude modulations (AMs) of an acoustic stimulus are presumed to be encoded in temporal activity patterns of neurons in the cochlear nucleus. Physiological recordings indicate that this temporal AM code is transformed into a rate-based periodicity code along the ascending auditory pathway. The present study suggests a neural circuit for the transformation from the temporal to the rate-based code. Due to the neural connectivity of the circuit, bandpass shaped rate modulation transfer functions are obtained that correspond to recorded functions of inferior colliculus (IC) neurons. In contrast to previous modeling studies, the present circuit does not employ a continuously changing temporal parameter to obtain different best modulation frequencies (BMFs) of the IC bandpass units. Instead, different BMFs are yielded from varying the number of input units projecting onto different bandpass units. In order to investigate the compatibility of the neural circuit with a linear modulation filterbank analysis as proposed in psychophysical studies, complex stimuli such as tones modulated by the sum of two sinusoids, narrowband noise, and iterated rippled noise were processed by the model. The model accounts for the encoding of AM depth over a large dynamic range and for modulation frequency selective processing of complex sounds.

Digital image processing for information extraction.

NASA Technical Reports Server (NTRS)

Billingsley, F. C.

1973-01-01

The modern digital computer has made practical image processing techniques for handling nonlinear operations in both the geometrical and the intensity domains, various types of nonuniform noise cleanup, and the numerical analysis of pictures. An initial requirement is that a number of anomalies caused by the camera (e.g., geometric distortion, MTF roll-off, vignetting, and nonuniform intensity response) must be taken into account or removed to avoid their interference with the information extraction process. Examples illustrating these operations are discussed along with computer techniques used to emphasize details, perform analyses, classify materials by multivariate analysis, detect temporal differences, and aid in human interpretation of photos.

Subliminal semantic priming changes the dynamic causal influence between the left frontal and temporal cortex.

PubMed

Matsumoto, Atsushi; Kakigi, Ryusuke

2014-01-01

Recent neuroimaging experiments have revealed that subliminal priming of a target stimulus leads to the reduction of neural activity in specific regions concerned with processing the target. Such findings lead to questions about the degree to which the subliminal priming effect is based only on decreased activity in specific local brain regions, as opposed to the influence of neural mechanisms that regulate communication between brain regions. To address this question, this study recorded EEG during performance of a subliminal semantic priming task. We adopted an information-based approach that used independent component analysis and multivariate autoregressive modeling. Results indicated that subliminal semantic priming caused significant modulation of alpha band activity in the left inferior frontal cortex and modulation of gamma band activity in the left inferior temporal regions. The multivariate autoregressive approach confirmed significant increases in information flow from the inferior frontal cortex to inferior temporal regions in the early time window that was induced by subliminal priming. In the later time window, significant enhancement of bidirectional causal flow between these two regions underlying subliminal priming was observed. Results suggest that unconscious processing of words influences not only local activity of individual brain regions but also the dynamics of neural communication between those regions.

Temporal and Statistical Information in Causal Structure Learning

ERIC Educational Resources Information Center

McCormack, Teresa; Frosch, Caren; Patrick, Fiona; Lagnado, David

2015-01-01

Three experiments examined children's and adults' abilities to use statistical and temporal information to distinguish between common cause and causal chain structures. In Experiment 1, participants were provided with conditional probability information and/or temporal information and asked to infer the causal structure of a 3-variable mechanical…

Combinatorial semantics strengthens angular-anterior temporal coupling.

PubMed

Molinaro, Nicola; Paz-Alonso, Pedro M; Duñabeitia, Jon Andoni; Carreiras, Manuel

2015-04-01

The human semantic combinatorial system allows us to create a wide number of new meanings from a finite number of existing representations. The present study investigates the neural dynamics underlying the semantic processing of different conceptual constructions based on predictions from previous neuroanatomical models of the semantic processing network. In two experiments, participants read sentences for comprehension containing noun-adjective pairs in three different conditions: prototypical (Redundant), nonsense (Anomalous) and low-typical but composable (Contrastive). In Experiment 1 we examined the processing costs associated to reading these sentences and found a processing dissociation between Anomalous and Contrastive word pairs, compared to prototypical (Redundant) stimuli. In Experiment 2, functional connectivity results showed strong co-activation across conditions between inferior frontal gyrus (IFG) and posterior middle temporal gyrus (MTG), as well as between these two regions and middle frontal gyrus (MFG), anterior temporal cortex (ATC) and fusiform gyrus (FG), consistent with previous neuroanatomical models. Importantly, processing of low-typical (but composable) meanings relative to prototypical and anomalous constructions was associated with a stronger positive coupling between ATC and angular gyrus (AG). Our results underscore the critical role of IFG-MTG co-activation during semantic processing and how other relevant nodes within the semantic processing network come into play to handle visual-orthographic information, to maintain multiple lexical-semantic representations in working memory and to combine existing representations while creatively constructing meaning. Copyright © 2015 Elsevier Ltd. All rights reserved.

Uniformity and nonuniformity of neural activities correlated to different insight problem solving.

PubMed

Zhao, Q; Li, Y; Shang, X; Zhou, Z; Han, L

2014-06-13

Previous studies on the neural basis of insight reflected weak consistency except for the anterior cingulate cortex. The present work adopted the semantic and homophonic punny riddle to explore the uniformity and nonuniformity of neural activities correlated to different insight problem solving. Results showed that in the early period of insight solving, the semantic and homophonic punny riddles induced a common N350-500 over the central scalp. However, during -400 to 0 ms before the riddles were solved, the semantic punny riddles induced a positive event-related potential (ERP) deflection over the temporal cortex for retrieving the extensive semantic information, while the homophonic punny riddles induced a positive ERP deflection over the temporal cortex and a negative one in the left frontal cortex which might reflect the semantic and phonological information processing respectively. Our study indicated that different insight problem solving should have the same cognitive process of detecting cognitive conflicts, but have different ways to solve the conflicts. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

Reversible Information Flow across the Medial Temporal Lobe: The Hippocampus Links Cortical Modules during Memory Retrieval

PubMed Central

Cooper, Elisa; Henson, Richard N.

2013-01-01

A simple cue can be sufficient to elicit vivid recollection of a past episode. Theoretical models suggest that upon perceiving such a cue, disparate episodic elements held in neocortex are retrieved through hippocampal pattern completion. We tested this fundamental assumption by applying functional magnetic resonance imaging (fMRI) while objects or scenes were used to cue participants' recall of previously paired scenes or objects, respectively. We first demonstrate functional segregation within the medial temporal lobe (MTL), showing domain specificity in perirhinal and parahippocampal cortices (for object-processing vs scene-processing, respectively), but domain generality in the hippocampus (retrieval of both stimulus types). Critically, using fMRI latency analysis and dynamic causal modeling, we go on to demonstrate functional integration between these MTL regions during successful memory retrieval, with reversible signal flow from the cue region to the target region via the hippocampus. This supports the claim that the human hippocampus provides the vital associative link that integrates information held in different parts of cortex. PMID:23986252

Effects of load and maintenance duration on the time course of information encoding and retrieval in working memory: from perceptual analysis to post-categorization processes.

PubMed

Pinal, Diego; Zurrón, Montserrat; Díaz, Fernando

2014-01-01

information encoding, maintenance, and retrieval; these are supported by brain activity in a network of frontal, parietal and temporal regions. Manipulation of WM load and duration of the maintenance period can modulate this activity. Although such modulations have been widely studied using the event-related potentials (ERP) technique, a precise description of the time course of brain activity during encoding and retrieval is still required. Here, we used this technique and principal component analysis to assess the time course of brain activity during encoding and retrieval in a delayed match to sample task. We also investigated the effects of memory load and duration of the maintenance period on ERP activity. Brain activity was similar during information encoding and retrieval and comprised six temporal factors, which closely matched the latency and scalp distribution of some ERP components: P1, N1, P2, N2, P300, and a slow wave. Changes in memory load modulated task performance and yielded variations in frontal lobe activation. Moreover, the P300 amplitude was smaller in the high than in the low load condition during encoding and retrieval. Conversely, the slow wave amplitude was higher in the high than in the low load condition during encoding, and the same was true for the N2 amplitude during retrieval. Thus, during encoding, memory load appears to modulate the processing resources for context updating and post-categorization processes, and during retrieval it modulates resources for stimulus classification and context updating. Besides, despite the lack of differences in task performance related to duration of the maintenance period, larger N2 amplitude and stronger activation of the left temporal lobe after long than after short maintenance periods were found during information retrieval. Thus, results regarding the duration of maintenance period were complex, and future work is required to test the time-based decay theory predictions.

The influence of monetary incentives on context processing in younger and older adults: an event-related potential study.

PubMed

Schmitt, Hannah; Ferdinand, Nicola K; Kray, Jutta

2015-06-01

Recent evidence has indicated that neuronal activity related to reward anticipation benefits subsequent stimulus processing, but the effect of penalties remains largely unknown. Since the dual-mechanisms-of-control theory (DMC; Braver & Barch, Neuroscience and Biobehavioral Reviews, 26, 809-81, 2002) assumes that temporal differences in context updating underlie age differences in cognitive control, in this study we investigated whether motivational cues (signaling the chance to win or the risk to lose money, relative to neutral cues) preceding context information in a modified AX-CPT paradigm influence the temporal stages of context processing in younger and older adults. In the behavioral data, younger adults benefited from gain cues, evident in their enhanced context updating, whereas older adults exhibited slowed responding after motivational cues, irrespective of valence. Event-related potentials (ERPs) revealed that the enhanced processing of motivational cues in the P2 and P3b was mainly age-invariant, whereas age-differential effects were found for the ERP correlates of context processing. Younger adults showed improved context maintenance (i.e., a larger negative-going CNV), as well as increased conflict detection (larger N450) and resolution (indicated by a sustained positivity), whenever incorrect responding would lead to a monetary loss. In contrast, motivationally salient cues benefited context representations (in cue-locked P3b amplitudes), but increased working memory demands during response preparation (via a temporally prolonged P3b) in older adults. In sum, motivational valence and salience effects differentially modulated the temporal stages of context processing in younger and older adults. These results are discussed in terms of the DMC theory, recent findings of emotion regulation in old age, and the relationship between cognitive and affective processing.

A multimodal approach to estimating vigilance using EEG and forehead EOG.

PubMed

Zheng, Wei-Long; Lu, Bao-Liang

2017-04-01

Covert aspects of ongoing user mental states provide key context information for user-aware human computer interactions. In this paper, we focus on the problem of estimating the vigilance of users using EEG and EOG signals. The PERCLOS index as vigilance annotation is obtained from eye tracking glasses. To improve the feasibility and wearability of vigilance estimation devices for real-world applications, we adopt a novel electrode placement for forehead EOG and extract various eye movement features, which contain the principal information of traditional EOG. We explore the effects of EEG from different brain areas and combine EEG and forehead EOG to leverage their complementary characteristics for vigilance estimation. Considering that the vigilance of users is a dynamic changing process because the intrinsic mental states of users involve temporal evolution, we introduce continuous conditional neural field and continuous conditional random field models to capture dynamic temporal dependency. We propose a multimodal approach to estimating vigilance by combining EEG and forehead EOG and incorporating the temporal dependency of vigilance into model training. The experimental results demonstrate that modality fusion can improve the performance compared with a single modality, EOG and EEG contain complementary information for vigilance estimation, and the temporal dependency-based models can enhance the performance of vigilance estimation. From the experimental results, we observe that theta and alpha frequency activities are increased, while gamma frequency activities are decreased in drowsy states in contrast to awake states. The forehead setup allows for the simultaneous collection of EEG and EOG and achieves comparative performance using only four shared electrodes in comparison with the temporal and posterior sites.

Explicit processing demands reveal language modality-specific organization of working memory.

PubMed

Rudner, Mary; Rönnberg, Jerker

2008-01-01

The working memory model for Ease of Language Understanding (ELU) predicts that processing differences between language modalities emerge when cognitive demands are explicit. This prediction was tested in three working memory experiments with participants who were Deaf Signers (DS), Hearing Signers (HS), or Hearing Nonsigners (HN). Easily nameable pictures were used as stimuli to avoid confounds relating to sensory modality. Performance was largely similar for DS, HS, and HN, suggesting that previously identified intermodal differences may be due to differences in retention of sensory information. When explicit processing demands were high, differences emerged between DS and HN, suggesting that although working memory storage in both groups is sensitive to temporal organization, retrieval is not sensitive to temporal organization in DS. A general effect of semantic similarity was also found. These findings are discussed in relation to the ELU model.

Auditory connections and functions of prefrontal cortex

PubMed Central

Plakke, Bethany; Romanski, Lizabeth M.

2014-01-01

The functional auditory system extends from the ears to the frontal lobes with successively more complex functions occurring as one ascends the hierarchy of the nervous system. Several areas of the frontal lobe receive afferents from both early and late auditory processing regions within the temporal lobe. Afferents from the early part of the cortical auditory system, the auditory belt cortex, which are presumed to carry information regarding auditory features of sounds, project to only a few prefrontal regions and are most dense in the ventrolateral prefrontal cortex (VLPFC). In contrast, projections from the parabelt and the rostral superior temporal gyrus (STG) most likely convey more complex information and target a larger, widespread region of the prefrontal cortex. Neuronal responses reflect these anatomical projections as some prefrontal neurons exhibit responses to features in acoustic stimuli, while other neurons display task-related responses. For example, recording studies in non-human primates indicate that VLPFC is responsive to complex sounds including vocalizations and that VLPFC neurons in area 12/47 respond to sounds with similar acoustic morphology. In contrast, neuronal responses during auditory working memory involve a wider region of the prefrontal cortex. In humans, the frontal lobe is involved in auditory detection, discrimination, and working memory. Past research suggests that dorsal and ventral subregions of the prefrontal cortex process different types of information with dorsal cortex processing spatial/visual information and ventral cortex processing non-spatial/auditory information. While this is apparent in the non-human primate and in some neuroimaging studies, most research in humans indicates that specific task conditions, stimuli or previous experience may bias the recruitment of specific prefrontal regions, suggesting a more flexible role for the frontal lobe during auditory cognition. PMID:25100931

The medial temporal lobe—conduit of parallel connectivity: a model for attention, memory, and perception

PubMed Central

Mozaffari, Brian

2014-01-01

Based on the notion that the brain is equipped with a hierarchical organization, which embodies environmental contingencies across many time scales, this paper suggests that the medial temporal lobe (MTL)—located deep in the hierarchy—serves as a bridge connecting supra- to infra—MTL levels. Bridging the upper and lower regions of the hierarchy provides a parallel architecture that optimizes information flow between upper and lower regions to aid attention, encoding, and processing of quick complex visual phenomenon. Bypassing intermediate hierarchy levels, information conveyed through the MTL “bridge” allows upper levels to make educated predictions about the prevailing context and accordingly select lower representations to increase the efficiency of predictive coding throughout the hierarchy. This selection or activation/deactivation is associated with endogenous attention. In the event that these “bridge” predictions are inaccurate, this architecture enables the rapid encoding of novel contingencies. A review of hierarchical models in relation to memory is provided along with a new theory, Medial-temporal-lobe Conduit for Parallel Connectivity (MCPC). In this scheme, consolidation is considered as a secondary process, occurring after a MTL-bridged connection, which eventually allows upper and lower levels to access each other directly. With repeated reactivations, as contingencies become consolidated, less MTL activity is predicted. Finally, MTL bridging may aid processing transient but structured perceptual events, by allowing communication between upper and lower levels without calling on intermediate levels of representation. PMID:25426036

Speech Synthesis Using Perceptually Motivated Features

DTIC Science & Technology

2012-01-23

with others a few years prior (with the concurrence of the project’s program manager. Willard Larkin). The Perceptual Flow of Phonetic Information and...34The Perceptual Flow of Phonetic Processing," consonant confusion matrices are analyzed for patterns of phonetic-feature decoding errors conditioned...decoding) is also observed. From these conditional probability patterns, it is proposed that they reflect a temporal flow of perceptual processing

Multi-pixel high-resolution three-dimensional imaging radar

NASA Technical Reports Server (NTRS)

Cooper, Ken B. (Inventor); Dengler, Robert J. (Inventor); Siegel, Peter H. (Inventor); Chattopadhyay, Goutam (Inventor); Ward, John S. (Inventor); Juan, Nuria Llombart (Inventor); Bryllert, Tomas E. (Inventor); Mehdi, Imran (Inventor); Tarsala, Jan A. (Inventor)

2012-01-01

A three-dimensional imaging radar operating at high frequency e.g., 670 GHz radar using low phase-noise synthesizers and a fast chirper to generate a frequency-modulated continuous-wave (FMCW) waveform, is disclosed that operates with a multiplexed beam to obtain range information simultaneously on multiple pixels of a target. A source transmit beam may be divided by a hybrid coupler into multiple transmit beams multiplexed together and directed to be reflected off a target and return as a single receive beam which is demultiplexed and processed to reveal range information of separate pixels of the target associated with each transmit beam simultaneously. The multiple transmit beams may be developed with appropriate optics to be temporally and spatially differentiated before being directed to the target. Temporal differentiation corresponds to a different intermediate frequencies separating the range information of the multiple pixels. Collinear transmit beams having differentiated polarizations may also be implemented.

Acoustic Signal Processing in Photorefractive Optical Systems.

NASA Astrophysics Data System (ADS)

Zhou, Gan

This thesis discusses applications of the photorefractive effect in the context of acoustic signal processing. The devices and systems presented here illustrate the ideas and optical principles involved in holographic processing of acoustic information. The interest in optical processing stems from the similarities between holographic optical systems and contemporary models for massively parallel computation, in particular, neural networks. An initial step in acoustic processing is the transformation of acoustic signals into relevant optical forms. A fiber-optic transducer with photorefractive readout transforms acoustic signals into optical images corresponding to their short-time spectrum. The device analyzes complex sound signals and interfaces them with conventional optical correlators. The transducer consists of 130 multimode optical fibers sampling the spectral range of 100 Hz to 5 kHz logarithmically. A physical model of the human cochlea can help us understand some characteristics of human acoustic transduction and signal representation. We construct a life-sized cochlear model using elastic membranes coupled with two fluid-filled chambers, and use a photorefractive novelty filter to investigate its response. The detection sensitivity is determined to be 0.3 angstroms per root Hz at 2 kHz. Qualitative agreement is found between the model response and physiological data. Delay lines map time-domain signals into space -domain and permit holographic processing of temporal information. A parallel optical delay line using dynamic beam coupling in a rotating photorefractive crystal is presented. We experimentally demonstrate a 64 channel device with 0.5 seconds of time-delay and 167 Hz bandwidth. Acoustic signal recognition is described in a photorefractive system implementing the time-delay neural network model. The system consists of a photorefractive optical delay-line and a holographic correlator programmed in a LiNbO_3 crystal. We demonstrate the recognition of synthesized chirps as well as spoken words. A photorefractive ring resonator containing an optical delay line can learn temporal information through self-organization. We experimentally investigate a system that learns by itself and picks out the most-frequently -presented signals from the input. We also give results demonstrating the separation of two orthogonal temporal signals into two competing ring resonators.

Spectral simplicity of apparent complexity. II. Exact complexities and complexity spectra

NASA Astrophysics Data System (ADS)

Riechers, Paul M.; Crutchfield, James P.

2018-03-01

The meromorphic functional calculus developed in Part I overcomes the nondiagonalizability of linear operators that arises often in the temporal evolution of complex systems and is generic to the metadynamics of predicting their behavior. Using the resulting spectral decomposition, we derive closed-form expressions for correlation functions, finite-length Shannon entropy-rate approximates, asymptotic entropy rate, excess entropy, transient information, transient and asymptotic state uncertainties, and synchronization information of stochastic processes generated by finite-state hidden Markov models. This introduces analytical tractability to investigating information processing in discrete-event stochastic processes, symbolic dynamics, and chaotic dynamical systems. Comparisons reveal mathematical similarities between complexity measures originally thought to capture distinct informational and computational properties. We also introduce a new kind of spectral analysis via coronal spectrograms and the frequency-dependent spectra of past-future mutual information. We analyze a number of examples to illustrate the methods, emphasizing processes with multivariate dependencies beyond pairwise correlation. This includes spectral decomposition calculations for one representative example in full detail.

Neurophysiological Basis of Multi-Scale Entropy of Brain Complexity and Its Relationship With Functional Connectivity.

PubMed

Wang, Danny J J; Jann, Kay; Fan, Chang; Qiao, Yang; Zang, Yu-Feng; Lu, Hanbing; Yang, Yihong

2018-01-01

Recently, non-linear statistical measures such as multi-scale entropy (MSE) have been introduced as indices of the complexity of electrophysiology and fMRI time-series across multiple time scales. In this work, we investigated the neurophysiological underpinnings of complexity (MSE) of electrophysiology and fMRI signals and their relations to functional connectivity (FC). MSE and FC analyses were performed on simulated data using neural mass model based brain network model with the Brain Dynamics Toolbox, on animal models with concurrent recording of fMRI and electrophysiology in conjunction with pharmacological manipulations, and on resting-state fMRI data from the Human Connectome Project. Our results show that the complexity of regional electrophysiology and fMRI signals is positively correlated with network FC. The associations between MSE and FC are dependent on the temporal scales or frequencies, with higher associations between MSE and FC at lower temporal frequencies. Our results from theoretical modeling, animal experiment and human fMRI indicate that (1) Regional neural complexity and network FC may be two related aspects of brain's information processing: the more complex regional neural activity, the higher FC this region has with other brain regions; (2) MSE at high and low frequencies may represent local and distributed information processing across brain regions. Based on literature and our data, we propose that the complexity of regional neural signals may serve as an index of the brain's capacity of information processing-increased complexity may indicate greater transition or exploration between different states of brain networks, thereby a greater propensity for information processing.

Towards a Generalizable Time Expression Model for Temporal Reasoning in Clinical Notes

PubMed Central

Velupillai, Sumithra; Mowery, Danielle L.; Abdelrahman, Samir; Christensen, Lee; Chapman, Wendy W

2015-01-01

Accurate temporal identification and normalization is imperative for many biomedical and clinical tasks such as generating timelines and identifying phenotypes. A major natural language processing challenge is developing and evaluating a generalizable temporal modeling approach that performs well across corpora and institutions. Our long-term goal is to create such a model. We initiate our work on reaching this goal by focusing on temporal expression (TIMEX3) identification. We present a systematic approach to 1) generalize existing solutions for automated TIMEX3 span detection, and 2) assess similarities and differences by various instantiations of TIMEX3 models applied on separate clinical corpora. When evaluated on the 2012 i2b2 and the 2015 Clinical TempEval challenge corpora, our conclusion is that our approach is successful – we achieve competitive results for automated classification, and we identify similarities and differences in TIMEX3 modeling that will be informative in the development of a simplified, general temporal model. PMID:26958265

tOWL: a temporal Web Ontology Language.

PubMed

Milea, Viorel; Frasincar, Flavius; Kaymak, Uzay

2012-02-01

Through its interoperability and reasoning capabilities, the Semantic Web opens a realm of possibilities for developing intelligent systems on the Web. The Web Ontology Language (OWL) is the most expressive standard language for modeling ontologies, the cornerstone of the Semantic Web. However, up until now, no standard way of expressing time and time-dependent information in OWL has been provided. In this paper, we present a temporal extension of the very expressive fragment SHIN(D) of the OWL Description Logic language, resulting in the temporal OWL language. Through a layered approach, we introduce three extensions: 1) concrete domains, which allow the representation of restrictions using concrete domain binary predicates; 2) temporal representation , which introduces time points, relations between time points, intervals, and Allen's 13 interval relations into the language; and 3) timeslices/fluents, which implement a perdurantist view on individuals and allow for the representation of complex temporal aspects, such as process state transitions. We illustrate the expressiveness of the newly introduced language by using an example from the financial domain.

Memory and betweenness preference in temporal networks induced from time series

NASA Astrophysics Data System (ADS)

Weng, Tongfeng; Zhang, Jie; Small, Michael; Zheng, Rui; Hui, Pan

2017-02-01

We construct temporal networks from time series via unfolding the temporal information into an additional topological dimension of the networks. Thus, we are able to introduce memory entropy analysis to unravel the memory effect within the considered signal. We find distinct patterns in the entropy growth rate of the aggregate network at different memory scales for time series with different dynamics ranging from white noise, 1/f noise, autoregressive process, periodic to chaotic dynamics. Interestingly, for a chaotic time series, an exponential scaling emerges in the memory entropy analysis. We demonstrate that the memory exponent can successfully characterize bifurcation phenomenon, and differentiate the human cardiac system in healthy and pathological states. Moreover, we show that the betweenness preference analysis of these temporal networks can further characterize dynamical systems and separate distinct electrocardiogram recordings. Our work explores the memory effect and betweenness preference in temporal networks constructed from time series data, providing a new perspective to understand the underlying dynamical systems.

Effects of temporal correlations in social multiplex networks.

PubMed

Starnini, Michele; Baronchelli, Andrea; Pastor-Satorras, Romualdo

2017-08-17

Multi-layered networks represent a major advance in the description of natural complex systems, and their study has shed light on new physical phenomena. Despite its importance, however, the role of the temporal dimension in their structure and function has not been investigated in much detail so far. Here we study the temporal correlations between layers exhibited by real social multiplex networks. At a basic level, the presence of such correlations implies a certain degree of predictability in the contact pattern, as we quantify by an extension of the entropy and mutual information analyses proposed for the single-layer case. At a different level, we demonstrate that temporal correlations are a signature of a 'multitasking' behavior of network agents, characterized by a higher level of switching between different social activities than expected in a uncorrelated pattern. Moreover, temporal correlations significantly affect the dynamics of coupled epidemic processes unfolding on the network. Our work opens the way for the systematic study of temporal multiplex networks and we anticipate it will be of interest to researchers in a broad array of fields.

Dynamic frontotemporal systems process space and time in working memory

PubMed Central

Adams, Jenna N.; Solbakk, Anne-Kristin; Endestad, Tor; Larsson, Pål G.; Ivanovic, Jugoslav; Meling, Torstein R.; Lin, Jack J.; Knight, Robert T.

2018-01-01

How do we rapidly process incoming streams of information in working memory, a cognitive mechanism central to human behavior? Dominant views of working memory focus on the prefrontal cortex (PFC), but human hippocampal recordings provide a neurophysiological signature distinct from the PFC. Are these regions independent, or do they interact in the service of working memory? We addressed this core issue in behavior by recording directly from frontotemporal sites in humans performing a visuospatial working memory task that operationalizes the types of identity and spatiotemporal information we encounter every day. Theta band oscillations drove bidirectional interactions between the PFC and medial temporal lobe (MTL; including the hippocampus). MTL theta oscillations directed the PFC preferentially during the processing of spatiotemporal information, while PFC theta oscillations directed the MTL for all types of information being processed in working memory. These findings reveal an MTL theta mechanism for processing space and time and a domain-general PFC theta mechanism, providing evidence that rapid, dynamic MTL–PFC interactions underlie working memory for everyday experiences. PMID:29601574

T-complex measures in bilingual Spanish-English and Turkish-German children and monolingual peers.

PubMed

Rinker, Tanja; Shafer, Valerie L; Kiefer, Markus; Vidal, Nancy; Yu, Yan H

2017-01-01

Lateral temporal neural measures (Na and T-complex Ta and Tb) of the auditory evoked potential (AEP) index maturation of auditory/speech processing. These measures are also sensitive to language experience in adults. This paper examined neural responses to a vowel sound at temporal electrodes in four- to five-year-old Spanish-English bilinguals and English monolinguals and in five- to six-year-old Turkish-German bilinguals and German monolinguals. The goal was to determine whether obligatory AEPs at temporal electrode sites were modulated by language experience. Language experience was defined in terms of monolingual versus bilingual status as well as the amount and quality of the bilingual language experience. AEPs were recorded at left and right temporal electrode sites to a 250-ms vowel [Ɛ] from 20 monolingual (American)-English and 18 Spanish-English children from New York City, and from 11 Turkish-German and 13 monolingual German children from Ulm, Germany. Language background information and standardized verbal and non-verbal test scores were obtained for the children. The results revealed differences in temporal AEPs (Na and Ta of the T-complex) between monolingual and bilingual children. Specifically, bilingual children showed smaller and/or later peak amplitudes than the monolingual groups. Ta-amplitude distinguished monolingual and bilingual children best at right electrode sites for both the German and American groups. Amount of experience and type of experience with the target language (English and German) influenced processing. The finding of reduced amplitudes at the Ta latency for bilingual compared to monolingual children indicates that language specific experience, and not simply maturational factors, influences development of the neural processes underlying the Ta AEP, and suggests that lateral temporal cortex has an important role in language-specific speech perception development.

T-complex measures in bilingual Spanish-English and Turkish-German children and monolingual peers

PubMed Central

Rinker, Tanja; Shafer, Valerie L.; Kiefer, Markus; Vidal, Nancy; Yu, Yan H.

2017-01-01

Background Lateral temporal neural measures (Na and T-complex Ta and Tb) of the auditory evoked potential (AEP) index maturation of auditory/speech processing. These measures are also sensitive to language experience in adults. This paper examined neural responses to a vowel sound at temporal electrodes in four- to five-year-old Spanish-English bilinguals and English monolinguals and in five- to six-year-old Turkish-German bilinguals and German monolinguals. The goal was to determine whether obligatory AEPs at temporal electrode sites were modulated by language experience. Language experience was defined in terms of monolingual versus bilingual status as well as the amount and quality of the bilingual language experience. Method AEPs were recorded at left and right temporal electrode sites to a 250-ms vowel [Ɛ] from 20 monolingual (American)-English and 18 Spanish-English children from New York City, and from 11 Turkish-German and 13 monolingual German children from Ulm, Germany. Language background information and standardized verbal and non-verbal test scores were obtained for the children. Results The results revealed differences in temporal AEPs (Na and Ta of the T-complex) between monolingual and bilingual children. Specifically, bilingual children showed smaller and/or later peak amplitudes than the monolingual groups. Ta-amplitude distinguished monolingual and bilingual children best at right electrode sites for both the German and American groups. Amount of experience and type of experience with the target language (English and German) influenced processing. Conclusions The finding of reduced amplitudes at the Ta latency for bilingual compared to monolingual children indicates that language specific experience, and not simply maturational factors, influences development of the neural processes underlying the Ta AEP, and suggests that lateral temporal cortex has an important role in language-specific speech perception development. PMID:28267801

Fast depth decision for HEVC inter prediction based on spatial and temporal correlation

NASA Astrophysics Data System (ADS)

Chen, Gaoxing; Liu, Zhenyu; Ikenaga, Takeshi

2016-07-01

High efficiency video coding (HEVC) is a video compression standard that outperforms the predecessor H.264/AVC by doubling the compression efficiency. To enhance the compression accuracy, the partition sizes ranging is from 4x4 to 64x64 in HEVC. However, the manifold partition sizes dramatically increase the encoding complexity. This paper proposes a fast depth decision based on spatial and temporal correlation. Spatial correlation utilize the code tree unit (CTU) Splitting information and temporal correlation utilize the motion vector predictor represented CTU in inter prediction to determine the maximum depth in each CTU. Experimental results show that the proposed method saves about 29.1% of the original processing time with 0.9% of BD-bitrate increase on average.

Toward a neurobiology of temporal cognition: advances and challenges.

PubMed

Gibbon, J; Malapani, C; Dale, C L; Gallistel, C

1997-04-01

A rich tradition of normative psychophysics has identified two ubiquitous properties of interval timing: the scalar property, a strong form of Weber's law, and ratio comparison mechanisms. Finding the neural substrate of these properties is a major challenge for neurobiology. Recently, advances have been made in our understanding of the brain structures important for timing, especially the basal ganglia and the cerebellum. Surgical intervention or diseases of the cerebellum generally result in increased variability in temporal processing, whereas both clock and memory effects are seen for neurotransmitter interventions, lesions and diseases of the basal ganglia. We propose that cerebellar dysfunction may induce deregulation of tonic thalamic tuning, which disrupts gating of the mnemonic temporal information generated in the basal ganglia through striato-thalamo-cortical loops.

Sensitivity to timing and order in human visual cortex

PubMed Central

Singer, Jedediah M.; Madsen, Joseph R.; Anderson, William S.

2014-01-01

Visual recognition takes a small fraction of a second and relies on the cascade of signals along the ventral visual stream. Given the rapid path through multiple processing steps between photoreceptors and higher visual areas, information must progress from stage to stage very quickly. This rapid progression of information suggests that fine temporal details of the neural response may be important to the brain's encoding of visual signals. We investigated how changes in the relative timing of incoming visual stimulation affect the representation of object information by recording intracranial field potentials along the human ventral visual stream while subjects recognized objects whose parts were presented with varying asynchrony. Visual responses along the ventral stream were sensitive to timing differences as small as 17 ms between parts. In particular, there was a strong dependency on the temporal order of stimulus presentation, even at short asynchronies. From these observations we infer that the neural representation of complex information in visual cortex can be modulated by rapid dynamics on scales of tens of milliseconds. PMID:25429116

The Involvement of Speed-of-Processing in Story Listening in Preschool Children: A Functional and Structural Connectivity Study.

PubMed

Horowitz-Kraus, Tzipi; Farah, Rola; DiFrancesco, Mark; Vannest, Jennifer

2017-02-01

Story listening in children relies on brain regions supporting speech perception, auditory word recognition, syntax, semantics, and discourse abilities, along with the ability to attend and process information (part of executive functions). Speed-of-processing is an early-developed executive function. We used functional and structural magnetic resonance imaging (MRI) to demonstrate the relationship between story listening and speed-of-processing in preschool-age children. Eighteen participants performed story-listening tasks during MRI scans. Functional and structural connectivity analysis was performed using the speed-of-processing scores as regressors. Activation in the superior frontal gyrus during story listening positively correlated with speed-of-processing scores. This region was functionally connected with the superior temporal gyrus, insula, and hippocampus. Fractional anisotropy in the inferior frontooccipital fasciculus, which connects the superior frontal and temporal gyri, was positively correlated with speed-of-processing scores. Our results suggest that speed-of-processing skills in preschool-age children are reflected in functional activation and connectivity during story listening and may act as a biomarker for future academic abilities. Georg Thieme Verlag KG Stuttgart · New York.

Biogeochemical Processes in Microbial Ecosystems

NASA Technical Reports Server (NTRS)

DesMarais, David J.

2001-01-01

The hierarchical organization of microbial ecosystems determines process rates that shape Earth's environment, create the biomarker sedimentary and atmospheric signatures of life, and define the stage upon which major evolutionary events occurred. In order to understand how microorganisms have shaped the global environment of Earth and, potentially, other worlds, we must develop an experimental paradigm that links biogeochemical processes with ever-changing temporal and spatial distributions of microbial populations and their metabolic properties. Additional information is contained in the original extended abstract.

The Effect of Congenital Deafness on Duration Judgment

ERIC Educational Resources Information Center

Kowalska, Joanna; Szelag, Elzbieta

2006-01-01

Objective: Congenital deafness provides the opportunity to study how atypical sensory and language experiences affect different aspects of information processing, e.g., time perception. Methods: Using two methods of temporal estimation, reproduction (Exp. 1) and production (Exp. 2), the effect of deafness on duration judgment was investigated…

Species-specific calls evoke asymmetric activity in the monkey's temporal poles.

PubMed

Poremba, Amy; Malloy, Megan; Saunders, Richard C; Carson, Richard E; Herscovitch, Peter; Mishkin, Mortimer

2004-01-29

It has often been proposed that the vocal calls of monkeys are precursors of human speech, in part because they provide critical information to other members of the species who rely on them for survival and social interactions. Both behavioural and lesion studies suggest that monkeys, like humans, use the auditory system of the left hemisphere preferentially to process vocalizations. To investigate the pattern of neural activity that might underlie this particular form of functional asymmetry in monkeys, we measured local cerebral metabolic activity while the animals listened passively to species-specific calls compared with a variety of other classes of sound. Within the superior temporal gyrus, significantly greater metabolic activity occurred on the left side than on the right, only in the region of the temporal pole and only in response to monkey calls. This functional asymmetry was absent when these regions were separated by forebrain commissurotomy, suggesting that the perception of vocalizations elicits concurrent interhemispheric interactions that focus the auditory processing within a specialized area of one hemisphere.

Temporal shaping of quantum states released from a superconducting cavity memory

NASA Astrophysics Data System (ADS)

Burkhart, L.; Axline, C.; Pfaff, W.; Zou, C.; Zhang, M.; Narla, A.; Frunzio, L.; Devoret, M. H.; Jiang, L.; Schoelkopf, R. J.

State transfer and entanglement distribution are essential primitives in network-based quantum information processing. We have previously demonstrated an interface between a quantum memory and propagating light fields in the microwave domain: by parametric conversion in a single Josephson junction, we have coherently released quantum states from a superconducting cavity resonator into a transmission line. Protocols for state transfer mediated by propagating fields typically rely on temporal mode-matching of couplings at both sender and receiver. However, parametric driving on a single junction results in dynamic frequency shifts, raising the question of whether the pumps alone provide enough control for achieving this mode-matching. We show, in theory and experiment, that phase and amplitude shaping of the parametric drives allows arbitrary control over the propagating field, limited only by the drives bandwidth and amplitude constraints. This temporal mode shaping technique allows for release and capture of quantum states, providing a credible route towards state transfer and entanglement generation in quantum networks in which quantum states are stored and processed in cavities.

Temporal Context in Speech Processing and Attentional Stream Selection: A Behavioral and Neural perspective

PubMed Central

Zion Golumbic, Elana M.; Poeppel, David; Schroeder, Charles E.

2012-01-01

The human capacity for processing speech is remarkable, especially given that information in speech unfolds over multiple time scales concurrently. Similarly notable is our ability to filter out of extraneous sounds and focus our attention on one conversation, epitomized by the ‘Cocktail Party’ effect. Yet, the neural mechanisms underlying on-line speech decoding and attentional stream selection are not well understood. We review findings from behavioral and neurophysiological investigations that underscore the importance of the temporal structure of speech for achieving these perceptual feats. We discuss the hypothesis that entrainment of ambient neuronal oscillations to speech’s temporal structure, across multiple time-scales, serves to facilitate its decoding and underlies the selection of an attended speech stream over other competing input. In this regard, speech decoding and attentional stream selection are examples of ‘active sensing’, emphasizing an interaction between proactive and predictive top-down modulation of neuronal dynamics and bottom-up sensory input. PMID:22285024

Anatomy is strategy: Skilled reading differences associated with structural connectivity differences in the reading network

PubMed Central

Graves, William W.; Binder, Jeffrey R.; Desai, Rutvik H.; Humphries, Colin; Stengel, Benjamin C.; Seidenberg, Mark S.

2014-01-01

Are there multiple ways to be a skilled reader? To address this longstanding, unresolved question, we hypothesized that individual variability in using semantic information in reading aloud would be associated with neuroanatomical variation in pathways linking semantics and phonology. Left-hemisphere regions of interest for diffusion tensor imaging analysis were defined based on fMRI results, including two regions linked with semantic processing – angular gyrus (AG) and inferior temporal sulcus (ITS) – and two linked with phonological processing – posterior superior temporal gyrus (pSTG) and posterior middle temporal gyrus (pMTG). Effects of imageability (a semantic measure) on response times varied widely among individuals and covaried with the volume of pathways through the ITS and pMTG, and through AG and pSTG, partially overlapping the inferior longitudinal fasciculus and the posterior branch of the arcuate fasciculus. These results suggest strategy differences among skilled readers associated with structural variation in the neural reading network. PMID:24735993

Mindfulness meditation and relaxation training increases time sensitivity.

PubMed

Droit-Volet, S; Fanget, M; Dambrun, M

2015-01-01

Two experiments examined the effect of mindfulness meditation and relaxation on time perception using a temporal bisection task. In Experiment 1, the participants performed a temporal task before and after exercises of mindfulness meditation or relaxation. In Experiment 2, the procedure was similar than that used in Experiment 1, except that the participants were trained to mediate or relax every day over a period of several weeks. The results showed that mindfulness meditation exercises increased sensitivity to time and lengthened perceived time. However, this temporal improvement with meditation exercises was primarily observed in the experienced meditators. Our results also showed the experienced meditators were less anxious than the novice participants, and that the sensitivity to time increased when the level of anxiety decreased. Our results were explained by the practice of mindfulness technique that had developed individuals' abilities in devoting more attention resources to temporal information processing. Copyright © 2014 Elsevier Inc. All rights reserved.

Entropy of Movement Outcome in Space-Time.

PubMed

Lai, Shih-Chiung; Hsieh, Tsung-Yu; Newell, Karl M

2015-07-01

Information entropy of the joint spatial and temporal (space-time) probability of discrete movement outcome was investigated in two experiments as a function of different movement strategies (space-time, space, and time instructional emphases), task goals (point-aiming and target-aiming) and movement speed-accuracy constraints. The variance of the movement spatial and temporal errors was reduced by instructional emphasis on the respective spatial or temporal dimension, but increased on the other dimension. The space-time entropy was lower in targetaiming task than the point aiming task but did not differ between instructional emphases. However, the joint probabilistic measure of spatial and temporal entropy showed that spatial error is traded for timing error in tasks with space-time criteria and that the pattern of movement error depends on the dimension of the measurement process. The unified entropy measure of movement outcome in space-time reveals a new relation for the speed-accuracy.

How does temporal preparation speed up response implementation in choice tasks? Evidence for an early cortical activation.

PubMed

Tandonnet, Christophe; Davranche, Karen; Meynier, Chloé; Burle, Borís; Vidal, Franck; Hasbroucq, Thierry

2012-02-01

We investigated the influence of temporal preparation on information processing. Single-pulse transcranial magnetic stimulation (TMS) of the primary motor cortex was delivered during a between-hand choice task. The time interval between the warning and the imperative stimulus varied across blocks of trials was either optimal (500 ms) or nonoptimal (2500 ms) for participants' performance. Silent period duration was shorter prior to the first evidence of response selection for the optimal condition. Amplitude of the motor evoked potential specific to the responding hand increased earlier for the optimal condition. These results revealed an early release of cortical inhibition and a faster integration of the response selection-related inputs to the corticospinal pathway when temporal preparation is better. Temporal preparation may induce cortical activation prior to response selection that speeds up the implementation of the selected response. Copyright © 2011 Society for Psychophysiological Research.

Adaptive coupling optimized spiking coherence and synchronization in Newman-Watts neuronal networks

NASA Astrophysics Data System (ADS)

Gong, Yubing; Xu, Bo; Wu, Ya'nan

2013-09-01

In this paper, we have numerically studied the effect of adaptive coupling on the temporal coherence and synchronization of spiking activity in Newman-Watts Hodgkin-Huxley neuronal networks. It is found that random shortcuts can enhance the spiking synchronization more rapidly when the increment speed of adaptive coupling is increased and can optimize the temporal coherence of spikes only when the increment speed of adaptive coupling is appropriate. It is also found that adaptive coupling strength can enhance the synchronization of spikes and can optimize the temporal coherence of spikes when random shortcuts are appropriate. These results show that adaptive coupling has a big influence on random shortcuts related spiking activity and can enhance and optimize the temporal coherence and synchronization of spiking activity of the network. These findings can help better understand the roles of adaptive coupling for improving the information processing and transmission in neural systems.

Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence

PubMed Central

Cichy, Radoslaw Martin; Khosla, Aditya; Pantazis, Dimitrios; Torralba, Antonio; Oliva, Aude

2016-01-01

The complex multi-stage architecture of cortical visual pathways provides the neural basis for efficient visual object recognition in humans. However, the stage-wise computations therein remain poorly understood. Here, we compared temporal (magnetoencephalography) and spatial (functional MRI) visual brain representations with representations in an artificial deep neural network (DNN) tuned to the statistics of real-world visual recognition. We showed that the DNN captured the stages of human visual processing in both time and space from early visual areas towards the dorsal and ventral streams. Further investigation of crucial DNN parameters revealed that while model architecture was important, training on real-world categorization was necessary to enforce spatio-temporal hierarchical relationships with the brain. Together our results provide an algorithmically informed view on the spatio-temporal dynamics of visual object recognition in the human visual brain. PMID:27282108

Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence.

PubMed

Cichy, Radoslaw Martin; Khosla, Aditya; Pantazis, Dimitrios; Torralba, Antonio; Oliva, Aude

2016-06-10

The complex multi-stage architecture of cortical visual pathways provides the neural basis for efficient visual object recognition in humans. However, the stage-wise computations therein remain poorly understood. Here, we compared temporal (magnetoencephalography) and spatial (functional MRI) visual brain representations with representations in an artificial deep neural network (DNN) tuned to the statistics of real-world visual recognition. We showed that the DNN captured the stages of human visual processing in both time and space from early visual areas towards the dorsal and ventral streams. Further investigation of crucial DNN parameters revealed that while model architecture was important, training on real-world categorization was necessary to enforce spatio-temporal hierarchical relationships with the brain. Together our results provide an algorithmically informed view on the spatio-temporal dynamics of visual object recognition in the human visual brain.

Differential involvement of the posterior temporal cortex in mentalizing but not perspective taking

PubMed Central

Aumann, Carolin; Santos, Natacha S.; Bewernick, Bettina H.; Eickhoff, Simon B.; Newen, Albert; Shah, N. Jon; Fink, Gereon R.; Vogeley, Kai

2008-01-01

Understanding and predicting other people's mental states and behavior are important prerequisites for social interactions. The capacity to attribute mental states such as desires, thoughts or intentions to oneself or others is referred to as mentalizing. The right posterior temporal cortex at the temporal–parietal junction has been associated with mentalizing but also with taking someone else's spatial perspective onto the world—possibly an important prerequisite for mentalizing. Here, we directly compared the neural correlates of mentalizing and perspective taking using the same stimulus material. We found significantly increased neural activity in the right posterior segment of the superior temporal sulcus only during mentalizing but not perspective taking. Our data further clarify the role of the posterior temporal cortex in social cognition by showing that it is involved in processing information from socially salient visual cues in situations that require the inference about other people's mental states. PMID:19015120

Constructing Social Networks from Unstructured Group Dialog in Virtual Worlds

NASA Astrophysics Data System (ADS)

Shah, Fahad; Sukthankar, Gita

Virtual worlds and massively multi-player online games are rich sources of information about large-scale teams and groups, offering the tantalizing possibility of harvesting data about group formation, social networks, and network evolution. However these environments lack many of the cues that facilitate natural language processing in other conversational settings and different types of social media. Public chat data often features players who speak simultaneously, use jargon and emoticons, and only erratically adhere to conversational norms. In this paper, we present techniques for inferring the existence of social links from unstructured conversational data collected from groups of participants in the Second Life virtual world. We present an algorithm for addressing this problem, Shallow Semantic Temporal Overlap (SSTO), that combines temporal and language information to create directional links between participants, and a second approach that relies on temporal overlap alone to create undirected links between participants. Relying on temporal overlap is noisy, resulting in a low precision and networks with many extraneous links. In this paper, we demonstrate that we can ameliorate this problem by using network modularity optimization to perform community detection in the noisy networks and severing cross-community links. Although using the content of the communications still results in the best performance, community detection is effective as a noise reduction technique for eliminating the extra links created by temporal overlap alone.

Synthetic Aperture Radar (SAR)-based paddy rice monitoring system: Development and application in key rice producing areas in Tropical Asia

NASA Astrophysics Data System (ADS)

Setiyono, T. D.; Holecz, F.; Khan, N. I.; Barbieri, M.; Quicho, E.; Collivignarelli, F.; Maunahan, A.; Gatti, L.; Romuga, G. C.

2017-01-01

Reliable and regular rice information is essential part of many countries’ national accounting process but the existing system may not be sufficient to meet the information demand in the context of food security and policy. Synthetic Aperture Radar (SAR) imagery is highly suitable for detecting lowland paddy rice, especially in tropical region where pervasive cloud cover in the rainy seasons limits the use of optical imagery. This study uses multi-temporal X-band and C-band SAR imagery, automated image processing, rule-based classification and field observations to classify rice in multiple locations across Tropical Asia and assimilate the information into ORYZA Crop Growth Simulation model (CGSM) to generate high resolution yield maps. The resulting cultivated rice area maps had classification accuracies above 85% and yield estimates were within 81-93% agreement against district level reported yields. The study sites capture much of the diversity in water management, crop establishment and rice maturity durations and the study demonstrates the feasibility of rice detection, yield monitoring, and damage assessment in case of climate disaster at national and supra-national scales using multi-temporal SAR imagery combined with CGSM and automated methods.

Evaluation and comparison of methods to estimate irrigation withdrawal for the National Water Census Focus Area Study of the Apalachicola-Chattahoochee-Flint River Basin in southwestern Georgia

USGS Publications Warehouse

Painter, Jaime A.; Torak, Lynn J.; Jones, John W.

2015-09-30

Methods to estimate irrigation withdrawal using nationally available datasets and techniques that are transferable to other agricultural regions were evaluated by the U.S. Geological Survey as part of the Apalachicola-Chattahoochee-Flint (ACF) River Basin focus area study of the National Water Census (ACF–FAS). These methods investigated the spatial, temporal, and quantitative distributions of water withdrawal for irrigation in the southwestern Georgia region of the ACF–FAS, filling a vital need to inform science-based decisions regarding resource management and conservation. The crop– demand method assumed that only enough water is pumped onto a crop to satisfy the deficit between evapotranspiration and precipitation. A second method applied a geostatistical regimen of variography and conditional simulation to monthly metered irrigation withdrawal to estimate irrigation withdrawal where data do not exist. A third method analyzed Landsat satellite imagery using an automated approach to generate monthly estimates of irrigated lands. These methods were evaluated independently and compared collectively with measured water withdrawal information available in the Georgia part of the ACF–FAS, principally in the Chattahoochee-Flint River Basin. An assessment of each method’s contribution to the National Water Census program was also made to identify transfer value of the methods to the national program and other water census studies. None of the three methods evaluated represent a turnkey process to estimate irrigation withdrawal on any spatial (local or regional) or temporal (monthly or annual) extent. Each method requires additional information on agricultural practices during the growing season to complete the withdrawal estimation process. Spatial and temporal limitations inherent in identifying irrigated acres during the growing season, and in designing spatially and temporally representative monitor (meter) networks, can belie the ability of the methods to produce accurate irrigation-withdrawal estimates that can be used to produce dependable and consistent assessments of water availability and use for the National Water Census. Emerging satellite-data products and techniques for data analysis can generate high spatial-resolution estimates of irrigated-acres distributions with near-term temporal frequencies compatible with the needs of the ACF–FAS and the National Water Census.

Clustering the lexicon in the brain: a meta-analysis of the neurofunctional evidence on noun and verb processing

PubMed Central

Crepaldi, Davide; Berlingeri, Manuela; Cattinelli, Isabella; Borghese, Nunzio A.; Luzzatti, Claudio; Paulesu, Eraldo

2013-01-01

Although it is widely accepted that nouns and verbs are functionally independent linguistic entities, it is less clear whether their processing recruits different brain areas. This issue is particularly relevant for those theories of lexical semantics (and, more in general, of cognition) that suggest the embodiment of abstract concepts, i.e., based strongly on perceptual and motoric representations. This paper presents a formal meta-analysis of the neuroimaging evidence on noun and verb processing in order to address this dichotomy more effectively at the anatomical level. We used a hierarchical clustering algorithm that grouped fMRI/PET activation peaks solely on the basis of spatial proximity. Cluster specificity for grammatical class was then tested on the basis of the noun-verb distribution of the activation peaks included in each cluster. Thirty-two clusters were identified: three were associated with nouns across different tasks (in the right inferior temporal gyrus, the left angular gyrus, and the left inferior parietal gyrus); one with verbs across different tasks (in the posterior part of the right middle temporal gyrus); and three showed verb specificity in some tasks and noun specificity in others (in the left and right inferior frontal gyrus and the left insula). These results do not support the popular tenets that verb processing is predominantly based in the left frontal cortex and noun processing relies specifically on temporal regions; nor do they support the idea that verb lexical-semantic representations are heavily based on embodied motoric information. Our findings suggest instead that the cerebral circuits deputed to noun and verb processing lie in close spatial proximity in a wide network including frontal, parietal, and temporal regions. The data also indicate a predominant—but not exclusive—left lateralization of the network. PMID:23825451

Dynamic speech representations in the human temporal lobe.

PubMed

Leonard, Matthew K; Chang, Edward F

2014-09-01

Speech perception requires rapid integration of acoustic input with context-dependent knowledge. Recent methodological advances have allowed researchers to identify underlying information representations in primary and secondary auditory cortex and to examine how context modulates these representations. We review recent studies that focus on contextual modulations of neural activity in the superior temporal gyrus (STG), a major hub for spectrotemporal encoding. Recent findings suggest a highly interactive flow of information processing through the auditory ventral stream, including influences of higher-level linguistic and metalinguistic knowledge, even within individual areas. Such mechanisms may give rise to more abstract representations, such as those for words. We discuss the importance of characterizing representations of context-dependent and dynamic patterns of neural activity in the approach to speech perception research. Copyright © 2014 Elsevier Ltd. All rights reserved.

Spectro-temporal cues enhance modulation sensitivity in cochlear implant users

PubMed Central

Zheng, Yi; Escabí, Monty; Litovsky, Ruth Y.

2018-01-01

Although speech understanding is highly variable amongst cochlear implants (CIs) subjects, the remarkably high speech recognition performance of many CI users is unexpected and not well understood. Numerous factors, including neural health and degradation of the spectral information in the speech signal of CIs, likely contribute to speech understanding. We studied the ability to use spectro-temporal modulations, which may be critical for speech understanding and discrimination, and hypothesize that CI users adopt a different perceptual strategy than normal-hearing (NH) individuals, whereby they rely more heavily on joint spectro-temporal cues to enhance detection of auditory cues. Modulation detection sensitivity was studied in CI users and NH subjects using broadband “ripple” stimuli that were modulated spectrally, temporally, or jointly, i.e., spectro-temporally. The spectro-temporal modulation transfer functions of CI users and NH subjects was decomposed into spectral and temporal dimensions and compared to those subjects’ spectral-only and temporal-only modulation transfer functions. In CI users, the joint spectro-temporal sensitivity was better than that predicted by spectral-only and temporal-only sensitivity, indicating a heightened spectro-temporal sensitivity. Such an enhancement through the combined integration of spectral and temporal cues was not observed in NH subjects. The unique use of spectro-temporal cues by CI patients can yield benefits for use of cues that are important for speech understanding. This finding has implications for developing sound processing strategies that may rely on joint spectro-temporal modulations to improve speech comprehension of CI users, and the findings of this study may be valuable for developing clinical assessment tools to optimize CI processor performance. PMID:28601530

Breaking down barriers in cooperative fault management: Temporal and functional information displays

NASA Technical Reports Server (NTRS)

Potter, Scott S.; Woods, David D.

1994-01-01

At the highest level, the fundamental question addressed by this research is how to aid human operators engaged in dynamic fault management. In dynamic fault management there is some underlying dynamic process (an engineered or physiological process referred to as the monitored process - MP) whose state changes over time and whose behavior must be monitored and controlled. In these types of applications (dynamic, real-time systems), a vast array of sensor data is available to provide information on the state of the MP. Faults disturb the MP and diagnosis must be performed in parallel with responses to maintain process integrity and to correct the underlying problem. These situations frequently involve time pressure, multiple interacting goals, high consequences of failure, and multiple interleaved tasks.

IDEF3 formalization report

NASA Technical Reports Server (NTRS)

Menzel, Christopher; Mayer, Richard J.; Edwards, Douglas D.

1991-01-01

The Process Description Capture Method (IDEF3) is one of several Integrated Computer-Aided Manufacturing (ICAM) DEFinition methods developed by the Air Force to support systems engineering activities, and in particular, to support information systems development. These methods have evolved as a distillation of 'good practice' experience by information system developers and are designed to raise the performance level of the novice practitioner to one comparable with that of an expert. IDEF3 is meant to serve as a knowledge acquisition and requirements definition tool that structures the user's understanding of how a given process, event, or system works around process descriptions. A special purpose graphical language accompanying the method serves to highlight temporal precedence and causality relationships relative to the process or event being described.

Object Representations in Human Visual Cortex Formed Through Temporal Integration of Dynamic Partial Shape Views.

PubMed

Orlov, Tanya; Zohary, Ehud

2018-01-17

We typically recognize visual objects using the spatial layout of their parts, which are present simultaneously on the retina. Therefore, shape extraction is based on integration of the relevant retinal information over space. The lateral occipital complex (LOC) can represent shape faithfully in such conditions. However, integration over time is sometimes required to determine object shape. To study shape extraction through temporal integration of successive partial shape views, we presented human participants (both men and women) with artificial shapes that moved behind a narrow vertical or horizontal slit. Only a tiny fraction of the shape was visible at any instant at the same retinal location. However, observers perceived a coherent whole shape instead of a jumbled pattern. Using fMRI and multivoxel pattern analysis, we searched for brain regions that encode temporally integrated shape identity. We further required that the representation of shape should be invariant to changes in the slit orientation. We show that slit-invariant shape information is most accurate in the LOC. Importantly, the slit-invariant shape representations matched the conventional whole-shape representations assessed during full-image runs. Moreover, when the same slit-dependent shape slivers were shuffled, thereby preventing their spatiotemporal integration, slit-invariant shape information was reduced dramatically. The slit-invariant representation of the various shapes also mirrored the structure of shape perceptual space as assessed by perceptual similarity judgment tests. Therefore, the LOC is likely to mediate temporal integration of slit-dependent shape views, generating a slit-invariant whole-shape percept. These findings provide strong evidence for a global encoding of shape in the LOC regardless of integration processes required to generate the shape percept. SIGNIFICANCE STATEMENT Visual objects are recognized through spatial integration of features available simultaneously on the retina. The lateral occipital complex (LOC) represents shape faithfully in such conditions even if the object is partially occluded. However, shape must sometimes be reconstructed over both space and time. Such is the case in anorthoscopic perception, when an object is moving behind a narrow slit. In this scenario, spatial information is limited at any moment so the whole-shape percept can only be inferred by integration of successive shape views over time. We find that LOC carries shape-specific information recovered using such temporal integration processes. The shape representation is invariant to slit orientation and is similar to that evoked by a fully viewed image. Existing models of object recognition lack such capabilities. Copyright © 2018 the authors 0270-6474/18/380659-20$15.00/0.

Tracking speech comprehension in space and time.

PubMed

Pulvermüller, Friedemann; Shtyrov, Yury; Ilmoniemi, Risto J; Marslen-Wilson, William D

2006-07-01

A fundamental challenge for the cognitive neuroscience of language is to capture the spatio-temporal patterns of brain activity that underlie critical functional components of the language comprehension process. We combine here psycholinguistic analysis, whole-head magnetoencephalography (MEG), the Mismatch Negativity (MMN) paradigm, and state-of-the-art source localization techniques (Equivalent Current Dipole and L1 Minimum-Norm Current Estimates) to locate the process of spoken word recognition at a specific moment in space and time. The magnetic MMN to words presented as rare "deviant stimuli" in an oddball paradigm among repetitive "standard" speech stimuli, peaked 100-150 ms after the information in the acoustic input, was sufficient for word recognition. The latency with which words were recognized corresponded to that of an MMN source in the left superior temporal cortex. There was a significant correlation (r = 0.7) of latency measures of word recognition in individual study participants with the latency of the activity peak of the superior temporal source. These results demonstrate a correspondence between the behaviorally determined recognition point for spoken words and the cortical activation in left posterior superior temporal areas. Both the MMN calculated in the classic manner, obtained by subtracting standard from deviant stimulus response recorded in the same experiment, and the identity MMN (iMMN), defined as the difference between the neuromagnetic responses to the same stimulus presented as standard and deviant stimulus, showed the same significant correlation with word recognition processes.

Explaining the Association between Music Training and Reading in Adults

ERIC Educational Resources Information Center

Swaminathan, Swathi; Schellenberg, E. Glenn; Venkatesan, Kirthika

2018-01-01

We sought to clarify whether the positive association between music lessons and reading ability is explained better by shared resources for processing pitch and temporal information, or by general cognitive abilities. Participants were native and nonnative speakers of English with varying levels of music training. We measured reading ability…

Timing Dysfunctions in Schizophrenia as Measured by a Repetitive Finger Tapping Task

ERIC Educational Resources Information Center

Carroll, Christine A.; O'Donnell, Brian F.; Shekhar, Anantha; Hetrick, William P.

2009-01-01

Schizophrenia may be associated with a fundamental disturbance in the temporal coordination of information processing in the brain, leading to classic symptoms of schizophrenia such as thought disorder and disorganized and contextually inappropriate behavior. Although a variety of behavioral studies have provided strong evidence for perceptual…

Timing Dysfunctions in Schizophrenia Span from Millisecond to Several-Second Durations

ERIC Educational Resources Information Center

Carroll, Christine A.; O'Donnell, Brian F.; Shekhar, Anantha; Hetrick, William P.

2009-01-01

Schizophrenia may be associated with a fundamental disturbance in the temporal coordination of information processing in the brain, leading to classic symptoms of schizophrenia such as thought disorder and disorganized and contextually inappropriate behavior. However, the majority of studies that have examined timing behavior in schizophrenia have…

Operating Characteristics of the Implicit Learning System Supporting Serial Interception Sequence Learning

ERIC Educational Resources Information Center

Sanchez, Daniel J.; Reber, Paul J.

2012-01-01

The memory system that supports implicit perceptual-motor sequence learning relies on brain regions that operate separately from the explicit, medial temporal lobe memory system. The implicit learning system therefore likely has distinct operating characteristics and information processing constraints. To attempt to identify the limits of the…

Impaired Timing and Frequency Discrimination in High-Functioning Autism Spectrum Disorders

ERIC Educational Resources Information Center

Bhatara, Anjali; Babikian, Talin; Laugeson, Elizabeth; Tachdjian, Raffi; Sininger, Yvonne S.

2013-01-01

Individuals with autism spectrum disorders (ASD) frequently demonstrate preserved or enhanced frequency perception but impaired timing perception. The present study investigated the processing of spectral and temporal information in 12 adolescents with ASD and 15 age-matched controls. Participants completed two psychoacoustic tasks: one determined…

Modeling Spatial and Temporal Aspects of Visual Backward Masking

ERIC Educational Resources Information Center

Hermens, Frouke; Luksys, Gediminas; Gerstner, Wulfram; Herzog, Michael H.; Ernst, Udo

2008-01-01

Visual backward masking is a versatile tool for understanding principles and limitations of visual information processing in the human brain. However, the mechanisms underlying masking are still poorly understood. In the current contribution, the authors show that a structurally simple mathematical model can explain many spatial and temporal…

Quick concurrent responses to global and local cognitive information underlie intuitive understanding in board-game experts

PubMed Central

Nakatani, Hironori; Yamaguchi, Yoko

2014-01-01

Experts have the superior cognitive capability of quickly understanding complex information in their domain; however, little is known about the neural processes underlying this ability. Here, using a board game named shogi (Japanese chess), we investigated the brain activity in expert players that was involved in their quick understanding of board-game patterns. The frontal area responded only to meaningful game positions, whereas the temporal area responded to both game and random positions with the same latency (200 ms). Subsequent to these quick responses, the temporal and parietal areas responded only to game positions, with a latency of 700 ms. During the responses, enhanced phase synchronization between these areas was observed. Thus, experts first responded to global cognitive information that was specific to game positions and to local cognitive information that was common to game and random positions concurrently. These types of information were integrated via neural synchronization at the posterior areas. As these properties were specific to experts, much of the experts' advantage in understanding game positions occurred within 1 s of perception. PMID:25081320

Individual Sensitivity to Spectral and Temporal Cues in Listeners With Hearing Impairment

PubMed Central

Wright, Richard A.; Blackburn, Michael C.; Tatman, Rachael; Gallun, Frederick J.

2015-01-01

Purpose The present study was designed to evaluate use of spectral and temporal cues under conditions in which both types of cues were available. Method Participants included adults with normal hearing and hearing loss. We focused on 3 categories of speech cues: static spectral (spectral shape), dynamic spectral (formant change), and temporal (amplitude envelope). Spectral and/or temporal dimensions of synthetic speech were systematically manipulated along a continuum, and recognition was measured using the manipulated stimuli. Level was controlled to ensure cue audibility. Discriminant function analysis was used to determine to what degree spectral and temporal information contributed to the identification of each stimulus. Results Listeners with normal hearing were influenced to a greater extent by spectral cues for all stimuli. Listeners with hearing impairment generally utilized spectral cues when the information was static (spectral shape) but used temporal cues when the information was dynamic (formant transition). The relative use of spectral and temporal dimensions varied among individuals, especially among listeners with hearing loss. Conclusion Information about spectral and temporal cue use may aid in identifying listeners who rely to a greater extent on particular acoustic cues and applying that information toward therapeutic interventions. PMID:25629388

An effective online data monitoring and saving strategy for large-scale climate simulations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Xian, Xiaochen; Archibald, Rick; Mayer, Benjamin

Large-scale climate simulation models have been developed and widely used to generate historical data and study future climate scenarios. These simulation models often have to run for a couple of months to understand the changes in the global climate over the course of decades. This long-duration simulation process creates a huge amount of data with both high temporal and spatial resolution information; however, how to effectively monitor and record the climate changes based on these large-scale simulation results that are continuously produced in real time still remains to be resolved. Due to the slow process of writing data to disk,more » the current practice is to save a snapshot of the simulation results at a constant, slow rate although the data generation process runs at a very high speed. This study proposes an effective online data monitoring and saving strategy over the temporal and spatial domains with the consideration of practical storage and memory capacity constraints. Finally, our proposed method is able to intelligently select and record the most informative extreme values in the raw data generated from real-time simulations in the context of better monitoring climate changes.« less

An effective online data monitoring and saving strategy for large-scale climate simulations

DOE PAGES

Xian, Xiaochen; Archibald, Rick; Mayer, Benjamin; ...

2018-01-22

Large-scale climate simulation models have been developed and widely used to generate historical data and study future climate scenarios. These simulation models often have to run for a couple of months to understand the changes in the global climate over the course of decades. This long-duration simulation process creates a huge amount of data with both high temporal and spatial resolution information; however, how to effectively monitor and record the climate changes based on these large-scale simulation results that are continuously produced in real time still remains to be resolved. Due to the slow process of writing data to disk,more » the current practice is to save a snapshot of the simulation results at a constant, slow rate although the data generation process runs at a very high speed. This study proposes an effective online data monitoring and saving strategy over the temporal and spatial domains with the consideration of practical storage and memory capacity constraints. Finally, our proposed method is able to intelligently select and record the most informative extreme values in the raw data generated from real-time simulations in the context of better monitoring climate changes.« less

Spectral and Temporal Processing in Rat Posterior Auditory Cortex

PubMed Central

Pandya, Pritesh K.; Rathbun, Daniel L.; Moucha, Raluca; Engineer, Navzer D.; Kilgard, Michael P.

2009-01-01

The rat auditory cortex is divided anatomically into several areas, but little is known about the functional differences in information processing between these areas. To determine the filter properties of rat posterior auditory field (PAF) neurons, we compared neurophysiological responses to simple tones, frequency modulated (FM) sweeps, and amplitude modulated noise and tones with responses of primary auditory cortex (A1) neurons. PAF neurons have excitatory receptive fields that are on average 65% broader than A1 neurons. The broader receptive fields of PAF neurons result in responses to narrow and broadband inputs that are stronger than A1. In contrast to A1, we found little evidence for an orderly topographic gradient in PAF based on frequency. These neurons exhibit latencies that are twice as long as A1. In response to modulated tones and noise, PAF neurons adapt to repeated stimuli at significantly slower rates. Unlike A1, neurons in PAF rarely exhibit facilitation to rapidly repeated sounds. Neurons in PAF do not exhibit strong selectivity for rate or direction of narrowband one octave FM sweeps. These results indicate that PAF, like nonprimary visual fields, processes sensory information on larger spectral and longer temporal scales than primary cortex. PMID:17615251

Mapping the Information Trace in Local Field Potentials by a Computational Method of Two-Dimensional Time-Shifting Synchronization Likelihood Based on Graphic Processing Unit Acceleration.

PubMed

Zhao, Zi-Fang; Li, Xue-Zhu; Wan, You

2017-12-01

The local field potential (LFP) is a signal reflecting the electrical activity of neurons surrounding the electrode tip. Synchronization between LFP signals provides important details about how neural networks are organized. Synchronization between two distant brain regions is hard to detect using linear synchronization algorithms like correlation and coherence. Synchronization likelihood (SL) is a non-linear synchronization-detecting algorithm widely used in studies of neural signals from two distant brain areas. One drawback of non-linear algorithms is the heavy computational burden. In the present study, we proposed a graphic processing unit (GPU)-accelerated implementation of an SL algorithm with optional 2-dimensional time-shifting. We tested the algorithm with both artificial data and raw LFP data. The results showed that this method revealed detailed information from original data with the synchronization values of two temporal axes, delay time and onset time, and thus can be used to reconstruct the temporal structure of a neural network. Our results suggest that this GPU-accelerated method can be extended to other algorithms for processing time-series signals (like EEG and fMRI) using similar recording techniques.

Organization of food protection behavior is differentially influenced by 192 IgG-saporin lesions of either the medial septum or the nucleus basalis magnocellularis

PubMed Central

Martin, Megan M.; Winter, Shawn S.; Cheatwood, Joseph L.; Carter, Lynniece A.; Jones, Jeana L.; Weathered, Scott L.; Wagner, Steven J.; Wallace, Douglas G.

2008-01-01

Converging lines of evidence have supported a role for the nucleus basalis magnocellularis (NB) in attentional mechanisms; however, debate continues regarding the role of the medial septum in behavior (MS). Recent studies have supported a role for the septohippocampal system in the online processing of internally generated cues. The current study was designed to investigate a possible double dissociation in rat food protection behavior, a natural behavior that has been shown to depend on external and internal sources of information. The study examined the effects of intraparenchymal injections of 192 IgG-saporin into either the MS or NB on the organization of food protection behavior. NB cholinergic lesions reduced the number of successful food protection behaviors while sparing the temporal organization of food protection behavior. In contrast, MS cholinergic lesions disrupted the temporal organization of food protection behavior while sparing the ability to successfully protect food items. These observations are consistent with a double dissociation of NB and MS cholinergic systems' contributions to processing external and internal sources of information and provide further evidence for the septohippocampal system's involvement in processing internally generated cues. PMID:18823954

Study on Mosaic and Uniform Color Method of Satellite Image Fusion in Large Srea

NASA Astrophysics Data System (ADS)

Liu, S.; Li, H.; Wang, X.; Guo, L.; Wang, R.

2018-04-01

Due to the improvement of satellite radiometric resolution and the color difference for multi-temporal satellite remote sensing images and the large amount of satellite image data, how to complete the mosaic and uniform color process of satellite images is always an important problem in image processing. First of all using the bundle uniform color method and least squares mosaic method of GXL and the dodging function, the uniform transition of color and brightness can be realized in large area and multi-temporal satellite images. Secondly, using Color Mapping software to color mosaic images of 16bit to mosaic images of 8bit based on uniform color method with low resolution reference images. At last, qualitative and quantitative analytical methods are used respectively to analyse and evaluate satellite image after mosaic and uniformity coloring. The test reflects the correlation of mosaic images before and after coloring is higher than 95 % and image information entropy increases, texture features are enhanced which have been proved by calculation of quantitative indexes such as correlation coefficient and information entropy. Satellite image mosaic and color processing in large area has been well implemented.

How females of chirping and trilling field crickets integrate the 'what' and 'where' of male acoustic signals during decision making.

PubMed

Gabel, Eileen; Gray, David A; Matthias Hennig, R

2016-11-01

In crickets acoustic communication serves mate selection. Female crickets have to perceive and integrate male cues relevant for mate choice while confronted with several different signals in an acoustically diverse background. Overall female decisions are based on the attractiveness of the temporal pattern (informative about the 'what') and on signal intensity (informative about the 'where') of male calling songs. Here, we investigated how the relevant cues for mate choice are integrated during the decision process by females of five different species of chirping and trilling field crickets. Using a behavioral design, female preferences in no-choice and choice situations for male calling songs differing in pulse rate, modulation depth, intensities, chirp/trill arrangements and temporal shifts were examined. Sensory processing underlying decisions in female field crickets is rather similar as combined evidence suggested that incoming song patterns were analyzed separately by bilaterally paired networks for pattern attractiveness and pattern intensity. A downstream gain control mechanism leads to a weighting of the intensity cue by pattern attractiveness. While remarkable differences between species were observed with respect to specific processing steps, closely related species exhibited more similar preferences than did more distantly related species.

Using Event-related Potentials to Inform the Neurocognitive Processes Underlying Knowledge Extension through Memory Integration.

PubMed

Varga, Nicole L; Bauer, Patricia J

2017-11-01

To build a general knowledge base, it is imperative that individuals acquire, integrate, and further extend knowledge across experiences. For instance, in one episode an individual may learn that George Washington was the first president. In a separate episode they may then learn that Washington was the commander of the Continental Army. Integration of the information in memory may then support self-derivation of the new knowledge that the leader of the Continental Army was also the first president. Despite a considerable amount of fMRI research aimed at further elucidating the neuroanatomical regions supporting this ability, a consensus has yet to be reached with regards to the precise neurocognitive processes involved. In the present research, we capitalized on the high temporal resolution of event-related potentials (ERPs) to inform the time course of processes elicited during successful integration and further extension of new factual knowledge. Adults read novel, related stem facts and were tested for self-derivation of novel integration facts while ERPs were recorded. Consistent with current theoretical models, memory integration was first triggered by novelty detection within 400 msec of experience of a second, related stem fact. Two additional temporally staged encoding processes were then observed interpreted to reflect (1) explicit meaning comprehension and (2) representation of the integrated relation in memory. During the test for self-derivation, a single ERP was elicited, which presumably reflected retrieval and/or recombination of previously integrated knowledge. Together, the present research provides important insight into the time course of neurocognitive processing associated with the formation of a knowledge base.

Image Motion Detection And Estimation: The Modified Spatio-Temporal Gradient Scheme

NASA Astrophysics Data System (ADS)

Hsin, Cheng-Ho; Inigo, Rafael M.

1990-03-01

The detection and estimation of motion are generally involved in computing a velocity field of time-varying images. A completely new modified spatio-temporal gradient scheme to determine motion is proposed. This is derived by using gradient methods and properties of biological vision. A set of general constraints is proposed to derive motion constraint equations. The constraints are that the second directional derivatives of image intensity at an edge point in the smoothed image will be constant at times t and t+L . This scheme basically has two stages: spatio-temporal filtering, and velocity estimation. Initially, image sequences are processed by a set of oriented spatio-temporal filters which are designed using a Gaussian derivative model. The velocity is then estimated for these filtered image sequences based on the gradient approach. From a computational stand point, this scheme offers at least three advantages over current methods. The greatest advantage of the modified spatio-temporal gradient scheme over the traditional ones is that an infinite number of motion constraint equations are derived instead of only one. Therefore, it solves the aperture problem without requiring any additional assumptions and is simply a local process. The second advantage is that because of the spatio-temporal filtering, the direct computation of image gradients (discrete derivatives) is avoided. Therefore the error in gradients measurement is reduced significantly. The third advantage is that during the processing of motion detection and estimation algorithm, image features (edges) are produced concurrently with motion information. The reliable range of detected velocity is determined by parameters of the oriented spatio-temporal filters. Knowing the velocity sensitivity of a single motion detection channel, a multiple-channel mechanism for estimating image velocity, seldom addressed by other motion schemes in machine vision, can be constructed by appropriately choosing and combining different sets of parameters. By applying this mechanism, a great range of velocity can be detected. The scheme has been tested for both synthetic and real images. The results of simulations are very satisfactory.

Top-down Processes in Simulated Electric-Acoustic Hearing: The Effect of Linguistic Context on Bimodal Benefit for Temporally Interrupted Speech

PubMed Central

Oh, Soo Hee; Donaldson, Gail S.; Kong, Ying-Yee

2016-01-01

Objectives Previous studies have documented the benefits of bimodal hearing as compared with a CI alone, but most have focused on the importance of bottom-up, low-frequency cues. The purpose of the present study was to evaluate the role of top-down processing in bimodal hearing by measuring the effect of sentence context on bimodal benefit for temporally interrupted sentences. It was hypothesized that low-frequency acoustic cues would facilitate the use of contextual information in the interrupted sentences, resulting in greater bimodal benefit for the higher context (CUNY) sentences than for the lower context (IEEE) sentences. Design Young normal-hearing listeners were tested in simulated bimodal listening conditions in which noise band vocoded sentences were presented to one ear with or without low-pass (LP) filtered speech or LP harmonic complexes (LPHCs) presented to the contralateral ear. Speech recognition scores were measured in three listening conditions: vocoder-alone, vocoder combined with LP speech, and vocoder combined with LPHCs. Temporally interrupted versions of the CUNY and IEEE sentences were used to assess listeners’ ability to fill in missing segments of speech by using top-down linguistic processing. Sentences were square-wave gated at a rate of 5 Hz with a 50 percent duty cycle. Three vocoder channel conditions were tested for each type of sentence (8, 12, and 16 channels for CUNY; 12, 16, and 32 channels for IEEE) and bimodal benefit was compared for similar amounts of spectral degradation (matched-channel comparisons) and similar ranges of baseline performance. Two gain measures, percentage-point gain and normalized gain, were examined. Results Significant effects of context on bimodal benefit were observed when LP speech was presented to the residual-hearing ear. For the matched-channel comparisons, CUNY sentences showed significantly higher normalized gains than IEEE sentences for both the 12-channel (20 points higher) and 16-channel (18 points higher) conditions. For the individual gain comparisons that used a similar range of baseline performance, CUNY sentences showed bimodal benefits that were significantly higher (7 percentage points, or 15 points normalized gain) than those for IEEE sentences. The bimodal benefits observed here for temporally interrupted speech were considerably smaller than those observed in an earlier study that used continuous speech (Kong et al., 2015). Further, unlike previous findings for continuous speech, no bimodal benefit was observed when LPHCs were presented to the LP ear. Conclusions Findings indicate that linguistic context has a significant influence on bimodal benefit for temporally interrupted speech and support the hypothesis that low-frequency acoustic information presented to the residual-hearing ear facilitates the use of top-down linguistic processing in bimodal hearing. However, bimodal benefit is reduced for temporally interrupted speech as compared to continuous speech, suggesting that listeners’ ability to restore missing speech information depends not only on top-down linguistic knowledge, but also on the quality of the bottom-up sensory input. PMID:27007220

Spatial and temporal relations in conditioned reinforcement and observing behavior

PubMed Central

Bowe, Craig A.; Dinsmoor, James A.

1983-01-01

In Experiment 1, depressing one perch produced stimuli indicating which of two keys, if pecked, could produce food (spatial information) and depressing the other perch produced stimuli indicating whether a variable-interval or an extinction schedule was operating (temporal information). The pigeons increased the time they spent depressing the perch that produced the temporal information but did not increase the time they spent depressing the perch that produced the spatial information. In Experiment 2, pigeons that were allowed to produce combined spatial and temporal information did not acquire the perch pressing any faster or maintain it at a higher level than pigeons allowed to produce only temporal information. Later, when perching produced only spatial information, the time spent depressing the perch eventually declined. The results are not those implied by the statement that information concerning biologically important events is reinforcing but are consistent with an interpretation in terms of the acquisition of reinforcing properties by a stimulus associated with a higher density of primary reinforcement. PMID:16812316

Brain oscillatory activity during spatial navigation: theta and gamma activity link medial temporal and parietal regions.

PubMed

White, David J; Congedo, Marco; Ciorciari, Joseph; Silberstein, Richard B

2012-03-01

Brain oscillatory correlates of spatial navigation were investigated using blind source separation (BSS) and standardized low resolution electromagnetic tomography (sLORETA) analyses of 62-channel EEG recordings. Twenty-five participants were instructed to navigate to distinct landmark buildings in a previously learned virtual reality town environment. Data from periods of navigation between landmarks were subject to BSS analyses to obtain source components. Two of these cortical sources were found to exhibit significant spectral power differences during navigation with respect to a resting eyes open condition and were subject to source localization using sLORETA. These two sources were localized as a right parietal component with gamma activation and a right medial-temporal-parietal component with activation in theta and gamma bandwidths. The parietal gamma activity was thought to reflect visuospatial processing associated with the task. The medial-temporal-parietal activity was thought to be more specific to the navigational processing, representing the integration of ego- and allo-centric representations of space required for successful navigation, suggesting theta and gamma oscillations may have a role in integrating information from parietal and medial-temporal regions. Theta activity on this medial-temporal-parietal source was positively correlated with more efficient navigation performance. Results are discussed in light of the depth and proposed closed field structure of the hippocampus and potential implications for scalp EEG data. The findings of the present study suggest that appropriate BSS methods are ideally suited to minimizing the effects of volume conduction in noninvasive recordings, allowing more accurate exploration of deep brain processes.

Resolving human object recognition in space and time

PubMed Central

Cichy, Radoslaw Martin; Pantazis, Dimitrios; Oliva, Aude

2014-01-01

A comprehensive picture of object processing in the human brain requires combining both spatial and temporal information about brain activity. Here, we acquired human magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) responses to 92 object images. Multivariate pattern classification applied to MEG revealed the time course of object processing: whereas individual images were discriminated by visual representations early, ordinate and superordinate category levels emerged relatively later. Using representational similarity analysis, we combine human fMRI and MEG to show content-specific correspondence between early MEG responses and primary visual cortex (V1), and later MEG responses and inferior temporal (IT) cortex. We identified transient and persistent neural activities during object processing, with sources in V1 and IT., Finally, human MEG signals were correlated to single-unit responses in monkey IT. Together, our findings provide an integrated space- and time-resolved view of human object categorization during the first few hundred milliseconds of vision. PMID:24464044

Which catchment characteristics control the temporal dependence structure of daily river flows?

NASA Astrophysics Data System (ADS)

Chiverton, Andrew; Hannaford, Jamie; Holman, Ian; Corstanje, Ron; Prudhomme, Christel; Bloomfield, John; Hess, Tim

2014-05-01

A hydrological classification system would provide information about the dominant processes in the catchment enabling information to be transferred between catchments. Currently there is no widely-agreed upon system for classifying river catchments. This paper developed a novel approach to assess the influence that catchment characteristics have on the precipitation-to-flow relationship, using a catchment classification based on the average temporal dependence structure in daily river flow data over the period 1980 to 2010. Temporal dependence in river flow data is driven by the flow pathways, connectivity and storage within the catchment. Temporal dependence was analysed by creating temporally averaged semi-variograms for a set of 116 near-natural catchments (in order to prevent direct anthropogenic disturbances influencing the results) distributed throughout the UK. Cluster analysis, using the variogram, classified the catchments into four well defined clusters driven by the interaction of catchment characteristics, predominantly characteristics which influence the precipitation-to-flow relationship. Geology, depth to gleyed layer in soils, slope of the catchment and the percentage of arable land were significantly different between the clusters. These characteristics drive the temporal dependence structure by influencing the rate at which water moves through the catchment and / or the storage in the catchment. Arable land is correlated with several other variables, hence is a proxy indicating the residence time of the water in the catchment. Finally, quadratic discriminant analysis was used to show that a model with five catchment characteristics is able to predict the temporal dependence structure for un-gauged catchments. This work demonstrates that a variogram-based approach is a powerful and flexible methodology for grouping catchments based on the precipitation-to-flow relationship which could be applied to any set of catchments with a relatively complete daily river flow record.