Integrated Remote Sensing Modalities for Classification at a Legacy Test Site

NASA Astrophysics Data System (ADS)

Lee, D. J.; Anderson, D.; Craven, J.

2016-12-01

Detecting, locating, and characterizing suspected underground nuclear test sites is of interest to the worldwide nonproliferation monitoring community. Remote sensing provides both cultural and surface geological information over a large search area in a non-intrusive manner. We have characterized a legacy nuclear test site at the Nevada National Security Site (NNSS) using an aerial system based on RGB imagery, light detection and ranging, and hyperspectral imaging. We integrate these different remote sensing modalities to perform pattern recognition and classification tasks on the test site. These tasks include detecting cultural artifacts and exotic materials. We evaluate if the integration of different remote sensing modalities improves classification performance.

Fusion of Multiple Sensing Modalities for Machine Vision

DTIC Science & Technology

1994-05-31

Modeling of Non-Homogeneous 3-D Objects for Thermal and Visual Image Synthesis," Pattern Recognition, in press. U [11] Nair, Dinesh , and J. K. Aggarwal...20th AIPR Workshop: Computer Vision--Meeting the Challenges, McLean, Virginia, October 1991. Nair, Dinesh , and J. K. Aggarwal, "An Object Recognition...Computer Engineering August 1992 Sunil Gupta Ph.D. Student Mohan Kumar M.S. Student Sandeep Kumar M.S. Student Xavier Lebegue Ph.D., Computer

Distributed flow estimation and closed-loop control of an underwater vehicle with a multi-modal artificial lateral line.

PubMed

DeVries, Levi; Lagor, Francis D; Lei, Hong; Tan, Xiaobo; Paley, Derek A

2015-03-25

Bio-inspired sensing modalities enhance the ability of autonomous vehicles to characterize and respond to their environment. This paper concerns the lateral line of cartilaginous and bony fish, which is sensitive to fluid motion and allows fish to sense oncoming flow and the presence of walls or obstacles. The lateral line consists of two types of sensing modalities: canal neuromasts measure approximate pressure gradients, whereas superficial neuromasts measure local flow velocities. By employing an artificial lateral line, the performance of underwater sensing and navigation strategies is improved in dark, cluttered, or murky environments where traditional sensing modalities may be hindered. This paper presents estimation and control strategies enabling an airfoil-shaped unmanned underwater vehicle to assimilate measurements from a bio-inspired, multi-modal artificial lateral line and estimate flow properties for feedback control. We utilize potential flow theory to model the fluid flow past a foil in a uniform flow and in the presence of an upstream obstacle. We derive theoretically justified nonlinear estimation strategies to estimate the free stream flowspeed, angle of attack, and the relative position of an upstream obstacle. The feedback control strategy uses the estimated flow properties to execute bio-inspired behaviors including rheotaxis (the tendency of fish to orient upstream) and station-holding (the tendency of fish to position behind an upstream obstacle). A robotic prototype outfitted with a multi-modal artificial lateral line composed of ionic polymer metal composite and embedded pressure sensors experimentally demonstrates the distributed flow sensing and closed-loop control strategies.

Effect of residual stress on modal patterns of MEMS vibratory gyroscope

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dutta, Shankar, E-mail: shankardutta77@gmail.com; Panchal, Abha; Kumar, Manoj

Deep boron diffusion often induces residual stress in bulk micromachined MEMS structures, which may affect the MEMS devices operation. In this study, we studied the modal patterns of MEMS vibratory gyroscope under the residual stress (100 – 1000 MPa). Modal patterns and modal frequencies of the gyro are found to be dependent on the residual stress values. Without any residual stress, the modal frequencies drive and sense modeswere found to be 20.06 kHz and 20.36 kHz respectively. In presence of 450 MPa residual stress, the modal frequencies of the drive and sense modes were changed to 42.75 kHz and 43.07 kHz respectively.

Computational Intelligence Techniques for Tactile Sensing Systems

PubMed Central

Gastaldo, Paolo; Pinna, Luigi; Seminara, Lucia; Valle, Maurizio; Zunino, Rodolfo

2014-01-01

Tactile sensing helps robots interact with humans and objects effectively in real environments. Piezoelectric polymer sensors provide the functional building blocks of the robotic electronic skin, mainly thanks to their flexibility and suitability for detecting dynamic contact events and for recognizing the touch modality. The paper focuses on the ability of tactile sensing systems to support the challenging recognition of certain qualities/modalities of touch. The research applies novel computational intelligence techniques and a tensor-based approach for the classification of touch modalities; its main results consist in providing a procedure to enhance system generalization ability and architecture for multi-class recognition applications. An experimental campaign involving 70 participants using three different modalities in touching the upper surface of the sensor array was conducted, and confirmed the validity of the approach. PMID:24949646

Computational intelligence techniques for tactile sensing systems.

PubMed

Gastaldo, Paolo; Pinna, Luigi; Seminara, Lucia; Valle, Maurizio; Zunino, Rodolfo

2014-06-19

Tactile sensing helps robots interact with humans and objects effectively in real environments. Piezoelectric polymer sensors provide the functional building blocks of the robotic electronic skin, mainly thanks to their flexibility and suitability for detecting dynamic contact events and for recognizing the touch modality. The paper focuses on the ability of tactile sensing systems to support the challenging recognition of certain qualities/modalities of touch. The research applies novel computational intelligence techniques and a tensor-based approach for the classification of touch modalities; its main results consist in providing a procedure to enhance system generalization ability and architecture for multi-class recognition applications. An experimental campaign involving 70 participants using three different modalities in touching the upper surface of the sensor array was conducted, and confirmed the validity of the approach.

Fiber-Optic Surface Temperature Sensor Based on Modal Interference.

PubMed

Musin, Frédéric; Mégret, Patrice; Wuilpart, Marc

2016-07-28

Spatially-integrated surface temperature sensing is highly useful when it comes to controlling processes, detecting hazardous conditions or monitoring the health and safety of equipment and people. Fiber-optic sensing based on modal interference has shown great sensitivity to temperature variation, by means of cost-effective image-processing of few-mode interference patterns. New developments in the field of sensor configuration, as described in this paper, include an innovative cooling and heating phase discrimination functionality and more precise measurements, based entirely on the image processing of interference patterns. The proposed technique was applied to the measurement of the integrated surface temperature of a hollow cylinder and compared with a conventional measurement system, consisting of an infrared camera and precision temperature probe. As a result, the optical technique is in line with the reference system. Compared with conventional surface temperature probes, the optical technique has the following advantages: low heat capacity temperature measurement errors, easier spatial deployment, and replacement of multiple angle infrared camera shooting and the continuous monitoring of surfaces that are not visually accessible.

Modal sensing and control of paraboloidal shell structronic system

NASA Astrophysics Data System (ADS)

Yue, Honghao; Lu, Yifan; Deng, Zongquan; Tzou, Hornsen

2018-02-01

Paraboloidal shells of revolution are commonly used as important components in the field of advanced aerospace structures and aviation mechanical systems. This study is to investigate the modal sensing behavior and the modal vibration control effect of distributed PVDF patches laminated on the paraboloidal shell. A paraboloidal shell sensing and control testing platform is set up first. Frequencies of lower order modes of the shell are obtained with the PVDF sensor and compared with the previous testing results to prove its accuracy. Then sensor patches are laminated on different positions (or different sides) of the shell and tested to reveal the relation between the sensing behaviors and their locations. Finally, a mathematical model of the structronic system is built by parameter identifications and the transfer function is derived. Independent and coupled modal controllers are designed based on the pole placement method and modal vibration control experiments are performed. The amplitude suppression ratio of each mode controlled by the pole placement controller is calculated and compared with the results obtained by using a PPF controller. Advantages of both methods are concluded and suggestions are given on how to choose control algorithm for different purpose.

Erbium-doped fiber ring laser with SMS modal interferometer for hydrogen sensing

NASA Astrophysics Data System (ADS)

Zhang, Ya-nan; Zhang, Lebin; Han, Bo; Peng, Huijie; Zhou, Tianmin; Lv, Ri-qing

2018-06-01

A hydrogen sensor based on erbium-doped fiber ring laser with modal interferometer is proposed. A single mode-multimode-single mode (SMS) modal interferometer structure coated with Pd/WO3 film is used as the sensing head, due to that it is easy to be fabricated and low cost. The sensing structure is inserted into an erbium-doped fiber ring laser in order to solve the problem of spectral confusion and improve the detection limit of the hydrogen sensor based on the SMS modal interferometer. The SMS sensing structure is acted as a fiber band-pass filter. When hydrogen concentration around the sensor is changed, it will induce the refractive index and strain variations of the Pd/WO3 film, and then shift the resonant spectrum of the SMS modal interferometer as well as the laser wavelength of the fiber ring laser. Therefore, the hydrogen concentration can be measured by monitoring the wavelength shift of the laser, which has high intensity and narrow full width half maximum. Experimental results demonstrate that the sensor has high sensitivity of 1.23 nm/%, low detection limit of 0.017%, good stability and excellent repeatability.

A reflective hydrogen sensor based on fiber ring laser with PCF modal interferometer

NASA Astrophysics Data System (ADS)

Zhang, Ya-Nan; Zhang, Aozhuo; Han, Bo; E, Siyu

2018-06-01

A new hydrogen sensor based on a fiber ring laser with a photonic crystal fiber (PCF) modal interferometer is proposed. The reflective PCF modal interferometer, which is fabricated by forming two collapse regions on the two ends of PCF with a fusion discharge technique, is utilized as the sensing head and filter. Particularly, the Pd/WO3 hydrogen-sensitive thin film is coated on the PCF for hydrogen sensing. The combination of the fiber ring laser and PCF modal interferometer gives the sensor a high signal-to-noise ratio and an improved detection limit. Experimental results show that the sensing system can achieve a hydrogen sensitivity of 1.28 nm/%, a high signal-to-noise ratio (∼30 dB), a narrow full width at half maximum (∼0.05 nm), and low detection limit of 0.0133%.

Performance Evaluation Modeling of Network Sensors

NASA Technical Reports Server (NTRS)

Clare, Loren P.; Jennings, Esther H.; Gao, Jay L.

2003-01-01

Substantial benefits are promised by operating many spatially separated sensors collectively. Such systems are envisioned to consist of sensor nodes that are connected by a communications network. A simulation tool is being developed to evaluate the performance of networked sensor systems, incorporating such metrics as target detection probabilities, false alarms rates, and classification confusion probabilities. The tool will be used to determine configuration impacts associated with such aspects as spatial laydown, and mixture of different types of sensors (acoustic, seismic, imaging, magnetic, RF, etc.), and fusion architecture. The QualNet discrete-event simulation environment serves as the underlying basis for model development and execution. This platform is recognized for its capabilities in efficiently simulating networking among mobile entities that communicate via wireless media. We are extending QualNet's communications modeling constructs to capture the sensing aspects of multi-target sensing (analogous to multiple access communications), unimodal multi-sensing (broadcast), and multi-modal sensing (multiple channels and correlated transmissions). Methods are also being developed for modeling the sensor signal sources (transmitters), signal propagation through the media, and sensors (receivers) that are consistent with the discrete event paradigm needed for performance determination of sensor network systems. This work is supported under the Microsensors Technical Area of the Army Research Laboratory (ARL) Advanced Sensors Collaborative Technology Alliance.

Location and Modality Effects in Online Dating: Rich Modality Profile and Location-Based Information Cues Increase Social Presence, While Moderating the Impact of Uncertainty Reduction Strategy.

PubMed

Jung, Soyoung; Roh, Soojin; Yang, Hyun; Biocca, Frank

2017-09-01

This study investigates how different interface modality features of online dating sites, such as location awareness cues and modality of profiles, affect the sense of social presence of a prospective date. We also examined how various user behaviors aimed at reducing uncertainty about online interactions affect social presence perceptions and are affected by the user interface features. Male users felt a greater sense of social presence when exposed to both location and accessibility cues (geographical proximity) and a richer medium (video profiles). Viewing a richer medium significantly increased the sense of social presence among female participants whereas location-based information sharing features did not directly affect their social presence perception. Augmented social presence, as a mediator, contributed to users' greater intention to meet potential dating partners in a face-to-face setting and to buy paid memberships on online dating sites.

The sense of agency is action-effect causality perception based on cross-modal grouping.

PubMed

Kawabe, Takahiro; Roseboom, Warrick; Nishida, Shin'ya

2013-07-22

Sense of agency, the experience of controlling external events through one's actions, stems from contiguity between action- and effect-related signals. Here we show that human observers link their action- and effect-related signals using a computational principle common to cross-modal sensory grouping. We first report that the detection of a delay between tactile and visual stimuli is enhanced when both stimuli are synchronized with separate auditory stimuli (experiment 1). This occurs because the synchronized auditory stimuli hinder the potential grouping between tactile and visual stimuli. We subsequently demonstrate an analogous effect on observers' key press as an action and a sensory event. This change is associated with a modulation in sense of agency; namely, sense of agency, as evaluated by apparent compressions of action-effect intervals (intentional binding) or subjective causality ratings, is impaired when both participant's action and its putative visual effect events are synchronized with auditory tones (experiments 2 and 3). Moreover, a similar role of action-effect grouping in determining sense of agency is demonstrated when the additional signal is presented in the modality identical to an effect event (experiment 4). These results are consistent with the view that sense of agency is the result of general processes of causal perception and that cross-modal grouping plays a central role in these processes.

The sense of agency is action–effect causality perception based on cross-modal grouping

PubMed Central

Kawabe, Takahiro; Roseboom, Warrick; Nishida, Shin'ya

2013-01-01

Sense of agency, the experience of controlling external events through one's actions, stems from contiguity between action- and effect-related signals. Here we show that human observers link their action- and effect-related signals using a computational principle common to cross-modal sensory grouping. We first report that the detection of a delay between tactile and visual stimuli is enhanced when both stimuli are synchronized with separate auditory stimuli (experiment 1). This occurs because the synchronized auditory stimuli hinder the potential grouping between tactile and visual stimuli. We subsequently demonstrate an analogous effect on observers' key press as an action and a sensory event. This change is associated with a modulation in sense of agency; namely, sense of agency, as evaluated by apparent compressions of action–effect intervals (intentional binding) or subjective causality ratings, is impaired when both participant's action and its putative visual effect events are synchronized with auditory tones (experiments 2 and 3). Moreover, a similar role of action–effect grouping in determining sense of agency is demonstrated when the additional signal is presented in the modality identical to an effect event (experiment 4). These results are consistent with the view that sense of agency is the result of general processes of causal perception and that cross-modal grouping plays a central role in these processes. PMID:23740784

Visual and tactile length matching in spatial neglect.

PubMed

Bisiach, Edoardo; McIntosh, Robert D; Dijkerman, H Chris; McClements, Kevin I; Colombo, Mariarosa; Milner, A David

2004-01-01

Previous studies have shown that many patients with spatial neglect underestimate the horizontal extent of leftwardly located shapes (presented on screen or on paper) relative to rightwardly located shapes. This has been used to help explain their leftward biases in line bisection. In the present study we have tested patients with right hemisphere damage, either with or without neglect, on a comparable length matching task, but using 3-dimensional objects. The task was executed first visually without tactile contact, and second through touch without vision. In both sense modalities, we found that patients with neglect, but not those without, tended to underestimate leftward located objects relative to rightward located objects, differing significantly in this regard from healthy subjects. However these lateral biases were not as frequent or as pronounced as in previous studies using 2-D visual shapes. Despite the similar asymmetries in the two sense modalities, we found only a small correlation between them, and clear double dissociations were observed among our patients. We conclude that leftward length underestimation cannot be attributed to any one single cause. First it cannot be entirely due to impairments in the visual pathways, such as hemianopia and/or processing biases, since the disorder is also seen in the tactile modality. At the same time, however, length underestimation phenomena cannot be fully explained as a disruption of a supramodal central size processor, since they can occur in either vision or touch alone. Our data would fit best with a multiple-factor model in which some patients show leftward length underestimation for modality-specific reasons, while others do so due to a more high-level disruption of size judgements.

Plasmonic mode converter for controlling optical impedance and nanoscale light-matter interaction.

PubMed

Hung, Yun-Ting; Huang, Chen-Bin; Huang, Jer-Shing

2012-08-27

To enable multiple functions of plasmonic nanocircuits, it is of key importance to control the propagation properties and the modal distribution of the guided optical modes such that their impedance matches to that of nearby quantum systems and desired light-matter interaction can be achieved. Here, we present efficient mode converters for manipulating guided modes on a plasmonic two-wire transmission line. The mode conversion is achieved through varying the path length, wire cross section and the surrounding index of refraction. Instead of pure optical interference, strong near-field coupling of surface plasmons results in great momentum splitting and modal profile variation. We theoretically demonstrate control over nanoantenna radiation and discuss the possibility to enhance nanoscale light-matter interaction. The proposed converter may find applications in surface plasmon amplification, index sensing and enhanced nanoscale spectroscopy.

Multiparameter fiber optic sensing system for monitoring enhanced geothermal systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Challener, William A

2014-12-04

The goal of this project was to design, fabricate and test an optical fiber cable which supports multiple sensing modalities for measurements in the harsh environment of enhanced geothermal systems. To accomplish this task, optical fiber was tested at both high temperatures and strains for mechanical integrity, and in the presence of hydrogen for resistance to darkening. Both single mode (SM) and multimode (MM) commercially available optical fiber were identified and selected for the cable based on the results of these tests. The cable was designed and fabricated using a tube-within-tube construction containing two MM fibers and one SM fiber,more » and without supporting gel that is not suitable for high temperature environments. Commercial fiber optic sensing instruments using Raman DTS (distributed temperature sensing), Brillouin DTSS (distributed temperature and strain sensing), and Raleigh COTDR (coherent optical time domain reflectometry) were selected for field testing. A microelectromechanical systems (MEMS) pressure sensor was designed, fabricated, packaged, and calibrated for high pressure measurements at high temperatures and spliced to the cable. A fiber Bragg grating (FBG) temperature sensor was also spliced to the cable. A geothermal well was selected and its temperature and pressure were logged. The cable was then deployed in the well in two separate field tests and measurements were made on these different sensing modalities. Raman DTS measurements were found to be accurate to ±5°C, even with some residual hydrogen darkening. Brillouin DTSS measurements were in good agreement with the Raman results. The Rayleigh COTDR instrument was able to detect some acoustic signatures, but was generally disappointing. The FBG sensor was used to determine the effects of hydrogen darkening, but drift over time made it unreliable as a temperature or pressure sensor. The MEMS sensor was found to be highly stable and accurate to better than its 0.1% calibration.« less

Modal Interpretation of Quantum Mechanics and Classical Physical Theories

NASA Astrophysics Data System (ADS)

Ingarden, R. S.

In 1990, Bas C. van Fraassen defined the modal interpretation of quantum mechanics as the consideration of it as ``a pure theory of the possible, with testable, empirical implications for what actually happens". This is a narrow, traditional understanding of modality, only in the sense of the concept of possibility (usually denoted in logic by the C. I. Lewis's symbol 3) and the concept of necessity 2 defined by means of 3. In modern logic, however, modality is understood in a much wider sense as any intensional functor (i.e. non-extensional or determined not only by the truth value of a sentence). In the recent (independent of van Fraassen) publications of the author (1997), an attempt was made to apply this wider understanding of modality to interpretation of classical and quantum physics. In the present lecture, these problems are discussed on the background of a brief review of the logical approch to quantum mechanics in the recent 7 decades. In this discussion, the new concepts of sub-modality and super-modality of many orders are used.

Electromagnetic pulsed thermography for natural cracks inspection

NASA Astrophysics Data System (ADS)

Gao, Yunlai; Tian, Gui Yun; Wang, Ping; Wang, Haitao; Gao, Bin; Woo, Wai Lok; Li, Kongjing

2017-02-01

Emerging integrated sensing and monitoring of material degradation and cracks are increasingly required for characterizing the structural integrity and safety of infrastructure. However, most conventional nondestructive evaluation (NDE) methods are based on single modality sensing which is not adequate to evaluate structural integrity and natural cracks. This paper proposed electromagnetic pulsed thermography for fast and comprehensive defect characterization. It hybrids multiple physical phenomena i.e. magnetic flux leakage, induced eddy current and induction heating linking to physics as well as signal processing algorithms to provide abundant information of material properties and defects. New features are proposed using 1st derivation that reflects multiphysics spatial and temporal behaviors to enhance the detection of cracks with different orientations. Promising results that robust to lift-off changes and invariant features for artificial and natural cracks detection have been demonstrated that the proposed method significantly improves defect detectability. It opens up multiphysics sensing and integrated NDE with potential impact for natural understanding and better quantitative evaluation of natural cracks including stress corrosion crack (SCC) and rolling contact fatigue (RCF).

Safe Operations of Unmanned Systems for Reconnaissance in Complex Environments Army Technology Objective (SOURCE ATO)

DTIC Science & Technology

2011-04-25

must adapt its planning to vehicle size, shape, wheelbase, wheel and axle configuration, the specific obstacle-crossing capabilities of the vehicle...scalability of the ANS is a consequence of making each sensing modality capable of performing reasonable perception tasks while allowing a wider...autonomous system design achieves flexibility by exploiting redundant sensing modalities where possible, and by a decision-making process that

Computer Based Behavioral Biometric Authentication via Multi-Modal Fusion

DTIC Science & Technology

2013-03-01

the decisions made by each individual modality. Fusion of features is the simple concatenation of feature vectors from multiple modalities to be...of Features BayesNet MDL 330 LibSVM PCA 80 J48 Wrapper Evaluator 11 3.5.3 Ensemble Based Decision Level Fusion. In ensemble learning multiple ...The high fusion percentages validate our hypothesis that by combining features from multiple modalities, classification accuracy can be improved. As

Somatosensory impairment and its association with balance limitation in people with multiple sclerosis.

PubMed

Jamali, Akram; Sadeghi-Demneh, Ebrahim; Fereshtenajad, Niloufar; Hillier, Susan

2017-09-01

Somatosensory impairments are common in multiple sclerosis. However, little data are available to characterize the nature and frequency of these problems in people with multiple sclerosis. To investigate the frequency of somatosensory impairments and identify any association with balance limitations in people with multiple sclerosis. The design was a prospective cross-sectional study, involving 82 people with multiple sclerosis and 30 healthy controls. Tactile and proprioceptive sensory acuity were measured using the Rivermead Assessment of Somatosensory Performance. Vibration duration was assessed using a tuning fork. Duration for the Timed Up and Go Test and reaching distance of the Functional Reach Test were measured to assess balance limitations. The normative range of sensory modalities was defined using cut-off points in the healthy participants. The multivariate linear regression was used to identify the significant predictors of balance in people with multiple sclerosis. Proprioceptive impairments (66.7%) were more common than tactile (60.8%) and vibration impairments (44.9%). Somatosensory impairments were more frequent in the lower limb (78.2%) than the upper limb (64.1%). All sensory modalities were significantly associated with the Timed Up and Go and Functional Reach tests (p<0.05). The Timed Up and Go test was independently predicted by the severity of the neurological lesion, Body Mass Index, ataxia, and tactile sensation (R2=0.58), whereas the Functional Reach test was predicted by the severity of the neurological lesion, lower limb strength, and vibration sense (R2=0.49). Somatosensory impairments are very common in people with multiple sclerosis. These impairments are independent predictors of balance limitation. Copyright © 2017 Elsevier B.V. All rights reserved.

NASA Tech Briefs, April 2009

NASA Technical Reports Server (NTRS)

2009-01-01

Topics covered include: Direct-Solve Image-Based Wavefront Sensing; Use of UV Sources for Detection and Identification of Explosives; Using Fluorescent Viruses for Detecting Bacteria in Water; Gradiometer Using Middle Loops as Sensing Elements in a Low-Field SQUID MRI System; Volcano Monitor: Autonomous Triggering of In-Situ Sensors; Wireless Fluid-Level Sensors for Harsh Environments; Interference-Detection Module in a Digital Radar Receiver; Modal Vibration Analysis of Large Castings; Structural/Radiation-Shielding Epoxies; Integrated Multilayer Insulation; Apparatus for Screening Multiple Oxygen-Reduction Catalysts; Determining Aliasing in Isolated Signal Conditioning Modules; Composite Bipolar Plate for Unitized Fuel Cell/Electrolyzer Systems; Spectrum Analyzers Incorporating Tunable WGM Resonators; Quantum-Well Thermophotovoltaic Cells; Bounded-Angle Iterative Decoding of LDPC Codes; Conversion from Tree to Graph Representation of Requirements; Parallel Hybrid Vehicle Optimal Storage System; and Anaerobic Digestion in a Flooded Densified Leachbed.

Smell or vision? The use of different sensory modalities in predator discrimination.

PubMed

Fischer, Stefan; Oberhummer, Evelyne; Cunha-Saraiva, Filipa; Gerber, Nina; Taborsky, Barbara

2017-01-01

Theory predicts that animals should adjust their escape responses to the perceived predation risk. The information animals obtain about potential predation risk may differ qualitatively depending on the sensory modality by which a cue is perceived. For instance, olfactory cues may reveal better information about the presence or absence of threats, whereas visual information can reliably transmit the position and potential attack distance of a predator. While this suggests a differential use of information perceived through the two sensory channels, the relative importance of visual vs. olfactory cues when distinguishing between different predation threats is still poorly understood. Therefore, we exposed individuals of the cooperatively breeding cichlid Neolamprologus pulcher to a standardized threat stimulus combined with either predator or non-predator cues presented either visually or chemically. We predicted that flight responses towards a threat stimulus are more pronounced if cues of dangerous rather than harmless heterospecifics are presented and that N. pulcher , being an aquatic species, relies more on olfaction when discriminating between dangerous and harmless heterospecifics. N. pulcher responded faster to the threat stimulus, reached a refuge faster and entered a refuge more likely when predator cues were perceived. Unexpectedly, the sensory modality used to perceive the cues did not affect the escape response or the duration of the recovery phase. This suggests that N. pulcher are able to discriminate heterospecific cues with similar acuity when using vision or olfaction. We discuss that this ability may be advantageous in aquatic environments where the visibility conditions strongly vary over time. The ability to rapidly discriminate between dangerous predators and harmless heterospecifics is crucial for the survival of prey animals. In seasonally fluctuating environment, sensory conditions may change over the year and may make the use of multiple sensory modalities for heterospecific discrimination highly beneficial. Here we compared the efficacy of visual and olfactory senses in the discrimination ability of the cooperatively breeding cichlid Neolamprologus pulcher . We presented individual fish with visual or olfactory cues of predators or harmless heterospecifics and recorded their flight response. When exposed to predator cues, individuals responded faster, reached a refuge faster and were more likely to enter the refuge. Unexpectedly, the olfactory and visual senses seemed to be equally efficient in this discrimination task, suggesting that seasonal variation of water conditions experienced by N. pulcher may necessitate the use of multiple sensory channels for the same task.

Establishment and analysis of coupled dynamic model for dual-mass silicon micro-gyroscope

NASA Astrophysics Data System (ADS)

Wang, Zhanghui; Qiu, Anping; Shi, Qin; Zhang, Taoyuan

2017-12-01

This paper presents a coupled dynamic model for a dual-mass silicon micro-gyroscope (DMSG). It can quantitatively analyze the influence of left-right stiffness difference on the natural frequencies, modal matrix and modal coupling coefficient of the DMSG. The analytic results are verified by using the finite element method (FEM) simulation. The model shows that with the left-right stiffness difference of 1%, the modal coupling coefficient is 12% in the driving direction and 31% in the sensing direction. It also shows that in order to achieve good separation, the stiffness of base beam should be small enough in both the driving and sensing direction.

Causal Inference for Cross-Modal Action Selection: A Computational Study in a Decision Making Framework.

PubMed

Daemi, Mehdi; Harris, Laurence R; Crawford, J Douglas

2016-01-01

Animals try to make sense of sensory information from multiple modalities by categorizing them into perceptions of individual or multiple external objects or internal concepts. For example, the brain constructs sensory, spatial representations of the locations of visual and auditory stimuli in the visual and auditory cortices based on retinal and cochlear stimulations. Currently, it is not known how the brain compares the temporal and spatial features of these sensory representations to decide whether they originate from the same or separate sources in space. Here, we propose a computational model of how the brain might solve such a task. We reduce the visual and auditory information to time-varying, finite-dimensional signals. We introduce controlled, leaky integrators as working memory that retains the sensory information for the limited time-course of task implementation. We propose our model within an evidence-based, decision-making framework, where the alternative plan units are saliency maps of space. A spatiotemporal similarity measure, computed directly from the unimodal signals, is suggested as the criterion to infer common or separate causes. We provide simulations that (1) validate our model against behavioral, experimental results in tasks where the participants were asked to report common or separate causes for cross-modal stimuli presented with arbitrary spatial and temporal disparities. (2) Predict the behavior in novel experiments where stimuli have different combinations of spatial, temporal, and reliability features. (3) Illustrate the dynamics of the proposed internal system. These results confirm our spatiotemporal similarity measure as a viable criterion for causal inference, and our decision-making framework as a viable mechanism for target selection, which may be used by the brain in cross-modal situations. Further, we suggest that a similar approach can be extended to other cognitive problems where working memory is a limiting factor, such as target selection among higher numbers of stimuli and selections among other modality combinations.

The optimal hormonal replacement modality selection for multiple organ procurement from brain-dead organ donors

PubMed Central

Mi, Zhibao; Novitzky, Dimitri; Collins, Joseph F; Cooper, David KC

2015-01-01

The management of brain-dead organ donors is complex. The use of inotropic agents and replacement of depleted hormones (hormonal replacement therapy) is crucial for successful multiple organ procurement, yet the optimal hormonal replacement has not been identified, and the statistical adjustment to determine the best selection is not trivial. Traditional pair-wise comparisons between every pair of treatments, and multiple comparisons to all (MCA), are statistically conservative. Hsu’s multiple comparisons with the best (MCB) – adapted from the Dunnett’s multiple comparisons with control (MCC) – has been used for selecting the best treatment based on continuous variables. We selected the best hormonal replacement modality for successful multiple organ procurement using a two-step approach. First, we estimated the predicted margins by constructing generalized linear models (GLM) or generalized linear mixed models (GLMM), and then we applied the multiple comparison methods to identify the best hormonal replacement modality given that the testing of hormonal replacement modalities is independent. Based on 10-year data from the United Network for Organ Sharing (UNOS), among 16 hormonal replacement modalities, and using the 95% simultaneous confidence intervals, we found that the combination of thyroid hormone, a corticosteroid, antidiuretic hormone, and insulin was the best modality for multiple organ procurement for transplantation. PMID:25565890

Displacement sensing based on modal interference in polymer optical fibers with partially applied strain

NASA Astrophysics Data System (ADS)

Mizuno, Yosuke; Hagiwara, Sonoko; Kawa, Tomohito; Lee, Heeyoung; Nakamura, Kentaro

2018-05-01

Strain sensing based on modal interference in multimode fibers (MMFs) has been extensively studied, but no experimental or theoretical reports have been given as to how the system works when strain is applied not to the whole MMF but only to part of the MMF. Here, using a perfluorinated graded-index polymer optical fiber as the MMF, we investigate the strain sensing characteristics of this type of sensor when strain is partially applied to fiber sections with different lengths. The strain sensitivity dependence on the length of the strained section reveals that this strain sensor actually behaves as a displacement sensor.

Study on the effect of carbon nanotube coating on the refractive index sensing sensitivity of fiber modal interferometer

NASA Astrophysics Data System (ADS)

Zhang, Ya-nan; Xie, Wen-ge; Wang, Jianzhang; Wang, Pengzhao

2018-01-01

Refractive index sensing of liquid is important in the domain of chemistry and biology. Fiber optical sensors provide an excellent way to measure the refractive index due to their feasible integration to other fiber optics components, high sensitivity, small size, and distributed sensing. However, conventional optical sensors have different shortages. To find a practical way to measure the refractive index of liquid, this paper intended to combine Carbon Nanotube (CNT) with non-core fiber (NCF) to prepare a kind of modal interferometer sensor and to explore the effect of CNT coating on refractive index sensing properties of the modal interferometer. Firstly, a structure of single mode non-core single mode (SNS) fiber with a CNT film coating was proposed and simulated. The simulation results showed that the CNT coating could improve the refractive index sensitivity of the interferometer sensor. Then in the experiment part, the CNT solution was fabricated and deposited onto the NCF, and a refractive index sensing system was built to examine the property of the CNT-coated SNS interferometer sensor. During the experiment, the influence factors of sensitivity were summarized by testing the sensing performance under different conditions, and it was demonstrated that the CNT coating could improve the contrast of the interference spectrum, and also had the possibility to increase the refractive index sensitivity of the interferometer sensor.

Psychophysiological Sensing and State Classification for Attention Management in Commercial Aviation

NASA Technical Reports Server (NTRS)

Harrivel, Angela R.; Liles, Charles; Stephens, Chad L.; Ellis, Kyle K.; Prinzel, Lawrence J.; Pope, Alan T.

2016-01-01

Attention-related human performance limiting states (AHPLS) can cause pilots to lose airplane state awareness (ASA), and their detection is important to improving commercial aviation safety. The Commercial Aviation Safety Team found that the majority of recent international commercial aviation accidents attributable to loss of control inflight involved flight crew loss of airplane state awareness, and that distraction of various forms was involved in all of them. Research on AHPLS, including channelized attention, diverted attention, startle / surprise, and confirmation bias, has been recommended in a Safety Enhancement (SE) entitled "Training for Attention Management." To accomplish the detection of such cognitive and psychophysiological states, a broad suite of sensors has been implemented to simultaneously measure their physiological markers during high fidelity flight simulation human subject studies. Pilot participants were asked to perform benchmark tasks and experimental flight scenarios designed to induce AHPLS. Pattern classification was employed to distinguish the AHPLS induced by the benchmark tasks. Unimodal classification using pre-processed electroencephalography (EEG) signals as input features to extreme gradient boosting, random forest and deep neural network multiclass classifiers was implemented. Multi-modal classification using galvanic skin response (GSR) in addition to the same EEG signals and using the same types of classifiers produced increased accuracy with respect to the unimodal case (90 percent vs. 86 percent), although only via the deep neural network classifier. These initial results are a first step toward the goal of demonstrating simultaneous real time classification of multiple states using multiple sensing modalities in high-fidelity flight simulators. This detection is intended to support and inform training methods under development to mitigate the loss of ASA and thus reduce accidents and incidents.

Being First Matters: Topographical Representational Similarity Analysis of ERP Signals Reveals Separate Networks for Audiovisual Temporal Binding Depending on the Leading Sense.

PubMed

Cecere, Roberto; Gross, Joachim; Willis, Ashleigh; Thut, Gregor

2017-05-24

In multisensory integration, processing in one sensory modality is enhanced by complementary information from other modalities. Intersensory timing is crucial in this process because only inputs reaching the brain within a restricted temporal window are perceptually bound. Previous research in the audiovisual field has investigated various features of the temporal binding window, revealing asymmetries in its size and plasticity depending on the leading input: auditory-visual (AV) or visual-auditory (VA). Here, we tested whether separate neuronal mechanisms underlie this AV-VA dichotomy in humans. We recorded high-density EEG while participants performed an audiovisual simultaneity judgment task including various AV-VA asynchronies and unisensory control conditions (visual-only, auditory-only) and tested whether AV and VA processing generate different patterns of brain activity. After isolating the multisensory components of AV-VA event-related potentials (ERPs) from the sum of their unisensory constituents, we ran a time-resolved topographical representational similarity analysis (tRSA) comparing the AV and VA ERP maps. Spatial cross-correlation matrices were built from real data to index the similarity between the AV and VA maps at each time point (500 ms window after stimulus) and then correlated with two alternative similarity model matrices: AV maps = VA maps versus AV maps ≠ VA maps The tRSA results favored the AV maps ≠ VA maps model across all time points, suggesting that audiovisual temporal binding (indexed by synchrony perception) engages different neural pathways depending on the leading sense. The existence of such dual route supports recent theoretical accounts proposing that multiple binding mechanisms are implemented in the brain to accommodate different information parsing strategies in auditory and visual sensory systems. SIGNIFICANCE STATEMENT Intersensory timing is a crucial aspect of multisensory integration, determining whether and how inputs in one modality enhance stimulus processing in another modality. Our research demonstrates that evaluating synchrony of auditory-leading (AV) versus visual-leading (VA) audiovisual stimulus pairs is characterized by two distinct patterns of brain activity. This suggests that audiovisual integration is not a unitary process and that different binding mechanisms are recruited in the brain based on the leading sense. These mechanisms may be relevant for supporting different classes of multisensory operations, for example, auditory enhancement of visual attention (AV) and visual enhancement of auditory speech (VA). Copyright © 2017 Cecere et al.

Being First Matters: Topographical Representational Similarity Analysis of ERP Signals Reveals Separate Networks for Audiovisual Temporal Binding Depending on the Leading Sense

PubMed Central

2017-01-01

In multisensory integration, processing in one sensory modality is enhanced by complementary information from other modalities. Intersensory timing is crucial in this process because only inputs reaching the brain within a restricted temporal window are perceptually bound. Previous research in the audiovisual field has investigated various features of the temporal binding window, revealing asymmetries in its size and plasticity depending on the leading input: auditory–visual (AV) or visual–auditory (VA). Here, we tested whether separate neuronal mechanisms underlie this AV–VA dichotomy in humans. We recorded high-density EEG while participants performed an audiovisual simultaneity judgment task including various AV–VA asynchronies and unisensory control conditions (visual-only, auditory-only) and tested whether AV and VA processing generate different patterns of brain activity. After isolating the multisensory components of AV–VA event-related potentials (ERPs) from the sum of their unisensory constituents, we ran a time-resolved topographical representational similarity analysis (tRSA) comparing the AV and VA ERP maps. Spatial cross-correlation matrices were built from real data to index the similarity between the AV and VA maps at each time point (500 ms window after stimulus) and then correlated with two alternative similarity model matrices: AVmaps = VAmaps versus AVmaps ≠ VAmaps. The tRSA results favored the AVmaps ≠ VAmaps model across all time points, suggesting that audiovisual temporal binding (indexed by synchrony perception) engages different neural pathways depending on the leading sense. The existence of such dual route supports recent theoretical accounts proposing that multiple binding mechanisms are implemented in the brain to accommodate different information parsing strategies in auditory and visual sensory systems. SIGNIFICANCE STATEMENT Intersensory timing is a crucial aspect of multisensory integration, determining whether and how inputs in one modality enhance stimulus processing in another modality. Our research demonstrates that evaluating synchrony of auditory-leading (AV) versus visual-leading (VA) audiovisual stimulus pairs is characterized by two distinct patterns of brain activity. This suggests that audiovisual integration is not a unitary process and that different binding mechanisms are recruited in the brain based on the leading sense. These mechanisms may be relevant for supporting different classes of multisensory operations, for example, auditory enhancement of visual attention (AV) and visual enhancement of auditory speech (VA). PMID:28450537

Sense, decide, act, communicate (SDAC): next generation of smart sensor systems

NASA Astrophysics Data System (ADS)

Berry, Nina; Davis, Jesse; Ko, Teresa H.; Kyker, Ron; Pate, Ron; Stark, Doug; Stinnett, Regan; Baker, James; Cushner, Adam; Van Dyke, Colin; Kyckelhahn, Brian

2004-09-01

The recent war on terrorism and increased urban warfare has been a major catalysis for increased interest in the development of disposable unattended wireless ground sensors. While the application of these sensors to hostile domains has been generally governed by specific tasks, this research explores a unique paradigm capitalizing on the fundamental functionality related to sensor systems. This functionality includes a sensors ability to Sense - multi-modal sensing of environmental events, Decide - smart analysis of sensor data, Act - response to environmental events, and Communication - internal to system and external to humans (SDAC). The main concept behind SDAC sensor systems is to integrate the hardware, software, and networking to generate 'knowledge and not just data'. This research explores the usage of wireless SDAC units to collectively make up a sensor system capable of persistent, adaptive, and autonomous behavior. These systems are base on the evaluation of scenarios and existing systems covering various domains. This paper presents a promising view of sensor network characteristics, which will eventually yield smart (intelligent collectives) network arrays of SDAC sensing units generally applicable to multiple related domains. This paper will also discuss and evaluate the demonstration system developed to test the concepts related to SDAC systems.

Flexible Skins Containing Integrated Sensors and Circuitry

NASA Technical Reports Server (NTRS)

Liu, Chang

2007-01-01

Artificial sensor skins modeled partly in imitation of biological sensor skins are undergoing development. These sensor skins comprise flexible polymer substrates that contain and/or support dense one- and two-dimensional arrays of microscopic sensors and associated microelectronic circuits. They afford multiple tactile sensing modalities for measuring physical phenomena that can include contact forces; hardnesses, temperatures, and thermal conductivities of objects with which they are in contact; and pressures, shear stresses, and flow velocities in fluids. The sensor skins are mechanically robust, and, because of their flexibility, they can be readily attached to curved and possibly moving and flexing surfaces of robots, wind-tunnel models, and other objects that one might seek to equip for tactile sensing. Because of the diversity of actual and potential sensor-skin design criteria and designs and the complexity of the fabrication processes needed to realize the designs, it is not possible to describe the sensor-skin concept in detail within this article.

Integration of Fiber-Optic Sensor Arrays into a Multi-Modal Tactile Sensor Processing System for Robotic End-Effectors

PubMed Central

Kampmann, Peter; Kirchner, Frank

2014-01-01

With the increasing complexity of robotic missions and the development towards long-term autonomous systems, the need for multi-modal sensing of the environment increases. Until now, the use of tactile sensor systems has been mostly based on sensing one modality of forces in the robotic end-effector. The use of a multi-modal tactile sensory system is motivated, which combines static and dynamic force sensor arrays together with an absolute force measurement system. This publication is focused on the development of a compact sensor interface for a fiber-optic sensor array, as optic measurement principles tend to have a bulky interface. Mechanical, electrical and software approaches are combined to realize an integrated structure that provides decentralized data pre-processing of the tactile measurements. Local behaviors are implemented using this setup to show the effectiveness of this approach. PMID:24743158

Optically defined modal sensors incorporating spiropyran-doped liquid crystals with piezoelectric sensors.

PubMed

Chen, Kuan-Ting; Chang, Chin-Kai; Kuo, Hui-Lung; Lee, Chih-Kung

2011-01-01

We integrated a piezoelectric sensing layer lamina containing liquid crystals (LC) and spiropyran (SP) in a LC/SP mixture to create an optically reconfigurable modal sensor for a cantilever beam. The impedance of this LC/SP lamina was decreased by UV irradiation which constituted the underlying mechanism to modulate the voltage externally applied to the piezoelectric actuating layer. Illuminating a specific pattern onto the LC/SP lamina provided us with a way to spatially modulate the piezoelectric vibration signal. We showed that if an UV illuminated pattern matches the strain distribution of a specific mode, a piezoelectric modal sensor can be created. Since UV illumination can be changed in situ in real-time, our results confirm for the first time since the inception of smart sensors, that an optically tailored modal sensor can be created. Some potential applications of this type of sensor include energy harvesting devices, bio-chips, vibration sensing and actuating devices.

A Visual Narrative Inquiry into Children's Sense of Agency in Preschool and First Grade

ERIC Educational Resources Information Center

Sairanen, Heidi; Kumpulainen, Kristiina

2014-01-01

This socioculturally framed case study focuses on children's sense of agency in educational settings. The study has two objectives: (a) to portray the modalities of children's sense of agency in preschool and first grade settings, and (b) to identify the sociocultural resources that mediate children's sense of agency in these two activity…

Psychophysical evidence for the number sense.

PubMed

Burr, David C; Anobile, Giovanni; Arrighi, Roberto

2017-02-19

It is now clear that most animals, including humans, possess an ability to rapidly estimate number. Some have questioned whether this ability arises from dedicated numerosity mechanisms, or is derived indirectly from judgements of density or other attributes. We describe a series of psychophysical experiments, largely using adaptation techniques, which demonstrate clearly the existence of a number sense in humans. The number sense is truly general, extending over space, time and sensory modality, and is closely linked with action. We further show that when multiple cues are present, numerosity emerges as the natural dimension for discrimination. However, when element density increases past a certain level, the elements become too crowded to parse, and the scene is perceived as a texture rather than array of elements. The two different regimes are psychophysically discriminable in that they follow distinct psychophysical laws, and show different dependencies on eccentricity, luminance levels and effects of perceptual grouping. The distinction is important, as the ability to discriminate numerosity, but not texture, correlates with formal maths skills.This article is part of the discussion meeting issue 'The origins of numerical abilities'. © 2017 The Authors.

Psychophysical evidence for the number sense

PubMed Central

2018-01-01

It is now clear that most animals, including humans, possess an ability to rapidly estimate number. Some have questioned whether this ability arises from dedicated numerosity mechanisms, or is derived indirectly from judgements of density or other attributes. We describe a series of psychophysical experiments, largely using adaptation techniques, which demonstrate clearly the existence of a number sense in humans. The number sense is truly general, extending over space, time and sensory modality, and is closely linked with action. We further show that when multiple cues are present, numerosity emerges as the natural dimension for discrimination. However, when element density increases past a certain level, the elements become too crowded to parse, and the scene is perceived as a texture rather than array of elements. The two different regimes are psychophysically discriminable in that they follow distinct psychophysical laws, and show different dependencies on eccentricity, luminance levels and effects of perceptual grouping. The distinction is important, as the ability to discriminate numerosity, but not texture, correlates with formal maths skills. This article is part of the discussion meeting issue ‘The origins of numerical abilities’. PMID:29292350

Electromagnetic pulsed thermography for natural cracks inspection

PubMed Central

Gao, Yunlai; Tian, Gui Yun; Wang, Ping; Wang, Haitao; Gao, Bin; Woo, Wai Lok; Li, Kongjing

2017-01-01

Emerging integrated sensing and monitoring of material degradation and cracks are increasingly required for characterizing the structural integrity and safety of infrastructure. However, most conventional nondestructive evaluation (NDE) methods are based on single modality sensing which is not adequate to evaluate structural integrity and natural cracks. This paper proposed electromagnetic pulsed thermography for fast and comprehensive defect characterization. It hybrids multiple physical phenomena i.e. magnetic flux leakage, induced eddy current and induction heating linking to physics as well as signal processing algorithms to provide abundant information of material properties and defects. New features are proposed using 1st derivation that reflects multiphysics spatial and temporal behaviors to enhance the detection of cracks with different orientations. Promising results that robust to lift-off changes and invariant features for artificial and natural cracks detection have been demonstrated that the proposed method significantly improves defect detectability. It opens up multiphysics sensing and integrated NDE with potential impact for natural understanding and better quantitative evaluation of natural cracks including stress corrosion crack (SCC) and rolling contact fatigue (RCF). PMID:28169361

Human grasping database for activities of daily living with depth, color and kinematic data streams.

PubMed

Saudabayev, Artur; Rysbek, Zhanibek; Khassenova, Raykhan; Varol, Huseyin Atakan

2018-05-29

This paper presents a grasping database collected from multiple human subjects for activities of daily living in unstructured environments. The main strength of this database is the use of three different sensing modalities: color images from a head-mounted action camera, distance data from a depth sensor on the dominant arm and upper body kinematic data acquired from an inertial motion capture suit. 3826 grasps were identified in the data collected during 9-hours of experiments. The grasps were grouped according to a hierarchical taxonomy into 35 different grasp types. The database contains information related to each grasp and associated sensor data acquired from the three sensor modalities. We also provide our data annotation software written in Matlab as an open-source tool. The size of the database is 172 GB. We believe this database can be used as a stepping stone to develop big data and machine learning techniques for grasping and manipulation with potential applications in rehabilitation robotics and intelligent automation.

Contrast-based sensorless adaptive optics for retinal imaging.

PubMed

Zhou, Xiaolin; Bedggood, Phillip; Bui, Bang; Nguyen, Christine T O; He, Zheng; Metha, Andrew

2015-09-01

Conventional adaptive optics ophthalmoscopes use wavefront sensing methods to characterize ocular aberrations for real-time correction. However, there are important situations in which the wavefront sensing step is susceptible to difficulties that affect the accuracy of the correction. To circumvent these, wavefront sensorless adaptive optics (or non-wavefront sensing AO; NS-AO) imaging has recently been developed and has been applied to point-scanning based retinal imaging modalities. In this study we show, for the first time, contrast-based NS-AO ophthalmoscopy for full-frame in vivo imaging of human and animal eyes. We suggest a robust image quality metric that could be used for any imaging modality, and test its performance against other metrics using (physical) model eyes.

Matching Teaching and Learning Styles.

ERIC Educational Resources Information Center

Caudill, Gil

1998-01-01

Outlines three basic learning modalities--auditory, visual, and tactile--and notes that technology can help incorporate multiple modalities within each lesson, to meet the needs of most students. Discusses the importance in multiple modality teaching of effectively assessing students. Presents visual, auditory and tactile activity suggestions.…

Superresolution parallel magnetic resonance imaging: Application to functional and spectroscopic imaging

PubMed Central

Otazo, Ricardo; Lin, Fa-Hsuan; Wiggins, Graham; Jordan, Ramiro; Sodickson, Daniel; Posse, Stefan

2009-01-01

Standard parallel magnetic resonance imaging (MRI) techniques suffer from residual aliasing artifacts when the coil sensitivities vary within the image voxel. In this work, a parallel MRI approach known as Superresolution SENSE (SURE-SENSE) is presented in which acceleration is performed by acquiring only the central region of k-space instead of increasing the sampling distance over the complete k-space matrix and reconstruction is explicitly based on intra-voxel coil sensitivity variation. In SURE-SENSE, parallel MRI reconstruction is formulated as a superresolution imaging problem where a collection of low resolution images acquired with multiple receiver coils are combined into a single image with higher spatial resolution using coil sensitivities acquired with high spatial resolution. The effective acceleration of conventional gradient encoding is given by the gain in spatial resolution, which is dictated by the degree of variation of the different coil sensitivity profiles within the low resolution image voxel. Since SURE-SENSE is an ill-posed inverse problem, Tikhonov regularization is employed to control noise amplification. Unlike standard SENSE, for which acceleration is constrained to the phase-encoding dimension/s, SURE-SENSE allows acceleration along all encoding directions — for example, two-dimensional acceleration of a 2D echo-planar acquisition. SURE-SENSE is particularly suitable for low spatial resolution imaging modalities such as spectroscopic imaging and functional imaging with high temporal resolution. Application to echo-planar functional and spectroscopic imaging in human brain is presented using two-dimensional acceleration with a 32-channel receiver coil. PMID:19341804

Smooth adaptive sliding mode vibration control of a flexible parallel manipulator with multiple smart linkages in modal space

NASA Astrophysics Data System (ADS)

Zhang, Quan; Li, Chaodong; Zhang, Jiantao; Zhang, Jianhui

2017-12-01

This paper addresses the dynamic model and active vibration control of a rigid-flexible parallel manipulator with three smart links actuated by three linear ultrasonic motors. To suppress the vibration of three flexible intermediate links under high speed and acceleration, multiple Lead Zirconium Titanate (PZT) sensors and actuators are collocated mounted on each link, forming a smart structure which can achieve self-sensing and self-actuating. The dynamic characteristics and equations of the flexible link incorporated with the PZT sensors and actuator are analyzed and formulated. The smooth adaptive sliding mode based active vibration control is proposed to suppress the vibration of the smart links, and the first and second modes of the three links are targeted to be suppressed in modal space to avoid the spillover phenomenon. Simulations and experiments are implemented to validate the effectiveness of the smart structures and the proposed control laws. Experimental results show that the vibration of the first mode around 92 Hz and the second mode around 240 Hz of the three smart links are reduced respectively by 64.98%, 59.47%, 62.28%, and 45.80%, 36.79%, 33.33%, which further verify the multi-mode vibration control ability of the smooth adaptive sliding mode control law.

Active touch sensing

PubMed Central

Prescott, Tony J.; Diamond, Mathew E.; Wing, Alan M.

2011-01-01

Active sensing systems are purposive and information-seeking sensory systems. Active sensing usually entails sensor movement, but more fundamentally, it involves control of the sensor apparatus, in whatever manner best suits the task, so as to maximize information gain. In animals, active sensing is perhaps most evident in the modality of touch. In this theme issue, we look at active touch across a broad range of species from insects, terrestrial and marine mammals, through to humans. In addition to analysing natural touch, we also consider how engineering is beginning to exploit physical analogues of these biological systems so as to endow robots with rich tactile sensing capabilities. The different contributions show not only the varieties of active touch—antennae, whiskers and fingertips—but also their commonalities. They explore how active touch sensing has evolved in different animal lineages, how it serves to provide rapid and reliable cues for controlling ongoing behaviour, and even how it can disintegrate when our brains begin to fail. They demonstrate that research on active touch offers a means both to understand this essential and primary sensory modality, and to investigate how animals, including man, combine movement with sensing so as to make sense of, and act effectively in, the world. PMID:21969680

Condition assessment of reinforced concrete beams using dynamic data measured with distributed long-gage macro-strain sensors

NASA Astrophysics Data System (ADS)

Hong, W.; Wu, Z. S.; Yang, C. Q.; Wan, C. F.; Wu, G.; Zhang, Y. F.

2012-06-01

A new condition assessment strategy of reinforced concrete (RC) beams is proposed in this paper. This strategy is based on frequency analysis of the dynamic data measured with distributed long-gage macro-stain sensors. After extracting modal macro-strain, the reference-based damage index is theoretically deducted in which the variations of modal flexural rigidity and modal neutral axis height are considered. The reference-free damage index is also presented for comparison. Both finite element simulation and experiment investigations were carried out to verify the proposed method. The manufacturing procedure of long-gage fiber Bragg grating (FBG) sensor chosen in the experiment is firstly presented, followed by an experimental study on the essential sensing properties of the long-gage macro-strain sensors and the results verify the excellent sensing properties, in particular the measurement accuracy and dynamic measuring capacity. Modal analysis results of a concrete beam show that the damage appearing in the beam can be well identified by the damage index while the vibration testing results of a RC beam show that the proposed method can not only capture small crack initiation but its propagation. It can be concluded that distributed long-gage dynamic macro-strain sensing technique has great potential for the condition assessment of RC structures subjected to dynamic loading.

On performing concepts during science lectures

NASA Astrophysics Data System (ADS)

Pozzer-Ardenghi, Lilian; Roth, Wolff-Michael

2007-01-01

When lecturing, teachers make use of both verbal and nonverbal communication. What is called teaching, therefore, involves not only the words and sentences a teacher utters and writes on the board during a lesson, but also all the hands/arms gestures, body movements, and facial expressions a teacher performs in the classroom. All of these communicative modalities constitute resources that are made available to students for making sense of and learning from lectures. Yet in the literature on teaching science, these other means of communication are little investigated and understood - and, correspondingly, they are undertheorized. The purpose of this position paper is to argue for a different view of concepts in lectures: they are performed simultaneously drawing on and producing multiple resources that are different expressions of the same holistic meaning unit. To support our point, we provide examples from a database of 26 lectures in a 12th-grade biology class, where the human body was the main topic of study. We analyze how different types of resources - including verbal and nonverbal discourse and various material artifacts - interact during lectures. We provide evidence for the unified production of these various sense-making resources during teaching to constitute a meaning unit, and we emphasize particularly the use of gestures and body orientations inside this meaning unit. We suggest that proper analyses of meaning units need to take into account not only language and diagrams but also a lecturer's pointing and depicting gestures, body positions, and the relationships between these different modalities. Scientific knowledge (conceptions) exists in the concurrent display of all sense-making resources, which we, following Vygotsky, understand as forming a unit (identity) of nonidentical entities.

Contrast-based sensorless adaptive optics for retinal imaging

PubMed Central

Zhou, Xiaolin; Bedggood, Phillip; Bui, Bang; Nguyen, Christine T.O.; He, Zheng; Metha, Andrew

2015-01-01

Conventional adaptive optics ophthalmoscopes use wavefront sensing methods to characterize ocular aberrations for real-time correction. However, there are important situations in which the wavefront sensing step is susceptible to difficulties that affect the accuracy of the correction. To circumvent these, wavefront sensorless adaptive optics (or non-wavefront sensing AO; NS-AO) imaging has recently been developed and has been applied to point-scanning based retinal imaging modalities. In this study we show, for the first time, contrast-based NS-AO ophthalmoscopy for full-frame in vivo imaging of human and animal eyes. We suggest a robust image quality metric that could be used for any imaging modality, and test its performance against other metrics using (physical) model eyes. PMID:26417525

Hybrid-modality high-resolution imaging: for diagnostic biomedical imaging and sensing for disease diagnosis

NASA Astrophysics Data System (ADS)

Murukeshan, Vadakke M.; Hoong Ta, Lim

2014-11-01

Medical diagnostics in the recent past has seen the challenging trend to come up with dual and multi-modality imaging for implementing better diagnostic procedures. The changes in tissues in the early disease stages are often subtle and can occur beneath the tissue surface. In most of these cases, conventional types of medical imaging using optics may not be able to detect these changes easily due to its penetration depth of the orders of 1 mm. Each imaging modality has its own advantages and limitations, and the use of a single modality is not suitable for every diagnostic applications. Therefore the need for multi or hybrid-modality imaging arises. Combining more than one imaging modalities overcomes the limitation of individual imaging method and integrates the respective advantages into a single setting. In this context, this paper will be focusing on the research and development of two multi-modality imaging platforms. The first platform combines ultrasound and photoacoustic imaging for diagnostic applications in the eye. The second platform consists of optical hyperspectral and photoacoustic imaging for diagnostic applications in the colon. Photoacoustic imaging is used as one of the modalities in both platforms as it can offer deeper penetration depth compared to optical imaging. The optical engineering and research challenges in developing the dual/multi-modality platforms will be discussed, followed by initial results validating the proposed scheme. The proposed schemes offer high spatial and spectral resolution imaging and sensing, and is expected to offer potential biomedical imaging solutions in the near future.

Demonstration of UAV deployment and control of mobile wireless sensing networks for modal analysis of structures

NASA Astrophysics Data System (ADS)

Zhou, Hao; Hirose, Mitsuhito; Greenwood, William; Xiao, Yong; Lynch, Jerome; Zekkos, Dimitrios; Kamat, Vineet

2016-04-01

Unmanned aerial vehicles (UAVs) can serve as a powerful mobile sensing platform for assessing the health of civil infrastructure systems. To date, the majority of their uses have been dedicated to vision and laser-based spatial imaging using on-board cameras and LiDAR units, respectively. Comparatively less work has focused on integration of other sensing modalities relevant to structural monitoring applications. The overarching goal of this study is to explore the ability for UAVs to deploy a network of wireless sensors on structures for controlled vibration testing. The study develops a UAV platform with an integrated robotic gripper that can be used to install wireless sensors in structures, drop a heavy weight for the introduction of impact loads, and to uninstall wireless sensors for reinstallation elsewhere. A pose estimation algorithm is embedded in the UAV to estimate the location of the UAV during sensor placement and impact load introduction. The Martlet wireless sensor network architecture is integrated with the UAV to provide the UAV a mobile sensing capability. The UAV is programmed to command field deployed Martlets, aggregate and temporarily store data from the wireless sensor network, and to communicate data to a fixed base station on site. This study demonstrates the integrated UAV system using a simply supported beam in the lab with Martlet wireless sensors placed by the UAV and impact load testing performed. The study verifies the feasibility of the integrated UAV-wireless monitoring system architecture with accurate modal characteristics of the beam estimated by modal analysis.

Bright Sneezes and Dark Coughs, Loud Sunlight and Soft Moonlight.

ERIC Educational Resources Information Center

Marks, Lawrence E.

1982-01-01

In a series of four experiments, subjects used scales of loudness, pitch, and brightness to evaluate the meanings of a variety of synesthetic metaphors--expressions in which words or phrases describing experiences proper to one sense modality transfer their meaning to another modality. (Author/PN)

Wearable sensors: modalities, challenges, and prospects.

PubMed

Heikenfeld, J; Jajack, A; Rogers, J; Gutruf, P; Tian, L; Pan, T; Li, R; Khine, M; Kim, J; Wang, J; Kim, J

2018-01-16

Wearable sensors have recently seen a large increase in both research and commercialization. However, success in wearable sensors has been a mix of both progress and setbacks. Most of commercial progress has been in smart adaptation of existing mechanical, electrical and optical methods of measuring the body. This adaptation has involved innovations in how to miniaturize sensing technologies, how to make them conformal and flexible, and in the development of companion software that increases the value of the measured data. However, chemical sensing modalities have experienced greater challenges in commercial adoption, especially for non-invasive chemical sensors. There have also been significant challenges in making significant fundamental improvements to existing mechanical, electrical, and optical sensing modalities, especially in improving their specificity of detection. Many of these challenges can be understood by appreciating the body's surface (skin) as more of an information barrier than as an information source. With a deeper understanding of the fundamental challenges faced for wearable sensors and of the state-of-the-art for wearable sensor technology, the roadmap becomes clearer for creating the next generation of innovations and breakthroughs.

Dynamic modal estimation using instrumental variables

NASA Technical Reports Server (NTRS)

Salzwedel, H.

1980-01-01

A method to determine the modes of dynamical systems is described. The inputs and outputs of a system are Fourier transformed and averaged to reduce the error level. An instrumental variable method that estimates modal parameters from multiple correlations between responses of single input, multiple output systems is applied to estimate aircraft, spacecraft, and off-shore platform modal parameters.

Multi-Modal Nano-Probes for Radionuclide and 5-color Near Infrared Optical Lymphatic Imaging

PubMed Central

Kobayashi, Hisataka; Koyama, Yoshinori; Barrett, Tristan; Hama, Yukihiro; Regino, Celeste A. S.; Shin, In Soo; Jang, Beom-Su; Le, Nhat; Paik, Chang H.; Choyke, Peter L.; Urano, Yasuteru

2008-01-01

Current contrast agents generally have one function and can only be imaged in monochrome, therefore, the majority of imaging methods can only impart uniparametric information. A single nano-particle has the potential to be loaded with multiple payloads. Such multi-modality probes have the ability to be imaged by more than one imaging technique, which could compensate for the weakness or even combine the advantages of each individual modality. Furthermore, optical imaging using different optical probes enables us to achieve multi-color in vivo imaging, wherein multiple parameters can be read from a single image. To allow differentiation of multiple optical signals in vivo, each probe should have a close but different near infrared emission. To this end, we synthesized nano-probes with multi-modal and multi-color potential, which employed a polyamidoamine dendrimer platform linked to both radionuclides and optical probes, permitting dual-modality scintigraphic and 5-color near infrared optical lymphatic imaging using a multiple excitation spectrally-resolved fluorescence imaging technique. PMID:19079788

An Holistic Approach for Counsellors: Embracing Multiple Intelligences

ERIC Educational Resources Information Center

Booth, Rosslyn; O'Brien, Patrick John

2008-01-01

This paper explores a range of therapeutic modalities used by counsellors of children and positions those modalities within Gardner's theory of multiple intelligences. Research by O'Brien ("Gardner's theory of multiple intelligence and its implications for the counselling of children." Unpublished doctoral dissertation, Queensland University of…

Parallel Processing Strategies of the Primate Visual System

PubMed Central

Nassi, Jonathan J.; Callaway, Edward M.

2009-01-01

Preface Incoming sensory information is sent to the brain along modality-specific channels corresponding to the five senses. Each of these channels further parses the incoming signals into parallel streams to provide a compact, efficient input to the brain. Ultimately, these parallel input signals must be elaborated upon and integrated within the cortex to provide a unified and coherent percept. Recent studies in the primate visual cortex have greatly contributed to our understanding of how this goal is accomplished. Multiple strategies including retinal tiling, hierarchical and parallel processing and modularity, defined spatially and by cell type-specific connectivity, are all used by the visual system to recover the rich detail of our visual surroundings. PMID:19352403

Effects of auditory and visual modalities in recall of words.

PubMed

Gadzella, B M; Whitehead, D A

1975-02-01

Ten experimental conditions were used to study the effects of auditory and visual (printed words, uncolored and colored pictures) modalities and their various combinations with college students. A recall paradigm was employed in which subjects responded in a written test. Analysis of data showed the auditory modality was superior to visual (pictures) ones but was not significantly different from visual (printed words) modality. In visual modalities, printed words were superior to colored pictures. Generally, conditions with multiple modes of representation of stimuli were significantly higher than for conditions with single modes. Multiple modalities, consisting of two or three modes, did not differ significantly from each other. It was concluded that any two modalities of the stimuli presented simultaneously were just as effective as three in recall of stimulus words.

Classification and data acquisition with incomplete data

NASA Astrophysics Data System (ADS)

Williams, David P.

In remote-sensing applications, incomplete data can result when only a subset of sensors (e.g., radar, infrared, acoustic) are deployed at certain regions. The limitations of single sensor systems have spurred interest in employing multiple sensor modalities simultaneously. For example, in land mine detection tasks, different sensor modalities are better-suited to capture different aspects of the underlying physics of the mines. Synthetic aperture radar sensors may be better at detecting surface mines, while infrared sensors may be better at detecting buried mines. By employing multiple sensor modalities to address the detection task, the strengths of the disparate sensors can be exploited in a synergistic manner to improve performance beyond that which would be achievable with either single sensor alone. When multi-sensor approaches are employed, however, incomplete data can be manifested. If each sensor is located on a separate platform ( e.g., aircraft), each sensor may interrogate---and hence collect data over---only partially overlapping areas of land. As a result, some data points may be characterized by data (i.e., features) from only a subset of the possible sensors employed in the task. Equivalently, this scenario implies that some data points will be missing features. Increasing focus in the future on using---and fusing data from---multiple sensors will make such incomplete-data problems commonplace. In many applications involving incomplete data, it is possible to acquire the missing data at a cost. In multi-sensor remote-sensing applications, data is acquired by deploying sensors to data points. Acquiring data is usually an expensive, time-consuming task, a fact that necessitates an intelligent data acquisition process. Incomplete data is not limited to remote-sensing applications, but rather, can arise in virtually any data set. In this dissertation, we address the general problem of classification when faced with incomplete data. We also address the closely related problem of active data acquisition, which develops a strategy to acquire missing features and labels that will most benefit the classification task. We first address the general problem of classification with incomplete data, maintaining the view that all data (i.e., information) is valuable. We employ a logistic regression framework within which we formulate a supervised classification algorithm for incomplete data. This principled, yet flexible, framework permits several interesting extensions that allow all available data to be utilized. One extension incorporates labeling error, which permits the usage of potentially imperfectly labeled data in learning a classifier. A second major extension converts the proposed algorithm to a semi-supervised approach by utilizing unlabeled data via graph-based regularization. Finally, the classification algorithm is extended to the case in which (image) data---from which features are extracted---are available from multiple resolutions. Taken together, this family of incomplete-data classification algorithms exploits all available data in a principled manner by avoiding explicit imputation. Instead, missing data is integrated out analytically with the aid of an estimated conditional density function (conditioned on the observed features). This feat is accomplished by invoking only mild assumptions. We also address the problem of active data acquisition by determining which missing data should be acquired to most improve performance. Specifically, we examine this data acquisition task when the data to be acquired can be either labels or features. The proposed approach is based on a criterion that accounts for the expected benefit of the acquisition. This approach, which is applicable for any general missing data problem, exploits the incomplete-data classification framework introduced in the first part of this dissertation. This data acquisition approach allows for the acquisition of both labels and features. Moreover, several types of feature acquisition are permitted, including the acquisition of individual or multiple features for individual or multiple data points, which may be either labeled or unlabeled. Furthermore, if different types of data acquisition are feasible for a given application, the algorithm will automatically determine the most beneficial type of data to acquire. Experimental results on both benchmark machine learning data sets and real (i.e., measured) remote-sensing data demonstrate the advantages of the proposed incomplete-data classification and active data acquisition algorithms.

Sensor fusion approaches for EMI and GPR-based subsurface threat identification

NASA Astrophysics Data System (ADS)

Torrione, Peter; Morton, Kenneth, Jr.; Besaw, Lance E.

2011-06-01

Despite advances in both electromagnetic induction (EMI) and ground penetrating radar (GPR) sensing and related signal processing, neither sensor alone provides a perfect tool for detecting the myriad of possible buried objects that threaten the lives of Soldiers and civilians. However, while neither GPR nor EMI sensing alone can provide optimal detection across all target types, the two approaches are highly complementary. As a result, many landmine systems seek to make use of both sensing modalities simultaneously and fuse the results from both sensors to improve detection performance for targets with widely varying metal content and GPR responses. Despite this, little work has focused on large-scale comparisons of different approaches to sensor fusion and machine learning for combining data from these highly orthogonal phenomenologies. In this work we explore a wide array of pattern recognition techniques for algorithm development and sensor fusion. Results with the ARA Nemesis landmine detection system suggest that nonlinear and non-parametric classification algorithms provide significant performance benefits for single-sensor algorithm development, and that fusion of multiple algorithms can be performed satisfactorily using basic parametric approaches, such as logistic discriminant classification, for the targets under consideration in our data sets.

The Sense of Agency Is More Sensitive to Manipulations of Outcome than Movement-Related Feedback Irrespective of Sensory Modality

PubMed Central

David, Nicole; Skoruppa, Stefan; Gulberti, Alessandro

2016-01-01

The sense of agency describes the ability to experience oneself as the agent of one's own actions. Previous studies of the sense of agency manipulated the predicted sensory feedback related either to movement execution or to the movement’s outcome, for example by delaying the movement of a virtual hand or the onset of a tone that resulted from a button press. Such temporal sensorimotor discrepancies reduce the sense of agency. It remains unclear whether movement-related feedback is processed differently than outcome-related feedback in terms of agency experience, especially if these types of feedback differ with respect to sensory modality. We employed a mixed-reality setup, in which participants tracked their finger movements by means of a virtual hand. They performed a single tap, which elicited a sound. The temporal contingency between the participants’ finger movements and (i) the movement of the virtual hand or (ii) the expected auditory outcome was systematically varied. In a visual control experiment, the tap elicited a visual outcome. For each feedback type and participant, changes in the sense of agency were quantified using a forced-choice paradigm and the Method of Constant Stimuli. Participants were more sensitive to delays of outcome than to delays of movement execution. This effect was very similar for visual or auditory outcome delays. Our results indicate different contributions of movement- versus outcome-related sensory feedback to the sense of agency, irrespective of the modality of the outcome. We propose that this differential sensitivity reflects the behavioral importance of assessing authorship of the outcome of an action. PMID:27536948

Integration of Multi-Modal Biomedical Data to Predict Cancer Grade and Patient Survival.

PubMed

Phan, John H; Hoffman, Ryan; Kothari, Sonal; Wu, Po-Yen; Wang, May D

2016-02-01

The Big Data era in Biomedical research has resulted in large-cohort data repositories such as The Cancer Genome Atlas (TCGA). These repositories routinely contain hundreds of matched patient samples for genomic, proteomic, imaging, and clinical data modalities, enabling holistic and multi-modal integrative analysis of human disease. Using TCGA renal and ovarian cancer data, we conducted a novel investigation of multi-modal data integration by combining histopathological image and RNA-seq data. We compared the performances of two integrative prediction methods: majority vote and stacked generalization. Results indicate that integration of multiple data modalities improves prediction of cancer grade and outcome. Specifically, stacked generalization, a method that integrates multiple data modalities to produce a single prediction result, outperforms both single-data-modality prediction and majority vote. Moreover, stacked generalization reveals the contribution of each data modality (and specific features within each data modality) to the final prediction result and may provide biological insights to explain prediction performance.

Scalable sensor management for automated fusion and tactical reconnaissance

NASA Astrophysics Data System (ADS)

Walls, Thomas J.; Wilson, Michael L.; Partridge, Darin C.; Haws, Jonathan R.; Jensen, Mark D.; Johnson, Troy R.; Petersen, Brad D.; Sullivan, Stephanie W.

2013-05-01

The capabilities of tactical intelligence, surveillance, and reconnaissance (ISR) payloads are expanding from single sensor imagers to integrated systems-of-systems architectures. Increasingly, these systems-of-systems include multiple sensing modalities that can act as force multipliers for the intelligence analyst. Currently, the separate sensing modalities operate largely independent of one another, providing a selection of operating modes but not an integrated intelligence product. We describe here a Sensor Management System (SMS) designed to provide a small, compact processing unit capable of managing multiple collaborative sensor systems on-board an aircraft. Its purpose is to increase sensor cooperation and collaboration to achieve intelligent data collection and exploitation. The SMS architecture is designed to be largely sensor and data agnostic and provide flexible networked access for both data providers and data consumers. It supports pre-planned and ad-hoc missions, with provisions for on-demand tasking and updates from users connected via data links. Management of sensors and user agents takes place over standard network protocols such that any number and combination of sensors and user agents, either on the local network or connected via data link, can register with the SMS at any time during the mission. The SMS provides control over sensor data collection to handle logging and routing of data products to subscribing user agents. It also supports the addition of algorithmic data processing agents for feature/target extraction and provides for subsequent cueing from one sensor to another. The SMS architecture was designed to scale from a small UAV carrying a limited number of payloads to an aircraft carrying a large number of payloads. The SMS system is STANAG 4575 compliant as a removable memory module (RMM) and can act as a vehicle specific module (VSM) to provide STANAG 4586 compliance (level-3 interoperability) to a non-compliant sensor system. The SMS architecture will be described and results from several flight tests and simulations will be shown.

Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks

NASA Astrophysics Data System (ADS)

Audebert, Nicolas; Le Saux, Bertrand; Lefèvre, Sébastien

2018-06-01

In this work, we investigate various methods to deal with semantic labeling of very high resolution multi-modal remote sensing data. Especially, we study how deep fully convolutional networks can be adapted to deal with multi-modal and multi-scale remote sensing data for semantic labeling. Our contributions are threefold: (a) we present an efficient multi-scale approach to leverage both a large spatial context and the high resolution data, (b) we investigate early and late fusion of Lidar and multispectral data, (c) we validate our methods on two public datasets with state-of-the-art results. Our results indicate that late fusion make it possible to recover errors steaming from ambiguous data, while early fusion allows for better joint-feature learning but at the cost of higher sensitivity to missing data.

Comparative VOCs sensing performance for conducting polymer and porphyrin functionalized carbon nanotubes based sensors

NASA Astrophysics Data System (ADS)

Datta, Kunal; Rushi, Arti; Ghosh, Prasanta; Shirsat, Mahendra

2018-05-01

We report sensors for detection of ethyl alcohol, a prominent volatile organic compound (VOC). Single walled carbon nanotubes were selected as main sensing backbone. As efficiency of sensor is dependent upon the choice of sensing materials, the performances of conducting polymer and porphyrin based sensors were compared. Chemiresistive sensing modality was adopted to observe the performance of sensors. It has been found that porphyrin based sensor shows higher affinity towards ethyl alcohol.

Intranasal Insulin for Improving Cognitive Function in Multiple Sclerosis

DTIC Science & Technology

2017-10-01

Insulin, Symbol Digit Modalities Test , Minimal Assessment of Cognitive Function in Multiple Sclerosis 16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF...going to evaluate if intranasal insulin improves cognition in people with MS, as assessed by standardized cognitive assessment tests . 2. KEYWORDS...Multiple Sclerosis, Cognitive Impairment, Neurodegenerative diseases, Intranasal Insulin, Symbol Digit Modalities Test , Minimal Assessment of Cognitive

Combinations of Multiple Neuroimaging Markers using Logistic Regression for Auxiliary Diagnosis of Alzheimer Disease and Mild Cognitive Impairment.

PubMed

Mao, Nini; Liu, Yunting; Chen, Kewei; Yao, Li; Wu, Xia

2018-06-05

Multiple neuroimaging modalities have been developed providing various aspects of information on the human brain. Used together and properly, these complementary multimodal neuroimaging data integrate multisource information which can facilitate a diagnosis and improve the diagnostic accuracy. In this study, 3 types of brain imaging data (sMRI, FDG-PET, and florbetapir-PET) were fused in the hope to improve diagnostic accuracy, and multivariate methods (logistic regression) were applied to these trimodal neuroimaging indices. Then, the receiver-operating characteristic (ROC) method was used to analyze the outcomes of the logistic classifier, with either each index, multiples from each modality, or all indices from all 3 modalities, to investigate their differential abilities to identify the disease. With increasing numbers of indices within each modality and across modalities, the accuracy of identifying Alzheimer disease (AD) increases to varying degrees. For example, the area under the ROC curve is above 0.98 when all the indices from the 3 imaging data types are combined. Using a combination of different indices, the results confirmed the initial hypothesis that different biomarkers were potentially complementary, and thus the conjoint analysis of multiple information from multiple sources would improve the capability to identify diseases such as AD and mild cognitive impairment. © 2018 S. Karger AG, Basel.

Intrinsic embedded sensors for polymeric mechatronics: flexure and force sensing.

PubMed

Jentoft, Leif P; Dollar, Aaron M; Wagner, Christopher R; Howe, Robert D

2014-02-25

While polymeric fabrication processes, including recent advances in additive manufacturing, have revolutionized manufacturing, little work has been done on effective sensing elements compatible with and embedded within polymeric structures. In this paper, we describe the development and evaluation of two important sensing modalities for embedding in polymeric mechatronic and robotic mechanisms: multi-axis flexure joint angle sensing utilizing IR phototransistors, and a small (12 mm), three-axis force sensing via embedded silicon strain gages with similar performance characteristics as an equally sized metal element based sensor.

Intrinsic Embedded Sensors for Polymeric Mechatronics: Flexure and Force Sensing

PubMed Central

Jentoft, Leif P.; Dollar, Aaron M.; Wagner, Christopher R.; Howe, Robert D.

2014-01-01

While polymeric fabrication processes, including recent advances in additive manufacturing, have revolutionized manufacturing, little work has been done on effective sensing elements compatible with and embedded within polymeric structures. In this paper, we describe the development and evaluation of two important sensing modalities for embedding in polymeric mechatronic and robotic mechanisms: multi-axis flexure joint angle sensing utilizing IR phototransistors, and a small (12 mm), three-axis force sensing via embedded silicon strain gages with similar performance characteristics as an equally sized metal element based sensor. PMID:24573310

A 24-Week Multi-Modality Exercise Program Improves Executive Control in Older Adults with a Self-Reported Cognitive Complaint: Evidence from the Antisaccade Task.

PubMed

Heath, Matthew; Shellington, Erin; Titheridge, Sam; Gill, Dawn P; Petrella, Robert J

2017-01-01

Exercise programs involving aerobic and resistance training (i.e., multiple-modality) have shown promise in improving cognition and executive control in older adults at risk, or experiencing, cognitive decline. It is, however, unclear whether cognitive training within a multiple-modality program elicits an additive benefit to executive/cognitive processes. This is an important question to resolve in order to identify optimal training programs that delay, or ameliorate, executive deficits in persons at risk for further cognitive decline. In the present study, individuals with a self-reported cognitive complaint (SCC) participated in a 24-week multiple-modality (i.e., the M2 group) exercise intervention program. In addition, a separate group of individuals with a SCC completed the same aerobic and resistance training as the M2 group but also completed a cognitive-based stepping task (i.e., multiple-modality, mind-motor intervention: M4 group). Notably, pre- and post-intervention executive control was examined via the antisaccade task (i.e., eye movement mirror-symmetrical to a target). Antisaccades are an ideal tool for the study of individuals with subtle executive deficits because of its hands- and language-free nature and because the task's neural mechanisms are linked to neuropathology in cognitive decline (i.e., prefrontal cortex). Results showed that M2 and M4 group antisaccade reaction times reliably decreased from pre- to post-intervention and the magnitude of the decrease was consistent across groups. Thus, multi-modality exercise training improved executive performance in persons with a SCC independent of mind-motor training. Accordingly, we propose that multiple-modality training provides a sufficient intervention to improve executive control in persons with a SCC.

40 CFR 1033.520 - Alternative ramped modal cycles.

Code of Federal Regulations, 2012 CFR

2012-07-01

...) Following the completion of the third test phase of the applicable ramped modal cycle, conduct the post... POLLUTION CONTROLS CONTROL OF EMISSIONS FROM LOCOMOTIVES Test Procedures § 1033.520 Alternative ramped modal... locomotive notch settings. Ramped modal cycles combine multiple test modes of a discrete-mode steady-state...

Multiple-modality exercise and mind-motor training to improve cardiovascular health and fitness in older adults at risk for cognitive impairment: A randomized controlled trial.

PubMed

Boa Sorte Silva, Narlon C; Gregory, Michael A; Gill, Dawn P; Petrella, Robert J

The effects of multiple-modality exercise on arterial stiffening and cardiovascular fitness has not been fully explored. To explore the influence of a 24-week multiple-modality exercise program associated with a mind-motor training in cardiovascular health and fitness in community-dwelling older adults, compared to multiple-modality exercise (M2) alone. Participants (n=127, aged 67.5 [7.3] years, 71% females) were randomized to either M4 or M2 groups. Both groups received multiple-modality exercise intervention (60min/day, 3days/week for 24-weeks); however, the M4 group underwent additional 15min of mind-motor training, whereas the M2 group received 15min of balance training. Participants were assessed at 24-weeks and after a 28-week non-contact follow-up (52-weeks). at 52-weeks, the M4 group demonstrated a greater VO2max (ml/kg/min) compared to the M2 group (mean difference: 2.39, 95% CI: 0. 61 to 4.16, p=0.009). Within-group analysis indicated that the M4 group demonstrated a positive change in VO2max at 24-weeks (mean change: 1.93, 95% CI: 0.82 to 3.05, p=0.001) and 52-weeks (4.02, 95% CI: 2.71 to 5.32, p=0.001). Similarly, the M2 group increased VO2max at 24-weeks (2.28, 95% CI: 1.23 to 3.32, p<0.001) and 52-weeks (1.63, 95% CI: 0.43 to 2.83, p=0.008). Additionally, the M2 group decreased 24h SBP (mmHg) at 24-weeks (-2.31, 95% CI: -4.61 to -0.01, p=0.049); whereas the M4 group improved 24h DBP (-1.6, 95% CI: -3.03 to -0.17, p=0.028) at 52-weeks. Mind-motor training associated with multiple-modality exercise can positively impact cardiovascular fitness to the same extent as multiple-modality exercise alone. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

A flexible and robust approach for segmenting cell nuclei from 2D microscopy images using supervised learning and template matching

PubMed Central

Chen, Cheng; Wang, Wei; Ozolek, John A.; Rohde, Gustavo K.

2013-01-01

We describe a new supervised learning-based template matching approach for segmenting cell nuclei from microscopy images. The method uses examples selected by a user for building a statistical model which captures the texture and shape variations of the nuclear structures from a given dataset to be segmented. Segmentation of subsequent, unlabeled, images is then performed by finding the model instance that best matches (in the normalized cross correlation sense) local neighborhood in the input image. We demonstrate the application of our method to segmenting nuclei from a variety of imaging modalities, and quantitatively compare our results to several other methods. Quantitative results using both simulated and real image data show that, while certain methods may work well for certain imaging modalities, our software is able to obtain high accuracy across several imaging modalities studied. Results also demonstrate that, relative to several existing methods, the template-based method we propose presents increased robustness in the sense of better handling variations in illumination, variations in texture from different imaging modalities, providing more smooth and accurate segmentation borders, as well as handling better cluttered nuclei. PMID:23568787

Vibration sensing in flexible structures using a distributed-effect modal domain optical fiber sensor

NASA Technical Reports Server (NTRS)

Reichard, Karl M.; Lindner, Douglas K.; Claus, Richard O.

1991-01-01

Modal domain optical fiber sensors have recently been employed in the implementation of system identification algorithms and the closed-loop control of vibrations in flexible structures. The mathematical model of the modal domain optical fiber sensor used in these applications, however, only accounted for the effects of strain in the direction of the fiber's longitudinal axis. In this paper, we extend this model to include the effects of arbitrary stress. Using this sensor model, we characterize the sensor's sensitivity and dynamic range.

Keep meaning in conversational coordination

PubMed Central

Cuffari, Elena C.

2014-01-01

Coordination is a widely employed term across recent quantitative and qualitative approaches to intersubjectivity, particularly approaches that give embodiment and enaction central explanatory roles. With a focus on linguistic and bodily coordination in conversational contexts, I review the operational meaning of coordination in recent empirical research and related theorizing of embodied intersubjectivity. This discussion articulates what must be involved in treating linguistic meaning as dynamic processes of coordination. The coordination approach presents languaging as a set of dynamic self-organizing processes and actions on multiple timescales and across multiple modalities that come about and work in certain domains (those jointly constructed in social, interactive, high-order sense-making). These processes go beyond meaning at the level that is available to first-person experience. I take one crucial consequence of this to be the ubiquitously moral nature of languaging with others. Languaging coordinates experience, among other levels of behavior and event. Ethical effort is called for by the automatic autonomy-influencing forces of languaging as coordination. PMID:25520693

Eigensystem realization algorithm user's guide forVAX/VMS computers: Version 931216

NASA Technical Reports Server (NTRS)

Pappa, Richard S.

1994-01-01

The eigensystem realization algorithm (ERA) is a multiple-input, multiple-output, time domain technique for structural modal identification and minimum-order system realization. Modal identification is the process of calculating structural eigenvalues and eigenvectors (natural vibration frequencies, damping, mode shapes, and modal masses) from experimental data. System realization is the process of constructing state-space dynamic models for modern control design. This user's guide documents VAX/VMS-based FORTRAN software developed by the author since 1984 in conjunction with many applications. It consists of a main ERA program and 66 pre- and post-processors. The software provides complete modal identification capabilities and most system realization capabilities.

A layered abduction model of perception: Integrating bottom-up and top-down processing in a multi-sense agent

NASA Technical Reports Server (NTRS)

Josephson, John R.

1989-01-01

A layered-abduction model of perception is presented which unifies bottom-up and top-down processing in a single logical and information-processing framework. The process of interpreting the input from each sense is broken down into discrete layers of interpretation, where at each layer a best explanation hypothesis is formed of the data presented by the layer or layers below, with the help of information available laterally and from above. The formation of this hypothesis is treated as a problem of abductive inference, similar to diagnosis and theory formation. Thus this model brings a knowledge-based problem-solving approach to the analysis of perception, treating perception as a kind of compiled cognition. The bottom-up passing of information from layer to layer defines channels of information flow, which separate and converge in a specific way for any specific sense modality. Multi-modal perception occurs where channels converge from more than one sense. This model has not yet been implemented, though it is based on systems which have been successful in medical and mechanical diagnosis and medical test interpretation.

Sensing and data classification for a robotic meteorite search

NASA Astrophysics Data System (ADS)

Pedersen, Liam; Apostolopoulos, Dimi; Whittaker, William L.; Benedix, Gretchen; Rousch, Ted

1999-01-01

Upcoming missions to Mars and the mon call for highly autonomous robots with capability to perform intra-site exploration, reason about their scientific finds, and perform comprehensive on-board analysis of data collected. An ideal case for testing such technologies and robot capabilities is the robotic search for Antarctic meteorites. The successful identification and classification of meteorites depends on sensing modalities and intelligent evaluation of acquired data. Data from color imagery and spectroscopic measurements are used to identify terrestrial rocks and distinguish them from meteorites. However, because of the large number of rocks and the high cost and delay of using some of the sensors, it is necessary to eliminate as many meteorite candidates as possible using cheap long range sensors, such as color cameras. More resource consuming sensor will be held in reserve for the more promising samples only. Bayes networks are used as the formalism for incrementally combing data from multiple sources in a statistically rigorous manner. Furthermore, they can be used to infer the utility of further sensor readings given currently known data. This information, along with cost estimates, in necessary for the sensing system to rationally schedule further sensor reading sand deployments. This paper address issues associated with sensor selection and implementation of an architecture for automatic identification of rocks and meteorites from a mobile robot.

Modal control of an oblique wing aircraft

NASA Technical Reports Server (NTRS)

Phillips, James D.

1989-01-01

A linear modal control algorithm is applied to the NASA Oblique Wing Research Aircraft (OWRA). The control law is evaluated using a detailed nonlinear flight simulation. It is shown that the modal control law attenuates the coupling and nonlinear aerodynamics of the oblique wing and remains stable during control saturation caused by large command inputs or large external disturbances. The technique controls each natural mode independently allowing single-input/single-output techniques to be applied to multiple-input/multiple-output systems.

Asian Perspectives on Diagnostic and Therapeutic Strategies in Inflammatory Bowel Disease: Report and Analysis of a Survey with Questionnaires.

PubMed

Yoshida, Atsushi; Ueno, Fumiaki; Morizane, Toshio; Joh, Takashi; Kamiya, Takeshi; Takahashi, Shin''ichi; Tokunaga, Kengo; Iwakiri, Ryuichi; Kinoshita, Yoshikazu; Suzuki, Hidekazu; Naito, Yuji; Uchiyama, Kazuhiko; Fukodo, Shin; Chan, Francis K L; Halm, Ki-Baik; Kachintorn, Udom; Fock, Kwong Ming; Rani, Abdul Aziz; Syam, Ari Fahrial; Sollano, Jose D; Zhu, Qi

2017-01-01

Diagnostic and therapeutic strategies in inflammatory bowel disease (IBD) vary among countries in terms of availability of modalities, affordability of health care resource, health care policy and cultural background. This may be the case in different countries in Eastern Asia. The aim of this study was to determine and understand the differences in diagnostic and therapeutic strategies of IBD between Japan and the rest of Asian countries (ROA). Questionnaires with regard to clinical practice in IBD were distributed to members of the International Gastroenterology Consensus Symposium Study Group. The responders were allowed to select multiple items for each question, as multiple modalities are frequently utilized in the diagnosis and the management of IBD. Dependency and independency of selected items for each question were evaluated by the Bayesian network analysis. The selected diagnostic modalities were not very different between Japan and ROA, except for those related to small bowel investigations. Balloon-assisted enteroscopy and small bowel follow through are frequently used in Japan, while CT/MR enterography is popular in ROA. Therapeutic modalities for IBD depend on availability of such modalities in clinical practice. As far as modalities commonly available in both regions are concerned, there seemed to be similarity in the selection of each therapeutic modality. However, evaluation of dependency of separate therapeutic modalities by Bayesian network analysis disclosed some difference in therapeutic strategies between Japan and ROA. Although selected modalities showed some similarity, Bayesian network analysis elicited certain differences in the clinical approaches combining multiple modalities in various aspects of IBD between Japan and ROA. © 2016 S. Karger AG, Basel.

An Evaluation of Multimodal Interactions with Technology while Learning Science Concepts

ERIC Educational Resources Information Center

Anastopoulou, Stamatina; Sharples, Mike; Baber, Chris

2011-01-01

This paper explores the value of employing multiple modalities to facilitate science learning with technology. In particular, it is argued that when multiple modalities are employed, learners construct strong relations between physical movement and visual representations of motion. Body interactions with visual representations, enabled by…

A 6.45 μW Self-Powered SoC With Integrated Energy-Harvesting Power Management and ULP Asymmetric Radios for Portable Biomedical Systems.

PubMed

Roy, Abhishek; Klinefelter, Alicia; Yahya, Farah B; Chen, Xing; Gonzalez-Guerrero, Luisa Patricia; Lukas, Christopher J; Kamakshi, Divya Akella; Boley, James; Craig, Kyle; Faisal, Muhammad; Oh, Seunghyun; Roberts, Nathan E; Shakhsheer, Yousef; Shrivastava, Aatmesh; Vasudevan, Dilip P; Wentzloff, David D; Calhoun, Benton H

2015-12-01

This paper presents a batteryless system-on-chip (SoC) that operates off energy harvested from indoor solar cells and/or thermoelectric generators (TEGs) on the body. Fabricated in a commercial 0.13 μW process, this SoC sensing platform consists of an integrated energy harvesting and power management unit (EH-PMU) with maximum power point tracking, multiple sensing modalities, programmable core and a low power microcontroller with several hardware accelerators to enable energy-efficient digital signal processing, ultra-low-power (ULP) asymmetric radios for wireless transmission, and a 100 nW wake-up radio. The EH-PMU achieves a peak end-to-end efficiency of 75% delivering power to a 100 μA load. In an example motion detection application, the SoC reads data from an accelerometer through SPI, processes it, and sends it over the radio. The SPI and digital processing consume only 2.27 μW, while the integrated radio consumes 4.18 μW when transmitting at 187.5 kbps for a total of 6.45 μW.

Voxelwise multivariate analysis of multimodality magnetic resonance imaging

PubMed Central

Naylor, Melissa G.; Cardenas, Valerie A.; Tosun, Duygu; Schuff, Norbert; Weiner, Michael; Schwartzman, Armin

2015-01-01

Most brain magnetic resonance imaging (MRI) studies concentrate on a single MRI contrast or modality, frequently structural MRI. By performing an integrated analysis of several modalities, such as structural, perfusion-weighted, and diffusion-weighted MRI, new insights may be attained to better understand the underlying processes of brain diseases. We compare two voxelwise approaches: (1) fitting multiple univariate models, one for each outcome and then adjusting for multiple comparisons among the outcomes and (2) fitting a multivariate model. In both cases, adjustment for multiple comparisons is performed over all voxels jointly to account for the search over the brain. The multivariate model is able to account for the multiple comparisons over outcomes without assuming independence because the covariance structure between modalities is estimated. Simulations show that the multivariate approach is more powerful when the outcomes are correlated and, even when the outcomes are independent, the multivariate approach is just as powerful or more powerful when at least two outcomes are dependent on predictors in the model. However, multiple univariate regressions with Bonferroni correction remains a desirable alternative in some circumstances. To illustrate the power of each approach, we analyze a case control study of Alzheimer's disease, in which data from three MRI modalities are available. PMID:23408378

Cortical plasticity and preserved function in early blindness

PubMed Central

Renier, Laurent; De Volder, Anne G.; Rauschecker, Josef P.

2013-01-01

The “neural Darwinism” theory predicts that when one sensory modality is lacking, as in congenital blindness, the target structures are taken over by the afferent inputs from other senses that will promote and control their functional maturation (Edelman, 1993). This view receives support from both cross-modal plasticity experiments in animal models and functional imaging studies in man, which are presented here. PMID:23453908

Towards Omni-Tomography—Grand Fusion of Multiple Modalities for Simultaneous Interior Tomography

PubMed Central

Wang, Ge; Zhang, Jie; Gao, Hao; Weir, Victor; Yu, Hengyong; Cong, Wenxiang; Xu, Xiaochen; Shen, Haiou; Bennett, James; Furth, Mark; Wang, Yue; Vannier, Michael

2012-01-01

We recently elevated interior tomography from its origin in computed tomography (CT) to a general tomographic principle, and proved its validity for other tomographic modalities including SPECT, MRI, and others. Here we propose “omni-tomography”, a novel concept for the grand fusion of multiple tomographic modalities for simultaneous data acquisition in a region of interest (ROI). Omni-tomography can be instrumental when physiological processes under investigation are multi-dimensional, multi-scale, multi-temporal and multi-parametric. Both preclinical and clinical studies now depend on in vivo tomography, often requiring separate evaluations by different imaging modalities. Over the past decade, two approaches have been used for multimodality fusion: Software based image registration and hybrid scanners such as PET-CT, PET-MRI, and SPECT-CT among others. While there are intrinsic limitations with both approaches, the main obstacle to the seamless fusion of multiple imaging modalities has been the bulkiness of each individual imager and the conflict of their physical (especially spatial) requirements. To address this challenge, omni-tomography is now unveiled as an emerging direction for biomedical imaging and systems biomedicine. PMID:22768108

Manifold Regularized Multitask Feature Learning for Multimodality Disease Classification

PubMed Central

Jie, Biao; Zhang, Daoqiang; Cheng, Bo; Shen, Dinggang

2015-01-01

Multimodality based methods have shown great advantages in classification of Alzheimer’s disease (AD) and its prodromal stage, that is, mild cognitive impairment (MCI). Recently, multitask feature selection methods are typically used for joint selection of common features across multiple modalities. However, one disadvantage of existing multimodality based methods is that they ignore the useful data distribution information in each modality, which is essential for subsequent classification. Accordingly, in this paper we propose a manifold regularized multitask feature learning method to preserve both the intrinsic relatedness among multiple modalities of data and the data distribution information in each modality. Specifically, we denote the feature learning on each modality as a single task, and use group-sparsity regularizer to capture the intrinsic relatedness among multiple tasks (i.e., modalities) and jointly select the common features from multiple tasks. Furthermore, we introduce a new manifold-based Laplacian regularizer to preserve the data distribution information from each task. Finally, we use the multikernel support vector machine method to fuse multimodality data for eventual classification. Conversely, we also extend our method to the semisupervised setting, where only partial data are labeled. We evaluate our method using the baseline magnetic resonance imaging (MRI), fluorodeoxyglucose positron emission tomography (FDG-PET), and cerebrospinal fluid (CSF) data of subjects from AD neuroimaging initiative database. The experimental results demonstrate that our proposed method can not only achieve improved classification performance, but also help to discover the disease-related brain regions useful for disease diagnosis. PMID:25277605

An early underwater artificial vision model in ocean investigations via independent component analysis.

PubMed

Nian, Rui; Liu, Fang; He, Bo

2013-07-16

Underwater vision is one of the dominant senses and has shown great prospects in ocean investigations. In this paper, a hierarchical Independent Component Analysis (ICA) framework has been established to explore and understand the functional roles of the higher order statistical structures towards the visual stimulus in the underwater artificial vision system. The model is inspired by characteristics such as the modality, the redundancy reduction, the sparseness and the independence in the early human vision system, which seems to respectively capture the Gabor-like basis functions, the shape contours or the complicated textures in the multiple layer implementations. The simulation results have shown good performance in the effectiveness and the consistence of the approach proposed for the underwater images collected by autonomous underwater vehicles (AUVs).

An Early Underwater Artificial Vision Model in Ocean Investigations via Independent Component Analysis

PubMed Central

Nian, Rui; Liu, Fang; He, Bo

2013-01-01

Underwater vision is one of the dominant senses and has shown great prospects in ocean investigations. In this paper, a hierarchical Independent Component Analysis (ICA) framework has been established to explore and understand the functional roles of the higher order statistical structures towards the visual stimulus in the underwater artificial vision system. The model is inspired by characteristics such as the modality, the redundancy reduction, the sparseness and the independence in the early human vision system, which seems to respectively capture the Gabor-like basis functions, the shape contours or the complicated textures in the multiple layer implementations. The simulation results have shown good performance in the effectiveness and the consistence of the approach proposed for the underwater images collected by autonomous underwater vehicles (AUVs). PMID:23863855

Modality-specific selective attention attenuates multisensory integration.

PubMed

Mozolic, Jennifer L; Hugenschmidt, Christina E; Peiffer, Ann M; Laurienti, Paul J

2008-01-01

Stimuli occurring in multiple sensory modalities that are temporally synchronous or spatially coincident can be integrated together to enhance perception. Additionally, the semantic content or meaning of a stimulus can influence cross-modal interactions, improving task performance when these stimuli convey semantically congruent or matching information, but impairing performance when they contain non-matching or distracting information. Attention is one mechanism that is known to alter processing of sensory stimuli by enhancing perception of task-relevant information and suppressing perception of task-irrelevant stimuli. It is not known, however, to what extent attention to a single sensory modality can minimize the impact of stimuli in the unattended sensory modality and reduce the integration of stimuli across multiple sensory modalities. Our hypothesis was that modality-specific selective attention would limit processing of stimuli in the unattended sensory modality, resulting in a reduction of performance enhancements produced by semantically matching multisensory stimuli, and a reduction in performance decrements produced by semantically non-matching multisensory stimuli. The results from two experiments utilizing a cued discrimination task demonstrate that selective attention to a single sensory modality prevents the integration of matching multisensory stimuli that is normally observed when attention is divided between sensory modalities. Attention did not reliably alter the amount of distraction caused by non-matching multisensory stimuli on this task; however, these findings highlight a critical role for modality-specific selective attention in modulating multisensory integration.

Overview of multi-input frequency domain modal testing methods with an emphasis on sine testing

NASA Technical Reports Server (NTRS)

Rost, Robert W.; Brown, David L.

1988-01-01

An overview of the current state of the art multiple-input, multiple-output modal testing technology is discussed. A very brief review of the current time domain methods is given. A detailed review of frequency and spatial domain methods is presented with an emphasis on sine testing.

Roles of Frequency, Attitudes, and Multiple Intelligence Modality Surrounding Electricity Content-Based Reader's Theatre

ERIC Educational Resources Information Center

Hosier, Julie Winchester

2009-01-01

Integration of subjects is something elementary teachers must do to insure required objectives are covered. Science-based Reader's Theatre is one way to weave reading into science. This study examined the roles of frequency, attitudes, and Multiple Intelligence modalities surrounding Electricity Content-Based Reader's Theatre. This study used…

Sensorimotor simulations underlie conceptual representations: modality-specific effects of prior activation.

PubMed

Pecher, Diane; Zeelenberg, René; Barsalou, Lawrence W

2004-02-01

According to the perceptual symbols theory (Barsalou, 1999), sensorimotor simulations underlie the representation of concepts. Simulations are componential in the sense that they vary with the context in which the concept is presented. In the present study, we investigated whether representations are affected by recent experiences with a concept. Concept names (e.g., APPLE) were presented twice in a property verification task with a different property on each occasion. The two properties were either from the same perceptual modality (e.g., green, shiny) or from different modalities (e.g., tart, shiny). All stimuli were words. There was a lag of several intervening trials between the first and second presentation. Verification times and error rates for the second presentation of the concept were higher if the properties were from different modalities than if they were from the same modality.

Online Multi-Modal Robust Non-Negative Dictionary Learning for Visual Tracking

PubMed Central

Zhang, Xiang; Guan, Naiyang; Tao, Dacheng; Qiu, Xiaogang; Luo, Zhigang

2015-01-01

Dictionary learning is a method of acquiring a collection of atoms for subsequent signal representation. Due to its excellent representation ability, dictionary learning has been widely applied in multimedia and computer vision. However, conventional dictionary learning algorithms fail to deal with multi-modal datasets. In this paper, we propose an online multi-modal robust non-negative dictionary learning (OMRNDL) algorithm to overcome this deficiency. Notably, OMRNDL casts visual tracking as a dictionary learning problem under the particle filter framework and captures the intrinsic knowledge about the target from multiple visual modalities, e.g., pixel intensity and texture information. To this end, OMRNDL adaptively learns an individual dictionary, i.e., template, for each modality from available frames, and then represents new particles over all the learned dictionaries by minimizing the fitting loss of data based on M-estimation. The resultant representation coefficient can be viewed as the common semantic representation of particles across multiple modalities, and can be utilized to track the target. OMRNDL incrementally learns the dictionary and the coefficient of each particle by using multiplicative update rules to respectively guarantee their non-negativity constraints. Experimental results on a popular challenging video benchmark validate the effectiveness of OMRNDL for visual tracking in both quantity and quality. PMID:25961715

Online multi-modal robust non-negative dictionary learning for visual tracking.

PubMed

Zhang, Xiang; Guan, Naiyang; Tao, Dacheng; Qiu, Xiaogang; Luo, Zhigang

2015-01-01

Dictionary learning is a method of acquiring a collection of atoms for subsequent signal representation. Due to its excellent representation ability, dictionary learning has been widely applied in multimedia and computer vision. However, conventional dictionary learning algorithms fail to deal with multi-modal datasets. In this paper, we propose an online multi-modal robust non-negative dictionary learning (OMRNDL) algorithm to overcome this deficiency. Notably, OMRNDL casts visual tracking as a dictionary learning problem under the particle filter framework and captures the intrinsic knowledge about the target from multiple visual modalities, e.g., pixel intensity and texture information. To this end, OMRNDL adaptively learns an individual dictionary, i.e., template, for each modality from available frames, and then represents new particles over all the learned dictionaries by minimizing the fitting loss of data based on M-estimation. The resultant representation coefficient can be viewed as the common semantic representation of particles across multiple modalities, and can be utilized to track the target. OMRNDL incrementally learns the dictionary and the coefficient of each particle by using multiplicative update rules to respectively guarantee their non-negativity constraints. Experimental results on a popular challenging video benchmark validate the effectiveness of OMRNDL for visual tracking in both quantity and quality.

Novel Tactile Sensor Technology and Smart Tactile Sensing Systems: A Review

PubMed Central

Ge, Chang; Wang, Z. Jane; Cretu, Edmond; Li, Xiaoou

2017-01-01

During the last decades, smart tactile sensing systems based on different sensing techniques have been developed due to their high potential in industry and biomedical engineering. However, smart tactile sensing technologies and systems are still in their infancy, as many technological and system issues remain unresolved and require strong interdisciplinary efforts to address them. This paper provides an overview of smart tactile sensing systems, with a focus on signal processing technologies used to interpret the measured information from tactile sensors and/or sensors for other sensory modalities. The tactile sensing transduction and principles, fabrication and structures are also discussed with their merits and demerits. Finally, the challenges that tactile sensing technology needs to overcome are highlighted. PMID:29149080

Linked independent component analysis for multimodal data fusion.

PubMed

Groves, Adrian R; Beckmann, Christian F; Smith, Steve M; Woolrich, Mark W

2011-02-01

In recent years, neuroimaging studies have increasingly been acquiring multiple modalities of data and searching for task- or disease-related changes in each modality separately. A major challenge in analysis is to find systematic approaches for fusing these differing data types together to automatically find patterns of related changes across multiple modalities, when they exist. Independent Component Analysis (ICA) is a popular unsupervised learning method that can be used to find the modes of variation in neuroimaging data across a group of subjects. When multimodal data is acquired for the subjects, ICA is typically performed separately on each modality, leading to incompatible decompositions across modalities. Using a modular Bayesian framework, we develop a novel "Linked ICA" model for simultaneously modelling and discovering common features across multiple modalities, which can potentially have completely different units, signal- and contrast-to-noise ratios, voxel counts, spatial smoothnesses and intensity distributions. Furthermore, this general model can be configured to allow tensor ICA or spatially-concatenated ICA decompositions, or a combination of both at the same time. Linked ICA automatically determines the optimal weighting of each modality, and also can detect single-modality structured components when present. This is a fully probabilistic approach, implemented using Variational Bayes. We evaluate the method on simulated multimodal data sets, as well as on a real data set of Alzheimer's patients and age-matched controls that combines two very different types of structural MRI data: morphological data (grey matter density) and diffusion data (fractional anisotropy, mean diffusivity, and tensor mode). Copyright © 2010 Elsevier Inc. All rights reserved.

Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements

NASA Astrophysics Data System (ADS)

Yang, Yongchao; Dorn, Charles; Mancini, Tyler; Talken, Zachary; Nagarajaiah, Satish; Kenyon, Garrett; Farrar, Charles; Mascareñas, David

2017-03-01

Enhancing the spatial and temporal resolution of vibration measurements and modal analysis could significantly benefit dynamic modelling, analysis, and health monitoring of structures. For example, spatially high-density mode shapes are critical for accurate vibration-based damage localization. In experimental or operational modal analysis, higher (frequency) modes, which may be outside the frequency range of the measurement, contain local structural features that can improve damage localization as well as the construction and updating of the modal-based dynamic model of the structure. In general, the resolution of vibration measurements can be increased by enhanced hardware. Traditional vibration measurement sensors such as accelerometers have high-frequency sampling capacity; however, they are discrete point-wise sensors only providing sparse, low spatial sensing resolution measurements, while dense deployment to achieve high spatial resolution is expensive and results in the mass-loading effect and modification of structure's surface. Non-contact measurement methods such as scanning laser vibrometers provide high spatial and temporal resolution sensing capacity; however, they make measurements sequentially that requires considerable acquisition time. As an alternative non-contact method, digital video cameras are relatively low-cost, agile, and provide high spatial resolution, simultaneous, measurements. Combined with vision based algorithms (e.g., image correlation or template matching, optical flow, etc.), video camera based measurements have been successfully used for experimental and operational vibration measurement and subsequent modal analysis. However, the sampling frequency of most affordable digital cameras is limited to 30-60 Hz, while high-speed cameras for higher frequency vibration measurements are extremely costly. This work develops a computational algorithm capable of performing vibration measurement at a uniform sampling frequency lower than what is required by the Shannon-Nyquist sampling theorem for output-only modal analysis. In particular, the spatio-temporal uncoupling property of the modal expansion of structural vibration responses enables a direct modal decoupling of the temporally-aliased vibration measurements by existing output-only modal analysis methods, yielding (full-field) mode shapes estimation directly. Then the signal aliasing properties in modal analysis is exploited to estimate the modal frequencies and damping ratios. The proposed method is validated by laboratory experiments where output-only modal identification is conducted on temporally-aliased acceleration responses and particularly the temporally-aliased video measurements of bench-scale structures, including a three-story building structure and a cantilever beam.

Meaning Making through Multiple Modalities in a Biology Classroom: A Multimodal Semiotics Discourse Analysis

ERIC Educational Resources Information Center

Jaipal, Kamini

2010-01-01

The teaching of science is a complex process, involving the use of multiple modalities. This paper illustrates the potential of a multimodal semiotics discourse analysis framework to illuminate meaning-making possibilities during the teaching of a science concept. A multimodal semiotics analytical framework is developed and used to (1) analyze the…

Voxelwise multivariate analysis of multimodality magnetic resonance imaging.

PubMed

Naylor, Melissa G; Cardenas, Valerie A; Tosun, Duygu; Schuff, Norbert; Weiner, Michael; Schwartzman, Armin

2014-03-01

Most brain magnetic resonance imaging (MRI) studies concentrate on a single MRI contrast or modality, frequently structural MRI. By performing an integrated analysis of several modalities, such as structural, perfusion-weighted, and diffusion-weighted MRI, new insights may be attained to better understand the underlying processes of brain diseases. We compare two voxelwise approaches: (1) fitting multiple univariate models, one for each outcome and then adjusting for multiple comparisons among the outcomes and (2) fitting a multivariate model. In both cases, adjustment for multiple comparisons is performed over all voxels jointly to account for the search over the brain. The multivariate model is able to account for the multiple comparisons over outcomes without assuming independence because the covariance structure between modalities is estimated. Simulations show that the multivariate approach is more powerful when the outcomes are correlated and, even when the outcomes are independent, the multivariate approach is just as powerful or more powerful when at least two outcomes are dependent on predictors in the model. However, multiple univariate regressions with Bonferroni correction remain a desirable alternative in some circumstances. To illustrate the power of each approach, we analyze a case control study of Alzheimer's disease, in which data from three MRI modalities are available. Copyright © 2013 Wiley Periodicals, Inc.

Alternative Audio Solution to Enhance Immersion in Deployable Synthetic Environments

DTIC Science & Technology

2003-09-01

sense of presence. For example, the musical score of a movie increases the viewers’ emotional involvement in a cinematic feature. The character...photo-realistic way can make mental immersion difficult, because any flaw in the realism will spoil the effect [SHER 03].” One way to overcome spoiling...the visual realism is to reinforce visual clues with those from other modalities. 3. Aural Modality a. General Aural displays can be

Air-Track: a real-world floating environment for active sensing in head-fixed mice.

PubMed

Nashaat, Mostafa A; Oraby, Hatem; Sachdev, Robert N S; Winter, York; Larkum, Matthew E

2016-10-01

Natural behavior occurs in multiple sensory and motor modalities and in particular is dependent on sensory feedback that constantly adjusts behavior. To investigate the underlying neuronal correlates of natural behavior, it is useful to have access to state-of-the-art recording equipment (e.g., 2-photon imaging, patch recordings, etc.) that frequently requires head fixation. This limitation has been addressed with various approaches such as virtual reality/air ball or treadmill systems. However, achieving multimodal realistic behavior in these systems can be challenging. These systems are often also complex and expensive to implement. Here we present "Air-Track," an easy-to-build head-fixed behavioral environment that requires only minimal computational processing. The Air-Track is a lightweight physical maze floating on an air table that has all the properties of the "real" world, including multiple sensory modalities tightly coupled to motor actions. To test this system, we trained mice in Go/No-Go and two-alternative forced choice tasks in a plus maze. Mice chose lanes and discriminated apertures or textures by moving the Air-Track back and forth and rotating it around themselves. Mice rapidly adapted to moving the track and used visual, auditory, and tactile cues to guide them in performing the tasks. A custom-controlled camera system monitored animal location and generated data that could be used to calculate reaction times in the visual and somatosensory discrimination tasks. We conclude that the Air-Track system is ideal for eliciting natural behavior in concert with virtually any system for monitoring or manipulating brain activity. Copyright © 2016 the American Physiological Society.

Air-Track: a real-world floating environment for active sensing in head-fixed mice

PubMed Central

Oraby, Hatem; Sachdev, Robert N. S.; Winter, York

2016-01-01

Natural behavior occurs in multiple sensory and motor modalities and in particular is dependent on sensory feedback that constantly adjusts behavior. To investigate the underlying neuronal correlates of natural behavior, it is useful to have access to state-of-the-art recording equipment (e.g., 2-photon imaging, patch recordings, etc.) that frequently requires head fixation. This limitation has been addressed with various approaches such as virtual reality/air ball or treadmill systems. However, achieving multimodal realistic behavior in these systems can be challenging. These systems are often also complex and expensive to implement. Here we present “Air-Track,” an easy-to-build head-fixed behavioral environment that requires only minimal computational processing. The Air-Track is a lightweight physical maze floating on an air table that has all the properties of the “real” world, including multiple sensory modalities tightly coupled to motor actions. To test this system, we trained mice in Go/No-Go and two-alternative forced choice tasks in a plus maze. Mice chose lanes and discriminated apertures or textures by moving the Air-Track back and forth and rotating it around themselves. Mice rapidly adapted to moving the track and used visual, auditory, and tactile cues to guide them in performing the tasks. A custom-controlled camera system monitored animal location and generated data that could be used to calculate reaction times in the visual and somatosensory discrimination tasks. We conclude that the Air-Track system is ideal for eliciting natural behavior in concert with virtually any system for monitoring or manipulating brain activity. PMID:27486102

Hybrid optical acoustic seafloor mapping

NASA Astrophysics Data System (ADS)

Inglis, Gabrielle

The oceanographic research and industrial communities have a persistent demand for detailed three dimensional sea floor maps which convey both shape and texture. Such data products are used for archeology, geology, ship inspection, biology, and habitat classification. There are a variety of sensing modalities and processing techniques available to produce these maps and each have their own potential benefits and related challenges. Multibeam sonar and stereo vision are such two sensors with complementary strengths making them ideally suited for data fusion. Data fusion approaches however, have seen only limited application to underwater mapping and there are no established methods for creating hybrid, 3D reconstructions from two underwater sensing modalities. This thesis develops a processing pipeline to synthesize hybrid maps from multi-modal survey data. It is helpful to think of this processing pipeline as having two distinct phases: Navigation Refinement and Map Construction. This thesis extends existing work in underwater navigation refinement by incorporating methods which increase measurement consistency between both multibeam and camera. The result is a self consistent 3D point cloud comprised of camera and multibeam measurements. In map construction phase, a subset of the multi-modal point cloud retaining the best characteristics of each sensor is selected to be part of the final map. To quantify the desired traits of a map several characteristics of a useful map are distilled into specific criteria. The different ways that hybrid maps can address these criteria provides justification for producing them as an alternative to current methodologies. The processing pipeline implements multi-modal data fusion and outlier rejection with emphasis on different aspects of map fidelity. The resulting point cloud is evaluated in terms of how well it addresses the map criteria. The final hybrid maps retain the strengths of both sensors and show significant improvement over the single modality maps and naively assembled multi-modal maps.

Modal Testing of Seven Shuttle Cargo Elements for Space Station

NASA Technical Reports Server (NTRS)

Kappus, Kathy O.; Driskill, Timothy C.; Parks, Russel A.; Patterson, Alan (Technical Monitor)

2001-01-01

From December 1996 to May 2001, the Modal and Control Dynamics Team at NASA's Marshall Space Flight Center (MSFC) conducted modal tests on seven large elements of the International Space Station. Each of these elements has been or will be launched as a Space Shuttle payload for transport to the International Space Station (ISS). Like other Shuttle payloads, modal testing of these elements was required for verification of the finite element models used in coupled loads analyses for launch and landing. The seven modal tests included three modules - Node, Laboratory, and Airlock, and four truss segments - P6, P3/P4, S1/P1, and P5. Each element was installed and tested in the Shuttle Payload Modal Test Bed at MSFC. This unique facility can accommodate any Shuttle cargo element for modal test qualification. Flexure assemblies were utilized at each Shuttle-to-payload interface to simulate a constrained boundary in the load carrying degrees of freedom. For each element, multiple-input, multiple-output burst random modal testing was the primary approach with controlled input sine sweeps for linearity assessments. The accelerometer channel counts ranged from 252 channels to 1251 channels. An overview of these tests, as well as some lessons learned, will be provided in this paper.

Mode separation in frequency-wavenumber domain through compressed sensing of far-field Lamb waves

NASA Astrophysics Data System (ADS)

Gao, Fei; Zeng, Liang; Lin, Jing; Luo, Zhi

2017-07-01

This method based on Lamb waves shows great potential for long-range damage detection. Mode superposition resulting from multi-modal and dispersive characteristics makes signal interpretation and damage feature extraction difficult. Mode separation in the frequency-wavenumber (f-k) domain using a 1D sparse sensing array is a promising solution. However, due to the lack of prior knowledge about damage location, this method based on 1D linear measurement, for the mode extraction of arbitrary reflections caused by defects that are not in line with the sensor array, is restricted. In this paper, an improved compressed sensing method under the far-field assumption is established, which is beneficial to the reconstruction of reflections in the f-k domain. Hence, multiple components consisting of structure and damage features could be recovered via a limited number of measurements. Subsequently, a mode sweeping process based on theoretical dispersion curves has been designed for mode characterization and direction of arrival estimation. Moreover, 2D f-k filtering and inverse transforms are applied to the reconstructed f-k distribution in order to extract the purified mode of interest. As a result, overlapping waveforms can be separated and the direction of defects can be estimated. A uniform linear sensor array consisting of 16 laser excitations is finally employed for experimental investigations and the results demonstrate the efficiency of the proposed method.

Linear high-boost fusion of Stokes vector imagery for effective discrimination and recognition of real targets in the presence of multiple identical decoys

NASA Astrophysics Data System (ADS)

El-Saba, Aed; Sakla, Wesam A.

2010-04-01

Recently, the use of imaging polarimetry has received considerable attention for use in automatic target recognition (ATR) applications. In military remote sensing applications, there is a great demand for sensors that are capable of discriminating between real targets and decoys. Accurate discrimination of decoys from real targets is a challenging task and often requires the fusion of various sensor modalities that operate simultaneously. In this paper, we use a simple linear fusion technique known as the high-boost fusion method for effective discrimination of real targets in the presence of multiple decoys. The HBF assigns more weight to the polarization-based imagery in forming the final fused image that is used for detection. We have captured both intensity and polarization-based imagery from an experimental laboratory arrangement containing a mixture of sand/dirt, rocks, vegetation, and other objects for the purpose of simulating scenery that would be acquired in a remote sensing military application. A target object and three decoys that are identical in physical appearance (shape, surface structure and color) and different in material composition have also been placed in the scene. We use the wavelet-filter joint transform correlation (WFJTC) technique to perform detection between input scenery and the target object. Our results show that use of the HBF method increases the correlation performance metrics associated with the WFJTC-based detection process when compared to using either the traditional intensity or polarization-based images.

Optogenetic Induction of Aversive Taste Memory

PubMed Central

C. Keene, Alex; Masek, Pavel

2013-01-01

The Drosophila melanogaster gustatory system consists of several neuronal pathways representing diverse taste modalities. The two predominant modalities are a sweet sensing pathway that mediates attraction, and a bitter sensing pathway that mediates avoidance. A central question is how flies integrate stimuli from these pathways and generate the appropriate behavioral response. We have developed a novel assay for induction of taste memories. We demonstrate that the gustatory response to fructose is suppressed when followed by the presence of bitter quinine. We employ optogenetic neural activation using infrared laser in combination with heat sensitive channel - TRPA1 to precisely activate gustatory neurons. This optogenetic system allows for spatially and temporally controlled activation of distinct neural classes in the gustatory circuit. We directly activated bitter-sensing neurons together with presentation of fructose for remote induction of aversive taste memories. Here we report that activation of bitter-sensing neurons in the proboscis suffices as a conditioning stimulus. Spatially restricted stimulation indicates that the conditioning stimulus is indeed a signal from the bitter neurons in the proboscis and it is independent of postingestive feedback. The coincidence of temporally specific activation of bitter-sensing neurons with fructose presentation is crucial for memory formation, establishing aversive taste learning in Drosophila as associative learning. Taken together, this optogenetic system provides a powerful new tool for interrogation of the central brain circuits that mediate memory formation. PMID:22820051

Modal analysis using a Fourier analyzer, curve-fitting, and modal tuning

NASA Technical Reports Server (NTRS)

Craig, R. R., Jr.; Chung, Y. T.

1981-01-01

The proposed modal test program differs from single-input methods in that preliminary data may be acquired using multiple inputs, and modal tuning procedures may be employed to define closely spaced frquency modes more accurately or to make use of frequency response functions (FRF's) which are based on several input locations. In some respects the proposed modal test proram resembles earlier sine-sweep and sine-dwell testing in that broadband FRF's are acquired using several input locations, and tuning is employed to refine the modal parameter estimates. The major tasks performed in the proposed modal test program are outlined. Data acquisition and FFT processing, curve fitting, and modal tuning phases are described and examples are given to illustrate and evaluate them.

Modal Correction Method For Dynamically Induced Errors In Wind-Tunnel Model Attitude Measurements

NASA Technical Reports Server (NTRS)

Buehrle, R. D.; Young, C. P., Jr.

1995-01-01

This paper describes a method for correcting the dynamically induced bias errors in wind tunnel model attitude measurements using measured modal properties of the model system. At NASA Langley Research Center, the predominant instrumentation used to measure model attitude is a servo-accelerometer device that senses the model attitude with respect to the local vertical. Under smooth wind tunnel operating conditions, this inertial device can measure the model attitude with an accuracy of 0.01 degree. During wind tunnel tests when the model is responding at high dynamic amplitudes, the inertial device also senses the centrifugal acceleration associated with model vibration. This centrifugal acceleration results in a bias error in the model attitude measurement. A study of the response of a cantilevered model system to a simulated dynamic environment shows significant bias error in the model attitude measurement can occur and is vibration mode and amplitude dependent. For each vibration mode contributing to the bias error, the error is estimated from the measured modal properties and tangential accelerations at the model attitude device. Linear superposition is used to combine the bias estimates for individual modes to determine the overall bias error as a function of time. The modal correction model predicts the bias error to a high degree of accuracy for the vibration modes characterized in the simulated dynamic environment.

Oversampling in virtual visual sensors as a means to recover higher modes of vibration

NASA Astrophysics Data System (ADS)

Shariati, Ali; Schumacher, Thomas

2015-03-01

Vibration-based structural health monitoring (SHM) techniques require modal information from the monitored structure in order to estimate the location and severity of damage. Natural frequencies also provide useful information to calibrate finite element models. There are several types of physical sensors that can measure the response over a range of frequencies. For most of those sensors however, accessibility, limitation of measurement points, wiring, and high system cost represent major challenges. Recent optical sensing approaches offer advantages such as easy access to visible areas, distributed sensing capabilities, and comparatively inexpensive data recording while having no wiring issues. In this research we propose a novel methodology to measure natural frequencies of structures using digital video cameras based on virtual visual sensors (VVS). In our initial study where we worked with commercially available inexpensive digital video cameras we found that for multiple degrees of freedom systems it is difficult to detect all of the natural frequencies simultaneously due to low quantization resolution. In this study we show how oversampling enabled by the use of high-end high-frame-rate video cameras enable recovering all of the three natural frequencies from a three story lab-scale structure.

Acoustic Sensing and Ultrasonic Drug Delivery in Multimodal Theranostic Capsule Endoscopy

PubMed Central

Stewart, Fraser R.; Qiu, Yongqiang; Newton, Ian P.; Cox, Benjamin F.; Al-Rawhani, Mohammed A.; Beeley, James; Liu, Yangminghao; Huang, Zhihong; Cumming, David R. S.; Näthke, Inke

2017-01-01

Video capsule endoscopy (VCE) is now a clinically accepted diagnostic modality in which miniaturized technology, an on-board power supply and wireless telemetry stand as technological foundations for other capsule endoscopy (CE) devices. However, VCE does not provide therapeutic functionality, and research towards therapeutic CE (TCE) has been limited. In this paper, a route towards viable TCE is proposed, based on multiple CE devices including important acoustic sensing and drug delivery components. In this approach, an initial multimodal diagnostic device with high-frequency quantitative microultrasound that complements video imaging allows surface and subsurface visualization and computer-assisted diagnosis. Using focused ultrasound (US) to mark sites of pathology with exogenous fluorescent agents permits follow-up with another device to provide therapy. This is based on an US-mediated targeted drug delivery system with fluorescence imaging guidance. An additional device may then be utilized for treatment verification and monitoring, exploiting the minimally invasive nature of CE. While such a theranostic patient pathway for gastrointestinal treatment is presently incomplete, the description in this paper of previous research and work under way to realize further components for the proposed pathway suggests it is feasible and provides a framework around which to structure further work. PMID:28671642

DOE Office of Scientific and Technical Information (OSTI.GOV)

Veedu, Vinod; Hadmack, Michael; Pollock, Jacob

Nanite™ is a cementitious material that contains a proprietary formulation of functionalized nanomaterial additive to transform conventional cement into a smart material responsive to pressure (or stress), temperature, and any intrinsic changes in composition. This project has identified optimal sensing modalities of smart well cement and demonstrated how real-time sensing of Nanite™ can improve long-term wellbore integrity and zonal isolation in shale gas and applicable oil and gas operations. Oceanit has explored Nanite’s electrical sensing properties in depth and has advanced the technology from laboratory proof-of-concept to sub-scale testing in preparation for field trials.

The Construct of the Multisensory Temporal Binding Window and its Dysregulation in Developmental Disabilities

PubMed Central

Wallace, Mark T.; Stevenson, Ryan A.

2014-01-01

Behavior, perception and cognition are strongly shaped by the synthesis of information across the different sensory modalities. Such multisensory integration often results in performance and perceptual benefits that reflect the additional information conferred by having cues from multiple senses providing redundant or complementary information. The spatial and temporal relationships of these cues provide powerful statistical information about how these cues should be integrated or “bound” in order to create a unified perceptual representation. Much recent work has examined the temporal factors that are integral in multisensory processing, with many focused on the construct of the multisensory temporal binding window – the epoch of time within which stimuli from different modalities is likely to be integrated and perceptually bound. Emerging evidence suggests that this temporal window is altered in a series of neurodevelopmental disorders, including autism, dyslexia and schizophrenia. In addition to their role in sensory processing, these deficits in multisensory temporal function may play an important role in the perceptual and cognitive weaknesses that characterize these clinical disorders. Within this context, focus on improving the acuity of multisensory temporal function may have important implications for the amelioration of the “higher-order” deficits that serve as the defining features of these disorders. PMID:25128432

What failure in collective decision-making tells us about metacognition

PubMed Central

Bahrami, Bahador; Olsen, Karsten; Bang, Dan; Roepstorff, Andreas; Rees, Geraint; Frith, Chris

2012-01-01

Condorcet (1785) proposed that a majority vote drawn from individual, independent and fallible (but not totally uninformed) opinions provides near-perfect accuracy if the number of voters is adequately large. Research in social psychology has since then repeatedly demonstrated that collectives can and do fail more often than expected by Condorcet. Since human collective decisions often follow from exchange of opinions, these failures provide an exquisite opportunity to understand human communication of metacognitive confidence. This question can be addressed by recasting collective decision-making as an information-integration problem similar to multisensory (cross-modal) perception. Previous research in systems neuroscience shows that one brain can integrate information from multiple senses nearly optimally. Inverting the question, we ask: under what conditions can two brains integrate information about one sensory modality optimally? We review recent work that has taken this approach and report discoveries about the quantitative limits of collective perceptual decision-making, and the role of the mode of communication and feedback in collective decision-making. We propose that shared metacognitive confidence conveys the strength of an individual's opinion and its reliability inseparably. We further suggest that a functional role of shared metacognition is to provide substitute signals in situations where outcome is necessary for learning but unavailable or impossible to establish. PMID:22492752

Motion Artifact Quantification and Sensor Fusion for Unobtrusive Health Monitoring.

PubMed

Hoog Antink, Christoph; Schulz, Florian; Leonhardt, Steffen; Walter, Marian

2017-12-25

Sensors integrated into objects of everyday life potentially allow unobtrusive health monitoring at home. However, since the coupling of sensors and subject is not as well-defined as compared to a clinical setting, the signal quality is much more variable and can be disturbed significantly by motion artifacts. One way of tackling this challenge is the combined evaluation of multiple channels via sensor fusion. For robust and accurate sensor fusion, analyzing the influence of motion on different modalities is crucial. In this work, a multimodal sensor setup integrated into an armchair is presented that combines capacitively coupled electrocardiography, reflective photoplethysmography, two high-frequency impedance sensors and two types of ballistocardiography sensors. To quantify motion artifacts, a motion protocol performed by healthy volunteers is recorded with a motion capture system, and reference sensors perform cardiorespiratory monitoring. The shape-based signal-to-noise ratio SNR S is introduced and used to quantify the effect on motion on different sensing modalities. Based on this analysis, an optimal combination of sensors and fusion methodology is developed and evaluated. Using the proposed approach, beat-to-beat heart-rate is estimated with a coverage of 99.5% and a mean absolute error of 7.9 ms on 425 min of data from seven volunteers in a proof-of-concept measurement scenario.

Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yang, Yongchao; Dorn, Charles; Mancini, Tyler

Enhancing the spatial and temporal resolution of vibration measurements and modal analysis could significantly benefit dynamic modelling, analysis, and health monitoring of structures. For example, spatially high-density mode shapes are critical for accurate vibration-based damage localization. In experimental or operational modal analysis, higher (frequency) modes, which may be outside the frequency range of the measurement, contain local structural features that can improve damage localization as well as the construction and updating of the modal-based dynamic model of the structure. In general, the resolution of vibration measurements can be increased by enhanced hardware. Traditional vibration measurement sensors such as accelerometers havemore » high-frequency sampling capacity; however, they are discrete point-wise sensors only providing sparse, low spatial sensing resolution measurements, while dense deployment to achieve high spatial resolution is expensive and results in the mass-loading effect and modification of structure's surface. Non-contact measurement methods such as scanning laser vibrometers provide high spatial and temporal resolution sensing capacity; however, they make measurements sequentially that requires considerable acquisition time. As an alternative non-contact method, digital video cameras are relatively low-cost, agile, and provide high spatial resolution, simultaneous, measurements. Combined with vision based algorithms (e.g., image correlation or template matching, optical flow, etc.), video camera based measurements have been successfully used for experimental and operational vibration measurement and subsequent modal analysis. However, the sampling frequency of most affordable digital cameras is limited to 30–60 Hz, while high-speed cameras for higher frequency vibration measurements are extremely costly. This work develops a computational algorithm capable of performing vibration measurement at a uniform sampling frequency lower than what is required by the Shannon-Nyquist sampling theorem for output-only modal analysis. In particular, the spatio-temporal uncoupling property of the modal expansion of structural vibration responses enables a direct modal decoupling of the temporally-aliased vibration measurements by existing output-only modal analysis methods, yielding (full-field) mode shapes estimation directly. Then the signal aliasing properties in modal analysis is exploited to estimate the modal frequencies and damping ratios. Furthermore, the proposed method is validated by laboratory experiments where output-only modal identification is conducted on temporally-aliased acceleration responses and particularly the temporally-aliased video measurements of bench-scale structures, including a three-story building structure and a cantilever beam.« less

Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements

DOE PAGES

Yang, Yongchao; Dorn, Charles; Mancini, Tyler; ...

2016-12-05

Enhancing the spatial and temporal resolution of vibration measurements and modal analysis could significantly benefit dynamic modelling, analysis, and health monitoring of structures. For example, spatially high-density mode shapes are critical for accurate vibration-based damage localization. In experimental or operational modal analysis, higher (frequency) modes, which may be outside the frequency range of the measurement, contain local structural features that can improve damage localization as well as the construction and updating of the modal-based dynamic model of the structure. In general, the resolution of vibration measurements can be increased by enhanced hardware. Traditional vibration measurement sensors such as accelerometers havemore » high-frequency sampling capacity; however, they are discrete point-wise sensors only providing sparse, low spatial sensing resolution measurements, while dense deployment to achieve high spatial resolution is expensive and results in the mass-loading effect and modification of structure's surface. Non-contact measurement methods such as scanning laser vibrometers provide high spatial and temporal resolution sensing capacity; however, they make measurements sequentially that requires considerable acquisition time. As an alternative non-contact method, digital video cameras are relatively low-cost, agile, and provide high spatial resolution, simultaneous, measurements. Combined with vision based algorithms (e.g., image correlation or template matching, optical flow, etc.), video camera based measurements have been successfully used for experimental and operational vibration measurement and subsequent modal analysis. However, the sampling frequency of most affordable digital cameras is limited to 30–60 Hz, while high-speed cameras for higher frequency vibration measurements are extremely costly. This work develops a computational algorithm capable of performing vibration measurement at a uniform sampling frequency lower than what is required by the Shannon-Nyquist sampling theorem for output-only modal analysis. In particular, the spatio-temporal uncoupling property of the modal expansion of structural vibration responses enables a direct modal decoupling of the temporally-aliased vibration measurements by existing output-only modal analysis methods, yielding (full-field) mode shapes estimation directly. Then the signal aliasing properties in modal analysis is exploited to estimate the modal frequencies and damping ratios. Furthermore, the proposed method is validated by laboratory experiments where output-only modal identification is conducted on temporally-aliased acceleration responses and particularly the temporally-aliased video measurements of bench-scale structures, including a three-story building structure and a cantilever beam.« less

"Life Within the Person Comes to The Fore": Pastoral Workers' Practice Wisdom on Using Arts in Palliative Care.

PubMed

O'Callaghan, Clare; Byrne, Libby; Cokalis, Eleni; Glenister, David; Santilli, Margaret; Clark, Rose; McCarthy, Therese; Michael, Natasha

2018-07-01

Pastoral care (also chaplaincy, spiritual care) assists people to find meaning, personal resources, and connection with self, others, and/or a higher power. Although essential in palliative care, there remains limited examination of what pastoral workers do. This study examined how pastoral workers use and consider the usefulness of art-based modalities. Qualitative research was used to examine the practice wisdom (tacit practice knowledge) of pastoral workers experienced in using visual arts and music in palliative care. Two focus groups were conducted. Thematic analysis was informed by grounded theory. Six pastoral workers shared information. Three themes emerged. First, pastoral workers use arts as "another tool" to extend scope of practice by assisting patients and families to symbolically and more deeply contemplate what they find "sacred." Second, pastoral workers' art affinities inform their aims, assessments, and interactions. Third, pastoral workers perceive that art-based modalities can validate, enlighten, and transform patients and families through enabling them to "multisensorially" (through many senses) feel recognized, accepted, empowered, and/or close to God. Key elements involved in the work's transformative effects include enabling beauty, ritual, and the sense of "home" being heard, and legacy creation. Pastoral workers interpret that offering art-based modalities in palliative care can help patients and families to symbolically deal with painful memories and experiences, creatively engage with that deemed significant, and/or encounter a sense of transcendence. Training in generalist art-based care needs to be offered in pastoral education.

Scan Patterns Predict Sentence Production in the Cross-Modal Processing of Visual Scenes

ERIC Educational Resources Information Center

Coco, Moreno I.; Keller, Frank

2012-01-01

Most everyday tasks involve multiple modalities, which raises the question of how the processing of these modalities is coordinated by the cognitive system. In this paper, we focus on the coordination of visual attention and linguistic processing during speaking. Previous research has shown that objects in a visual scene are fixated before they…

Roles of frequency, attitudes, and multiple intelligence modality surrounding Electricity Content-Based Reader's Theatre

NASA Astrophysics Data System (ADS)

Hosier, Julie Winchester

Integration of subjects is something elementary teachers must do to insure required objectives are covered. Science-based Reader's Theatre is one way to weave reading into science. This study examined the roles of frequency, attitudes, and Multiple Intelligence modalities surrounding Electricity Content-Based Reader's Theatre. This study used quasi-experimental, repeated measures ANOVA with time as a factor design. A convenience sample of two fifth-grade classrooms participated in the study for eighteen weeks. Five Electricity Achievement Tests were given throughout the study to assess students' growth. A Student Reader's Theatre Attitudinal Survey revealed students' attitudes before and after Electricity Content-Based Reader's Theatre treatment. The Multiple Intelligence Inventory for Kids (Faris, 2007) examined whether Multiple Intelligence modality played a role in achievement on Electricity Test 4, the post-treatment test. Analysis using repeated measures ANOVA and an independent t-test found that students in the experimental group, which practiced its student-created Electricity Content-Based Reader's Theatre skits ten times versus two times for the for control group, did significantly better on Electricity Achievement Test 4, t(76) = 3.018, p = 0.003. Dependent t-tests did not find statistically significant differences between students' attitudes about Electricity Content-Based Reader's Theatre before and after treatment. A Kruskal-Wallis test found no statistically significant difference between the various Multiple Intelligence modalities score mean ranks (x2 = 5.57, df = 2, alpha = .062). Qualitative data do, however, indicate students had strong positive feelings about Electricity Content-Based Reader's Theatre after treatment. Students indicated it to be motivating, confidence-building, and a fun way to learn about science; however, they disliked writing their own scripts. Examining the frequency, attitudes, and Multiple Intelligence modalities lead to the conclusion that the role of frequency had the greatest impact on the success of Electricity Content-Based Reader's Theatre. The participating teachers, students, and research found integrating science and reading through Electricity Content-Based Reader's Theatre beneficial.

Non-contact modal testing by the electromagnetic acoustic principle: Applications to bending and torsional vibrations of metallic pipes

NASA Astrophysics Data System (ADS)

Kim, Hongjin; Park, Chan Il; Lee, Sun Ho; Kim, Yoon Young

2013-02-01

This work aims to investigate a possibility of non-contact vibration modal testing for bending and torsional motions of cylindrical bodies such as pipes. Here, a transducer operated by the electromagnetic acoustic coupling principle is newly devised. Depending on vibration modes, bending or torsional, different magnetic circuit configurations are employed to fabricate the transducer. The main characteristic of the proposed transducer is non-contact vibration generation in a test specimen without any mechanical movement of the actuating unit. It can be also used as a non-contact sensing unit if necessary. The validity and the performance of the proposed non-contact modal testing method are checked with several experiments.

Basic multisensory functions can be acquired after congenital visual pattern deprivation in humans.

PubMed

Putzar, Lisa; Gondan, Matthias; Röder, Brigitte

2012-01-01

People treated for bilateral congenital cataracts offer a model to study the influence of visual deprivation in early infancy on visual and multisensory development. We investigated cross-modal integration capabilities in cataract patients using a simple detection task that provided redundant information to two different senses. In both patients and controls, redundancy gains were consistent with coactivation models, indicating an integrated processing of modality-specific information. This finding is in contrast with recent studies showing impaired higher-level multisensory interactions in cataract patients. The present results suggest that basic cross-modal integrative processes for simple short stimuli do not depend on visual and/or crossmodal input since birth.

Quantitative, Noninvasive Imaging of DNA Damage in Vivo of Prostate Cancer Therapy by Transurethral Photoacoustic (TUPA) Imaging

DTIC Science & Technology

2015-12-01

Xiang, L Xing, “ X - Ray Fluorescence CT as a Novel Imaging Modality for Improved Radiation Therapy Target Delineation”, Presented at 56th Annual Meeting... Imaging and Sensing, 1: 18-22 (2014).  Moiz Ahmad, Magdalena Bazalova, Liangzhong Xiang, and Lei Xing, Order of magnitude sensitivity increase in x - ray ...Unlimited 13. SUPPLEMENTARY NOTES 14. ABSTRACT The goals of this training grant is to develop the foundations for a new medical imaging modality, now

Compensatory Plasticity in the Deaf Brain: Effects on Perception of Music

PubMed Central

Good, Arla; Reed, Maureen J.; Russo, Frank A.

2014-01-01

When one sense is unavailable, sensory responsibilities shift and processing of the remaining modalities becomes enhanced to compensate for missing information. This shift, referred to as compensatory plasticity, results in a unique sensory experience for individuals who are deaf, including the manner in which music is perceived. This paper evaluates the neural, behavioural and cognitive evidence for compensatory plasticity following auditory deprivation and considers how this manifests in a unique experience of music that emphasizes visual and vibrotactile modalities. PMID:25354235

Differential modal Zernike wavefront sensor employing a computer-generated hologram: a proposal.

PubMed

Mishra, Sanjay K; Bhatt, Rahul; Mohan, Devendra; Gupta, Arun Kumar; Sharma, Anurag

2009-11-20

The process of Zernike mode detection with a Shack-Hartmann wavefront sensor is computationally extensive. A holographic modal wavefront sensor has therefore evolved to process the data optically by use of the concept of equal and opposite phase bias. Recently, a multiplexed computer-generated hologram (CGH) technique was developed in which the output is in the form of bright dots that specify the presence and strength of a specific Zernike mode. We propose a wavefront sensor using the concept of phase biasing in the latter technique such that the output is a pair of bright dots for each mode to be sensed. A normalized difference signal between the intensities of the two dots is proportional to the amplitude of the sensed Zernike mode. In our method the number of holograms to be multiplexed is decreased, thereby reducing the modal cross talk significantly. We validated the proposed method through simulation studies for several cases. The simulation results demonstrate simultaneous wavefront detection of lower-order Zernike modes with a resolution better than lambda/50 for the wide measurement range of +/-3.5lambda with much reduced cross talk at high speed.

Dynamic Dependence Analysis : Modeling and Inference of Changing Dependence Among Multiple Time-Series

DTIC Science & Technology

2009-06-01

isolation. In addition to being inherently multi-modal, human perception takes advantages of multiple sources of information within a single modality...restric- tion was reasonable for the applications we looked at. However, consider using a TIM to model a teacher student relationship among moving objects...That is, imagine one teacher object demonstrating a behavior for a student object. The student can observe the teacher and then recreate the behavior

Unified commutation-pruning technique for efficient computation of composite DFTs

NASA Astrophysics Data System (ADS)

Castro-Palazuelos, David E.; Medina-Melendrez, Modesto Gpe.; Torres-Roman, Deni L.; Shkvarko, Yuriy V.

2015-12-01

An efficient computation of a composite length discrete Fourier transform (DFT), as well as a fast Fourier transform (FFT) of both time and space data sequences in uncertain (non-sparse or sparse) computational scenarios, requires specific processing algorithms. Traditional algorithms typically employ some pruning methods without any commutations, which prevents them from attaining the potential computational efficiency. In this paper, we propose an alternative unified approach with automatic commutations between three computational modalities aimed at efficient computations of the pruned DFTs adapted for variable composite lengths of the non-sparse input-output data. The first modality is an implementation of the direct computation of a composite length DFT, the second one employs the second-order recursive filtering method, and the third one performs the new pruned decomposed transform. The pruned decomposed transform algorithm performs the decimation in time or space (DIT) data acquisition domain and, then, decimation in frequency (DIF). The unified combination of these three algorithms is addressed as the DFTCOMM technique. Based on the treatment of the combinational-type hypotheses testing optimization problem of preferable allocations between all feasible commuting-pruning modalities, we have found the global optimal solution to the pruning problem that always requires a fewer or, at most, the same number of arithmetic operations than other feasible modalities. The DFTCOMM method outperforms the existing competing pruning techniques in the sense of attainable savings in the number of required arithmetic operations. It requires fewer or at most the same number of arithmetic operations for its execution than any other of the competing pruning methods reported in the literature. Finally, we provide the comparison of the DFTCOMM with the recently developed sparse fast Fourier transform (SFFT) algorithmic family. We feature that, in the sensing scenarios with sparse/non-sparse data Fourier spectrum, the DFTCOMM technique manifests robustness against such model uncertainties in the sense of insensitivity for sparsity/non-sparsity restrictions and the variability of the operating parameters.

A wireless modular multi-modal multi-node patch platform for robust biosignal monitoring.

PubMed

Pantelopoulos, Alexandros; Saldivar, Enrique; Roham, Masoud

2011-01-01

In this paper a wireless modular, multi-modal, multi-node patch platform is described. The platform comprises low-cost semi-disposable patch design aiming at unobtrusive ambulatory monitoring of multiple physiological parameters. Owing to its modular design it can be interfaced with various low-power RF communication and data storage technologies, while the data fusion of multi-modal and multi-node features facilitates measurement of several biosignals from multiple on-body locations for robust feature extraction. Preliminary results of the patch platform are presented which illustrate the capability to extract respiration rate from three different independent metrics, which combined together can give a more robust estimate of the actual respiratory rate.

Compressed single pixel imaging in the spatial frequency domain

PubMed Central

Torabzadeh, Mohammad; Park, Il-Yong; Bartels, Randy A.; Durkin, Anthony J.; Tromberg, Bruce J.

2017-01-01

Abstract. We have developed compressed sensing single pixel spatial frequency domain imaging (cs-SFDI) to characterize tissue optical properties over a wide field of view (35  mm×35  mm) using multiple near-infrared (NIR) wavelengths simultaneously. Our approach takes advantage of the relatively sparse spatial content required for mapping tissue optical properties at length scales comparable to the transport scattering length in tissue (ltr∼1  mm) and the high bandwidth available for spectral encoding using a single-element detector. cs-SFDI recovered absorption (μa) and reduced scattering (μs′) coefficients of a tissue phantom at three NIR wavelengths (660, 850, and 940 nm) within 7.6% and 4.3% of absolute values determined using camera-based SFDI, respectively. These results suggest that cs-SFDI can be developed as a multi- and hyperspectral imaging modality for quantitative, dynamic imaging of tissue optical and physiological properties. PMID:28300272

Biased migration of confined neutrophil-like cells in asymmetric hydraulic environments.

PubMed

Prentice-Mott, Harrison V; Chang, Chi-Han; Mahadevan, L; Mitchison, Timothy J; Irimia, Daniel; Shah, Jagesh V

2013-12-24

Cells integrate multiple measurement modalities to navigate their environment. Soluble and substrate-bound chemical gradients and physical cues have all been shown to influence cell orientation and migration. Here we investigate the role of asymmetric hydraulic pressure in directional sensing. Cells confined in microchannels identified and chose a path of lower hydraulic resistance in the absence of chemical cues. In a bifurcating channel with asymmetric hydraulic resistances, this choice was preceded by the elaboration of two leading edges with a faster extension rate along the lower resistance channel. Retraction of the "losing" edge appeared to precipitate a final choice of direction. The pressure differences altering leading edge protrusion rates were small, suggesting weak force generation by leading edges. The response to the physical asymmetry was able to override a dynamically generated chemical cue. Motile cells may use this bias as a result of hydraulic resistance, or "barotaxis," in concert with chemotaxis to navigate complex environments.

Sensor modeling and demonstration of a multi-object spectrometer for performance-driven sensing

NASA Astrophysics Data System (ADS)

Kerekes, John P.; Presnar, Michael D.; Fourspring, Kenneth D.; Ninkov, Zoran; Pogorzala, David R.; Raisanen, Alan D.; Rice, Andrew C.; Vasquez, Juan R.; Patel, Jeffrey P.; MacIntyre, Robert T.; Brown, Scott D.

2009-05-01

A novel multi-object spectrometer (MOS) is being explored for use as an adaptive performance-driven sensor that tracks moving targets. Developed originally for astronomical applications, the instrument utilizes an array of micromirrors to reflect light to a panchromatic imaging array. When an object of interest is detected the individual micromirrors imaging the object are tilted to reflect the light to a spectrometer to collect a full spectrum. This paper will present example sensor performance from empirical data collected in laboratory experiments, as well as our approach in designing optical and radiometric models of the MOS channels and the micromirror array. Simulation of moving vehicles in a highfidelity, hyperspectral scene is used to generate a dynamic video input for the adaptive sensor. Performance-driven algorithms for feature-aided target tracking and modality selection exploit multiple electromagnetic observables to track moving vehicle targets.

The electrophotonic silicon biosensor

NASA Astrophysics Data System (ADS)

Juan-Colás, José; Parkin, Alison; Dunn, Katherine E.; Scullion, Mark G.; Krauss, Thomas F.; Johnson, Steven D.

2016-09-01

The emergence of personalized and stratified medicine requires label-free, low-cost diagnostic technology capable of monitoring multiple disease biomarkers in parallel. Silicon photonic biosensors combine high-sensitivity analysis with scalable, low-cost manufacturing, but they tend to measure only a single biomarker and provide no information about their (bio)chemical activity. Here we introduce an electrochemical silicon photonic sensor capable of highly sensitive and multiparameter profiling of biomarkers. Our electrophotonic technology consists of microring resonators optimally n-doped to support high Q resonances alongside electrochemical processes in situ. The inclusion of electrochemical control enables site-selective immobilization of different biomolecules on individual microrings within a sensor array. The combination of photonic and electrochemical characterization also provides additional quantitative information and unique insight into chemical reactivity that is unavailable with photonic detection alone. By exploiting both the photonic and the electrical properties of silicon, the sensor opens new modalities for sensing on the microscale.

Physical Security Against Explosive Threats: Standoff Magnetic and Electro-optical Sensing and Target Characterization

DTIC Science & Technology

2012-10-21

PBIEDS ). Coupled with recent suicide bomb events in unstable regions of Southwest Asia and Africa, long-standing Urgent Operation Need Statements for...explosives and shrapnel (metal screws, bolts, ball bearings). A PBIED detection capability is critically needed not only for operations during open...produce magnetic signals above a certain threshold. We have developed a simple and robust multi- modal sensing system to detect PBIEDs and metal

Turbofan aft duct suppressor study. Contractor's data report of mode probe signal data

NASA Technical Reports Server (NTRS)

Fiske, G. H.; Motsinger, R. E.; Syed, A. A.; Joshi, M. C.; Kraft, R. E.

1983-01-01

Acoustic modal distributions were measured in a fan test model having an annular exhaust duct for comparison with theoretically predicted acoustic suppression values. This report contains the amplitude and phase data of the acoustic signals sensed by the transducers of the two mode probes employed in the measurement. Each mode probe consisted of an array of 12 transducers sensing the acoustic field at three axial positions and four radial positions.

Mental Imagery Induces Cross-Modal Sensory Plasticity and Changes Future Auditory Perception.

PubMed

Berger, Christopher C; Ehrsson, H Henrik

2018-04-01

Can what we imagine in our minds change how we perceive the world in the future? A continuous process of multisensory integration and recalibration is responsible for maintaining a correspondence between the senses (e.g., vision, touch, audition) and, ultimately, a stable and coherent perception of our environment. This process depends on the plasticity of our sensory systems. The so-called ventriloquism aftereffect-a shift in the perceived localization of sounds presented alone after repeated exposure to spatially mismatched auditory and visual stimuli-is a clear example of this type of plasticity in the audiovisual domain. In a series of six studies with 24 participants each, we investigated an imagery-induced ventriloquism aftereffect in which imagining a visual stimulus elicits the same frequency-specific auditory aftereffect as actually seeing one. These results demonstrate that mental imagery can recalibrate the senses and induce the same cross-modal sensory plasticity as real sensory stimuli.

Gyrocopter-Based Remote Sensing Platform

NASA Astrophysics Data System (ADS)

Weber, I.; Jenal, A.; Kneer, C.; Bongartz, J.

2015-04-01

In this paper the development of a lightweight and highly modularized airborne sensor platform for remote sensing applications utilizing a gyrocopter as a carrier platform is described. The current sensor configuration consists of a high resolution DSLR camera for VIS-RGB recordings. As a second sensor modality, a snapshot hyperspectral camera was integrated in the aircraft. Moreover a custom-developed thermal imaging system composed of a VIS-PAN camera and a LWIR-camera is used for aerial recordings in the thermal infrared range. Furthermore another custom-developed highly flexible imaging system for high resolution multispectral image acquisition with up to six spectral bands in the VIS-NIR range is presented. The performance of the overall system was tested during several flights with all sensor modalities and the precalculated demands with respect to spatial resolution and reliability were validated. The collected data sets were georeferenced, georectified, orthorectified and then stitched to mosaics.

All-Fiber Laser Curvature Sensor Using an In-Fiber Modal Interferometer Based on a Double Clad Fiber and a Multimode Fiber Structure

PubMed Central

Durán-Sánchez, Manuel; Prieto-Cortés, Patricia; Salceda-Delgado, Guillermo; Castillo-Guzmán, Arturo A.; Selvas-Aguilar, Romeo; Ibarra-Escamilla, Baldemar; Kuzin, Evgeny A.

2017-01-01

An all-fiber curvature laser sensor by using a novel modal interference in-fiber structure is proposed and experimentally demonstrated. The in-fiber device, fabricated by fusion splicing of multimode fiber and double-clad fiber segments, is used as wavelength filter as well as the sensing element. By including a multimode fiber in an ordinary modal interference structure based on a double-clad fiber, the fringe visibility of the filter transmission spectrum is significantly increased. By using the modal interferometer as a curvature sensitive wavelength filter within a ring cavity erbium-doped fiber laser, the spectral quality factor Q is considerably increased. The results demonstrate the reliability of the proposed curvature laser sensor with advantages of robustness, ease of fabrication, low cost, repeatability on the fabrication process and simple operation. PMID:29182527

All-Fiber Laser Curvature Sensor Using an In-Fiber Modal Interferometer Based on a Double Clad Fiber and a Multimode Fiber Structure.

PubMed

Álvarez-Tamayo, Ricardo I; Durán-Sánchez, Manuel; Prieto-Cortés, Patricia; Salceda-Delgado, Guillermo; Castillo-Guzmán, Arturo A; Selvas-Aguilar, Romeo; Ibarra-Escamilla, Baldemar; Kuzin, Evgeny A

2017-11-28

An all-fiber curvature laser sensor by using a novel modal interference in-fiber structure is proposed and experimentally demonstrated. The in-fiber device, fabricated by fusion splicing of multimode fiber and double-clad fiber segments, is used as wavelength filter as well as the sensing element. By including a multimode fiber in an ordinary modal interference structure based on a double-clad fiber, the fringe visibility of the filter transmission spectrum is significantly increased. By using the modal interferometer as a curvature sensitive wavelength filter within a ring cavity erbium-doped fiber laser, the spectral quality factor Q is considerably increased. The results demonstrate the reliability of the proposed curvature laser sensor with advantages of robustness, ease of fabrication, low cost, repeatability on the fabrication process and simple operation.

Multimodal Sparse Coding for Event Detection

DTIC Science & Technology

2015-10-13

classification tasks based on single modality. We present multimodal sparse coding for learning feature representations shared across multiple modalities...The shared representa- tions are applied to multimedia event detection (MED) and evaluated in compar- ison to unimodal counterparts, as well as other...and video tracks from the same multimedia clip, we can force the two modalities to share a similar sparse representation whose benefit includes robust

Non-hierarchical Influence of Visual Form, Touch, and Position Cues on Embodiment, Agency, and Presence in Virtual Reality

PubMed Central

Pritchard, Stephen C.; Zopf, Regine; Polito, Vince; Kaplan, David M.; Williams, Mark A.

2016-01-01

The concept of self-representation is commonly decomposed into three component constructs (sense of embodiment, sense of agency, and sense of presence), and each is typically investigated separately across different experimental contexts. For example, embodiment has been explored in bodily illusions; agency has been investigated in hypnosis research; and presence has been primarily studied in the context of Virtual Reality (VR) technology. Given that each component involves the integration of multiple cues within and across sensory modalities, they may rely on similar underlying mechanisms. However, the degree to which this may be true remains unclear when they are independently studied. As a first step toward addressing this issue, we manipulated a range of cues relevant to these components of self-representation within a single experimental context. Using consumer-grade Oculus Rift VR technology, and a new implementation of the Virtual Hand Illusion, we systematically manipulated visual form plausibility, visual–tactile synchrony, and visual–proprioceptive spatial offset to explore their influence on self-representation. Our results show that these cues differentially influence embodiment, agency, and presence. We provide evidence that each type of cue can independently and non-hierarchically influence self-representation yet none of these cues strictly constrains or gates the influence of the others. We discuss theoretical implications for understanding self-representation as well as practical implications for VR experiment design, including the suitability of consumer-based VR technology in research settings. PMID:27826275

On validating remote sensing simulations using coincident real data

NASA Astrophysics Data System (ADS)

Wang, Mingming; Yao, Wei; Brown, Scott; Goodenough, Adam; van Aardt, Jan

2016-05-01

The remote sensing community often requires data simulation, either via spectral/spatial downsampling or through virtual, physics-based models, to assess systems and algorithms. The Digital Imaging and Remote Sensing Image Generation (DIRSIG) model is one such first-principles, physics-based model for simulating imagery for a range of modalities. Complex simulation of vegetation environments subsequently has become possible, as scene rendering technology and software advanced. This in turn has created questions related to the validity of such complex models, with potential multiple scattering, bidirectional distribution function (BRDF), etc. phenomena that could impact results in the case of complex vegetation scenes. We selected three sites, located in the Pacific Southwest domain (Fresno, CA) of the National Ecological Observatory Network (NEON). These sites represent oak savanna, hardwood forests, and conifer-manzanita-mixed forests. We constructed corresponding virtual scenes, using airborne LiDAR and imaging spectroscopy data from NEON, ground-based LiDAR data, and field-collected spectra to characterize the scenes. Imaging spectroscopy data for these virtual sites then were generated using the DIRSIG simulation environment. This simulated imagery was compared to real AVIRIS imagery (15m spatial resolution; 12 pixels/scene) and NEON Airborne Observation Platform (AOP) data (1m spatial resolution; 180 pixels/scene). These tests were performed using a distribution-comparison approach for select spectral statistics, e.g., established the spectra's shape, for each simulated versus real distribution pair. The initial comparison results of the spectral distributions indicated that the shapes of spectra between the virtual and real sites were closely matched.

Scientific and industrial challenges of developing nanoparticle-based theranostics and multiple-modality contrast agents for clinical application

NASA Astrophysics Data System (ADS)

Wáng, Yì Xiáng J.; Idée, Jean-Marc; Corot, Claire

2015-10-01

Designing of theranostics and dual or multi-modality contrast agents are currently two of the hottest topics in biotechnology and biomaterials science. However, for single entity theranostics, a right ratio of their diagnostic component and their therapeutic component may not always be realized in a composite suitable for clinical application. For dual/multiple modality molecular imaging agents, after in vivo administration, there is an optimal time window for imaging, when an agent is imaged by one modality, the pharmacokinetics of this agent may not allow imaging by another modality. Due to reticuloendothelial system clearance, efficient in vivo delivery of nanoparticles to the lesion site is sometimes difficult. The toxicity of these entities also remains poorly understood. While the medical need of theranostics is admitted, the business model remains to be established. There is an urgent need for a global and internationally harmonized re-evaluation of the approval and marketing processes of theranostics. However, a reasonable expectation exists that, in the near future, the current obstacles will be removed, thus allowing the wide use of these very promising agents.

Modal vector estimation for closely spaced frequency modes

NASA Technical Reports Server (NTRS)

Craig, R. R., Jr.; Chung, Y. T.; Blair, M.

1982-01-01

Techniques for obtaining improved modal vector estimates for systems with closely spaced frequency modes are discussed. In describing the dynamical behavior of a complex structure modal parameters are often analyzed: undamped natural frequency, mode shape, modal mass, modal stiffness and modal damping. From both an analytical standpoint and an experimental standpoint, identification of modal parameters is more difficult if the system has repeated frequencies or even closely spaced frequencies. The more complex the structure, the more likely it is to have closely spaced frequencies. This makes it difficult to determine valid mode shapes using single shaker test methods. By employing band selectable analysis (zoom) techniques and by employing Kennedy-Pancu circle fitting or some multiple degree of freedom (MDOF) curve fit procedure, the usefulness of the single shaker approach can be extended.

How meaning similarity influences ambiguous word processing: the current state of the literature

PubMed Central

Tokowicz, Natasha

2016-01-01

The majority of words in the English language do not correspond to a single meaning, but rather correspond to two or more unrelated meanings (i.e., are homonyms) or multiple related senses (i.e., are polysemes). It has been proposed that the different types of “semantically-ambiguous words” (i.e., words with more than one meaning) are processed and represented differently in the human mind. Several review papers and books have been written on the subject of semantic ambiguity (e.g., Adriaens, Small, Cottrell, & Tanenhaus, 1988; Burgess & Simpson, 1988; Degani & Tokowicz, 2010; Gorfein, 1989, 2001; Simpson, 1984). However, several more recent studies (e.g., Klein & Murphy, 2001; Klepousniotou, 2002; Klepousniotou & Baum, 2007; Rodd, Gaskell, & Marslen-Wilson, 2002) have investigated the role of the semantic similarity between the multiple meanings of ambiguous words on processing and representation, whereas this was not the emphasis of previous reviews of the literature. In this review, we focus on the current state of the semantic ambiguity literature that examines how different types of ambiguous words influence processing and representation. We analyze the consistent and inconsistent findings reported in the literature and how factors such as semantic similarity, meaning/sense frequency, task, timing, and modality affect ambiguous word processing. We discuss the findings with respect to recent parallel distributed processing (PDP) models of ambiguity processing (Armstrong & Plaut, 2008, 2011; Rodd, Gaskell, & Marslen-Wilson, 2004). Finally, we discuss how experience/instance-based models (e.g., Hintzman, 1986; Reichle & Perfetti, 2003) can inform a comprehensive understanding of semantic ambiguity resolution. PMID:24889119

Advanced wireless mobile collaborative sensing network for tactical and strategic missions

NASA Astrophysics Data System (ADS)

Xu, Hao

2017-05-01

In this paper, an advanced wireless mobile collaborative sensing network will be developed. Through properly combining wireless sensor network, emerging mobile robots and multi-antenna sensing/communication techniques, we could demonstrate superiority of developed sensing network. To be concrete, heterogeneous mobile robots including unmanned aerial vehicle (UAV) and unmanned ground vehicle (UGV) are equipped with multi-model sensors and wireless transceiver antennas. Through real-time collaborative formation control, multiple mobile robots can team the best formation that can provide most accurate sensing results. Also, formatting multiple mobile robots can also construct a multiple-input multiple-output (MIMO) communication system that can provide a reliable and high performance communication network.

Robust energy-absorbing compensators for the ACTEX II test article

NASA Astrophysics Data System (ADS)

Blaurock, Carl A.; Miller, David W.; Nye, Ted

1995-05-01

The paper addresses the problem of satellite solar panel vibration. A multi-layer vibration control scheme is investigated using a flight test article. Key issues in the active control portion are presented in the paper. The paper discusses the primary control design drivers, which are the time variations in modal frequencies due to configuration and thermal changes. A local control design approach is investigated, but found to be unworkable due to sensor/actuator non-collocation. An alternate design process uses linear robust control techniques, by describing the modal shifts as uncertainties. Multiple modal design, alpha- shifted multiple model, and a feedthrough compensation scheme are examined. Ground and simulation tests demonstrate that the resulting controllers provide significant vibration reduction in the presence of expected system variations.

Prospective Elementary Teachers Making Sense of Multidigit Multiplication: Leveraging Resources

ERIC Educational Resources Information Center

Whitacre, Ian; Nickerson, Susan D.

2016-01-01

This study examines how collective activity related to multiplication evolved over several class sessions in an elementary mathematics content course that was designed to foster prospective elementary teachers' number-sense development. We document how the class drew on as-if-shared ideas to make sense of multidigit multiplication in terms of…

FieldSAFE: Dataset for Obstacle Detection in Agriculture.

PubMed

Kragh, Mikkel Fly; Christiansen, Peter; Laursen, Morten Stigaard; Larsen, Morten; Steen, Kim Arild; Green, Ole; Karstoft, Henrik; Jørgensen, Rasmus Nyholm

2017-11-09

In this paper, we present a multi-modal dataset for obstacle detection in agriculture. The dataset comprises approximately 2 h of raw sensor data from a tractor-mounted sensor system in a grass mowing scenario in Denmark, October 2016. Sensing modalities include stereo camera, thermal camera, web camera, 360 ∘ camera, LiDAR and radar, while precise localization is available from fused IMU and GNSS. Both static and moving obstacles are present, including humans, mannequin dolls, rocks, barrels, buildings, vehicles and vegetation. All obstacles have ground truth object labels and geographic coordinates.

FieldSAFE: Dataset for Obstacle Detection in Agriculture

PubMed Central

Christiansen, Peter; Larsen, Morten; Steen, Kim Arild; Green, Ole; Karstoft, Henrik

2017-01-01

In this paper, we present a multi-modal dataset for obstacle detection in agriculture. The dataset comprises approximately 2 h of raw sensor data from a tractor-mounted sensor system in a grass mowing scenario in Denmark, October 2016. Sensing modalities include stereo camera, thermal camera, web camera, 360∘ camera, LiDAR and radar, while precise localization is available from fused IMU and GNSS. Both static and moving obstacles are present, including humans, mannequin dolls, rocks, barrels, buildings, vehicles and vegetation. All obstacles have ground truth object labels and geographic coordinates. PMID:29120383

Is Red Heavier Than Yellow Even for Blind?

PubMed

Barilari, Marco; de Heering, Adélaïde; Crollen, Virginie; Collignon, Olivier; Bottini, Roberto

2018-01-01

Across cultures and languages, people find similarities between the products of different senses in mysterious ways. By studying what is called cross-modal correspondences, cognitive psychologists discovered that lemons are fast rather than slow, boulders are sour, and red is heavier than yellow. Are these cross-modal correspondences established via sensory perception or can they be learned merely through language? We contribute to this debate by demonstrating that early blind people who lack the perceptual experience of color also think that red is heavier than yellow but to a lesser extent than sighted do.

Multi-modal remote sensing system (MRSS) for transportation infrastructure inspection and monitoring.

DOT National Transportation Integrated Search

2013-12-01

In this final report draft, our research results during the project period are highlighted : and summarized. Detailed description of our research activities is documented in our : submitted quarterly reports. The results reported in this Final Report...

Clutter and target discrimination in forward-looking ground penetrating radar using sparse structured basis pursuits

NASA Astrophysics Data System (ADS)

Camilo, Joseph A.; Malof, Jordan M.; Torrione, Peter A.; Collins, Leslie M.; Morton, Kenneth D.

2015-05-01

Forward-looking ground penetrating radar (FLGPR) is a remote sensing modality that has recently been investigated for buried threat detection. FLGPR offers greater standoff than other downward-looking modalities such as electromagnetic induction and downward-looking GPR, but it suffers from high false alarm rates due to surface and ground clutter. A stepped frequency FLGPR system consists of multiple radars with varying polarizations and bands, each of which interacts differently with subsurface materials and therefore might potentially be able to discriminate clutter from true buried targets. However, it is unclear which combinations of bands and polarizations would be most useful for discrimination or how to fuse them. This work applies sparse structured basis pursuit, a supervised statistical model which searches for sets of bands that are collectively effective for discriminating clutter from targets. The algorithm works by trying to minimize the number of selected items in a dictionary of signals; in this case the separate bands and polarizations make up the dictionary elements. A structured basis pursuit algorithm is employed to gather groups of modes together in collections to eliminate whole polarizations or sensors. The approach is applied to a large collection of FLGPR data for data around emplaced target and non-target clutter. The results show that a sparse structure basis pursuits outperforms a conventional CFAR anomaly detector while also pruning out unnecessary bands of the FLGPR sensor.

Learning multimodal dictionaries.

PubMed

Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

2007-09-01

Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

Chemosensory interaction: acquired olfactory impairment is associated with decreased taste function.

PubMed

Landis, Basile N; Scheibe, Mandy; Weber, Cornelia; Berger, Robert; Brämerson, Annika; Bende, Mats; Nordin, Steven; Hummel, Thomas

2010-08-01

Olfaction, taste and trigeminal function are three distinct modalities. However, in daily life they are often activated concomitantly. In health and disease, it has been shown that in two of these senses, the trigeminal and olfactory senses, modification of one sense leads to changes in the other sense and vice versa. The objective of the study was to investigate whether and (if so) how, the third modality, taste, is influenced by olfactory impairment. We tested 210 subjects with normal (n = 107) or impaired (n = 103) olfactory function for their taste identification capacities. Validated tests were used for olfactory and gustatory testing (Sniffin' Sticks, Taste Strips). In an additional experiment, healthy volunteers underwent reversible olfactory cleft obstruction to investigate short-time changes of gustatory function after olfactory alteration. Mean gustatory identification (taste strip score) for the subjects with impaired olfaction was 19.4 +/- 0.6 points and 22.9 +/- 0.5 points for those with normal olfactory function (t = 4.6, p < 0.001). The frequencies of both, smell and taste impairments interacted significantly (Chi(2), F = 16.4, p < 0.001), and olfactory and gustatory function correlated (r (210) = 0.30, p < 0.001). Neither age nor olfactory impairment cause effects interfered with this olfactory-gustatory interaction. In contrast, after short-lasting induced olfactory decrease, gustatory function remained unchanged. The present study suggests that longstanding impaired olfactory function is associated with decreased gustatory function. These findings seem to extend previously described mutual chemosensory interactions also to smell and taste. It further raises the question whether chemical senses in general decrease mutually after acquired damage.

Hybrid wavefront sensor for the fast detection of wavefront disturbances.

PubMed

Dong, Shihao; Haist, Tobias; Osten, Wolfgang

2012-09-01

Strongly aberrated wavefronts lead to inaccuracies and nonlinearities in holography-based modal wavefront sensing (HMWS). In this contribution, a low-resolution Shack-Hartmann sensor (LRSHS) is incorporated into HMWS via a compact holographic design to extend the dynamic range of HMWS. A static binary-phase computer-generated hologram is employed to generate the desired patterns for Shack-Hartmann sensing and HMWS. The low-order aberration modes dominating the wavefront error are first sensed with the LRSHS and corrected by the wavefront modulator. The system then switches to HMWS to obtain better sensor sensitivity and accuracy. Simulated as well as experimental results are shown for validating the proposed method.

Multiple Volume Scattering in Random Media and Periodic Structures with Applications in Microwave Remote Sensing and Wave Functional Materials

NASA Astrophysics Data System (ADS)

Tan, Shurun

The objective of my research is two-fold: to study wave scattering phenomena in dense volumetric random media and in periodic wave functional materials. For the first part, the goal is to use the microwave remote sensing technique to monitor water resources and global climate change. Towards this goal, I study the microwave scattering behavior of snow and ice sheet. For snowpack scattering, I have extended the traditional dense media radiative transfer (DMRT) approach to include cyclical corrections that give rise to backscattering enhancements, enabling the theory to model combined active and passive observations of snowpack using the same set of physical parameters. Besides DMRT, a fully coherent approach is also developed by solving Maxwell's equations directly over the entire snowpack including a bottom half space. This revolutionary new approach produces consistent scattering and emission results, and demonstrates backscattering enhancements and coherent layer effects. The birefringence in anisotropic snow layers is also analyzed by numerically solving Maxwell's equation directly. The effects of rapid density fluctuations in polar ice sheet emission in the 0.5˜2.0 GHz spectrum are examined using both fully coherent and partially coherent layered media emission theories that agree with each other and distinct from incoherent approaches. For the second part, the goal is to develop integral equation based methods to solve wave scattering in periodic structures such as photonic crystals and metamaterials that can be used for broadband simulations. Set upon the concept of modal expansion of the periodic Green's function, we have developed the method of broadband Green's function with low wavenumber extraction (BBGFL), where a low wavenumber component is extracted and results a non-singular and fast-converging remaining part with simple wavenumber dependence. We've applied the technique to simulate band diagrams and modal solutions of periodic structures, and to construct broadband Green's functions including periodic scatterers.

Enhanced operator interface for hand-held landmine detector

NASA Astrophysics Data System (ADS)

Herman, Herman; McMahill, Jeffrey D.; Kantor, George

2001-10-01

As landmines get harder to detect, the complexity of landmine detectors has also been increasing. To increase the probability of detection and decrease the false alarm rate of low metallic landmines, many detectors employ multiple sensing modalities, which include radar and metal detector. Unfortunately, the operator interface for these new detectors stays pretty much the same as for the older detectors. Although the amount of information that the new detectors acquire has increased significantly, the interface has been limited to a simple audio interface. We are currently developing a hybrid audiovisual interface for enhancing the overall performance of the detector. The hybrid audiovisual interface combines the simplicity of the audio output with the rich spatial content of the video display. It is designed to optimally present the output of the detector and also to give the proper feedback to the operator. Instead of presenting all the data to the operator simultaneously, the interface allows the operator to access the information as needed. This capability is critical to avoid information overload, which can significantly reduce the performance of the operator. The audio is used as the primary notification signal, while the video is used for further feedback, discrimination, localization and sensor fusion. The idea is to let the operator gets the feedback that he needs and enable him to look at the data in the most efficient way. We are also looking at a hybrid man-machine detection system which utilizes precise sweeping by the machine and powerful human cognitive ability. In such a hybrid system, the operator is free to concentrate on discriminant task, such as manually fusing the output of the different sensing modalities, instead of worrying about the proper sweep technique. In developing this concept, we have been using the virtual mien lane to validate some of these concepts. We obtained some very encouraging results form our preliminary test. It clearly shows that with the proper feedback, the performance of the operator can be improved significantly in a very short time.

Experimental verification of a novel MEMS multi-modal vibration energy harvester for ultra-low power remote sensing nodes

NASA Astrophysics Data System (ADS)

Iannacci, J.; Sordo, G.; Serra, E.; Kucera, M.; Schmid, U.

2015-05-01

In this work, we discuss the verification and preliminary experimental characterization of a MEMS-based vibration Energy Harvester (EH) design. The device, named Four-Leaf Clover (FLC), is based on a circular-shaped mechanical resonator with four petal-like mass-spring cascaded systems. This solution introduces several mechanical Degrees of Freedom (DOFs), and therefore enables multiple resonant modes and deformation shapes in the vibrations frequency range of interest. The target is to realize a wideband multi-modal EH-MEMS device, that overcomes the typical narrowband working characteristics of standard cantilevered EHs, by ensuring flexible and adaptable power source to ultra-low power electronics for integrated remote sensing nodes (e.g. Wireless Sensor Networks - WSNs) in the Internet of Things (IoT) scenario, aiming to self-powered and energy autonomous smart systems. Finite Element Method simulations of the FLC EH-MEMS show the presence of several resonant modes for vibrations up to 4-5 kHz, and level of converted power up to a few μW at resonance and in closed-loop conditions (i.e. with resistive load). On the other hand, the first experimental tests of FLC fabricated samples, conducted with a Laser Doppler Vibrometer (LDV), proved the presence of several resonant modes, and allowed to validate the accuracy of the FEM modeling method. Such a good accordance holds validity for what concerns the coupled field behavior of the FLC EH-MEMS, as well. Both measurements and simulations performed at 190 Hz (i.e. out of resonance) showed the generation of power in the range of nW (Root Mean Square - RMS values). Further steps of this work will include the experimental characterization in a full range of vibrations, aiming to prove the whole functionality of the FLC EH-MEMS proposed design concept.

Viking Landers and remote sensing

NASA Technical Reports Server (NTRS)

Moore, H. J.; Jakosky, B. M.; Christensen, P. R.

1987-01-01

Thermal and radar remote sensing signatures of the materials in the lander sample fields can be crudely estimated from evaluations of their physical-mechanical properties, laboratory data on thermal conductivities and dielectric constants, and theory. The estimated thermal inertias and dielectric constants of some of the materials in the sample field are close to modal values estimated from orbital and earth-based observations. This suggests that the mechanical properties of the surface materials of much of Mars will not be significantly different that those of the landing sites.

Ontology-aided feature correlation for multi-modal urban sensing

NASA Astrophysics Data System (ADS)

Misra, Archan; Lantra, Zaman; Jayarajah, Kasthuri

2016-05-01

The paper explores the use of correlation across features extracted from different sensing channels to help in urban situational understanding. We use real-world datasets to show how such correlation can improve the accuracy of detection of city-wide events by combining metadata analysis with image analysis of Instagram content. We demonstrate this through a case study on the Singapore Haze. We show that simple ontological relationships and reasoning can significantly help in automating such correlation-based understanding of transient urban events.

Multi-Sensor Based State Prediction for Personal Mobility Vehicles

PubMed Central

Gupta, Pankaj; Umata, Ichiro; Watanabe, Atsushi; Even, Jani; Suyama, Takayuki; Ishii, Shin

2016-01-01

This paper presents a study on multi-modal human emotional state detection while riding a powered wheelchair (PMV; Personal Mobility Vehicle) in an indoor labyrinth-like environment. The study reports findings on the habituation of human stress response during self-driving. In addition, the effects of “loss of controllability”, change in the role of the driver to a passenger, are investigated via an autonomous driving modality. The multi-modal emotional state detector sensing framework consists of four sensing devices: electroencephalograph (EEG), heart inter-beat interval (IBI), galvanic skin response (GSR) and stressor level lever (in the case of autonomous riding). Physiological emotional state measurement characteristics are organized by time-scale, in terms of capturing slower changes (long-term) and quicker changes from moment-to-moment. Experimental results with fifteen participants regarding subjective emotional state reports and commercial software measurements validated the proposed emotional state detector. Short-term GSR and heart signal characterizations captured moment-to-moment emotional state during autonomous riding (Spearman correlation; ρ = 0.6, p < 0.001). Short-term GSR and EEG characterizations reliably captured moment-to-moment emotional state during self-driving (Classification accuracy; 69.7). Finally, long-term GSR and heart characterizations were confirmed to reliably capture slow changes during autonomous riding and also of emotional state during participant resting state. The purpose of this study and the exploration of various algorithms and sensors in a structured framework is to provide a comprehensive background for multi-modal emotional state prediction experiments and/or applications. Additional discussion regarding the feasibility and utility of the possibilities of these concepts are given. PMID:27732589

Multi-Sensor Based State Prediction for Personal Mobility Vehicles.

PubMed

Abdur-Rahim, Jamilah; Morales, Yoichi; Gupta, Pankaj; Umata, Ichiro; Watanabe, Atsushi; Even, Jani; Suyama, Takayuki; Ishii, Shin

2016-01-01

This paper presents a study on multi-modal human emotional state detection while riding a powered wheelchair (PMV; Personal Mobility Vehicle) in an indoor labyrinth-like environment. The study reports findings on the habituation of human stress response during self-driving. In addition, the effects of "loss of controllability", change in the role of the driver to a passenger, are investigated via an autonomous driving modality. The multi-modal emotional state detector sensing framework consists of four sensing devices: electroencephalograph (EEG), heart inter-beat interval (IBI), galvanic skin response (GSR) and stressor level lever (in the case of autonomous riding). Physiological emotional state measurement characteristics are organized by time-scale, in terms of capturing slower changes (long-term) and quicker changes from moment-to-moment. Experimental results with fifteen participants regarding subjective emotional state reports and commercial software measurements validated the proposed emotional state detector. Short-term GSR and heart signal characterizations captured moment-to-moment emotional state during autonomous riding (Spearman correlation; ρ = 0.6, p < 0.001). Short-term GSR and EEG characterizations reliably captured moment-to-moment emotional state during self-driving (Classification accuracy; 69.7). Finally, long-term GSR and heart characterizations were confirmed to reliably capture slow changes during autonomous riding and also of emotional state during participant resting state. The purpose of this study and the exploration of various algorithms and sensors in a structured framework is to provide a comprehensive background for multi-modal emotional state prediction experiments and/or applications. Additional discussion regarding the feasibility and utility of the possibilities of these concepts are given.

Attention to olfaction. A psychophysical investigation.

PubMed

Spence, C; McGlone, F P; Kettenmann, B; Kobal, G

2001-06-01

Olfaction is unique among the senses in that signals from the peripheral sensory receptors bypass the thalamus on their way to the cortex. The fact that olfactory stimuli are not gated by the thalamus has led some researchers to suggest that people may be unable to selectively direct their attention toward the olfactory modality. We examined this issue in an experiment where participants made speeded intensity (strong vs weak)-discrimination responses to an unpredictable sequence of olfactory and visual stimuli. Attention was directed to either olfaction or to vision by means of an informative cue that predicted the likely modality for the upcoming target on the majority of trials. Participants responded more rapidly when the target was presented in the expected rather than the unexpected modality, showing that people can selectively attend to olfaction.

Biological Parametric Mapping: A Statistical Toolbox for Multi-Modality Brain Image Analysis

PubMed Central

Casanova, Ramon; Ryali, Srikanth; Baer, Aaron; Laurienti, Paul J.; Burdette, Jonathan H.; Hayasaka, Satoru; Flowers, Lynn; Wood, Frank; Maldjian, Joseph A.

2006-01-01

In recent years multiple brain MR imaging modalities have emerged; however, analysis methodologies have mainly remained modality specific. In addition, when comparing across imaging modalities, most researchers have been forced to rely on simple region-of-interest type analyses, which do not allow the voxel-by-voxel comparisons necessary to answer more sophisticated neuroscience questions. To overcome these limitations, we developed a toolbox for multimodal image analysis called biological parametric mapping (BPM), based on a voxel-wise use of the general linear model. The BPM toolbox incorporates information obtained from other modalities as regressors in a voxel-wise analysis, thereby permitting investigation of more sophisticated hypotheses. The BPM toolbox has been developed in MATLAB with a user friendly interface for performing analyses, including voxel-wise multimodal correlation, ANCOVA, and multiple regression. It has a high degree of integration with the SPM (statistical parametric mapping) software relying on it for visualization and statistical inference. Furthermore, statistical inference for a correlation field, rather than a widely-used T-field, has been implemented in the correlation analysis for more accurate results. An example with in-vivo data is presented demonstrating the potential of the BPM methodology as a tool for multimodal image analysis. PMID:17070709

Compressive power spectrum sensing for vibration-based output-only system identification of structural systems in the presence of noise

NASA Astrophysics Data System (ADS)

Tau Siesakul, Bamrung; Gkoktsi, Kyriaki; Giaralis, Agathoklis

2015-05-01

Motivated by the need to reduce monetary and energy consumption costs of wireless sensor networks in undertaking output-only/operational modal analysis of engineering structures, this paper considers a multi-coset analog-toinformation converter for structural system identification from acceleration response signals of white noise excited linear damped structures sampled at sub-Nyquist rates. The underlying natural frequencies, peak gains in the frequency domain, and critical damping ratios of the vibrating structures are estimated directly from the sub-Nyquist measurements and, therefore, the computationally demanding signal reconstruction step is by-passed. This is accomplished by first employing a power spectrum blind sampling (PSBS) technique for multi-band wide sense stationary stochastic processes in conjunction with deterministic non-uniform multi-coset sampling patterns derived from solving a weighted least square optimization problem. Next, modal properties are derived by the standard frequency domain peak picking algorithm. Special attention is focused on assessing the potential of the adopted PSBS technique, which poses no sparsity requirements to the sensed signals, to derive accurate estimates of modal structural system properties from noisy sub- Nyquist measurements. To this aim, sub-Nyquist sampled acceleration response signals corrupted by various levels of additive white noise pertaining to a benchmark space truss structure with closely spaced natural frequencies are obtained within an efficient Monte Carlo simulation-based framework. Accurate estimates of natural frequencies and reasonable estimates of local peak spectral ordinates and critical damping ratios are derived from measurements sampled at about 70% below the Nyquist rate and for SNR as low as 0db demonstrating that the adopted approach enjoys noise immunity.

An Investigation of New Snow Water Equivalence Sensing Modalities

NASA Astrophysics Data System (ADS)

Frolik, J.; Skalka, C.; Wemple, B.

2008-12-01

It is well known that snowpack is highly variable and influenced by a range of factors, including topography and vegetation cover. As such, single point measurements may be viewed as being inadequate to characterize snowpack in a given area. Thus motivated by the desire for distributed sensing, this work presents results of a proof-of-concept investigation for new, low-cost, snow water equivalence (SWE) sensors based on the attenuation of microwave and gamma radiation. First, our work considers the attenuation of microwave signals at 2.4 GHz and 5 GHz due to an accumulating snowpack. These frequencies coincide with those used for common wireless networks and thus our proposed sensor can leverage existing hardware designs which are low-cost and power efficient. Second, we present attenuation data for radiation energy occurring between 500 keV and 1 MeV. These results were obtained utilizing a radiation detector based on Cadmium Zinc Telluride (CZT) technology. The proposed sensor will leverage recent investments such CZT based designs for homeland security applications. We contend that sensors based on these modalities will be low-cost and low-energy and thus readily integrated with wireless sensor network hardware for distributed monitoring. In addition, these sensors will be compact and thus can be placed in locations not feasible for current SWE sensor designs (e.g., snow pillows) or in locations too dangerous for snow course measurements (e.g., areas prone to avalanche). Since neither sensing methods requires contact with the snowpack, these modalities are also immune to snow bridging effects which plague existing designs. We also present preliminary findings of work conducted in a mountainous forested setting in northern New England which examines the influence of forest vegetation on snowpack.

Multiple Objects Fusion Tracker Using a Matching Network for Adaptively Represented Instance Pairs

PubMed Central

Oh, Sang-Il; Kang, Hang-Bong

2017-01-01

Multiple-object tracking is affected by various sources of distortion, such as occlusion, illumination variations and motion changes. Overcoming these distortions by tracking on RGB frames, such as shifting, has limitations because of material distortions caused by RGB frames. To overcome these distortions, we propose a multiple-object fusion tracker (MOFT), which uses a combination of 3D point clouds and corresponding RGB frames. The MOFT uses a matching function initialized on large-scale external sequences to determine which candidates in the current frame match with the target object in the previous frame. After conducting tracking on a few frames, the initialized matching function is fine-tuned according to the appearance models of target objects. The fine-tuning process of the matching function is constructed as a structured form with diverse matching function branches. In general multiple object tracking situations, scale variations for a scene occur depending on the distance between the target objects and the sensors. If the target objects in various scales are equally represented with the same strategy, information losses will occur for any representation of the target objects. In this paper, the output map of the convolutional layer obtained from a pre-trained convolutional neural network is used to adaptively represent instances without information loss. In addition, MOFT fuses the tracking results obtained from each modality at the decision level to compensate the tracking failures of each modality using basic belief assignment, rather than fusing modalities by selectively using the features of each modality. Experimental results indicate that the proposed tracker provides state-of-the-art performance considering multiple objects tracking (MOT) and KITTIbenchmarks. PMID:28420194

Do early sensory cortices integrate cross-modal information?

PubMed

Kayser, Christoph; Logothetis, Nikos K

2007-09-01

Our different senses provide complementary evidence about the environment and their interaction often aids behavioral performance or alters the quality of the sensory percept. A traditional view defers the merging of sensory information to higher association cortices, and posits that a large part of the brain can be reduced into a collection of unisensory systems that can be studied in isolation. Recent studies, however, challenge this view and suggest that cross-modal interactions can already occur in areas hitherto regarded as unisensory. We review results from functional imaging and electrophysiology exemplifying cross-modal interactions that occur early during the evoked response, and at the earliest stages of sensory cortical processing. Although anatomical studies revealed several potential origins of these cross-modal influences, there is yet no clear relation between particular functional observations and specific anatomical connections. In addition, our view on sensory integration at the neuronal level is coined by many studies on subcortical model systems of sensory integration; yet, the patterns of cross-modal interaction in cortex deviate from these model systems in several ways. Consequently, future studies on cortical sensory integration need to leave the descriptive level and need to incorporate cross-modal influences into models of the organization of sensory processing. Only then will we be able to determine whether early cross-modal interactions truly merit the label sensory integration, and how they increase a sensory system's ability to scrutinize its environment and finally aid behavior.

A frequency domain global parameter estimation method for multiple reference frequency response measurements

NASA Astrophysics Data System (ADS)

Shih, C. Y.; Tsuei, Y. G.; Allemang, R. J.; Brown, D. L.

1988-10-01

A method of using the matrix Auto-Regressive Moving Average (ARMA) model in the Laplace domain for multiple-reference global parameter identification is presented. This method is particularly applicable to the area of modal analysis where high modal density exists. The method is also applicable when multiple reference frequency response functions are used to characterise linear systems. In order to facilitate the mathematical solution, the Forsythe orthogonal polynomial is used to reduce the ill-conditioning of the formulated equations and to decouple the normal matrix into two reduced matrix blocks. A Complex Mode Indicator Function (CMIF) is introduced, which can be used to determine the proper order of the rational polynomials.

The sensory substrate of multimodal communication in brown-headed cowbirds: are females sensory 'specialists' or 'generalists'?

PubMed

Ronald, Kelly L; Sesterhenn, Timothy M; Fernandez-Juricic, Esteban; Lucas, Jeffrey R

2017-11-01

Many animals communicate with multimodal signals. While we have an understanding of multimodal signal production, we know relatively less about receiver filtering of multimodal signals and whether filtering capacity in one modality influences filtering in a second modality. Most multimodal signals contain a temporal element, such as change in frequency over time or a dynamic visual display. We examined the relationship in temporal resolution across two modalities to test whether females are (1) sensory 'specialists', where a trade-off exists between the sensory modalities, (2) sensory 'generalists', where a positive relationship exists between the modalities, or (3) whether no relationship exists between modalities. We used female brown-headed cowbirds (Molothrus ater) to investigate this question as males court females with an audiovisual display. We found a significant positive relationship between female visual and auditory temporal resolution, suggesting that females are sensory 'generalists'. Females appear to resolve information well across multiple modalities, which may select for males that signal their quality similarly across modalities.

Sounds and Sense-Abilities: Science for All

ERIC Educational Resources Information Center

Plourde, Lee A.; Klemm, E. Barbara

2004-01-01

Activities-oriented instruction offers multi modal opportunities for learning science. How do college students in elementary pre-service teacher preparation programs describe science lab activities in terms of visual, kinesthetic, auditory and motor characteristics? Research with elementary science methods students shows that the Levels of…

Spatially distributed modal signals of free shallow membrane shell structronic system

NASA Astrophysics Data System (ADS)

Yue, H. H.; Deng, Z. Q.; Tzou, H. S.

2008-11-01

Based on the smart material and structronics technology, distributed sensor and control of shell structures have been rapidly developed for the last 20 years. This emerging technology has been utilized in aerospace, telecommunication, micro-electromechanical systems and other engineering applications. However, distributed monitoring technique and its resulting global spatially distributed sensing signals of shallow paraboloidal membrane shells are not clearly understood. In this paper, modeling of free flexible paraboloidal shell with spatially distributed sensor, micro-sensing signal characteristics, and location of distributed piezoelectric sensor patches are investigated based on a new set of assumed mode shape functions. Parametric analysis indicates that the signal generation depends on modal membrane strains in the meridional and circumferential directions in which the latter is more significant than the former, when all bending strains vanish in membrane shells. This study provides a modeling and analysis technique for distributed sensors laminated on lightweight paraboloidal flexible structures and identifies critical components and regions that generate significant signals.

Building v/s Exploring Models: Comparing Learning of Evolutionary Processes through Agent-based Modeling

NASA Astrophysics Data System (ADS)

Wagh, Aditi

Two strands of work motivate the three studies in this dissertation. Evolutionary change can be viewed as a computational complex system in which a small set of rules operating at the individual level result in different population level outcomes under different conditions. Extensive research has documented students' difficulties with learning about evolutionary change (Rosengren et al., 2012), particularly in terms of levels slippage (Wilensky & Resnick, 1999). Second, though building and using computational models is becoming increasingly common in K-12 science education, we know little about how these two modalities compare. This dissertation adopts agent-based modeling as a representational system to compare these modalities in the conceptual context of micro-evolutionary processes. Drawing on interviews, Study 1 examines middle-school students' productive ways of reasoning about micro-evolutionary processes to find that the specific framing of traits plays a key role in whether slippage explanations are cued. Study 2, which was conducted in 2 schools with about 150 students, forms the crux of the dissertation. It compares learning processes and outcomes when students build their own models or explore a pre-built model. Analysis of Camtasia videos of student pairs reveals that builders' and explorers' ways of accessing rules, and sense-making of observed trends are of a different character. Builders notice rules through available blocks-based primitives, often bypassing their enactment while explorers attend to rules primarily through the enactment. Moreover, builders' sense-making of observed trends is more rule-driven while explorers' is more enactment-driven. Pre and posttests reveal that builders manifest a greater facility with accessing rules, providing explanations manifesting targeted assembly. Explorers use rules to construct explanations manifesting non-targeted assembly. Interviews reveal varying degrees of shifts away from slippage in both modalities, with students who built models not incorporating slippage explanations in responses. Study 3 compares these modalities with a control using traditional activities. Pre and posttests reveal that the two modalities manifested greater facility with accessing and assembling rules than the control. The dissertation offers implications for the design of learning environments for evolutionary change, design of the two modalities based on their strengths and weaknesses, and teacher training for the same.

Audiovisual Modulation in Mouse Primary Visual Cortex Depends on Cross-Modal Stimulus Configuration and Congruency.

PubMed

Meijer, Guido T; Montijn, Jorrit S; Pennartz, Cyriel M A; Lansink, Carien S

2017-09-06

The sensory neocortex is a highly connected associative network that integrates information from multiple senses, even at the level of the primary sensory areas. Although a growing body of empirical evidence supports this view, the neural mechanisms of cross-modal integration in primary sensory areas, such as the primary visual cortex (V1), are still largely unknown. Using two-photon calcium imaging in awake mice, we show that the encoding of audiovisual stimuli in V1 neuronal populations is highly dependent on the features of the stimulus constituents. When the visual and auditory stimulus features were modulated at the same rate (i.e., temporally congruent), neurons responded with either an enhancement or suppression compared with unisensory visual stimuli, and their prevalence was balanced. Temporally incongruent tones or white-noise bursts included in audiovisual stimulus pairs resulted in predominant response suppression across the neuronal population. Visual contrast did not influence multisensory processing when the audiovisual stimulus pairs were congruent; however, when white-noise bursts were used, neurons generally showed response suppression when the visual stimulus contrast was high whereas this effect was absent when the visual contrast was low. Furthermore, a small fraction of V1 neurons, predominantly those located near the lateral border of V1, responded to sound alone. These results show that V1 is involved in the encoding of cross-modal interactions in a more versatile way than previously thought. SIGNIFICANCE STATEMENT The neural substrate of cross-modal integration is not limited to specialized cortical association areas but extends to primary sensory areas. Using two-photon imaging of large groups of neurons, we show that multisensory modulation of V1 populations is strongly determined by the individual and shared features of cross-modal stimulus constituents, such as contrast, frequency, congruency, and temporal structure. Congruent audiovisual stimulation resulted in a balanced pattern of response enhancement and suppression compared with unisensory visual stimuli, whereas incongruent or dissimilar stimuli at full contrast gave rise to a population dominated by response-suppressing neurons. Our results indicate that V1 dynamically integrates nonvisual sources of information while still attributing most of its resources to coding visual information. Copyright © 2017 the authors 0270-6474/17/378783-14$15.00/0.

Quantitative optical imaging and sensing by joint design of point spread functions and estimation algorithms

NASA Astrophysics Data System (ADS)

Quirin, Sean Albert

The joint application of tailored optical Point Spread Functions (PSF) and estimation methods is an important tool for designing quantitative imaging and sensing solutions. By enhancing the information transfer encoded by the optical waves into an image, matched post-processing algorithms are able to complete tasks with improved performance relative to conventional designs. In this thesis, new engineered PSF solutions with image processing algorithms are introduced and demonstrated for quantitative imaging using information-efficient signal processing tools and/or optical-efficient experimental implementations. The use of a 3D engineered PSF, the Double-Helix (DH-PSF), is applied as one solution for three-dimensional, super-resolution fluorescence microscopy. The DH-PSF is a tailored PSF which was engineered to have enhanced information transfer for the task of localizing point sources in three dimensions. Both an information- and optical-efficient implementation of the DH-PSF microscope are demonstrated here for the first time. This microscope is applied to image single-molecules and micro-tubules located within a biological sample. A joint imaging/axial-ranging modality is demonstrated for application to quantifying sources of extended transverse and axial extent. The proposed implementation has improved optical-efficiency relative to prior designs due to the use of serialized cycling through select engineered PSFs. This system is demonstrated for passive-ranging, extended Depth-of-Field imaging and digital refocusing of random objects under broadband illumination. Although the serialized engineered PSF solution is an improvement over prior designs for the joint imaging/passive-ranging modality, it requires the use of multiple PSFs---a potentially significant constraint. Therefore an alternative design is proposed, the Single-Helix PSF, where only one engineered PSF is necessary and the chromatic behavior of objects under broadband illumination provides the necessary information transfer. The matched estimation algorithms are introduced along with an optically-efficient experimental system to image and passively estimate the distance to a test object. An engineered PSF solution is proposed for improving the sensitivity of optical wave-front sensing using a Shack-Hartmann Wave-front Sensor (SHWFS). The performance limits of the classical SHWFS design are evaluated and the engineered PSF system design is demonstrated to enhance performance. This system is fabricated and the mechanism for additional information transfer is identified.

Multisensory Integration and Behavioral Plasticity in Sharks from Different Ecological Niches

PubMed Central

Gardiner, Jayne M.; Atema, Jelle; Hueter, Robert E.; Motta, Philip J.

2014-01-01

The underwater sensory world and the sensory systems of aquatic animals have become better understood in recent decades, but typically have been studied one sense at a time. A comprehensive analysis of multisensory interactions during complex behavioral tasks has remained a subject of discussion without experimental evidence. We set out to generate a general model of multisensory information extraction by aquatic animals. For our model we chose to analyze the hierarchical, integrative, and sometimes alternate use of various sensory systems during the feeding sequence in three species of sharks that differ in sensory anatomy and behavioral ecology. By blocking senses in different combinations, we show that when some of their normal sensory cues were unavailable, sharks were often still capable of successfully detecting, tracking and capturing prey by switching to alternate sensory modalities. While there were significant species differences, odor was generally the first signal detected, leading to upstream swimming and wake tracking. Closer to the prey, as more sensory cues became available, the preferred sensory modalities varied among species, with vision, hydrodynamic imaging, electroreception, and touch being important for orienting to, striking at, and capturing the prey. Experimental deprivation of senses showed how sharks exploit the many signals that comprise their sensory world, each sense coming into play as they provide more accurate information during the behavioral sequence of hunting. The results may be applicable to aquatic hunting in general and, with appropriate modification, to other types of animal behavior. PMID:24695492

Dual-Modal Colorimetric/Fluorescence Molecular Probe for Ratiometric Sensing of pH and Its Application.

PubMed

Wu, Luling; Li, Xiaolin; Huang, Chusen; Jia, Nengqin

2016-08-16

As traditional pH meters cannot work well for minute regions (such as subcellular organelles) and in harsh media, molecular pH-sensitive devices for monitoring pH changes in diverse local heterogeneous environments are urgently needed. Here, we report a new dual-modal colorimetric/fluorescence merocyanine-based molecular probe (CPH) for ratiometric sensing of pH. Compared with previously reported pH probes, CPH bearing the benzyl group at the nitrogen position of the indolium group and the phenol, which is used as the acceptor for proton, could respond to pH changes immediately through both the ratiometric fluorescence signal readout and naked-eye colorimetric observation. The sensing process was highly stable and reversible. Most importantly, the suitable pKa value (6.44) allows CPH to presumably accumulate in lysosomes and become a lysosome-target fluorescent probe. By using CPH, the intralysosomal pH fluctuation stimulated by antimalaria drug chloroquine was successfully tracked in live cells through the ratiometric fluorescence images. Additionally, CPH could be immobilized on test papers, which exhibited a rapid and reversible colorimetric response to acid/base vapor through the naked-eye colorimetric analysis. This proof-of-concept study presents the potential application of CPH as a molecular tool for monitoring intralysosomal pH fluctuation in live cells, as well as paves the way for developing the economic, reusable, and fast-response optical pH meters for colorimetric sensing acid/base vapor with direct naked-eye observation.

Bayesian operational modal analysis with asynchronous data, part I: Most probable value

NASA Astrophysics Data System (ADS)

Zhu, Yi-Chen; Au, Siu-Kui

2018-01-01

In vibration tests, multiple sensors are used to obtain detailed mode shape information about the tested structure. Time synchronisation among data channels is required in conventional modal identification approaches. Modal identification can be more flexibly conducted if this is not required. Motivated by the potential gain in feasibility and economy, this work proposes a Bayesian frequency domain method for modal identification using asynchronous 'output-only' ambient data, i.e. 'operational modal analysis'. It provides a rigorous means for identifying the global mode shape taking into account the quality of the measured data and their asynchronous nature. This paper (Part I) proposes an efficient algorithm for determining the most probable values of modal properties. The method is validated using synthetic and laboratory data. The companion paper (Part II) investigates identification uncertainty and challenges in applications to field vibration data.

Mental Reactivation and Pleasantness Judgment of Experience Related to Vision, Hearing, Skin Sensations, Taste and Olfaction

PubMed Central

2016-01-01

Language acquisition is based on our knowledge about the world and forms through multiple sensory-motor interactions with the environment. We link the properties of individual experience formed at different stages of ontogeny with the phased development of sensory modalities and with the acquisition of words describing the appropriate forms of sensitivity. To test whether early-formed experience related to skin sensations, olfaction and taste differs from later-formed experience related to vision and hearing, we asked Russian-speaking participants to categorize or to assess the pleasantness of experience mentally reactivated by sense-related adjectives found in common dictionaries. It was found that categorizing adjectives in relation to vision, hearing and skin sensations took longer than categorizing adjectives in relation to olfaction and taste. In addition, experience described by adjectives predominantly related to vision, hearing and skin sensations took more time for the pleasantness judgment and generated less intense emotions than that described by adjectives predominantly related to olfaction and taste. Interestingly the dynamics of skin resistance corresponded to the intensity and pleasantness of reported emotions. We also found that sense-related experience described by early-acquired adjectives took less time for the pleasantness judgment and generated more intense and more positive emotions than that described by later-acquired adjectives. Correlations were found between the time of the pleasantness judgment of experience, intensity and pleasantness of reported emotions, age of acquisition, frequency, imageability and length of sense-related adjectives. All in all these findings support the hypothesis that early-formed experience is less differentiated than later-formed experience. PMID:27400090

Multi-modal automatic montaging of adaptive optics retinal images

PubMed Central

Chen, Min; Cooper, Robert F.; Han, Grace K.; Gee, James; Brainard, David H.; Morgan, Jessica I. W.

2016-01-01

We present a fully automated adaptive optics (AO) retinal image montaging algorithm using classic scale invariant feature transform with random sample consensus for outlier removal. Our approach is capable of using information from multiple AO modalities (confocal, split detection, and dark field) and can accurately detect discontinuities in the montage. The algorithm output is compared to manual montaging by evaluating the similarity of the overlapping regions after montaging, and calculating the detection rate of discontinuities in the montage. Our results show that the proposed algorithm has high alignment accuracy and a discontinuity detection rate that is comparable (and often superior) to manual montaging. In addition, we analyze and show the benefits of using multiple modalities in the montaging process. We provide the algorithm presented in this paper as open-source and freely available to download. PMID:28018714

Pheromone-sensing neurons regulate peripheral lipid metabolism in Caenorhabditis elegans

PubMed Central

Stieglitz, Jon; Locke, Tiffany T.; Zhang, Ying K.; Schroeder, Frank C.; Srinivasan, Supriya

2017-01-01

It is now established that the central nervous system plays an important role in regulating whole body metabolism and energy balance. However, the extent to which sensory systems relay environmental information to modulate metabolic events in peripheral tissues has remained poorly understood. In addition, it has been challenging to map the molecular mechanisms underlying discrete sensory modalities with respect to their role in lipid metabolism. In previous work our lab has identified instructive roles for serotonin signaling as a surrogate for food availability, as well as oxygen sensing, in the control of whole body metabolism. In this study, we now identify a role for a pair of pheromone-sensing neurons in regulating fat metabolism in C. elegans, which has emerged as a tractable and highly informative model to study the neurobiology of metabolism. A genetic screen revealed that GPA-3, a member of the Gα family of G proteins, regulates body fat content in the intestine, the major metabolic organ for C. elegans. Genetic and reconstitution studies revealed that the potent body fat phenotype of gpa-3 null mutants is controlled from a pair of neurons called ADL(L/R). We show that cAMP functions as the second messenger in the ADL neurons, and regulates body fat stores via the neurotransmitter acetylcholine, from downstream neurons. We find that the pheromone ascr#3, which is detected by the ADL neurons, regulates body fat stores in a GPA-3-dependent manner. We define here a third sensory modality, pheromone sensing, as a major regulator of body fat metabolism. The pheromone ascr#3 is an indicator of population density, thus we hypothesize that pheromone sensing provides a salient 'denominator' to evaluate the amount of food available within a population and to accordingly adjust metabolic rate and body fat levels. PMID:28545126

Pheromone-sensing neurons regulate peripheral lipid metabolism in Caenorhabditis elegans.

PubMed

Hussey, Rosalind; Stieglitz, Jon; Mesgarzadeh, Jaleh; Locke, Tiffany T; Zhang, Ying K; Schroeder, Frank C; Srinivasan, Supriya

2017-05-01

It is now established that the central nervous system plays an important role in regulating whole body metabolism and energy balance. However, the extent to which sensory systems relay environmental information to modulate metabolic events in peripheral tissues has remained poorly understood. In addition, it has been challenging to map the molecular mechanisms underlying discrete sensory modalities with respect to their role in lipid metabolism. In previous work our lab has identified instructive roles for serotonin signaling as a surrogate for food availability, as well as oxygen sensing, in the control of whole body metabolism. In this study, we now identify a role for a pair of pheromone-sensing neurons in regulating fat metabolism in C. elegans, which has emerged as a tractable and highly informative model to study the neurobiology of metabolism. A genetic screen revealed that GPA-3, a member of the Gα family of G proteins, regulates body fat content in the intestine, the major metabolic organ for C. elegans. Genetic and reconstitution studies revealed that the potent body fat phenotype of gpa-3 null mutants is controlled from a pair of neurons called ADL(L/R). We show that cAMP functions as the second messenger in the ADL neurons, and regulates body fat stores via the neurotransmitter acetylcholine, from downstream neurons. We find that the pheromone ascr#3, which is detected by the ADL neurons, regulates body fat stores in a GPA-3-dependent manner. We define here a third sensory modality, pheromone sensing, as a major regulator of body fat metabolism. The pheromone ascr#3 is an indicator of population density, thus we hypothesize that pheromone sensing provides a salient 'denominator' to evaluate the amount of food available within a population and to accordingly adjust metabolic rate and body fat levels.

Polyarteritis nodosa: MDCT as a 'One-Stop Shop' Modality for Whole-Body Arterial Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tsai, W.-L.; Tsai, I-C.; Lee Tain, E-mail: s841082@ym.edu.t

Polyarteritis nodosa is a rare disease, which is characterized by aneurysm formation and occlusion in the arteries of multiple systems. Due to its extensive involvement, whole-body evaluation is necessary for diagnosis and treatment monitoring. We report a case of polyarteritis nodosa using multidetector-row computed tomography (MDCT) as a 'one-stop shop' modality for whole-body arterial evaluation. With precise protocol design, MDCT can be used as a reliable noninvasive modality providing comprehensive whole-body arterial evaluation.

Design and implementation of a novel modal space active force control concept for spatial multi-DOF parallel robotic manipulators actuated by electrical actuators.

PubMed

Yang, Chifu; Zhao, Jinsong; Li, Liyi; Agrawal, Sunil K

2018-01-01

Robotic spine brace based on parallel-actuated robotic system is a new device for treatment and sensing of scoliosis, however, the strong dynamic coupling and anisotropy problem of parallel manipulators result in accuracy loss of rehabilitation force control, including big error in direction and value of force. A novel active force control strategy named modal space force control is proposed to solve these problems. Considering the electrical driven system and contact environment, the mathematical model of spatial parallel manipulator is built. The strong dynamic coupling problem in force field is described via experiments as well as the anisotropy problem of work space of parallel manipulators. The effects of dynamic coupling on control design and performances are discussed, and the influences of anisotropy on accuracy are also addressed. With mass/inertia matrix and stiffness matrix of parallel manipulators, a modal matrix can be calculated by using eigenvalue decomposition. Making use of the orthogonality of modal matrix with mass matrix of parallel manipulators, the strong coupled dynamic equations expressed in work space or joint space of parallel manipulator may be transformed into decoupled equations formulated in modal space. According to this property, each force control channel is independent of others in the modal space, thus we proposed modal space force control concept which means the force controller is designed in modal space. A modal space active force control is designed and implemented with only a simple PID controller employed as exampled control method to show the differences, uniqueness, and benefits of modal space force control. Simulation and experimental results show that the proposed modal space force control concept can effectively overcome the effects of the strong dynamic coupling and anisotropy problem in the physical space, and modal space force control is thus a very useful control framework, which is better than the current joint space control and work space control. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

Accuracy of Different Modalities to Record Natural Head Position in 3 Dimensions: A Systematic Review.

PubMed

Leung, Ming Yin; Lo, John; Leung, Yiu Yan

2016-11-01

Three-dimensional (3D) images are taken with positioning devices to ensure a patient's stability, which, however, place the patient's head into a random orientation. Reorientation of images to the natural head position (NHP) is necessary for appropriate assessment of dentofacial deformities before any surgical planning. The aim of this study was to review the literature systematically to identify and evaluate the various modalities available to record the NHP in 3 dimensions and to compare their accuracy. A systematic literature search of the PubMed, Cochrane Library and Embase databases, with no limitations on publication time or language, was performed in July 2015. The search and evaluations of articles were performed in 4 rounds. The methodologies, accuracies, advantages, and limitations of various modalities to record NHP were examined. Eight articles were included in the final review. Six modalities to record NHP were identified, namely 1) stereophotogrammetry, 2) facial markings along laser lines, 3) clinical photographs and the pose from orthography and scaling with iterations (POSIT) algorithm, 4) digital orientation sensing, 5) handheld 3D camera measuring system, and 6) laser scanning. Digital orientation sensing had good accuracy, with mean angular differences from the reference within 1° (0.07 ± 0.49° and 0.12 ± 0.54°, respectively). Laser scanning was shown to be comparable to digital orientation sensing. The method involving clinical photographs and the POSIT algorithm was reported to have good accuracy, with mean angular differences for pitch, roll, and yaw within 1° (-0.17 ± 0.50°). Stereophotogrammetry was reported to have the highest reliability, with mean angular deviations in pitch, roll, and yaw for active and passive stereophotogrammetric devices within 0.1° (0.004771 ± 0.045645° and 0.007572 ± 0.079088°, respectively). This systematic review showed that recording the NHP in 3 dimensions with a digital orientation sensor has good accuracy. Laser scanning was found to have comparable accuracy to digital orientation sensing, but routine clinical use was limited by its high cost and low portability. Stereophotogrammetry and the method using a single clinical photograph and the POSIT algorithm were potential alternatives. Nevertheless, clinical trials are needed to verify their applications in patients. Preferably, digital orientation sensor should be used as a reference for comparison with new proposed methods of recording the NHP in future research. Copyright © 2016 American Association of Oral and Maxillofacial Surgeons. Published by Elsevier Inc. All rights reserved.

A qualitative investigation of lay perspectives of diagnosis and self-management strategies employed by people with progressive multiple sclerosis.

PubMed

Frost, Julia; Grose, Jane; Britten, Nicky

2017-05-01

This article explores how people with progressive multiple sclerosis give meaning to their experiences. It builds upon the self-management literature, which has captured the tension between the desire for retaining normalcy and the increasing burden of self-management associated with chronic disease progression. This repeat interview study is empirically grounded in 28 interviews with 14 people with progressive multiple sclerosis. We identified gender differences in diagnosis-seeking which impacted subsequent sense-making. Male respondents found a diagnosis of multiple sclerosis difficult to come to terms with, and an enduring sense of loss or anger could inhibit further sense-making. A diagnosis of multiple sclerosis was more difficult to obtain for women respondents, and any sense of certainty that diagnosis provided framed their subsequent sense-making strategies. The complex sequelae of multiple sclerosis require that self-management strategies are both contextual and timely, although even the most accomplished self-managers can lose their sense of self with neurodegeneration. Disease progression can be associated with suicidal ideation, suggesting the need for greater dialogue to ensure that people with multiple sclerosis are adequately supported to fulfil their quality of life at all stages of neurodegeneration. These lay perspectives emphasise the articulation of affect rather than the rendering of a medical diagnosis, although diagnosis may provide a degree of certainty in the short term. The ethos of self-management ensures people attempt to retain their sense of 'normality' and existent social roles for as long as possible, but this ethos can negate both one's ability to self-manage and the management of self.

A modal parameter extraction procedure applicable to linear time-invariant dynamic systems

NASA Technical Reports Server (NTRS)

Kurdila, A. J.; Craig, R. R., Jr.

1985-01-01

Modal analysis has emerged as a valuable tool in many phases of the engineering design process. Complex vibration and acoustic problems in new designs can often be remedied through use of the method. Moreover, the technique has been used to enhance the conceptual understanding of structures by serving to verify analytical models. A new modal parameter estimation procedure is presented. The technique is applicable to linear, time-invariant systems and accommodates multiple input excitations. In order to provide a background for the derivation of the method, some modal parameter extraction procedures currently in use are described. Key features implemented in the new technique are elaborated upon.

Single Mode Air-Clad Single Crystal Sapphire Optical Fiber

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hill, Cary; Homa, Dan; Yu, Zhihao

The observation of single mode propagation in an air-clad single crystal sapphire optical fiber at wavelengths at and above 783 nm is presented for the first time. A high-temperature wet acid etching method was used to reduce the diameter of a 10 cm length of commercially-sourced sapphire fiber from 125 micrometers to 6.5 micrometers, and far-field imaging provided modal information at intervals as the fiber diameter decreased. Modal volume was shown to decrease with decreasing diameter, and single mode behavior was observed at the minimum diameter achieved. While weakly-guiding approximations are generally inaccurate for low modal volume optical fiber withmore » high core-cladding refractive index disparity, consistency between these approximations and experimental results was observed when the effective numerical aperture was measured and substituted for the theoretical numerical aperture in weakly-guiding approximation calculations. With the demonstration of very low modal volume in sapphire at fiber diameters much larger than anticipated by legacy calculations, the resolution of sapphire fiber distributed sensors may be increased and other sensing schemes requiring very low modal volume, such as fiber Bragg gratings, may be realized in extreme environment applications.« less

Single Mode Air-Clad Single Crystal Sapphire Optical Fiber

DOE PAGES

Hill, Cary; Homa, Dan; Yu, Zhihao; ...

2017-05-03

The observation of single mode propagation in an air-clad single crystal sapphire optical fiber at wavelengths at and above 783 nm is presented for the first time. A high-temperature wet acid etching method was used to reduce the diameter of a 10 cm length of commercially-sourced sapphire fiber from 125 micrometers to 6.5 micrometers, and far-field imaging provided modal information at intervals as the fiber diameter decreased. Modal volume was shown to decrease with decreasing diameter, and single mode behavior was observed at the minimum diameter achieved. While weakly-guiding approximations are generally inaccurate for low modal volume optical fiber withmore » high core-cladding refractive index disparity, consistency between these approximations and experimental results was observed when the effective numerical aperture was measured and substituted for the theoretical numerical aperture in weakly-guiding approximation calculations. With the demonstration of very low modal volume in sapphire at fiber diameters much larger than anticipated by legacy calculations, the resolution of sapphire fiber distributed sensors may be increased and other sensing schemes requiring very low modal volume, such as fiber Bragg gratings, may be realized in extreme environment applications.« less

REKRIATE: A Knowledge Representation System for Object Recognition and Scene Interpretation

NASA Astrophysics Data System (ADS)

Meystel, Alexander M.; Bhasin, Sanjay; Chen, X.

1990-02-01

What humans actually observe and how they comprehend this information is complex due to Gestalt processes and interaction of context in predicting the course of thinking and enforcing one idea while repressing another. How we extract the knowledge from the scene, what we get from the scene indeed and what we bring from our mechanisms of perception are areas separated by a thin, ill-defined line. The purpose of this paper is to present a system for Representing Knowledge and Recognizing and Interpreting Attention Trailed Entities dubbed as REKRIATE. It will be used as a tool for discovering the underlying principles involved in knowledge representation required for conceptual learning. REKRIATE has some inherited knowledge and is given a vocabulary which is used to form rules for identification of the object. It has various modalities of sensing and has the ability to measure the distance between the objects in the image as well as the similarity between different images of presumably the same object. All sensations received from matrix of different sensors put into an adequate form. The methodology proposed is applicable to not only the pictorial or visual world representation, but to any sensing modality. It is based upon the two premises: a) inseparability of all domains of the world representation including linguistic, as well as those formed by various sensor modalities. and b) representativity of the object at several levels of resolution simultaneously.

Unitary vs Multiple Semantics: PET Studies of Word and Picture Processing

ERIC Educational Resources Information Center

Bright, P.; Moss, H.; Tyler, L. K.

2004-01-01

In this paper we examine a central issue in cognitive neuroscience: are there separate conceptual representations associated with different input modalities (e.g., Paivio, 1971, 1986; Warrington & Shallice, 1984) or do inputs from different modalities converge on to the same set of representations (e.g., Caramazza, Hillis, Rapp, & Romani, 1990;…

Cargo identification algorithms facilitating unmanned/unattended inspection at high throughput portals

NASA Astrophysics Data System (ADS)

Chalmers, Alex

2007-10-01

A simple model is presented of a possible inspection regimen applied to each leg of a cargo containers' journey between its point of origin and destination. Several candidate modalities are proposed to be used at multiple remote locations to act as a pre-screen inspection as the target approaches a perimeter and as the primary inspection modality at the portal. Information from multiple data sets are fused to optimize the costs and performance of a network of such inspection systems. A series of image processing algorithms are presented that automatically process X-ray images of containerized cargo. The goal of this processing is to locate the container in a real time stream of traffic traversing a portal without impeding the flow of commerce. Such processing may facilitate the inclusion of unmanned/unattended inspection systems in such a network. Several samples of the processing applied to data collected from deployed systems are included. Simulated data from a notional cargo inspection system with multiple sensor modalities and advanced data fusion algorithms are also included to show the potential increased detection and throughput performance of such a configuration.

Modeling the Development of Audiovisual Cue Integration in Speech Perception

PubMed Central

Getz, Laura M.; Nordeen, Elke R.; Vrabic, Sarah C.; Toscano, Joseph C.

2017-01-01

Adult speech perception is generally enhanced when information is provided from multiple modalities. In contrast, infants do not appear to benefit from combining auditory and visual speech information early in development. This is true despite the fact that both modalities are important to speech comprehension even at early stages of language acquisition. How then do listeners learn how to process auditory and visual information as part of a unified signal? In the auditory domain, statistical learning processes provide an excellent mechanism for acquiring phonological categories. Is this also true for the more complex problem of acquiring audiovisual correspondences, which require the learner to integrate information from multiple modalities? In this paper, we present simulations using Gaussian mixture models (GMMs) that learn cue weights and combine cues on the basis of their distributional statistics. First, we simulate the developmental process of acquiring phonological categories from auditory and visual cues, asking whether simple statistical learning approaches are sufficient for learning multi-modal representations. Second, we use this time course information to explain audiovisual speech perception in adult perceivers, including cases where auditory and visual input are mismatched. Overall, we find that domain-general statistical learning techniques allow us to model the developmental trajectory of audiovisual cue integration in speech, and in turn, allow us to better understand the mechanisms that give rise to unified percepts based on multiple cues. PMID:28335558

Modeling the Development of Audiovisual Cue Integration in Speech Perception.

PubMed

Getz, Laura M; Nordeen, Elke R; Vrabic, Sarah C; Toscano, Joseph C

2017-03-21

Adult speech perception is generally enhanced when information is provided from multiple modalities. In contrast, infants do not appear to benefit from combining auditory and visual speech information early in development. This is true despite the fact that both modalities are important to speech comprehension even at early stages of language acquisition. How then do listeners learn how to process auditory and visual information as part of a unified signal? In the auditory domain, statistical learning processes provide an excellent mechanism for acquiring phonological categories. Is this also true for the more complex problem of acquiring audiovisual correspondences, which require the learner to integrate information from multiple modalities? In this paper, we present simulations using Gaussian mixture models (GMMs) that learn cue weights and combine cues on the basis of their distributional statistics. First, we simulate the developmental process of acquiring phonological categories from auditory and visual cues, asking whether simple statistical learning approaches are sufficient for learning multi-modal representations. Second, we use this time course information to explain audiovisual speech perception in adult perceivers, including cases where auditory and visual input are mismatched. Overall, we find that domain-general statistical learning techniques allow us to model the developmental trajectory of audiovisual cue integration in speech, and in turn, allow us to better understand the mechanisms that give rise to unified percepts based on multiple cues.

Multiset singular value decomposition for joint analysis of multi-modal data: application to fingerprint analysis

NASA Astrophysics Data System (ADS)

Emge, Darren K.; Adalı, Tülay

2014-06-01

As the availability and use of imaging methodologies continues to increase, there is a fundamental need to jointly analyze data that is collected from multiple modalities. This analysis is further complicated when, the size or resolution of the images differ, implying that the observation lengths of each of modality can be highly varying. To address this expanding landscape, we introduce the multiset singular value decomposition (MSVD), which can perform a joint analysis on any number of modalities regardless of their individual observation lengths. Through simulations, the inter modal relationships across the different modalities which are revealed by the MSVD are shown. We apply the MSVD to forensic fingerprint analysis, showing that MSVD joint analysis successfully identifies relevant similarities for further analysis, significantly reducing the processing time required. This reduction, takes this technique from a laboratory method to a useful forensic tool with applications across the law enforcement and security regimes.

Bayesian networks and information theory for audio-visual perception modeling.

PubMed

Besson, Patricia; Richiardi, Jonas; Bourdin, Christophe; Bringoux, Lionel; Mestre, Daniel R; Vercher, Jean-Louis

2010-09-01

Thanks to their different senses, human observers acquire multiple information coming from their environment. Complex cross-modal interactions occur during this perceptual process. This article proposes a framework to analyze and model these interactions through a rigorous and systematic data-driven process. This requires considering the general relationships between the physical events or factors involved in the process, not only in quantitative terms, but also in term of the influence of one factor on another. We use tools from information theory and probabilistic reasoning to derive relationships between the random variables of interest, where the central notion is that of conditional independence. Using mutual information analysis to guide the model elicitation process, a probabilistic causal model encoded as a Bayesian network is obtained. We exemplify the method by using data collected in an audio-visual localization task for human subjects, and we show that it yields a well-motivated model with good predictive ability. The model elicitation process offers new prospects for the investigation of the cognitive mechanisms of multisensory perception.

Specific roles for DEG/ENaC and TRP channels in touch and thermosensation in C. elegans nociceptors

PubMed Central

Chatzigeorgiou, Marios; Yoo, Sungjae; Watson, Joseph D.; Lee, Wei-Hsiang; Spencer, W. Clay; Kindt, Katie S.; Hwang, Sun Wook; Miller, David M.; Treinin, Millet; Driscoll, Monica; Schafer, William R.

2010-01-01

Summary Polymodal nociceptors detect noxious stimuli including harsh touch, toxic chemicals, and extremes of heat and cold. The molecular mechanisms by which nociceptors are able to sense multiple qualitatively distinct stimuli are not well-understood. We show here that the C. elegans PVD neurons are mulitidendritic nociceptors that respond to harsh touch as well as cold temperatures. The harsh touch modality specifically requires the DEG/ENaC proteins MEC-10 and DEGT-1, which represent putative components of a harsh touch mechanotransduction complex. By contrast, responses to cold require the TRPA-1 channel and are MEC-10- and DEGT-1-independent. Heterologous expression of C. elegans TRPA-1 can confer cold responsiveness to other C. elegans neurons or to mammalian cells, indicating that TRPA-1 is itself a cold sensor. These results show that C. elegans nociceptors respond to thermal and mechanical stimuli using distinct sets of molecules, and identify DEG/ENaC channels as potential receptors for mechanical pain. PMID:20512132

A double responsive smart upconversion fluorescence sensing material for glycoprotein.

PubMed

Guo, Ting; Deng, Qiliang; Fang, Guozhen; Yun, Yaguang; Hu, Yongjin; Wang, Shuo

2016-11-15

A novel strategy was developed to prepare double responsive smart upconversion fluorescence material for highly specific enrichment and sensing of glycoprotein. The novel double responsive smart sensing material was synthesized by choosing Horse radish peroxidase (HRP) as modal protein, the grapheme oxide (GO) as support material, upconversion nanoparticles (UCNPs) as fluorescence signal reporter, N-isopropyl acrylamide (NIPAAM) and 4-vinylphenylboronic acid (VPBA) as functional monomers. The structure and component of smart sensing material was investigated by transmission electron microscopy (TEM), Scanning electron microscopy (SEM), X-ray photoelectron spectroscopic (XPS) and Fourier transform infrared (FTIR), respectively. These results illustrated the smart sensing material was prepared successfully. The recognition characterizations of smart sensing material were evaluated, and results showed that the fluorescence intensity of smart sensing material was reduced gradually, as the concentration of protein increased, and the smart sensing material showed selective recognition for HRP among other proteins. Furthermore, the recognition ability of the smart sensing material for glycoprotein was regulated by controlling the pH value and temperature. Therefore, this strategy opens up new way to construct smart material for detection of glycoprotein. Copyright © 2016 Elsevier B.V. All rights reserved.

Sensing the Sentence: An Embodied Simulation Approach to Rhetorical Grammar

ERIC Educational Resources Information Center

Rule, Hannah J.

2017-01-01

This article applies the neuroscientific concept of embodied simulation--the process of understanding language through visual, motor, and spatial modalities of the body--to rhetorical grammar and sentence-style pedagogies. Embodied simulation invigorates rhetorical grammar instruction by attuning writers to the felt effects of written language,…

Theorising Creative Expression in Children's Participation

ERIC Educational Resources Information Center

Henderson, Patricia C.

2011-01-01

The paper suggests that phenomenology, the anthropology of the senses and of embodiment, performance theory and multi-modal pedagogies offer a rich set of theoretical ideas with which to consider children's expressive repertoires as overlooked forms of social participation and critique. Four case studies in relation to children's photography,…

Estimating the future agriculture freight transportation network needs due to climate change using remote sensing and regional climate models.

DOT National Transportation Integrated Search

2016-12-01

A reoccurring challenge with increasing fuel prices is optimization of multi- and inter-modal freight transport to move products most efficiently. Projections for the future of agriculture in the United States (U.S.) combined with regional climate mo...

Reflections on Deaf Education: Perspectives of Deaf Senior Citizens

ERIC Educational Resources Information Center

Roberson, Len; Shaw, Sherry

2015-01-01

Parents with deaf children face many challenges in making educational choices, developing language and a sense of belonging. Other key aspects of life including concept development and social competency are also critical decision points faced by parents. Developing language, whether it is through spoken or signed modalities, is of utmost…

Alchemy and the Teacher

ERIC Educational Resources Information Center

Mayes, Clifford

2003-01-01

In order for teachers to reflect deeply upon themselves, they need powerful models and images to guide their introspection. In teacher reflectivity, as in the therapeutic processes, psychic energy must ultimately be "contained" by models and modalities that enable one to make sense out of one's inner and outer experiences. This enables those…

Professional efficiencies for diagnostic imaging services rendered by different physicians: analysis of recent medicare multiple procedure payment reduction policy.

PubMed

Duszak, Richard; Silva, Ezequiel; Kim, Angela J; Barr, Robert M; Donovan, William D; Kassing, Pamela; McGinty, Geraldine; Allen, Bibb

2013-09-01

The aim of this study was to quantify potential physician work efficiencies and appropriate multiple procedure payment reductions for different same-session diagnostic imaging studies interpreted by different physicians in the same group practice. Medicare Resource-Based Relative Value Scale data were analyzed to determine the relative contributions of various preservice, intraservice, and postservice physician diagnostic imaging work activities. An expert panel quantified potential duplications in professional work activities when separate examinations were performed during the same session by different physicians within the same group practice. Maximum potential work duplications for various imaging modalities were calculated and compared with those used as the basis of CMS payment policy. No potential intraservice work duplication was identified when different examination interpretations were rendered by different physicians in the same group practice. When multiple interpretations within the same modality were rendered by different physicians, maximum potential duplicated preservice and postservice activities ranged from 5% (radiography, fluoroscopy, and nuclear medicine) to 13.6% (CT). Maximum mean potential duplicated work relative value units ranged from 0.0049 (radiography and fluoroscopy) to 0.0413 (CT). This equates to overall potential total work reductions ranging from 1.39% (nuclear medicine) to 2.73% (CT). Across all modalities, this corresponds to maximum Medicare professional component physician fee reductions of 1.23 ± 0.38% (range, 0.95%-1.87%) for services within the same modality, much less than an order of magnitude smaller than those implemented by CMS. For services from different modalities, potential duplications were too small to quantify. Although potential efficiencies exist in physician preservice and postservice work when same-session, same-modality imaging services are rendered by different physicians in the same group practice, these are relatively minuscule and have been grossly overestimated by current CMS payment policy. Greater transparency and methodologic rigor in government payment policy development are warranted. Copyright © 2013 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Linear Subspace Ranking Hashing for Cross-Modal Retrieval.

PubMed

Li, Kai; Qi, Guo-Jun; Ye, Jun; Hua, Kien A

2017-09-01

Hashing has attracted a great deal of research in recent years due to its effectiveness for the retrieval and indexing of large-scale high-dimensional multimedia data. In this paper, we propose a novel ranking-based hashing framework that maps data from different modalities into a common Hamming space where the cross-modal similarity can be measured using Hamming distance. Unlike existing cross-modal hashing algorithms where the learned hash functions are binary space partitioning functions, such as the sign and threshold function, the proposed hashing scheme takes advantage of a new class of hash functions closely related to rank correlation measures which are known to be scale-invariant, numerically stable, and highly nonlinear. Specifically, we jointly learn two groups of linear subspaces, one for each modality, so that features' ranking orders in different linear subspaces maximally preserve the cross-modal similarities. We show that the ranking-based hash function has a natural probabilistic approximation which transforms the original highly discontinuous optimization problem into one that can be efficiently solved using simple gradient descent algorithms. The proposed hashing framework is also flexible in the sense that the optimization procedures are not tied up to any specific form of loss function, which is typical for existing cross-modal hashing methods, but rather we can flexibly accommodate different loss functions with minimal changes to the learning steps. We demonstrate through extensive experiments on four widely-used real-world multimodal datasets that the proposed cross-modal hashing method can achieve competitive performance against several state-of-the-arts with only moderate training and testing time.

Characterizing novice-expert differences in macrocognition: an exploratory study of cognitive work in the emergency department.

PubMed

Schubert, Christiane C; Denmark, T Kent; Crandall, Beth; Grome, Anna; Pappas, James

2013-01-01

The objectives of this study are to elicit and document descriptions of emergency physician expertise, to characterize cognitive differences between novice and expert physicians, and to identify areas in which novices' skill and knowledge gaps are most pronounced. The nature of the differences between novices and experts needs to be explored to develop effective instructional modalities that accelerate the learning curve of inexperienced physicians who work in high-complexity environments. We interviewed novice emergency physicians (first-year residents) and attending physicians with significant expertise, working in an academic Level I trauma center in Southern California. With cognitive task analysis, we used task diagrams to capture nonroutine critical incidents that required the use of complex cognitive skills. Timelines were constructed to develop a detailed understanding of challenging incidents and the decisions involved as the incident unfolded, followed by progressive deepening to tease out situation-specific cues, knowledge, and information that experts and novices used. A thematic analysis of the interview transcripts was conducted to identify key categories. Using classification techniques for data reduction, we identified a smaller set of key themes, which composed the core findings of the study. Five interns and 6 attending physicians participated in the interviews. Novice physicians reported having difficulties representing the patient's story to attending physicians and other health care providers. Overrelying on objective data, novice physicians use linear thinking to move to diagnosis quickly and are likely to discount and explain away data that do not "fit" the frame. Experienced physicians draw on expertise to recognize cues and patterns while leaving room for altering or even changing their initial diagnosis. Whereas experts maintain high levels of spatial, temporal, and organizational systems awareness when overseeing treatment modalities of multiple patients, novices have difficulty seeing and maintaining the "big picture." Novice physicians use sense-making styles that differ from those of experts. Training novices to respond to the high cognitive demand of complex environments early in their careers requires instructional modalities that not only increase their knowledge base but also accelerate the integration of knowledge and practice. Simulation and custom-designed avatar-mediated virtual worlds are a promising new technology that may facilitate such training. Future research should expand on the results of this study through the use of larger sample sizes and interviews conducted at multiple sites to increase generalizability. Copyright © 2012. Published by Mosby, Inc.

The neural basis of visual dominance in the context of audio-visual object processing.

PubMed

Schmid, Carmen; Büchel, Christian; Rose, Michael

2011-03-01

Visual dominance refers to the observation that in bimodal environments vision often has an advantage over other senses in human. Therefore, a better memory performance for visual compared to, e.g., auditory material is assumed. However, the reason for this preferential processing and the relation to the memory formation is largely unknown. In this fMRI experiment, we manipulated cross-modal competition and attention, two factors that both modulate bimodal stimulus processing and can affect memory formation. Pictures and sounds of objects were presented simultaneously in two levels of recognisability, thus manipulating the amount of cross-modal competition. Attention was manipulated via task instruction and directed either to the visual or the auditory modality. The factorial design allowed a direct comparison of the effects between both modalities. The resulting memory performance showed that visual dominance was limited to a distinct task setting. Visual was superior to auditory object memory only when allocating attention towards the competing modality. During encoding, cross-modal competition and attention towards the opponent domain reduced fMRI signals in both neural systems, but cross-modal competition was more pronounced in the auditory system and only in auditory cortex this competition was further modulated by attention. Furthermore, neural activity reduction in auditory cortex during encoding was closely related to the behavioural auditory memory impairment. These results indicate that visual dominance emerges from a less pronounced vulnerability of the visual system against competition from the auditory domain. Copyright © 2010 Elsevier Inc. All rights reserved.

Primary or secondary tasks? Dual-task interference between cyclist hazard perception and cadence control using cross-modal sensory aids with rider assistance bike computers.

PubMed

Yang, Chao-Yang; Wu, Cheng-Tse

2017-03-01

This research investigated the risks involved in bicycle riding while using various sensory modalities to deliver training information. To understand the risks associated with using bike computers, this study evaluated hazard perception performance through lab-based simulations of authentic riding conditions. Analysing hazard sensitivity (d') of signal detection theory, the rider's response time, and eye glances provided insights into the risks of using bike computers. In this study, 30 participants were tested with eight hazard perception tasks while they maintained a cadence of 60 ± 5 RPM and used bike computers with different sensory displays, namely visual, auditory, and tactile feedback signals. The results indicated that synchronously using different sense organs to receive cadence feedback significantly affects hazard perception performance; direct visual information leads to the worst rider distraction, with a mean sensitivity to hazards (d') of -1.03. For systems with multiple interacting sensory aids, auditory aids were found to result in the greatest reduction in sensitivity to hazards (d' mean = -0.57), whereas tactile sensory aids reduced the degree of rider distraction (d' mean = -0.23). Our work complements existing work in this domain by advancing the understanding of how to design devices that deliver information subtly, thereby preventing disruption of a rider's perception of road hazards. Copyright © 2016 Elsevier Ltd. All rights reserved.

SU-E-P-10: Imaging in the Cardiac Catheterization Lab - Technologies and Clinical Applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fetterly, K

2014-06-01

Purpose: Diagnosis and treatment of cardiovascular disease in the cardiac catheterization laboratory is often aided by a multitude of imaging technologies. The purpose of this work is to highlight the contributions to patient care offered by the various imaging systems used during cardiovascular interventional procedures. Methods: Imaging technologies used in the cardiac catheterization lab were characterized by their fundamental technology and by the clinical applications for which they are used. Whether the modality is external to the patient, intravascular, or intracavity was specified. Specific clinical procedures for which multiple modalities are routinely used will be highlighted. Results: X-ray imaging modalitiesmore » include fluoroscopy/angiography and angiography CT. Ultrasound imaging is performed with external, trans-esophageal echocardiography (TEE), and intravascular (IVUS) transducers. Intravascular infrared optical coherence tomography (IVOCT) is used to assess vessel endothelium. Relatively large (>0.5 mm) anatomical structures are imaged with x-ray and ultrasound. IVUS and IVOCT provide high resolution images of vessel walls. Cardiac CT and MRI images are used to plan complex cardiovascular interventions. Advanced applications are used to spatially and temporally merge images from different technologies. Diagnosis and treatment of coronary artery disease frequently utilizes angiography and intra-vascular imaging, and treatment of complex structural heart conditions routinely includes use of multiple imaging modalities. Conclusion: There are several imaging modalities which are routinely used in the cardiac catheterization laboratory to diagnose and treat both coronary artery and structural heart disease. Multiple modalities are frequently used to enhance the quality and safety of procedures. The cardiac catheterization laboratory includes many opportunities for medical physicists to contribute substantially toward advancing patient care.« less

Evaluation of Fear Using Nonintrusive Measurement of Multimodal Sensors

PubMed Central

Choi, Jong-Suk; Bang, Jae Won; Heo, Hwan; Park, Kang Ryoung

2015-01-01

Most previous research into emotion recognition used either a single modality or multiple modalities of physiological signal. However, the former method allows for limited enhancement of accuracy, and the latter has the disadvantages that its performance can be affected by head or body movements. Further, the latter causes inconvenience to the user due to the sensors attached to the body. Among various emotions, the accurate evaluation of fear is crucial in many applications, such as criminal psychology, intelligent surveillance systems and the objective evaluation of horror movies. Therefore, we propose a new method for evaluating fear based on nonintrusive measurements obtained using multiple sensors. Experimental results based on the t-test, the effect size and the sum of all of the correlation values with other modalities showed that facial temperature and subjective evaluation are more reliable than electroencephalogram (EEG) and eye blinking rate for the evaluation of fear. PMID:26205268

Modal Mineralogy of Lunar Soils

NASA Astrophysics Data System (ADS)

Taylor, J.; Martel, L.; Lucey, P. G.; Crites, S. T.; Blake, D. F.

2012-12-01

Modal mineralogy of the lunar regolith is fundamentally important. It varies with the composition of underlying bedrock, extent of addition of materials excavated by impact both local and distant, and small-scale reworking by micrometeorite bombardment, so it contains information about local geological history. Determining modal mineralogy of soils provides vital ground truth to remote sensing studies. Mineralogy can be determined by a variety of techniques that provide complementary information: X-Ray Diffraction (XRD), optical point counting, element mapping by scanning electron microscopy (SEM) or electron microprobe (EMP), and normative calculation from a bulk chemical analysis. SEM and EMP element mapping can be converted into mineral modal abundances in a variety of ways, including defining compositional windows for specific minerals and using image processing techniques. XRD provides direct determination of the phases present, but gives little information about the chemical composition of those phases. We have launched a project to determine the modal mineralogy of over 100 lunar soils from all Apollo sites. The goal is to use this quantitative mineralogy and laboratory and remote reflectance spectra of the same soils to improve our ability to extract quantitative mineralogy from remote sensing data. Samples (< 1mm bulk soils) were dry-sieved and the <150 micron fractions analyzed in a Terra XRD instrument (InXitu, Inc.) using sample sizes of ~35 mg. We reduced the data using Reitveld refinement as implemented by the Jade program (Materials Data, Inc.). Glass abundances were determined by choosing a linear background and fitting a broad Gaussian to the scattering hump above background. Quantitative XRD is well established, but usually requires some calibration, in spite of the sophisticated Reitveld refinement and whole-pattern fitting. We calibrated the instrument by using mixtures of terrestrial minerals and results from the Lunar Sample Characterization Consortium (data available at web.utk.edu/~pgi/data.html). Without calibration our results differ (though by < 10 % relative) from those of the LSCC. Discrepancies may stem from the uncertainties in assigning a pixel to a specific mineral in the SEM point counting approach, not completely randomized orientations of the mineral grains during analysis by Terra, or shock effects in minerals not being taken into account by the Reitveld method. Data for 30 soils from the Apollo 16 site show that on a glass-free basis plagioclase ranges from 78 to 94 wt%, with the sites on the Descartes Mountains (Stations 4, 11, and 13) tending to contain more plagioclase, consistent with previous conclusions that the Descartes highlands are more feldspathic than the Cayley Plains. The relative abundance among mafic silicates varies throughout the site, although the small abundance of the mafic components leads to uncertainty in the Reitveld analysis. Particularly interesting for using the combination of remote sensing and sample measurements is the observation that modal plagioclase is systematically greater than normative plagioclase (normative/modal plagioclase is 0.83 to 0.95). A difference between modes and norms is not unusual, but this substantial difference indicates that the glass in the Apollo 16 regolith is more mafic than the crystalline material, consistent with the average composition of impact glass in Apollo 16 samples compared to bulk soils.

Response analysis of holography-based modal wavefront sensor.

PubMed

Dong, Shihao; Haist, Tobias; Osten, Wolfgang; Ruppel, Thomas; Sawodny, Oliver

2012-03-20

The crosstalk problem of holography-based modal wavefront sensing (HMWS) becomes more severe with increasing aberration. In this paper, crosstalk effects on the sensor response are analyzed statistically for typical aberrations due to atmospheric turbulence. For specific turbulence strength, we optimized the sensor by adjusting the detector radius and the encoded phase bias for each Zernike mode. Calibrated response curves of low-order Zernike modes were further utilized to improve the sensor accuracy. The simulation results validated our strategy. The number of iterations for obtaining a residual RMS wavefront error of 0.1λ is reduced from 18 to 3. © 2012 Optical Society of America

Music to My Eyes: Cross-Modal Interactions in the Perception of Emotions in Musical Performance

ERIC Educational Resources Information Center

Vines, Bradley W.; Krumhansl, Carol L.; Wanderley, Marcelo M.; Dalca, Ioana M.; Levitin, Daniel J.

2011-01-01

We investigate non-verbal communication through expressive body movement and musical sound, to reveal higher cognitive processes involved in the integration of emotion from multiple sensory modalities. Participants heard, saw, or both heard and saw recordings of a Stravinsky solo clarinet piece, performed with three distinct expressive styles:…

Two Modalities of the Contextualized Courseware in Three Modalities of Classroom Use

ERIC Educational Resources Information Center

Akpinar, Yavuz; Sengül, Özlem

2018-01-01

This study investigated the effect of various combinations of contextualization and teacher support on achievement and critical thinking. Two specially-designed sets of courseware were used to teach a unit on logic, one based on a single context and one based on multiple contexts. The participants were 151 9th graders in two vocational high…

Interoception: the forgotten modality in perceptual grounding of abstract and concrete concepts.

PubMed

Connell, Louise; Lynott, Dermot; Banks, Briony

2018-08-05

Conceptual representations are perceptually grounded, but when investigating which perceptual modalities are involved, researchers have typically restricted their consideration to vision, touch, hearing, taste and smell. However, there is another major modality of perceptual information that is distinct from these traditional five senses; that is, interoception, or sensations inside the body. In this paper, we use megastudy data (modality-specific ratings of perceptual strength for over 32 000 words) to explore how interoceptive information contributes to the perceptual grounding of abstract and concrete concepts. We report how interoceptive strength captures a distinct form of perceptual experience across the abstract-concrete spectrum, but is markedly more important to abstract concepts (e.g. hungry , serenity ) than to concrete concepts (e.g. capacity , rainy ). In particular, interoception dominates emotion concepts, especially negative emotions relating to fear and sadness , moreso than other concepts of equivalent abstractness and valence. Finally, we examine whether interoceptive strength represents valuable information in conceptual content by investigating its role in concreteness effects in word recognition, and find that it enhances semantic facilitation over and above the traditional five sensory modalities. Overall, these findings suggest that interoception has comparable status to other modalities in contributing to the perceptual grounding of abstract and concrete concepts.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'. © 2018 The Author(s).

Label-aligned Multi-task Feature Learning for Multimodal Classification of Alzheimer’s Disease and Mild Cognitive Impairment

PubMed Central

Zu, Chen; Jie, Biao; Liu, Mingxia; Chen, Songcan

2015-01-01

Multimodal classification methods using different modalities of imaging and non-imaging data have recently shown great advantages over traditional single-modality-based ones for diagnosis and prognosis of Alzheimer’s disease (AD), as well as its prodromal stage, i.e., mild cognitive impairment (MCI). However, to the best of our knowledge, most existing methods focus on mining the relationship across multiple modalities of the same subjects, while ignoring the potentially useful relationship across different subjects. Accordingly, in this paper, we propose a novel learning method for multimodal classification of AD/MCI, by fully exploring the relationships across both modalities and subjects. Specifically, our proposed method includes two subsequent components, i.e., label-aligned multi-task feature selection and multimodal classification. In the first step, the feature selection learning from multiple modalities are treated as different learning tasks and a group sparsity regularizer is imposed to jointly select a subset of relevant features. Furthermore, to utilize the discriminative information among labeled subjects, a new label-aligned regularization term is added into the objective function of standard multi-task feature selection, where label-alignment means that all multi-modality subjects with the same class labels should be closer in the new feature-reduced space. In the second step, a multi-kernel support vector machine (SVM) is adopted to fuse the selected features from multi-modality data for final classification. To validate our method, we perform experiments on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database using baseline MRI and FDG-PET imaging data. The experimental results demonstrate that our proposed method achieves better classification performance compared with several state-of-the-art methods for multimodal classification of AD/MCI. PMID:26572145

Three-way parallel independent component analysis for imaging genetics using multi-objective optimization.

PubMed

Ulloa, Alvaro; Jingyu Liu; Vergara, Victor; Jiayu Chen; Calhoun, Vince; Pattichis, Marios

2014-01-01

In the biomedical field, current technology allows for the collection of multiple data modalities from the same subject. In consequence, there is an increasing interest for methods to analyze multi-modal data sets. Methods based on independent component analysis have proven to be effective in jointly analyzing multiple modalities, including brain imaging and genetic data. This paper describes a new algorithm, three-way parallel independent component analysis (3pICA), for jointly identifying genomic loci associated with brain function and structure. The proposed algorithm relies on the use of multi-objective optimization methods to identify correlations among the modalities and maximally independent sources within modality. We test the robustness of the proposed approach by varying the effect size, cross-modality correlation, noise level, and dimensionality of the data. Simulation results suggest that 3p-ICA is robust to data with SNR levels from 0 to 10 dB and effect-sizes from 0 to 3, while presenting its best performance with high cross-modality correlations, and more than one subject per 1,000 variables. In an experimental study with 112 human subjects, the method identified links between a genetic component (pointing to brain function and mental disorder associated genes, including PPP3CC, KCNQ5, and CYP7B1), a functional component related to signal decreases in the default mode network during the task, and a brain structure component indicating increases of gray matter in brain regions of the default mode region. Although such findings need further replication, the simulation and in-vivo results validate the three-way parallel ICA algorithm presented here as a useful tool in biomedical data decomposition applications.

Multimodal Imaging of the Normal Eye.

PubMed

Kawali, Ankush; Pichi, Francesco; Avadhani, Kavitha; Invernizzi, Alessandro; Hashimoto, Yuki; Mahendradas, Padmamalini

2017-10-01

Multimodal imaging is the concept of "bundling" images obtained from various imaging modalities, viz., fundus photograph, fundus autofluorescence imaging, infrared (IR) imaging, simultaneous fluorescein and indocyanine angiography, optical coherence tomography (OCT), and, more recently, OCT angiography. Each modality has its pros and cons as well as its limitations. Combination of multiple imaging techniques will overcome their individual weaknesses and give a comprehensive picture. Such approach helps in accurate localization of a lesion and understanding the pathology in posterior segment. It is important to know imaging of normal eye before one starts evaluating pathology. This article describes multimodal imaging modalities in detail and discusses healthy eye features as seen on various imaging modalities mentioned above.

Highly sensitive force sensor based on balloon-like interferometer

NASA Astrophysics Data System (ADS)

Wu, Yue; Xiao, Shiying; Xu, Yao; Shen, Ya; Jiang, Youchao; Jin, Wenxing; Yang, Yuguang; Jian, Shuisheng

2018-07-01

An all-fiber highly sensitive force sensor based on modal interferometer has been presented and demonstrated. The single-mode fiber (SMF) with coating stripped is designed into a balloon-like shape to form a modal interferometer. Due to the bent SMF, the interference occurs between the core mode and cladding modes. With variation of the force applied to the balloon-like interferometer, the bending diameter changes, which caused the wavelength shift of the modal interference. Thus the measurement of the force variation can be achieved by monitoring the wavelength shift. The performances of the interferometer with different bending diameter are experimentally investigated, and the maximum force sensitivity of 24.9 pm/ μ N can be achieved with the bending diameter 14 mm ranging from 0 μ N to 1464.12 μ N. Furthermore, the proposed fiber sensor exhibits the advantages of easy fabrication and low cost, making it a suitable candidate in the optical fiber sensing field.

Transverse stress induced LP 02-LP 21 modal interference of stimulated Raman scattered light in a few-mode optical fiber

NASA Astrophysics Data System (ADS)

Sharma, A.; Posey, R.

1996-02-01

Four-photon mixing followed by stimulated Raman scattering is observed in LP 02 mode in a 7.9 μm core diameter optical fiber. A localized transverse stress efficiency couples LP 02 to the LP 21 mode with a macroscopic beat length of 1.8 mm. LP 02-LP 21 modal interference is investigated by detecting the 550-590 nm SRS through a pinhole in the far field exit plane. Quantitative explanation of wavelength dependent intensity modulation results in a precise experimental determination of {∂[β 02(λ) - β 21(λ)] }/{∂λ}, for mode-propagation constants β02( λ) and β21( λ) of LP 02 and LP 21 modes respectively, as well as Δ, the relative core-cladding refractive index difference. The LP 02-LP 21 modal interference is used for sensing of temperature between 50-300°C.

Estimating free-body modal parameters from tests of a constrained structure

NASA Technical Reports Server (NTRS)

Cooley, Victor M.

1993-01-01

Hardware advances in suspension technology for ground tests of large space structures provide near on-orbit boundary conditions for modal testing. Further advances in determining free-body modal properties of constrained large space structures have been made, on the analysis side, by using time domain parameter estimation and perturbing the stiffness of the constraints over multiple sub-tests. In this manner, passive suspension constraint forces, which are fully correlated and therefore not usable for spectral averaging techniques, are made effectively uncorrelated. The technique is demonstrated with simulated test data.

Characterising a holographic modal phase mask for the detection of ocular aberrations

NASA Astrophysics Data System (ADS)

Corbett, A. D.; Leyva, D. Gil; Diaz-Santana, L.; Wilkinson, T. D.; Zhong, J. J.

2005-12-01

The accurate measurement of the double-pass ocular wave front has been shown to have a broad range of applications from LASIK surgery to adaptively corrected retinal imaging. The ocular wave front can be accurately described by a small number of Zernike circle polynomials. The modal wave front sensor was first proposed by Neil et al. and allows the coefficients of the individual Zernike modes to be measured directly. Typically the aberrations measured with the modal sensor are smaller than those seen in the ocular wave front. In this work, we investigated a technique for adapting a modal phase mask for the sensing of the ocular wave front. This involved extending the dynamic range of the sensor by increasing the pinhole size to 2.4mm and optimising the mask bias to 0.75λ. This was found to decrease the RMS error by up to a factor of three for eye-like aberrations with amplitudes up to 0.2μm. For aberrations taken from a sample of real-eye measurements a 20% decrease in the RMS error was observed.

Multiple-modality exercise and mind-motor training to improve mobility in older adults: A randomized controlled trial.

PubMed

Boa Sorte Silva, Narlon C; Gill, Dawn P; Gregory, Michael A; Bocti, John; Petrella, Robert J

2018-03-01

To investigate the effects of multiple-modality exercise with or without additional mind-motor training on mobility outcomes in older adults with subjective cognitive complaints. This was a 24-week randomized controlled trial with a 28-week no-contact follow-up. Community-dwelling older adults underwent a thrice -weekly, Multiple-Modality exercise and Mind-Motor (M4) training or Multiple-Modality (M2) exercise with an active control intervention (balance, range of motion and breathing exercises). Study outcomes included differences between groups at 24weeks and after the no-contact follow-up (i.e., 52weeks) in usual and dual-task (DT, i.e., serial sevens [S7] and phonemic verbal fluency [VF] tasks) gait velocity, step length and cycle time variability, as well as DT cognitive accuracy. 127 participants (mean age 67.5 [7.3] years, 71% women) were randomized to either M2 (n=64) or M4 (n=63) groups. Participants were assessed at baseline, intervention endpoint (24weeks), and study endpoint (52weeks). At 24weeks, the M2 group demonstrated greater improvements in usual gait velocity, usual step length, and DT gait velocity (VF) compared to the M4 group, and no between- or within-group changes in DT accuracy were observed. At 52weeks, the M2 group retained the gains in gait velocity and step length, whereas the M4 group demonstrated trends for improvement (p=0.052) in DT cognitive accuracy (VF). Our results suggest that additional mind-motor training was not effective to improve mobility outcomes. In fact, participants in the active control group experienced greater benefits as a result of the intervention. Copyright © 2017 Elsevier Inc. All rights reserved.

Multi-modal data fusion using source separation: Two effective models based on ICA and IVA and their properties

PubMed Central

Adali, Tülay; Levin-Schwartz, Yuri; Calhoun, Vince D.

2015-01-01

Fusion of information from multiple sets of data in order to extract a set of features that are most useful and relevant for the given task is inherent to many problems we deal with today. Since, usually, very little is known about the actual interaction among the datasets, it is highly desirable to minimize the underlying assumptions. This has been the main reason for the growing importance of data-driven methods, and in particular of independent component analysis (ICA) as it provides useful decompositions with a simple generative model and using only the assumption of statistical independence. A recent extension of ICA, independent vector analysis (IVA) generalizes ICA to multiple datasets by exploiting the statistical dependence across the datasets, and hence, as we discuss in this paper, provides an attractive solution to fusion of data from multiple datasets along with ICA. In this paper, we focus on two multivariate solutions for multi-modal data fusion that let multiple modalities fully interact for the estimation of underlying features that jointly report on all modalities. One solution is the Joint ICA model that has found wide application in medical imaging, and the second one is the the Transposed IVA model introduced here as a generalization of an approach based on multi-set canonical correlation analysis. In the discussion, we emphasize the role of diversity in the decompositions achieved by these two models, present their properties and implementation details to enable the user make informed decisions on the selection of a model along with its associated parameters. Discussions are supported by simulation results to help highlight the main issues in the implementation of these methods. PMID:26525830

Predictive Modeling of Structural Sensing for Aerospace Applications

DTIC Science & Technology

2015-08-03

3rd European workshop on structural health monitoring, 5–7 July 2006, Granada , Spain. Castaings M, Le Clezio E and Hosten B (2002) Modal decom...monitoring. In: 3rd European workshop on structural health monitoring, 5–7 July 2006, Granada , Spain. Peng H, Meng G and Li F (2009) Modeling of wave propaga

Designing and testing the coronagraphic Modal Wavefront Sensor: a fast non-common path error sensor for high-contrast imaging

NASA Astrophysics Data System (ADS)

Wilby, M. J.; Keller, C. U.; Haffert, S.; Korkiakoski, V.; Snik, F.; Pietrow, A. G. M.

2016-07-01

Non-Common Path Errors (NCPEs) are the dominant factor limiting the performance of current astronomical high-contrast imaging instruments. If uncorrected, the resulting quasi-static speckle noise floor limits coronagraph performance to a raw contrast of typically 10-4, a value which does not improve with increasing integration time. The coronagraphic Modal Wavefront Sensor (cMWS) is a hybrid phase optic which uses holographic PSF copies to supply focal-plane wavefront sensing information directly from the science camera, whilst maintaining a bias-free coronagraphic PSF. This concept has already been successfully implemented on-sky at the William Herschel Telescope (WHT), La Palma, demonstrating both real-time wavefront sensing capability and successful extraction of slowly varying wavefront errors under a dominant and rapidly changing atmospheric speckle foreground. In this work we present an overview of the development of the cMWS and recent first light results obtained using the Leiden EXoplanet Instrument (LEXI), a high-contrast imager and high-dispersion spectrograph pathfinder instrument for the WHT.

An investigation into non-invasive physical activity recognition using smartphones.

PubMed

Kelly, Daniel; Caulfield, Brian

2012-01-01

Technology utilized to automatically monitor Activities of Daily Living (ADL) could be a key component in identifying deviations from normal functional profiles and providing feedback on interventions aimed at improving health. However, if activity recognition systems are to be implemented in real world scenarios such as health and wellness monitoring, the activity sensing modality must unobtrusively fit the human environment rather than forcing humans to adhere to sensor specific conditions. Modern smart phones represent a ubiquitous computing device which has already undergone mainstream adoption. In this paper, we investigate the feasibility of using a modern smartphone, with limited placement constraints, as the sensing modality for an activity recognition system. A dataset of 4 subjects performing 7 activities, using varying sensor placement conditions, is utilized to investigate this. Initial experiments show that a decision tree classifier performs activity classification with precision and recall scores of 0.75 and 0.73 respectively. More importantly, as part of this initial experiment, 3 main problems, and subsequently 3 solutions, relating to unconstrained sensor placement were identified. Using our proposed solutions, classification precision and recall scores were improved by +13% and +14.6% respectively.

Local Learning Strategies for Wake Identification

NASA Astrophysics Data System (ADS)

Colvert, Brendan; Alsalman, Mohamad; Kanso, Eva

2017-11-01

Swimming agents, biological and engineered alike, must navigate the underwater environment to survive. Tasks such as autonomous navigation, foraging, mating, and predation require the ability to extract critical cues from the hydrodynamic environment. A substantial body of evidence supports the hypothesis that biological systems leverage local sensing modalities, including flow sensing, to gain knowledge of their global surroundings. The nonlinear nature and high degree of complexity of fluid dynamics makes the development of algorithms for implementing localized sensing in bioinspired engineering systems essentially intractable for many systems of practical interest. In this work, we use techniques from machine learning for training a bioinspired swimmer to learn from its environment. We demonstrate the efficacy of this strategy by learning how to sense global characteristics of the wakes of other swimmers measured only from local sensory information. We conclude by commenting on the advantages and limitations of this data-driven, machine learning approach and its potential impact on broader applications in underwater sensing and navigation.

Extended FDD-WT method based on correcting the errors due to non-synchronous sensing of sensors

NASA Astrophysics Data System (ADS)

Tarinejad, Reza; Damadipour, Majid

2016-05-01

In this research, a combinational non-parametric method called frequency domain decomposition-wavelet transform (FDD-WT) that was recently presented by the authors, is extended for correction of the errors resulting from asynchronous sensing of sensors, in order to extend the application of the algorithm for different kinds of structures, especially for huge structures. Therefore, the analysis process is based on time-frequency domain decomposition and is performed with emphasis on correcting time delays between sensors. Time delay estimation (TDE) methods are investigated for their efficiency and accuracy for noisy environmental records and the Phase Transform - β (PHAT-β) technique was selected as an appropriate method to modify the operation of traditional FDD-WT in order to achieve the exact results. In this paper, a theoretical example (3DOF system) has been provided in order to indicate the non-synchronous sensing effects of the sensors on the modal parameters; moreover, the Pacoima dam subjected to 13 Jan 2001 earthquake excitation was selected as a case study. The modal parameters of the dam obtained from the extended FDD-WT method were compared with the output of the classical signal processing method, which is referred to as 4-Spectral method, as well as other literatures relating to the dynamic characteristics of Pacoima dam. The results comparison indicates that values are correct and reliable.

Convergent and invariant object representations for sight, sound, and touch.

PubMed

Man, Kingson; Damasio, Antonio; Meyer, Kaspar; Kaplan, Jonas T

2015-09-01

We continuously perceive objects in the world through multiple sensory channels. In this study, we investigated the convergence of information from different sensory streams within the cerebral cortex. We presented volunteers with three common objects via three different modalities-sight, sound, and touch-and used multivariate pattern analysis of functional magnetic resonance imaging data to map the cortical regions containing information about the identity of the objects. We could reliably predict which of the three stimuli a subject had seen, heard, or touched from the pattern of neural activity in the corresponding early sensory cortices. Intramodal classification was also successful in large portions of the cerebral cortex beyond the primary areas, with multiple regions showing convergence of information from two or all three modalities. Using crossmodal classification, we also searched for brain regions that would represent objects in a similar fashion across different modalities of presentation. We trained a classifier to distinguish objects presented in one modality and then tested it on the same objects presented in a different modality. We detected audiovisual invariance in the right temporo-occipital junction, audiotactile invariance in the left postcentral gyrus and parietal operculum, and visuotactile invariance in the right postcentral and supramarginal gyri. Our maps of multisensory convergence and crossmodal generalization reveal the underlying organization of the association cortices, and may be related to the neural basis for mental concepts. © 2015 Wiley Periodicals, Inc.

Multi-Modal Curriculum Learning for Semi-Supervised Image Classification.

PubMed

Gong, Chen; Tao, Dacheng; Maybank, Stephen J; Liu, Wei; Kang, Guoliang; Yang, Jie

2016-07-01

Semi-supervised image classification aims to classify a large quantity of unlabeled images by typically harnessing scarce labeled images. Existing semi-supervised methods often suffer from inadequate classification accuracy when encountering difficult yet critical images, such as outliers, because they treat all unlabeled images equally and conduct classifications in an imperfectly ordered sequence. In this paper, we employ the curriculum learning methodology by investigating the difficulty of classifying every unlabeled image. The reliability and the discriminability of these unlabeled images are particularly investigated for evaluating their difficulty. As a result, an optimized image sequence is generated during the iterative propagations, and the unlabeled images are logically classified from simple to difficult. Furthermore, since images are usually characterized by multiple visual feature descriptors, we associate each kind of features with a teacher, and design a multi-modal curriculum learning (MMCL) strategy to integrate the information from different feature modalities. In each propagation, each teacher analyzes the difficulties of the currently unlabeled images from its own modality viewpoint. A consensus is subsequently reached among all the teachers, determining the currently simplest images (i.e., a curriculum), which are to be reliably classified by the multi-modal learner. This well-organized propagation process leveraging multiple teachers and one learner enables our MMCL to outperform five state-of-the-art methods on eight popular image data sets.

Multibeam Interferometer Using a Photonic Crystal Fiber with Two Asymmetric Cores for Torsion, Strain and Temperature Sensing

PubMed Central

Naeem, Khurram; Kwon, Il-Bum; Chung, Youngjoo

2017-01-01

We present a fiber-optic multibeam Mach-Zehnder interferometer (m-MZI) for simultaneous multi-parameter measurement. The m-MZI is comprised of a section of photonic crystal fiber integrated with two independent cores of distinct construction and birefringence properties characterized for torsion, strain and temperature sensing. Due to the presence of small core geometry and use of a short fiber length, the sensing device demonstrates inter-modal interference in the small core alongside the dominant inter-core interference between the cores for each of the orthogonal polarizations. The output spectrum of the device is characterized by the three-beam interference model and is polarization-dependent. The two types of interferometers present in the fiber m-MZI exhibit distinct sensitivities to torsion, strain and temperature for different polarizations, and matrix coefficients allowing simultaneous measurement of the three sensing parameters are proposed in experiment. PMID:28085046

RTEMIS: Real-time Tumoroid and Environment Monitoring Using Impedance Spectroscopy and pH Sensing

NASA Astrophysics Data System (ADS)

Alexander, Frank A., Jr.

This research utilizes Electrical Impedance Spectroscopy, a technique classically used for electrochemical analysis and material characterization, as the basis for a non-destructive, label-free assay platform for three dimensional (3D) cellular spheroids. In this work, a linear array of microelectrodes is optimized to rapidly respond to changes located within a 3D multicellular model. In addition, this technique is coupled with an on chip micro-pH sensor for monitoring the environment around the cells. Finally, the responses of both impedance and pH are correlated with physical changes within the cellular model. The impedance analysis system realized through this work provides a foundation for the development of high-throughput drug screening systems that utilize multiple parallel sensing modalities including pH and impedance sensing in order to quickly assess the efficacy of specific drug candidates. The slow development of new drugs is mainly attributed to poor predictability of current chemosensitivity and resistivity assays, as well as genetic differences between the animal models used for tests and humans. In addition, monolayer cultures used in early experimentation are fundamentally different from the complex structure of organs in vivo. This requires the study of smaller 3D models (spheroids) that more efficiently replicate the conditions within the body. The main objective of this research was to develop a microfluidic system on a chip that is capable of deducing viability and morphology of 3D tumor spheroids by monitoring both the impedance of the cellular model and the pH of their local environment. This would provide a fast and reliable method for screening pharmaceutical compounds in a high-throughput system.

Common Sense in Choice: The Effect of Sensory Modality on Neural Value Representations.

PubMed

Shuster, Anastasia; Levy, Dino J

2018-01-01

Although it is well established that the ventromedial prefrontal cortex (vmPFC) represents value using a common currency across categories of rewards, it is unknown whether the vmPFC represents value irrespective of the sensory modality in which alternatives are presented. In the current study, male and female human subjects completed a decision-making task while their neural activity was recorded using functional magnetic resonance imaging. On each trial, subjects chose between a safe alternative and a lottery, which was presented visually or aurally. A univariate conjunction analysis revealed that the anterior portion of the vmPFC tracks subjective value (SV) irrespective of the sensory modality. Using a novel cross-modality multivariate classifier, we were able to decode auditory value based on visual trials and vice versa. In addition, we found that the visual and auditory sensory cortices, which were identified using functional localizers, are also sensitive to the value of stimuli, albeit in a modality-specific manner. Whereas both primary and higher-order auditory cortices represented auditory SV (aSV), only a higher-order visual area represented visual SV (vSV). These findings expand our understanding of the common currency network of the brain and shed a new light on the interplay between sensory and value information processing.

Common Sense in Choice: The Effect of Sensory Modality on Neural Value Representations

PubMed Central

2018-01-01

Abstract Although it is well established that the ventromedial prefrontal cortex (vmPFC) represents value using a common currency across categories of rewards, it is unknown whether the vmPFC represents value irrespective of the sensory modality in which alternatives are presented. In the current study, male and female human subjects completed a decision-making task while their neural activity was recorded using functional magnetic resonance imaging. On each trial, subjects chose between a safe alternative and a lottery, which was presented visually or aurally. A univariate conjunction analysis revealed that the anterior portion of the vmPFC tracks subjective value (SV) irrespective of the sensory modality. Using a novel cross-modality multivariate classifier, we were able to decode auditory value based on visual trials and vice versa. In addition, we found that the visual and auditory sensory cortices, which were identified using functional localizers, are also sensitive to the value of stimuli, albeit in a modality-specific manner. Whereas both primary and higher-order auditory cortices represented auditory SV (aSV), only a higher-order visual area represented visual SV (vSV). These findings expand our understanding of the common currency network of the brain and shed a new light on the interplay between sensory and value information processing. PMID:29619408

Shapes, scents and sounds: quantifying the full multi-sensory basis of conceptual knowledge.

PubMed

Hoffman, Paul; Lambon Ralph, Matthew A

2013-01-01

Contemporary neuroscience theories assume that concepts are formed through experience in multiple sensory-motor modalities. Quantifying the contribution of each modality to different object categories is critical to understanding the structure of the conceptual system and to explaining category-specific knowledge deficits. Verbal feature listing is typically used to elicit this information but has a number of drawbacks: sensory knowledge often cannot easily be translated into verbal features and many features are experienced in multiple modalities. Here, we employed a more direct approach in which subjects rated their knowledge of objects in each sensory-motor modality separately. Compared with these ratings, feature listing over-estimated the importance of visual form and functional knowledge and under-estimated the contributions of other sensory channels. An item's sensory rating proved to be a better predictor of lexical-semantic processing speed than the number of features it possessed, suggesting that ratings better capture the overall quantity of sensory information associated with a concept. Finally, the richer, multi-modal rating data not only replicated the sensory-functional distinction between animals and non-living things but also revealed novel distinctions between different types of artefact. Hierarchical cluster analyses indicated that mechanical devices (e.g., vehicles) were distinct from other non-living objects because they had strong sound and motion characteristics, making them more similar to animals in this respect. Taken together, the ratings align with neuroscience evidence in suggesting that a number of distinct sensory processing channels make important contributions to object knowledge. Multi-modal ratings for 160 objects are provided as supplementary materials. Copyright © 2012 Elsevier Ltd. All rights reserved.

Feature-based fusion of medical imaging data.

PubMed

Calhoun, Vince D; Adali, Tülay

2009-09-01

The acquisition of multiple brain imaging types for a given study is a very common practice. There have been a number of approaches proposed for combining or fusing multitask or multimodal information. These can be roughly divided into those that attempt to study convergence of multimodal imaging, for example, how function and structure are related in the same region of the brain, and those that attempt to study the complementary nature of modalities, for example, utilizing temporal EEG information and spatial functional magnetic resonance imaging information. Within each of these categories, one can attempt data integration (the use of one imaging modality to improve the results of another) or true data fusion (in which multiple modalities are utilized to inform one another). We review both approaches and present a recent computational approach that first preprocesses the data to compute features of interest. The features are then analyzed in a multivariate manner using independent component analysis. We describe the approach in detail and provide examples of how it has been used for different fusion tasks. We also propose a method for selecting which combination of modalities provides the greatest value in discriminating groups. Finally, we summarize and describe future research topics.

Nanoparticles for Imaging, Sensing, and Therapeutic Intervention

PubMed Central

2014-01-01

Nanoparticles have the potential to contribute to new modalities in molecular imaging and sensing as well as in therapeutic interventions. In this Nano Focus article, we identify some of the current challenges and knowledge gaps that need to be confronted to accelerate the developments of various applications. Using specific examples, we journey from the characterization of these complex hybrid nanomaterials; continue with surface design and (bio)physicochemical properties, their fate in biological media and cells, and their potential for cancer treatment; and finally reflect on the role of animal models to predict their behavior in humans. PMID:24641589

Advances in Spatial Data Infrastructure, Acquisition, Analysis, Archiving and Dissemination

NASA Technical Reports Server (NTRS)

Ramapriyan, Hampapuran K.; Rochon, Gilbert L.; Duerr, Ruth; Rank, Robert; Nativi, Stefano; Stocker, Erich Franz

2010-01-01

The authors review recent contributions to the state-of-thescience and benign proliferation of satellite remote sensing, spatial data infrastructure, near-real-time data acquisition, analysis on high performance computing platforms, sapient archiving, multi-modal dissemination and utilization for a wide array of scientific applications. The authors also address advances in Geoinformatics and its growing ubiquity, as evidenced by its inclusion as a focus area within the American Geophysical Union (AGU), European Geosciences Union (EGU), as well as by the evolution of the IEEE Geoscience and Remote Sensing Society's (GRSS) Data Archiving and Distribution Technical Committee (DAD TC).

High-Visibility Photonic Crystal Fiber Interferometer as Multifunctional Sensor

PubMed Central

Cárdenas-Sevilla, G.A.; Fávero, Fernando C.; Villatoro, Joel

2013-01-01

A photonic crystal fiber (PCF) interferometer that exhibits record fringe contrast (∼40 dB) is demonstrated along with its sensing applications. The device operates in reflection mode and consists of a centimeter-long segment of properly selected PCF fusion spliced to single mode optical fibers. Two identical collapsed zones in the PCF combined with its modal properties allow high-visibility interference patterns. The interferometer is suitable for refractometric and liquid level sensing. The measuring refractive index range goes from 1.33 to 1.43 and the maximum resolution is ∼1.6 × 10−5. PMID:23396192

Fast, cheap and in control: spectral imaging with handheld devices

NASA Astrophysics Data System (ADS)

Gooding, Edward A.; Deutsch, Erik R.; Huehnerhoff, Joseph; Hajian, Arsen R.

2017-05-01

Remote sensing has moved out of the laboratory and into the real world. Instruments using reflection or Raman imaging modalities become faster, cheaper and more powerful annually. Enabling technologies include virtual slit spectrometer design, high power multimode diode lasers, fast open-loop scanning systems, low-noise IR-sensitive array detectors and low-cost computers with touchscreen interfaces. High-volume manufacturing assembles these components into inexpensive portable or handheld devices that make possible sophisticated decision-making based on robust data analytics. Examples include threat, hazmat and narcotics detection; remote gas sensing; biophotonic screening; environmental remediation and a host of other applications.

Somatosensory disturbance by methylmercury exposure.

PubMed

Takaoka, Shigeru; Kawakami, Yoshinobu; Fujino, Tadashi; Oh-ishi, Fumihiro; Motokura, Fukuo; Kumagai, Yoshio; Miyaoka, Tetsu

2008-05-01

Minamata disease is methylmercury poisoning from consuming fish and shellfish contaminated by industrial waste. The polluted seafood was widely consumed in the area around Minamata, but many individuals were never examined for or classified as having Minamata disease. Following the determination of the Supreme Court of Japan in October 2004 that the Japanese Government was responsible for spreading Minamata disease, over 13,000 residents came forward to be examined for Minamata disease. We studied 197 residents from the Minamata area who had a history of fish consumption during the polluted period to determine the importance of sensory symptoms and findings in making a diagnosis of Minamata disease. We divided the exposed subjects into non-complicated (E) and complicated (E+N) groups based on the absence or presence of other neurological or neurologically related disorders and compared them to residents in control area (C) after matching for age and sex. We quantitatively measured four somatosensory modalities (minimal tactile sense by Semmes-Weinstein monofilaments, vibration sense, position sense, and two-point discrimination) and did psychophysical tests of fine-surface-texture discrimination. Subjective complaints were higher in groups E and E+N than C. Over 90% of E+N and E subjects displayed a sensory disturbance on conventional neurological examination and 28% had visual constriction. About 50% of the E and E +N groups had upper and lower extremity ataxia and about 70% had truncal ataxia. The prevalence of these neurological findings was significantly higher in exposed subjects than controls. All sensory modalities were impaired in the E and E+N groups. All four quantitatively measured sensory modalities were correlated. The prevalence of complaints, neurological findings, and sensory impairment was similar or a little worse in group E+N than in group E. We conclude that sensory symptoms and findings are important in making the diagnosis of Minamata disease and that they can be determined even in the presence of neurological or neurologically related diseases.

Large Margin Multi-Modal Multi-Task Feature Extraction for Image Classification.

PubMed

Yong Luo; Yonggang Wen; Dacheng Tao; Jie Gui; Chao Xu

2016-01-01

The features used in many image analysis-based applications are frequently of very high dimension. Feature extraction offers several advantages in high-dimensional cases, and many recent studies have used multi-task feature extraction approaches, which often outperform single-task feature extraction approaches. However, most of these methods are limited in that they only consider data represented by a single type of feature, even though features usually represent images from multiple modalities. We, therefore, propose a novel large margin multi-modal multi-task feature extraction (LM3FE) framework for handling multi-modal features for image classification. In particular, LM3FE simultaneously learns the feature extraction matrix for each modality and the modality combination coefficients. In this way, LM3FE not only handles correlated and noisy features, but also utilizes the complementarity of different modalities to further help reduce feature redundancy in each modality. The large margin principle employed also helps to extract strongly predictive features, so that they are more suitable for prediction (e.g., classification). An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging real-world image data sets demonstrate the effectiveness and superiority of the proposed method.

Autonomous Modal Identification of the Space Shuttle Tail Rudder

NASA Technical Reports Server (NTRS)

Pappa, Richard S.; James, George H., III; Zimmerman, David C.

1997-01-01

Autonomous modal identification automates the calculation of natural vibration frequencies, damping, and mode shapes of a structure from experimental data. This technology complements damage detection techniques that use continuous or periodic monitoring of vibration characteristics. The approach shown in the paper incorporates the Eigensystem Realization Algorithm (ERA) as a data analysis engine and an autonomous supervisor to condense multiple estimates of modal parameters using ERA's Consistent-Mode Indicator and correlation of mode shapes. The procedure was applied to free-decay responses of a Space Shuttle tail rudder and successfully identified the seven modes of the structure below 250 Hz. The final modal parameters are a condensed set of results for 87 individual ERA cases requiring approximately five minutes of CPU time on a DEC Alpha computer.

Imaging trends in suspected appendicitis-a Canadian perspective.

PubMed

Tan, Victoria F; Patlas, Michael N; Katz, Douglas S

2017-06-01

The purpose of our study was to assess trends in the imaging of suspected appendicitis in adult patients in emergency departments of academic centers in Canada. A questionnaire was sent to all 17 academic centers in Canada to be completed by a radiologist who works in emergency radiology. The questionnaires were sent and collected over a period of 4 months from October 2015 to February 2016. Sixteen centers (94%) responded to the questionnaire. Eleven respondents (73%) use IV contrast-enhanced computed tomography (CT) as the imaging modality of choice for all patients with suspected appendicitis. Thirteen respondents (81%) use ultrasound as the first modality of choice in imaging pregnant patients with suspected appendicitis. Eleven respondents (69%) use ultrasound (US) as the first modality of choice in patients younger than 40 years of age. Ten respondents (67%) use ultrasound as the first imaging modality in female patients younger than 40 years of age. When CT is used, 81% use non-focused CT of the abdomen and pelvis, and 44% of centers use oral contrast. Thirteen centers (81%) have ultrasound available 24 h a day/7 days a week. At 12 centers (75%), ultrasound is performed by ultrasound technologists. Four centers (40%) perform magnetic resonance imaging (MRI) in suspected appendicitis in adult patients at the discretion of the attending radiologist. Eleven centers (69%) have MRI available 24/7. All 16 centers (100%) use unenhanced MRI. Various imaging modalities are available for the work-up of suspected appendicitis. Although there are North American societal guidelines and recommendations regarding the appropriateness of the multiple imaging modalities, significant heterogeneity in the first-line modalities exist, which vary depending on the patient demographics and resource availability. Imaging trends in the use of the first-line modalities should be considered in order to plan for the availability of the imaging examinations and to consider plans for an imaging algorithm to permit standardization across multiple centers. While this study examined the imaging trends specifically in Canada, there are implications to other countries seeking to streamline imaging protocols and determining appropriateness of the first-line imaging modalities.

Planetary Remote Sensing Science Enabled by MIDAS (Multiple Instrument Distributed Aperture Sensor)

NASA Technical Reports Server (NTRS)

Pitman, Joe; Duncan, Alan; Stubbs, David; Sigler, Robert; Kendrick, Rick; Chilese, John; Lipps, Jere; Manga, Mike; Graham, James; dePater, Imke

2004-01-01

The science capabilities and features of an innovative and revolutionary approach to remote sensing imaging systems, aimed at increasing the return on future space science missions many fold, are described. Our concept, called Multiple Instrument Distributed Aperture Sensor (MIDAS), provides a large-aperture, wide-field, diffraction-limited telescope at a fraction of the cost, mass and volume of conventional telescopes, by integrating optical interferometry technologies into a mature multiple aperture array concept that addresses one of the highest needs for advancing future planetary science remote sensing.

Modality dependency of familiarity ratings of Japanese words.

PubMed

Amano, S; Kondo, T; Kakehi, K

1995-07-01

Familiarity ratings for a large number of aurally and visually presented Japanese words wer measured for 11 subjects, in order to investigate the modality dependency of familiarity. The correlation coefficient between auditory and visual ratings was .808, which is lower than that observed for English words, suggesting that a substantial portion of the mental lexicon is modality dependent. It was shown that the modality dependency is greater for low-familiarity words than it is for medium- or high-familiarity words. This difference between the low- and the medium- or high-familiarity words has a relationship to orthography. That is, the dependency is larger in words consisting only of kanji, which may have multiple pronunciations and usually represent meaning, than it is in words consisting only of hiragana or katakana, which have a single pronunciation and usually do not represent meaning. These results indicate that the idiosyncratic characteristics of Japanese orthography contribute to the modality dependency.

Tracking fluid-borne odors in diverse and dynamic environments using multiple sensory mechanisms

NASA Astrophysics Data System (ADS)

Taylor, Brian Kyle

The ability to locate odor sources in different types of environments (i.e. diverse) and environments that change radically during the mission (i.e., dynamic) is essential. While many engineered odor tracking systems have been developed, they appear to be designed for a particular environment (e.g., strong or low flow). In field conditions, agents may encounter both. Insect olfactory orientation studies show that several animals can locate odor sources in both high and low flow environments, and environments where the wind vanishes during tracking behavior. Furthermore, animals use multi-modal sensing, including olfaction, vision and touch to localize a source. This work uses simulated and hardware environments to explore how engineered systems can maintain wind-driven tracking behavior in diverse and dynamic environments. The simulation uses olfaction, vision and tactile attributes to track and localize a source in the following environments: high flow, low flow, and transition from high to low flow (i.e., Wind Stop). The hardware platform tests two disparate tracking strategies (including the simulated strategy) in an environment that transitions from strong to low flow. Results indicate that using a remembered wind direction post wind-shutoff is a viable way to maintain wind-driven tracking behavior in a wind stop environment, which can help bridge the gap between high flow and low flow strategies. Also, multi-modal sensing with tactile attributes, vision and olfaction helps a vehicle to localize a source. In addition to engineered systems, the moth Manduca sexta is challenged to track in the following environments: Wind and Odor, Wind Stop, Odor and No Wind, No Odor and No Wind to gain a better understanding of animal behavior in these environments. Results show that contrary to previous studies of different moth species, M. sexta does not generally maintain its wind-driven tracking behavior post-wind shutoff, but instead executes a stereotyped sequence of maneuvers followed by odor-modulated undirected exploration of its environment. In the Odor and No Wind environment, animals become biased towards the area of the arena where odor is located compared to the No Odor and No Wind environment. Robot and animal results are compared to learn more about both.

Direct system parameter identification of mechanical structures with application to modal analysis

NASA Technical Reports Server (NTRS)

Leuridan, J. M.; Brown, D. L.; Allemang, R. J.

1982-01-01

In this paper a method is described to estimate mechanical structure characteristics in terms of mass, stiffness and damping matrices using measured force input and response data. The estimated matrices can be used to calculate a consistent set of damped natural frequencies and damping values, mode shapes and modal scale factors for the structure. The proposed technique is attractive as an experimental modal analysis method since the estimation of the matrices does not require previous estimation of frequency responses and since the method can be used, without any additional complications, for multiple force input structure testing.

Active control for vibration suppression in a flexible beam using a modal domain optical fiber sensor

NASA Technical Reports Server (NTRS)

Cox, D. E.; Lindner, D. K.

1991-01-01

An account is given of the use of a modal-domain (MD) fiber-optic sensor as an active control system component for vibration suppression, whose output is proportional to the integral of the axial strain along the optical fiber. When an MD sensor is attached to, or embedded in, a flexible structure, it senses the strain in the structure along its gage length. On the basis of the present integration of the sensor model into a flexible-structure model, it becomes possible to design a control system with a dynamic compensator which adds damping to the low-order modes of the flexible structure. This modeling procedure has been experimentally validated.

Mechanosensory neurons control sweet sensing in Drosophila

PubMed Central

Jeong, Yong Taek; Oh, Soo Min; Shim, Jaewon; Seo, Jeong Taeg; Kwon, Jae Young; Moon, Seok Jun

2016-01-01

Animals discriminate nutritious food from toxic substances using their sense of taste. Since taste perception requires taste receptor cells to come into contact with water-soluble chemicals, it is a form of contact chemosensation. Concurrent with that contact, mechanosensitive cells detect the texture of food and also contribute to the regulation of feeding. Little is known, however, about the extent to which chemosensitive and mechanosensitive circuits interact. Here, we show Drosophila prefers soft food at the expense of sweetness and that this preference requires labellar mechanosensory neurons (MNs) and the mechanosensory channel Nanchung. Activation of these labellar MNs causes GABAergic inhibition of sweet-sensing gustatory receptor neurons, reducing the perceived intensity of a sweet stimulus. These findings expand our understanding of the ways different sensory modalities cooperate to shape animal behaviour. PMID:27641708

Magnetic Field Sensing Based on Bi-Tapered Optical Fibers Using Spectral Phase Analysis.

PubMed

Herrera-Piad, Luis A; Haus, Joseph W; Jauregui-Vazquez, Daniel; Sierra-Hernandez, Juan M; Estudillo-Ayala, Julian M; Lopez-Dieguez, Yanelis; Rojas-Laguna, Roberto

2017-10-20

A compact, magnetic field sensor system based on a short, bi-tapered optical fiber (BTOF) span lying on a magnetic tape was designed, fabricated, and characterized. We monitored the transmission spectrum from a broadband light source, which displayed a strong interference signal. After data collection, we applied a phase analysis of the interference optical spectrum. We here report the results on two fabricated, BTOFs with different interference spectrum characteristics; we analyzed the signal based on the interference between a high-order modal component and the core fiber mode. The sensor exhibited a linear response for magnetic field increments, and we achieved a phase sensitivity of around 0.28 rad/mT. The sensing setup presented remote sensing operation and low-cost transducer magnetic material.

Magnetic Field Sensing Based on Bi-Tapered Optical Fibers Using Spectral Phase Analysis

PubMed Central

Herrera-Piad, Luis A.; Jauregui-Vazquez, Daniel; Sierra-Hernandez, Juan M.; Lopez-Dieguez, Yanelis

2017-01-01

A compact, magnetic field sensor system based on a short, bi-tapered optical fiber (BTOF) span lying on a magnetic tape was designed, fabricated, and characterized. We monitored the transmission spectrum from a broadband light source, which displayed a strong interference signal. After data collection, we applied a phase analysis of the interference optical spectrum. We here report the results on two fabricated, BTOFs with different interference spectrum characteristics; we analyzed the signal based on the interference between a high-order modal component and the core fiber mode. The sensor exhibited a linear response for magnetic field increments, and we achieved a phase sensitivity of around 0.28 rad/mT. The sensing setup presented remote sensing operation and low-cost transducer magnetic material. PMID:29053570

FMRI investigation of cross-modal interactions in beat perception: Audition primes vision, but not vice versa

PubMed Central

Grahn, Jessica A.; Henry, Molly J.; McAuley, J. Devin

2011-01-01

How we measure time and integrate temporal cues from different sensory modalities are fundamental questions in neuroscience. Sensitivity to a “beat” (such as that routinely perceived in music) differs substantially between auditory and visual modalities. Here we examined beat sensitivity in each modality, and examined cross-modal influences, using functional magnetic resonance imaging (fMRI) to characterize brain activity during perception of auditory and visual rhythms. In separate fMRI sessions, participants listened to auditory sequences or watched visual sequences. The order of auditory and visual sequence presentation was counterbalanced so that cross-modal order effects could be investigated. Participants judged whether sequences were speeding up or slowing down, and the pattern of tempo judgments was used to derive a measure of sensitivity to an implied beat. As expected, participants were less sensitive to an implied beat in visual sequences than in auditory sequences. However, visual sequences produced a stronger sense of beat when preceded by auditory sequences with identical temporal structure. Moreover, increases in brain activity were observed in the bilateral putamen for visual sequences preceded by auditory sequences when compared to visual sequences without prior auditory exposure. No such order-dependent differences (behavioral or neural) were found for the auditory sequences. The results provide further evidence for the role of the basal ganglia in internal generation of the beat and suggest that an internal auditory rhythm representation may be activated during visual rhythm perception. PMID:20858544

A method for experimental modal separation

NASA Technical Reports Server (NTRS)

Hallauer, W. L., Jr.

1977-01-01

A method is described for the numerical simulation of multiple-shaker modal survey testing using simulated experimental data to optimize the shaker force-amplitude distribution for the purpose of isolating individual modes of vibration. Inertia, damping, stiffness, and model data are stored on magnetic disks, available by direct access to the interactive FORTRAN programs which perform all computations required by this relative force amplitude distribution method.

Sensor chip and apparatus for tactile and/or flow sensing

NASA Technical Reports Server (NTRS)

Liu, Chang (Inventor); Chen, Jack (Inventor); Engel, Jonathan (Inventor)

2008-01-01

A sensor chip, comprising a flexible, polymer-based substrate, and at least one microfabricated sensor disposed on the substrate and including a conductive element. The at least one sensor comprises at least one of a tactile sensor and a flow sensor. Other embodiments of the present invention include sensors and/or multi-modal sensor nodes.

Student Musicians' Experiences of Reflexivity during Internships: Personal Narratives and Complex Modalities

ERIC Educational Resources Information Center

Bennett, Dawn; Reid, Anna; Rowley, Jennifer

2017-01-01

A presumption behind work-integrated learning activities such as internship programmes is that student thinking will shift as a result of exposure to industry practice. We wondered if all students experience this change in the positive sense that teachers expect. To examine this presumption we asked to what extent and in what ways students…

Impact of Metacognitive Practices and Assorted Assessment Modalities towards Creating Self-Regulated Learners

ERIC Educational Resources Information Center

Nair N., Sreevrinda

2014-01-01

Worldwide efforts are increasing to infuse thinking skills into the curriculum, which are part of cognitive behavior, and to include them in the instructional strategies, which will make the learner producer of knowledge and help to create a sense of responsibility among them. Metacognitive learning activities immerse students in challenging tasks…

A Motion-Sensing Game-Based Therapy to Foster the Learning of Children with Sensory Integration Dysfunction

ERIC Educational Resources Information Center

Chuang, Tsung-Yen; Kuo, Ming-Shiou

2016-01-01

Children with Sensory Integration Dysfunction (SID, also known as Sensory Processing Disorder, SPD) are also learners with disabilities with regard to responding adequately to the demands made by a learning environment. With problems of organizing and processing the sensation information coming from body modalities, children with SID (CwSID)…

Haptics in Education: Exploring an Untapped Sensory Modality

ERIC Educational Resources Information Center

Minogue, James; Jones, M. Gail

2006-01-01

As human beings, we can interact with our environment through the sense of touch, which helps us to build an understanding of objects and events. The implications of touch for cognition are recognized by many educators who advocate the use of "hands-on" instruction. But is it possible to know something more completely by touching it? Does touch…

Sensor chip and apparatus for tactile and/or flow sensing

NASA Technical Reports Server (NTRS)

Liu, Chang (Inventor); Chen, Jack (Inventor); Engel, Jonathan (Inventor)

2009-01-01

A sensor chip, comprising a flexible, polymer-based substrate, and at least one microfabricated sensor disposed on the substrate and including a conductive element. The at least one sensor comprises at least one of a tactile sensor and a flow sensor. Other embodiments of the present invention include sensors and/or multi-modal sensor nodes.

An Extrinsic Fabry-Perot Interferometric Sensor using Intermodal Phase Shifting and Demultiplexing of the Propagating Modes in a Few-Mode Fiber

NASA Astrophysics Data System (ADS)

Chatterjee, Julius

This dissertation demonstrates a fiber-optic phase shifted Fabry-Perot interferometer (PS-FPI) as a sensor using modal demultiplexing. Single wavelength Fabry-Perot interferometers suffer from fringe ambiguity and loss of sensitivity at fringe extremes. These hindrances cause it to be a secondary choice when being selected for a measurement task at hand, and more often than not, white light based sensors are selected in favor of the single wavelength Fabry-Perot sensors. This work aims to introduce a technique involving the demultiplexing of the propagating linearly polarized (LP) modes in few mode fibers to obtain two fringe systems from the same sensing cavity. This results in a few-mode interferometer that effectively has two to three orders of magnitude higher perturbation sensitivity than a conventional few mode interferometer for the same sensing region. In this work, two different modal demultiplexing techniques (MD) are used to demodulate the propagating modes and to obtain two fringe sets. These output fringe sets are shifted in phase with respect to each other by a phase shift due to the propagation of the modes in the fiber-optic layout. A method of controlling this phase shift by straining a length of a two mode fiber located separate from the PS-FPI cavity is demonstrated and corresponding changes in phase shifts are shown. The results show a controllable phase shift for both the MD techniques, which is useful in sensing by permitting quadrature demodulation of interferometric fringes and also results in a novel few-mode sensing system having more than two orders of magnitude sensitivity than conventional few-mode devices.

Interactive wearable systems for upper body rehabilitation: a systematic review.

PubMed

Wang, Qi; Markopoulos, Panos; Yu, Bin; Chen, Wei; Timmermans, Annick

2017-03-11

The development of interactive rehabilitation technologies which rely on wearable-sensing for upper body rehabilitation is attracting increasing research interest. This paper reviews related research with the aim: 1) To inventory and classify interactive wearable systems for movement and posture monitoring during upper body rehabilitation, regarding the sensing technology, system measurements and feedback conditions; 2) To gauge the wearability of the wearable systems; 3) To inventory the availability of clinical evidence supporting the effectiveness of related technologies. A systematic literature search was conducted in the following search engines: PubMed, ACM, Scopus and IEEE (January 2010-April 2016). Forty-five papers were included and discussed in a new cuboid taxonomy which consists of 3 dimensions: sensing technology, feedback modalities and system measurements. Wearable sensor systems were developed for persons in: 1) Neuro-rehabilitation: stroke (n = 21), spinal cord injury (n = 1), cerebral palsy (n = 2), Alzheimer (n = 1); 2) Musculoskeletal impairment: ligament rehabilitation (n = 1), arthritis (n = 1), frozen shoulder (n = 1), bones trauma (n = 1); 3) Others: chronic pulmonary obstructive disease (n = 1), chronic pain rehabilitation (n = 1) and other general rehabilitation (n = 14). Accelerometers and inertial measurement units (IMU) are the most frequently used technologies (84% of the papers). They are mostly used in multiple sensor configurations to measure upper limb kinematics and/or trunk posture. Sensors are placed mostly on the trunk, upper arm, the forearm, the wrist, and the finger. Typically sensors are attachable rather than embedded in wearable devices and garments; although studies that embed and integrate sensors are increasing in the last 4 years. 16 studies applied knowledge of result (KR) feedback, 14 studies applied knowledge of performance (KP) feedback and 15 studies applied both in various modalities. 16 studies have conducted their evaluation with patients and reported usability tests, while only three of them conducted clinical trials including one randomized clinical trial. This review has shown that wearable systems are used mostly for the monitoring and provision of feedback on posture and upper extremity movements in stroke rehabilitation. The results indicated that accelerometers and IMUs are the most frequently used sensors, in most cases attached to the body through ad hoc contraptions for the purpose of improving range of motion and movement performance during upper body rehabilitation. Systems featuring sensors embedded in wearable appliances or garments are only beginning to emerge. Similarly, clinical evaluations are scarce and are further needed to provide evidence on effectiveness and pave the path towards implementation in clinical settings.

Satellite Remote Sensing of Harmful Algal Blooms (HABs) and a Potential Synthesized Framework

PubMed Central

Shen, Li; Xu, Huiping; Guo, Xulin

2012-01-01

Harmful algal blooms (HABs) are severe ecological disasters threatening aquatic systems throughout the World, which necessitate scientific efforts in detecting and monitoring them. Compared with traditional in situ point observations, satellite remote sensing is considered as a promising technique for studying HABs due to its advantages of large-scale, real-time, and long-term monitoring. The present review summarizes the suitability of current satellite data sources and different algorithms for detecting HABs. It also discusses the spatial scale issue of HABs. Based on the major problems identified from previous literature, including the unsystematic understanding of HABs, the insufficient incorporation of satellite remote sensing, and a lack of multiple oceanographic explanations of the mechanisms causing HABs, this review also attempts to provide a comprehensive understanding of the complicated mechanism of HABs impacted by multiple oceanographic factors. A potential synthesized framework can be established by combining multiple accessible satellite remote sensing approaches including visual interpretation, spectra analysis, parameters retrieval and spatial-temporal pattern analysis. This framework aims to lead to a systematic and comprehensive monitoring of HABs based on satellite remote sensing from multiple oceanographic perspectives. PMID:22969372

[Pay attention to the application of the international intraocular retinoblastoma classification and sequential multiple modality treatment].

PubMed

Fan, X Q

2017-08-11

Retinoblastoma (RB) is the most common intraocular malignancy in childhood. It may seriously affect vision, and even threaten the life. The early diagnosis rate of RB in China remains low, and the majority of patients are at late phase with high rates of enucleation and mortality. The International Intraocular Retinoblastoma Classification and TNM staging system are guidances for therapeutic choices and bases for prognosis evaluation. Based on the sequential multi-method treatment modality, chemotherapy combined with local therapy is the mainstream in dealing with RB, which may maximize the results of eye saving and even vision retaining. New therapeutic techniques including supra-selective ophthalmic artery interventional chemotherapy and intravitreal chemotherapy can further improve the efficacy of treatment, especially the eye salvage rate. The overall level of RB treatment should be improved by promoting the international staging, new therapeutic techniques, and the sequential multiple modality treatment. (Chin J Ophthalmol, 2017, 53: 561 - 565) .

Incremental dynamical downscaling for probabilistic analysis based on multiple GCM projections

NASA Astrophysics Data System (ADS)

Wakazuki, Y.

2015-12-01

A dynamical downscaling method for probabilistic regional scale climate change projections was developed to cover an uncertainty of multiple general circulation model (GCM) climate simulations. The climatological increments (future minus present climate states) estimated by GCM simulation results were statistically analyzed using the singular vector decomposition. Both positive and negative perturbations from the ensemble mean with the magnitudes of their standard deviations were extracted and were added to the ensemble mean of the climatological increments. The analyzed multiple modal increments were utilized to create multiple modal lateral boundary conditions for the future climate regional climate model (RCM) simulations by adding to an objective analysis data. This data handling is regarded to be an advanced method of the pseudo-global-warming (PGW) method previously developed by Kimura and Kitoh (2007). The incremental handling for GCM simulations realized approximated probabilistic climate change projections with the smaller number of RCM simulations. Three values of a climatological variable simulated by RCMs for a mode were used to estimate the response to the perturbation of the mode. For the probabilistic analysis, climatological variables of RCMs were assumed to show linear response to the multiple modal perturbations, although the non-linearity was seen for local scale rainfall. Probability of temperature was able to be estimated within two modes perturbation simulations, where the number of RCM simulations for the future climate is five. On the other hand, local scale rainfalls needed four modes simulations, where the number of the RCM simulations is nine. The probabilistic method is expected to be used for regional scale climate change impact assessment in the future.

Regression-based pediatric norms for the brief visuospatial memory test: revised and the symbol digit modalities test.

PubMed

Smerbeck, A M; Parrish, J; Yeh, E A; Hoogs, M; Krupp, Lauren B; Weinstock-Guttman, B; Benedict, R H B

2011-04-01

The Brief Visuospatial Memory Test - Revised (BVMTR) and the Symbol Digit Modalities Test (SDMT) oral-only administration are known to be sensitive to cerebral disease in adult samples, but pediatric norms are not available. A demographically balanced sample of healthy control children (N = 92) ages 6-17 was tested with the BVMTR and SDMT. Multiple regression analysis (MRA) was used to develop demographically controlled normative equations. This analysis provided equations that were then used to construct demographically adjusted z-scores for the BVMTR Trial 1, Trial 2, Trial 3, Total Learning, and Delayed Recall indices, as well as the SDMT total correct score. To demonstrate the utility of this approach, a comparison group of children with acute disseminated encephalomyelitis (ADEM) or multiple sclerosis (MS) were also assessed. We find that these visual processing tests discriminate neurological patients from controls. As the tests are validated in adult multiple sclerosis, they are likely to be useful in monitoring pediatric onset multiple sclerosis patients as they transition into adulthood.

Multimodal nanoprobes for radionuclide and five-color near-infrared optical lymphatic imaging.

PubMed

Kobayashi, Hisataka; Koyama, Yoshinori; Barrett, Tristan; Hama, Yukihiro; Regino, Celeste A S; Shin, In Soo; Jang, Beom-Su; Le, Nhat; Paik, Chang H; Choyke, Peter L; Urano, Yasuteru

2007-11-01

Current contrast agents generally have one function and can only be imaged in monochrome; therefore, the majority of imaging methods can only impart uniparametric information. A single nanoparticle has the potential to be loaded with multiple payloads. Such multimodality probes have the ability to be imaged by more than one imaging technique, which could compensate for the weakness or even combine the advantages of each individual modality. Furthermore, optical imaging using different optical probes enables us to achieve multicolor in vivo imaging, wherein multiple parameters can be read from a single image. To allow differentiation of multiple optical signals in vivo, each probe should have a close but different near-infrared emission. To this end, we synthesized nanoprobes with multimodal and multicolor potential, which employed a polyamidoamine dendrimer platform linked to both radionuclides and optical probes, permitting dual-modality scintigraphic and five-color near-infrared optical lymphatic imaging using a multiple-excitation spectrally resolved fluorescence imaging technique.

Audition and vision share spatial attentional resources, yet attentional load does not disrupt audiovisual integration.

PubMed

Wahn, Basil; König, Peter

2015-01-01

Humans continuously receive and integrate information from several sensory modalities. However, attentional resources limit the amount of information that can be processed. It is not yet clear how attentional resources and multisensory processing are interrelated. Specifically, the following questions arise: (1) Are there distinct spatial attentional resources for each sensory modality? and (2) Does attentional load affect multisensory integration? We investigated these questions using a dual task paradigm: participants performed two spatial tasks (a multiple object tracking task and a localization task), either separately (single task condition) or simultaneously (dual task condition). In the multiple object tracking task, participants visually tracked a small subset of several randomly moving objects. In the localization task, participants received either visual, auditory, or redundant visual and auditory location cues. In the dual task condition, we found a substantial decrease in participants' performance relative to the results of the single task condition. Importantly, participants performed equally well in the dual task condition regardless of the location cues' modality. This result suggests that having spatial information coming from different modalities does not facilitate performance, thereby indicating shared spatial attentional resources for the auditory and visual modality. Furthermore, we found that participants integrated redundant multisensory information similarly even when they experienced additional attentional load in the dual task condition. Overall, findings suggest that (1) visual and auditory spatial attentional resources are shared and that (2) audiovisual integration of spatial information occurs in an pre-attentive processing stage.

Modal Parameters Evaluation in a Full-Scale Aircraft Demonstrator under Different Environmental Conditions Using HS 3D-DIC.

PubMed

Molina-Viedma, Ángel Jesús; López-Alba, Elías; Felipe-Sesé, Luis; Díaz, Francisco A; Rodríguez-Ahlquist, Javier; Iglesias-Vallejo, Manuel

2018-02-02

In real aircraft structures the comfort and the occupational performance of crewmembers and passengers are affected by the presence of noise. In this sense, special attention is focused on mechanical and material design for isolation and vibration control. Experimental characterization and, in particular, experimental modal analysis, provides information for adequate cabin noise control. Traditional sensors employed in the aircraft industry for this purpose are invasive and provide a low spatial resolution. This paper presents a methodology for experimental modal characterization of a front fuselage full-scale demonstrator using high-speed 3D digital image correlation, which is non-invasive, ensuring that the structural response is unperturbed by the instrumentation mass. Specifically, full-field measurements on the passenger window area were conducted when the structure was excited using an electrodynamic shaker. The spectral analysis of the measured time-domain displacements made it possible to identify natural frequencies and full-field operational deflection shapes. Changes in the modal parameters due to cabin pressurization and the behavior of different local structural modifications were assessed using this methodology. The proposed full-field methodology allowed the characterization of relevant dynamic response patterns, complementing the capabilities provided by accelerometers.

Active Noise Control of Low Speed Fan Rotor-Stator Modes

NASA Technical Reports Server (NTRS)

Sutliff, Daniel L.; Hu, Ziqiang; Pla, Frederic G.; Heidelberg, Laurence J.

1996-01-01

This report describes the Active Noise Cancellation System designed by General Electric and tested in the NASA Lewis Research Center's 48 inch Active Noise Control Fan. The goal of this study was to assess the feasibility of using wall mounted secondary acoustic sources and sensors within the duct of a high bypass turbofan aircraft engine for active noise cancellation of fan tones. The control system is based on a modal control approach. A known acoustic mode propagating in the fan duct is cancelled using an array of flush-mounted compact sound sources. Controller inputs are signals from a shaft encoder and a microphone array which senses the residual acoustic mode in the duct. The canceling modal signal is generated by a modal controller. The key results are that the (6,0) mode was completely eliminated at 920 Hz and substantially reduced elsewhere. The total tone power was reduced 9.4 dB. Farfield 2BPF SPL reductions of 13 dB were obtained. The (4,0) and (4,1) modes were reduced simultaneously yielding a 15 dB modal PWL decrease. Global attenuation of PWL was obtained using an actuator and sensor system totally contained within the duct.

Physical modeling of Tibetan bowls

NASA Astrophysics Data System (ADS)

Antunes, Jose; Inacio, Octavio

2004-05-01

Tibetan bowls produce rich penetrating sounds, used in musical contexts and to induce a state of relaxation for meditation or therapy purposes. To understand the dynamics of these instruments under impact and rubbing excitation, we developed a simulation method based on the modal approach, following our previous papers on physical modeling of plucked/bowed strings and impacted/bowed bars. This technique is based on a compact representation of the system dynamics, in terms of the unconstrained bowl modes. Nonlinear contact/friction interaction forces, between the exciter (puja) and the bowl, are computed at each time step and projected on the bowl modal basis, followed by step integration of the modal equations. We explore the behavior of two different-sized bowls, for extensive ranges of excitation conditions (contact/friction parameters, normal force, and tangential puja velocity). Numerical results and experiments show that various self-excited motions may arise depending on the playing conditions and, mainly, on the contact/friction interaction parameters. Indeed, triggering of a given bowl modal frequency mainly depends on the puja material. Computed animations and experiments demonstrate that self-excited modes spin, following the puja motion. Accordingly, the sensed pressure field pulsates, with frequency controlled by the puja spinning velocity and the spatial pattern of the singing mode.

Perception of the material properties of wood based on vision, audition, and touch.

PubMed

Fujisaki, Waka; Tokita, Midori; Kariya, Kenji

2015-04-01

Most research on the multimodal perception of material properties has investigated the perception of material properties of two modalities such as vision-touch, vision-audition, audition-touch, and vision-action. Here, we investigated whether the same affective classifications of materials can be found in three different modalities of vision, audition, and touch, using wood as the target object. Fifty participants took part in an experiment involving the three modalities of vision, audition, and touch, in isolation. Twenty-two different wood types including genuine, processed, and fake were perceptually evaluated using a questionnaire consisting of twenty-three items (12 perceptual and 11 affective). The results demonstrated that evaluations of the affective properties of wood were similar in all three modalities. The elements of "expensiveness, sturdiness, rareness, interestingness, and sophisticatedness" and "pleasantness, relaxed feelings, and liked-disliked" were separately grouped for all three senses. Our results suggest that the affective material properties of wood are at least partly represented in a supramodal fashion. Our results also suggest an association between perceptual and affective properties, which will be a useful tool not only in science, but also in applied fields. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Modal Parameters Evaluation in a Full-Scale Aircraft Demonstrator under Different Environmental Conditions Using HS 3D-DIC

PubMed Central

López-Alba, Elías; Felipe-Sesé, Luis; Díaz, Francisco A.; Rodríguez-Ahlquist, Javier; Iglesias-Vallejo, Manuel

2018-01-01

In real aircraft structures the comfort and the occupational performance of crewmembers and passengers are affected by the presence of noise. In this sense, special attention is focused on mechanical and material design for isolation and vibration control. Experimental characterization and, in particular, experimental modal analysis, provides information for adequate cabin noise control. Traditional sensors employed in the aircraft industry for this purpose are invasive and provide a low spatial resolution. This paper presents a methodology for experimental modal characterization of a front fuselage full-scale demonstrator using high-speed 3D digital image correlation, which is non-invasive, ensuring that the structural response is unperturbed by the instrumentation mass. Specifically, full-field measurements on the passenger window area were conducted when the structure was excited using an electrodynamic shaker. The spectral analysis of the measured time-domain displacements made it possible to identify natural frequencies and full-field operational deflection shapes. Changes in the modal parameters due to cabin pressurization and the behavior of different local structural modifications were assessed using this methodology. The proposed full-field methodology allowed the characterization of relevant dynamic response patterns, complementing the capabilities provided by accelerometers. PMID:29393897

NeMO-Net & Fluid Lensing: The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment Using Fluid Lensing Augmentation of NASA EOS Data

NASA Technical Reports Server (NTRS)

Chirayath, Ved

2018-01-01

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low-resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with global low-resolution (m, km-scale) airborne and spaceborne imagery to reduce classification errors up to 80% over regional scales. Such technologies can substantially enhance our ability to assess coral reef ecosystems dynamics.

Structural Health Monitoring of Nuclear Spent Fuel Storage Facilities

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yu, Lingyu

Interim storage of spent nuclear fuel from reactor sites has gained additional importance and urgency for resolving waste-management-related technical issues. To ensure that nuclear power remains clean energy, monitoring has been identified by DOE as a high priority cross-cutting need, necessary to determine and predict the degradation state of the systems, structures, and components (SSCs) important to safety (ITS). Therefore, nondestructive structural condition monitoring becomes a need to be installed on existing or to be integrated into future storage system to quantify the state of health or to guarantee the safe operation of nuclear power plants (NPPs) during their extendedmore » life span. In this project, the lead university and the collaborating national laboratory teamed to develop a nuclear structural health monitoring (n-SHM) system based on in-situ piezoelectric sensing technologies that can monitor structural degradation and aging for nuclear spent fuel DCSS and similar structures. We also aimed to identify and quantify possible influences of nuclear spent fuel environment (temperature and radiation) to the piezoelectric sensor system and come up with adequate solutions and guidelines therefore. We have therefore developed analytical model for piezoelectric based n-SHM methods, with considerations of temperature and irradiation influence on the model of sensing and algorithms in acoustic emission (AE), guided ultrasonic waves (GUW), and electromechanical impedance spectroscopy (EMIS). On the other side, experimentally the temperature and irradiation influence on the piezoelectric sensors and sensing capabilities were investigated. Both short-term and long-term irradiation investigation with our collaborating national laboratory were performed. Moreover, we developed multi-modal sensing, validated in laboratory setup, and conducted the testing on the We performed multi-modal sensing development, verification and validation tests on very complex structures including a medium-scale vacuum drying chamber and a small-scale mockup canister available for the desired testing. Our work developed the potential candidate for long term structural health monitoring of spent fuel canister through piezoelectric wafer sensors and provided the sensing methodologies based on AE and GUW methodologies. It overall provides an innovative system and methodology for enhancing the safe operation of nuclear power plant. All major accomplishments planned in the original proposal were successfully achieved.« less

Pollution going multimodal: the complex impact of the human-altered sensory environment on animal perception and performance

PubMed Central

Halfwerk, Wouter; Slabbekoorn, Hans

2015-01-01

Anthropogenic sensory pollution is affecting ecosystems worldwide. Human actions generate acoustic noise, emanate artificial light and emit chemical substances. All of these pollutants are known to affect animals. Most studies on anthropogenic pollution address the impact of pollutants in unimodal sensory domains. High levels of anthropogenic noise, for example, have been shown to interfere with acoustic signals and cues. However, animals rely on multiple senses, and pollutants often co-occur. Thus, a full ecological assessment of the impact of anthropogenic activities requires a multimodal approach. We describe how sensory pollutants can co-occur and how covariance among pollutants may differ from natural situations. We review how animals combine information that arrives at their sensory systems through different modalities and outline how sensory conditions can interfere with multimodal perception. Finally, we describe how sensory pollutants can affect the perception, behaviour and endocrinology of animals within and across sensory modalities. We conclude that sensory pollution can affect animals in complex ways due to interactions among sensory stimuli, neural processing and behavioural and endocrinal feedback. We call for more empirical data on covariance among sensory conditions, for instance, data on correlated levels in noise and light pollution. Furthermore, we encourage researchers to test animal responses to a full-factorial set of sensory pollutants in the presence or the absence of ecologically important signals and cues. We realize that such approach is often time and energy consuming, but we think this is the only way to fully understand the multimodal impact of sensory pollution on animal performance and perception. PMID:25904319

Framework and implementation of a continuous network-wide health monitoring system for roadways

NASA Astrophysics Data System (ADS)

Wang, Ming; Birken, Ralf; Shahini Shamsabadi, Salar

2014-03-01

According to the 2013 ASCE report card America's infrastructure scores only a D+. There are more than four million miles of roads (grade D) in the U.S. requiring a broad range of maintenance activities. The nation faces a monumental problem of infrastructure management in the scheduling and implementation of maintenance and repair operations, and in the prioritization of expenditures within budgetary constraints. The efficient and effective performance of these operations however is crucial to ensuring roadway safety, preventing catastrophic failures, and promoting economic growth. There is a critical need for technology that can cost-effectively monitor the condition of a network-wide road system and provide accurate, up-to-date information for maintenance activity prioritization. The Versatile Onboard Traffic Embedded Roaming Sensors (VOTERS) project provides a framework and the sensing capability to complement periodical localized inspections to continuous network-wide health monitoring. Research focused on the development of a cost-effective, lightweight package of multi-modal sensor systems compatible with this framework. An innovative software infrastructure is created that collects, processes, and evaluates these large time-lapse multi-modal data streams. A GIS-based control center manages multiple inspection vehicles and the data for further analysis, visualization, and decision making. VOTERS' technology can monitor road conditions at both the surface and sub-surface levels while the vehicle is navigating through daily traffic going about its normal business, thereby allowing for network-wide frequent assessment of roadways. This deterioration process monitoring at unprecedented time and spatial scales provides unique experimental data that can be used to improve life-cycle cost analysis models.

Sensing Strategies for Disambiguating among Multiple Objects in Known Poses.

DTIC Science & Technology

1985-08-01

ELEMENT. PROIECT. TASK Artificial Inteligence Laboratory AE OKUI UBR 545 Technology Square Cambridge, MA 021.39 11. CONTROLLING OFFICE NAME AND ADDRESS 12...AD-Ali65 912 SENSING STRATEGIES FOR DISAMBIGURTING MONG MULTIPLE 1/1 OBJECTS IN KNOWN POSES(U) MASSACHUSETTS INST OF TECH CAMBRIDGE ARTIFICIAL ...or Dist Special 1 ’ MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY A. I. Memo 855 August, 1985 Sensing Strategies for

Large-Scale Brain Networks Supporting Divided Attention across Spatial Locations and Sensory Modalities

PubMed Central

Santangelo, Valerio

2018-01-01

Higher-order cognitive processes were shown to rely on the interplay between large-scale neural networks. However, brain networks involved with the capability to split attentional resource over multiple spatial locations and multiple stimuli or sensory modalities have been largely unexplored to date. Here I re-analyzed data from Santangelo et al. (2010) to explore the causal interactions between large-scale brain networks during divided attention. During fMRI scanning, participants monitored streams of visual and/or auditory stimuli in one or two spatial locations for detection of occasional targets. This design allowed comparing a condition in which participants monitored one stimulus/modality (either visual or auditory) in two spatial locations vs. a condition in which participants monitored two stimuli/modalities (both visual and auditory) in one spatial location. The analysis of the independent components (ICs) revealed that dividing attentional resources across two spatial locations necessitated a brain network involving the left ventro- and dorso-lateral prefrontal cortex plus the posterior parietal cortex, including the intraparietal sulcus (IPS) and the angular gyrus, bilaterally. The analysis of Granger causality highlighted that the activity of lateral prefrontal regions were predictive of the activity of all of the posteriors parietal nodes. By contrast, dividing attention across two sensory modalities necessitated a brain network including nodes belonging to the dorsal frontoparietal network, i.e., the bilateral frontal eye-fields (FEF) and IPS, plus nodes belonging to the salience network, i.e., the anterior cingulated cortex and the left and right anterior insular cortex (aIC). The analysis of Granger causality highlights a tight interdependence between the dorsal frontoparietal and salience nodes in trials requiring divided attention between different sensory modalities. The current findings therefore highlighted a dissociation among brain networks implicated during divided attention across spatial locations and sensory modalities, pointing out the importance of investigating effective connectivity of large-scale brain networks supporting complex behavior. PMID:29535614

Large-Scale Brain Networks Supporting Divided Attention across Spatial Locations and Sensory Modalities.

PubMed

Santangelo, Valerio

2018-01-01

Higher-order cognitive processes were shown to rely on the interplay between large-scale neural networks. However, brain networks involved with the capability to split attentional resource over multiple spatial locations and multiple stimuli or sensory modalities have been largely unexplored to date. Here I re-analyzed data from Santangelo et al. (2010) to explore the causal interactions between large-scale brain networks during divided attention. During fMRI scanning, participants monitored streams of visual and/or auditory stimuli in one or two spatial locations for detection of occasional targets. This design allowed comparing a condition in which participants monitored one stimulus/modality (either visual or auditory) in two spatial locations vs. a condition in which participants monitored two stimuli/modalities (both visual and auditory) in one spatial location. The analysis of the independent components (ICs) revealed that dividing attentional resources across two spatial locations necessitated a brain network involving the left ventro- and dorso-lateral prefrontal cortex plus the posterior parietal cortex, including the intraparietal sulcus (IPS) and the angular gyrus, bilaterally. The analysis of Granger causality highlighted that the activity of lateral prefrontal regions were predictive of the activity of all of the posteriors parietal nodes. By contrast, dividing attention across two sensory modalities necessitated a brain network including nodes belonging to the dorsal frontoparietal network, i.e., the bilateral frontal eye-fields (FEF) and IPS, plus nodes belonging to the salience network, i.e., the anterior cingulated cortex and the left and right anterior insular cortex (aIC). The analysis of Granger causality highlights a tight interdependence between the dorsal frontoparietal and salience nodes in trials requiring divided attention between different sensory modalities. The current findings therefore highlighted a dissociation among brain networks implicated during divided attention across spatial locations and sensory modalities, pointing out the importance of investigating effective connectivity of large-scale brain networks supporting complex behavior.

The physiologic basis and clinical applications of cryotherapy and thermotherapy for the pain practitioner.

PubMed

Nadler, Scott F; Weingand, Kurt; Kruse, Roger J

2004-07-01

Cryotherapy and thermotherapy are useful adjuncts for the treatment of musculoskeletal injuries. Clinicians treating these conditions should be aware of current research findings regarding these modalities, because their choice of modality may affect the ultimate outcome of the patient being treated. Through a better understanding of these modalities, clinicians can optimize their present treatment strategies. Although cold and hot treatment modalities both decrease pain and muscle spasm, they have opposite effects on tissue metabolism, blood flow, inflammation, edema, and connective tissue extensibility. Cryotherapy decreases these effects while thermotherapy increases them. Continuous low-level cryotherapy and thermotherapy are newer concepts in therapeutic modalities. Both modalities provide significant pain relief with a low side-effect profile. Contrast therapy, which alternates between hot and cold treatment modalities, provides no additional therapeutic benefits compared with cryotherapy or thermotherapy alone. Complications of cryotherapy include nerve damage, frostbite, Raynaud's phenomenon, cold-induced urticaria, and slowed wound healing. With thermotherapy, skin burns may occur, especially in patients with diabetes mellitus, multiple sclerosis, poor circulation, and spinal cord injuries. In individuals with rheumatoid arthritis, deep-heating modalities should be used with caution because increased inflammation may occur. Whirlpool and other types of hydrotherapy have caused infections of the skin, urogenital, and pulmonary systems. Additionally, ultrasound should not be used in patients with joint prostheses.

Sight and sound converge to form modality-invariant representations in temporo-parietal cortex

PubMed Central

Man, Kingson; Kaplan, Jonas T.; Damasio, Antonio; Meyer, Kaspar

2013-01-01

People can identify objects in the environment with remarkable accuracy, irrespective of the sensory modality they use to perceive them. This suggests that information from different sensory channels converges somewhere in the brain to form modality-invariant representations, i.e., representations that reflect an object independently of the modality through which it has been apprehended. In this functional magnetic resonance imaging study of human subjects, we first identified brain areas that responded to both visual and auditory stimuli and then used crossmodal multivariate pattern analysis to evaluate the neural representations in these regions for content-specificity (i.e., do different objects evoke different representations?) and modality-invariance (i.e., do the sight and the sound of the same object evoke a similar representation?). While several areas became activated in response to both auditory and visual stimulation, only the neural patterns recorded in a region around the posterior part of the superior temporal sulcus displayed both content-specificity and modality-invariance. This region thus appears to play an important role in our ability to recognize objects in our surroundings through multiple sensory channels and to process them at a supra-modal (i.e., conceptual) level. PMID:23175818

Dual-modality NIRF-MRI cubosomes and hexosomes: High throughput formulation and in vivo biodistribution.

PubMed

Tran, Nhiem; Bye, Nicole; Moffat, Bradford A; Wright, David K; Cuddihy, Andrew; Hinton, Tracey M; Hawley, Adrian M; Reynolds, Nicholas P; Waddington, Lynne J; Mulet, Xavier; Turnley, Ann M; Morganti-Kossmann, M Cristina; Muir, Benjamin W

2017-02-01

Engineered nanoparticles with multiple complementary imaging modalities are of great benefit to the rapid treatment and diagnosis of disease in various organs. Herein, we report the formulation of cubosomes and hexosomes that carry multiple amphiphilic imaging contrast agents in their self-assembled lipid bilayers. This is the first report of the use of both near infrared fluorescent (NIRF) imaging and gadolinium lipid based magnetic resonance (MR) imaging modalities in cubosomes and hexosomes. High-throughput screening was used to rapidly optimize formulations with desirable nano-architectures and low in vitro cytotoxicity. The dual-modal imaging nanoparticles in vivo biodistribution and organ specific contrast enhancement were then studied. The NIRF in vivo imaging results indicated accumulation of both cubosomes and hexosomes in the liver and spleen of mice up to 20h post-injection. Remarkably, the biodistribution of the nanoparticle formulations was affected by the mesophase (i.e. cubic or hexagonal), a finding of significant importance for the future use of these compounds, with hexosomes showing higher accumulation in the spleen than the liver compared to cubosomes. Furthermore, in vivo MRI data of animals injected with either type of lyotropic liquid crystal nanoparticle displayed enhanced contrast in the liver and spleen. Copyright © 2016 Elsevier B.V. All rights reserved.

A common perceptual temporal limit of binding synchronous inputs across different sensory attributes and modalities.

PubMed

Fujisaki, Waka; Nishida, Shin'ya

2010-08-07

The human brain processes different aspects of the surrounding environment through multiple sensory modalities, and each modality can be subdivided into multiple attribute-specific channels. When the brain rebinds sensory content information ('what') across different channels, temporal coincidence ('when') along with spatial coincidence ('where') provides a critical clue. It however remains unknown whether neural mechanisms for binding synchronous attributes are specific to each attribute combination, or universal and central. In human psychophysical experiments, we examined how combinations of visual, auditory and tactile attributes affect the temporal frequency limit of synchrony-based binding. The results indicated that the upper limits of cross-attribute binding were lower than those of within-attribute binding, and surprisingly similar for any combination of visual, auditory and tactile attributes (2-3 Hz). They are unlikely to be the limits for judging synchrony, since the temporal limit of a cross-attribute synchrony judgement was higher and varied with the modality combination (4-9 Hz). These findings suggest that cross-attribute temporal binding is mediated by a slow central process that combines separately processed 'what' and 'when' properties of a single event. While the synchrony performance reflects temporal bottlenecks existing in 'when' processing, the binding performance reflects the central temporal limit of integrating 'when' and 'what' properties.

Integration of heterogeneous data for classification in hyperspectral satellite imagery

NASA Astrophysics Data System (ADS)

Benedetto, J.; Czaja, W.; Dobrosotskaya, J.; Doster, T.; Duke, K.; Gillis, D.

2012-06-01

As new remote sensing modalities emerge, it becomes increasingly important to nd more suitable algorithms for fusion and integration of dierent data types for the purposes of target/anomaly detection and classication. Typical techniques that deal with this problem are based on performing detection/classication/segmentation separately in chosen modalities, and then integrating the resulting outcomes into a more complete picture. In this paper we provide a broad analysis of a new approach, based on creating fused representations of the multi- modal data, which then can be subjected to analysis by means of the state-of-the-art classiers or detectors. In this scenario we shall consider the hyperspectral imagery combined with spatial information. Our approach involves machine learning techniques based on analysis of joint data-dependent graphs and their associated diusion kernels. Then, the signicant eigenvectors of the derived fused graph Laplace operator form the new representation, which provides integrated features from the heterogeneous input data. We compare these fused approaches with analysis of integrated outputs of spatial and spectral graph methods.

Highly sensitive biochemical sensor utilizing Bragg grating in submicron Si/SiO2 waveguides

NASA Astrophysics Data System (ADS)

Tripathi, Saurabh Mani; Kumar, Arun; Meunier, Jean-Pierre; Marin, Emmanuel

2009-05-01

We present a novel highly sensitive biochemical sensor based on a Bragg grating written in the cladding region of a submicron planar Si/SiO2 waveguide. Owing to the high refractive index contrast at the Si/SiO2 boundary the TM modal power is relatively high in low refractive index sensing region, leading to higher sensitivity in this configuration [1]. Waveguide parameters have been optimized to obtain maximum modal power in the sensing region (PSe) and an optimum core width corresponding to maximum sensitivity is found to exist while operating in TM mode configuration, as has been shown in Fig. 1. It has been found that operating in TM mode configuration at optimum core width the structure exhibits extremely high sensitivity, ~ 5×10-6 RIU - 1.35×10-6 RIU for the ambient refractive indices between 1.33 - 1.63. Such high sensitivities are typically attainable for Surface Plasmon Polariton (SPP) based biosensors and is much higher than any non SPP based sensors. Being free from any metallic layer or bulky prism the structure is easy to realize. Owing to its simple structure and small dimensions the proposed sensor can be integrated with planar lightwave circuits and could be used in handy lab-on-a-chip devices. The device may find application in highly sensitive biological/chemical sensing areas in civil and defense sectors where analyzing the samples at the point of need is required rather than sending it to some centralized laboratory.

Blind Source Separation for Unimodal and Multimodal Brain Networks: A Unifying Framework for Subspace Modeling

PubMed Central

Silva, Rogers F.; Plis, Sergey M.; Sui, Jing; Pattichis, Marios S.; Adalı, Tülay; Calhoun, Vince D.

2016-01-01

In the past decade, numerous advances in the study of the human brain were fostered by successful applications of blind source separation (BSS) methods to a wide range of imaging modalities. The main focus has been on extracting “networks” represented as the underlying latent sources. While the broad success in learning latent representations from multiple datasets has promoted the wide presence of BSS in modern neuroscience, it also introduced a wide variety of objective functions, underlying graphical structures, and parameter constraints for each method. Such diversity, combined with a host of datatype-specific know-how, can cause a sense of disorder and confusion, hampering a practitioner’s judgment and impeding further development. We organize the diverse landscape of BSS models by exposing its key features and combining them to establish a novel unifying view of the area. In the process, we unveil important connections among models according to their properties and subspace structures. Consequently, a high-level descriptive structure is exposed, ultimately helping practitioners select the right model for their applications. Equipped with that knowledge, we review the current state of BSS applications to neuroimaging. The gained insight into model connections elicits a broader sense of generalization, highlighting several directions for model development. In light of that, we discuss emerging multi-dataset multidimensional (MDM) models and summarize their benefits for the study of the healthy brain and disease-related changes. PMID:28461840

Sensory Substitution and Multimodal Mental Imagery.

PubMed

Nanay, Bence

2017-09-01

Many philosophers use findings about sensory substitution devices in the grand debate about how we should individuate the senses. The big question is this: Is "vision" assisted by (tactile) sensory substitution really vision? Or is it tactile perception? Or some sui generis novel form of perception? My claim is that sensory substitution assisted "vision" is neither vision nor tactile perception, because it is not perception at all. It is mental imagery: visual mental imagery triggered by tactile sensory stimulation. But it is a special form of mental imagery that is triggered by corresponding sensory stimulation in a different sense modality, which I call "multimodal mental imagery."

Cos-Gaussian modal field of a terahertz rectangular metal waveguide filled with multiple slices of dielectric

NASA Astrophysics Data System (ADS)

Wang, Kai; Cao, Qing; Zhang, Huifang; Shen, Pengcheng; Xing, Lujing

2018-06-01

Based on the TE01 mode of a rectangular metal waveguide and the Gaussian mode of a fiber, we propose the cos-Gaussian mode of a terahertz rectangular metal waveguide filled with multiple slices of dielectric. First, we consider a rectangular metal waveguide filled with an ideal graded-index dielectric along one direction. Furthermore, we replace the graded-index dielectric with multiple slices of dielectric according to the effective medium theory. The modal field, the effective index, and the coupling efficiency of this waveguide are investigated. It is found that the approximately linearly polarized electric field is Gaussian along one dimensionality and cosine along the other one. In addition, the low loss and high coupling efficiency with a Gaussian beam can be acquired at 0.9 THz. By optimization, the coupling efficiency could reach 88.5%.

Modal smoothing for analysis of room reflections measured with spherical microphone and loudspeaker arrays.

PubMed

Morgenstern, Hai; Rafaely, Boaz

2018-02-01

Spatial analysis of room acoustics is an ongoing research topic. Microphone arrays have been employed for spatial analyses with an important objective being the estimation of the direction-of-arrival (DOA) of direct sound and early room reflections using room impulse responses (RIRs). An optimal method for DOA estimation is the multiple signal classification algorithm. When RIRs are considered, this method typically fails due to the correlation of room reflections, which leads to rank deficiency of the cross-spectrum matrix. Preprocessing methods for rank restoration, which may involve averaging over frequency, for example, have been proposed exclusively for spherical arrays. However, these methods fail in the case of reflections with equal time delays, which may arise in practice and could be of interest. In this paper, a method is proposed for systems that combine a spherical microphone array and a spherical loudspeaker array, referred to as multiple-input multiple-output systems. This method, referred to as modal smoothing, exploits the additional spatial diversity for rank restoration and succeeds where previous methods fail, as demonstrated in a simulation study. Finally, combining modal smoothing with a preprocessing method is proposed in order to increase the number of DOAs that can be estimated using low-order spherical loudspeaker arrays.

Analysing and correcting the differences between multi-source and multi-scale spatial remote sensing observations.

PubMed

Dong, Yingying; Luo, Ruisen; Feng, Haikuan; Wang, Jihua; Zhao, Jinling; Zhu, Yining; Yang, Guijun

2014-01-01

Differences exist among analysis results of agriculture monitoring and crop production based on remote sensing observations, which are obtained at different spatial scales from multiple remote sensors in same time period, and processed by same algorithms, models or methods. These differences can be mainly quantitatively described from three aspects, i.e. multiple remote sensing observations, crop parameters estimation models, and spatial scale effects of surface parameters. Our research proposed a new method to analyse and correct the differences between multi-source and multi-scale spatial remote sensing surface reflectance datasets, aiming to provide references for further studies in agricultural application with multiple remotely sensed observations from different sources. The new method was constructed on the basis of physical and mathematical properties of multi-source and multi-scale reflectance datasets. Theories of statistics were involved to extract statistical characteristics of multiple surface reflectance datasets, and further quantitatively analyse spatial variations of these characteristics at multiple spatial scales. Then, taking the surface reflectance at small spatial scale as the baseline data, theories of Gaussian distribution were selected for multiple surface reflectance datasets correction based on the above obtained physical characteristics and mathematical distribution properties, and their spatial variations. This proposed method was verified by two sets of multiple satellite images, which were obtained in two experimental fields located in Inner Mongolia and Beijing, China with different degrees of homogeneity of underlying surfaces. Experimental results indicate that differences of surface reflectance datasets at multiple spatial scales could be effectively corrected over non-homogeneous underlying surfaces, which provide database for further multi-source and multi-scale crop growth monitoring and yield prediction, and their corresponding consistency analysis evaluation.

Analysing and Correcting the Differences between Multi-Source and Multi-Scale Spatial Remote Sensing Observations

PubMed Central

Dong, Yingying; Luo, Ruisen; Feng, Haikuan; Wang, Jihua; Zhao, Jinling; Zhu, Yining; Yang, Guijun

2014-01-01

Differences exist among analysis results of agriculture monitoring and crop production based on remote sensing observations, which are obtained at different spatial scales from multiple remote sensors in same time period, and processed by same algorithms, models or methods. These differences can be mainly quantitatively described from three aspects, i.e. multiple remote sensing observations, crop parameters estimation models, and spatial scale effects of surface parameters. Our research proposed a new method to analyse and correct the differences between multi-source and multi-scale spatial remote sensing surface reflectance datasets, aiming to provide references for further studies in agricultural application with multiple remotely sensed observations from different sources. The new method was constructed on the basis of physical and mathematical properties of multi-source and multi-scale reflectance datasets. Theories of statistics were involved to extract statistical characteristics of multiple surface reflectance datasets, and further quantitatively analyse spatial variations of these characteristics at multiple spatial scales. Then, taking the surface reflectance at small spatial scale as the baseline data, theories of Gaussian distribution were selected for multiple surface reflectance datasets correction based on the above obtained physical characteristics and mathematical distribution properties, and their spatial variations. This proposed method was verified by two sets of multiple satellite images, which were obtained in two experimental fields located in Inner Mongolia and Beijing, China with different degrees of homogeneity of underlying surfaces. Experimental results indicate that differences of surface reflectance datasets at multiple spatial scales could be effectively corrected over non-homogeneous underlying surfaces, which provide database for further multi-source and multi-scale crop growth monitoring and yield prediction, and their corresponding consistency analysis evaluation. PMID:25405760

Highly Sensitive and Wide-Dynamic-Range Multichannel Optical-Fiber pH Sensor Based on PWM Technique.

PubMed

Khan, Md Rajibur Rahaman; Kang, Shin-Won

2016-11-09

In this study, we propose a highly sensitive multichannel pH sensor that is based on an optical-fiber pulse width modulation (PWM) technique. According to the optical-fiber PWM method, the received sensing signal's pulse width changes when the optical-fiber pH sensing-element of the array comes into contact with pH buffer solutions. The proposed optical-fiber PWM pH-sensing system offers a linear sensing response over a wide range of pH values from 2 to 12, with a high pH-sensing ability. The sensitivity of the proposed pH sensor is 0.46 µs/pH, and the correlation coefficient R² is approximately 0.997. Additional advantages of the proposed optical-fiber PWM pH sensor include a short/fast response-time of about 8 s, good reproducibility properties with a relative standard deviation (RSD) of about 0.019, easy fabrication, low cost, small size, reusability of the optical-fiber sensing-element, and the capability of remote sensing. Finally, the performance of the proposed PWM pH sensor was compared with that of potentiometric, optical-fiber modal interferometer, and optical-fiber Fabry-Perot interferometer pH sensors with respect to dynamic range width, linearity as well as response and recovery times. We observed that the proposed sensing systems have better sensing abilities than the above-mentioned pH sensors.

Highly Sensitive and Wide-Dynamic-Range Multichannel Optical-Fiber pH Sensor Based on PWM Technique

PubMed Central

Khan, Md. Rajibur Rahaman; Kang, Shin-Won

2016-01-01

In this study, we propose a highly sensitive multichannel pH sensor that is based on an optical-fiber pulse width modulation (PWM) technique. According to the optical-fiber PWM method, the received sensing signal’s pulse width changes when the optical-fiber pH sensing-element of the array comes into contact with pH buffer solutions. The proposed optical-fiber PWM pH-sensing system offers a linear sensing response over a wide range of pH values from 2 to 12, with a high pH-sensing ability. The sensitivity of the proposed pH sensor is 0.46 µs/pH, and the correlation coefficient R2 is approximately 0.997. Additional advantages of the proposed optical-fiber PWM pH sensor include a short/fast response-time of about 8 s, good reproducibility properties with a relative standard deviation (RSD) of about 0.019, easy fabrication, low cost, small size, reusability of the optical-fiber sensing-element, and the capability of remote sensing. Finally, the performance of the proposed PWM pH sensor was compared with that of potentiometric, optical-fiber modal interferometer, and optical-fiber Fabry–Perot interferometer pH sensors with respect to dynamic range width, linearity as well as response and recovery times. We observed that the proposed sensing systems have better sensing abilities than the above-mentioned pH sensors. PMID:27834865

Validity of an ankle joint motion and position sense measurement system and its application in healthy subjects and patients with ankle sprain.

PubMed

Lin, Chueh-Ho; Chiang, Shang-Lin; Lu, Liang-Hsuan; Wei, Shun-Hwa; Sung, Wen-Hsu

2016-07-01

Ankle motion and proprioception in multiple axis movements are crucial for daily activities. However, few studies have developed and used a multiple axis system for measuring ankle motion and proprioception. This study was designed to validate a novel ankle haptic interface system that measures the ankle range of motion (ROM) and joint position sense in multiple plane movements, investigating the proprioception deficits during joint position sense tasks for patients with ankle instability. Eleven healthy adults (mean ± standard deviation; age, 24.7 ± 1.9 years) and thirteen patients with ankle instability were recruited in this study. All subjects were asked to perform tests to evaluate the validity of the ankle ROM measurements and underwent tests for validating the joint position sense measurements conducted during multiple axis movements of the ankle joint. Pearson correlation was used for validating the angular position measurements obtained using the developed system; the independent t test was used to investigate the differences in joint position sense task performance for people with or without ankle instability. The ROM measurements of the device were linearly correlated with the criterion standards (r = 0.99). The ankle instability and healthy groups were significantly different in direction, absolute, and variable errors of plantar flexion, dorsiflexion, inversion, and eversion (p < 0.05). The results demonstrate that the novel ankle joint motion and position sense measurement system is valid and can be used for measuring the ankle ROM and joint position sense in multiple planes and indicate proprioception deficits for people with ankle instability. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Phase retrieval in generalized optical interferometry systems.

PubMed

Farriss, Wesley E; Fienup, James R; Malhotra, Tanya; Vamivakas, A Nick

2018-02-05

Modal analysis of an optical field via generalized interferometry (GI) is a novel technique that treats said field as a linear superposition of transverse modes and recovers the amplitudes of modal weighting coefficients. We use phase retrieval by nonlinear optimization to recover the phase of these modal weighting coefficients. Information diversity increases the robustness of the algorithm by better constraining the solution. Additionally, multiple sets of random starting phase values assist the algorithm in overcoming local minima. The algorithm was able to recover nearly all coefficient phases for simulated fields consisting of up to 21 superpositioned Hermite Gaussian modes from simulated data and proved to be resilient to shot noise.

Equalizer tap length requirement for mode group delay-compensated fiber link with weakly random mode coupling.

PubMed

Bai, Neng; Li, Guifang

2014-02-24

The equalizer tap length requirement is investigated analytically and numerically for differential modal group delay (DMGD) compensated fiber link with weakly random mode coupling. Each span of the DMGD compensated link comprises multiple pairs of fibers which have opposite signs of DMGD. The result reveals that under weak random mode coupling, the required tap length of the equalizer is proportional to modal group delay of a single DMGD compensated pair, instead of the total modal group delay (MGD) of the entire link. By using small DMGD compensation step sizes, the required tap length (RTL) can be potentially reduced by 2 orders of magnitude.

Sensing of Substrate Vibrations in the Adult Cicada Okanagana rimosa (Hemiptera: Cicadidae).

PubMed

Alt, Joscha A; Lakes-Harlan, Reinhard

2018-05-01

Detection of substrate vibrations is an evolutionarily old sensory modality and is important for predator detection as well as for intraspecific communication. In insects, substrate vibrations are detected mainly by scolopidial (chordotonal) sense organs found at different sites in the legs. Among these sense organs, the tibial subgenual organ (SGO) is one of the most sensitive sensors. The neuroanatomy and physiology of vibratory sense organs of cicadas is not well known. Here, we investigated the leg nerve by neuronal tracing and summed nerve recordings. Tracing with Neurobiotin revealed that the cicada Okanagana rimosa (Say) (Hemiptera: Cicadidae) has a femoral chordotonal organ with about 20 sensory cells and a tibial SGO with two sensory cells. Recordings from the leg nerve show that the vibrational response is broadly tuned with a threshold of about 1 m/s2 and a minimum latency of about 6 ms. The vibratory sense of cicadas might be used in predator avoidance and intraspecific communication, although no tuning to the peak frequency of the calling song (9 kHz) could be found.

DICOM: key concepts--part II.

PubMed

Kabachinski, Jeff

2005-01-01

The objective of these two installments of IT World was to give a general overview of DICOM and to take a look at different parts of the standard to get a sense of its main themes. We found that the standard provides a common reference for all developers but does not impose a single type of implementation. This allows for innovation. The standard is also built for flexibility, able to adapt to new modalities that have a need to communicate. The speedy acceptance of DICOM by the medical imaging industry is opening new possibilities for healthcare organizations to increase the quality while decreasing the cost of patient care. All of the DICOM networked supporting medical equipment as well as the organization's computer systems made by multiple original equipment manufacturers and located at one site or many sites can communicate by means of DICOM. This gives us the opportunity for medical images to be captured and communicated quicker. The result enables physicians to make diagnoses and treatment decisions sooner. It's all good stuff and even more reason why we should endeavor to understand the basics of DICOM. DICOM is here to stay!

Through-barrier electromagnetic imaging with an atomic magnetometer.

PubMed

Deans, Cameron; Marmugi, Luca; Renzoni, Ferruccio

2017-07-24

We demonstrate the penetration of thick metallic and ferromagnetic barriers for imaging of conductive targets underneath. Our system is based on an 85 Rb radio-frequency atomic magnetometer operating in electromagnetic induction imaging modality in an unshielded environment. Detrimental effects, including unpredictable magnetic signatures from ferromagnetic screens and variations in the magnetic background, are automatically compensated by active compensation coils controlled by servo loops. We exploit the tunability and low-frequency sensitivity of the atomic magnetometer to directly image multiple conductive targets concealed by a 2.5 mm ferromagnetic steel shield and/or a 2.0 mm aluminium shield, in a single scan. The performance of the atomic magnetometer allows imaging without any prior knowledge of the barriers or the targets, and without the need of background subtraction. A dedicated edge detection algorithm allows automatic estimation of the targets' size within 3.3 mm and of their position within 2.4 mm. Our results prove the feasibility of a compact, sensitive and automated sensing platform for imaging of concealed objects in a range of applications, from security screening to search and rescue.

Signal and image processing algorithm performance in a virtual and elastic computing environment

NASA Astrophysics Data System (ADS)

Bennett, Kelly W.; Robertson, James

2013-05-01

The U.S. Army Research Laboratory (ARL) supports the development of classification, detection, tracking, and localization algorithms using multiple sensing modalities including acoustic, seismic, E-field, magnetic field, PIR, and visual and IR imaging. Multimodal sensors collect large amounts of data in support of algorithm development. The resulting large amount of data, and their associated high-performance computing needs, increases and challenges existing computing infrastructures. Purchasing computer power as a commodity using a Cloud service offers low-cost, pay-as-you-go pricing models, scalability, and elasticity that may provide solutions to develop and optimize algorithms without having to procure additional hardware and resources. This paper provides a detailed look at using a commercial cloud service provider, such as Amazon Web Services (AWS), to develop and deploy simple signal and image processing algorithms in a cloud and run the algorithms on a large set of data archived in the ARL Multimodal Signatures Database (MMSDB). Analytical results will provide performance comparisons with existing infrastructure. A discussion on using cloud computing with government data will discuss best security practices that exist within cloud services, such as AWS.

Progress and opportunities in EELS and EDS tomography.

PubMed

Collins, Sean M; Midgley, Paul A

2017-09-01

Electron tomography using energy loss and X-ray spectroscopy in the electron microscope continues to develop in rapidly evolving and diverse directions, enabling new insight into the three-dimensional chemistry and physics of nanoscale volumes. Progress has been made recently in improving reconstructions from EELS and EDS signals in electron tomography by applying compressed sensing methods, characterizing new detector technologies in detail, deriving improved models of signal generation, and exploring machine learning approaches to signal processing. These disparate threads can be brought together in a cohesive framework in terms of a model-based approach to analytical electron tomography. Models incorporate information on signal generation and detection as well as prior knowledge of structures in the spectrum image data. Many recent examples illustrate the flexibility of this approach and its feasibility for addressing challenges in non-linear or limited signals in EELS and EDS tomography. Further work in combining multiple imaging and spectroscopy modalities, developing synergistic data acquisition, processing, and reconstruction approaches, and improving the precision of quantitative spectroscopic tomography will expand the frontiers of spatial resolution, dose limits, and maximal information recovery. Copyright © 2017 Elsevier B.V. All rights reserved.

Integrating Information from Different Senses in the Auditory Cortex

PubMed Central

King, Andrew J.; Walker, Kerry M.M.

2015-01-01

Multisensory integration was once thought to be the domain of brain areas high in the cortical hierarchy, with early sensory cortical fields devoted to unisensory processing of inputs from their given set of sensory receptors. More recently, a wealth of evidence documenting visual and somatosensory responses in auditory cortex, even as early as the primary fields, has changed this view of cortical processing. These multisensory inputs may serve to enhance responses to sounds that are accompanied by other sensory cues, effectively making them easier to hear, but may also act more selectively to shape the receptive field properties of auditory cortical neurons to the location or identity of these events. We discuss the new, converging evidence that multiplexing of neural signals may play a key role in informatively encoding and integrating signals in auditory cortex across multiple sensory modalities. We highlight some of the many open research questions that exist about the neural mechanisms that give rise to multisensory integration in auditory cortex, which should be addressed in future experimental and theoretical studies. PMID:22798035

Stokes parameter studies of spontaneous emission from chiral nematic liquid crystals as a one-dimensional photonic stopband crystal: experiment and theory.

PubMed

Woon, Kai L; O'Neill, Mary; Richards, Gary J; Aldred, Matthew P; Kelly, Stephen M

2005-04-01

The helical structure of uniformly aligned chiral nematic liquid crystals results in a photonic stopband for only one sense of circular polarization. The spectroscopic Stokes polarimeter is used to analyze spontaneous emission in the stopband. Highly polarized photoluminescence is found and the polarization properties vary with the excitation wavelength. Spontaneous emission is enhanced at the stopband edge and this Purcell effect is greater on excitation at wavelengths where the absorption coefficient is low. This is interpreted as greater overlap between the excited molecules and the electrical modal field of the resonant modes at the stopband edge. Photoluminescence detected from the excitation face of the liquid crystal cell is less polarized because of photon tunneling. Fermi's golden rule in conjunction with Stokes vectors is used to model the polarization of emission taking multiple reflections at the interfaces of the cell into account. The discrepancy between the experiment and the theoretical model is interpreted as direct experimental evidence that virtual photons, which originate from zero point fluctuations of quantum space, are randomly polarized.

Audiovisual synchrony enhances BOLD responses in a brain network including multisensory STS while also enhancing target-detection performance for both modalities

PubMed Central

Marchant, Jennifer L; Ruff, Christian C; Driver, Jon

2012-01-01

The brain seeks to combine related inputs from different senses (e.g., hearing and vision), via multisensory integration. Temporal information can indicate whether stimuli in different senses are related or not. A recent human fMRI study (Noesselt et al. [2007]: J Neurosci 27:11431–11441) used auditory and visual trains of beeps and flashes with erratic timing, manipulating whether auditory and visual trains were synchronous or unrelated in temporal pattern. A region of superior temporal sulcus (STS) showed higher BOLD signal for the synchronous condition. But this could not be related to performance, and it remained unclear if the erratic, unpredictable nature of the stimulus trains was important. Here we compared synchronous audiovisual trains to asynchronous trains, while using a behavioral task requiring detection of higher-intensity target events in either modality. We further varied whether the stimulus trains had predictable temporal pattern or not. Synchrony (versus lag) between auditory and visual trains enhanced behavioral sensitivity (d') to intensity targets in either modality, regardless of predictable versus unpredictable patterning. The analogous contrast in fMRI revealed BOLD increases in several brain areas, including the left STS region reported by Noesselt et al. [2007: J Neurosci 27:11431–11441]. The synchrony effect on BOLD here correlated with the subject-by-subject impact on performance. Predictability of temporal pattern did not affect target detection performance or STS activity, but did lead to an interaction with audiovisual synchrony for BOLD in inferior parietal cortex. PMID:21953980

Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification

NASA Astrophysics Data System (ADS)

Yang, Yongchao; Dorn, Charles; Mancini, Tyler; Talken, Zachary; Kenyon, Garrett; Farrar, Charles; Mascareñas, David

2017-02-01

Experimental or operational modal analysis traditionally requires physically-attached wired or wireless sensors for vibration measurement of structures. This instrumentation can result in mass-loading on lightweight structures, and is costly and time-consuming to install and maintain on large civil structures, especially for long-term applications (e.g., structural health monitoring) that require significant maintenance for cabling (wired sensors) or periodic replacement of the energy supply (wireless sensors). Moreover, these sensors are typically placed at a limited number of discrete locations, providing low spatial sensing resolution that is hardly sufficient for modal-based damage localization, or model correlation and updating for larger-scale structures. Non-contact measurement methods such as scanning laser vibrometers provide high-resolution sensing capacity without the mass-loading effect; however, they make sequential measurements that require considerable acquisition time. As an alternative non-contact method, digital video cameras are relatively low-cost, agile, and provide high spatial resolution, simultaneous, measurements. Combined with vision based algorithms (e.g., image correlation, optical flow), video camera based measurements have been successfully used for vibration measurements and subsequent modal analysis, based on techniques such as the digital image correlation (DIC) and the point-tracking. However, they typically require speckle pattern or high-contrast markers to be placed on the surface of structures, which poses challenges when the measurement area is large or inaccessible. This work explores advanced computer vision and video processing algorithms to develop a novel video measurement and vision-based operational (output-only) modal analysis method that alleviate the need of structural surface preparation associated with existing vision-based methods and can be implemented in a relatively efficient and autonomous manner with little user supervision and calibration. First a multi-scale image processing method is applied on the frames of the video of a vibrating structure to extract the local pixel phases that encode local structural vibration, establishing a full-field spatiotemporal motion matrix. Then a high-spatial dimensional, yet low-modal-dimensional, over-complete model is used to represent the extracted full-field motion matrix using modal superposition, which is physically connected and manipulated by a family of unsupervised learning models and techniques, respectively. Thus, the proposed method is able to blindly extract modal frequencies, damping ratios, and full-field (as many points as the pixel number of the video frame) mode shapes from line of sight video measurements of the structure. The method is validated by laboratory experiments on a bench-scale building structure and a cantilever beam. Its ability for output (video measurements)-only identification and visualization of the weakly-excited mode is demonstrated and several issues with its implementation are discussed.

Implementation of Multiple Host Nodes in Wireless Sensing Node Network System for Landslide Monitoring

NASA Astrophysics Data System (ADS)

Abas, Faizulsalihin bin; Takayama, Shigeru

2015-02-01

This paper proposes multiple host nodes in Wireless Sensing Node Network System (WSNNS) for landslide monitoring. As landslide disasters damage monitoring system easily, one major demand in landslide monitoring is the flexibility and robustness of the system to evaluate the current situation in the monitored area. For various reasons WSNNS can provide an important contribution to reach that aim. In this system, acceleration sensors and GPS are deployed in sensing nodes. Location information by GPS, enable the system to estimate network topology and enable the system to perceive the location in emergency by monitoring the node mode. Acceleration sensors deployment, capacitate this system to detect slow mass movement that can lead to landslide occurrence. Once deployed, sensing nodes self-organize into an autonomous wireless ad hoc network. The measurement parameter data from sensing nodes is transmitted to Host System via host node and "Cloud" System. The implementation of multiple host nodes in Local Sensing Node Network System (LSNNS), improve risk- management of the WSNNS for real-time monitoring of landslide disaster.

The production of digital and printed resources from multiple modalities using visualization and three-dimensional printing techniques.

PubMed

Shui, Wuyang; Zhou, Mingquan; Chen, Shi; Pan, Zhouxian; Deng, Qingqiong; Yao, Yong; Pan, Hui; He, Taiping; Wang, Xingce

2017-01-01

Virtual digital resources and printed models have become indispensable tools for medical training and surgical planning. Nevertheless, printed models of soft tissue organs are still challenging to reproduce. This study adopts open source packages and a low-cost desktop 3D printer to convert multiple modalities of medical images to digital resources (volume rendering images and digital models) and lifelike printed models, which are useful to enhance our understanding of the geometric structure and complex spatial nature of anatomical organs. Neuroimaging technologies such as CT, CTA, MRI, and TOF-MRA collect serial medical images. The procedures for producing digital resources can be divided into volume rendering and medical image reconstruction. To verify the accuracy of reconstruction, this study presents qualitative and quantitative assessments. Subsequently, digital models are archived as stereolithography format files and imported to the bundled software of the 3D printer. The printed models are produced using polylactide filament materials. We have successfully converted multiple modalities of medical images to digital resources and printed models for both hard organs (cranial base and tooth) and soft tissue organs (brain, blood vessels of the brain, the heart chambers and vessel lumen, and pituitary tumor). Multiple digital resources and printed models were provided to illustrate the anatomical relationship between organs and complicated surrounding structures. Three-dimensional printing (3DP) is a powerful tool to produce lifelike and tangible models. We present an available and cost-effective method for producing both digital resources and printed models. The choice of modality in medical images and the processing approach is important when reproducing soft tissue organs models. The accuracy of the printed model is determined by the quality of organ models and 3DP. With the ongoing improvement of printing techniques and the variety of materials available, 3DP will become an indispensable tool in medical training and surgical planning.

Dancing with Gravity—Why the Sense of Balance Is (the) Fundamental

PubMed Central

2018-01-01

The sense of balance, which is usually barely noticeable in the background of each of our movements, only becomes manifest in its function during intense stimulation or in the event of illness, which may quite literally turn your world upside down. While it is true that balance is becoming a bigger issue, that is mainly because people are losing it more frequently. So why is balance not as commonly talked about in psychology, medicine or the arts as the other five traditional senses? This is partly due to its unusual multi-modal nature, whereby three sensory inputs are coordinated and integrated by the central nervous system. Without it, however, we might not have much use for the other senses. The sense of balance encompasses the bodily experience in its entirety. Not only do we act with the body, we may also think and feel through it and with it. Bodily states are not simply effects of cognition; they cause it as well. Equilibrioception is an essential sense and it is interconnected with a wide range of other areas, including cognition, perception, embodiment, the autonomic nervous system, aesthetics, the arts, and education. PMID:29303967

Dancing with Gravity-Why the Sense of Balance Is (the) Fundamental.

PubMed

Fuchs, Dominik

2018-01-05

The sense of balance, which is usually barely noticeable in the background of each of our movements, only becomes manifest in its function during intense stimulation or in the event of illness, which may quite literally turn your world upside down. While it is true that balance is becoming a bigger issue, that is mainly because people are losing it more frequently. So why is balance not as commonly talked about in psychology, medicine or the arts as the other five traditional senses? This is partly due to its unusual multi-modal nature, whereby three sensory inputs are coordinated and integrated by the central nervous system. Without it, however, we might not have much use for the other senses. The sense of balance encompasses the bodily experience in its entirety. Not only do we act with the body, we may also think and feel through it and with it. Bodily states are not simply effects of cognition; they cause it as well. Equilibrioception is an essential sense and it is interconnected with a wide range of other areas, including cognition, perception, embodiment, the autonomic nervous system, aesthetics, the arts, and education.

Multi-Modalities Sensor Science

DTIC Science & Technology

2015-02-28

enhanced multi-mode sensor science. bio -sensing, cross-discipling, multi-physics, nano-technology sailing He +46-8790 8465 1 Final Report for SOARD Project...spectroscopy, nano-technology, biophotonics and multi-physics modeling to produce adaptable bio -nanostructure enhanced multi-mode sensor science. 1...adaptable bio -nanostructure enhanced multi-mode sensor science. The accomplishments includes 1) A General Method for Designing a Radome to Enhance

Fusion and Sense Making of Heterogeneous Sensor Network and Other Sources

DTIC Science & Technology

2017-03-16

multimodal fusion framework that uses both training data and web resources for scene classification, the experimental results on the benchmark datasets...show that the proposed text-aided scene classification framework could significantly improve classification performance. Experimental results also show...human whose adaptability is achieved by reliability- dependent weighting of different sensory modalities. Experimental results show that the proposed

Eye movement analysis for activity recognition using electrooculography.

PubMed

Bulling, Andreas; Ward, Jamie A; Gellersen, Hans; Tröster, Gerhard

2011-04-01

In this work, we investigate eye movement analysis as a new sensing modality for activity recognition. Eye movement data were recorded using an electrooculography (EOG) system. We first describe and evaluate algorithms for detecting three eye movement characteristics from EOG signals-saccades, fixations, and blinks-and propose a method for assessing repetitive patterns of eye movements. We then devise 90 different features based on these characteristics and select a subset of them using minimum redundancy maximum relevance (mRMR) feature selection. We validate the method using an eight participant study in an office environment using an example set of five activity classes: copying a text, reading a printed paper, taking handwritten notes, watching a video, and browsing the Web. We also include periods with no specific activity (the NULL class). Using a support vector machine (SVM) classifier and person-independent (leave-one-person-out) training, we obtain an average precision of 76.1 percent and recall of 70.5 percent over all classes and participants. The work demonstrates the promise of eye-based activity recognition (EAR) and opens up discussion on the wider applicability of EAR to other activities that are difficult, or even impossible, to detect using common sensing modalities.

Listening to membrane potential: photoacoustic voltage-sensitive dye recording.

PubMed

Zhang, Haichong K; Yan, Ping; Kang, Jeeun; Abou, Diane S; Le, Hanh N D; Jha, Abhinav K; Thorek, Daniel L J; Kang, Jin U; Rahmim, Arman; Wong, Dean F; Boctor, Emad M; Loew, Leslie M

2017-04-01

Voltage-sensitive dyes (VSDs) are designed to monitor membrane potential by detecting fluorescence changes in response to neuronal or muscle electrical activity. However, fluorescence imaging is limited by depth of penetration and high scattering losses, which leads to low sensitivity in vivo systems for external detection. By contrast, photoacoustic (PA) imaging, an emerging modality, is capable of deep tissue, noninvasive imaging by combining near-infrared light excitation and ultrasound detection. Here, we show that voltage-dependent quenching of dye fluorescence leads to a reciprocal enhancement of PA intensity. We synthesized a near-infrared photoacoustic VSD (PA-VSD), whose PA intensity change is sensitive to membrane potential. In the polarized state, this cyanine-based probe enhances PA intensity while decreasing fluorescence output in a lipid vesicle membrane model. A theoretical model accounts for how the experimental PA intensity change depends on fluorescence and absorbance properties of the dye. These results not only demonstrate PA voltage sensing but also emphasize the interplay of both fluorescence and absorbance properties in the design of optimized PA probes. Together, our results demonstrate PA sensing as a potential new modality for recording and external imaging of electrophysiological and neurochemical events in the brain.

Listening to membrane potential: photoacoustic voltage-sensitive dye recording

NASA Astrophysics Data System (ADS)

Zhang, Haichong K.; Yan, Ping; Kang, Jeeun; Abou, Diane S.; Le, Hanh N. D.; Jha, Abhinav K.; Thorek, Daniel L. J.; Kang, Jin U.; Rahmim, Arman; Wong, Dean F.; Boctor, Emad M.; Loew, Leslie M.

2017-04-01

Voltage-sensitive dyes (VSDs) are designed to monitor membrane potential by detecting fluorescence changes in response to neuronal or muscle electrical activity. However, fluorescence imaging is limited by depth of penetration and high scattering losses, which leads to low sensitivity in vivo systems for external detection. By contrast, photoacoustic (PA) imaging, an emerging modality, is capable of deep tissue, noninvasive imaging by combining near-infrared light excitation and ultrasound detection. Here, we show that voltage-dependent quenching of dye fluorescence leads to a reciprocal enhancement of PA intensity. We synthesized a near-infrared photoacoustic VSD (PA-VSD), whose PA intensity change is sensitive to membrane potential. In the polarized state, this cyanine-based probe enhances PA intensity while decreasing fluorescence output in a lipid vesicle membrane model. A theoretical model accounts for how the experimental PA intensity change depends on fluorescence and absorbance properties of the dye. These results not only demonstrate PA voltage sensing but also emphasize the interplay of both fluorescence and absorbance properties in the design of optimized PA probes. Together, our results demonstrate PA sensing as a potential new modality for recording and external imaging of electrophysiological and neurochemical events in the brain.

Radar research at the University of Kansas

NASA Astrophysics Data System (ADS)

Blunt, Shannon D.; Allen, Christopher; Arnold, Emily; Hale, Richard; Hui, Rongqing; Keshmiri, Shahriar; Leuschen, Carlton; Li, Jilu; Paden, John; Rodriguez-Morales, Fernando; Salandrino, Alessandro; Stiles, James

2017-05-01

Radar research has been synonymous with the University of Kansas (KU) for over half a century. As part of this special session organized to highlight significant radar programs in academia, this paper surveys recent and ongoing work at KU. This work encompasses a wide breadth of sensing applications including the remote sensing of ice sheets, autonomous navigation methods for unmanned aerial vehicles (UAVs), novel laser radar capabilities, detection of highenergy cosmic rays using bistatic radar, different forms of waveform diversity such as MIMO radar and pulse agility, and various radar-embedded communication methods. The results of these efforts impact our understanding of the changing nature of the environment, address the proliferation of unmanned systems in the US airspace, realize new sensing modalities enabled by the joint consideration of electromagnetics and signal processing, and greater facilitate radar operation in an increasingly congested and contested spectrum.

Neural practice effect during cross-modal selective attention: Supra-modal and modality-specific effects.

PubMed

Xia, Jing; Zhang, Wei; Jiang, Yizhou; Li, You; Chen, Qi

2018-05-16

Practice and experiences gradually shape the central nervous system, from the synaptic level to large-scale neural networks. In natural multisensory environment, even when inundated by streams of information from multiple sensory modalities, our brain does not give equal weight to different modalities. Rather, visual information more frequently receives preferential processing and eventually dominates consciousness and behavior, i.e., visual dominance. It remains unknown, however, the supra-modal and modality-specific practice effect during cross-modal selective attention, and moreover whether the practice effect shows similar modality preferences as the visual dominance effect in the multisensory environment. To answer the above two questions, we adopted a cross-modal selective attention paradigm in conjunction with the hybrid fMRI design. Behaviorally, visual performance significantly improved while auditory performance remained constant with practice, indicating that visual attention more flexibly adapted behavior with practice than auditory attention. At the neural level, the practice effect was associated with decreasing neural activity in the frontoparietal executive network and increasing activity in the default mode network, which occurred independently of the modality attended, i.e., the supra-modal mechanisms. On the other hand, functional decoupling between the auditory and the visual system was observed with the progress of practice, which varied as a function of the modality attended. The auditory system was functionally decoupled with both the dorsal and ventral visual stream during auditory attention while was decoupled only with the ventral visual stream during visual attention. To efficiently suppress the irrelevant visual information with practice, auditory attention needs to additionally decouple the auditory system from the dorsal visual stream. The modality-specific mechanisms, together with the behavioral effect, thus support the visual dominance model in terms of the practice effect during cross-modal selective attention. Copyright © 2018 Elsevier Ltd. All rights reserved.

The experience of agency in human-computer interactions: a review

PubMed Central

Limerick, Hannah; Coyle, David; Moore, James W.

2014-01-01

The sense of agency is the experience of controlling both one’s body and the external environment. Although the sense of agency has been studied extensively, there is a paucity of studies in applied “real-life” situations. One applied domain that seems highly relevant is human-computer-interaction (HCI), as an increasing number of our everyday agentive interactions involve technology. Indeed, HCI has long recognized the feeling of control as a key factor in how people experience interactions with technology. The aim of this review is to summarize and examine the possible links between sense of agency and understanding control in HCI. We explore the overlap between HCI and sense of agency for computer input modalities and system feedback, computer assistance, and joint actions between humans and computers. An overarching consideration is how agency research can inform HCI and vice versa. Finally, we discuss the potential ethical implications of personal responsibility in an ever-increasing society of technology users and intelligent machine interfaces. PMID:25191256

Evaluating the operations underlying multisensory integration in the cat superior colliculus.

PubMed

Stanford, Terrence R; Quessy, Stephan; Stein, Barry E

2005-07-13

It is well established that superior colliculus (SC) multisensory neurons integrate cues from different senses; however, the mechanisms responsible for producing multisensory responses are poorly understood. Previous studies have shown that spatially congruent cues from different modalities (e.g., auditory and visual) yield enhanced responses and that the greatest relative enhancements occur for combinations of the least effective modality-specific stimuli. Although these phenomena are well documented, little is known about the mechanisms that underlie them, because no study has systematically examined the operation that multisensory neurons perform on their modality-specific inputs. The goal of this study was to evaluate the computations that multisensory neurons perform in combining the influences of stimuli from two modalities. The extracellular activities of single neurons in the SC of the cat were recorded in response to visual, auditory, and bimodal visual-auditory stimulation. Each neuron was tested across a range of stimulus intensities and multisensory responses evaluated against the null hypothesis of simple summation of unisensory influences. We found that the multisensory response could be superadditive, additive, or subadditive but that the computation was strongly dictated by the efficacies of the modality-specific stimulus components. Superadditivity was most common within a restricted range of near-threshold stimulus efficacies, whereas for the majority of stimuli, response magnitudes were consistent with the linear summation of modality-specific influences. In addition to providing a constraint for developing models of multisensory integration, the relationship between response mode and stimulus efficacy emphasizes the importance of considering stimulus parameters when inducing or interpreting multisensory phenomena.

Low Complexity Track Initialization and Fusion for Multi-Modal Sensor Networks

DTIC Science & Technology

2012-11-08

feature was demonstrated via the simulations. Aerospace 2011work further documents our investigation of multiple target tracking filters in...bounds that determine how well a sensor network can resolve and localize multiple targets as a function of the operating parameters such as sensor...probability density (PHD) filter for binary measurements using proximity sensors. 15. SUBJECT TERMS proximity sensors, PHD filter, multiple

Cross-Modal Retrieval With CNN Visual Features: A New Baseline.

PubMed

Wei, Yunchao; Zhao, Yao; Lu, Canyi; Wei, Shikui; Liu, Luoqi; Zhu, Zhenfeng; Yan, Shuicheng

2017-02-01

Recently, convolutional neural network (CNN) visual features have demonstrated their powerful ability as a universal representation for various recognition tasks. In this paper, cross-modal retrieval with CNN visual features is implemented with several classic methods. Specifically, off-the-shelf CNN visual features are extracted from the CNN model, which is pretrained on ImageNet with more than one million images from 1000 object categories, as a generic image representation to tackle cross-modal retrieval. To further enhance the representational ability of CNN visual features, based on the pretrained CNN model on ImageNet, a fine-tuning step is performed by using the open source Caffe CNN library for each target data set. Besides, we propose a deep semantic matching method to address the cross-modal retrieval problem with respect to samples which are annotated with one or multiple labels. Extensive experiments on five popular publicly available data sets well demonstrate the superiority of CNN visual features for cross-modal retrieval.

Retrospective Analysis of Communication Events - Understanding the Dynamics of Collaborative Multi-Party Discourse

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cowell, Andrew J.; Haack, Jereme N.; McColgin, Dave W.

2006-06-08

This research is aimed at understanding the dynamics of collaborative multi-party discourse across multiple communication modalities. Before we can truly make sig-nificant strides in devising collaborative communication systems, there is a need to understand how typical users utilize com-putationally supported communications mechanisms such as email, instant mes-saging, video conferencing, chat rooms, etc., both singularly and in conjunction with traditional means of communication such as face-to-face meetings, telephone calls and postal mail. Attempting to un-derstand an individual’s communications profile with access to only a single modal-ity is challenging at best and often futile. Here, we discuss the development of RACE –more » Retrospective Analysis of Com-munications Events – a test-bed prototype to investigate issues relating to multi-modal multi-party discourse.« less

Rational chemical design of the next generation of molecular imaging probes based on physics and biology: mixing modalities, colors and signals

PubMed Central

Longmire, Michelle R.; Ogawa, Mikako; Choyke, Peter L.

2012-01-01

In recent years, numerous in vivo molecular imaging probes have been developed. As a consequence, much has been published on the design and synthesis of molecular imaging probes focusing on each modality, each type of material, or each target disease. More recently, second generation molecular imaging probes with unique, multi-functional, or multiplexed characteristics have been designed. This critical review focuses on (i) molecular imaging using combinations of modalities and signals that employ the full range of the electromagnetic spectra, (ii) optimized chemical design of molecular imaging probes for in vivo kinetics based on biology and physiology across a range of physical sizes, (iii) practical examples of second generation molecular imaging probes designed to extract complementary data from targets using multiple modalities, color, and comprehensive signals (277 references). PMID:21607237

High resolution skin-like sensor capable of sensing and visualizing various sensations and three dimensional shape.

PubMed

Xu, Tianbai; Wang, Wenbo; Bian, Xiaolei; Wang, Xiaoxue; Wang, Xiaozhi; Luo, J K; Dong, Shurong

2015-08-13

Human skin contains multiple receptors, and is able to sense various stimuli such as temperature, pressure, force, corrosion etc, and to feel pains and the shape of objects. The development of skin-like sensors capable of sensing these stimuli is of great importance for various applications such as robots, touch detection, temperature monitoring, strain gauges etc. Great efforts have been made to develop high performance skin-like sensors, but they are far from perfect and much inferior to human skin as most of them can only sense one stimulus with focus on pressure (strain) or temperature, and are unable to visualize sensations and shape of objects. Here we report a skin-like sensor which imitates real skin with multiple receptors, and a new concept of pain sensation. The sensor with very high resolution not only has multiple sensations for touch, pressure, temperature, but also is able to sense various pains and reproduce the three dimensional shape of an object in contact.

Modal Testing of the NPSAT1 Engineering Development Unit

DTIC Science & Technology

2012-07-01

erkläre ich, dass die vorliegende Master Arbeit von mir selbstständig und nur unter Verwendung der angegebenen Quellen und Hilfsmittel angefertigt...logarithmic scale . As 5 Figure 2 shows, natural frequencies are indicated by large values of the first CMIF (peaks), and multiple modes can be detected by...structure’s behavior. Ewins even states, “that no large- scale modal test should be permitted to proceed until some preliminary SDOF analyses have

Network inference from multimodal data: A review of approaches from infectious disease transmission.

PubMed

Ray, Bisakha; Ghedin, Elodie; Chunara, Rumi

2016-12-01

Networks inference problems are commonly found in multiple biomedical subfields such as genomics, metagenomics, neuroscience, and epidemiology. Networks are useful for representing a wide range of complex interactions ranging from those between molecular biomarkers, neurons, and microbial communities, to those found in human or animal populations. Recent technological advances have resulted in an increasing amount of healthcare data in multiple modalities, increasing the preponderance of network inference problems. Multi-domain data can now be used to improve the robustness and reliability of recovered networks from unimodal data. For infectious diseases in particular, there is a body of knowledge that has been focused on combining multiple pieces of linked information. Combining or analyzing disparate modalities in concert has demonstrated greater insight into disease transmission than could be obtained from any single modality in isolation. This has been particularly helpful in understanding incidence and transmission at early stages of infections that have pandemic potential. Novel pieces of linked information in the form of spatial, temporal, and other covariates including high-throughput sequence data, clinical visits, social network information, pharmaceutical prescriptions, and clinical symptoms (reported as free-text data) also encourage further investigation of these methods. The purpose of this review is to provide an in-depth analysis of multimodal infectious disease transmission network inference methods with a specific focus on Bayesian inference. We focus on analytical Bayesian inference-based methods as this enables recovering multiple parameters simultaneously, for example, not just the disease transmission network, but also parameters of epidemic dynamics. Our review studies their assumptions, key inference parameters and limitations, and ultimately provides insights about improving future network inference methods in multiple applications. Copyright © 2016 Elsevier Inc. All rights reserved.

Prospective Mathematics Teachers' Sense Making of Polynomial Multiplication and Factorization Modeled with Algebra Tiles

ERIC Educational Resources Information Center

Caglayan, Günhan

2013-01-01

This study is about prospective secondary mathematics teachers' understanding and sense making of representational quantities generated by algebra tiles, the quantitative units (linear vs. areal) inherent in the nature of these quantities, and the quantitative addition and multiplication operations--referent preserving versus referent…

"Combo" nanomedicine: Co-delivery of multi-modal therapeutics for efficient, targeted, and safe cancer therapy.

PubMed

Kemp, Jessica A; Shim, Min Suk; Heo, Chan Yeong; Kwon, Young Jik

2016-03-01

The dynamic and versatile nature of diseases such as cancer has been a pivotal challenge for developing efficient and safe therapies. Cancer treatments using a single therapeutic agent often result in limited clinical outcomes due to tumor heterogeneity and drug resistance. Combination therapies using multiple therapeutic modalities can synergistically elevate anti-cancer activity while lowering doses of each agent, hence, reducing side effects. Co-administration of multiple therapeutic agents requires a delivery platform that can normalize pharmacokinetics and pharmacodynamics of the agents, prolong circulation, selectively accumulate, specifically bind to the target, and enable controlled release in target site. Nanomaterials, such as polymeric nanoparticles, gold nanoparticles/cages/shells, and carbon nanomaterials, have the desired properties, and they can mediate therapeutic effects different from those generated by small molecule drugs (e.g., gene therapy, photothermal therapy, photodynamic therapy, and radiotherapy). This review aims to provide an overview of developing multi-modal therapies using nanomaterials ("combo" nanomedicine) along with the rationale, up-to-date progress, further considerations, and the crucial roles of interdisciplinary approaches. Copyright © 2015 Elsevier B.V. All rights reserved.

Direct calculation of modal parameters from matrix orthogonal polynomials

NASA Astrophysics Data System (ADS)

El-Kafafy, Mahmoud; Guillaume, Patrick

2011-10-01

The object of this paper is to introduce a new technique to derive the global modal parameter (i.e. system poles) directly from estimated matrix orthogonal polynomials. This contribution generalized the results given in Rolain et al. (1994) [5] and Rolain et al. (1995) [6] for scalar orthogonal polynomials to multivariable (matrix) orthogonal polynomials for multiple input multiple output (MIMO) system. Using orthogonal polynomials improves the numerical properties of the estimation process. However, the derivation of the modal parameters from the orthogonal polynomials is in general ill-conditioned if not handled properly. The transformation of the coefficients from orthogonal polynomials basis to power polynomials basis is known to be an ill-conditioned transformation. In this paper a new approach is proposed to compute the system poles directly from the multivariable orthogonal polynomials. High order models can be used without any numerical problems. The proposed method will be compared with existing methods (Van Der Auweraer and Leuridan (1987) [4] Chen and Xu (2003) [7]). For this comparative study, simulated as well as experimental data will be used.

Distributed-effect optical fiber sensors for trusses and plates

NASA Technical Reports Server (NTRS)

Reichard, Karl; Lindner, Douglas K.

1991-01-01

Modal domain optical fiber sensors, or distributed effect sensors, for active vibration suppression in flexible structures are considered. Preliminary modeling results indicate that these sensors can be used to sense vibrations in a flexible beam and the signal can be used to damp vibrations in the beam. Weighted distributed-effect sensors can be used to implement high order compensators with low order functional observers.

The intentionality of smell

PubMed Central

Lycan, William G.

2014-01-01

If any sense modality represents, vision does, but argument is needed to show that smell does. This paper rebuts two reasons for doubting that smell represents, and offers several arguments that it does. The paper then considers several recent proposals as to exactly what a smell represents, and defends a version of the author's original proposal—that a smell represents a miasma in the air—against its competitors. PMID:24904458

Postinflammatory hyperpigmentation in patients with skin of color.

PubMed

Shokeen, Divya

2016-01-01

Postinflammatory hyperpigmentation (PIH) has posed a substantial challenge for patients with higher Fitzpatrick skin types, specifically types III to VI. Treatment modalities pose a number of limitations due to the number of treatments required, potential side effects, and overall efficacy. Fortunately, multiple therapies have been delineated that can be moderately to highly efficacious in treating PIH in patients with skin of color. This article will review some of these modalities and procedures for this common patient concern.

Multiple layer identification label using stacked identification symbols

NASA Technical Reports Server (NTRS)

Schramm, Harry F. (Inventor)

2005-01-01

An automatic identification system and method are provided which employ a machine readable multiple layer label. The label has a plurality of machine readable marking layers stacked one upon another. Each of the marking layers encodes an identification symbol detectable using one or more sensing technologies. The various marking layers may comprise the same marking material or each marking layer may comprise a different medium having characteristics detectable by a different sensing technology. These sensing technologies include x-ray, radar, capacitance, thermal, magnetic and ultrasonic. A complete symbol may be encoded within each marking layer or a symbol may be segmented into fragments which are then divided within a single marking layer or encoded across multiple marking layers.

Weakly-coupled 4-mode step-index FMF and demonstration of IM/DD MDM transmission.

PubMed

Hu, Tao; Li, Juhao; Ge, Dawei; Wu, Zhongying; Tian, Yu; Shen, Lei; Liu, Yaping; Chen, Su; Li, Zhengbin; He, Yongqi; Chen, Zhangyuan

2018-04-02

Weakly coupled-mode division multiplexing (MDM) over few-mode fibers (FMF) for short-reach transmission has attracted great interest, which can avoid multiple-input-multiple-output digital signal processing (MIMO-DSP) by greatly suppressing modal crosstalk. In this paper, step-index FMF supporting 4 linearity polarization (LP) modes for MIMO-free transmission is designed and fabricated for the first time, to our knowledge. Modal crosstalk of the fiber is suppressed by increasing the mode effective refractive index differences. The same fabrication method as standard single-mode fiber is adopted so that it is practical and cost-effective. The mode multiplexer/demultiplexer (MUX/DEMUX) consists of cascaded mode-selective couplers (MSCs), which are designed and fabricated by tapering the proposed FMF with single-mode fiber (SMF). The mode MUX and DEMUX achieve very low modal crosstalk not only for the multiplexing/demultiplexing but also for the coupling to/from the FMF. Based on the fabricated FMF and mode MUX/DEMUX, we successfully demonstrate the first simultaneous 4-modes (LP 01 , LP 11 , LP 21 & LP 31 ) 10-km FMF transmission with 10-Gb/s intensity modulation and MIMO-free direct detection (IM/DD). The modal crosstalk of the whole transmission link is successfully suppressed to less than -16.5 dB. The experimental results indicate that FMF with simple step-index structure supporting 4 weakly-coupled modes is feasible.

A common perceptual temporal limit of binding synchronous inputs across different sensory attributes and modalities

PubMed Central

Fujisaki, Waka; Nishida, Shin'ya

2010-01-01

The human brain processes different aspects of the surrounding environment through multiple sensory modalities, and each modality can be subdivided into multiple attribute-specific channels. When the brain rebinds sensory content information (‘what’) across different channels, temporal coincidence (‘when’) along with spatial coincidence (‘where’) provides a critical clue. It however remains unknown whether neural mechanisms for binding synchronous attributes are specific to each attribute combination, or universal and central. In human psychophysical experiments, we examined how combinations of visual, auditory and tactile attributes affect the temporal frequency limit of synchrony-based binding. The results indicated that the upper limits of cross-attribute binding were lower than those of within-attribute binding, and surprisingly similar for any combination of visual, auditory and tactile attributes (2–3 Hz). They are unlikely to be the limits for judging synchrony, since the temporal limit of a cross-attribute synchrony judgement was higher and varied with the modality combination (4–9 Hz). These findings suggest that cross-attribute temporal binding is mediated by a slow central process that combines separately processed ‘what’ and ‘when’ properties of a single event. While the synchrony performance reflects temporal bottlenecks existing in ‘when’ processing, the binding performance reflects the central temporal limit of integrating ‘when’ and ‘what’ properties. PMID:20335212

Distributed microscopic actuation analysis of deformable plate membrane mirrors

NASA Astrophysics Data System (ADS)

Lu, Yifan; Yue, Honghao; Deng, Zongquan; Tzou, Hornsen

2018-02-01

To further reduce the areal density of optical mirrors used in space telescopes and other space-borne optical structures, the concept of flexible membrane deformable mirror has been proposed. Because of their high flexibility, poor stiffness and low damping properties, environmental excitations such as orbital maneuver, path changing, and non-uniform heating may induce unexpected vibrations and thus reduce working performance. Therefore, active vibration control is essential for these membrane mirrors. In this paper, two different mirror models, i.e., the plate membrane model and pure membrane model, are studied respectively. In order to investigate the modal vibration characteristics of the mirror, a piezoelectric layer is fully laminated on its non-reflective side to serve as actuators. Dynamic equations of the mirror laminated with piezoelectric actuators are presented first. Then, the actuator induced modal control force is defined. When the actuator area shrinks to infinitesimal, the expressions of microscopic local modal control force and its two components are obtained to predict the spatial microscopic actuation behavior of the mirror. Different membrane pretension forces are also applied to reveal the tension effects on the actuation of the mirror. Analyses indicate that the spatial distribution of modal micro-control forces is exactly the same with the sensing signals distribution of the mirror, which provides crucial guidelines for optimal actuator placement of membrane deformable mirrors.

Terahertz sensing of highly absorptive water-methanol mixtures with multiple resonances in metamaterials.

PubMed

Chen, Min; Singh, Leena; Xu, Ningning; Singh, Ranjan; Zhang, Weili; Xie, Lijuan

2017-06-26

Terahertz sensing of highly absorptive aqueous solutions remains challenging due to strong absorption of water in the terahertz regime. Here, we experimentally demonstrate a cost-effective metamaterial-based sensor integrated with terahertz time-domain spectroscopy for highly absorptive water-methanol mixture sensing. This metamaterial has simple asymmetric wire structures that support multiple resonances including a fundamental Fano resonance and higher order dipolar resonance in the terahertz regime. Both the resonance modes have strong intensity in the transmission spectra which we exploit for detection of the highly absorptive water-methanol mixtures. The experimentally characterized sensitivities of the Fano and dipole resonances for the water-methanol mixtures are found to be 160 and 305 GHz/RIU, respectively. This method provides a robust route for metamaterial-assisted terahertz sensing of highly absorptive chemical and biochemical materials with multiple resonances and high accuracy.

Comparing solutions to the expectancy-value muddle in the theory of planned behaviour.

PubMed

O' Sullivan, B; McGee, H; Keegan, O

2008-11-01

The authors of the Theories of Reasoned Action (TRA) and Planned Behaviour (TPB) recommended a method for statistically analysing the relationship between the indirect belief-based measures and the direct measures of attitude, subjective norm, and perceived behavioural control (PBC). However, there is a growing awareness that this yields statistically uninterpretable results. This study's objective was to compare two solutions to what has been called the 'expectancy-value muddle'. These solutions were (i) optimal scoring of modal beliefs and (ii) individual beliefs without multiplicative composites. Cross-sectional data were collected by telephone interview. Participants were 110 first-degree relatives (FDRs) of patients diagnosed with colorectal cancer (CRC), who were offered CRC screening in the study hospital (83% response rate). Participants were asked to rate the TPB constructs in relation to attending for CRC screening. There was no significant difference in the correlation between behavioural beliefs and attitude for rescaled modal and individual beliefs. This was also the case for control beliefs and PBC. By contrast, there was a large correlation between rescaled modal normative beliefs and subjective norm, whereas individual normative beliefs did not correlate with subjective norm. Using individual beliefs without multiplicative composites allows for a fairly unproblematic interpretation of the relationship between the indirect and direct TPB constructs (French & Hankins, 2003). Therefore, it is recommended that future studies consider using individual measures of behavioural and control beliefs without multiplicative composites and examine a different way of measuring individual normative beliefs without multiplicative composites to that used in this study.

Alignment of multimodality, 2D and 3D breast images

NASA Astrophysics Data System (ADS)

Grevera, George J.; Udupa, Jayaram K.

2003-05-01

In a larger effort, we are studying methods to improve the specificity of the diagnosis of breast cancer by combining the complementary information available from multiple imaging modalities. Merging information is important for a number of reasons. For example, contrast uptake curves are an indication of malignancy. The determination of anatomical locations in corresponding images from various modalities is necessary to ascertain the extent of regions of tissue. To facilitate this fusion, registration becomes necessary. We describe in this paper a framework in which 2D and 3D breast images from MRI, PET, Ultrasound, and Digital Mammography can be registered to facilitate this goal. Briefly, prior to image acquisition, an alignment grid is drawn on the breast skin. Modality-specific markers are then placed at the indicated grid points. Images are then acquired by a specific modality with the modality specific external markers in place causing the markers to appear in the images. This is the first study that we are aware of that has undertaken the difficult task of registering 2D and 3D images of such a highly deformable (the breast) across such a wide variety of modalities. This paper reports some very preliminary results from this project.

Neural network for intelligent query of an FBI forensic database

NASA Astrophysics Data System (ADS)

Uvanni, Lee A.; Rainey, Timothy G.; Balasubramanian, Uma; Brettle, Dean W.; Weingard, Fred; Sibert, Robert W.; Birnbaum, Eric

1997-02-01

Examiner is an automated fired cartridge case identification system utilizing a dual-use neural network pattern recognition technology, called the statistical-multiple object detection and location system (S-MODALS) developed by Booz(DOT)Allen & Hamilton, Inc. in conjunction with Rome Laboratory. S-MODALS was originally designed for automatic target recognition (ATR) of tactical and strategic military targets using multisensor fusion [electro-optical (EO), infrared (IR), and synthetic aperture radar (SAR)] sensors. Since S-MODALS is a learning system readily adaptable to problem domains other than automatic target recognition, the pattern matching problem of microscopic marks for firearms evidence was analyzed using S-MODALS. The physics; phenomenology; discrimination and search strategies; robustness requirements; error level and confidence level propagation that apply to the pattern matching problem of military targets were found to be applicable to the ballistic domain as well. The Examiner system uses S-MODALS to rank a set of queried cartridge case images from the most similar to the least similar image in reference to an investigative fired cartridge case image. The paper presents three independent tests and evaluation studies of the Examiner system utilizing the S-MODALS technology for the Federal Bureau of Investigation.

Infrared polarimetric sensing of oil on water

NASA Astrophysics Data System (ADS)

Chenault, David B.; Vaden, Justin P.; Mitchell, Douglas A.; DeMicco, Erik D.

2016-10-01

Infrared polarimetry is an emerging sensing modality that offers the potential for significantly enhanced contrast in situations where conventional thermal imaging falls short. Polarimetric imagery leverages the different polarization signatures that result from material differences, surface roughness quality, and geometry that are frequently different from those features that lead to thermal signatures. Imaging of the polarization in a scene can lead to enhanced understanding, particularly when materials in a scene are at thermal equilibrium. Polaris Sensor Technologies has measured the polarization signatures of oil on water in a number of different scenarios and has shown significant improvement in detection through the contrast improvement offered by polarimetry. The sensing improvement offers the promise of automated detection of oil spills and leaks for routine monitoring and accidents with the added benefit of being able to continue monitoring at night. In this paper, we describe the instrumentation, and the results of several measurement exercises in both controlled and uncontrolled conditions.

Oxytocin mediates early experience-dependent cross-modal plasticity in the sensory cortices.

PubMed

Zheng, Jing-Jing; Li, Shu-Jing; Zhang, Xiao-Di; Miao, Wan-Ying; Zhang, Dinghong; Yao, Haishan; Yu, Xiang

2014-03-01

Sensory experience is critical to development and plasticity of neural circuits. Here we report a new form of plasticity in neonatal mice, where early sensory experience cross-modally regulates development of all sensory cortices via oxytocin signaling. Unimodal sensory deprivation from birth through whisker deprivation or dark rearing reduced excitatory synaptic transmission in the correspondent sensory cortex and cross-modally in other sensory cortices. Sensory experience regulated synthesis and secretion of the neuropeptide oxytocin as well as its level in the cortex. Both in vivo oxytocin injection and increased sensory experience elevated excitatory synaptic transmission in multiple sensory cortices and significantly rescued the effects of sensory deprivation. Together, these results identify a new function for oxytocin in promoting cross-modal, experience-dependent cortical development. This link between sensory experience and oxytocin is particularly relevant to autism, where hypersensitivity or hyposensitivity to sensory inputs is prevalent and oxytocin is a hotly debated potential therapy.

Estimating modal abundances from the spectra of natural and laboratory pyroxene mixtures using the modified Gaussian model

NASA Technical Reports Server (NTRS)

Sunshine, Jessica M.; Pieters, Carle M.

1993-01-01

The modified Gaussian model (MGM) is used to explore spectra of samples containing multiple pyroxene components as a function of modal abundance. The MGM allows spectra to be analyzed directly, without the use of actual or assumed end-member spectra and therefore holds great promise for remote applications. A series of mass fraction mixtures created from several different particle size fractions are analyzed with the MGM to quantify the properties of pyroxene mixtures as a function of both modal abundance and grain size. Band centers, band widths, and relative band strengths of absorptions from individual pyroxenes in mixture spectra are found to be largely independent of particle size. Spectral properties of both zoned and exsolved pyroxene components are resolved in exsolved samples using the MGM, and modal abundances are accurately estimated to within 5-10 percent without predetermined knowledge of the end-member spectra.

Wireless Computing Architecture III

DTIC Science & Technology

2013-09-01

MIMO Multiple-Input and Multiple-Output MIMO /CON MIMO with concurrent hannel access and estimation MU- MIMO Multiuser MIMO OFDM Orthogonal...compressive sensing \\; a design for concurrent channel estimation in scalable multiuser MIMO networking; and novel networking protocols based on machine...Network, Antenna Arrays, UAV networking, Angle of Arrival, Localization MIMO , Access Point, Channel State Information, Compressive Sensing 16

The Multilingual Mind: Issues Discussed by, for, and about People Living with Many Languages.

ERIC Educational Resources Information Center

Tokuhama-Espinosa, Tracey, Ed.

This collection of 21 essays focuses on people who experience the world with multiple languages: (1) "Myths about Multilingualism" (Tracey Tokuhama-Espinosa); (2) "Teaching Languages using the Multiple Intelligences and the Senses" (Tracey Tokuhama-Espinosa); (3) "The Role of the Sense of Smell in Language Learning"…

Mobile user identity sensing using the motion sensor

NASA Astrophysics Data System (ADS)

Zhao, Xi; Feng, Tao; Xu, Lei; Shi, Weidong

2014-05-01

Employing mobile sensor data to recognize user behavioral activities has been well studied in recent years. However, to adopt the data as a biometric modality has rarely been explored. Existing methods either used the data to recognize gait, which is considered as a distinguished identity feature; or segmented a specific kind of motion for user recognition, such as phone picking-up motion. Since the identity and the motion gesture jointly affect motion data, to fix the gesture (walking or phone picking-up) definitively simplifies the identity sensing problem. However, it meanwhile introduces the complexity from gesture detection or requirement on a higher sample rate from motion sensor readings, which may draw the battery fast and affect the usability of the phone. In general, it is still under investigation that motion based user authentication in a large scale satisfies the accuracy requirement as a stand-alone biometrics modality. In this paper, we propose a novel approach to use the motion sensor readings for user identity sensing. Instead of decoupling the user identity from a gesture, we reasonably assume users have their own distinguishing phone usage habits and extract the identity from fuzzy activity patterns, represented by a combination of body movements whose signals in chains span in relative low frequency spectrum and hand movements whose signals span in relative high frequency spectrum. Then Bayesian Rules are applied to analyze the dependency of different frequency components in the signals. During testing, a posterior probability of user identity given the observed chains can be computed for authentication. Tested on an accelerometer dataset with 347 users, our approach has demonstrated the promising results.

In vivo confirmation of hydration based contrast mechanisms for terahertz medical imaging using MRI

NASA Astrophysics Data System (ADS)

Bajwa, Neha; Sung, Shijun; Garritano, James; Nowroozi, Bryan; Tewari, Priyamvada; Ennis, Daniel B.; Alger, Jeffery; Grundfest, Warren; Taylor, Zachary

2014-09-01

Terahertz (THz) detection has been proposed and applied to a variety of medical imaging applications in view of its unrivaled hydration profiling capabilities. Variations in tissue dielectric function have been demonstrated at THz frequencies to generate high contrast imagery of tissue, however, the source of image contrast remains to be verified using a modality with a comparable sensing scheme. To investigate the primary contrast mechanism, a pilot comparison study was performed in a burn wound rat model, widely known to create detectable gradients in tissue hydration through both injured and surrounding tissue. Parallel T2 weighted multi slice multi echo (T2w MSME) 7T Magnetic Resonance (MR) scans and THz surface reflectance maps were acquired of a full thickness skin burn in a rat model over a 5 hour time period. A comparison of uninjured and injured regions in the full thickness burn demonstrates a 3-fold increase in average T2 relaxation times and a 15% increase in average THz reflectivity, respectively. These results support the sensitivity and specificity of MRI for measuring in vivo burn tissue water content and the use of this modality to verify and understand the hydration sensing capabilities of THz imaging for acute assessments of the onset and evolution of diseases that affect the skin. A starting point for more sophisticated in vivo studies, this preliminary analysis may be used in the future to explore how and to what extent the release of unbound water affects imaging contrast in THz burn sensing.

Spatial and Temporal Scaling of Thermal Infrared Remote Sensing Data

NASA Technical Reports Server (NTRS)

Quattrochi, Dale A.; Goel, Narendra S.

1995-01-01

Although remote sensing has a central role to play in the acquisition of synoptic data obtained at multiple spatial and temporal scales to facilitate our understanding of local and regional processes as they influence the global climate, the use of thermal infrared (TIR) remote sensing data in this capacity has received only minimal attention. This results from some fundamental challenges that are associated with employing TIR data collected at different space and time scales, either with the same or different sensing systems, and also from other problems that arise in applying a multiple scaled approach to the measurement of surface temperatures. In this paper, we describe some of the more important problems associated with using TIR remote sensing data obtained at different spatial and temporal scales, examine why these problems appear as impediments to using multiple scaled TIR data, and provide some suggestions for future research activities that may address these problems. We elucidate the fundamental concept of scale as it relates to remote sensing and explore how space and time relationships affect TIR data from a problem-dependency perspective. We also describe how linearity and non-linearity observation versus parameter relationships affect the quantitative analysis of TIR data. Some insight is given on how the atmosphere between target and sensor influences the accurate measurement of surface temperatures and how these effects will be compounded in analyzing multiple scaled TIR data. Last, we describe some of the challenges in modeling TIR data obtained at different space and time scales and discuss how multiple scaled TIR data can be used to provide new and important information for measuring and modeling land-atmosphere energy balance processes.

A quinoline-based fluorometric and colorimetric dual-modal pH probe and its application in bioimaging

NASA Astrophysics Data System (ADS)

Zhu, Qin; Li, Zhao; Mu, Lan; Zeng, Xi; Redshaw, Carl; Wei, Gang

2018-01-01

The compound (E)-8-hydroxyl-2-[(E)-2-(2, 4-dihydroxyphenyl)vinyl]-quinoline (1) has been developed as a fluorometric and colorimetric dual-modal probe for pH detection in solution and in vivo. Remarkable changes in the fluorescence intensity with large Stokes shifts and colorimetric responses were observed as a function of pH. The sensing mechanisms involving protonation and deprotonation processes over the acidic and alkaline pH ranges were confirmed by 1H NMR and IR spectroscopic analysis. Furthermore, the application of probe 1 for the imaging of live PC3 cells was successfully achieved. Test strips based on probe 1 were fabricated, and were found to act as a convenient and efficient pH test kits.

Modal, ray, and beam techniques for analyzing the EM scattering by open-ended waveguide cavities

NASA Technical Reports Server (NTRS)

Pathak, Prabhakar H.; Burkholder, Robert J.

1989-01-01

The problem of high-frequency electromagnetic (EM) scattering by open-ended waveguide cavities with an interior termination is analyzed via three different approaches. When cavities can be adequately modeled by joining together piecewise separable waveguide sections, a hybrid combination of asymptotic high-frequency and modal techniques is employed. In the case of more arbitrarily shaped waveguide cavities for which modes cannot even be defined in the conventional sense, the geometrical optics ray approach proves to be highly useful. However, at sufficiently high frequencies, both of these approaches tend to become inefficient. Hence, a paraxial Gaussian batch technique, which retains much of the simplicity of the ray approximation but is potentially more efficient, is investigated. Typical numerical results based on the different approaches are discussed.

Emerging Cytokine Biosensors with Optical Detection Modalities and Nanomaterial-Enabled Signal Enhancement

PubMed Central

Singh, Manpreet; Truong, Johnson; Reeves, W. Brian; Hahm, Jong-in

2017-01-01

Protein biomarkers, especially cytokines, play a pivotal role in the diagnosis and treatment of a wide spectrum of diseases. Therefore, a critical need for advanced cytokine sensors has been rapidly growing and will continue to expand to promote clinical testing, new biomarker development, and disease studies. In particular, sensors employing transduction principles of various optical modalities have emerged as the most common means of detection. In typical cytokine assays which are based on the binding affinities between the analytes of cytokines and their specific antibodies, optical schemes represent the most widely used mechanisms, with some serving as the gold standard against which all existing and new sensors are benchmarked. With recent advancements in nanoscience and nanotechnology, many of the recently emerging technologies for cytokine detection exploit various forms of nanomaterials for improved sensing capabilities. Nanomaterials have been demonstrated to exhibit exceptional optical properties unique to their reduced dimensionality. Novel sensing approaches based on the newly identified properties of nanomaterials have shown drastically improved performances in both the qualitative and quantitative analyses of cytokines. This article brings together the fundamentals in the literature that are central to different optical modalities developed for cytokine detection. Recent advancements in the applications of novel technologies are also discussed in terms of those that enable highly sensitive and multiplexed cytokine quantification spanning a wide dynamic range. For each highlighted optical technique, its current detection capabilities as well as associated challenges are discussed. Lastly, an outlook for nanomaterial-based cytokine sensors is provided from the perspective of optimizing the technologies for sensitivity and multiplexity as well as promoting widespread adaptations of the emerging optical techniques by lowering high thresholds currently present in the new approaches. PMID:28241443

A comparison of three different physiotherapy modalities used in the physiotherapy of burns.

PubMed

Sar, Zübeyir; Polat, Mine Gülden; Özgül, Bahar; Aydoğdu, Onur; Camcoğlu, Burcu; Acar, Ahmet Hakan; Yurdalan, Saadet Ufuk

2013-01-01

The present study compared the effectiveness of matrix rhythm therapy, ultrasound treatment (UT), laser treatment (LT) used in the physiotherapy of burns. The study was conducted at the Wound and Burn Healing Center, Dr. Lütfi Kırdar Kartal Education and Research Hospital (Turkey) from June 2009 to January 2012. The case series comprised 39 individuals with second- and third-degree upper-limb burns, whose burn traumas ended approximately 1 to 3 months previously. Participants were separated into three groups: matrix rhythm treatment (MRT), UT and LT; each group was also applied a treatment protocol including whirlpool and exercise. Pain, range of motion (ROM), muscular strength, skin elasticity, and sensory functions were evaluated before and after the treatment. Pressure sense and passive ROM were higher in the MRT group than in the LT group (P < .05). Pain was lower in the LT group than in the UT group, and passive ROM was higher in the UT group than the in LT group (P < .05). Active ROM was found to increase in all treatment groups, whereas passive ROM increased only in the MRT and UT groups; pressure sense increased only in the MRT group, and pain decreased only in the LT group (P < .05). MRT was found to be more effective in the restoration of sensory functions than LT, whereas LT was more effective in reducing pain than UT. No significant difference was observed in terms of skin elasticity according to the results of three treatment modalities. It is suggested that further research with more cases should be conducted to examine the long-term effect of treatment modalities.

Musicians are more consistent: Gestural cross-modal mappings of pitch, loudness and tempo in real-time

PubMed Central

Küssner, Mats B.; Tidhar, Dan; Prior, Helen M.; Leech-Wilkinson, Daniel

2014-01-01

Cross-modal mappings of auditory stimuli reveal valuable insights into how humans make sense of sound and music. Whereas researchers have investigated cross-modal mappings of sound features varied in isolation within paradigms such as speeded classification and forced-choice matching tasks, investigations of representations of concurrently varied sound features (e.g., pitch, loudness and tempo) with overt gestures—accounting for the intrinsic link between movement and sound—are scant. To explore the role of bodily gestures in cross-modal mappings of auditory stimuli we asked 64 musically trained and untrained participants to represent pure tones—continually sounding and concurrently varied in pitch, loudness and tempo—with gestures while the sound stimuli were played. We hypothesized musical training to lead to more consistent mappings between pitch and height, loudness and distance/height, and tempo and speed of hand movement and muscular energy. Our results corroborate previously reported pitch vs. height (higher pitch leading to higher elevation in space) and tempo vs. speed (increasing tempo leading to increasing speed of hand movement) associations, but also reveal novel findings pertaining to musical training which influenced consistency of pitch mappings, annulling a commonly observed bias for convex (i.e., rising–falling) pitch contours. Moreover, we reveal effects of interactions between musical parameters on cross-modal mappings (e.g., pitch and loudness on speed of hand movement), highlighting the importance of studying auditory stimuli concurrently varied in different musical parameters. Results are discussed in light of cross-modal cognition, with particular emphasis on studies within (embodied) music cognition. Implications for theoretical refinements and potential clinical applications are provided. PMID:25120506

Materials to clinical devices: technologies for remotely triggered drug delivery.

PubMed

Timko, Brian P; Kohane, Daniel S

2012-11-01

Technologies in which a remote trigger is used to release drug from an implanted or injected device could enable on-demand release profiles that enhance therapeutic effectiveness or reduce systemic toxicity. A number of new materials have been developed that exhibit sensitivity to light, ultrasound, or electrical or magnetic fields. Delivery systems that incorporate these materials might be triggered externally by the patient, parent or physician to provide flexible control of dose magnitude and timing. To review injectable or implantable systems that are candidates for translation to the clinic, or ones that have already undergone clinical trials. Also considered are applicability in pediatrics and prospects for the future of drug delivery systems. We performed literature searches of the PubMed and Science Citation Index databases for articles in English that reported triggerable drug delivery devices, and for articles reporting related materials and concepts. Approaches to remotely-triggered systems that have clinical potential were identified. Ideally, these systems have been engineered to exhibit controlled on-state release kinetics, low baseline leak rates, and reproducible dosing across multiple cycles. Advances in remotely-triggered drug delivery have been brought about by the convergence of numerous scientific and engineering disciplines, and this convergence is likely to play an important part in the current trend to develop systems that provide more than one therapeutic modality. Preclinical systems must be carefully assessed for biocompatibility, and engineered to ensure pharmacokinetics within the therapeutic window. Future drug delivery systems may incorporate additional modalities, such as closed-loop sensing or onboard power generation, enabling more sophisticated drug delivery regimens. Copyright © 2012 Elsevier HS Journals, Inc. All rights reserved.

Cranial electrotherapy stimulation and fibromyalgia.

PubMed

Gilula, Marshall F

2007-07-01

Cranial electrotherapy stimulation (CES) is a well-documented neuroelectrical modality that has been proven effective in some good studies of fibromyalgia (FM) patients. CES is no panacea but, for some FM patients, the modality can be valuable. This article discusses aspects of both CES and FM and how they relate to the individual with the condition. FM frequently has many comorbidities such as anxiety, depression, insomnia and a great variety of different rheumatologic and neurological symptoms that often resemble multiple sclerosis, dysautonomias, chronic fatigue syndrome and others. However, despite long-standing criteria from the American College of Rheumatology for FM, some physicians believe there is probably no single homogeneous condition that can be labeled as FM. Whether it is a disease, a syndrome or something else, sufferers feel like they are living one disaster after another. Active self-involvement in care usually enhances the therapeutic results of various treatments and also improves the patient's sense of being in control of the condition. D-ribose supplementation may prove to significantly enhance energy, sleep, mental clarity, pain control and well-being in FM patients. A form of evoked potential biofeedback, the EPFX, is a powerful stress reduction technique which assesses the chief stressors and risk factors for illness that can impede the FM patient's built-in healing abilities. Future healthcare will likely expand the diagnostic criteria of FM and/or illuminate a group of related conditions and the ways in which the conditions relate to each other. Future medicine for FM and related conditions may increasingly involve multimodality treatment that features CES as one significant part of the therapeutic regimen. Future medicine may also include CES as an invaluable, cost-effective add-on to many facets of clinical pharmacology and medical therapeutics.

Pollution going multimodal: the complex impact of the human-altered sensory environment on animal perception and performance.

PubMed

Halfwerk, Wouter; Slabbekoorn, Hans

2015-04-01

Anthropogenic sensory pollution is affecting ecosystems worldwide. Human actions generate acoustic noise, emanate artificial light and emit chemical substances. All of these pollutants are known to affect animals. Most studies on anthropogenic pollution address the impact of pollutants in unimodal sensory domains. High levels of anthropogenic noise, for example, have been shown to interfere with acoustic signals and cues. However, animals rely on multiple senses, and pollutants often co-occur. Thus, a full ecological assessment of the impact of anthropogenic activities requires a multimodal approach. We describe how sensory pollutants can co-occur and how covariance among pollutants may differ from natural situations. We review how animals combine information that arrives at their sensory systems through different modalities and outline how sensory conditions can interfere with multimodal perception. Finally, we describe how sensory pollutants can affect the perception, behaviour and endocrinology of animals within and across sensory modalities. We conclude that sensory pollution can affect animals in complex ways due to interactions among sensory stimuli, neural processing and behavioural and endocrinal feedback. We call for more empirical data on covariance among sensory conditions, for instance, data on correlated levels in noise and light pollution. Furthermore, we encourage researchers to test animal responses to a full-factorial set of sensory pollutants in the presence or the absence of ecologically important signals and cues. We realize that such approach is often time and energy consuming, but we think this is the only way to fully understand the multimodal impact of sensory pollution on animal performance and perception. © 2015 The Author(s) Published by the Royal Society. All rights reserved.

Label-free, single-object sensing with a microring resonator: FDTD simulation.

PubMed

Nguyen, Dan T; Norwood, Robert A

2013-01-14

Label-free, single-object sensing with a microring resonator is investigated numerically using the finite difference time-domain (FDTD) method. A pulse with ultra-wide bandwidth that spans over several resonant modes of the ring and of the sensing object is used for simulation, enabling a single-shot simulation of the microring sensing. The FDTD simulation not only can describe the circulation of the light in a whispering-gallery-mode (WGM) microring and multiple interactions between the light and the sensing object, but also other important factors of the sensing system, such as scattering and radiation losses. The FDTD results show that the simulation can yield a resonant shift of the WGM cavity modes. Furthermore, it can also extract eigenmodes of the sensing object, and therefore information from deep inside the object. The simulation method is not only suitable for a single object (single molecule, nano-, micro-scale particle) but can be extended to the problem of multiple objects as well.

The interactions of multisensory integration with endogenous and exogenous attention

PubMed Central

Tang, Xiaoyu; Wu, Jinglong; Shen, Yong

2016-01-01

Stimuli from multiple sensory organs can be integrated into a coherent representation through multiple phases of multisensory processing; this phenomenon is called multisensory integration. Multisensory integration can interact with attention. Here, we propose a framework in which attention modulates multisensory processing in both endogenous (goal-driven) and exogenous (stimulus-driven) ways. Moreover, multisensory integration exerts not only bottom-up but also top-down control over attention. Specifically, we propose the following: (1) endogenous attentional selectivity acts on multiple levels of multisensory processing to determine the extent to which simultaneous stimuli from different modalities can be integrated; (2) integrated multisensory events exert top-down control on attentional capture via multisensory search templates that are stored in the brain; (3) integrated multisensory events can capture attention efficiently, even in quite complex circumstances, due to their increased salience compared to unimodal events and can thus improve search accuracy; and (4) within a multisensory object, endogenous attention can spread from one modality to another in an exogenous manner. PMID:26546734

The interactions of multisensory integration with endogenous and exogenous attention.

PubMed

Tang, Xiaoyu; Wu, Jinglong; Shen, Yong

2016-02-01

Stimuli from multiple sensory organs can be integrated into a coherent representation through multiple phases of multisensory processing; this phenomenon is called multisensory integration. Multisensory integration can interact with attention. Here, we propose a framework in which attention modulates multisensory processing in both endogenous (goal-driven) and exogenous (stimulus-driven) ways. Moreover, multisensory integration exerts not only bottom-up but also top-down control over attention. Specifically, we propose the following: (1) endogenous attentional selectivity acts on multiple levels of multisensory processing to determine the extent to which simultaneous stimuli from different modalities can be integrated; (2) integrated multisensory events exert top-down control on attentional capture via multisensory search templates that are stored in the brain; (3) integrated multisensory events can capture attention efficiently, even in quite complex circumstances, due to their increased salience compared to unimodal events and can thus improve search accuracy; and (4) within a multisensory object, endogenous attention can spread from one modality to another in an exogenous manner. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Spectrum Analysis Solution (SAS) System: Theoretical Analysis, Hardware Design and Implementation.

PubMed

Narayanan, Ram M; Pooler, Richard K; Martone, Anthony F; Gallagher, Kyle A; Sherbondy, Kelly D

2018-02-22

This paper describes a multichannel super-heterodyne signal analyzer, called the Spectrum Analysis Solution (SAS), which performs multi-purpose spectrum sensing to support spectrally adaptive and cognitive radar applications. The SAS operates from ultrahigh frequency (UHF) to the S-band and features a wideband channel with eight narrowband channels. The wideband channel acts as a monitoring channel that can be used to tune the instantaneous band of the narrowband channels to areas of interest in the spectrum. The data collected from the SAS has been utilized to develop spectrum sensing algorithms for the budding field of spectrum sharing (SS) radar. Bandwidth (BW), average total power, percent occupancy (PO), signal-to-interference-plus-noise ratio (SINR), and power spectral entropy (PSE) have been examined as metrics for the characterization of the spectrum. These metrics are utilized to determine a contiguous optimal sub-band (OSB) for a SS radar transmission in a given spectrum for different modalities. Three OSB algorithms are presented and evaluated: the spectrum sensing multi objective (SS-MO), the spectrum sensing with brute force PSE (SS-BFE), and the spectrum sensing multi-objective with brute force PSE (SS-MO-BFE).

Recent Progress in Electronic Skin

PubMed Central

Wang, Xiandi; Dong, Lin; Zhang, Hanlu; Yu, Ruomeng; Wang, Zhong Lin

2015-01-01

The skin is the largest organ of the human body and can sense pressure, temperature, and other complex environmental stimuli or conditions. The mimicry of human skin's sensory ability via electronics is a topic of innovative research that could find broad applications in robotics, artificial intelligence, and human–machine interfaces, all of which promote the development of electronic skin (e‐skin). To imitate tactile sensing via e‐skins, flexible and stretchable pressure sensor arrays are constructed based on different transduction mechanisms and structural designs. These arrays can map pressure with high resolution and rapid response beyond that of human perception. Multi‐modal force sensing, temperature, and humidity detection, as well as self‐healing abilities are also exploited for multi‐functional e‐skins. Other recent progress in this field includes the integration with high‐density flexible circuits for signal processing, the combination with wireless technology for convenient sensing and energy/data transfer, and the development of self‐powered e‐skins. Future opportunities lie in the fabrication of highly intelligent e‐skins that can sense and respond to variations in the external environment. The rapidly increasing innovations in this area will be important to the scientific community and to the future of human life. PMID:27980911

The Spectrum Analysis Solution (SAS) System: Theoretical Analysis, Hardware Design and Implementation

PubMed Central

Pooler, Richard K.; Martone, Anthony F.; Gallagher, Kyle A.; Sherbondy, Kelly D.

2018-01-01

This paper describes a multichannel super-heterodyne signal analyzer, called the Spectrum Analysis Solution (SAS), which performs multi-purpose spectrum sensing to support spectrally adaptive and cognitive radar applications. The SAS operates from ultrahigh frequency (UHF) to the S-band and features a wideband channel with eight narrowband channels. The wideband channel acts as a monitoring channel that can be used to tune the instantaneous band of the narrowband channels to areas of interest in the spectrum. The data collected from the SAS has been utilized to develop spectrum sensing algorithms for the budding field of spectrum sharing (SS) radar. Bandwidth (BW), average total power, percent occupancy (PO), signal-to-interference-plus-noise ratio (SINR), and power spectral entropy (PSE) have been examined as metrics for the characterization of the spectrum. These metrics are utilized to determine a contiguous optimal sub-band (OSB) for a SS radar transmission in a given spectrum for different modalities. Three OSB algorithms are presented and evaluated: the spectrum sensing multi objective (SS-MO), the spectrum sensing with brute force PSE (SS-BFE), and the spectrum sensing multi-objective with brute force PSE (SS-MO-BFE). PMID:29470448

Simulating Operation of a Complex Sensor Network

NASA Technical Reports Server (NTRS)

Jennings, Esther; Clare, Loren; Woo, Simon

2008-01-01

Simulation Tool for ASCTA Microsensor Network Architecture (STAMiNA) ["ASCTA" denotes the Advanced Sensors Collaborative Technology Alliance.] is a computer program for evaluating conceptual sensor networks deployed over terrain to provide military situational awareness. This or a similar program is needed because of the complexity of interactions among such diverse phenomena as sensing and communication portions of a network, deployment of sensor nodes, effects of terrain, data-fusion algorithms, and threat characteristics. STAMiNA is built upon a commercial network-simulator engine, with extensions to include both sensing and communication models in a discrete-event simulation environment. Users can define (1) a mission environment, including terrain features; (2) objects to be sensed; (3) placements and modalities of sensors, abilities of sensors to sense objects of various types, and sensor false alarm rates; (4) trajectories of threatening objects; (5) means of dissemination and fusion of data; and (6) various network configurations. By use of STAMiNA, one can simulate detection of targets through sensing, dissemination of information by various wireless communication subsystems under various scenarios, and fusion of information, incorporating such metrics as target-detection probabilities, false-alarm rates, and communication loads, and capturing effects of terrain and threat.

How to specify and measure sensitivity in Distributed Acoustic Sensing (DAS)?

NASA Astrophysics Data System (ADS)

Gabai, Haniel; Eyal, Avishay

2017-04-01

In Rayleigh-scattering-based Distributed Acoustic Sensing (DAS) an optical fiber is transformed into an array of thousands of 'virtual microphones'. This approach has gained tremendous popularity in recent years and is one of the most successful examples of a fiber-optic sensing method which made its way from the academia to the market. Despite the great amount of work done in this field, sensitivity, which is ones of the most critical parameters of any sensing technique, was rarely investigated in this context. In particular, little attention was given to its random characteristics. Without careful consideration of the random aspects of DAS, any attempt to specify its sensitivity or to compare between different DAS modalities is of limited value. Recently we introduced a new statistical parameter which defines DAS sensitivity and enables comparison between the performances of different DAS systems. In this paper we generalize the previous parameter and give a broader, simple and intuitive definition to DAS sensitivity. An important attribute of these parameters is that they can be easily extracted from the static backscatter profile of the sensing fiber. In the paper we derive the relation between DAS sensitivity and the static backscatter profile and present an experimental verification of this relation.

The Integrated Taxonomy of Health Care: Classifying Both Complementary and Biomedical Practices Using a Uniform Classification Protocol

PubMed Central

Porcino, Antony; MacDougall, Colleen

2009-01-01

Background: Since the late 1980s, several taxonomies have been developed to help map and describe the interrelationships of complementary and alternative medicine (CAM) modalities. In these taxonomies, several issues are often incompletely addressed: A simple categorization process that clearly isolates a modality to a single conceptual categoryClear delineation of verticality—that is, a differentiation of scale being observed from individually applied techniques, through modalities (therapies), to whole medical systemsRecognition of CAM as part of the general field of health care Methods: Development of the Integrated Taxonomy of Health Care (ITHC) involved three stages: Development of a precise, uniform health glossaryAnalysis of the extant taxonomiesUse of an iterative process of classifying modalities and medical systems into categories until a failure to singularly classify a modality occurred, requiring a return to the glossary and adjustment of the classifying protocol Results: A full vertical taxonomy was developed that includes and clearly differentiates between techniques, modalities, domains (clusters of similar modalities), systems of health care (coordinated care system involving multiple modalities), and integrative health care. Domains are the classical primary focus of taxonomies. The ITHC has eleven domains: chemical/substance-based work, device-based work, soft tissue–focused manipulation, skeletal manipulation, fitness/movement instruction, mind–body integration/classical somatics work, mental/emotional–based work, bio-energy work based on physical manipulation, bio-energy modulation, spiritual-based work, unique assessments. Modalities are assigned to the domains based on the primary mode of interaction with the client, according the literature of the practitioners. Conclusions: The ITHC has several strengths: little interpretation is used while successfully assigning modalities to single domains; the issue of taxonomic verticality is fully resolved; and the design fully integrates the complementary health care fields of biomedicine and CAM. PMID:21589735

Mapping the Margins in Higher Education: On the Promise of Intersectionality Frameworks in Research and Discourse

ERIC Educational Resources Information Center

Museus, Samuel D.; Griffin, Kimberly A.

2011-01-01

"Intersectionality" can be defined as the "relationships among multiple social dimensions and modalities of social relations and subject formations." In simpler terms, it can be defined as the processes through which multiple social identities converge and ultimately shape individual and group experiences. In this article, the authors discuss the…

Conceptual Structure within and between Modalities

PubMed Central

Dilkina, Katia; Lambon Ralph, Matthew A.

2012-01-01

Current views of semantic memory share the assumption that conceptual representations are based on multimodal experience, which activates distinct modality-specific brain regions. This proposition is widely accepted, yet little is known about how each modality contributes to conceptual knowledge and how the structure of this contribution varies across these multiple information sources. We used verbal feature lists, features from drawings, and verbal co-occurrence statistics from latent semantic analysis to examine the informational structure in four domains of knowledge: perceptual, functional, encyclopedic, and verbal. The goals of the analysis were three-fold: (1) to assess the structure within individual modalities; (2) to compare structures between modalities; and (3) to assess the degree to which concepts organize categorically or randomly. Our results indicated significant and unique structure in all four modalities: perceptually, concepts organize based on prominent features such as shape, size, color, and parts; functionally, they group based on use and interaction; encyclopedically, they arrange based on commonality in location or behavior; and verbally, they group associatively or relationally. Visual/perceptual knowledge gives rise to the strongest hierarchical organization and is closest to classic taxonomic structure. Information is organized somewhat similarly in the perceptual and encyclopedic domains, which differs significantly from the structure in the functional and verbal domains. Notably, the verbal modality has the most unique organization, which is not at all categorical but also not random. The idiosyncrasy and complexity of conceptual structure across modalities raise the question of how all of these modality-specific experiences are fused together into coherent, multifaceted yet unified concepts. Accordingly, both methodological and theoretical implications of the present findings are discussed. PMID:23293593

Assessment of a Wearable Force- and Electromyography Device and Comparison of the Related Signals for Myocontrol

PubMed Central

Connan, Mathilde; Ruiz Ramírez, Eduardo; Vodermayer, Bernhard; Castellini, Claudio

2016-01-01

In the frame of assistive robotics, multi-finger prosthetic hand/wrists have recently appeared, offering an increasing level of dexterity; however, in practice their control is limited to a few hand grips and still unreliable, with the effect that pattern recognition has not yet appeared in the clinical environment. According to the scientific community, one of the keys to improve the situation is multi-modal sensing, i.e., using diverse sensor modalities to interpret the subject's intent and improve the reliability and safety of the control system in daily life activities. In this work, we first describe and test a novel wireless, wearable force- and electromyography device; through an experiment conducted on ten intact subjects, we then compare the obtained signals both qualitatively and quantitatively, highlighting their advantages and disadvantages. Our results indicate that force-myography yields signals which are more stable across time during whenever a pattern is held, than those obtained by electromyography. We speculate that fusion of the two modalities might be advantageous to improve the reliability of myocontrol in the near future. PMID:27909406

Integrative Data Analysis of Multi-Platform Cancer Data with a Multimodal Deep Learning Approach.

PubMed

Liang, Muxuan; Li, Zhizhong; Chen, Ting; Zeng, Jianyang

2015-01-01

Identification of cancer subtypes plays an important role in revealing useful insights into disease pathogenesis and advancing personalized therapy. The recent development of high-throughput sequencing technologies has enabled the rapid collection of multi-platform genomic data (e.g., gene expression, miRNA expression, and DNA methylation) for the same set of tumor samples. Although numerous integrative clustering approaches have been developed to analyze cancer data, few of them are particularly designed to exploit both deep intrinsic statistical properties of each input modality and complex cross-modality correlations among multi-platform input data. In this paper, we propose a new machine learning model, called multimodal deep belief network (DBN), to cluster cancer patients from multi-platform observation data. In our integrative clustering framework, relationships among inherent features of each single modality are first encoded into multiple layers of hidden variables, and then a joint latent model is employed to fuse common features derived from multiple input modalities. A practical learning algorithm, called contrastive divergence (CD), is applied to infer the parameters of our multimodal DBN model in an unsupervised manner. Tests on two available cancer datasets show that our integrative data analysis approach can effectively extract a unified representation of latent features to capture both intra- and cross-modality correlations, and identify meaningful disease subtypes from multi-platform cancer data. In addition, our approach can identify key genes and miRNAs that may play distinct roles in the pathogenesis of different cancer subtypes. Among those key miRNAs, we found that the expression level of miR-29a is highly correlated with survival time in ovarian cancer patients. These results indicate that our multimodal DBN based data analysis approach may have practical applications in cancer pathogenesis studies and provide useful guidelines for personalized cancer therapy.

An improved EMD method for modal identification and a combined static-dynamic method for damage detection

NASA Astrophysics Data System (ADS)

Yang, Jinping; Li, Peizhen; Yang, Youfa; Xu, Dian

2018-04-01

Empirical mode decomposition (EMD) is a highly adaptable signal processing method. However, the EMD approach has certain drawbacks, including distortions from end effects and mode mixing. In the present study, these two problems are addressed using an end extension method based on the support vector regression machine (SVRM) and a modal decomposition method based on the characteristics of the Hilbert transform. The algorithm includes two steps: using the SVRM, the time series data are extended at both endpoints to reduce the end effects, and then, a modified EMD method using the characteristics of the Hilbert transform is performed on the resulting signal to reduce mode mixing. A new combined static-dynamic method for identifying structural damage is presented. This method combines the static and dynamic information in an equilibrium equation that can be solved using the Moore-Penrose generalized matrix inverse. The combination method uses the differences in displacements of the structure with and without damage and variations in the modal force vector. Tests on a four-story, steel-frame structure were conducted to obtain static and dynamic responses of the structure. The modal parameters are identified using data from the dynamic tests and improved EMD method. The new method is shown to be more accurate and effective than the traditional EMD method. Through tests with a shear-type test frame, the higher performance of the proposed static-dynamic damage detection approach, which can detect both single and multiple damage locations and the degree of the damage, is demonstrated. For structures with multiple damage, the combined approach is more effective than either the static or dynamic method. The proposed EMD method and static-dynamic damage detection method offer improved modal identification and damage detection, respectively, in structures.

Design, Simulation, Fabrication and Testing of a Bio-Inspired Amphibious Robot with Multiple Modes of Mobility

DTIC Science & Technology

2012-01-01

performance. Ob- stacle climbing using the tail is compared to results from a previous robot with a posterior body segment and body flexion joint. Actual...3. Mechanisms of Locomotion for Multi-Modal Mobility 3.1. Gate and Tail Design Demands of multi-modal locomotion motivated a quadruped design for...tail instead of a rear body segment simplifies waterproofing design requirements and adds stability both on land and in water. This new morphology is

The impact of attentional, linguistic, and visual features during object naming

PubMed Central

Clarke, Alasdair D. F.; Coco, Moreno I.; Keller, Frank

2013-01-01

Object detection and identification are fundamental to human vision, and there is mounting evidence that objects guide the allocation of visual attention. However, the role of objects in tasks involving multiple modalities is less clear. To address this question, we investigate object naming, a task in which participants have to verbally identify objects they see in photorealistic scenes. We report an eye-tracking study that investigates which features (attentional, visual, and linguistic) influence object naming. We find that the amount of visual attention directed toward an object, its position and saliency, along with linguistic factors such as word frequency, animacy, and semantic proximity, significantly influence whether the object will be named or not. We then ask how features from different modalities are combined during naming, and find significant interactions between saliency and position, saliency and linguistic features, and attention and position. We conclude that when the cognitive system performs tasks such as object naming, it uses input from one modality to constraint or enhance the processing of other modalities, rather than processing each input modality independently. PMID:24379792

Multiplexed mRNA Sensing and Combinatorial-Targeted Drug Delivery Using DNA-Gold Nanoparticle Dimers.

PubMed

Kyriazi, Maria-Eleni; Giust, Davide; El-Sagheer, Afaf H; Lackie, Peter M; Muskens, Otto L; Brown, Tom; Kanaras, Antonios G

2018-04-24

The design of nanoparticulate systems which can perform multiple synergistic functions in cells with high specificity and selectivity is of great importance in applications. Here we combine recent advances in DNA-gold nanoparticle self-assembly and sensing to develop gold nanoparticle dimers that are able to perform multiplexed synergistic functions within a cellular environment. These dimers can sense two mRNA targets and simultaneously or independently deliver one or two DNA-intercalating anticancer drugs (doxorubicin and mitoxantrone) in live cells. Our study focuses on the design of sophisticated nanoparticle assemblies with multiple and synergistic functions that have the potential to advance sensing and drug delivery in cells.

Optical sensing of analytes in aqueous solutions with a multiple surface-plasmon-polariton-wave platform

PubMed Central

Swiontek, Stephen E.; Pulsifer, Drew P.; Lakhtakia, Akhlesh

2013-01-01

The commonly used optical sensor based on surface plasmon-polariton wave phenomenon can sense just one chemical, because only one SPP wave can be guided by the interface of a metal and a dielectric material contained in the sensor. Multiple analytes could be detected and/or the sensing reliability for a single analyte could be enhanced, if multiple SPP-wave modes could be excited on a single metal/dielectric interface. For that to happen, the partnering dielectric material must be periodically non-homogeneous. Using a chiral sculptured thin film (CSTF) as that material in a SPP-wave platform, we show that the angular locations of multiple SPP-wave modes shift when the void regions of the CSTF are infiltrated with a fluid. The sensitivities realized in the proof-of-concept experiments are comparable to state-of-research values. PMID:23474988

Conflicting Community Commitments: A Dialogical Analysis of a British Woman's World War II Diaries

ERIC Educational Resources Information Center

Gillespie, Alex; Cornish, Flora; Aveling, Emma-Louise; Zittoun, Tania

2008-01-01

Recent developments of the concept of "sense of community" have highlighted the multiplicity of people's senses of community. In this article, the authors introduce the theory of the dialogical self as a means of theorizing the conflicts that can arise between a person's commitments to multiple communities. They ask the question,…

Crush: Mapping Historical, Material and Affective Force Relations in Young Children's Hetero-Sexual Playground Play

ERIC Educational Resources Information Center

Huuki, Tuija; Renold, Emma

2016-01-01

Drawing on ethnographic multi-modal data of the gendered and sexual dynamics of pre-school play (age 6) in a rapidly declining fishing and farming community in North Finland, this paper offers a glimpse into our sense-making of a short video-recorded episode in which three boys repeatedly pile up on and demand a kiss from one of their girl…

Disposable Plasmonics: Plastic Templated Plasmonic Metamaterials with Tunable Chirality.

PubMed

Karimullah, Affar S; Jack, Calum; Tullius, Ryan; Rotello, Vincent M; Cooke, Graeme; Gadegaard, Nikolaj; Barron, Laurence D; Kadodwala, Malcolm

2015-10-07

Development of low-cost disposable plasmonic substrates is vital for the applicability of plasmonic sensing. Such devices can be made using injection-molded templates to create plasmonic films. The elements of these plasmonic films are hybrid nanostructures composed of inverse and solid structures. Tuning the modal coupling between the two allows optimization of the optical properties for nanophotonic applications. © 2015 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Slow Computing Simulation of Bio-plausible Control

DTIC Science & Technology

2012-03-01

information networks, neuromorphic chips would become necessary. Small unstable flying platforms currently require RTK, GPS, or Vicon closed-circuit...Visual, and IR Sensing FPGA ASIC Neuromorphic Chip Simulation Quad Rotor Robotic Insect Uniform Independent Network Single Modality Neural Network... neuromorphic Processing across parallel computational elements =0.54 N u m b e r o f c o m p u ta tio n s - No info 14 integrated circuit

Aristotelian syllogisms

NASA Astrophysics Data System (ADS)

Ollongren, Alexander

2011-02-01

Aristotelian assertive syllogistic logic (without modalities) is embedded in the author's Lingua Cosmica. The well-known basic structures of assertions and conversions between them in this logic are represented in LINCOS. Since these representations correspond with set-theoretic operations, the latter are embedded in LINCOS as well. Based on this valid argumentation in Aristotle's sense is obtained for four important so-called perfect figures. Their constructive (intuitionistic) verifications are of a surprisingly elegant simplicity.

A graphene quantum dot@Fe3O4@SiO2 based nanoprobe for drug delivery sensing and dual-modal fluorescence and MRI imaging in cancer cells.

PubMed

Su, Xiaoqian; Chan, Chunyu; Shi, Jingyu; Tsang, Ming-Kiu; Pan, Yi; Cheng, Changming; Gerile, Oudeng; Yang, Mo

2017-06-15

A novel graphene quantum dot (GQD)@Fe 3 O 4 @SiO 2 based nanoprobe was reported for targeted drug delivery, sensing, dual-modal imaging and therapy. Carboxyl-terminated GQD (C-GQD) was firstly conjugated with Fe 3 O 4 @SiO 2 and then functionalized with cancer targeting molecule folic acid (FA). DOX drug molecules were then loaded on GQD surface of Fe 3 O 4 @SiO 2 @GQD-FA nanoprobe via pi-pi stacking, which resulted in Fe 3 O 4 @SiO 2 @GQD-FA/DOX conjugates based on a FRET mechanism with GQD as donor molecules and DOX as acceptor molecules. Meanwhile, we successfully performed in vitro MRI and fluorescence imaging of living Hela cells and monitored intracellular drug release process using this Fe 3 O 4 @SiO 2 @GQD-FA/DOX nanoprobe. Cell viability study demonstrated the low cytotoxicity of Fe 3 O 4 @SiO 2 @GQD-FA nanocarrier and the enhanced therapeutic efficacy of Fe 3 O 4 @SiO 2 @GQD-FA/DOX nanoprobe for cancer cells. This luminomagnetic nanoprobe will be a potential platform for cancer accurate diagnosis and therapy. Copyright © 2016 Elsevier B.V. All rights reserved.

All-fiber Mach-Zehnder type interferometers formed in photonic crystal fiber

NASA Astrophysics Data System (ADS)

Choi, Hae Young; Kim, Myoung Jin; Lee, Byeong Ha

2007-04-01

We propose simple and compact methods for implementing all-fiber interferometers. The interference between the core and the cladding modes of a photonic crystal fiber (PCF) is utilized. To excite the cladding modes from the fundamental core mode of a PCF, a coupling point or region is formed by using two methods. One is fusion splicing two pieces of a PCF with a small lateral offset, and the other is partially collapsing the air-holes in a single piece of PCF. By making another coupling point at a different location along the fiber, the proposed all-PCF interferometer is implemented. The spectral response of the interferometer is investigated mainly in terms of its wavelength spectrum. The spatial frequency of the spectrum was proportional to the physical length of the interferometer and the difference between the modal group indices of involved waveguide modes. For the splicing type interferometer, only a single spatial frequency component was dominantly observed, while the collapsing type was associated with several components at a time. By analyzing the spatial frequency spectrum of the wavelength spectrum, the modal group index differences of the PCF were obtained from to . As potential applications of the all-PCF interferometer, strain sensing is experimentally demonstrated and ultra-high temperature sensing is proposed.

Hearing regulates Drosophila aggression.

PubMed

Versteven, Marijke; Vanden Broeck, Lies; Geurten, Bart; Zwarts, Liesbeth; Decraecker, Lisse; Beelen, Melissa; Göpfert, Martin C; Heinrich, Ralf; Callaerts, Patrick

2017-02-21

Aggression is a universal social behavior important for the acquisition of food, mates, territory, and social status. Aggression in Drosophila is context-dependent and can thus be expected to involve inputs from multiple sensory modalities. Here, we use mechanical disruption and genetic approaches in Drosophila melanogaster to identify hearing as an important sensory modality in the context of intermale aggressive behavior. We demonstrate that neuronal silencing and targeted knockdown of hearing genes in the fly's auditory organ elicit abnormal aggression. Further, we show that exposure to courtship or aggression song has opposite effects on aggression. Our data define the importance of hearing in the control of Drosophila intermale aggression and open perspectives to decipher how hearing and other sensory modalities are integrated at the neural circuit level.

Hearing regulates Drosophila aggression

PubMed Central

Versteven, Marijke; Vanden Broeck, Lies; Geurten, Bart; Zwarts, Liesbeth; Decraecker, Lisse; Beelen, Melissa; Göpfert, Martin C.; Heinrich, Ralf; Callaerts, Patrick

2017-01-01

Aggression is a universal social behavior important for the acquisition of food, mates, territory, and social status. Aggression in Drosophila is context-dependent and can thus be expected to involve inputs from multiple sensory modalities. Here, we use mechanical disruption and genetic approaches in Drosophila melanogaster to identify hearing as an important sensory modality in the context of intermale aggressive behavior. We demonstrate that neuronal silencing and targeted knockdown of hearing genes in the fly’s auditory organ elicit abnormal aggression. Further, we show that exposure to courtship or aggression song has opposite effects on aggression. Our data define the importance of hearing in the control of Drosophila intermale aggression and open perspectives to decipher how hearing and other sensory modalities are integrated at the neural circuit level. PMID:28115690

Multitask SVM learning for remote sensing data classification

NASA Astrophysics Data System (ADS)

Leiva-Murillo, Jose M.; Gómez-Chova, Luis; Camps-Valls, Gustavo

2010-10-01

Many remote sensing data processing problems are inherently constituted by several tasks that can be solved either individually or jointly. For instance, each image in a multitemporal classification setting could be taken as an individual task but relation to previous acquisitions should be properly considered. In such problems, different modalities of the data (temporal, spatial, angular) gives rise to changes between the training and test distributions, which constitutes a difficult learning problem known as covariate shift. Multitask learning methods aim at jointly solving a set of prediction problems in an efficient way by sharing information across tasks. This paper presents a novel kernel method for multitask learning in remote sensing data classification. The proposed method alleviates the dataset shift problem by imposing cross-information in the classifiers through matrix regularization. We consider the support vector machine (SVM) as core learner and two regularization schemes are introduced: 1) the Euclidean distance of the predictors in the Hilbert space; and 2) the inclusion of relational operators between tasks. Experiments are conducted in the challenging remote sensing problems of cloud screening from multispectral MERIS images and for landmine detection.

Distributed sensing signal analysis of deformable plate/membrane mirrors

NASA Astrophysics Data System (ADS)

Lu, Yifan; Yue, Honghao; Deng, Zongquan; Tzou, Hornsen

2017-11-01

Deformable optical mirrors usually play key roles in aerospace and optical structural systems applied to space telescopes, radars, solar collectors, communication antennas, etc. Limited by the payload capacity of current launch vehicles, the deformable mirrors should be lightweight and are generally made of ultra-thin plates or even membranes. These plate/membrane mirrors are susceptible to external excitations and this may lead to surface inaccuracy and jeopardize relevant working performance. In order to investigate the modal vibration characteristics of the mirror, a piezoelectric layer is fully laminated on its non-reflective side to serve as sensors. The piezoelectric layer is segmented into infinitesimal elements so that microscopic distributed sensing signals can be explored. In this paper, the deformable mirror is modeled as a pre-tensioned plate and membrane respectively and sensing signal distributions of the two models are compared. Different pre-tensioning forces are also applied to reveal the tension effects on the mode shape and sensing signals of the mirror. Analytical results in this study could be used as guideline of optimal sensor/actuator placement for deformable space mirrors.

Efficient two-dimensional compressive sensing in MIMO radar

NASA Astrophysics Data System (ADS)

Shahbazi, Nafiseh; Abbasfar, Aliazam; Jabbarian-Jahromi, Mohammad

2017-12-01

Compressive sensing (CS) has been a way to lower sampling rate leading to data reduction for processing in multiple-input multiple-output (MIMO) radar systems. In this paper, we further reduce the computational complexity of a pulse-Doppler collocated MIMO radar by introducing a two-dimensional (2D) compressive sensing. To do so, we first introduce a new 2D formulation for the compressed received signals and then we propose a new measurement matrix design for our 2D compressive sensing model that is based on minimizing the coherence of sensing matrix using gradient descent algorithm. The simulation results show that our proposed 2D measurement matrix design using gradient decent algorithm (2D-MMDGD) has much lower computational complexity compared to one-dimensional (1D) methods while having better performance in comparison with conventional methods such as Gaussian random measurement matrix.

Robust biological parametric mapping: an improved technique for multimodal brain image analysis

NASA Astrophysics Data System (ADS)

Yang, Xue; Beason-Held, Lori; Resnick, Susan M.; Landman, Bennett A.

2011-03-01

Mapping the quantitative relationship between structure and function in the human brain is an important and challenging problem. Numerous volumetric, surface, region of interest and voxelwise image processing techniques have been developed to statistically assess potential correlations between imaging and non-imaging metrics. Recently, biological parametric mapping has extended the widely popular statistical parametric approach to enable application of the general linear model to multiple image modalities (both for regressors and regressands) along with scalar valued observations. This approach offers great promise for direct, voxelwise assessment of structural and functional relationships with multiple imaging modalities. However, as presented, the biological parametric mapping approach is not robust to outliers and may lead to invalid inferences (e.g., artifactual low p-values) due to slight mis-registration or variation in anatomy between subjects. To enable widespread application of this approach, we introduce robust regression and robust inference in the neuroimaging context of application of the general linear model. Through simulation and empirical studies, we demonstrate that our robust approach reduces sensitivity to outliers without substantial degradation in power. The robust approach and associated software package provides a reliable way to quantitatively assess voxelwise correlations between structural and functional neuroimaging modalities.

Multiscale imaging of bone microdamage

PubMed Central

Poundarik, Atharva A.; Vashishth, Deepak

2015-01-01

Bone is a structural and hierarchical composite that exhibits remarkable ability to sustain complex mechanical loading and resist fracture. Bone quality encompasses various attributes of bone matrix from the quality of its material components (type-I collagen, mineral and non-collagenous matrix proteins) and cancellous microarchitecture, to the nature and extent of bone microdamage. Microdamage, produced during loading, manifests in multiple forms across the scales of hierarchy in bone and functions to dissipate energy and avert fracture. Microdamage formation is a key determinant of bone quality, and through a range of biological and physical mechanisms, accumulates with age and disease. Accumulated microdamage in bone decreases bone strength and increases bone’s propensity to fracture. Thus, a thorough assessment of microdamage, across the hierarchical levels of bone, is crucial to better understand bone quality and bone fracture. This review article details multiple imaging modalities that have been used to study and characterize microdamage; from bulk staining techniques originally developed by Harold Frost to assess linear microcracks, to atomic force microscopy, a modality that revealed mechanistic insights into the formation diffuse damage at the ultrastructural level in bone. New automated techniques using imaging modalities such as microcomputed tomography are also presented for a comprehensive overview. PMID:25664772

The liminal self in people with multiple sclerosis: an interpretative phenomenological exploration of being diagnosed.

PubMed

Strickland, Karen; Worth, Allison; Kennedy, Catriona

2017-06-01

To explore the lived experience of the meaning of being diagnosed with multiple sclerosis on the individual's sense of self. The time leading up to and immediately following the diagnosis of multiple sclerosis has been identified as a time period shrouded by uncertainty and one where individuals have a heightened desire to seek accurate information and support. The diagnosis brings changes to the way one views the self which has consequences for biographical construction. A hermeneutic phenomenological study. In-depth qualitative interviews were conducted with 10 people recently diagnosed with multiple sclerosis. The data were analysed using interpretative phenomenological analysis. This study presents the three master themes: the 'road to diagnosis', 'the liminal self' and 'learning to live with multiple sclerosis'. The diagnosis of multiple sclerosis may be conceptualised as a 'threshold moment' where the individual's sense of self is disrupted from the former taken-for-granted way of being and propose a framework which articulates the transition. The findings highlight the need for healthcare professionals to develop interventions to better support people affected by a new diagnosis of multiple sclerosis. The conceptual framework which has been developed from the data and presented in this study provides a new way of understanding the impact of the diagnosis on the individual's sense of self when affected by a new diagnosis of multiple sclerosis. This framework can guide healthcare professionals in the provision of supportive care around the time of diagnosis. The findings provide practitioners with a new way of understanding the impact of the diagnosis on the individual's sense of self and a framework which can guide them in the provision of supportive care around the time of diagnosis. © 2016 John Wiley & Sons Ltd.

Non-ablative fractional resurfacing in combination with topical tretinoin cream as a field treatment modality for multiple actinic keratosis: a pilot study and a review of other field treatment modalities.

PubMed

Prens, Sebastiaan P; de Vries, Karin; Neumann, H A Martino; Prens, Errol P

2013-06-01

Actinic keratoses (AK) are premalignant lesions occurring mainly in sun-damaged skin. Current topical treatment options for AK and photo-damaged skin such as liquid nitrogen and electrosurgery are not suitable for field treatment. Otherwise, therapies suitable for field treatment bring along considerable patient discomfort. Non-ablative fractional resurfacing has emerged as a logical treatment option especially for field treatment of AK. To evaluate the clinical efficacy of fractional laser therapy for clearing AK and improving skin quality. To compare patient friendliness of the "fractional" therapy with those reported for other field treatment modalities. Ten patients with Fitzpatrick skin type I to III with multiple AK and extensive sun-damaged skin, received 5-10 sessions with a 4-week interval using a 1550 nm Erbium-Glass Fractionated laser (Sellas, Korea). Four weeks and 24 weeks after the last treatment the clinical results were evaluated by an independent physician. The mean degree of improvement, in terms of reduction in the number of AK and improvement of skin texture, was 54% on a 4 point PGA scale, and persisted for approximately 6 months. The biggest advantage of fractional laser treatment, besides the eradication of AK and a clear rejuvenation effect, is the absence of "downtime". Fractional non-ablative resurfacing induces significant reduction in the number of AK and improves the skin quality. Also all patients preferred fractional laser therapy above other AK treatment modalities.

[Physical inactivity and associated factors in adults, São Paulo, Brazil].

PubMed

Zanchetta, Luane Margarete; Barros, Marilisa Berti de Azevedo; César, Chester Luiz Galvão; Carandina, Luana; Goldbaum, Moisés; Alves, Maria Cecília Goi Porto

2010-09-01

To analyze the prevalence of overall and leisure time physical inactivity and associated factors and types of exercises or sports modalities according to schooling in 2,050 adults from 18 to 59 years of age - state of São Paulo, Brazil. Population-based cross-sectional study with a stratified sample of clusters performed in multiple stages. Physical inactivity was determined using the short version of the International Physical Activity Questionnaire - IPAQ and by a question on the regular practice of leisure time physical activity. Data analysis took the sample design into account. Prevalence of physical inactivity during leisure was higher among women. Poisson multiple regression model in man indicated that overall sedentarism was lower among single and separated men, students and without car in the household. Leisure physical inactivity was greater among men over forty years, among those with less schooling and full-time students. Overall physical inactivity was more prevalent among woman with more schooling, with less qualified occupations and widows. Leisure physical inactivity decreased with age and schooling. Among modalities practiced for leisure, walking was more prevalent among women and football was more prevalent among men. Most modalities were directly associated with schooling; approximately 25% of the individuals with more than 12 years of schooling practiced walking. These results suggest that interventions and public policies to promote physical activity should consider differences in gender and socioeconomic status as well as the preferences for different modalities and the context in which the physical activity is practiced.

Integrated trimodal SSEP experimental setup for visual, auditory and tactile stimulation

NASA Astrophysics Data System (ADS)

Kuś, Rafał; Spustek, Tomasz; Zieleniewska, Magdalena; Duszyk, Anna; Rogowski, Piotr; Suffczyński, Piotr

2017-12-01

Objective. Steady-state evoked potentials (SSEPs), the brain responses to repetitive stimulation, are commonly used in both clinical practice and scientific research. Particular brain mechanisms underlying SSEPs in different modalities (i.e. visual, auditory and tactile) are very complex and still not completely understood. Each response has distinct resonant frequencies and exhibits a particular brain topography. Moreover, the topography can be frequency-dependent, as in case of auditory potentials. However, to study each modality separately and also to investigate multisensory interactions through multimodal experiments, a proper experimental setup appears to be of critical importance. The aim of this study was to design and evaluate a novel SSEP experimental setup providing a repetitive stimulation in three different modalities (visual, tactile and auditory) with a precise control of stimuli parameters. Results from a pilot study with a stimulation in a particular modality and in two modalities simultaneously prove the feasibility of the device to study SSEP phenomenon. Approach. We developed a setup of three separate stimulators that allows for a precise generation of repetitive stimuli. Besides sequential stimulation in a particular modality, parallel stimulation in up to three different modalities can be delivered. Stimulus in each modality is characterized by a stimulation frequency and a waveform (sine or square wave). We also present a novel methodology for the analysis of SSEPs. Main results. Apart from constructing the experimental setup, we conducted a pilot study with both sequential and simultaneous stimulation paradigms. EEG signals recorded during this study were analyzed with advanced methodology based on spatial filtering and adaptive approximation, followed by statistical evaluation. Significance. We developed a novel experimental setup for performing SSEP experiments. In this sense our study continues the ongoing research in this field. On the other hand, the described setup along with the presented methodology is a considerable improvement and an extension of methods constituting the state-of-the-art in the related field. Device flexibility both with developed analysis methodology can lead to further development of diagnostic methods and provide deeper insight into information processing in the human brain.

Supporting Students in Making Sense of Connections and in Becoming Perceptually Fluent in Making Connections among Multiple Graphical Representations

ERIC Educational Resources Information Center

Rau, Martina A.; Aleven, Vincent; Rummel, Nikol

2017-01-01

Prior research shows that multiple representations can enhance learning, provided that students make connections among them. We hypothesized that support for connection making is most effective in enhancing learning of domain knowledge if it helps students both in making sense of these connections and in becoming perceptually fluent in making…

Effect of stimulus type and temperature on EEG reactivity in cardiac arrest.

PubMed

Fantaneanu, Tadeu A; Tolchin, Benjamin; Alvarez, Vincent; Friolet, Raymond; Avery, Kathleen; Scirica, Benjamin M; O'Brien, Molly; Henderson, Galen V; Lee, Jong Woo

2016-11-01

Electroencephalogram (EEG) background reactivity is a reliable outcome predictor in cardiac arrest patients post therapeutic hypothermia. However, there is no consensus on modality testing and prior studies reveal only fair to moderate agreement rates. The aim of this study was to explore different stimulus modalities and report interrater agreements. We studied a multicenter, prospectively collected cohort of cardiac arrest patients who underwent therapeutic hypothermia between September 2014 and December 2015. We identified patients with reactivity data and evaluated interrater agreements of different stimulus modalities tested in hypothermia and normothermia. Of the 60 patients studied, agreement rates were moderate to substantial during hypothermia and fair to moderate during normothermia. Bilateral nipple pressure is more sensitive (80%) when compared to other modalities in eliciting a reactive background in hypothermia. Auditory, nasal tickle, nailbed pressure and nipple pressure reactivity were associated with good outcomes in both hypothermia and normothermia. EEG reactivity varies depending on the stimulus testing modality as well as the temperature during which stimulation is performed, with nipple pressure emerging as the most sensitive during hypothermia for reactivity and outcome determination. This highlights the importance of multiple stimulus testing modalities in EEG reactivity determination to reduce false negatives and optimize prognostication. Copyright © 2016 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Forest Attributes from Radar Interferometric Structure and its Fusion with Optical Remote Sensing

NASA Technical Reports Server (NTRS)

Treuhaft, Robert N.; Law, Beverly E.; Asner, Gregory P.

2004-01-01

The possibility of global, three-dimensional remote sensing of forest structure with interferometric synthetic aperture radar (InSAR) bears on important forest ecological processes, particularly the carbon cycle. InSAR supplements two-dimensional remote sensing with information in the vertical dimension. Its strengths in potential for global coverage complement those of lidar (light detecting and ranging), which has the potential for high-accuracy vertical profiles over small areas. InSAR derives its sensitivity to forest vertical structure from the differences in signals received by two, spatially separate radar receivers. Estimation of parameters describing vertical structure requires multiple-polarization, multiple-frequency, or multiple-baseline InSAR. Combining InSAR with complementary remote sensing techniques, such as hyperspectral optical imaging and lidar, can enhance vertical-structure estimates and consequent biophysical quantities of importance to ecologists, such as biomass. Future InSAR experiments will supplement recent airborne and spaceborne demonstrations, and together with inputs from ecologists regarding structure, they will suggest designs for future spaceborne strategies for measuring global vegetation structure.

Compressed Sensing mm-Wave SAR for Non-Destructive Testing Applications Using Multiple Weighted Side Information.

PubMed

Becquaert, Mathias; Cristofani, Edison; Van Luong, Huynh; Vandewal, Marijke; Stiens, Johan; Deligiannis, Nikos

2018-05-31

This work explores an innovative strategy for increasing the efficiency of compressed sensing applied on mm-wave SAR sensing using multiple weighted side information. The approach is tested on synthetic and on real non-destructive testing measurements performed on a 3D-printed object with defects while taking advantage of multiple previous SAR images of the object with different degrees of similarity. The tested algorithm attributes autonomously weights to the side information at two levels: (1) between the components inside the side information and (2) between the different side information. The reconstruction is thereby almost immune to poor quality side information while exploiting the relevant components hidden inside the added side information. The presented results prove that, in contrast to common compressed sensing, good SAR image reconstruction is achieved at subsampling rates far below the Nyquist rate. Moreover, the algorithm is shown to be much more robust for low quality side information compared to coherent background subtraction.

Passive detection of vehicle loading

NASA Astrophysics Data System (ADS)

McKay, Troy R.; Salvaggio, Carl; Faulring, Jason W.; Salvaggio, Philip S.; McKeown, Donald M.; Garrett, Alfred J.; Coleman, David H.; Koffman, Larry D.

2012-01-01

The Digital Imaging and Remote Sensing Laboratory (DIRS) at the Rochester Institute of Technology, along with the Savannah River National Laboratory is investigating passive methods to quantify vehicle loading. The research described in this paper investigates multiple vehicle indicators including brake temperature, tire temperature, engine temperature, acceleration and deceleration rates, engine acoustics, suspension response, tire deformation and vibrational response. Our investigation into these variables includes building and implementing a sensing system for data collection as well as multiple full-scale vehicle tests. The sensing system includes; infrared video cameras, triaxial accelerometers, microphones, video cameras and thermocouples. The full scale testing includes both a medium size dump truck and a tractor-trailer truck on closed courses with loads spanning the full range of the vehicle's capacity. Statistical analysis of the collected data is used to determine the effectiveness of each of the indicators for characterizing the weight of a vehicle. The final sensing system will monitor multiple load indicators and combine the results to achieve a more accurate measurement than any of the indicators could provide alone.

Rewriting the Script: Multiple Modalities in a High School Humanities Classroom

ERIC Educational Resources Information Center

Block, Joshua

2014-01-01

In this article, Joshua Block states that his high school students are creators discovering how to express their ideas and emotions in multiple, complex ways. He teaches students who write their lives through words on pages as they fill journal after journal. There are others who constantly write and create in the form of tweets, photos, videos,…

Wearable knee health rehabilitation assessment using acoustical emissions

NASA Astrophysics Data System (ADS)

Teague, Caitlin N.; Hersek, Sinan; Conant, Jordan L.; Gilliland, Scott M.; Inan, Omer T.

2017-02-01

We have developed a novel, wearable sensing system based on miniature piezoelectric contact microphones for measuring the acoustical emissions from the knee during movement. The system consists of two contact microphones, positioned on the medial and lateral sides of the patella, connected to custom, analog pre-amplifier circuits and a microcontroller for digitization and data storage on a secure digital card. Tn addition to the acoustical sensing, the system includes two integrated inertial measurement sensors including accelerometer and gyroscope modalities to enable joint angle calculations; these sensors, with digital outputs, are connected directly to the same microcontroller. The system provides low noise, accurate joint acoustical emission and angle measurements in a wearable form factor and has several hours of battery life.

Visual enhancing of tactile perception in the posterior parietal cortex.

PubMed

Ro, Tony; Wallace, Ruth; Hagedorn, Judith; Farnè, Alessandro; Pienkos, Elizabeth

2004-01-01

The visual modality typically dominates over our other senses. Here we show that after inducing an extreme conflict in the left hand between vision of touch (present) and the feeling of touch (absent), sensitivity to touch increases for several minutes after the conflict. Transcranial magnetic stimulation of the posterior parietal cortex after this conflict not only eliminated the enduring visual enhancement of touch, but also impaired normal tactile perception. This latter finding demonstrates a direct role of the parietal lobe in modulating tactile perception as a result of the conflict between these senses. These results provide evidence for visual-to-tactile perceptual modulation and demonstrate effects of illusory vision of touch on touch perception through a long-lasting modulatory process in the posterior parietal cortex.

A multiple camera tongue switch for a child with severe spastic quadriplegic cerebral palsy.

PubMed

Leung, Brian; Chau, Tom

2010-01-01

The present study proposed a video-based access technology that facilitated a non-contact tongue protrusion access modality for a 7-year-old boy with severe spastic quadriplegic cerebral palsy (GMFCS level 5). The proposed system featured a centre camera and two peripheral cameras to extend coverage of the frontal face view of this user for longer durations. The child participated in a descriptive case study. The participant underwent 3 months of tongue protrusion training while the multiple camera tongue switch prototype was being prepared. Later, the participant was brought back for five experiment sessions where he worked on a single-switch picture matching activity, using the multiple camera tongue switch prototype in a controlled environment. The multiple camera tongue switch achieved an average sensitivity of 82% and specificity of 80%. In three of the experiment sessions, the peripheral cameras were associated with most of the true positive switch activations. These activations would have been missed by a centre-camera-only setup. The study demonstrated proof-of-concept of a non-contact tongue access modality implemented by a video-based system involving three cameras and colour video processing.

Dual modal endoscopic cancer detection based on optical pH sensing and Raman spectroscopy

NASA Astrophysics Data System (ADS)

Kim, Soogeun; Kim, ByungHyun; Sohn, Won Bum; Byun, Kyung Min; Lee, Soo Yeol

2017-02-01

To discriminate between normal and cancerous tissue, a dual modal approach using Raman spectroscopy and pH sensor was designed and applied. Raman spectroscopy has demonstrated the possibility of using as diagnostic method for the early detection of precancerous and cancerous lesions in vivo. It also can be used in identifying markers associated with malignant change. However, Raman spectroscopy lacks sufficient sensitivity due to very weak Raman scattering signal or less distinctive spectral pattern. A dual modal approach could be one of the solutions to solve this issue. The level of extracellular pH in cancer tissue is lower than that in normal tissue due to increased lactic acid production, decreased interstitial fluid buffering and decreased perfusion. High sensitivity and specificity required for accurate cancer diagnosis could be achieved by combining the chemical information from Raman spectrum with metabolic information from pH level. Raman spectra were acquired by using a fiber optic Raman probe, a cooled CCD camera connected to a spectrograph and 785 nm laser source. Different transmission spectra depending on tissue pH were measured by a lossy-mode resonance sensor based on fiber optic. The discriminative capability of pH-Raman dual modal method was evaluated using principal component analysis (PCA). The obtained results showed that the pH-Raman dual modal approach can improve discriminative capability between normal and cancerous tissue, which can lead to very high sensitivity and specificity. The proposed method for cancer detection is expected to be used in endoscopic diagnosis later.

Aging and the interaction of sensory cortical function and structure.

PubMed

Peiffer, Ann M; Hugenschmidt, Christina E; Maldjian, Joseph A; Casanova, Ramon; Srikanth, Ryali; Hayasaka, Satoru; Burdette, Jonathan H; Kraft, Robert A; Laurienti, Paul J

2009-01-01

Even the healthiest older adults experience changes in cognitive and sensory function. Studies show that older adults have reduced neural responses to sensory information. However, it is well known that sensory systems do not act in isolation but function cooperatively to either enhance or suppress neural responses to individual environmental stimuli. Very little research has been dedicated to understanding how aging affects the interactions between sensory systems, especially cross-modal deactivations or the ability of one sensory system (e.g., audition) to suppress the neural responses in another sensory system cortex (e.g., vision). Such cross-modal interactions have been implicated in attentional shifts between sensory modalities and could account for increased distractibility in older adults. To assess age-related changes in cross-modal deactivations, functional MRI studies were performed in 61 adults between 18 and 80 years old during simple auditory and visual discrimination tasks. Results within visual cortex confirmed previous findings of decreased responses to visual stimuli for older adults. Age-related changes in the visual cortical response to auditory stimuli were, however, much more complex and suggested an alteration with age in the functional interactions between the senses. Ventral visual cortical regions exhibited cross-modal deactivations in younger but not older adults, whereas more dorsal aspects of visual cortex were suppressed in older but not younger adults. These differences in deactivation also remained after adjusting for age-related reductions in brain volume of sensory cortex. Thus, functional differences in cortical activity between older and younger adults cannot solely be accounted for by differences in gray matter volume. (c) 2007 Wiley-Liss, Inc.

[Sulfide ooze mud and sodium chloride baths in treating osteoarthrosis patients].

PubMed

Novikova, N V

1989-01-01

Humoral immunity initially affected in patients with osteoarthrosis returns to normal under the influence of a multiple-modality treatment involving application of sulphide moor in combination with sodium chloride baths.

[Physical factors in the treatment of patients with osteoarthrosis and venous insufficiency].

PubMed

Tereshina, L G; Oranskiĭ, I E; Kozlova, L A; Veselkova, E E

1995-01-01

Comparative evaluation of two variants of multiple modality treatment for osteoarthritis gives preference to combination of decimetric wave radiation and effervescent baths over magnetotherapy combination with effervescent baths.

A clinically oriented comprehensive pictorial review of canine elbow anatomy.

PubMed

Constantinescu, Gheorghe M; Constantinescu, Ileana A

2009-02-01

The clinically oriented canine elbow anatomy in its complexity earned a high importance in surgery especially after multiple imaging modalities have been used in the benefit of diagnosis and treatment of canine elbow disorders. The bony, joint, and muscular structures, the arteries, the veins and the nerves supplying the elbow are described and illustrated in textbooks and atlases in the context of the comparative anatomy. Nevertheless, there is no publication focused on all of these structures described together from the skin to the bones in a systematic and topographic order, nor through cross and/or sagittal and coronal sections. The figures used in this article are original and drawn after dissection, cross, sagittal, and coronal sections of the elbow structures. The sections are correlated to the multiple imaging modalities shown in the next article.

Challenges and Support When Teaching Science Through an Integrated Inquiry and Literacy Approach

NASA Astrophysics Data System (ADS)

Ødegaard, Marianne; Haug, Berit; Mork, Sonja M.; Ove Sørvik, Gard

2014-12-01

In the Budding Science and Literacy project, we explored how working with an integrated inquiry-based science and literacy approach may challenge and support the teaching and learning of science at the classroom level. By studying the inter-relationship between multiple learning modalities and phases of inquiry, we wished to illuminate possible dynamics between science inquiry and literacy in an integrated science approach. Six teachers and their students were recruited from a professional development course for the current classroom study. The teachers were to try out the Budding Science teaching model. This paper presents an overall video analysis of our material demonstrating variations and patterns of inquiry-based science and literacy activities. Our analysis revealed that multiple learning modalities (read it, write it, do it, and talk it) are used in the integrated approach; oral activities dominate. The inquiry phases shifted throughout the students' investigations, but the consolidating phases of discussion and communication were given less space. The data phase of inquiry seems essential as a driving force for engaging in science learning in consolidating situations. The multiple learning modalities were integrated in all inquiry phases, but to a greater extent in preparation and data. Our results indicate that literacy activities embedded in science inquiry provide support for teaching and learning science; however, the greatest challenge for teachers is to find the time and courage to exploit the discussion and communication phases to consolidate the students' conceptual learning.

Assessment of feedback modalities for wearable visual aids in blind mobility

PubMed Central

Sorrentino, Paige; Bohlool, Shadi; Zhang, Carey; Arditti, Mort; Goodrich, Gregory; Weiland, James D.

2017-01-01

Sensory substitution devices engage sensory modalities other than vision to communicate information typically obtained through the sense of sight. In this paper, we examine the ability of subjects who are blind to follow simple verbal and vibrotactile commands that allow them to navigate a complex path. A total of eleven visually impaired subjects were enrolled in the study. Prototype systems were developed to deliver verbal and vibrotactile commands to allow an investigator to guide a subject through a course. Using this mode, subjects could follow commands easily and navigate significantly faster than with their cane alone (p <0.05). The feedback modes were similar with respect to the increased speed for course completion. Subjects rated usability of the feedback systems as “above average” with scores of 76.3 and 90.9 on the system usability scale. PMID:28182731

Vibration monitoring of a helicopter blade model using the optical fiber distributed strain sensing technique.

PubMed

Wada, Daichi; Igawa, Hirotaka; Kasai, Tokio

2016-09-01

We demonstrate a dynamic distributed monitoring technique using a long-length fiber Bragg grating (FBG) interrogated by optical frequency domain reflectometry (OFDR) that measures strain at a speed of 150 Hz, spatial resolution of 1 mm, and measurement range of 20 m. A 5 m FBG is bonded to a 5.5 m helicopter blade model, and vibration is applied by the step relaxation method. The time domain responses of the strain distributions are measured, and the blade deflections are calculated based on the strain distributions. Frequency response functions are obtained using the time domain responses of the calculated deflection induced by the preload release, and the modal parameters are retrieved. Experimental results demonstrated the dynamic monitoring performances and the applicability to the modal analysis of the OFDR-FBG technique.

3D multi-scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi-modality MR Images.

PubMed

Li, Xiaomeng; Dou, Qi; Chen, Hao; Fu, Chi-Wing; Qi, Xiaojuan; Belavý, Daniel L; Armbrecht, Gabriele; Felsenberg, Dieter; Zheng, Guoyan; Heng, Pheng-Ann

2018-04-01

Intervertebral discs (IVDs) are small joints that lie between adjacent vertebrae. The localization and segmentation of IVDs are important for spine disease diagnosis and measurement quantification. However, manual annotation is time-consuming and error-prone with limited reproducibility, particularly for volumetric data. In this work, our goal is to develop an automatic and accurate method based on fully convolutional networks (FCN) for the localization and segmentation of IVDs from multi-modality 3D MR data. Compared with single modality data, multi-modality MR images provide complementary contextual information, which contributes to better recognition performance. However, how to effectively integrate such multi-modality information to generate accurate segmentation results remains to be further explored. In this paper, we present a novel multi-scale and modality dropout learning framework to locate and segment IVDs from four-modality MR images. First, we design a 3D multi-scale context fully convolutional network, which processes the input data in multiple scales of context and then merges the high-level features to enhance the representation capability of the network for handling the scale variation of anatomical structures. Second, to harness the complementary information from different modalities, we present a random modality voxel dropout strategy which alleviates the co-adaption issue and increases the discriminative capability of the network. Our method achieved the 1st place in the MICCAI challenge on automatic localization and segmentation of IVDs from multi-modality MR images, with a mean segmentation Dice coefficient of 91.2% and a mean localization error of 0.62 mm. We further conduct extensive experiments on the extended dataset to validate our method. We demonstrate that the proposed modality dropout strategy with multi-modality images as contextual information improved the segmentation accuracy significantly. Furthermore, experiments conducted on extended data collected from two different time points demonstrate the efficacy of our method on tracking the morphological changes in a longitudinal study. Copyright © 2018 Elsevier B.V. All rights reserved.

Advances of Molecular Imaging for Monitoring the Anatomical and Functional Architecture of the Olfactory System.

PubMed

Zhang, Xintong; Bi, Anyao; Gao, Quansheng; Zhang, Shuai; Huang, Kunzhu; Liu, Zhiguo; Gao, Tang; Zeng, Wenbin

2016-01-20

The olfactory system of organisms serves as a genetically and anatomically model for studying how sensory input can be translated into behavior output. Some neurologic diseases are considered to be related to olfactory disturbance, especially Alzheimer's disease, Parkinson's disease, multiple sclerosis, and so forth. However, it is still unclear how the olfactory system affects disease generation processes and olfaction delivery processes. Molecular imaging, a modern multidisciplinary technology, can provide valid tools for the early detection and characterization of diseases, evaluation of treatment, and study of biological processes in living subjects, since molecular imaging applies specific molecular probes as a novel approach to produce special data to study biological processes in cellular and subcellular levels. Recently, molecular imaging plays a key role in studying the activation of olfactory system, thus it could help to prevent or delay some diseases. Herein, we present a comprehensive review on the research progress of the imaging probes for visualizing olfactory system, which is classified on different imaging modalities, including PET, MRI, and optical imaging. Additionally, the probes' design, sensing mechanism, and biological application are discussed. Finally, we provide an outlook for future studies in this field.

Multi-modal distraction: insights from children's limited attention.

PubMed

Matusz, Pawel J; Broadbent, Hannah; Ferrari, Jessica; Forrest, Benjamin; Merkley, Rebecca; Scerif, Gaia

2015-03-01

How does the multi-sensory nature of stimuli influence information processing? Cognitive systems with limited selective attention can elucidate these processes. Six-year-olds, 11-year-olds and 20-year-olds engaged in a visual search task that required them to detect a pre-defined coloured shape under conditions of low or high visual perceptual load. On each trial, a peripheral distractor that could be either compatible or incompatible with the current target colour was presented either visually, auditorily or audiovisually. Unlike unimodal distractors, audiovisual distractors elicited reliable compatibility effects across the two levels of load in adults and in the older children, but high visual load significantly reduced distraction for all children, especially the youngest participants. This study provides the first demonstration that multi-sensory distraction has powerful effects on selective attention: Adults and older children alike allocate attention to potentially relevant information across multiple senses. However, poorer attentional resources can, paradoxically, shield the youngest children from the deleterious effects of multi-sensory distraction. Furthermore, we highlight how developmental research can enrich the understanding of distinct mechanisms controlling adult selective attention in multi-sensory environments. Copyright © 2014 Elsevier B.V. All rights reserved.

From Pressure to Path: Barometer-based Vehicle Tracking

PubMed Central

Ho, Bo-Jhang; Martin, Paul; Swaminathan, Prashanth; Srivastava, Mani

2017-01-01

Pervasive mobile devices have enabled countless context-and location-based applications that facilitate navigation, life-logging, and more. As we build the next generation of smart cities, it is important to leverage the rich sensing modalities that these numerous devices have to offer. This work demonstrates how mobile devices can be used to accurately track driving patterns based solely on pressure data collected from the device’s barometer. Specifically, by correlating pressure time-series data against topographic elevation data and road maps for a given region, a centralized computer can estimate the likely paths through which individual users have driven, providing an exceptionally low-power method for measuring driving patterns of a given individual or for analyzing group behavior across multiple users. This work also brings to bear a more nefarious side effect of pressure-based path estimation: a mobile application can, without consent and without notifying the user, use pressure data to accurately detect an individual’s driving behavior, compromising both user privacy and security. We further analyze the ability to predict driving trajectories in terms of the variance in barometer pressure and geographical elevation, demonstrating cases in which more than 80% of paths can be accurately predicted. PMID:29503981

From Pressure to Path: Barometer-based Vehicle Tracking.

PubMed

Ho, Bo-Jhang; Martin, Paul; Swaminathan, Prashanth; Srivastava, Mani

2015-11-01

Pervasive mobile devices have enabled countless context-and location-based applications that facilitate navigation, life-logging, and more. As we build the next generation of smart cities, it is important to leverage the rich sensing modalities that these numerous devices have to offer. This work demonstrates how mobile devices can be used to accurately track driving patterns based solely on pressure data collected from the device's barometer. Specifically, by correlating pressure time-series data against topographic elevation data and road maps for a given region, a centralized computer can estimate the likely paths through which individual users have driven, providing an exceptionally low-power method for measuring driving patterns of a given individual or for analyzing group behavior across multiple users. This work also brings to bear a more nefarious side effect of pressure-based path estimation: a mobile application can, without consent and without notifying the user, use pressure data to accurately detect an individual's driving behavior, compromising both user privacy and security. We further analyze the ability to predict driving trajectories in terms of the variance in barometer pressure and geographical elevation, demonstrating cases in which more than 80% of paths can be accurately predicted.

The Angular Gyrus

PubMed Central

2013-01-01

There is considerable interest in the structural and functional properties of the angular gyrus (AG). Located in the posterior part of the inferior parietal lobule, the AG has been shown in numerous meta-analysis reviews to be consistently activated in a variety of tasks. This review discusses the involvement of the AG in semantic processing, word reading and comprehension, number processing, default mode network, memory retrieval, attention and spatial cognition, reasoning, and social cognition. This large functional neuroimaging literature depicts a major role for the AG in processing concepts rather than percepts when interfacing perception-to-recognition-to-action. More specifically, the AG emerges as a cross-modal hub where converging multisensory information is combined and integrated to comprehend and give sense to events, manipulate mental representations, solve familiar problems, and reorient attention to relevant information. In addition, this review discusses recent findings that point to the existence of multiple subdivisions in the AG. This spatial parcellation can serve as a framework for reporting AG activations with greater definition. This review also acknowledges that the role of the AG cannot comprehensibly be identified in isolation but needs to be understood in parallel with the influence from other regions. Several interesting questions that warrant further investigations are finally emphasized. PMID:22547530

On the generalizability of the Chunk-and-Pass processing approach: Perspectives from language acquisition and music.

PubMed

Lakshmanan, Usha; Graham, Robert E

2016-01-01

Christiansen & Chater (C&C) offer the Chunk-and-Pass strategy as a language processing approach allowing humans to make sense of incoming language in the face of cognitive and perceptual constraints. We propose that the Chunk-and-Pass strategy is not adequate to extend universally across languages (accounting for typologically diverse languages), nor is it sufficient to generalize to other auditory modalities such as music.

Making sense of endovascular therapies for femoropopliteal disease.

PubMed

Altin, S Elissa; Abbott, J Dawn

2018-06-01

The femoropoliteal segment is a common target for endovascular intervention and the unique biomechanical forces on the arteries increase the risk of restenosis This large meta-analysis supports drug coated balloons as the initial endovascular strategy due to lower risk of target lesion revascularization compared to other modalities Whether there are subgroups of patients or lesion types that benefit from an alternative revascularization approach is unclear and warrants investigation. © 2018 Wiley Periodicals, Inc.

Utilizing Glove-Based Gestures and a Tactile Vest Display for Covert Communications and Robot Control

DTIC Science & Technology

2014-06-01

transmitted from a controller mechanism that contains inertial measurement unit ( IMU ) sensors to sense rotation and acceleration of movement. Earlier...assets, and standard hand signal commands can be presented to human team members via a variety of modalities. IMU sensor technologies placed on the body...obstacle event (e.g., climbing, crawling, combat roll , running) and between obstacles (i.e., walking). The following analyses are for each task

A cooperative function for multisensory stimuli in the induction of approach behavior of a potential mate

PubMed Central

Ågmo, Anders

2017-01-01

Intrasexual competition is an important element of natural selection in which the most attractive conspecific has a considerable reproductive advantage over the others. The conspecifics that are approached first often become the preferred mate partners, and could thus from a biological perspective have a reproductive advantage. This underlines the importance of the initial approach and raises the question of what induces this approach, or what makes a conspecific attractive. Identification of the sensory modalities crucial for the activation of approach is necessary for elucidating the central nervous processes involved in the activation of sexual motivation and eventually copulatory behavior. The initial approach to a potential mate depends on distant stimuli in the modalities of audition, olfaction, vision, and other undefined characteristics. This study investigated the role of the different modalities and the combination of these modalities in the sexual incentive value of a female rat. This study provides evidence that the presence of a single-sensory stimulus with one modality (olfaction, vision, or ‘others’, but not audition) is sufficient to attenuate the preference for a social contact with a male rat. However, a multisensory stimulus of multiple modalities is necessary to induce preference for the stimulus over social contact to a level of an intact receptive female. The initial approach behavior, therefore, seems to be induced by the combination of at least two modalities among which olfaction is crucial. This suggests that there is a cooperative function for the different modalities in the induction of approach behavior of a potential mate. PMID:28306729

Biological fiducial point based registration for multiple brain tissues reconstructed from different imaging modalities

NASA Astrophysics Data System (ADS)

Wu, Huiqun; Zhou, Gangping; Geng, Xingyun; Zhang, Xiaofeng; Jiang, Kui; Tang, Lemin; Zhou, Guomin; Dong, Jiancheng

2013-10-01

With the development of computer aided navigation system, more and more tissues shall be reconstructed to provide more useful information for surgical pathway planning. In this study, we aimed to propose a registration framework for different reconstructed tissues from multi-modalities based on some fiducial points on lateral ventricles. A male patient with brain lesion was admitted and his brain scans were performed by different modalities. Then, the different brain tissues were segmented in different modality with relevant suitable algorithms. Marching cubes were calculated for three dimensional reconstructions, and then the rendered tissues were imported to a common coordinate system for registration. Four pairs of fiducial markers were selected to calculate the rotation and translation matrix using least-square measure method. The registration results were satisfied in a glioblastoma surgery planning as it provides the spatial relationship between tumors and surrounding fibers as well as vessels. Hence, our framework is of potential value for clinicians to plan surgery.

Computer-assisted time-averaged holograms of the motion of the surface of the mammalian tympanic membrane with sound stimuli of 0.4 to 25 kHz

PubMed Central

Rosowski, John J.; Cheng, Jeffrey Tao; Ravicz, Michael E.; Hulli, Nesim; Hernandez-Montes, Maria; Harrington, Ellery; Furlong, Cosme

2009-01-01

Time-averaged holograms describing the sound-induced motion of the tympanic membrane (TM) in cadaveric preparations from three mammalian species and one live ear were measured using opto-electronic holography. This technique allows rapid measurements of the magnitude of motion of the tympanic membrane surface at frequencies as high as 25 kHz. The holograms measured in response to low and middle-frequency sound stimuli are similar to previously reported time-averaged holograms. However, at higher frequencies (f > 4 kHz), our holograms reveal unique TM surface displacement patterns that consist of highly-ordered arrangements of multiple local displacement magnitude maxima, each of which is surrounded by nodal areas of low displacement magnitude. These patterns are similar to modal patterns (two-dimensional standing waves) produced by either the interaction of surface waves traveling in multiple directions or the uniform stimulation of modes of motion that are determined by the structural properties and boundary conditions of the TM. From the ratio of the displacement magnitude peaks to nodal valleys in these apparent surface waves, we estimate a Standing Wave Ratio of at least 4 that is consistent with energy reflection coefficients at the TM boundaries of at least 0.35. It is also consistent with small losses within the uniformly stimulated modal surface waves. We also estimate possible TM surface wave speeds that vary with frequency and species from 20 to 65 m/s, consistent with other estimates in the literature. The presence of standing wave or modal phenomena has previously been intuited from measurements of TM function, but is ignored in some models of tympanic membrane function. Whether these standing waves result either from the interactions of multiple surface waves that travel along the membrane, or by uniformly excited modal displacement patterns of the entire TM surface is still to be determined. PMID:19328841

Computer-assisted time-averaged holograms of the motion of the surface of the mammalian tympanic membrane with sound stimuli of 0.4-25 kHz.

PubMed

Rosowski, John J; Cheng, Jeffrey Tao; Ravicz, Michael E; Hulli, Nesim; Hernandez-Montes, Maria; Harrington, Ellery; Furlong, Cosme

2009-07-01

Time-averaged holograms describing the sound-induced motion of the tympanic membrane (TM) in cadaveric preparations from three mammalian species and one live ear were measured using opto-electronic holography. This technique allows rapid measurements of the magnitude of motion of the tympanic membrane surface at frequencies as high as 25 kHz. The holograms measured in response to low and middle-frequency sound stimuli are similar to previously reported time-averaged holograms. However, at higher frequencies (f>4 kHz), our holograms reveal unique TM surface displacement patterns that consist of highly-ordered arrangements of multiple local displacement magnitude maxima, each of which is surrounded by nodal areas of low displacement magnitude. These patterns are similar to modal patterns (two-dimensional standing waves) produced by either the interaction of surface waves traveling in multiple directions or the uniform stimulation of modes of motion that are determined by the structural properties and boundary conditions of the TM. From the ratio of the displacement magnitude peaks to nodal valleys in these apparent surface waves, we estimate a Standing Wave Ratio of at least 4 that is consistent with energy reflection coefficients at the TM boundaries of at least 0.35. It is also consistent with small losses within the uniformly stimulated modal surface waves. We also estimate possible TM surface wave speeds that vary with frequency and species from 20 to 65 m/s, consistent with other estimates in the literature. The presence of standing wave or modal phenomena has previously been intuited from measurements of TM function, but is ignored in some models of tympanic membrane function. Whether these standing waves result either from the interactions of multiple surface waves that travel along the membrane, or by uniformly excited modal displacement patterns of the entire TM surface is still to be determined.

UAV Cooperation Architectures for Persistent Sensing

DOE Office of Scientific and Technical Information (OSTI.GOV)

Roberts, R S; Kent, C A; Jones, E D

2003-03-20

With the number of small, inexpensive Unmanned Air Vehicles (UAVs) increasing, it is feasible to build multi-UAV sensing networks. In particular, by using UAVs in conjunction with unattended ground sensors, a degree of persistent sensing can be achieved. With proper UAV cooperation algorithms, sensing is maintained even though exceptional events, e.g., the loss of a UAV, have occurred. In this paper a cooperation technique that allows multiple UAVs to perform coordinated, persistent sensing with unattended ground sensors over a wide area is described. The technique automatically adapts the UAV paths so that on the average, the amount of time thatmore » any sensor has to wait for a UAV revisit is minimized. We also describe the Simulation, Tactical Operations and Mission Planning (STOMP) software architecture. This architecture is designed to help simulate and operate distributed sensor networks where multiple UAVs are used to collect data.« less

Employment, Sense of Coherence, and Identity Formation: Contextual and Psychological Processes on the Pathway to Sense of Adulthood

ERIC Educational Resources Information Center

Luyckx, Koen; Schwartz, Seth J.; Goossens, Luc; Pollock, Sophie

2008-01-01

The present study investigated the influence of contextual (i.e., being in college vs. being employed) and psychological (i.e., sense of coherence) processes on achieving a sense of adulthood in a sample of 317 emerging adults. Identity formation, conceptualized as multiple dimensions of exploration and of commitment, was conceived of as a…

Capsule endoscopy in Crohn’s disease: Are we seeing any better?

PubMed Central

Hudesman, David; Mazurek, Jonathan; Swaminath, Arun

2014-01-01

Crohn’s disease (CD) is a complex, immune-mediated disorder that often requires a multi-modality approach for optimal diagnosis and management. While traditional methods include ileocolonoscopy and radiologic modalities, increasingly, capsule endoscopy (CE) has been incorporated into the algorithm for both the diagnosis and monitoring of CD. Multiple studies have examined the utility of this emerging technology in the management of CD, and have compared it to other available modalities. CE offers a noninvasive approach to evaluate areas of the small bowel that are difficult to reach with traditional endoscopy. Furthermore, CE maybe favored in specific sub segments of patients with inflammatory bowel disease (IBD), such as those with IBD unclassified (IBD-U), pediatric patients and patients with CD who have previously undergone surgery. PMID:25278698

TLD linearity vs. beam energy and modality.

PubMed

Troncalli, Andrew J; Chapman, Jane

2002-01-01

Thermoluminescent dosimetry (TLD) is considered to be a valuable dosimetric tool in determining patient dose. Lithium fluoride doped with magnesium and titanium (TLD-100) is widely used, as it does not display widely divergent energy dependence. For many years, we have known that TLD-100 shows supralinearity to dose. In a radiotherapy clinic, there are multiple energies and modality beams. This work investigates whether individual linearity corrections must be used for each beam or whether a single correction can be applied to all beams. The response of TLD as a function of dose was measured from 25 cGy to 1000 cGy on both electrons and photons from 6 to 18 MeV. This work shows that, within our measurement uncertainty, TLD-100 exhibits supralinearity at all megavoltage energies and modalities.

Multiple-modality program for standoff detection of roadside hazards

NASA Astrophysics Data System (ADS)

Williams, Kathryn; Middleton, Seth; Close, Ryan; Luke, Robert H.; Suri, Rajiv

2016-05-01

The U.S. Army RDECOM CERDEC Night Vision and Electronic Sensors Directorate (NVESD) is executing a program to assess the performance of a variety of sensor modalities for standoff detection of roadside explosive hazards. The program objective is to identify an optimal sensor or combination of fused sensors to incorporate with autonomous detection algorithms into a system of systems for use in future route clearance operations. This paper provides an overview of the program, including a description of the sensors under consideration, sensor test events, and ongoing data analysis.

Pharmacological Stress Cardiovascular Magnetic Resonance

PubMed Central

Chotenimitkhun, Runyawan; Hundley, W. Gregory

2013-01-01

Over the past decade, cardiovascular magnetic resonance (CMR) has evolved into a cardiac stress testing modality that can be used to diagnose myocardial ischemia using intravenous dobutamine or vasodilator perfusion agents such as adenosine or dipyridamole. Because CMR produces high-resolution tomographic images of the human heart in multiple imaging planes, it has become a highly attractive noninvasive testing modality for those suspected of having myocardial ischemia. The purpose of this article is to review the clinical, diagnostic, and prognostic utility of stress CMR testing for patients with (or suspected of having) coronary artery disease. PMID:21566427

Active damping of modal vibrations by force apportioning

NASA Technical Reports Server (NTRS)

Hallauer, W. L., Jr.

1980-01-01

Force apportioning, a method of active structural damping based on that used in modal vibration testing of isolating modes by multiple shaker excitation, was analyzed and numerically simulated. A distribution of as few forces as possible on the structure is chosen so as to maximally affect selected vibration modes while minimally exciting all other modes. The accuracy of numerical simulations of active damping, active damping of higher-frequency modes, and studies of imperfection sensitivity are discussed. The computer programs developed are described and possible refinements of the research are examined.

Multimodal browsing using VoiceXML

NASA Astrophysics Data System (ADS)

Caccia, Giuseppe; Lancini, Rosa C.; Peschiera, Giuseppe

2003-06-01

With the increasing development of devices such as personal computers, WAP and personal digital assistants connected to the World Wide Web, end users feel the need to browse the Internet through multiple modalities. We intend to investigate on how to create a user interface and a service distribution platform granting the user access to the Internet through standard I/O modalities and voice simultaneously. Different architectures are evaluated suggesting the more suitable for each client terminal (PC o WAP). In particular the design of the multimodal usermachine interface considers the synchronization issue between graphical and voice contents.

Modality-Driven Classification and Visualization of Ensemble Variance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bensema, Kevin; Gosink, Luke; Obermaier, Harald

Paper for the IEEE Visualization Conference Advances in computational power now enable domain scientists to address conceptual and parametric uncertainty by running simulations multiple times in order to sufficiently sample the uncertain input space.

Neurocognitive insights on conceptual knowledge and its breakdown

PubMed Central

Lambon Ralph, Matthew A.

2014-01-01

Conceptual knowledge reflects our multi-modal ‘semantic database’. As such, it brings meaning to all verbal and non-verbal stimuli, is the foundation for verbal and non-verbal expression and provides the basis for computing appropriate semantic generalizations. Multiple disciplines (e.g. philosophy, cognitive science, cognitive neuroscience and behavioural neurology) have striven to answer the questions of how concepts are formed, how they are represented in the brain and how they break down differentially in various neurological patient groups. A long-standing and prominent hypothesis is that concepts are distilled from our multi-modal verbal and non-verbal experience such that sensation in one modality (e.g. the smell of an apple) not only activates the intramodality long-term knowledge, but also reactivates the relevant intermodality information about that item (i.e. all the things you know about and can do with an apple). This multi-modal view of conceptualization fits with contemporary functional neuroimaging studies that observe systematic variation of activation across different modality-specific association regions dependent on the conceptual category or type of information. A second vein of interdisciplinary work argues, however, that even a smorgasbord of multi-modal features is insufficient to build coherent, generalizable concepts. Instead, an additional process or intermediate representation is required. Recent multidisciplinary work, which combines neuropsychology, neuroscience and computational models, offers evidence that conceptualization follows from a combination of modality-specific sources of information plus a transmodal ‘hub’ representational system that is supported primarily by regions within the anterior temporal lobe, bilaterally. PMID:24324236

An investigation of response and stimulus modality transfer effects after dual-task training in younger and older.

PubMed

Lussier, Maxime; Gagnon, Christine; Bherer, Louis

2012-01-01

It has been shown that dual-task training leads to significant improvement in dual-task performance in younger and older adults. However, the extent to which training benefits to untrained tasks requires further investigation. The present study assessed (a) whether dual-task training leads to cross-modality transfer in untrained tasks using new stimuli and/or motor responses modalities, (b) whether transfer effects are related to improved ability to prepare and maintain multiple task-set and/or enhanced response coordination, (c) whether there are age-related differences in transfer effects. Twenty-three younger and 23 older adults were randomly assigned to dual-task training or control conditions. All participants were assessed before and after training on three dual-task transfer conditions; (1) stimulus modality transfer (2) response modality transfer (3) stimulus and response modalities transfer task. Training group showed larger improvement than the control group in the three transfer dual-task conditions, which suggests that training leads to more than specific learning of stimuli/response associations. Attentional costs analyses showed that training led to improved dual-task cost, only in conditions that involved new stimuli or response modalities, but not both. Moreover, training did not lead to a reduced task-set cost in the transfer conditions, which suggests some limitations in transfer effects that can be expected. Overall, the present study supports the notion that cognitive plasticity for attentional control is preserved in late adulthood.

An eye movement analysis of the effect of interruption modality on primary task resumption.

PubMed

Ratwani, Raj; Trafton, J Gregory

2010-06-01

We examined the effect of interruption modality (visual or auditory) on primary task (visual) resumption to determine which modality was the least disruptive. Theories examining interruption modality have focused on specific periods of the interruption timeline. Preemption theory has focused on the switch from the primary task to the interrupting task. Multiple resource theory has focused on interrupting tasks that are to be performed concurrently with the primary task. Our focus was on examining how interruption modality influences task resumption.We leverage the memory-for-goals theory, which suggests that maintaining an associative link between environmental cues and the suspended primary task goal is important for resumption. Three interruption modality conditions were examined: auditory interruption with the primary task visible, auditory interruption with a blank screen occluding the primary task, and a visual interruption occluding the primary task. Reaction time and eye movement data were collected. The auditory condition with the primary task visible was the least disruptive. Eye movement data suggest that participants in this condition were actively maintaining an associative link between relevant environmental cues on the primary task interface and the suspended primary task goal during the interruption. These data suggest that maintaining cue association is the important factor for reducing the disruptiveness of interruptions, not interruption modality. Interruption-prone computing environments should be designed to allow for the user to have access to relevant primary task cues during an interruption to minimize disruptiveness.

Damage identification in beams using speckle shearography and an optimal spatial sampling

NASA Astrophysics Data System (ADS)

Mininni, M.; Gabriele, S.; Lopes, H.; Araújo dos Santos, J. V.

2016-10-01

Over the years, the derivatives of modal displacement and rotation fields have been used to localize damage in beams. Usually, the derivatives are computed by applying finite differences. The finite differences propagate and amplify the errors that exist in real measurements, and thus, it is necessary to minimize this problem in order to get reliable damage localizations. A way to decrease the propagation and amplification of the errors is to select an optimal spatial sampling. This paper presents a technique where an optimal spatial sampling of modal rotation fields is computed and used to obtain the modal curvatures. Experimental measurements of modal rotation fields of a beam with single and multiple damages are obtained with shearography, which is an optical technique allowing the measurement of full-fields. These measurements are used to test the validity of the optimal sampling technique for the improvement of damage localization in real structures. An investigation on the ability of a model updating technique to quantify the damage is also reported. The model updating technique is defined by the variations of measured natural frequencies and measured modal rotations and aims at calibrating the values of the second moment of area in the damaged areas, which were previously localized.

The influence of the visual modality on language structure and conventionalization: insights from sign language and gesture.

PubMed

Perniss, Pamela; Özyürek, Asli; Morgan, Gary

2015-01-01

For humans, the ability to communicate and use language is instantiated not only in the vocal modality but also in the visual modality. The main examples of this are sign languages and (co-speech) gestures. Sign languages, the natural languages of Deaf communities, use systematic and conventionalized movements of the hands, face, and body for linguistic expression. Co-speech gestures, though non-linguistic, are produced in tight semantic and temporal integration with speech and constitute an integral part of language together with speech. The articles in this issue explore and document how gestures and sign languages are similar or different and how communicative expression in the visual modality can change from being gestural to grammatical in nature through processes of conventionalization. As such, this issue contributes to our understanding of how the visual modality shapes language and the emergence of linguistic structure in newly developing systems. Studying the relationship between signs and gestures provides a new window onto the human ability to recruit multiple levels of representation (e.g., categorical, gradient, iconic, abstract) in the service of using or creating conventionalized communicative systems. Copyright © 2015 Cognitive Science Society, Inc.

Modal Analysis Using the Singular Value Decomposition and Rational Fraction Polynomials

DTIC Science & Technology

2017-04-06

information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and...results. The programs are designed for experimental datasets with multiple drive and response points and have proven effective even for systems with... designed for experimental datasets with multiple drive and response points and have proven effective even for systems with numerous closely-spaced

Increasing Retention of Adult Learners in Telecourses through the Incorporation of Learning-Centered Instructional Strategies and the Use of Multiple Modalities for Content Delivery and Interaction.

ERIC Educational Resources Information Center

Nelson, Lin M.

A project was undertaken to increase retention in a health education telecourse by incorporating a competency-based orientation to distance learning and learner-centered instructional strategies into the telecourse, and by using multiple media for content delivery and interaction. A general orientation to distance learning was developed that…

Airborne and Ground-Based Optical Characterization of Legacy Underground Nuclear Test Sites

NASA Astrophysics Data System (ADS)

Vigil, S.; Craven, J.; Anderson, D.; Dzur, R.; Schultz-Fellenz, E. S.; Sussman, A. J.

2015-12-01

Detecting, locating, and characterizing suspected underground nuclear test sites is a U.S. security priority. Currently, global underground nuclear explosion monitoring relies on seismic and infrasound sensor networks to provide rapid initial detection of potential underground nuclear tests. While seismic and infrasound might be able to generally locate potential underground nuclear tests, additional sensing methods might be required to further pinpoint test site locations. Optical remote sensing is a robust approach for site location and characterization due to the ability it provides to search large areas relatively quickly, resolve surface features in fine detail, and perform these tasks non-intrusively. Optical remote sensing provides both cultural and surface geological information about a site, for example, operational infrastructure, surface fractures. Surface geological information, when combined with known or estimated subsurface geologic information, could provide clues concerning test parameters. We have characterized two legacy nuclear test sites on the Nevada National Security Site (NNSS), U20ak and U20az using helicopter-, ground- and unmanned aerial system-based RGB imagery and light detection and ranging (lidar) systems. The multi-faceted information garnered from these different sensing modalities has allowed us to build a knowledge base of how a nuclear test site might look when sensed remotely, and the standoff distances required to resolve important site characteristics.

Biochemical measurement of bilirubin with an evanescent wave optical sensor

NASA Astrophysics Data System (ADS)

Poscio, Patrick; Depeursinge, Christian D.; Emery, Y.; Parriaux, Olivier M.; Voirin, Guy

1991-09-01

Optical sensing techniques can be considered as powerful information sources on the biochemistry of tissue, blood, and physiological fluids. Various sensing modalities can be considered: spectroscopic determination of the fluorescence or optical absorption of the biological medium itself, or more generally, of a reagent in contact with the biological medium. The principle and realization of the optical sensor developed are based on the use of polished fibers: the cladding of a monomode fiber is removed on a longitudinal section. The device can then be inserted into an hypodermic needle for in-vivo measurements. Using this minute probe, local measurements of the tissue biochemistry or metabolic processes can be obtained. The sensing mechanism is based on the propagation of the evanescent wave in the tissues or reagent: the proximity of the fiber core allows the penetration of the model field tail into the sensed medium, with a uniquely defined field distribution. Single or multi-wavelength analysis of the light collected into the fiber yields the biochemical information. Here an example of this sensing technology is discussed. In-vitro measurement of bilirubin in gastric juice demonstrates that the evanescent wave optical sensor provides a sensitivity which matches the physiological concentrations. A device is proposed for in-vivo monitoring of bilirubin concentration in the gastro-oesophageal tract.

Assessing the Effectiveness of E-learning Integration in College Physics in the Alamo Community Colleges District

NASA Astrophysics Data System (ADS)

Zhou, Qiaoying

Academic achievement and student participation in physics are lower than desired. Research has shown that there is a shortage of college students entering science and technology fields such as physics. E-learning may provide the technology-oriented Net Generation learner an option for taking courses such as physics in a course modality with which they are most comfortable thus garnering more participation and higher academic achievement. A quantitative ex-post facto study was performed to compare face-to-face and E-learning modalities on course completion and physics achievement for an entire introductory physics course. The theoretical framework for this study was based on the constructivist theory of education that implies a student-centered learning process. The sample consisted of 116 students enrolled in introductory physics courses at four 2-year community colleges in Texas. Course completion, SAT scores, Force Concept Inventory examination scores, as well as demographic information and employment information were examined. Linear and ordinal multiple regression analysis were used to determine if course modality is predictive of physics achievement while controlling for general scholastic aptitude, current employment, the presence of children in the home, and teacher evaluations. The results showed that students in the E-learning course performed better on the Force Concept Inventory than those in the traditional course both in the multiple regression analysis, beta = .61, p < .001, and in the ordinal regression analysis, Wald(1) = 18.83, p < .001. A chi-square test was used to determine if course completion rates differ between students in the two course modalities. The results showed no difference in course completion rates between students in the two course modalities, chi 2(1, n = 116) = 1.02, p = .312. It was concluded that students in an E-learning course modality had higher physics achievement but were no more likely to complete the introductory physics course than students were in a face-to-face modality. It was recommended that other colleges and universities should develop and test E-learning courses for introductory physics, that larger sample sizes should be used in future studies, and that additional outcome variables including the likelihood that a student chooses physics as a major or the likelihood that a student completes a physics degree should be examined.

LapTrain: multi-modality training curriculum for laparoscopic cholecystectomy-results of a randomized controlled trial.

PubMed

Kowalewski, K F; Garrow, C R; Proctor, T; Preukschas, A A; Friedrich, M; Müller, P C; Kenngott, H G; Fischer, L; Müller-Stich, B P; Nickel, F

2018-02-12

Multiple training modalities for laparoscopy have different advantages, but little research has been conducted on the benefit of a training program that includes multiple different training methods compared to one method only. This study aimed to evaluate benefits of a combined multi-modality training program for surgical residents. Laparoscopic cholecystectomy (LC) was performed on a porcine liver as the pre-test. Randomization was stratified for experience to the multi-modality Training group (12 h of training on Virtual Reality (VR) and box trainer) or Control group (no training). The post-test consisted of a VR LC and porcine LC. Performance was rated with the Global Operative Assessment of Laparoscopic Skills (GOALS) score by blinded experts. Training (n = 33) and Control (n = 31) were similar in the pre-test (GOALS: 13.7 ± 3.4 vs. 14.7 ± 2.6; p = 0.198; operation time 57.0 ± 18.1 vs. 63.4 ± 17.5 min; p = 0.191). In the post-test porcine LC, Training had improved GOALS scores (+ 2.84 ± 2.85 points, p < 0.001), while Control did not (+ 0.55 ± 2.34 points, p = 0.154). Operation time in the post-test was shorter for Training vs. Control (40.0 ± 17.0 vs. 55.0 ± 22.2 min; p = 0.012). Junior residents improved GOALS scores to the level of senior residents (pre-test: 13.7 ± 2.7 vs. 18.3 ± 2.9; p = 0.010; post-test: 15.5 ± 3.4 vs. 18.8 ± 3.8; p = 0.120) but senior residents remained faster (50.1 ± 20.6 vs. 25.0 ± 1.9 min; p < 0.001). No differences were found between groups on the post-test VR trainer. Structured multi-modality training is beneficial for novices to improve basics and overcome the initial learning curve in laparoscopy as well as to decrease operation time for LCs in different stages of experience. Future studies should evaluate multi-modality training in comparison with single modalities. German Clinical Trials Register DRKS00011040.

Cross-Modal Attention Effects in the Vestibular Cortex during Attentive Tracking of Moving Objects.

PubMed

Frank, Sebastian M; Sun, Liwei; Forster, Lisa; Tse, Peter U; Greenlee, Mark W

2016-12-14

The midposterior fundus of the Sylvian fissure in the human brain is central to the cortical processing of vestibular cues. At least two vestibular areas are located at this site: the parietoinsular vestibular cortex (PIVC) and the posterior insular cortex (PIC). It is now well established that activity in sensory systems is subject to cross-modal attention effects. Attending to a stimulus in one sensory modality enhances activity in the corresponding cortical sensory system, but simultaneously suppresses activity in other sensory systems. Here, we wanted to probe whether such cross-modal attention effects also target the vestibular system. To this end, we used a visual multiple-object tracking task. By parametrically varying the number of tracked targets, we could measure the effect of attentional load on the PIVC and the PIC while holding the perceptual load constant. Participants performed the tracking task during functional magnetic resonance imaging. Results show that, compared with passive viewing of object motion, activity during object tracking was suppressed in the PIVC and enhanced in the PIC. Greater attentional load, induced by increasing the number of tracked targets, was associated with a corresponding increase in the suppression of activity in the PIVC. Activity in the anterior part of the PIC decreased with increasing load, whereas load effects were absent in the posterior PIC. Results of a control experiment show that attention-induced suppression in the PIVC is stronger than any suppression evoked by the visual stimulus per se. Overall, our results suggest that attention has a cross-modal modulatory effect on the vestibular cortex during visual object tracking. In this study we investigate cross-modal attention effects in the human vestibular cortex. We applied the visual multiple-object tracking task because it is known to evoke attentional load effects on neural activity in visual motion-processing and attention-processing areas. Here we demonstrate a load-dependent effect of attention on the activation in the vestibular cortex, despite constant visual motion stimulation. We find that activity in the parietoinsular vestibular cortex is more strongly suppressed the greater the attentional load on the visual tracking task. These findings suggest cross-modal attentional modulation in the vestibular cortex. Copyright © 2016 the authors 0270-6474/16/3612720-09$15.00/0.

Multi-Modal Active Perception for Autonomously Selecting Landing Sites on Icy Moons

NASA Technical Reports Server (NTRS)

Arora, A.; Furlong, P. M.; Wong, U.; Fong, T.; Sukkarieh, S.

2017-01-01

Selecting suitable landing sites is fundamental to achieving many mission objectives in planetary robotic lander missions. However, due to sensing limitations, landing sites which are both safe and scientifically valuable often cannot be determined reliably from orbit, particularly, in icy moon missions where orbital sensing data is noisy and incomplete. This paper presents an active perception approach to Entry Descent and Landing (EDL) which enables the lander to autonomously plan informative descent trajectories, acquire high quality sensing data during descent and exploit this additional information to select higher utility landing sites. Our approach consists of two components: probabilistic modeling of landing site features and approximate trajectory planning using a sampling based planner. The proposed framework allows the lander to plan long horizons paths and remain robust to noisy data. Results in simulated environments show large performance improvements over alternative approaches and show promise that our approach has strong potential to improve science return of not only icy moon missions but EDL systems in general.

Interesting images: Multiple coronary artery aneurysms.

PubMed

Howard, Jonathon M; Viswanath, Omar; Armas, Alfredo; Santana, Orlando; Rosen, Gerald P

2017-01-01

We present the case of a 65-year-old male who presented with stable angina and dyspnea on exertion. His initial workup yielded a positive treadmill stress test for reversible apical ischemia, and transthoracic echocardiogram demonstrated impaired systolic function. Cardiac catheterization was then performed, revealing severe atherosclerotic disease including multiple coronary artery aneurysms. As a result, the patient was advised to and subsequently underwent a coronary artery bypass graft. This case highlights the presence of multiple coronary artery aneurysms and the ability to appreciate these pathologic findings on multiple imaging modalities, including coronary angiogram, transesophageal echocardiography, and direct visualization through the surgical field.

Interesting Images: Multiple Coronary Artery Aneurysms

PubMed Central

Howard, Jonathon M; Viswanath, Omar; Armas, Alfredo; Santana, Orlando; Rosen, Gerald P

2017-01-01

We present the case of a 65-year-old male who presented with stable angina and dyspnea on exertion. His initial workup yielded a positive treadmill stress test for reversible apical ischemia, and transthoracic echocardiogram demonstrated impaired systolic function. Cardiac catheterization was then performed, revealing severe atherosclerotic disease including multiple coronary artery aneurysms. As a result, the patient was advised to and subsequently underwent a coronary artery bypass graft. This case highlights the presence of multiple coronary artery aneurysms and the ability to appreciate these pathologic findings on multiple imaging modalities, including coronary angiogram, transesophageal echocardiography, and direct visualization through the surgical field. PMID:28701599

Annual Technology Transfer Report FY 2017

DOT National Transportation Integrated Search

2018-04-01

The U.S. Department of Transportation (U.S. DOT) is the Federal steward of the Nation's transportation system. U.S. DOT consists of multiple modal operating administrations (OAs) that carry out mission-related research, development, and technology (R...

Characteristics of long recovery early VLF events observed by the North African AWESOME Network

NASA Astrophysics Data System (ADS)

Naitamor, S.; Cohen, M. B.; Cotts, B. R. T.; Ghalila, H.; Alabdoadaim, M. A.; Graf, K.

2013-08-01

Lightning strokes are capable of initiating disturbances in the lower ionosphere, whose recoveries persist for many minutes. These events are remotely sensed via monitoring subionospherically propagating very low frequency (VLF) transmitter signals, which are perturbed as they pass through the region above the lightning stroke. In this paper we describe the properties and characteristics of the early VLF signal perturbations, which exhibit long recovery times using subionospheric VLF transmitter data from three identical receivers located at Algiers (Algeria), Tunis (Tunisia), and Sebha (Libya). The results indicate that the observation of long recovery events depends strongly on the modal structure of the signal electromagnetic field and the distance from the disturbed region and the receiver or transmitter locations. Comparison of simultaneously collected data at the three sites indicates that the role of the causative lightning stroke properties (e.g., peak current and polarity), or that of transient luminous events may be much less important. The dominant parameter which determines the duration of the recovery time and amplitude appears to be the modal structure of the subionospheric VLF probe signal at the ionospheric disturbance, where scattering occurs, and the subsequent modal structure that propagates to the receiver location.

X-ray digital intra-oral tomosynthesis for quasi-three-dimensional imaging: system, reconstruction algorithm, and experiments

NASA Astrophysics Data System (ADS)

Li, Liang; Chen, Zhiqiang; Zhao, Ziran; Wu, Dufan

2013-01-01

At present, there are mainly three x-ray imaging modalities for dental clinical diagnosis: radiography, panorama and computed tomography (CT). We develop a new x-ray digital intra-oral tomosynthesis (IDT) system for quasi-three-dimensional dental imaging which can be seen as an intermediate modality between traditional radiography and CT. In addition to normal x-ray tube and digital sensor used in intra-oral radiography, IDT has a specially designed mechanical device to complete the tomosynthesis data acquisition. During the scanning, the measurement geometry is such that the sensor is stationary inside the patient's mouth and the x-ray tube moves along an arc trajectory with respect to the intra-oral sensor. Therefore, the projection geometry can be obtained without any other reference objects, which makes it be easily accepted in clinical applications. We also present a compressed sensing-based iterative reconstruction algorithm for this kind of intra-oral tomosynthesis. Finally, simulation and experiment were both carried out to evaluate this intra-oral imaging modality and algorithm. The results show that IDT has its potentiality to become a new tool for dental clinical diagnosis.

Auditory and tactile gap discrimination by observers with normal and impaired hearing.

PubMed

Desloge, Joseph G; Reed, Charlotte M; Braida, Louis D; Perez, Zachary D; Delhorne, Lorraine A; Villabona, Timothy J

2014-02-01

Temporal processing ability for the senses of hearing and touch was examined through the measurement of gap-duration discrimination thresholds (GDDTs) employing the same low-frequency sinusoidal stimuli in both modalities. GDDTs were measured in three groups of observers (normal-hearing, hearing-impaired, and normal-hearing with simulated hearing loss) covering an age range of 21-69 yr. GDDTs for a baseline gap of 6 ms were measured for four different combinations of 100-ms leading and trailing markers (250-250, 250-400, 400-250, and 400-400 Hz). Auditory measurements were obtained for monaural presentation over headphones and tactile measurements were obtained using sinusoidal vibrations presented to the left middle finger. The auditory GDDTs of the hearing-impaired listeners, which were larger than those of the normal-hearing observers, were well-reproduced in the listeners with simulated loss. The magnitude of the GDDT was generally independent of modality and showed effects of age in both modalities. The use of different-frequency compared to same-frequency markers led to a greater deterioration in auditory GDDTs compared to tactile GDDTs and may reflect differences in bandwidth properties between the two sensory systems.

Gaze and Feet as Additional Input Modalities for Interacting with Geospatial Interfaces

NASA Astrophysics Data System (ADS)

Çöltekin, A.; Hempel, J.; Brychtova, A.; Giannopoulos, I.; Stellmach, S.; Dachselt, R.

2016-06-01

Geographic Information Systems (GIS) are complex software environments and we often work with multiple tasks and multiple displays when we work with GIS. However, user input is still limited to mouse and keyboard in most workplace settings. In this project, we demonstrate how the use of gaze and feet as additional input modalities can overcome time-consuming and annoying mode switches between frequently performed tasks. In an iterative design process, we developed gaze- and foot-based methods for zooming and panning of map visualizations. We first collected appropriate gestures in a preliminary user study with a small group of experts, and designed two interaction concepts based on their input. After the implementation, we evaluated the two concepts comparatively in another user study to identify strengths and shortcomings in both. We found that continuous foot input combined with implicit gaze input is promising for supportive tasks.

Output-only modal dynamic identification of frames by a refined FDD algorithm at seismic input and high damping

NASA Astrophysics Data System (ADS)

Pioldi, Fabio; Ferrari, Rosalba; Rizzi, Egidio

2016-02-01

The present paper deals with the seismic modal dynamic identification of frame structures by a refined Frequency Domain Decomposition (rFDD) algorithm, autonomously formulated and implemented within MATLAB. First, the output-only identification technique is outlined analytically and then employed to characterize all modal properties. Synthetic response signals generated prior to the dynamic identification are adopted as input channels, in view of assessing a necessary condition for the procedure's efficiency. Initially, the algorithm is verified on canonical input from random excitation. Then, modal identification has been attempted successfully at given seismic input, taken as base excitation, including both strong motion data and single and multiple input ground motions. Rather than different attempts investigating the role of seismic response signals in the Time Domain, this paper considers the identification analysis in the Frequency Domain. Results turn-out very much consistent with the target values, with quite limited errors in the modal estimates, including for the damping ratios, ranging from values in the order of 1% to 10%. Either seismic excitation and high values of damping, resulting critical also in case of well-spaced modes, shall not fulfill traditional FFD assumptions: this shows the consistency of the developed algorithm. Through original strategies and arrangements, the paper shows that a comprehensive rFDD modal dynamic identification of frames at seismic input is feasible, also at concomitant high damping.

Path Finding for Maximum Value of Information in Multi-Modal Underwater Wireless Sensor Networks

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gjanci, Petrika; Petrioli, Chiara; Basagni, Stefano

Here, we consider underwater multi-modal wireless sensor networks (UWSNs) suitable for applications on submarine surveillance and monitoring, where nodes offload data to a mobile autonomous underwater vehicle (AUV) via optical technology, and coordinate using acoustic communication. Sensed data are associated with a value, decaying in time. In this scenario, we address the problem of finding the path of the AUV so that the Value of Information (VoI) of the data delivered to a sink on the surface is maximized. We define a Greedy and Adaptive AUV Path-finding (GAAP) heuristic that drives the AUV to collect data from nodes depending onmore » the VoI of their data. For benchmarking the performance of AUV path-finding heuristics, we define an integer linear programming (ILP) formulation that accurately models the considered scenario, deriving a path that drives the AUV to collect and deliver data with the maximum VoI. In our experiments GAAP consistently delivers more than 80 percent of the theoretical maximum VoI determined by the ILP model. We also compare the performance of GAAP with that of other strategies for driving the AUV among sensing nodes, namely, random paths, TSP-based paths and a “lawn mower”-like strategy. Our results show that GAAP always outperforms every other heuristic in terms of delivered VoI, also obtaining higher energy efficiency.« less

Path Finding for Maximum Value of Information in Multi-Modal Underwater Wireless Sensor Networks

DOE PAGES

Gjanci, Petrika; Petrioli, Chiara; Basagni, Stefano; ...

2017-05-19

Here, we consider underwater multi-modal wireless sensor networks (UWSNs) suitable for applications on submarine surveillance and monitoring, where nodes offload data to a mobile autonomous underwater vehicle (AUV) via optical technology, and coordinate using acoustic communication. Sensed data are associated with a value, decaying in time. In this scenario, we address the problem of finding the path of the AUV so that the Value of Information (VoI) of the data delivered to a sink on the surface is maximized. We define a Greedy and Adaptive AUV Path-finding (GAAP) heuristic that drives the AUV to collect data from nodes depending onmore » the VoI of their data. For benchmarking the performance of AUV path-finding heuristics, we define an integer linear programming (ILP) formulation that accurately models the considered scenario, deriving a path that drives the AUV to collect and deliver data with the maximum VoI. In our experiments GAAP consistently delivers more than 80 percent of the theoretical maximum VoI determined by the ILP model. We also compare the performance of GAAP with that of other strategies for driving the AUV among sensing nodes, namely, random paths, TSP-based paths and a “lawn mower”-like strategy. Our results show that GAAP always outperforms every other heuristic in terms of delivered VoI, also obtaining higher energy efficiency.« less

Computational and design methods for advanced imaging

NASA Astrophysics Data System (ADS)

Birch, Gabriel C.

This dissertation merges the optical design and computational aspects of imaging systems to create novel devices that solve engineering problems in optical science and attempts to expand the solution space available to the optical designer. This dissertation is divided into two parts: the first discusses a new active illumination depth sensing modality, while the second part discusses a passive illumination system called plenoptic, or lightfield, imaging. The new depth sensing modality introduced in part one is called depth through controlled aberration. This technique illuminates a target with a known, aberrated projected pattern and takes an image using a traditional, unmodified imaging system. Knowing how the added aberration in the projected pattern changes as a function of depth, we are able to quantitatively determine depth of a series of points from the camera. A major advantage this method permits is the ability for illumination and imaging axes to be coincident. Plenoptic cameras capture both spatial and angular data simultaneously. This dissertation present a new set of parameters that permit the design and comparison of plenoptic devices outside the traditionally published plenoptic 1.0 and plenoptic 2.0 configurations. Additionally, a series of engineering advancements are presented, including full system raytraces of raw plenoptic images, Zernike compression techniques of raw image files, and non-uniform lenslet arrays to compensate for plenoptic system aberrations. Finally, a new snapshot imaging spectrometer is proposed based off the plenoptic configuration.

Fiber sensor network with multipoint sensing using double-pass hybrid LPFG-FBG sensor configuration

NASA Astrophysics Data System (ADS)

Yong, Yun-Thung; Lee, Sheng-Chyan; Rahman, Faidz Abd

2017-03-01

This is a study on double-pass intensity-based hybrid Long Period Fiber Grating (LPFG)and Fiber Bragg Grating (FBG) sensor configuration where a fiber sensor network was constructed with multiple sensing capability. The sensing principle is based on interrogation of intensity changes of the reflected signal from an FBG caused by the LPFG spectral response to the surrounding perturbations. The sensor network developed was tested in monitoring diesel adulteration of up to a distance of 8 km. Kerosene concentration from 0% to 50% was added as adulterant into diesel. The sensitivity of the double-pass hybrid LPFG-FBG sensor over multiple points was>0.21 dB/% (for adulteration range of 0-30%) and >0.45 dB/% from 30% to 50% adulteration. It is found that the sensitivity can drop up to 35% when the fiber length increased from 0 km to 8 km (for the case of adulteration of 0-30%). With the multiple sensing capabilities, normalized FBG's reflected power can be demodulated at the same time for comparison of sensitivity performance across various fiber sensors.

Multipoint sensing with a low-coherence source using single-arm frequency-shifted interferometry

DOE PAGES

Zhang, Yiwei; Ye, Fei; Qi, Bing; ...

2016-07-12

We demonstrate that multiple-site sensing along an optical fiber can be done with incoherent continuous-wave light. Here, using a broadband low-coherence noise source, a slow detector, and an optical modulator, we construct a single-arm frequency-shifted interferometer (SA-FSI) capable of simultaneously sensing multiple weak-reflection sites distributed either in parallel or in series along fiber links. By scanning the driving frequency of an electro-optic amplitude modulator in the range of 2.7–3.2 GHz at steps of 41.7 KHz, we demonstrate a spatial resolution of 0.3 m and a measurement range of over 1 km.

Multimode-singlemode-multimode fiber sensor for alcohol sensing application

NASA Astrophysics Data System (ADS)

Rofi'ah, Iftihatur; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol is volatile and flammable liquid which is soluble substances both on polar and non polar substances that has been used in some industrial sectors. Alcohol detection method now widely used one of them is the optical fiber sensor. In this paper used fiber optic sensor based on Multimode-Single-mode-Multimode (MSM) to detect alcohol solution at a concentration range of 0-3%. The working principle of sensor utilizes the modal interference between the core modes and the cladding modes, thus make the sensor sensitive to environmental changes. The result showed that characteristic of the sensor not affect the length of the single-mode fiber (SMF). We obtain that the sensor with a length of 5 mm of single-mode can sensing the alcohol with a sensitivity of 0.107 dB/v%.

A Theory Upon Origin of Implicit Musical Language.

PubMed

Vas József, P

2015-11-30

The author suggests that the origin of musicality is implied in an implicit musical language every human being possesses in uterus due to a resonance and attunement with prenatal environment, mainly the mother. It is emphasized that ego-development and evolving implicit musical language can be regarded as parallel processes. To support this idea a lot of examples of musical representations are demonstrated by the author. Music is viewed as a tone of ego-functioning involving the musical representations of bodily and visceral senses, cross-modal perception, unity of sense of self, individual fate of ego, and tripolar and bipolar musical coping codes. Finally, a special form of music therapy is shown to illustrate how can implicit musical language be transformed into explicit language by virtue of participants' spontaneity, creativity, and playfulness.

A Theory Upon Origin of Implicit Musical Language

PubMed Central

Vas József, P.

2015-01-01

The author suggests that the origin of musicality is implied in an implicit musical language every human being possesses in uterus due to a resonance and attunement with prenatal environment, mainly the mother. It is emphasized that ego-development and evolving implicit musical language can be regarded as parallel processes. To support this idea a lot of examples of musical representations are demonstrated by the author. Music is viewed as a tone of ego-functioning involving the musical representations of bodily and visceral senses, cross-modal perception, unity of sense of self, individual fate of ego, and tripolar and bipolar musical coping codes. Finally, a special form of music therapy is shown to illustrate how can implicit musical language be transformed into explicit language by virtue of participants’ spontaneity, creativity, and playfulness. PMID:26973966

Hydrostatic Pressure Sensing with High Birefringence Photonic Crystal Fibers

PubMed Central

Fávero, Fernando C.; Quintero, Sully M. M.; Martelli, Cicero; Braga, Arthur M.B.; Silva, Vinícius V.; Carvalho, Isabel C. S.; Llerena, Roberth W. A.; Valente, Luiz C. G.

2010-01-01

The effect of hydrostatic pressure on the waveguiding properties of high birefringence photonic crystal fibers (HiBi PCF) is evaluated both numerically and experimentally. A fiber design presenting form birefringence induced by two enlarged holes in the innermost ring defining the fiber core is investigated. Numerical results show that modal sensitivity to the applied pressure depends on the diameters of the holes, and can be tailored by independently varying the sizes of the large or small holes. Numerical and experimental results are compared showing excellent agreement. A hydrostatic pressure sensor is proposed and demonstrated using an in-fiber modal interferometer where the two orthogonally polarized modes of a HiBi PCF generate fringes over the optical spectrum of a broad band source. From the analysis of experimental results, it is concluded that, in principle, an operating limit of 92 MPa in pressure could be achieved with 0.0003% of full scale resolution. PMID:22163435

Multisensory integration in Lepidoptera: Insights into flower-visitor interactions.

PubMed

Kinoshita, Michiyo; Stewart, Finlay J; Ômura, Hisashi

2017-04-01

As most work on flower foraging focuses on bees, studying Lepidoptera can offer fresh perspectives on how sensory capabilities shape the interaction between flowers and insects. Through a combination of innate preferences and learning, many Lepidoptera persistently visit particular flower species. Butterflies tend to rely on their highly developed sense of colour to locate rewarding flowers, while moths have evolved sophisticated olfactory systems towards the same end. However, these modalities can interact in complex ways; for instance, butterflies' colour preference can shift depending on olfactory context. The mechanisms by which such cross-modal interaction occurs are poorly understood, but the mushroom bodies appear to play a central role. Because of the diversity seen within Lepidoptera in terms of their sensory capabilities and the nature of their relationships with flowers, they represent a fruitful avenue for comparative studies to shed light on the co-evolution of flowers and flower-visiting insects. © 2017 WILEY Periodicals, Inc.

A remote instruction system empowered by tightly shared haptic sensation

NASA Astrophysics Data System (ADS)

Nishino, Hiroaki; Yamaguchi, Akira; Kagawa, Tsuneo; Utsumiya, Kouichi

2007-09-01

We present a system to realize an on-line instruction environment among physically separated participants based on a multi-modal communication strategy. In addition to visual and acoustic information, commonly used communication modalities in network environments, our system provides a haptic channel to intuitively conveying partners' sense of touch. The human touch sensation, however, is very sensitive for delays and jitters in the networked virtual reality (NVR) systems. Therefore, a method to compensate for such negative factors needs to be provided. We show an NVR architecture to implement a basic framework that can be shared by various applications and effectively deals with the problems. We take a hybrid approach to implement both data consistency by client-server and scalability by peer-to-peer models. As an application system built on the proposed architecture, a remote instruction system targeted at teaching handwritten characters and line patterns on a Korea-Japan high-speed research network also is mentioned.

Multimodal physiological sensor for motion artefact rejection.

PubMed

Goverdovsky, Valentin; Looney, David; Kidmose, Preben; Mandic, Danilo P

2014-01-01

This work introduces a novel physiological sensor, which combines electrical and mechanical modalities in a co-located arrangement, to reject motion-induced artefacts. The mechanically sensitive element consists of an electret condenser microphone containing a light diaphragm, allowing it to detect local mechanical displacements and disregard large-scale whole body movements. The electrically sensitive element comprises a highly flexible membrane, conductive on one side and insulating on the other. It covers the sound hole of the microphone, thereby forming an isolated pocket of air between the membrane and the diaphragm. The co-located arrangement of the modalities allows the microphone to sense mechanical disturbances directly through the electrode, thus providing an accurate proxy to artefacts caused by relative motion between the skin and the electrode. This proxy is used to reject such artefacts in the electrical physiological signals, enabling enhanced recording quality in wearable health applications.

Synergistic advances in diagnostic and therapeutic medical ultrasound

NASA Astrophysics Data System (ADS)

Lizzi, Frederic L.

2003-04-01

Significant advances are more fully exploiting ultrasound's potential for noninvasive diagnosis and treatment. Therapeutic systems employ intense focused beams to thermally kill cancer cells in, e.g., prostate; to stop bleeding; and to treat specific diseases (e.g., glaucoma). Diagnostic ultrasound techniques can quantitatively image an increasingly broad spectrum of physical tissue attributes. An exciting aspect of this progress is the emerging synergy between these modalities. Advanced diagnostic techniques may contribute at several stages in therapy. For example, treatment planning for small ocular tumors uses 50-MHz, 3-D ultrasonic images with 0.05-mm resolution. Thermal simulations employ these images to evaluate desired and undesired effects using exposure stategies with specially designed treatment beams. Therapy beam positioning can use diagnostic elastography to sense tissue motion induced by radiation pressure from high-intensity treatment beams. Therapy monitoring can sense lesion formation using elastography motion sensing (to detect the increased stiffness in lesions); harmonic imaging (to sense altered nonlinear properties); and spectrum analysis images (depicting changes in the sizes, concentration, and configuration of sub-resolution structures.) Experience from these applications will greatly expand the knowledge of acoustic phenomena in living tissues and should lead to further advances in medical ultrasound.

Shape Sensing Techniques for Continuum Robots in Minimally Invasive Surgery: A Survey.

PubMed

Shi, Chaoyang; Luo, Xiongbiao; Qi, Peng; Li, Tianliang; Song, Shuang; Najdovski, Zoran; Fukuda, Toshio; Ren, Hongliang

2017-08-01

Continuum robots provide inherent structural compliance with high dexterity to access the surgical target sites along tortuous anatomical paths under constrained environments and enable to perform complex and delicate operations through small incisions in minimally invasive surgery. These advantages enable their broad applications with minimal trauma and make challenging clinical procedures possible with miniaturized instrumentation and high curvilinear access capabilities. However, their inherent deformable designs make it difficult to realize 3-D intraoperative real-time shape sensing to accurately model their shape. Solutions to this limitation can lead themselves to further develop closely associated techniques of closed-loop control, path planning, human-robot interaction, and surgical manipulation safety concerns in minimally invasive surgery. Although extensive model-based research that relies on kinematics and mechanics has been performed, accurate shape sensing of continuum robots remains challenging, particularly in cases of unknown and dynamic payloads. This survey investigates the recent advances in alternative emerging techniques for 3-D shape sensing in this field and focuses on the following categories: fiber-optic-sensor-based, electromagnetic-tracking-based, and intraoperative imaging modality-based shape-reconstruction methods. The limitations of existing technologies and prospects of new technologies are also discussed.

Integrated remote sensing and visualization (IRSV) system for transportation infrastructure operations and management, phase two, volume 4 : web-based bridge information database--visualization analytics and distributed sensing.

DOT National Transportation Integrated Search

2012-03-01

This report introduces the design and implementation of a Web-based bridge information visual analytics system. This : project integrates Internet, multiple databases, remote sensing, and other visualization technologies. The result : combines a GIS ...

Nonsmooth modal analysis of a N-degree-of-freedom system undergoing a purely elastic impact law

NASA Astrophysics Data System (ADS)

Legrand, Mathias; Junca, Stéphane; Heng, Sokly

2017-04-01

The dynamics of a N-degree-of-freedom autonomous oscillator undergoing an energy-preserving impact law on one of its masses is investigated in the light of nonlinear modal analysis. The impacted rigid foundation provides a natural Poincaré section of the investigated system from which is formulated a smooth First Return Map well-defined away from the grazing trajectory. In order to focus on the impact-induced nonlinearity, the oscillator is assumed linear. Continuous one-parameter families of T-periodic orbits featuring one impact per period and lying on two-dimensional invariant manifolds in the state-space are shown to exist. The geometry of these piecewise-smooth manifolds is such that a linear "flat" portion (on which contact is not activated) is continuously attached to a purely nonlinear portion (on which contact is activated once per period) exhibiting a velocity discontinuity through a grazing orbit. These features explain the newly introduced terminology "Nonsmooth modal analysis". The stability of the periodic orbits lying on the invariant manifolds is also explored by calculating the eigenvalues of the linearized First Return Map. Internal resonances and multiple impacts per period are not addressed in this work. However, the pre-stressed case is succinctly described and extensions to multiple oscillators as well as self-contact are discussed.

Effectiveness of CO2 laser with subcision in patients with acne scars.

PubMed

Anupama, Y G; Wahab, Afthab Jameela

2016-11-01

Post-acne facial scarring has always been a challenge to treat. It requires multiple therapeutic modalities as single modality is not hundred percent effective. Therefore, we have combined CO 2 laser resurfacing with subcision in patients with acne scars for better results. The aim is to study the effectiveness and side effects of CO 2 laser with subcision in patients with atrophic acne scars. Fifty patients were selected for the study. Baseline grading was done with Goodman and Baron grading system. Twenty-five patients were randomly selected for subcision followed by CO 2 laser and the remaining patients were selected for CO 2 laser alone. The treatment was done for four sessions at 4-week interval. Clinical photographs were obtained for evaluation. CO 2 laser with subcision showed excellent response in grade-2 and -3 acne scars. Statistically there is a significant difference between CO 2 laser following subcision and CO 2 laser alone at 5% level (p < 0.05). Both procedures were well tolerated with minimal side effects. The highly versatile CO 2 laser is useful for treating acne scars. Subcision prior to the CO 2 laser procedure showed better improvement when compared to CO 2 laser alone. Thus, in acne scars, multiple therapeutic modalities achieve better results.

Lightweight Biometric Sensing for Walker Classification Using Narrowband RF Links

PubMed Central

Liang, Zhuo-qian

2017-01-01

This article proposes a lightweight biometric sensing system using ubiquitous narrowband radio frequency (RF) links for path-dependent walker classification. The fluctuated received signal strength (RSS) sequence generated by human motion is used for feature representation. To capture the most discriminative characteristics of individuals, a three-layer RF sensing network is organized for building multiple sampling links at the most common heights of upper limbs, thighs, and lower legs. The optimal parameters of sensing configuration, such as the height of link location and number of fused links, are investigated to improve sensory data distinctions among subjects, and the experimental results suggest that the synergistic sensing by using multiple links can contribute a better performance. This is the new consideration of using RF links in building a biometric sensing system. In addition, two types of classification methods involving vector quantization (VQ) and hidden Markov models (HMMs) are developed and compared for closed-set walker recognition and verification. Experimental studies in indoor line-of-sight (LOS) and non-line-of-sight (NLOS) scenarios are conducted to validate the proposed method. PMID:29206188

Lightweight Biometric Sensing for Walker Classification Using Narrowband RF Links.

PubMed

Liu, Tong; Liang, Zhuo-Qian

2017-12-05

This article proposes a lightweight biometric sensing system using ubiquitous narrowband radio frequency (RF) links for path-dependent walker classification. The fluctuated received signal strength (RSS) sequence generated by human motion is used for feature representation. To capture the most discriminative characteristics of individuals, a three-layer RF sensing network is organized for building multiple sampling links at the most common heights of upper limbs, thighs, and lower legs. The optimal parameters of sensing configuration, such as the height of link location and number of fused links, are investigated to improve sensory data distinctions among subjects, and the experimental results suggest that the synergistic sensing by using multiple links can contribute a better performance. This is the new consideration of using RF links in building a biometric sensing system. In addition, two types of classification methods involving vector quantization (VQ) and hidden Markov models (HMMs) are developed and compared for closed-set walker recognition and verification. Experimental studies in indoor line-of-sight (LOS) and non-line-of-sight (NLOS) scenarios are conducted to validate the proposed method.

Assessing the Downstream Impact of the Integrated Use of Socioeconomic and Remote Sensing Data

NASA Astrophysics Data System (ADS)

Chen, R. S.; Downs, R. R.; Schumacher, J.

2014-12-01

The interdisciplinary use of data from multiple disciplines to address both research and applied problems has received increasing attention in the sciences, but understanding remains limited on the specific modalities of data use and their impact not only in enabling new research insights but also in facilitating the application of research to societal problems. In our previous work, we used citation analysis to investigate the use of data from the NASA Socioeconomic Data and Applications Center (SEDAC) and identify the extent of interdisciplinary use, based on the subject classifications of citing journals. We also proposed and tested a taxonomy of data integration and use on a selection of peer-reviewed scientific articles that cited both remote sensing data and socioeconomic data from SEDAC. We extend both of these analyses here. We analyze the interdisciplinary use of SEDAC data over a seven-year period including the types and topical areas of application observed. We also explore the degree to which different types of data integration and use are leading to further "downstream" research and applications, and if objective measures can be developed using bibliometric methods to quantify downstream use and impact in meaningful ways. These methods include both traditional citation analysis and searches of the informal literature and online resources. Better understanding of how disparate data and information has been utilized to address new interdisciplinary problems will help the data user and provider communities improve the effectiveness and efficiency of their efforts. It should also provide justification for further investments in linking different data resources and networks across scientific fields, in methods of interdisciplinary data integration, and in application of integrated data to societal problems.

Multi-temporal and multi-source remote sensing image classification by nonlinear relative normalization

NASA Astrophysics Data System (ADS)

Tuia, Devis; Marcos, Diego; Camps-Valls, Gustau

2016-10-01

Remote sensing image classification exploiting multiple sensors is a very challenging problem: data from different modalities are affected by spectral distortions and mis-alignments of all kinds, and this hampers re-using models built for one image to be used successfully in other scenes. In order to adapt and transfer models across image acquisitions, one must be able to cope with datasets that are not co-registered, acquired under different illumination and atmospheric conditions, by different sensors, and with scarce ground references. Traditionally, methods based on histogram matching have been used. However, they fail when densities have very different shapes or when there is no corresponding band to be matched between the images. An alternative builds upon manifold alignment. Manifold alignment performs a multidimensional relative normalization of the data prior to product generation that can cope with data of different dimensionality (e.g. different number of bands) and possibly unpaired examples. Aligning data distributions is an appealing strategy, since it allows to provide data spaces that are more similar to each other, regardless of the subsequent use of the transformed data. In this paper, we study a methodology that aligns data from different domains in a nonlinear way through kernelization. We introduce the Kernel Manifold Alignment (KEMA) method, which provides a flexible and discriminative projection map, exploits only a few labeled samples (or semantic ties) in each domain, and reduces to solving a generalized eigenvalue problem. We successfully test KEMA in multi-temporal and multi-source very high resolution classification tasks, as well as on the task of making a model invariant to shadowing for hyperspectral imaging.

Vision-Based Detection and Distance Estimation of Micro Unmanned Aerial Vehicles

PubMed Central

Gökçe, Fatih; Üçoluk, Göktürk; Şahin, Erol; Kalkan, Sinan

2015-01-01

Detection and distance estimation of micro unmanned aerial vehicles (mUAVs) is crucial for (i) the detection of intruder mUAVs in protected environments; (ii) sense and avoid purposes on mUAVs or on other aerial vehicles and (iii) multi-mUAV control scenarios, such as environmental monitoring, surveillance and exploration. In this article, we evaluate vision algorithms as alternatives for detection and distance estimation of mUAVs, since other sensing modalities entail certain limitations on the environment or on the distance. For this purpose, we test Haar-like features, histogram of gradients (HOG) and local binary patterns (LBP) using cascades of boosted classifiers. Cascaded boosted classifiers allow fast processing by performing detection tests at multiple stages, where only candidates passing earlier simple stages are processed at the preceding more complex stages. We also integrate a distance estimation method with our system utilizing geometric cues with support vector regressors. We evaluated each method on indoor and outdoor videos that are collected in a systematic way and also on videos having motion blur. Our experiments show that, using boosted cascaded classifiers with LBP, near real-time detection and distance estimation of mUAVs are possible in about 60 ms indoors (1032×778 resolution) and 150 ms outdoors (1280×720 resolution) per frame, with a detection rate of 0.96 F-score. However, the cascaded classifiers using Haar-like features lead to better distance estimation since they can position the bounding boxes on mUAVs more accurately. On the other hand, our time analysis yields that the cascaded classifiers using HOG train and run faster than the other algorithms. PMID:26393599

Joint sparse representation for robust multimodal biometrics recognition.

PubMed

Shekhar, Sumit; Patel, Vishal M; Nasrabadi, Nasser M; Chellappa, Rama

2014-01-01

Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle nonlinearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that the proposed method compares favorably with competing fusion-based methods.

The Roles of Relative Linguistic Proficiency and Modality Switching in Language Switch Cost: Evidence from Chinese Visual Unimodal and Bimodal Bilinguals.

PubMed

Lu, Aitao; Wang, Lu; Guo, Yuyang; Zeng, Jiahong; Zheng, Dongping; Wang, Xiaolu; Shao, Yulan; Wang, Ruiming

2017-09-01

The current study investigated the mechanism of language switching in unbalanced visual unimodal bilinguals as well as balanced and unbalanced bimodal bilinguals during a picture naming task. All three groups exhibited significant switch costs across two languages, with symmetrical switch cost in balanced bimodal bilinguals and asymmetrical switch cost in unbalanced unimodal bilinguals and bimodal bilinguals. Moreover, the relative proficiency of the two languages but not their absolute proficiency had an effect on language switch cost. For the bimodal bilinguals the language switch cost also arose from modality switching. These findings suggest that the language switch cost might originate from multiple sources from both outside (e.g., modality switching) and inside (e.g., the relative proficiency of the two languages) the linguistic lexicon.

Nano- and micro-electromechanical switch dynamics

NASA Astrophysics Data System (ADS)

Pulskamp, Jeffrey S.; Proie, Robert M.; Polcawich, Ronald G.

2013-01-01

This paper reports theoretical analysis and experimental results on the dynamics of piezoelectric MEMS mechanical logic relays. The multiple degree of freedom analytical model, based on modal decomposition, utilizes modal parameters obtained from finite element analysis and an analytical model of piezoelectric actuation. The model accounts for exact device geometry, damping, drive waveform variables, and high electric field piezoelectric nonlinearity. The piezoelectrically excited modal force is calculated directly and provides insight into design optimization for switching speed. The model accurately predicts the propagation delay dependence on actuation voltage of mechanically distinct relay designs. The model explains the observed discrepancies in switching speed of these devices relative to single degree of freedom switching speed models and suggests the strong potential for improved switching speed performance in relays designed for mechanical logic and RF circuits through the exploitation of higher order vibrational modes.

Bronchoscopic modalities to diagnose sarcoidosis.

PubMed

Benzaquen, Sadia; Aragaki-Nakahodo, Alejandro Adolfo

2017-09-01

Several studies have investigated different bronchoscopic techniques to obtain tissue diagnosis in patients with suspected sarcoidosis when the diagnosis cannot be based on clinicoradiographic findings alone. In this review, we will describe the most recent and relevant evidence from different bronchoscopic modalities to diagnose sarcoidosis. Despite multiple available bronchoscopic modalities to procure tissue samples to diagnose sarcoidosis, the vast majority of evidence favors endobronchial ultrasound transbronchial needle aspiration to diagnose Scadding stages 1 and 2 sarcoidosis. Transbronchial lung cryobiopsy is a new technique that is mainly used to aid in the diagnosis of undifferentiated interstitial lung disease; however, we will discuss its potential use in sarcoidosis. This review illustrates the limited information about the different bronchoscopic techniques to aid in the diagnosis of pulmonary sarcoidosis. However, it demonstrates that the combination of available bronchoscopic techniques increases the diagnostic yield for suspected sarcoidosis.

Dependency of a therapy-resistant state of cancer cells on a lipid peroxidase pathway* | Office of Cancer Genomics

Cancer.gov

Plasticity of the cell state has been proposed to drive resistance to multiple classes of cancer therapies, thereby limiting their effectiveness. A high-mesenchymal cell state observed in human tumors and cancer cell lines has been associated with resistance to multiple treatment modalities across diverse cancer lineages, but the mechanistic underpinning for this state has remained incompletely understood.