Severe Speech Sound Disorders: An Integrated Multimodal Intervention

ERIC Educational Resources Information Center

King, Amie M.; Hengst, Julie A.; DeThorne, Laura S.

2013-01-01

Purpose: This study introduces an integrated multimodal intervention (IMI) and examines its effectiveness for the treatment of persistent and severe speech sound disorders (SSD) in young children. The IMI is an activity-based intervention that focuses simultaneously on increasing the "quantity" of a child's meaningful productions of target words…

A Mediated Discourse Analysis (MDA) Approach to Multimodal Data

ERIC Educational Resources Information Center

Dooly, Melinda

2017-01-01

Just as research in language learning is moving beyond the four walls of the classroom, there is a growing awareness that language use (and simultaneous learning) takes place in increasingly complex and interconnected ways, in particular through the use of technology. This chapter summarizes an investigation into multimodal communicative…

Simultaneous measurement of temperature and magnetic field based on a long period grating concatenated with multimode fiber

NASA Astrophysics Data System (ADS)

Miao, Yinping; Zhang, Hao; Lin, Jichao; Song, Binbin; Zhang, Kailiang; Lin, Wei; Liu, Bo; Yao, Jianquan

2015-03-01

A dual-parameter measurement scheme based on a long-period fiber grating (LPFG) concatenated with a multimode fiber (MMF) has been proposed and experimentally demonstrated for simultaneous measurement of magnetic field and temperature. Splicing the LPFG with the etched MMF enables the coupling between the core modes and different cladding modes of the LPFG as well as the interferences between higher-order modes in the MMF. Due to different transmission mechanisms of the LPFG and mode interference, the proposed sensor shows transmission dip wavelength sensitivities of 0.02878 nm/Oe and -0.04048 nm/°C for multi-mode interference (MMI) and -0.0024 nm/Oe and 0.03929 nm/°C for the LPFG, respectively. By monitoring the opposite behaviors of resonance wavelength shift corresponding to the LPFG and MMI, the magnetic field and environmental temperature can be simultaneously measured. The spectral characteristics of the proposed sensor that could be tuned through control of both environmental temperature and applied magnetic field, which would provide a promising candidate for dual-channel filtering applications as well as multi-parameter measurement applications.

Language development at 18 months is related to multimodal communicative strategies at 12 months.

PubMed

Igualada, Alfonso; Bosch, Laura; Prieto, Pilar

2015-05-01

The present study investigated the degree to which an infants' use of simultaneous gesture-speech combinations during controlled social interactions predicts later language development. Nineteen infants participated in a declarative pointing task involving three different social conditions: two experimental conditions (a) available, when the adult was visually attending to the infant but did not attend to the object of reference jointly with the child, and (b) unavailable, when the adult was not visually attending to neither the infant nor the object; and (c) a baseline condition, when the adult jointly engaged with the infant's object of reference. At 12 months of age measures related to infants' speech-only productions, pointing-only gestures, and simultaneous pointing-speech combinations were obtained in each of the three social conditions. Each child's lexical and grammatical output was assessed at 18 months of age through parental report. Results revealed a significant interaction between social condition and type of communicative production. Specifically, only simultaneous pointing-speech combinations increased in frequency during the available condition compared to baseline, while no differences were found for speech-only and pointing-only productions. Moreover, simultaneous pointing-speech combinations in the available condition at 12 months positively correlated with lexical and grammatical development at 18 months of age. The ability to selectively use this multimodal communicative strategy to engage the adult in joint attention by drawing his attention toward an unseen event or object reveals 12-month-olds' clear understanding of referential cues that are relevant for language development. This strategy to successfully initiate and maintain joint attention is related to language development as it increases learning opportunities from social interactions. Copyright © 2015 Elsevier Inc. All rights reserved.

Simultaneous Teleportation of the Spectral and Polarization States of a Photon

DOE Office of Scientific and Technical Information (OSTI.GOV)

Humble, Travis S; Bennink, Ryan S; Grice, Warren P

2008-01-01

We describe how spectrally multimode, polarization-entangled photons simultaneously teleport quantum information encoded into the spectral and polarization degrees of freedom of a single photon using sum frequency generation to implement a Bell-state measurement.

A Case Study of Diverse Multimodal Influences on Music Improvisation Using Visual Methodology

ERIC Educational Resources Information Center

Tomlinson, Michelle M.

2016-01-01

This case study employed multimodal methods and visual analysis to explore how a young multilingual student used music improvisation to form a speech rap. This student, recently arrived in Australia from Ethiopia, created piano music that was central to his music identity and that simultaneously, through dialogue with his mother, enhanced his…

Investigation of protein selectivity in multimodal chromatography using in silico designed Fab fragment variants.

PubMed

Karkov, Hanne Sophie; Krogh, Berit Olsen; Woo, James; Parimal, Siddharth; Ahmadian, Haleh; Cramer, Steven M

2015-11-01

In this study, a unique set of antibody Fab fragments was designed in silico and produced to examine the relationship between protein surface properties and selectivity in multimodal chromatographic systems. We hypothesized that multimodal ligands containing both hydrophobic and charged moieties would interact strongly with protein surface regions where charged groups and hydrophobic patches were in close spatial proximity. Protein surface property characterization tools were employed to identify the potential multimodal ligand binding regions on the Fab fragment of a humanized antibody and to evaluate the impact of mutations on surface charge and hydrophobicity. Twenty Fab variants were generated by site-directed mutagenesis, recombinant expression, and affinity purification. Column gradient experiments were carried out with the Fab variants in multimodal, cation-exchange, and hydrophobic interaction chromatographic systems. The results clearly indicated that selectivity in the multimodal system was different from the other chromatographic modes examined. Column retention data for the reduced charge Fab variants identified a binding site comprising light chain CDR1 as the main electrostatic interaction site for the multimodal and cation-exchange ligands. Furthermore, the multimodal ligand binding was enhanced by additional hydrophobic contributions as evident from the results obtained with hydrophobic Fab variants. The use of in silico protein surface property analyses combined with molecular biology techniques, protein expression, and chromatographic evaluations represents a previously undescribed and powerful approach for investigating multimodal selectivity with complex biomolecules. © 2015 Wiley Periodicals, Inc.

A User-Configurable Headstage for Multimodality Neuromonitoring in Freely Moving Rats

PubMed Central

Limnuson, Kanokwan; Narayan, Raj K.; Chiluwal, Amrit; Golanov, Eugene V.; Bouton, Chad E.; Li, Chunyan

2016-01-01

Multimodal monitoring of brain activity, physiology, and neurochemistry is an important approach to gain insight into brain function, modulation, and pathology. With recent progress in micro- and nanotechnology, micro-nano-implants have become important catalysts in advancing brain research. However, to date, only a limited number of brain parameters have been measured simultaneously in awake animals in spite of significant recent progress in sensor technology. Here we have provided a cost and time effective approach to designing a headstage to conduct a multimodality brain monitoring in freely moving animals. To demonstrate this method, we have designed a user-configurable headstage for our micromachined multimodal neural probe. The headstage can reliably record direct-current electrocorticography (DC-ECoG), brain oxygen tension (PbrO2), cortical temperature, and regional cerebral blood flow (rCBF) simultaneously without significant signal crosstalk or movement artifacts for 72 h. Even in a noisy environment, it can record low-level neural signals with high quality. Moreover, it can easily interface with signal conditioning circuits that have high power consumption and are difficult to miniaturize. To the best of our knowledge, this is the first time where multiple physiological, biochemical, and electrophysiological cerebral variables have been simultaneously recorded from freely moving rats. We anticipate that the developed system will aid in gaining further insight into not only normal cerebral functioning but also pathophysiology of conditions such as epilepsy, stroke, and traumatic brain injury. PMID:27594826

Simultaneous in vivo imaging of melanin and lipofuscin in the retina with multimodal photoacoustic ophthalmoscopy

NASA Astrophysics Data System (ADS)

Zhang, Xiangyang; Zhang, Hao F.; Zhou, Lixiang; Jiao, Shuliang

2012-02-01

We combined photoacoustic ophthalmoscopy (PAOM) with autofluorescence imaging for simultaneous in vivo imaging of dual molecular contrasts in the retina using a single light source. The dual molecular contrasts come from melanin and lipofuscin in the retinal pigment epithelium (RPE). Melanin and lipofuscin are two types of pigments and are believed to play opposite roles (protective vs. exacerbate) in the RPE in the aging process. We successfully imaged the retina of pigmented and albino rats at different ages. The experimental results showed that multimodal PAOM system can be a potentially powerful tool in the study of age-related degenerative retinal diseases.

The multi-mode polarization modulation spectrometer: part 1: simultaneous detection of absorption, turbidity, and optical activity.

PubMed

Arvinte, Tudor; Bui, Tam T T; Dahab, Ali A; Demeule, Barthélemy; Drake, Alex F; Elhag, Dhia; King, Peter

2004-09-01

Circular dichroism (CD) is an important spectroscopic technique for monitoring chirality and biological macromolecule conformation. However, during a CD measurement, absorbance, light scattering/turbidity, and fluorescence can also be detected. The simultaneous measurement of these different spectral features for a single sample is the basis of a multi-mode optical spectrometer. This allows time-efficient gathering of complementary information and provides a scheme to ensure that CD measurements are reliable. Aspects of circular polarization differential light scattering, pH, and temperature variation of a protein (antibody) solution are described. A procedure to help ensure that CD measurements are reliable is described.

Using optical fibers with different modes to improve the signal-to-noise ratio of diffuse correlation spectroscopy flow-oximeter measurements

PubMed Central

He, Lian; Lin, Yu; Shang, Yu; Shelton, Brent J.

2013-01-01

Abstract. The dual-wavelength diffuse correlation spectroscopy (DCS) flow-oximeter is an emerging technique enabling simultaneous measurements of blood flow and blood oxygenation changes in deep tissues. High signal-to-noise ratio (SNR) is crucial when applying DCS technologies in the study of human tissues where the detected signals are usually very weak. In this study, single-mode, few-mode, and multimode fibers are compared to explore the possibility of improving the SNR of DCS flow-oximeter measurements. Experiments on liquid phantom solutions and in vivo muscle tissues show only slight improvements in flow measurements when using the few-mode fiber compared with using the single-mode fiber. However, light intensities detected by the few-mode and multimode fibers are increased, leading to significant SNR improvements in detections of phantom optical property and tissue blood oxygenation. The outcomes from this study provide useful guidance for the selection of optical fibers to improve DCS flow-oximeter measurements. PMID:23455963

Image-guided plasma therapy of cutaneous wound

NASA Astrophysics Data System (ADS)

Zhang, Zhiwu; Ren, Wenqi; Yu, Zelin; Zhang, Shiwu; Yue, Ting; Xu, Ronald

2014-02-01

The wound healing process involves the reparative phases of inflammation, proliferation, and remodeling. Interrupting any of these phases may result in chronically unhealed wounds, amputation, or even patient death. Despite the clinical significance in chronic wound management, no effective methods have been developed for quantitative image-guided treatment. We integrated a multimodal imaging system with a cold atmospheric plasma probe for image-guided treatment of chronic wound. Multimodal imaging system offers a non-invasive, painless, simultaneous and quantitative assessment of cutaneous wound healing. Cold atmospheric plasma accelerates the wound healing process through many mechanisms including decontamination, coagulation and stimulation of the wound healing. The therapeutic effect of cold atmospheric plasma is studied in vivo under the guidance of a multimodal imaging system. Cutaneous wounds are created on the dorsal skin of the nude mice. During the healing process, the sample wound is treated by cold atmospheric plasma at different controlled dosage, while the control wound is healed naturally. The multimodal imaging system integrating a multispectral imaging module and a laser speckle imaging module is used to collect the information of cutaneous tissue oxygenation (i.e. oxygen saturation, StO2) and blood perfusion simultaneously to assess and guide the plasma therapy. Our preliminary tests show that cold atmospheric plasma in combination with multimodal imaging guidance has the potential to facilitate the healing of chronic wounds.

Simultaneous multimodal ophthalmic imaging using swept-source spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography

PubMed Central

Malone, Joseph D.; El-Haddad, Mohamed T.; Bozic, Ivan; Tye, Logan A.; Majeau, Lucas; Godbout, Nicolas; Rollins, Andrew M.; Boudoux, Caroline; Joos, Karen M.; Patel, Shriji N.; Tao, Yuankai K.

2016-01-01

Scanning laser ophthalmoscopy (SLO) benefits diagnostic imaging and therapeutic guidance by allowing for high-speed en face imaging of retinal structures. When combined with optical coherence tomography (OCT), SLO enables real-time aiming and retinal tracking and provides complementary information for post-acquisition volumetric co-registration, bulk motion compensation, and averaging. However, multimodality SLO-OCT systems generally require dedicated light sources, scanners, relay optics, detectors, and additional digitization and synchronization electronics, which increase system complexity. Here, we present a multimodal ophthalmic imaging system using swept-source spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography (SS-SESLO-OCT) for in vivo human retinal imaging. SESLO reduces the complexity of en face imaging systems by multiplexing spatial positions as a function of wavelength. SESLO image quality benefited from single-mode illumination and multimode collection through a prototype double-clad fiber coupler, which optimized scattered light throughput and reduce speckle contrast while maintaining lateral resolution. Using a shared 1060 nm swept-source, shared scanner and imaging optics, and a shared dual-channel high-speed digitizer, we acquired inherently co-registered en face retinal images and OCT cross-sections simultaneously at 200 frames-per-second. PMID:28101411

Molecular brain imaging in the multimodality era

PubMed Central

Price, Julie C

2012-01-01

Multimodality molecular brain imaging encompasses in vivo visualization, evaluation, and measurement of cellular/molecular processes. Instrumentation and software developments over the past 30 years have fueled advancements in multimodality imaging platforms that enable acquisition of multiple complementary imaging outcomes by either combined sequential or simultaneous acquisition. This article provides a general overview of multimodality neuroimaging in the context of positron emission tomography as a molecular imaging tool and magnetic resonance imaging as a structural and functional imaging tool. Several image examples are provided and general challenges are discussed to exemplify complementary features of the modalities, as well as important strengths and weaknesses of combined assessments. Alzheimer's disease is highlighted, as this clinical area has been strongly impacted by multimodality neuroimaging findings that have improved understanding of the natural history of disease progression, early disease detection, and informed therapy evaluation. PMID:22434068

Who acquires infection from whom and how? Disentangling multi-host and multi-mode transmission dynamics in the ‘elimination’ era

PubMed Central

Borlase, Anna; Rudge, James W.

2017-01-01

Multi-host infectious agents challenge our abilities to understand, predict and manage disease dynamics. Within this, many infectious agents are also able to use, simultaneously or sequentially, multiple modes of transmission. Furthermore, the relative importance of different host species and modes can itself be dynamic, with potential for switches and shifts in host range and/or transmission mode in response to changing selective pressures, such as those imposed by disease control interventions. The epidemiology of such multi-host, multi-mode infectious agents thereby can involve a multi-faceted community of definitive and intermediate/secondary hosts or vectors, often together with infectious stages in the environment, all of which may represent potential targets, as well as specific challenges, particularly where disease elimination is proposed. Here, we explore, focusing on examples from both human and animal pathogen systems, why and how we should aim to disentangle and quantify the relative importance of multi-host multi-mode infectious agent transmission dynamics under contrasting conditions, and ultimately, how this can be used to help achieve efficient and effective disease control. This article is part of the themed issue ‘Opening the black box: re-examining the ecology and evolution of parasite transmission’. PMID:28289259

Developing single-laser sources for multimodal coherent anti-Stokes Raman scattering microscopy

NASA Astrophysics Data System (ADS)

Pegoraro, Adrian Frank

Coherent anti-Stokes Raman scattering (CARS) microscopy has developed rapidly and is opening the door to new types of experiments. This work describes the development of new laser sources for CARS microscopy and their use for different applications. It is specifically focused on multimodal nonlinear optical microscopy—the simultaneous combination of different imaging techniques. This allows us to address a diverse range of applications, such as the study of biomaterials, fluid inclusions, atherosclerosis, hepatitis C infection in cells, and ice formation in cells. For these applications new laser sources are developed that allow for practical multimodal imaging. For example, it is shown that using a single Ti:sapphire oscillator with a photonic crystal fiber, it is possible to develop a versatile multimodal imaging system using optimally chirped laser pulses. This system can perform simultaneous two photon excited fluorescence, second harmonic generation, and CARS microscopy. The versatility of the system is further demonstrated by showing that it is possible to probe different Raman modes using CARS microscopy simply by changing a time delay between the excitation beams. Using optimally chirped pulses also enables further simplification of the laser system required by using a single fiber laser combined with nonlinear optical fibers to perform effective multimodal imaging. While these sources are useful for practical multimodal imaging, it is believed that for further improvements in CARS microscopy sensitivity, new excitation schemes are necessary. This has led to the design of a new, high power, extended cavity oscillator that should be capable of implementing new excitation schemes for CARS microscopy as well as other techniques. Our interest in multimodal imaging has led us to other areas of research as well. For example, a fiber-coupling scheme for signal collection in the forward direction is demonstrated that allows for fluorescence lifetime imaging without significant temporal distortion. Also highlighted is an imaging artifact that is unique to CARS microscopy that can alter image interpretation, especially when using multimodal imaging. By combining expertise in nonlinear optics, laser development, fiber optics, and microscopy, we have developed systems and techniques that will be of benefit for multimodal CARS microscopy.

Development of a brain monitoring system for multimodality investigation in awake rats.

PubMed

Limnuson, Kanokwan; Narayan, Raj K; Chiluwal, Amrit; Bouton, Chad; Ping Wang; Chunyan Li

2016-08-01

Multimodal brain monitoring is an important approach to gain insight into brain function, modulation, and pathology. We have developed a unique micromachined neural probe capable of real-time continuous monitoring of multiple physiological, biochemical and electrophysiological variables. However, to date, it has only been used in anesthetized animals due to a lack of an appropriate interface for awake animals. We have developed a versatile headstage for recording the small neural signal and bridging the sensors to the remote sensing units for multimodal brain monitoring in awake rats. The developed system has been successfully validated in awake rats by simultaneously measuring four cerebral variables: electrocorticography, oxygen tension, temperature and cerebral blood flow. Reliable signal recordings were obtained with minimal artifacts from movement and environmental noise. For the first time, multiple variables of cerebral function and metabolism were simultaneously recorded from awake rats using a single neural probe. The system is envisioned for studying the effects of pharmacologic treatments, mapping the development of central nervous system diseases, and better understanding normal cerebral physiology.

Multimodal optical workstation for simultaneous linear, nonlinear microscopy and nanomanipulation: upgrading a commercial confocal inverted microscope.

PubMed

Mathew, Manoj; Santos, Susana I C O; Zalvidea, Dobryna; Loza-Alvarez, Pablo

2009-07-01

In this work we propose and build a multimodal optical workstation that extends a commercially available confocal microscope (Nikon Confocal C1-Si) to include nonlinear/multiphoton microscopy and optical manipulation/stimulation tools such as nanosurgery. The setup allows both subsystems (confocal and nonlinear) to work independently and simultaneously. The workstation enables, for instance, nanosurgery along with simultaneous confocal and brightfield imaging. The nonlinear microscopy capabilities are added around the commercial confocal microscope by exploiting all the flexibility offered by this microscope and without need for any mechanical or electronic modification of the confocal microscope systems. As an example, the standard differential interference contrast condenser and diascopic detector in the confocal microscope are readily used as a forward detection mount for second harmonic generation imaging. The various capabilities of this workstation, as applied directly to biology, are demonstrated using the model organism Caenorhabditis elegans.

Single-cell multimodal profiling reveals cellular epigenetic heterogeneity.

PubMed

Cheow, Lih Feng; Courtois, Elise T; Tan, Yuliana; Viswanathan, Ramya; Xing, Qiaorui; Tan, Rui Zhen; Tan, Daniel S W; Robson, Paul; Loh, Yuin-Han; Quake, Stephen R; Burkholder, William F

2016-10-01

Sample heterogeneity often masks DNA methylation signatures in subpopulations of cells. Here, we present a method to genotype single cells while simultaneously interrogating gene expression and DNA methylation at multiple loci. We used this targeted multimodal approach, implemented on an automated, high-throughput microfluidic platform, to assess primary lung adenocarcinomas and human fibroblasts undergoing reprogramming by profiling epigenetic variation among cell types identified through genotyping and transcriptional analysis.

Using Shaun Tan's Work to Foster Multiliteracies in 21st-Century Classrooms

ERIC Educational Resources Information Center

Dallacqua, Ashley K.; Kersten, Sara; Rhoades, Mindi

2015-01-01

This paper explores work in multimodality and design as it relates to 21st century multiliteracies. After outlining the concept of a multiliteracies pedagogy, this paper describes multimodality and multimodal texts. Moving from the theoretical to the practical, this paper primarily explores selected multimodal works of Shaun Tan and the…

Adiabatically tapered splice for selective excitation of the fundamental mode in a multimode fiber.

PubMed

Jung, Yongmin; Jeong, Yoonchan; Brambilla, Gilberto; Richardson, David J

2009-08-01

We propose a simple and effective method to selectively excite the fundamental mode of a multimode fiber by adiabatically tapering a fusion splice to a single-mode fiber. We experimentally demonstrate the method by adiabatically tapering splice (taper waist=15 microm, uniform length=40 mm) between single-mode and multimode fiber and show that it provides a successful mode conversion/connection and allows for almost perfect fundamental mode excitation in the multimode fiber. Excellent beam quality (M(2) approximately 1.08) was achieved with low loss and high environmental stability.

Visual brain activity patterns classification with simultaneous EEG-fMRI: A multimodal approach.

PubMed

Ahmad, Rana Fayyaz; Malik, Aamir Saeed; Kamel, Nidal; Reza, Faruque; Amin, Hafeez Ullah; Hussain, Muhammad

2017-01-01

Classification of the visual information from the brain activity data is a challenging task. Many studies reported in the literature are based on the brain activity patterns using either fMRI or EEG/MEG only. EEG and fMRI considered as two complementary neuroimaging modalities in terms of their temporal and spatial resolution to map the brain activity. For getting a high spatial and temporal resolution of the brain at the same time, simultaneous EEG-fMRI seems to be fruitful. In this article, we propose a new method based on simultaneous EEG-fMRI data and machine learning approach to classify the visual brain activity patterns. We acquired EEG-fMRI data simultaneously on the ten healthy human participants by showing them visual stimuli. Data fusion approach is used to merge EEG and fMRI data. Machine learning classifier is used for the classification purposes. Results showed that superior classification performance has been achieved with simultaneous EEG-fMRI data as compared to the EEG and fMRI data standalone. This shows that multimodal approach improved the classification accuracy results as compared with other approaches reported in the literature. The proposed simultaneous EEG-fMRI approach for classifying the brain activity patterns can be helpful to predict or fully decode the brain activity patterns.

Vision 20/20: Simultaneous CT-MRI — Next chapter of multimodality imaging

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wang, Ge, E-mail: wangg6@rpi.edu; Xi, Yan; Gjesteby, Lars

Multimodality imaging systems such as positron emission tomography-computed tomography (PET-CT) and MRI-PET are widely available, but a simultaneous CT-MRI instrument has not been developed. Synergies between independent modalities, e.g., CT, MRI, and PET/SPECT can be realized with image registration, but such postprocessing suffers from registration errors that can be avoided with synchronized data acquisition. The clinical potential of simultaneous CT-MRI is significant, especially in cardiovascular and oncologic applications where studies of the vulnerable plaque, response to cancer therapy, and kinetic and dynamic mechanisms of targeted agents are limited by current imaging technologies. The rationale, feasibility, and realization of simultaneous CT-MRImore » are described in this perspective paper. The enabling technologies include interior tomography, unique gantry designs, open magnet and RF sequences, and source and detector adaptation. Based on the experience with PET-CT, PET-MRI, and MRI-LINAC instrumentation where hardware innovation and performance optimization were instrumental to construct commercial systems, the authors provide top-level concepts for simultaneous CT-MRI to meet clinical requirements and new challenges. Simultaneous CT-MRI fills a major gap of modality coupling and represents a key step toward the so-called “omnitomography” defined as the integration of all relevant imaging modalities for systems biology and precision medicine.« less

Multimodal Image Registration through Simultaneous Segmentation.

PubMed

Aganj, Iman; Fischl, Bruce

2017-11-01

Multimodal image registration facilitates the combination of complementary information from images acquired with different modalities. Most existing methods require computation of the joint histogram of the images, while some perform joint segmentation and registration in alternate iterations. In this work, we introduce a new non-information-theoretical method for pairwise multimodal image registration, in which the error of segmentation - using both images - is considered as the registration cost function. We empirically evaluate our method via rigid registration of multi-contrast brain magnetic resonance images, and demonstrate an often higher registration accuracy in the results produced by the proposed technique, compared to those by several existing methods.

Model regulations and plan amendments for multimodal transportation districts

DOT National Transportation Integrated Search

2004-02-01

In 1999, the Florida legislature enabled local governments to establish Multimodal Transportation Districts (MMTD) in their comprehensive plan as a means of promoting a high quality multimodal environment within selected urban areas. The Florida Depa...

Rats in Virtual Space: The development and implementation of a multimodal virtual reality system for small animals

NASA Astrophysics Data System (ADS)

Aharoni, Daniel Benjamin

The integration of multimodal sensory information into a common neural code is a critical function of all complex nervous systems. This process is required for adaptive responding to incoming stimuli as well as the formation of a cognitive map of the external sensory environment. The underlying neural mechanisms of multimodal integration are poorly understood due, in part, to the technical difficulties of manipulating multimodal sensory information in combination with simultaneous in-vivo electrophysiological recording in awake behaving animals. We therefore developed a non-invasive multimodal virtual reality system that is conducive to wired electrophysiological recording techniques. This system allows for the dynamic presentation of highly immersive audiovisual virtual environments to rats maintained in a body fixed position on top of a quiet spherical treadmill. Notably, this allows the rats to remain at the same spatial location in the real world without the need for head fixation. This method opens the door for a wide array of future studies aimed at elucidating the underlying neural mechanisms of multimodal integration.

Label-aligned Multi-task Feature Learning for Multimodal Classification of Alzheimer’s Disease and Mild Cognitive Impairment

PubMed Central

Zu, Chen; Jie, Biao; Liu, Mingxia; Chen, Songcan

2015-01-01

Multimodal classification methods using different modalities of imaging and non-imaging data have recently shown great advantages over traditional single-modality-based ones for diagnosis and prognosis of Alzheimer’s disease (AD), as well as its prodromal stage, i.e., mild cognitive impairment (MCI). However, to the best of our knowledge, most existing methods focus on mining the relationship across multiple modalities of the same subjects, while ignoring the potentially useful relationship across different subjects. Accordingly, in this paper, we propose a novel learning method for multimodal classification of AD/MCI, by fully exploring the relationships across both modalities and subjects. Specifically, our proposed method includes two subsequent components, i.e., label-aligned multi-task feature selection and multimodal classification. In the first step, the feature selection learning from multiple modalities are treated as different learning tasks and a group sparsity regularizer is imposed to jointly select a subset of relevant features. Furthermore, to utilize the discriminative information among labeled subjects, a new label-aligned regularization term is added into the objective function of standard multi-task feature selection, where label-alignment means that all multi-modality subjects with the same class labels should be closer in the new feature-reduced space. In the second step, a multi-kernel support vector machine (SVM) is adopted to fuse the selected features from multi-modality data for final classification. To validate our method, we perform experiments on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database using baseline MRI and FDG-PET imaging data. The experimental results demonstrate that our proposed method achieves better classification performance compared with several state-of-the-art methods for multimodal classification of AD/MCI. PMID:26572145

Mode synthesizing atomic force microscopy and mode-synthesizing sensing

DOEpatents

Passian, Ali; Thundat, Thomas George; Tetard, Laurene

2013-05-17

A method of analyzing a sample that includes applying a first set of energies at a first set of frequencies to a sample and applying, simultaneously with the applying the first set of energies, a second set of energies at a second set of frequencies, wherein the first set of energies and the second set of energies form a multi-mode coupling. The method further includes detecting an effect of the multi-mode coupling.

Mode-synthesizing atomic force microscopy and mode-synthesizing sensing

DOEpatents

Passain, Ali; Thundat, Thomas George; Tetard, Laurene

2014-07-22

A method of analyzing a sample that includes applying a first set of energies at a first set of frequencies to a sample and applying, simultaneously with the applying the first set of energies, a second set of energies at a second set of frequencies, wherein the first set of energies and the second set of energies form a multi-mode coupling. The method further includes detecting an effect of the multi-mode coupling.

Simultaneous fluorescence and quantitative phase microscopy with single-pixel detectors

NASA Astrophysics Data System (ADS)

Liu, Yang; Suo, Jinli; Zhang, Yuanlong; Dai, Qionghai

2018-02-01

Multimodal microscopy offers high flexibilities for biomedical observation and diagnosis. Conventional multimodal approaches either use multiple cameras or a single camera spatially multiplexing different modes. The former needs expertise demanding alignment and the latter suffers from limited spatial resolution. Here, we report an alignment-free full-resolution simultaneous fluorescence and quantitative phase imaging approach using single-pixel detectors. By combining reference-free interferometry with single-pixel detection, we encode the phase and fluorescence of the sample in two detection arms at the same time. Then we employ structured illumination and the correlated measurements between the sample and the illuminations for reconstruction. The recovered fluorescence and phase images are inherently aligned thanks to single-pixel detection. To validate the proposed method, we built a proof-of-concept setup for first imaging the phase of etched glass with the depth of a few hundred nanometers and then imaging the fluorescence and phase of the quantum dot drop. This method holds great potential for multispectral fluorescence microscopy with additional single-pixel detectors or a spectrometer. Besides, this cost-efficient multimodal system might find broad applications in biomedical science and neuroscience.

Joint sparse representation for robust multimodal biometrics recognition.

PubMed

Shekhar, Sumit; Patel, Vishal M; Nasrabadi, Nasser M; Chellappa, Rama

2014-01-01

Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle nonlinearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that the proposed method compares favorably with competing fusion-based methods.

Multimode Surface Plasmon Excitations on Organic Thin Film/Metallic Diffraction Grating

NASA Astrophysics Data System (ADS)

Baba, Akira; Kanda, Kenji; Ohno, Tsutomu; Ohdaira, Yasuo; Shinbo, Kazunari; Kato, Keizo; Kaneko, Futao

2010-01-01

In this work, we demonstrate multimode surface plasmon (SP) excitations by white light irradiation on metallic diffraction grating/plastic substrates. Recordable compact discs were used as the diffraction grating substrates on which silver films were deposited by vacuum evaporation. Since the grating pitch (1.6 µm) was larger than that of diffraction gratings commonly used for the excitation of SPs, multimode SP excitations due to several diffraction orders were observed simultaneously in the wavelength region from 400 to 800 nm. The obtained SP excitations were then compared with the calculated SP dispersion on the grating. The multimode SP excitations were further studied on spin-coated poly[2-methoxy-5-(2'-ethyl-hexyloxy)-1,4-phenylene vinylene] (MEH-PPV) thin film/silver grating substrates. An increased photoluminescence intensity due to SP excitations was observed on MEH-PPV/silver grating surfaces.

Multimodal imaging of ischemic wounds

NASA Astrophysics Data System (ADS)

Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Liu, Peng; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

2012-12-01

The wound healing process involves the reparative phases of inflammation, proliferation, and remodeling. Interrupting any of these phases may result in chronically unhealed wounds, amputation, or even patient death. Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, no method is available for noninvasive, simultaneous, and quantitative imaging of these tissue parameters. We integrated hyperspectral, laser speckle, and thermographic imaging modalities into a single setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Advanced algorithms were developed for accurate reconstruction of wound oxygenation and appropriate co-registration between different imaging modalities. The multimodal wound imaging system was validated by an ongoing clinical trials approved by OSU IRB. In the clinical trial, a wound of 3mm in diameter was introduced on a healthy subject's lower extremity and the healing process was serially monitored by the multimodal imaging setup. Our experiments demonstrated the clinical usability of multimodal wound imaging.

A miniature integrated multimodal sensor for measuring pH, EC and temperature for precision agriculture.

PubMed

Futagawa, Masato; Iwasaki, Taichi; Murata, Hiroaki; Ishida, Makoto; Sawada, Kazuaki

2012-01-01

Making several simultaneous measurements with different kinds of sensors at the same location in a solution is difficult because of crosstalk between the sensors. In addition, because the conditions at different locations in plant beds differ, in situ measurements in agriculture need to be done in small localized areas. We have fabricated a multimodal sensor on a small Si chip in which a pH sensor was integrated with electrical conductivity (EC) and temperature sensors. An ISFET with a Si(3)N(4) membrane was used for the pH sensor. For the EC sensor, the electrical conductivity between platinum electrodes was measured, and the temperature sensor was a p-n junction diode. These are some of the most important measurements required for controlling the conditions in plant beds. The multimodal sensor can be inserted into a plant bed for in situ monitoring. To confirm the absence of crosstalk between the sensors, we made simultaneous measurements of pH, EC, and temperature of a pH buffer solution in a plant bed. When the solution was diluted with hot or cold water, the real time measurements showed changes to the EC and temperature, but no change in pH. We also demonstrated that our sensor was capable of simultaneous in situ measurements in rock wool without being affected by crosstalk.

A Miniature Integrated Multimodal Sensor for Measuring pH, EC and Temperature for Precision Agriculture

PubMed Central

Futagawa, Masato; Iwasaki, Taichi; Murata, Hiroaki; Ishida, Makoto; Sawada, Kazuaki

2012-01-01

Making several simultaneous measurements with different kinds of sensors at the same location in a solution is difficult because of crosstalk between the sensors. In addition, because the conditions at different locations in plant beds differ, in situ measurements in agriculture need to be done in small localized areas. We have fabricated a multimodal sensor on a small Si chip in which a pH sensor was integrated with electrical conductivity (EC) and temperature sensors. An ISFET with a Si3N4 membrane was used for the pH sensor. For the EC sensor, the electrical conductivity between platinum electrodes was measured, and the temperature sensor was a p-n junction diode. These are some of the most important measurements required for controlling the conditions in plant beds. The multimodal sensor can be inserted into a plant bed for in situ monitoring. To confirm the absence of crosstalk between the sensors, we made simultaneous measurements of pH, EC, and temperature of a pH buffer solution in a plant bed. When the solution was diluted with hot or cold water, the real time measurements showed changes to the EC and temperature, but no change in pH. We also demonstrated that our sensor was capable of simultaneous in situ measurements in rock wool without being affected by crosstalk. PMID:22969403

Angle selective fiber coupler.

PubMed

Barnoski, M K; Morrison, R J

1976-01-01

Angle selective input coupling through the side of a slightly tapered section of Corning highly multimode fiber has been experimentally demonstrated for the first time. This coupling technique allows the possibility of fabricating bidirectional (duplex) couplers for systems employing single strands of multimode, low loss fiber.

Design and characterization of a handheld multimodal imaging device for the assessment of oral epithelial lesions

NASA Astrophysics Data System (ADS)

Higgins, Laura M.; Pierce, Mark C.

2014-08-01

A compact handpiece combining high resolution fluorescence (HRF) imaging with optical coherence tomography (OCT) was developed to provide real-time assessment of oral lesions. This multimodal imaging device simultaneously captures coregistered en face images with subcellular detail alongside cross-sectional images of tissue microstructure. The HRF imaging acquires a 712×594 μm2 field-of-view at the sample with a spatial resolution of 3.5 μm. The OCT images were acquired to a depth of 1.5 mm with axial and lateral resolutions of 9.3 and 8.0 μm, respectively. HRF and OCT images are simultaneously displayed at 25 fps. The handheld device was used to image a healthy volunteer, demonstrating the potential for in vivo assessment of the epithelial surface for dysplastic and neoplastic changes at the cellular level, while simultaneously evaluating submucosal involvement. We anticipate potential applications in real-time assessment of oral lesions for improved surveillance and surgical guidance.

Multimodal Imaging of the Normal Eye.

PubMed

Kawali, Ankush; Pichi, Francesco; Avadhani, Kavitha; Invernizzi, Alessandro; Hashimoto, Yuki; Mahendradas, Padmamalini

2017-10-01

Multimodal imaging is the concept of "bundling" images obtained from various imaging modalities, viz., fundus photograph, fundus autofluorescence imaging, infrared (IR) imaging, simultaneous fluorescein and indocyanine angiography, optical coherence tomography (OCT), and, more recently, OCT angiography. Each modality has its pros and cons as well as its limitations. Combination of multiple imaging techniques will overcome their individual weaknesses and give a comprehensive picture. Such approach helps in accurate localization of a lesion and understanding the pathology in posterior segment. It is important to know imaging of normal eye before one starts evaluating pathology. This article describes multimodal imaging modalities in detail and discusses healthy eye features as seen on various imaging modalities mentioned above.

Multimodal imaging of cutaneous wound tissue

NASA Astrophysics Data System (ADS)

Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Ren, Wenqi; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

2015-01-01

Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, few methods are available for simultaneous assessment of these tissue parameters in a noninvasive and quantitative fashion. We integrated hyperspectral, laser speckle, and thermographic imaging modalities in a single-experimental setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Algorithms were developed for appropriate coregistration between wound images acquired by different imaging modalities at different times. The multimodal wound imaging system was validated in an occlusion experiment, where oxygenation and perfusion maps of a healthy subject's upper extremity were continuously monitored during a postocclusive reactive hyperemia procedure and compared with standard measurements. The system was also tested in a clinical trial where a wound of three millimeters in diameter was introduced on a healthy subject's lower extremity and the healing process was continuously monitored. Our in vivo experiments demonstrated the clinical feasibility of multimodal cutaneous wound imaging.

When to Intervene in Selective Mutism: The Multimodal Treatment of a Case of Persistent Selective Mutism.

ERIC Educational Resources Information Center

Powell, Shawn; Dalley, Mahlono

1995-01-01

An identification and treatment model differentiating transient mutism from persistent selective mutism is proposed. The case study of a six-year-old girl is presented, who was treated with a multimodal approach combining behavioral techniques with play therapy and family involvement. At posttreatment and follow-up, she was talking in a manner…

A photoactivable multi-inhibitor nanoliposome for tumour control and simultaneous inhibition of treatment escape pathways

NASA Astrophysics Data System (ADS)

Spring, Bryan Q.; Bryan Sears, R.; Zheng, Lei Zak; Mai, Zhiming; Watanabe, Reika; Sherwood, Margaret E.; Schoenfeld, David A.; Pogue, Brian W.; Pereira, Stephen P.; Villa, Elizabeth; Hasan, Tayyaba

2016-04-01

Nanoscale drug delivery vehicles can facilitate multimodal therapies of cancer by promoting tumour-selective drug release. However, few are effective because cancer cells develop ways to resist and evade treatment. Here, we introduce a photoactivable multi-inhibitor nanoliposome (PMIL) that imparts light-induced cytotoxicity in synchrony with a photoinitiated and sustained release of inhibitors that suppress tumour regrowth and treatment escape signalling pathways. The PMIL consists of a nanoliposome doped with a photoactivable chromophore (benzoporphyrin derivative, BPD) in the lipid bilayer, and a nanoparticle containing cabozantinib (XL184)—a multikinase inhibitor—encapsulated inside. Near-infrared tumour irradiation, following intravenous PMIL administration, triggers photodynamic damage of tumour cells and microvessels, and simultaneously initiates release of XL184 inside the tumour. A single PMIL treatment achieves prolonged tumour reduction in two mouse models and suppresses metastatic escape in an orthotopic pancreatic tumour model. The PMIL offers new prospects for cancer therapy by enabling spatiotemporal control of drug release while reducing systemic drug exposure and associated toxicities.

Multimodal hard x-ray imaging with resolution approaching 10 nm for studies in material science

NASA Astrophysics Data System (ADS)

Yan, Hanfei; Bouet, Nathalie; Zhou, Juan; Huang, Xiaojing; Nazaretski, Evgeny; Xu, Weihe; Cocco, Alex P.; Chiu, Wilson K. S.; Brinkman, Kyle S.; Chu, Yong S.

2018-03-01

We report multimodal scanning hard x-ray imaging with spatial resolution approaching 10 nm and its application to contemporary studies in the field of material science. The high spatial resolution is achieved by focusing hard x-rays with two crossed multilayer Laue lenses and raster-scanning a sample with respect to the nanofocusing optics. Various techniques are used to characterize and verify the achieved focus size and imaging resolution. The multimodal imaging is realized by utilizing simultaneously absorption-, phase-, and fluorescence-contrast mechanisms. The combination of high spatial resolution and multimodal imaging enables a comprehensive study of a sample on a very fine length scale. In this work, the unique multimodal imaging capability was used to investigate a mixed ionic-electronic conducting ceramic-based membrane material employed in solid oxide fuel cells and membrane separations (compound of Ce0.8Gd0.2O2‑x and CoFe2O4) which revealed the existence of an emergent material phase and quantified the chemical complexity at the nanoscale.

Prediction of Cognitive States During Flight Simulation Using Multimodal Psychophysiological Sensing

NASA Technical Reports Server (NTRS)

Harrivel, Angela R.; Stephens, Chad L.; Milletich, Robert J.; Heinich, Christina M.; Last, Mary Carolyn; Napoli, Nicholas J.; Abraham, Nijo A.; Prinzel, Lawrence J.; Motter, Mark A.; Pope, Alan T.

2017-01-01

The Commercial Aviation Safety Team found the majority of recent international commercial aviation accidents attributable to loss of control inflight involved flight crew loss of airplane state awareness (ASA), and distraction was involved in all of them. Research on attention-related human performance limiting states (AHPLS) such as channelized attention, diverted attention, startle/surprise, and confirmation bias, has been recommended in a Safety Enhancement (SE) entitled "Training for Attention Management." To accomplish the detection of such cognitive and psychophysiological states, a broad suite of sensors was implemented to simultaneously measure their physiological markers during a high fidelity flight simulation human subject study. Twenty-four pilot participants were asked to wear the sensors while they performed benchmark tasks and motion-based flight scenarios designed to induce AHPLS. Pattern classification was employed to predict the occurrence of AHPLS during flight simulation also designed to induce those states. Classifier training data were collected during performance of the benchmark tasks. Multimodal classification was performed, using pre-processed electroencephalography, galvanic skin response, electrocardiogram, and respiration signals as input features. A combination of one, some or all modalities were used. Extreme gradient boosting, random forest and two support vector machine classifiers were implemented. The best accuracy for each modality-classifier combination is reported. Results using a select set of features and using the full set of available features are presented. Further, results are presented for training one classifier with the combined features and for training multiple classifiers with features from each modality separately. Using the select set of features and combined training, multistate prediction accuracy averaged 0.64 +/- 0.14 across thirteen participants and was significantly higher than that for the separate training case. These results support the goal of demonstrating simultaneous real-time classification of multiple states using multiple sensing modalities in high fidelity flight simulators. This detection is intended to support and inform training methods under development to mitigate the loss of ASA and thus reduce accidents and incidents.

A multimodal imaging platform with integrated simultaneous photoacoustic microscopy, optical coherence tomography, optical Doppler tomography and fluorescence microscopy

NASA Astrophysics Data System (ADS)

Dadkhah, Arash; Zhou, Jun; Yeasmin, Nusrat; Jiao, Shuliang

2018-02-01

Various optical imaging modalities with different optical contrast mechanisms have been developed over the past years. Although most of these imaging techniques are being used in many biomedical applications and researches, integration of these techniques will allow researchers to reach the full potential of these technologies. Nevertheless, combining different imaging techniques is always challenging due to the difference in optical and hardware requirements for different imaging systems. Here, we developed a multimodal optical imaging system with the capability of providing comprehensive structural, functional and molecular information of living tissue in micrometer scale. This imaging system integrates photoacoustic microscopy (PAM), optical coherence tomography (OCT), optical Doppler tomography (ODT) and fluorescence microscopy in one platform. Optical-resolution PAM (OR-PAM) provides absorption-based imaging of biological tissues. Spectral domain OCT is able to provide structural information based on the scattering property of biological sample with no need for exogenous contrast agents. In addition, ODT is a functional extension of OCT with the capability of measurement and visualization of blood flow based on the Doppler effect. Fluorescence microscopy allows to reveal molecular information of biological tissue using autofluoresce or exogenous fluorophores. In-vivo as well as ex-vivo imaging studies demonstrated the capability of our multimodal imaging system to provide comprehensive microscopic information on biological tissues. Integrating all the aforementioned imaging modalities for simultaneous multimodal imaging has promising potential for preclinical research and clinical practice in the near future.

Learning multimodal dictionaries.

PubMed

Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

2007-09-01

Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

Simultaneous identification of optical constants and PSD of spherical particles by multi-wavelength scattering-transmittance measurement

NASA Astrophysics Data System (ADS)

Zhang, Jun-You; Qi, Hong; Ren, Ya-Tao; Ruan, Li-Ming

2018-04-01

An accurate and stable identification technique is developed to retrieve the optical constants and particle size distributions (PSDs) of particle system simultaneously from the multi-wavelength scattering-transmittance signals by using the improved quantum particle swarm optimization algorithm. The Mie theory are selected to calculate the directional laser intensity scattered by particles and the spectral collimated transmittance. The sensitivity and objective function distribution analysis were conducted to evaluate the mathematical properties (i.e. ill-posedness and multimodality) of the inverse problems under three different optical signals combinations (i.e. the single-wavelength multi-angle light scattering signal, the single-wavelength multi-angle light scattering and spectral transmittance signal, and the multi-angle light scattering and spectral transmittance signal). It was found the best global convergence performance can be obtained by using the multi-wavelength scattering-transmittance signals. Meanwhile, the present technique have been tested under different Gaussian measurement noise to prove its feasibility in a large solution space. All the results show that the inverse technique by using multi-wavelength scattering-transmittance signals is effective and suitable for retrieving the optical complex refractive indices and PSD of particle system simultaneously.

The Study on the Optimization of Container Multimodal Transport Business Process in Shandong

NASA Astrophysics Data System (ADS)

Wang, Fengmei; Gong, Xiaoyi; Ni, Yingying; Zhan, Jun; Che, Huiping

2018-06-01

Shandong is a coastal city with good location advantages. As a hub port for international trade goods and a port of transhipment, shandong's demand for multimodal transport is more urgent. By selecting the suitable non-water port and the multimodal transport carrier to improve the efficiency of multimodal transport, the purpose of saving the time of logistics is achieved, thus reducing the logistics cost.It branch out through Shandongt, and it can reach the central region of China, can reach the Western remote area ,too. This paper puts forward the optimization scheme of the business process of container multimodal transport. The optimization of freight forwarding business process is analyzed. The multimodal transport model in Shandong was designed. Finally, the optimal approach of multimodal transport in Shandong is put forward.

Mode-selective mapping and control of vectorial nonlinear-optical processes in multimode photonic-crystal fibers.

PubMed

Hu, Ming-Lie; Wang, Ching-Yue; Song, You-Jian; Li, Yan-Feng; Chai, Lu; Serebryannikov, Evgenii; Zheltikov, Aleksei

2006-02-06

We demonstrate an experimental technique that allows a mapping of vectorial nonlinear-optical processes in multimode photonic-crystal fibers (PCFs). Spatial and polarization modes of PCFs are selectively excited in this technique by varying the tilt angle of the input beam and rotating the polarization of the input field. Intensity spectra of the PCF output plotted as a function of the input field power and polarization then yield mode-resolved maps of nonlinear-optical interactions in multimode PCFs, facilitating the analysis and control of nonlinear-optical transformations of ultrashort laser pulses in such fibers.

Using Poetry as a Communication Multimodality to Encourage Reading Engagement of Selected African-American Learners: A Case Study

ERIC Educational Resources Information Center

Ward, Cherie A.

2015-01-01

This study examined the use of poetry as a multimodal communicative text to encourage reading engagement in selected African-American learners with mild intellectual disabilities. Framed by critical discourse theory, genre theory, and Gardner's theory of multiple intelligences, this investigation presented poetry as an alternative text…

Spatiotemporal light-beam compression from nonlinear mode coupling

NASA Astrophysics Data System (ADS)

Krupa, Katarzyna; Tonello, Alessandro; Couderc, Vincent; Barthélémy, Alain; Millot, Guy; Modotto, Daniele; Wabnitz, Stefan

2018-04-01

We experimentally demonstrate simultaneous spatial and temporal compression in the propagation of light pulses in multimode nonlinear optical fibers. We reveal that the spatial beam self-cleaning recently discovered in graded-index multimode fibers is accompanied by significant temporal reshaping and up to fourfold shortening of the injected subnanosecond laser pulses. Since the nonlinear coupling among the modes strongly depends on the instantaneous power, we explore the entire range of the nonlinear dynamics with a single optical pulse, where the optical power is continuously varied across the pulse profile.

Multimodal browsing using VoiceXML

NASA Astrophysics Data System (ADS)

Caccia, Giuseppe; Lancini, Rosa C.; Peschiera, Giuseppe

2003-06-01

With the increasing development of devices such as personal computers, WAP and personal digital assistants connected to the World Wide Web, end users feel the need to browse the Internet through multiple modalities. We intend to investigate on how to create a user interface and a service distribution platform granting the user access to the Internet through standard I/O modalities and voice simultaneously. Different architectures are evaluated suggesting the more suitable for each client terminal (PC o WAP). In particular the design of the multimodal usermachine interface considers the synchronization issue between graphical and voice contents.

PEDOT:PSS/QCM-based multimodal humidity and pressure sensor

DOE Office of Scientific and Technical Information (OSTI.GOV)

Muckley, Eric S.; Lynch, James; Kumar, Rajeev

A room-temperature multimodal sensor composed of PEDOT:PSS deposited on an AT-cut quartz crystalmicrobalance (QCM) crystal has been fabricated. The nonlinear resistive and frequency sensor responses aredeconvolved using an articial neural network (ANN), which allows the single sensor to function simultane-ously as a relative humidity (RH) sensor and a pressure sensor using only two electrodes. We demonstratethat the predictive ability of the sensor is highly inuenced by the data used to train the ANN. When trainingsets are tailored to resemble the operating conditions of the sensor, the sensor achieves an average resolutionof < 3% RH from 0-100% RH, even after Hmore » 2O saturation occurs on the surface. Our results indicate thatANNs show strong promise for improving the resolution of low cost gas sensors and for expanding the rangeof environmental conditions in which a given sensor can operate.« less

PEDOT:PSS/QCM-based multimodal humidity and pressure sensor

DOE PAGES

Muckley, Eric S.; Lynch, James; Kumar, Rajeev; ...

2016-05-11

A room-temperature multimodal sensor composed of PEDOT:PSS deposited on an AT-cut quartz crystalmicrobalance (QCM) crystal has been fabricated. The nonlinear resistive and frequency sensor responses aredeconvolved using an articial neural network (ANN), which allows the single sensor to function simultane-ously as a relative humidity (RH) sensor and a pressure sensor using only two electrodes. We demonstratethat the predictive ability of the sensor is highly inuenced by the data used to train the ANN. When trainingsets are tailored to resemble the operating conditions of the sensor, the sensor achieves an average resolutionof < 3% RH from 0-100% RH, even after Hmore » 2O saturation occurs on the surface. Our results indicate thatANNs show strong promise for improving the resolution of low cost gas sensors and for expanding the rangeof environmental conditions in which a given sensor can operate.« less

Multimodal Spatial Calibration for Accurately Registering EEG Sensor Positions

PubMed Central

Chen, Shengyong; Xiao, Gang; Li, Xiaoli

2014-01-01

This paper proposes a fast and accurate calibration method to calibrate multiple multimodal sensors using a novel photogrammetry system for fast localization of EEG sensors. The EEG sensors are placed on human head and multimodal sensors are installed around the head to simultaneously obtain all EEG sensor positions. A multiple views' calibration process is implemented to obtain the transformations of multiple views. We first develop an efficient local repair algorithm to improve the depth map, and then a special calibration body is designed. Based on them, accurate and robust calibration results can be achieved. We evaluate the proposed method by corners of a chessboard calibration plate. Experimental results demonstrate that the proposed method can achieve good performance, which can be further applied to EEG source localization applications on human brain. PMID:24803954

Multimode intravascular RF coil for MRI-guided interventions.

PubMed

Kurpad, Krishna N; Unal, Orhan

2011-04-01

To demonstrate the feasibility of using a single intravascular radiofrequency (RF) probe connected to the external magnetic resonance imaging (MRI) system via a single coaxial cable to perform active tip tracking and catheter visualization and high signal-to-noise ratio (SNR) intravascular imaging. A multimode intravascular RF coil was constructed on a 6F balloon catheter and interfaced to a 1.5T MRI scanner via a decoupling circuit. Bench measurements of coil impedances were followed by imaging experiments in saline and phantoms. The multimode coil behaves as an inductively coupled transmit coil. The forward-looking capability of 6 mm was measured. A greater than 3-fold increase in SNR compared to conventional imaging using optimized external coil was demonstrated. Simultaneous active tip tracking and catheter visualization was demonstrated. It is feasible to perform 1) active tip tracking, 2) catheter visualization, and 3) high SNR imaging using a single multimode intravascular RF coil that is connected to the external system via a single coaxial cable. Copyright © 2011 Wiley-Liss, Inc.

Multi-mode Intravascular RF Coil for MRI-guided Interventions

PubMed Central

Kurpad, Krishna N.; Unal, Orhan

2011-01-01

Purpose To demonstrate the feasibility of using a single intravascular RF probe connected to the external MRI system via a single coaxial cable to perform active tip tracking and catheter visualization, and high SNR intravascular imaging. Materials and Methods A multi-mode intravascular RF coil was constructed on a 6F balloon catheter and interfaced to a 1.5T MRI scanner via a decoupling circuit. Bench measurements of coil impedances were followed by imaging experiments in saline and phantoms. Results The multi-mode coil behaves as an inductively-coupled transmit coil. Forward looking capability of 6mm is measured. Greater than 3-fold increase in SNR compared to conventional imaging using optimized external coil is demonstrated. Simultaneous active tip tracking and catheter visualization is demonstrated. Conclusions It is feasible to perform 1) active tip tracking, 2) catheter visualization, and 3) high SNR imaging using a single multi-mode intravascular RF coil that is connected to the external system via a single coaxial cable. PMID:21448969

Study of wavelength division multiplexing as a means of increasing the number of channels in multimode fiber optic communication links

NASA Technical Reports Server (NTRS)

Bates, Harry

1990-01-01

A number of optical communication lines are now in use at the Kennedy Space Center (KSC) for the transmission of voice, computer data, and video signals. Presently, all of these channels utilize a single carrier wavelength centered near 1300 nm. The theoretical bandwidth of the fiber far exceeds the utilized capacity. Yet, practical considerations limit the usable bandwidth. The fibers have the capability of transmitting a multiplicity of signals simultaneously in each of two separate bands (1300 and 1550 nm). Thus, in principle, the number of transmission channels can be increased without installing new cable if some means of wavelength division multiplexing (WDM) can be utilized. The main goal of these experiments was to demonstrate that a factor of 2 increase in bandwidth utilization can share the same fiber in both a unidirectional configuration and a bidirectional mode of operation. Both signal and multimode fiber are installed at KSC. The great majority is multimode; therefore, this effort concentrated on multimode systems.

Precise Spatially Selective Photothermolysis Using Modulated Femtosecond Lasers and Real-time Multimodal Microscopy Monitoring.

PubMed

Huang, Yimei; Lui, Harvey; Zhao, Jianhua; Wu, Zhenguo; Zeng, Haishan

2017-01-01

The successful application of lasers in the treatment of skin diseases and cosmetic surgery is largely based on the principle of conventional selective photothermolysis which relies strongly on the difference in the absorption between the therapeutic target and its surroundings. However, when the differentiation in absorption is not sufficient, collateral damage would occur due to indiscriminate and nonspecific tissue heating. To deal with such cases, we introduce a novel spatially selective photothermolysis method based on multiphoton absorption in which the radiant energy of a tightly focused near-infrared femtosecond laser beam can be directed spatially by aiming the laser focal point to the target of interest. We construct a multimodal optical microscope to perform and monitor the spatially selective photothermolysis. We demonstrate that precise alteration of the targeted tissue is achieved while leaving surrounding tissue intact by choosing appropriate femtosecond laser exposure with multimodal optical microscopy monitoring in real time.

Precise Spatially Selective Photothermolysis Using Modulated Femtosecond Lasers and Real-time Multimodal Microscopy Monitoring

PubMed Central

Huang, Yimei; Lui, Harvey; Zhao, Jianhua; Wu, Zhenguo; Zeng, Haishan

2017-01-01

The successful application of lasers in the treatment of skin diseases and cosmetic surgery is largely based on the principle of conventional selective photothermolysis which relies strongly on the difference in the absorption between the therapeutic target and its surroundings. However, when the differentiation in absorption is not sufficient, collateral damage would occur due to indiscriminate and nonspecific tissue heating. To deal with such cases, we introduce a novel spatially selective photothermolysis method based on multiphoton absorption in which the radiant energy of a tightly focused near-infrared femtosecond laser beam can be directed spatially by aiming the laser focal point to the target of interest. We construct a multimodal optical microscope to perform and monitor the spatially selective photothermolysis. We demonstrate that precise alteration of the targeted tissue is achieved while leaving surrounding tissue intact by choosing appropriate femtosecond laser exposure with multimodal optical microscopy monitoring in real time. PMID:28255346

Intermodal Attention Shifts in Multimodal Working Memory.

PubMed

Katus, Tobias; Grubert, Anna; Eimer, Martin

2017-04-01

Attention maintains task-relevant information in working memory (WM) in an active state. We investigated whether the attention-based maintenance of stimulus representations that were encoded through different modalities is flexibly controlled by top-down mechanisms that depend on behavioral goals. Distinct components of the ERP reflect the maintenance of tactile and visual information in WM. We concurrently measured tactile (tCDA) and visual contralateral delay activity (CDA) to track the attentional activation of tactile and visual information during multimodal WM. Participants simultaneously received tactile and visual sample stimuli on the left and right sides and memorized all stimuli on one task-relevant side. After 500 msec, an auditory retrocue indicated whether the sample set's tactile or visual content had to be compared with a subsequent test stimulus set. tCDA and CDA components that emerged simultaneously during the encoding phase were consistently reduced after retrocues that marked the corresponding (tactile or visual) modality as task-irrelevant. The absolute size of cue-dependent modulations was similar for the tCDA/CDA components and did not depend on the number of tactile/visual stimuli that were initially encoded into WM. Our results suggest that modality-specific maintenance processes in sensory brain regions are flexibly modulated by top-down influences that optimize multimodal WM representations for behavioral goals.

Multifocus confocal Raman microspectroscopy for fast multimode vibrational imaging of living cells.

PubMed

Okuno, Masanari; Hamaguchi, Hiro-o

2010-12-15

We have developed a multifocus confocal Raman microspectroscopic system for the fast multimode vibrational imaging of living cells. It consists of an inverted microscope equipped with a microlens array, a pinhole array, a fiber bundle, and a multichannel Raman spectrometer. Forty-eight Raman spectra from 48 foci under the microscope are simultaneously obtained by using multifocus excitation and image-compression techniques. The multifocus confocal configuration suppresses the background generated from the cover glass and the cell culturing medium so that high-contrast images are obtainable with a short accumulation time. The system enables us to obtain multimode (10 different vibrational modes) vibrational images of living cells in tens of seconds with only 1 mW laser power at one focal point. This image acquisition time is more than 10 times faster than that in conventional single-focus Raman microspectroscopy.

Multimodal Image Alignment via Linear Mapping between Feature Modalities.

PubMed

Jiang, Yanyun; Zheng, Yuanjie; Hou, Sujuan; Chang, Yuchou; Gee, James

2017-01-01

We propose a novel landmark matching based method for aligning multimodal images, which is accomplished uniquely by resolving a linear mapping between different feature modalities. This linear mapping results in a new measurement on similarity of images captured from different modalities. In addition, our method simultaneously solves this linear mapping and the landmark correspondences by minimizing a convex quadratic function. Our method can estimate complex image relationship between different modalities and nonlinear nonrigid spatial transformations even in the presence of heavy noise, as shown in our experiments carried out by using a variety of image modalities.

Sensing textile seam-line for wearable multimodal physiological monitoring.

PubMed

McKnight, M; Agcayazi, T; Kausche, H; Ghosh, T; Bozkurt, A

2016-08-01

This paper investigates a novel multimodal sensing method by forming seam-lines of conductive textile fibers into commercially available fabrics. The proposed ultra-low cost micro-electro-mechanical sensor would provide, wearable, flexible, textile based biopotential signal recording, wetness detection and tactile sensing simultaneously. Three types of fibers are evaluated for their array-based sensing capability, including a 3D printed conductive fiber, a multiwall carbon nanotube based fiber, and a commercially available stainless steel conductive thread. The sensors were shown to have a correlation between capacitance and pressure; impedance and wetness; and recorded potential and ECG waveforms.

Monolithically integrated distributed feedback laser array wavelength-selectable light sources for WDM-PON application

NASA Astrophysics Data System (ADS)

Chen, Xin; Zhao, Jianyi; Zhou, Ning; Huang, Xiaodong; Cao, Mingde; Wang, Lei; Liu, Wen

2015-01-01

The monolithic integration of 1.5-μm four channels phase shift distributed feedback lasers array (DFB-LD array) with 4×1 multi-mode interference (MMI) optical combiner is demonstrated. A home developed process mainly consists of butt-joint regrowth (BJR) and simultaneous thermal and ultraviolet nanoimprint lithography (STU-NIL) is implemented to fabricate gratings and integrated devices. The threshold currents of the lasers are less than 10 mA and the side mode suppression ratios (SMSR) are better than 40 dB for all channels. Quasi-continuous tuning is realized over 7.5 nm wavelength region with the 30 °C temperature variation. The results indicate that the integration device we proposed can be used in wavelength division multiplexing passive optical networks (WDM-PON).

Simultaneous acquisition of EEG and NIRS during cognitive tasks for an open access dataset.

PubMed

Shin, Jaeyoung; von Lühmann, Alexander; Kim, Do-Won; Mehnert, Jan; Hwang, Han-Jeong; Müller, Klaus-Robert

2018-02-13

We provide an open access multimodal brain-imaging dataset of simultaneous electroencephalography (EEG) and near-infrared spectroscopy (NIRS) recordings. Twenty-six healthy participants performed three cognitive tasks: 1) n-back (0-, 2- and 3-back), 2) discrimination/selection response task (DSR) and 3) word generation (WG) tasks. The data provided includes: 1) measured data, 2) demographic data, and 3) basic analysis results. For n-back (dataset A) and DSR tasks (dataset B), event-related potential (ERP) analysis was performed, and spatiotemporal characteristics and classification results for 'target' versus 'non-target' (dataset A) and symbol 'O' versus symbol 'X' (dataset B) are provided. Time-frequency analysis was performed to show the EEG spectral power to differentiate the task-relevant activations. Spatiotemporal characteristics of hemodynamic responses are also shown. For the WG task (dataset C), the EEG spectral power and spatiotemporal characteristics of hemodynamic responses are analyzed, and the potential merit of hybrid EEG-NIRS BCIs was validated with respect to classification accuracy. We expect that the dataset provided will facilitate performance evaluation and comparison of many neuroimaging analysis techniques.

Simultaneous acquisition of EEG and NIRS during cognitive tasks for an open access dataset

PubMed Central

Shin, Jaeyoung; von Lühmann, Alexander; Kim, Do-Won; Mehnert, Jan; Hwang, Han-Jeong; Müller, Klaus-Robert

2018-01-01

We provide an open access multimodal brain-imaging dataset of simultaneous electroencephalography (EEG) and near-infrared spectroscopy (NIRS) recordings. Twenty-six healthy participants performed three cognitive tasks: 1) n-back (0-, 2- and 3-back), 2) discrimination/selection response task (DSR) and 3) word generation (WG) tasks. The data provided includes: 1) measured data, 2) demographic data, and 3) basic analysis results. For n-back (dataset A) and DSR tasks (dataset B), event-related potential (ERP) analysis was performed, and spatiotemporal characteristics and classification results for ‘target’ versus ‘non-target’ (dataset A) and symbol ‘O’ versus symbol ‘X’ (dataset B) are provided. Time-frequency analysis was performed to show the EEG spectral power to differentiate the task-relevant activations. Spatiotemporal characteristics of hemodynamic responses are also shown. For the WG task (dataset C), the EEG spectral power and spatiotemporal characteristics of hemodynamic responses are analyzed, and the potential merit of hybrid EEG-NIRS BCIs was validated with respect to classification accuracy. We expect that the dataset provided will facilitate performance evaluation and comparison of many neuroimaging analysis techniques. PMID:29437166

Simultaneous observations of electromagnetically induced transparency (EIT) and absorption (EIA) in a multi-level V-type system of 87Rb and theoretical simulation of the observed spectra using a multi-mode approach

NASA Astrophysics Data System (ADS)

Das, Bankim Chandra; Bhattacharyya, Dipankar; Das, Arpita; Chakrabarti, Shrabana; De, Sankar

2016-12-01

We report here simultaneous experimental observation of Electromagnetically Induced Transparency (EIT) and Electromagnetically Induced Absorption (EIA) in a multi-level V-type system in D2 transition of 87Rb, i.e., F =2 →F' with a strong pump and a weak probe beam. We studied the probe spectrum by locking the probe beam to the transition F =2 →F'=2 while the pump is scanned from F =2 →F' . EIA is observed for the open transition (F =2 →F'=2 ) whereas EIT is observed in the closed transition (F =2 →F'=3 ). Sub natural line-width is observed for the EIA. To simulate the observed spectra theoretically, Liouville equation for the three-level V-type system is solved analytically with a multi-mode approach for the density matrix elements. We assumed both the pump and the probe beams can couple the excited states. A multi-mode approach for the coherence terms facilitates the study of all the frequency contributions due to the pump and the probe fields. Since the terms contain higher harmonics of the pump and the probe frequencies, we expressed them in Fourier transformed forms. To simulate the probe spectrum, we have solved inhomogeneous difference equations for the coherence terms using the Green's function technique and continued fraction theory. The experimental line-widths of the EIT and the EIA are compared with our theoretical model. Our system can be useful in optical switching applications as it can be precisely tuned to render the medium opaque and transparent simultaneously.

Simultaneous observations of electromagnetically induced transparency (EIT) and absorption (EIA) in a multi-level V-type system of 87Rb and theoretical simulation of the observed spectra using a multi-mode approach.

PubMed

Das, Bankim Chandra; Bhattacharyya, Dipankar; Das, Arpita; Chakrabarti, Shrabana; De, Sankar

2016-12-14

We report here simultaneous experimental observation of Electromagnetically Induced Transparency (EIT) and Electromagnetically Induced Absorption (EIA) in a multi-level V-type system in D 2 transition of Rb87, i.e., F=2→F ' with a strong pump and a weak probe beam. We studied the probe spectrum by locking the probe beam to the transition F=2→F ' =2 while the pump is scanned from F=2→F ' . EIA is observed for the open transition (F=2→F ' =2) whereas EIT is observed in the closed transition (F=2→F ' =3). Sub natural line-width is observed for the EIA. To simulate the observed spectra theoretically, Liouville equation for the three-level V-type system is solved analytically with a multi-mode approach for the density matrix elements. We assumed both the pump and the probe beams can couple the excited states. A multi-mode approach for the coherence terms facilitates the study of all the frequency contributions due to the pump and the probe fields. Since the terms contain higher harmonics of the pump and the probe frequencies, we expressed them in Fourier transformed forms. To simulate the probe spectrum, we have solved inhomogeneous difference equations for the coherence terms using the Green's function technique and continued fraction theory. The experimental line-widths of the EIT and the EIA are compared with our theoretical model. Our system can be useful in optical switching applications as it can be precisely tuned to render the medium opaque and transparent simultaneously.

Multimodal optoacoustic and multiphoton fluorescence microscopy

NASA Astrophysics Data System (ADS)

Sela, Gali; Razansky, Daniel; Shoham, Shy

2013-03-01

Multiphoton microscopy is a powerful imaging modality that enables structural and functional imaging with cellular and sub-cellular resolution, deep within biological tissues. Yet, its main contrast mechanism relies on extrinsically administered fluorescent indicators. Here we developed a system for simultaneous multimodal optoacoustic and multiphoton fluorescence 3D imaging, which attains both absorption and fluorescence-based contrast by integrating an ultrasonic transducer into a two-photon laser scanning microscope. The system is readily shown to enable acquisition of multimodal microscopic images of fluorescently labeled targets and cell cultures as well as intrinsic absorption-based images of pigmented biological tissue. During initial experiments, it was further observed that that detected optoacoustically-induced response contains low frequency signal variations, presumably due to cavitation-mediated signal generation by the high repetition rate (80MHz) near IR femtosecond laser. The multimodal system may provide complementary structural and functional information to the fluorescently labeled tissue, by superimposing optoacoustic images of intrinsic tissue chromophores, such as melanin deposits, pigmentation, and hemoglobin or other extrinsic particle or dye-based markers highly absorptive in the NIR spectrum.

On the effects of multimodal information integration in multitasking.

PubMed

Stock, Ann-Kathrin; Gohil, Krutika; Huster, René J; Beste, Christian

2017-07-07

There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

Simultaneous strain and temperature sensor based on polarization maintaining fiber and multimode fiber

NASA Astrophysics Data System (ADS)

Xing, Rui; Dong, Changbin; Wang, Zixiao; Wu, Yue; Yang, Yuguang; Jian, Shuisheng

2018-06-01

A novel, simultaneous strain and temperature sensor utilizing polarization maintaining fiber (PMF) and multimode fiber (MMF) is proposed and experimentally demonstrated in this paper. The sensing head of this sensor can be obtained by splicing PMF and MMF in the structure of PMF-MMF-PMF. The extinction ratio of the transmission spectrum can be over 30 dB. The strain sensitivities of sensor by two spectrum dips can be 1.01 pm/με and 1.27 pm/με in the range from 0 to 2000 με. Meanwhile, the temperature sensitivities of 49 pm/°C and 41 pm/°C can be achieved by two spectrum dips in the range from 30 °C to 70 °C. The sensitivity difference between the two spectrum dips can be used to realize dual parameters fiber sensing. This sensor exhibits the advantages of simple fabrication, compact structure and multi-purpose measuring. It may have the great potential in fields of robot arms and artificial limbs.

Application of a multicompartment dynamical model to multimodal optical imaging for investigating individual cerebrovascular properties

NASA Astrophysics Data System (ADS)

Desjardins, Michèle; Gagnon, Louis; Gauthier, Claudine; Hoge, Rick D.; Dehaes, Mathieu; Desjardins-Crépeau, Laurence; Bherer, Louis; Lesage, Frédéric

2009-02-01

Biophysical models of hemodynamics provide a tool for quantitative multimodal brain imaging by allowing a deeper understanding of the interplay between neural activity and blood oxygenation, volume and flow responses to stimuli. Multicompartment dynamical models that describe the dynamics and interactions of the vascular and metabolic components of evoked hemodynamic responses have been developed in the literature. In this work, multimodal data using near-infrared spectroscopy (NIRS) and diffuse correlation flowmetry (DCF) is used to estimate total baseline hemoglobin concentration (HBT0) in 7 adult subjects. A validation of the model estimate and investigation of the partial volume effect is done by comparing with time-resolved spectroscopy (TRS) measures of absolute HBT0. Simultaneous NIRS and DCF measurements during hypercapnia are then performed, but are found to be hardly reproducible. The results raise questions about the feasibility of an all-optical model-based estimation of individual vascular properties.

A collaborative interaction and visualization multi-modal environment for surgical planning.

PubMed

Foo, Jung Leng; Martinez-Escobar, Marisol; Peloquin, Catherine; Lobe, Thom; Winer, Eliot

2009-01-01

The proliferation of virtual reality visualization and interaction technologies has changed the way medical image data is analyzed and processed. This paper presents a multi-modal environment that combines a virtual reality application with a desktop application for collaborative surgical planning. Both visualization applications can function independently but can also be synced over a network connection for collaborative work. Any changes to either application is immediately synced and updated to the other. This is an efficient collaboration tool that allows multiple teams of doctors with only an internet connection to visualize and interact with the same patient data simultaneously. With this multi-modal environment framework, one team working in the VR environment and another team from a remote location working on a desktop machine can both collaborate in the examination and discussion for procedures such as diagnosis, surgical planning, teaching and tele-mentoring.

Image recovery from defocused 2D fluorescent images in multimodal digital holographic microscopy.

PubMed

Quan, Xiangyu; Matoba, Osamu; Awatsuji, Yasuhiro

2017-05-01

A technique of three-dimensional (3D) intensity retrieval from defocused, two-dimensional (2D) fluorescent images in the multimodal digital holographic microscopy (DHM) is proposed. In the multimodal DHM, 3D phase and 2D fluorescence distributions are obtained simultaneously by an integrated system of an off-axis DHM and a conventional epifluorescence microscopy, respectively. This gives us more information of the target; however, defocused fluorescent images are observed due to the short depth of field. In this Letter, we propose a method to recover the defocused images based on the phase compensation and backpropagation from the defocused plane to the focused plane using the distance information that is obtained from a 3D phase distribution. By applying Zernike polynomial phase correction, we brought back the fluorescence intensity to the focused imaging planes. The experimental demonstration using fluorescent beads is presented, and the expected applications are suggested.

Multimodal Nonlinear Optical Imaging for Sensitive Detection of Multiple Pharmaceutical Solid-State Forms and Surface Transformations.

PubMed

Novakovic, Dunja; Saarinen, Jukka; Rojalin, Tatu; Antikainen, Osmo; Fraser-Miller, Sara J; Laaksonen, Timo; Peltonen, Leena; Isomäki, Antti; Strachan, Clare J

2017-11-07

Two nonlinear imaging modalities, coherent anti-Stokes Raman scattering (CARS) and sum-frequency generation (SFG), were successfully combined for sensitive multimodal imaging of multiple solid-state forms and their changes on drug tablet surfaces. Two imaging approaches were used and compared: (i) hyperspectral CARS combined with principal component analysis (PCA) and SFG imaging and (ii) simultaneous narrowband CARS and SFG imaging. Three different solid-state forms of indomethacin-the crystalline gamma and alpha forms, as well as the amorphous form-were clearly distinguished using both approaches. Simultaneous narrowband CARS and SFG imaging was faster, but hyperspectral CARS and SFG imaging has the potential to be applied to a wider variety of more complex samples. These methodologies were further used to follow crystallization of indomethacin on tablet surfaces under two storage conditions: 30 °C/23% RH and 30 °C/75% RH. Imaging with (sub)micron resolution showed that the approach allowed detection of very early stage surface crystallization. The surfaces progressively crystallized to predominantly (but not exclusively) the gamma form at lower humidity and the alpha form at higher humidity. Overall, this study suggests that multimodal nonlinear imaging is a highly sensitive, solid-state (and chemically) specific, rapid, and versatile imaging technique for understanding and hence controlling (surface) solid-state forms and their complex changes in pharmaceuticals.

A Wearable EEG-HEG-HRV Multimodal System With Simultaneous Monitoring of tES for Mental Health Management.

PubMed

Ha, Unsoo; Lee, Yongsu; Kim, Hyunki; Roh, Taehwan; Bae, Joonsung; Kim, Changhyeon; Yoo, Hoi-Jun

2015-12-01

A multimodal mental management system in the shape of the wearable headband and earplugs is proposed to monitor electroencephalography (EEG), hemoencephalography (HEG) and heart rate variability (HRV) for accurate mental health monitoring. It enables simultaneous transcranial electrical stimulation (tES) together with real-time monitoring. The total weight of the proposed system is less than 200 g. The multi-loop low-noise amplifier (MLLNA) achieves over 130 dB CMRR for EEG sensing and the capacitive correlated-double sampling transimpedance amplifier (CCTIA) has low-noise characteristics for HEG and HRV sensing. Measured three-physiology domains such as neural, vascular and autonomic domain signals are combined with canonical correlation analysis (CCA) and temporal kernel canonical correlation analysis (tkCCA) algorithm to find the neural-vascular-autonomic coupling. It supports highly accurate classification with the 19% maximum improvement with multimodal monitoring. For the multi-channel stimulation functionality, after-effects maximization monitoring and sympathetic nerve disorder monitoring, the stimulator is designed as reconfigurable. The 3.37 × 2.25 mm(2) chip has 2-channel EEG sensor front-end, 2-channel NIRS sensor front-end, NIRS current driver to drive dual-wavelength VCSEL and 6-b DAC current source for tES mode. It dissipates 24 mW with 2 mA stimulation current and 5 mA NIRS driver current.

Simultaneous off-axis multiplexed holography and regular fluorescence microscopy of biological cells.

PubMed

Nygate, Yoav N; Singh, Gyanendra; Barnea, Itay; Shaked, Natan T

2018-06-01

We present a new technique for obtaining simultaneous multimodal quantitative phase and fluorescence microscopy of biological cells, providing both quantitative phase imaging and molecular specificity using a single camera. Our system is based on an interferometric multiplexing module, externally positioned at the exit of an optical microscope. In contrast to previous approaches, the presented technique allows conventional fluorescence imaging, rather than interferometric off-axis fluorescence imaging. We demonstrate the presented technique for imaging fluorescent beads and live biological cells.

A novel clinical multimodal multiphoton tomograph for AF, SHG, CARS imaging, and FLIM

NASA Astrophysics Data System (ADS)

Weinigel, Martin; Breunig, Hans Georg; König, Karsten

2014-02-01

We report on a flexible nonlinear medical tomograph with multiple miniaturized detectors for simultaneous acquisition of two-photon autofluorescence (AF), second harmonic generation (SHG) and coherent anti-Stokes Raman scattering (CARS) images. The simultaneous visualization of the distribution of endogenous fluorophores NAD(P)H, melanin and elastin, SHG-active collagen and as well as non-fluorescent lipids within human skin in vivo is possible. Furthermore, fluorescence lifetime images (FLIM) can be generated using time-correlated single photon counting.

Staining-free malaria diagnostics by multispectral and multimodality light-emitting-diode microscopy

NASA Astrophysics Data System (ADS)

Merdasa, Aboma; Brydegaard, Mikkel; Svanberg, Sune; Zoueu, Jeremie T.

2013-03-01

We report an accurate optical differentiation technique between healthy and malaria-infected erythrocytes by quasi-simultaneous measurements of transmittance, reflectance, and scattering properties of unstained blood smears using a multispectral and multimode light-emitting diode microscope. We propose a technique for automated imaging, identification, and counting of malaria-infected erythrocytes for real-time and cost-effective parasitaemia diagnosis as an effective alternative to the manual screening of stained blood smears, now considered to be the gold standard in malaria diagnosis. We evaluate the performance of our algorithm against manual estimations of an expert and show a spectrally resolved increased scattering from malaria-infected blood cells.

Multimodal optical coherence tomography for in vivo imaging of brain tissue structure and microvascular network at glioblastoma

NASA Astrophysics Data System (ADS)

Yashin, Konstantin S.; Kiseleva, Elena B.; Gubarkova, Ekaterina V.; Matveev, Lev A.; Karabut, Maria M.; Elagin, Vadim V.; Sirotkina, Marina A.; Medyanik, Igor A.; Kravets, L. Y.; Gladkova, Natalia D.

2017-02-01

In the case of infiltrative brain tumors the surgeon faces difficulties in determining their boundaries to achieve total resection. The aim of the investigation was to evaluate the performance of multimodal OCT (MM OCT) for differential diagnostics of normal brain tissue and glioma using an experimental model of glioblastoma. The spectral domain OCT device that was used for the study provides simultaneously two modes: cross-polarization and microangiographic OCT. The comparative analysis of the both OCT modalities images from tumorous and normal brain tissue areas concurrently with histologic correlation shows certain difference between when accordingly to morphological and microvascular tissue features.

Computational method for multi-modal microscopy based on transport of intensity equation

NASA Astrophysics Data System (ADS)

Li, Jiaji; Chen, Qian; Sun, Jiasong; Zhang, Jialin; Zuo, Chao

2017-02-01

In this paper, we develop the requisite theory to describe a hybrid virtual-physical multi-modal imaging system which yields quantitative phase, Zernike phase contrast, differential interference contrast (DIC), and light field moment imaging simultaneously based on transport of intensity equation(TIE). We then give the experimental demonstration of these ideas by time-lapse imaging of live HeLa cell mitosis. Experimental results verify that a tunable lens based TIE system, combined with the appropriate post-processing algorithm, can achieve a variety of promising imaging modalities in parallel with the quantitative phase images for the dynamic study of cellular processes.

Multi-species detection using multi-mode absorption spectroscopy (MUMAS)

NASA Astrophysics Data System (ADS)

Northern, J. H.; Thompson, A. W. J.; Hamilton, M. L.; Ewart, P.

2013-06-01

The detection of multiple species using a single laser and single detector employing multi-mode absorption spectroscopy (MUMAS) is reported. An in-house constructed, diode-pumped, Er:Yb:glass micro-laser operating at 1,565 nm with 10 modes separated by 18 GHz was used to record MUMAS signals in a gas mixture containing C2H2, N2O and CO. The components of the mixture were detected simultaneously by identifying multiple transitions in each of the species. By using temperature- and pressure-dependent modelled spectral fits to the data, partial pressures of each species in the mixture were determined with an uncertainty of ±2 %.

Practical Aspects of Access Network Indoor Extensions Using Multimode Glass and Plastic Optical Fibers

NASA Astrophysics Data System (ADS)

Keiser, Gerd; Liu, Hao-Yu; Lu, Shao-Hsi; Devi Pukhrambam, Puspa

2012-07-01

Low-cost multimode glass and plastic optical fibers are attractive for high-capacity indoor telecom networks. Many existing buildings already have glass multimode fibers installed for local area network applications. Future indoor applications will use combinations of glass multimode fibers with plastic optical fibers that have low losses in the 850-nm-1,310-nm range. This article examines real-world link losses when randomly interconnecting glass and plastic fiber segments having factory-installed connectors. Potential interconnection issues include large variations in connector losses among randomly selected fiber segments, asymmetric link losses in bidirectional links, and variations in bandwidths among different types of fibers.

Simultaneous strain and temperature measure based on a single suspended core photonic crystal fiber

NASA Astrophysics Data System (ADS)

Rota-Rodrigo, S.; López-Amo, M.; Kobelke, J.; Schuster, K.; Santos, J. L.; Frazão, O.

2014-05-01

In this work a simultaneous strain and temperature sensor based on a suspended core fiber is proposed. The sensor comprises a 3mm suspended core PCF between SMFs and is based on the combination of two multimodal interferences with different frequency fringe patterns. The interference of the both signal has different sensitivity responses to strain and temperature. Thought a low-pass frequency filtering of the detected spectrum, the wavelength shift of the two interferences can be measured allowing the discrimination of strain and temperature simultaneously. The resolutions of this sensor are 0.45 ºC and 4.02 μɛ.

Phonetic Variation and Interactional Contingencies in Simultaneous Responses

ERIC Educational Resources Information Center

Walker, Gareth

2016-01-01

An auspicious but unexplored environment for studying phonetic variation in naturalistic interaction is where two or more participants say the same thing at the same time. Working with a core dataset built from the multimodal Augmented Multi-party Interaction corpus, the principles of conversation analysis were followed to analyze the sequential…

Influence of Sequential vs. Simultaneous Dual-Task Exercise Training on Cognitive Function in Older Adults.

PubMed

Tait, Jamie L; Duckham, Rachel L; Milte, Catherine M; Main, Luana C; Daly, Robin M

2017-01-01

Emerging research indicates that exercise combined with cognitive training may improve cognitive function in older adults. Typically these programs have incorporated sequential training, where exercise and cognitive training are undertaken separately. However, simultaneous or dual-task training, where cognitive and/or motor training are performed simultaneously with exercise, may offer greater benefits. This review summary provides an overview of the effects of combined simultaneous vs. sequential training on cognitive function in older adults. Based on the available evidence, there are inconsistent findings with regard to the cognitive benefits of sequential training in comparison to cognitive or exercise training alone. In contrast, simultaneous training interventions, particularly multimodal exercise programs in combination with secondary tasks regulated by sensory cues, have significantly improved cognition in both healthy older and clinical populations. However, further research is needed to determine the optimal characteristics of a successful simultaneous training program for optimizing cognitive function in older people.

Indirect competitive assays on DVD for direct multiplex detection of drugs of abuse in oral fluids.

PubMed

Zhang, Lingling; Li, Xiaochun; Li, Yunchao; Shi, Xiaoli; Yu, Hua-Zhong

2015-02-03

On-site oral fluid testing for drugs of abuse has become prominent in order to take immediate administrative action in an enforcement process. Herein, we report a DVD technology-based indirect competitive immunoassay platform for the quantitative detection of drugs of abuse. A microfluidic approach was adapted to prepare multiplex immunoassays on a standard DVD-R, an unmodified multimode DVD/Blu-Ray drive to read signal, and a free disc-quality analysis software program to process the data. The DVD assay platform was successfully demonstrated for the simultaneous, quantitative detection of drug candidates (morphine and cocaine) in oral fluids with high selectivity. The detection limit achieved was as low as 1.0 ppb for morphine and 5.0 ppb for cocaine, comparable with that of standard mass spectrometry and ELISA methods.

A unique case of penetrating neck and cervical spine trauma resulting in vertebral artery transection and internal carotid artery laceration.

PubMed

Marston, Alexander P; Montenegro, Monique M; Oldenburg, Michael S; Thom, Joshua T; Driscoll, Colin L W

2016-01-01

Describe the presentation and treatment of a patient who suffered a penetrating cervical trauma resulting in occlusion of the vertebral and internal carotid arteries. The electronic medical record was used to collect information pertaining to the patient's clinical history. A 20-year-old male suffered a unique penetrating neck injury resulting in simultaneous injuries to the internal carotid and vertebral arteries as demonstrated by pre-operative angiography. Combined endovascular and open surgical approaches were utilized to successfully manage the vascular injuries prior to foreign body extraction. Complex penetrating cervical trauma is best managed with a multidisciplinary and multimodality approach. In appropriately selected patients, pre-operative angiography is a critical diagnostic modality that can prevent life-threatening hemorrhage following foreign body extraction. Copyright © 2016 Elsevier Inc. All rights reserved.

Motivating Students' Research Skills and Interests through a Multimodal, Multigenre Research Project

ERIC Educational Resources Information Center

Bailey, Nancy M.; Carroll, Kristen M.

2010-01-01

The authors investigate how innovative research assignments based on students' personal interests can help them want to develop their research skills. They find that multimodal communication and representation, including film, written scripts, comic strips, music, and photography, encourage students to carefully select information from the…

A model for distribution centers location-routing problem on a multimodal transportation network with a meta-heuristic solving approach

NASA Astrophysics Data System (ADS)

Fazayeli, Saeed; Eydi, Alireza; Kamalabadi, Isa Nakhai

2017-07-01

Nowadays, organizations have to compete with different competitors in regional, national and international levels, so they have to improve their competition capabilities to survive against competitors. Undertaking activities on a global scale requires a proper distribution system which could take advantages of different transportation modes. Accordingly, the present paper addresses a location-routing problem on multimodal transportation network. The introduced problem follows four objectives simultaneously which form main contribution of the paper; determining multimodal routes between supplier and distribution centers, locating mode changing facilities, locating distribution centers, and determining product delivery tours from the distribution centers to retailers. An integer linear programming is presented for the problem, and a genetic algorithm with a new chromosome structure proposed to solve the problem. Proposed chromosome structure consists of two different parts for multimodal transportation and location-routing parts of the model. Based on published data in the literature, two numerical cases with different sizes generated and solved. Also, different cost scenarios designed to better analyze model and algorithm performance. Results show that algorithm can effectively solve large-size problems within a reasonable time which GAMS software failed to reach an optimal solution even within much longer times.

Reflection Effects in Multimode Fiber Systems Utilizing Laser Transmitters

NASA Technical Reports Server (NTRS)

Bates, Harry E.

1991-01-01

A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

A model for distribution centers location-routing problem on a multimodal transportation network with a meta-heuristic solving approach

NASA Astrophysics Data System (ADS)

Fazayeli, Saeed; Eydi, Alireza; Kamalabadi, Isa Nakhai

2018-07-01

Nowadays, organizations have to compete with different competitors in regional, national and international levels, so they have to improve their competition capabilities to survive against competitors. Undertaking activities on a global scale requires a proper distribution system which could take advantages of different transportation modes. Accordingly, the present paper addresses a location-routing problem on multimodal transportation network. The introduced problem follows four objectives simultaneously which form main contribution of the paper; determining multimodal routes between supplier and distribution centers, locating mode changing facilities, locating distribution centers, and determining product delivery tours from the distribution centers to retailers. An integer linear programming is presented for the problem, and a genetic algorithm with a new chromosome structure proposed to solve the problem. Proposed chromosome structure consists of two different parts for multimodal transportation and location-routing parts of the model. Based on published data in the literature, two numerical cases with different sizes generated and solved. Also, different cost scenarios designed to better analyze model and algorithm performance. Results show that algorithm can effectively solve large-size problems within a reasonable time which GAMS software failed to reach an optimal solution even within much longer times.

Reflection effects in multimode fiber systems utilizing laser transmitters

NASA Astrophysics Data System (ADS)

Bates, Harry E.

1991-11-01

A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

Mid-infrared supercontinuum generation in multimode step index chalcogenide fiber

NASA Astrophysics Data System (ADS)

Ben Khalifa, Ameni; Ben Salem, Amine; Cherif, Rim; Zghal, Mourad

2016-09-01

In this paper, we propose a design of a high numerical aperture multimode hybrid step-index fiber for mid-infrared (mid- IR) supercontinuum generation (SCG) where two chalcogenide glass compositions As40Se60 and Ge10As23.4Se66.6 for the core and the cladding are selected, respectively. Aiming to get accurate modeling of the SCG by the fundamental mode, we solve the multimode generalized nonlinear Schrödinger equations and demonstrate nonlinear coupling and energy transfer between high order modes. The proposed study points out the impact of nonlinear mode coupling that should be taken into account in order to successfully predict the mid-infrared supercontinuum generation in highly nonlinear multimode fibers.

Mate choice in the eye and ear of the beholder? Female multimodal sensory configuration influences her preferences.

PubMed

Ronald, Kelly L; Fernández-Juricic, Esteban; Lucas, Jeffrey R

2018-05-16

A common assumption in sexual selection studies is that receivers decode signal information similarly. However, receivers may vary in how they rank signallers if signal perception varies with an individual's sensory configuration. Furthermore, receivers may vary in their weighting of different elements of multimodal signals based on their sensory configuration. This could lead to complex levels of selection on signalling traits. We tested whether multimodal sensory configuration could affect preferences for multimodal signals. We used brown-headed cowbird ( Molothrus ater ) females to examine how auditory sensitivity and auditory filters, which influence auditory spectral and temporal resolution, affect song preferences, and how visual spatial resolution and visual temporal resolution, which influence resolution of a moving visual signal, affect visual display preferences. Our results show that multimodal sensory configuration significantly affects preferences for male displays: females with better auditory temporal resolution preferred songs that were shorter, with lower Wiener entropy, and higher frequency; and females with better visual temporal resolution preferred males with less intense visual displays. Our findings provide new insights into mate-choice decisions and receiver signal processing. Furthermore, our results challenge a long-standing assumption in animal communication which can affect how we address honest signalling, assortative mating and sensory drive. © 2018 The Author(s).

Simultaneous Intrinsic and Extrinsic Parameter Identification of a Hand-Mounted Laser-Vision Sensor

PubMed Central

Lee, Jong Kwang; Kim, Kiho; Lee, Yongseok; Jeong, Taikyeong

2011-01-01

In this paper, we propose a simultaneous intrinsic and extrinsic parameter identification of a hand-mounted laser-vision sensor (HMLVS). A laser-vision sensor (LVS), consisting of a camera and a laser stripe projector, is used as a sensor component of the robotic measurement system, and it measures the range data with respect to the robot base frame using the robot forward kinematics and the optical triangulation principle. For the optimal estimation of the model parameters, we applied two optimization techniques: a nonlinear least square optimizer and a particle swarm optimizer. Best-fit parameters, including both the intrinsic and extrinsic parameters of the HMLVS, are simultaneously obtained based on the least-squares criterion. From the simulation and experimental results, it is shown that the parameter identification problem considered was characterized by a highly multimodal landscape; thus, the global optimization technique such as a particle swarm optimization can be a promising tool to identify the model parameters for a HMLVS, while the nonlinear least square optimizer often failed to find an optimal solution even when the initial candidate solutions were selected close to the true optimum. The proposed optimization method does not require good initial guesses of the system parameters to converge at a very stable solution and it could be applied to a kinematically dissimilar robot system without loss of generality. PMID:22164104

Photon pair generation with tailored frequency correlations in graded-index multimode fibers.

PubMed

Pourbeyram, Hamed; Mafi, Arash

2018-05-01

We study theoretically the generation of photon pairs with controlled spectral correlations via the four-wave mixing process in graded-index multimode optical fibers (GIMFs). We show that the quantum correlations of the generated photons in GIMFs can be preserved over a wide spectral range for a tunable pump source. Therefore, GIMFs can be utilized as quantum-state-preserving tunable sources of photons. In particular, we have shown that it is possible to generate factorable two-photon states, which allow for heralding of pure-state single photons without the need for narrowband spectral post filtering. We also elaborate on the possibility of simultaneously generating correlated and uncorrelated photon pairs in the same optical fiber.

A low-power multi-modal body sensor network with application to epileptic seizure monitoring.

PubMed

Altini, Marco; Del Din, Silvia; Patel, Shyamal; Schachter, Steven; Penders, Julien; Bonato, Paolo

2011-01-01

Monitoring patients' physiological signals during their daily activities in the home environment is one of the challenge of the health care. New ultra-low-power wireless technologies could help to achieve this goal. In this paper we present a low-power, multi-modal, wearable sensor platform for the simultaneous recording of activity and physiological data. First we provide a description of the wearable sensor platform, and its characteristics with respect to power consumption. Second we present the preliminary results of the comparison between our sensors and a reference system, on healthy subjects, to test the reliability of the detected physiological (electrocardiogram and respiration) and electromyography signals.

Principles of Simultaneous PET/MR Imaging.

PubMed

Catana, Ciprian

2017-05-01

Combined PET/MR imaging scanners capable of acquiring simultaneously the complementary information provided by the 2 imaging modalities are now available for human use. After addressing the hardware challenges for integrating the 2 imaging modalities, most of the efforts in the field have focused on developing MR-based attenuation correction methods for neurologic and whole-body applications, implementing approaches for improving one modality by using the data provided by the other and exploring research and clinical applications that could benefit from the synergistic use of the multimodal data. Copyright © 2017 Elsevier Inc. All rights reserved.

Dual-color single-mode lasing in axially coupled organic nanowire resonators

PubMed Central

Zhang, Chunhuan; Zou, Chang-Ling; Dong, Haiyun; Yan, Yongli; Yao, Jiannian; Zhao, Yong Sheng

2017-01-01

Miniaturized lasers with multicolor output and high spectral purity are of crucial importance for yielding more compact and more versatile photonic devices. However, multicolor lasers usually operate in multimode, which largely restricts their practical applications due to the lack of an effective mode selection mechanism that is simultaneously applicable to multiple wavebands. We propose a mutual mode selection strategy to realize dual-color single-mode lasing in axially coupled cavities constructed from two distinct organic self-assembled single-crystal nanowires. The unique mode selection mechanism in the heterogeneously coupled nanowires was elucidated experimentally and theoretically. With each individual nanowire functioning as both the laser source and the mode filter for the other nanowire, dual-color single-mode lasing was successfully achieved in the axially coupled heterogeneous nanowire resonators. Furthermore, the heterogeneously coupled resonators provided multiple nanoscale output ports for delivering coherent signals with different colors, which could greatly contribute to increasing the integration level of functional photonic devices. These results advance the fundamental understanding of the lasing modulation in coupled cavity systems and offer a promising route to building multifunctional nanoscale lasers for high-level practical photonic integrations. PMID:28785731

Simultaneous Ionic Current and Potential Detection of Nanoparticles by a Multifunctional Nanopipette.

PubMed

Panday, Namuna; Qian, Gongming; Wang, Xuewen; Chang, Shuai; Pandey, Popular; He, Jin

2016-12-27

Nanopore sensing-based technologies have made significant progress for single molecule and single nanoparticle detection and analysis. In recent years, multimode sensing by multifunctional nanopores shows the potential to greatly improve the sensitivity and selectivity of traditional resistive-pulse sensing methods. In this paper, we showed that two label-free electric sensing modes could work cooperatively to detect the motion of 40 nm diameter spherical gold nanoparticles (GNPs) in solution by a multifunctional nanopipette. The multifunctional nanopipettes containing both nanopore and nanoelectrode (pyrolytic carbon) at the tip were fabricated quickly and cheaply. We demonstrated that the ionic current and local electrical potential changes could be detected simultaneously during the translocation of individual GNPs. We also showed that the nanopore/CNE tip geometry enabled the CNE not only to detect the translocation of single GNP but also to collectively detect several GNPs outside the nanopore entrance. The dynamic accumulation of GNPs near the nanopore entrance resulted in no detectable current changes, but was detected by the potential changes at the CNE. We revealed the motions of GNPs both outside and inside the nanopore, individually and collectively, with the combination of ionic current and potential measurements.

Construction of Multi-Mode Affective Learning System: Taking Affective Design as an Example

ERIC Educational Resources Information Center

Lin, Hao-Chiang Koong; Su, Sheng-Hsiung; Chao, Ching-Ju; Hsieh, Cheng-Yen; Tsai, Shang-Chin

2016-01-01

This study aims to design a non-simultaneous distance instruction system with affective computing, which integrates interactive agent technology with the curricular instruction of affective design. The research subjects were 78 students, and prototype assessment and final assessment were adopted to assess the interface and usability of the system.…

Usefulness of Simultaneous EEG-NIRS Recording in Language Studies

ERIC Educational Resources Information Center

Wallois, F.; Mahmoudzadeh, M.; Patil, A.; Grebe, R.

2012-01-01

One of the most challenging tasks in neuroscience in language studies, is investigation of the brain's ability to integrate and process information. This task can only be successfully addressed by applying various assessment techniques integrated into a multimodal approach. Each of these techniques has its advantages and disadvantages, but help to…

Being Human Today: A Digital Storytelling Pedagogy for Transcontinental Border Crossing

ERIC Educational Resources Information Center

Stewart, Kristian; Gachago, Daniela

2016-01-01

This article reports the findings of a collaborative digital storytelling project titled "Being Human Today," a multimodal curricular initiative that was implemented simultaneously in both a South African and an American university classroom in 2015. By facilitating dialogue and the sharing of digital stories by means of a closed…

Real-time multi-mode neutron multiplicity counter

DOEpatents

Rowland, Mark S; Alvarez, Raymond A

2013-02-26

Embodiments are directed to a digital data acquisition method that collects data regarding nuclear fission at high rates and performs real-time preprocessing of large volumes of data into directly useable forms for use in a system that performs non-destructive assaying of nuclear material and assemblies for mass and multiplication of special nuclear material (SNM). Pulses from a multi-detector array are fed in parallel to individual inputs that are tied to individual bits in a digital word. Data is collected by loading a word at the individual bit level in parallel, to reduce the latency associated with current shift-register systems. The word is read at regular intervals, all bits simultaneously, with no manipulation. The word is passed to a number of storage locations for subsequent processing, thereby removing the front-end problem of pulse pileup. The word is used simultaneously in several internal processing schemes that assemble the data in a number of more directly useable forms. The detector includes a multi-mode counter that executes a number of different count algorithms in parallel to determine different attributes of the count data.

Multimodal second harmonic generation and two photon fluorescence imaging of microdomain calcium contraction coupling in single cardiomyocytes

NASA Astrophysics Data System (ADS)

Chan, James; Awasthi, Samir; Izu, Leighton; Mao, Ziliang; Jian, Zhong; Landas, Trevor; Lerner, Aaron; Shimkunas, Rafael; Woldeyesus, Rahwa; Bossuyt, Julie; Wood, Brittani; Chen, Yi-Je; Matthews, Dennis; Lieu, Deborah; Chiamvimonvat, Nipavan; Lam, Kit; Chen-Izu, Ye

2016-11-01

The objective of this study was to develop a method for simultaneously measuring the calcium and contraction dynamics of single, live cardiomyocytes at high spatial resolutions. Such measurements are important to investigate local calcium release and the mechanical response at the sarcomere level (i.e. the basic unit of contraction), which have important implications in cardiac dysfunction and arrhythmias in conditions such as hypertension, atrial fibrillation, and myocardial infarction. Here, we describe a multimodal second harmonic generation (SHG) and two photon fluorescence (2PF) microscopy technique that is used to simultaneously measure subsarcomere calcium and contraction events at high spatial and temporal resolutions. The method takes advantage of the label-free nature of SHG for imaging the sarcomeres and the high spatial colocalization of the SHG signal and the fluorescence signal excited from calcium indicators. This microscope was used to measure calcium sparks and waves and associated contractions in subcellular microdomains, leading to the generation of subcellular strain. We anticipate this new imaging tool will play an important role in studying mechanical stress-induced heart disease.

Simulated microsurgery monitoring using intraoperative multimodal surgical microscopy

NASA Astrophysics Data System (ADS)

Lee, Donghyun; Lee, Changho; Kim, Sehui; Zhou, Qifa; Kim, Jeehyun; Kim, Chulhong

2016-03-01

We have developed an intraoperative multimodal surgical microscopy system that provides simultaneous real-time enlarged surface views and subsurface anatomic information during surgeries by integrating spectral domain optical coherence tomography (SD-OCT), optical-resolution photoacoustic microscopy (OR-PAM), and conventional surgical microscopy. By sharing the same optical path, both OCT and PAM images were simultaneously acquired. Additionally, the custom-made needle-type transducer received the generated PA signals enabling convenient surgical operation without using a water bath. Using a simple augmented device, the OCT and PAM images were projected on the view plane of the surgical microscope. To quantify the performance of our system, we measured spatial resolutions of our system. Then, three microsurgery simulation and analysis were processed: (1) ex vivo needle tracking and monitoring injection of carbon particles in biological tissues, (2) in vivo needle tracking and monitoring injection of carbon particles in tumor-bearing mice, and (3) in vivo guiding of melanoma removal in melanoma-bearing mice. The results indicate that this triple modal system is useful for intraoperative purposes, and can potentially be a vital tool in microsurgeries.

Integrated cladding-pumped multicore few-mode erbium-doped fibre amplifier for space-division-multiplexed communications

NASA Astrophysics Data System (ADS)

Chen, H.; Jin, C.; Huang, B.; Fontaine, N. K.; Ryf, R.; Shang, K.; Grégoire, N.; Morency, S.; Essiambre, R.-J.; Li, G.; Messaddeq, Y.; Larochelle, S.

2016-08-01

Space-division multiplexing (SDM), whereby multiple spatial channels in multimode and multicore optical fibres are used to increase the total transmission capacity per fibre, is being investigated to avert a data capacity crunch and reduce the cost per transmitted bit. With the number of channels employed in SDM transmission experiments continuing to rise, there is a requirement for integrated SDM components that are scalable. Here, we demonstrate a cladding-pumped SDM erbium-doped fibre amplifier (EDFA) that consists of six uncoupled multimode erbium-doped cores. Each core supports three spatial modes, which enables the EDFA to amplify a total of 18 spatial channels (six cores × three modes) simultaneously with a single pump diode and a complexity similar to a single-mode EDFA. The amplifier delivers >20 dBm total output power per core and <7 dB noise figure over the C-band. This cladding-pumped EDFA enables combined space-division and wavelength-division multiplexed transmission over multiple multimode fibre spans.

Dual CARS and SHG image acquisition scheme that combines single central fiber and multimode fiber bundle to collect and differentiate backward and forward generated photons

PubMed Central

Weng, Sheng; Chen, Xu; Xu, Xiaoyun; Wong, Kelvin K.; Wong, Stephen T. C.

2016-01-01

In coherent anti-Stokes Raman scattering (CARS) and second harmonic generation (SHG) imaging, backward and forward generated photons exhibit different image patterns and thus capture salient intrinsic information of tissues from different perspectives. However, they are often mixed in collection using traditional image acquisition methods and thus are hard to interpret. We developed a multimodal scheme using a single central fiber and multimode fiber bundle to simultaneously collect and differentiate images formed by these two types of photons and evaluated the scheme in an endomicroscopy prototype. The ratio of these photons collected was calculated for the characterization of tissue regions with strong or weak epi-photon generation while different image patterns of these photons at different tissue depths were revealed. This scheme provides a new approach to extract and integrate information captured by backward and forward generated photons in dual CARS/SHG imaging synergistically for biomedical applications. PMID:27375938

A new multimodal interactive way of subjective scoring of 3D video quality of experience

NASA Astrophysics Data System (ADS)

Kim, Taewan; Lee, Kwanghyun; Lee, Sanghoon; Bovik, Alan C.

2014-03-01

People that watch today's 3D visual programs, such as 3D cinema, 3D TV and 3D games, experience wide and dynamically varying ranges of 3D visual immersion and 3D quality of experience (QoE). It is necessary to be able to deploy reliable methodologies that measure each viewers subjective experience. We propose a new methodology that we call Multimodal Interactive Continuous Scoring of Quality (MICSQ). MICSQ is composed of a device interaction process between the 3D display and a separate device (PC, tablet, etc.) used as an assessment tool, and a human interaction process between the subject(s) and the device. The scoring process is multimodal, using aural and tactile cues to help engage and focus the subject(s) on their tasks. Moreover, the wireless device interaction process makes it possible for multiple subjects to assess 3D QoE simultaneously in a large space such as a movie theater, and at di®erent visual angles and distances.

A Multi-Mode Blade Damping Control using Shunted Piezoelectric Transducers with Active Feedback Structure

NASA Technical Reports Server (NTRS)

Choi, Benjamin; Morrison, Carlos; Min, James

2009-01-01

The Structural Dynamics and. Mechanics branch (RXS) is developing smart adaptive structures to improve fan blade damping at resonances using piezoelectric (PE) transducers. In this presentation, only one shunted PE transducer was used to demonstrate active control of multi-mode blade resonance damping on a titanium alloy (Ti-6A1-4V) flat plate model, regardless of bending, torsion, and 2-stripe modes. This work would have a significant impact on the conventional passive shunt damping world because the standard feedback control design tools can now be used to design and implement electric shunt for vibration control. In other words, the passive shunt circuit components using massive inductors and. resistors for multi-mode resonance control can be replaced with digital codes. Furthermore, this active approach with multi patches can simultaneously control several modes in the engine operating range. Dr. Benjamin Choi presented the analytical and experimental results from this work at the Propulsion-Safety and. Affordable Readiness (P-SAR) Conference in March, 2009.

Diagnostic for two-mode variable valve activation device

DOEpatents

Fedewa, Andrew M

2014-01-07

A method is provided for diagnosing a multi-mode valve train device which selectively provides high lift and low lift to a combustion valve of an internal combustion engine having a camshaft phaser actuated by an electric motor. The method includes applying a variable electric current to the electric motor to achieve a desired camshaft phaser operational mode and commanding the multi-mode valve train device to a desired valve train device operational mode selected from a high lift mode and a low lift mode. The method also includes monitoring the variable electric current and calculating a first characteristic of the parameter. The method also includes comparing the calculated first characteristic against a predetermined value of the first characteristic measured when the multi-mode valve train device is known to be in the desired valve train device operational mode.

Cortical light scattering during interictal epileptic spikes in frontal lobe epilepsy in children: A fast optical signal and electroencephalographic study.

PubMed

Manoochehri, Mana; Mahmoudzadeh, Mahdi; Bourel-Ponchel, Emilie; Wallois, Fabrice

2017-12-01

Interictal epileptic spikes (IES) represent a signature of the transient synchronous and excessive discharge of a large ensemble of cortical heterogeneous neurons. Epilepsy cannot be reduced to a hypersynchronous activation of neurons whose functioning is impaired, resulting on electroencephalogram (EEG) in epileptic seizures or IES. The complex pathophysiological mechanisms require a global approach to the interactions between neural synaptic and nonsynaptic, vascular, and metabolic systems. In the present study, we focused on the interaction between synaptic and nonsynaptic mechanisms through the simultaneous noninvasive multimodal multiscale recording of high-density EEG (HD-EEG; synaptic) and fast optical signal (FOS; nonsynaptic), which evaluate rapid changes in light scattering related to changes in membrane configuration occurring during neuronal activation of IES. To evaluate changes in light scattering occurring around IES, three children with frontal IES were simultaneously recorded with HD-EEG and FOS. To evaluate change in synchronization, time-frequency representation analysis of the HD-EEG was performed simultaneously around the IES. To independently evaluate our multimodal method, a control experiment with somatosensory stimuli was designed and applied to five healthy volunteers. Alternating increase-decrease-increase in optical signals occurred 200 ms before to 180 ms after the IES peak. These changes started before any changes in EEG signal. In addition, time-frequency domain EEG analysis revealed alternating decrease-increase-decrease in the EEG spectral power concomitantly with changes in the optical signal during IES. These results suggest a relationship between (de)synchronization and neuronal volume changes in frontal lobe epilepsy during IES. These changes in the neuronal environment around IES in frontal lobe epilepsy observed in children, as they have been in rats, raise new questions about the synaptic/nonsynaptic mechanisms that propel the neurons to hypersynchronization, as occurs during IES. We further demonstrate that this noninvasive multiscale multimodal approach is suitable for studying the pathophysiology of the IES in patients. Wiley Periodicals, Inc. © 2017 International League Against Epilepsy.

Multi-Modal Hallucinations and Cognitive Function in Parkinson's Disease

PubMed Central

Katzen, Heather; Myerson, Connie; Papapetropoulos, Spiridon; Nahab, Fatta; Gallo, Bruno; Levin, Bonnie

2010-01-01

Background/Aims Hallucinations have been linked to a constellation of cognitive deficits in Parkinson's disease (PD), but it is not known whether multi-modal hallucinations are associated with greater neuropsychological dysfunction. Methods 152 idiopathic PD patients were categorized based on the presence or absence of hallucinations and then were further subdivided into visual-only (VHonly; n = 35) or multi-modal (VHplus; n = 12) hallucination groups. All participants underwent detailed neuropsychological assessment. Results Participants with hallucinations performed more poorly on select neuropsychological measures and exhibited more mood symptoms. There were no differences between VHonly and VHplus groups. Conclusions PD patients with multi-modal hallucinations are not at greater risk for neuropsychological impairment than those with single-modal hallucinations. PMID:20689283

Simultaneous Neutron and X-ray Tomography for Quantitative analysis of Geological Samples

NASA Astrophysics Data System (ADS)

LaManna, J.; Hussey, D. S.; Baltic, E.; Jacobson, D. L.

2016-12-01

Multiphase flow is a critical area of research for shale gas, oil recovery, underground CO2 sequestration, geothermal power, and aquifer management. It is critical to understand the porous structure of the geological formations in addition to the fluid/pore and fluid/fluid interactions. Difficulties for analyzing flow characteristics of rock cores are in obtaining 3D distribution information on the fluid flow and maintaining the cores in a state for other analysis methods. Two powerful non-destructive methods for obtaining 3D structural and compositional information are X-ray and neutron tomography. X-ray tomography produces information on density and structure while neutrons excel at acquiring the liquid phase and produces compositional information. These two methods can offer strong complementary information but are typically conducted at separate times and often at different facilities. This poses issues for obtaining dynamic and stochastic information as the sample will change between analysis modes. To address this, NIST has developed a system that allows for multimodal, simultaneous tomography using thermal neutrons and X-rays by placing a 90 keVp micro-focus X-ray tube 90° to the neutron beam. High pressure core holders that simulate underground conditions have been developed to facilitate simultaneous tomography. These cells allow for the control of confining pressure, axial load, temperature, and fluid flow through the core. This talk will give an overview the simultaneous neutron and x-ray tomography capabilities at NIST, the benefits of multimodal imaging, environmental equipment for geology studies, and several case studies that have been conducted at NIST.

Using Multimodal Functional Behavioral Assessment to Inform Treatment Selection for Children with Either Emotional Disturbance or Social Maladjustment

ERIC Educational Resources Information Center

Miller, Jeffrey A.; Williams, Shelagh J.; McCoy, Erika L. B.

2004-01-01

Functional behavioral assessment (FBA) is an assessment procedure used to identify the reasons for children's misbehavior. In this article we provide an overview of one approach to FBA known as "multimodal functional behavioral assessment" (MFBA) that provides a comprehensive examination of the causes of children's disruptive behavior. The…

Long-range dismount activity classification: LODAC

NASA Astrophysics Data System (ADS)

Garagic, Denis; Peskoe, Jacob; Liu, Fang; Cuevas, Manuel; Freeman, Andrew M.; Rhodes, Bradley J.

2014-06-01

Continuous classification of dismount types (including gender, age, ethnicity) and their activities (such as walking, running) evolving over space and time is challenging. Limited sensor resolution (often exacerbated as a function of platform standoff distance) and clutter from shadows in dense target environments, unfavorable environmental conditions, and the normal properties of real data all contribute to the challenge. The unique and innovative aspect of our approach is a synthesis of multimodal signal processing with incremental non-parametric, hierarchical Bayesian machine learning methods to create a new kind of target classification architecture. This architecture is designed from the ground up to optimally exploit correlations among the multiple sensing modalities (multimodal data fusion) and rapidly and continuously learns (online self-tuning) patterns of distinct classes of dismounts given little a priori information. This increases classification performance in the presence of challenges posed by anti-access/area denial (A2/AD) sensing. To fuse multimodal features, Long-range Dismount Activity Classification (LODAC) develops a novel statistical information theoretic approach for multimodal data fusion that jointly models multimodal data (i.e., a probabilistic model for cross-modal signal generation) and discovers the critical cross-modal correlations by identifying components (features) with maximal mutual information (MI) which is efficiently estimated using non-parametric entropy models. LODAC develops a generic probabilistic pattern learning and classification framework based on a new class of hierarchical Bayesian learning algorithms for efficiently discovering recurring patterns (classes of dismounts) in multiple simultaneous time series (sensor modalities) at multiple levels of feature granularity.

Multimodal flexible cystoscopy for creating co-registered panoramas of the bladder urothelium

NASA Astrophysics Data System (ADS)

Seibel, Eric J.; Soper, Timothy D.; Burkhardt, Matthew R.; Porter, Michael P.; Yoon, W. Jong

2012-02-01

Bladder cancer is the most expensive cancer to treat due to the high rate of recurrence. Though white light cystoscopy is the gold standard for bladder cancer surveillance, the advent of fluorescence biomarkers provides an opportunity to improve sensitivity for early detection and reduced recurrence resulting from more accurate excision. Ideally, fluorescence information could be combined with standard reflectance images to provide multimodal views of the bladder wall. The scanning fiber endoscope (SFE) of 1.2mm in diameter is able to acquire wide-field multimodal video from a bladder phantom with fluorescence cancer "hot-spots". The SFE generates images by scanning red, green, and blue (RGB) laser light and detects the backscatter signal for reflectance video of 500-line resolution at 30 frames per second. We imaged a bladder phantom with painted vessels and mimicked fluorescent lesions by applying green fluorescent microspheres to the surface. By eliminating the green laser illumination, simultaneous reflectance and fluorescence images can be acquired at the same field of view, resolution, and frame rate. Moreover, the multimodal SFE is combined with a robotic steering mechanism and image stitching software as part of a fully automated bladder surveillance system. Using this system, the SFE can be reliably articulated over the entire 360° bladder surface. Acquired images can then be stitched into a multimodal 3D panorama of the bladder using software developed in our laboratory. In each panorama, the fluorescence images are exactly co-registered with RGB reflectance.

Computer-aided psychotherapy based on multimodal elicitation, estimation and regulation of emotion.

PubMed

Cosić, Krešimir; Popović, Siniša; Horvat, Marko; Kukolja, Davor; Dropuljić, Branimir; Kovač, Bernard; Jakovljević, Miro

2013-09-01

Contemporary psychiatry is looking at affective sciences to understand human behavior, cognition and the mind in health and disease. Since it has been recognized that emotions have a pivotal role for the human mind, an ever increasing number of laboratories and research centers are interested in affective sciences, affective neuroscience, affective psychology and affective psychopathology. Therefore, this paper presents multidisciplinary research results of Laboratory for Interactive Simulation System at Faculty of Electrical Engineering and Computing, University of Zagreb in the stress resilience. Patient's distortion in emotional processing of multimodal input stimuli is predominantly consequence of his/her cognitive deficit which is result of their individual mental health disorders. These emotional distortions in patient's multimodal physiological, facial, acoustic, and linguistic features related to presented stimulation can be used as indicator of patient's mental illness. Real-time processing and analysis of patient's multimodal response related to annotated input stimuli is based on appropriate machine learning methods from computer science. Comprehensive longitudinal multimodal analysis of patient's emotion, mood, feelings, attention, motivation, decision-making, and working memory in synchronization with multimodal stimuli provides extremely valuable big database for data mining, machine learning and machine reasoning. Presented multimedia stimuli sequence includes personalized images, movies and sounds, as well as semantically congruent narratives. Simultaneously, with stimuli presentation patient provides subjective emotional ratings of presented stimuli in terms of subjective units of discomfort/distress, discrete emotions, or valence and arousal. These subjective emotional ratings of input stimuli and corresponding physiological, speech, and facial output features provides enough information for evaluation of patient's cognitive appraisal deficit. Aggregated real-time visualization of this information provides valuable assistance in patient mental state diagnostics enabling therapist deeper and broader insights into dynamics and progress of the psychotherapy.

Spatial accessibility to healthcare services in Shenzhen, China: improving the multi-modal two-step floating catchment area method by estimating travel time via online map APIs.

PubMed

Tao, Zhuolin; Yao, Zaoxing; Kong, Hui; Duan, Fei; Li, Guicai

2018-05-09

Shenzhen has rapidly grown into a megacity in the recent decades. It is a challenging task for the Shenzhen government to provide sufficient healthcare services. The spatial configuration of healthcare services can influence the convenience for the consumers to obtain healthcare services. Spatial accessibility has been widely adopted as a scientific measurement for evaluating the rationality of the spatial configuration of healthcare services. The multi-modal two-step floating catchment area (2SFCA) method is an important advance in the field of healthcare accessibility modelling, which enables the simultaneous assessment of spatial accessibility via multiple transport modes. This study further develops the multi-modal 2SFCA method by introducing online map APIs to improve the estimation of travel time by public transit or by car respectively. As the results show, the distribution of healthcare accessibility by multi-modal 2SFCA shows significant spatial disparity. Moreover, by dividing the multi-modal accessibility into car-mode and transit-mode accessibility, this study discovers that the transit-mode subgroup is disadvantaged in the competition for healthcare services with the car-mode subgroup. The disparity in transit-mode accessibility is the main reason of the uneven pattern of healthcare accessibility in Shenzhen. The findings suggest improving the public transit conditions for accessing healthcare services to reduce the disparity of healthcare accessibility. More healthcare services should be allocated in the eastern and western Shenzhen, especially sub-districts in Dapeng District and western Bao'an District. As these findings cannot be drawn by the traditional single-modal 2SFCA method, the advantage of the multi-modal 2SFCA method is significant to both healthcare studies and healthcare system planning.

Influence of Sequential vs. Simultaneous Dual-Task Exercise Training on Cognitive Function in Older Adults

PubMed Central

Tait, Jamie L.; Duckham, Rachel L.; Milte, Catherine M.; Main, Luana C.; Daly, Robin M.

2017-01-01

Emerging research indicates that exercise combined with cognitive training may improve cognitive function in older adults. Typically these programs have incorporated sequential training, where exercise and cognitive training are undertaken separately. However, simultaneous or dual-task training, where cognitive and/or motor training are performed simultaneously with exercise, may offer greater benefits. This review summary provides an overview of the effects of combined simultaneous vs. sequential training on cognitive function in older adults. Based on the available evidence, there are inconsistent findings with regard to the cognitive benefits of sequential training in comparison to cognitive or exercise training alone. In contrast, simultaneous training interventions, particularly multimodal exercise programs in combination with secondary tasks regulated by sensory cues, have significantly improved cognition in both healthy older and clinical populations. However, further research is needed to determine the optimal characteristics of a successful simultaneous training program for optimizing cognitive function in older people. PMID:29163146

Delivery of ultrashort spatially focused pulses through a multimode fiber

NASA Astrophysics Data System (ADS)

Morales-Delgado, Edgar E.; Papadopoulos, Ioannis N.; Farahi, Salma; Psaltis, Demetri; Moser, Christophe

2015-08-01

Multimode optical fibers potentially allow the transmission of larger amounts of information than their single mode counterparts because of their high number of supported modes. However, propagation of a light pulse through a multimode fiber suffers from spatial distortions due to the superposition of the various exited modes and from time broadening due to modal dispersion. We present a method based on digital phase conjugation to selectively excite in a multimode fiber specific optical fiber modes that follow similar optical paths as they travel through the fiber. The excited modes interfere constructively at the fiber output generating an ultrashort spatially focused pulse. The excitation of a limited number of modes following similar optical paths limits modal dispersion, allowing the transmission of the ultrashort pulse. We have experimentally demonstrated the delivery of a focused spot of pulse width equal to 500 fs through a 30 cm, 200 micrometer core step index multimode fiber. The results of this study show that two-photon imaging capability can be added to ultra-thin lensless endoscopy using commercial multimode fibers.

Delivery of an ultrashort spatially focused pulse to the other end of a multimode fiber using digital phase conjugation

NASA Astrophysics Data System (ADS)

Morales Delgado, Edgar E.; Papadopoulos, Ioannis N.; Farahi, Salma; Psaltis, Demetri; Moser, Christophe

2015-03-01

Multimode optical fibers potentially allow the transmission of larger amounts of information than their single mode counterparts because of their high number of supported modes. However, propagation of a light pulse through a multimode fiber suffers from spatial distortions due to the superposition of the various exited modes and from time broadening due to modal dispersion. We present a method based on digital phase conjugation to selectively excite in a multimode fiber specific optical fiber modes that follow similar optical paths as they travel through the fiber. The excited modes interfere constructively at the fiber output generating an ultrashort spatially focused pulse. The excitation of a limited number of modes following similar optical paths limits modal dispersion, allowing the transmission of the ultrashort pulse. We have experimentally demonstrated the delivery of a focused spot of pulse width equal to 500 fs through a 30 cm, 200 micrometer core step-index multimode fiber. The results of this study show that two-photon imaging capability can be added to ultra-thin lensless endoscopy using commercial multimode fibers.

The Simultaneity of Experience: Cultural Identity, Magical Realism and the Artefactual in Digital Storytelling

ERIC Educational Resources Information Center

Honeyford, Michelle A.

2013-01-01

This paper explores how students, as multimodal storytellers, can weave powerful narratives blending modes, genres, artefacts and literary conventions to represent the real and imagined in their lives. Part of a larger ethnographic case study of student writing in a middle years class for immigrant students learning English as an additional…

Multimodal segmentation of optic disc and cup from stereo fundus and SD-OCT images

NASA Astrophysics Data System (ADS)

Miri, Mohammad Saleh; Lee, Kyungmoo; Niemeijer, Meindert; Abràmoff, Michael D.; Kwon, Young H.; Garvin, Mona K.

2013-03-01

Glaucoma is one of the major causes of blindness worldwide. One important structural parameter for the diagnosis and management of glaucoma is the cup-to-disc ratio (CDR), which tends to become larger as glaucoma progresses. While approaches exist for segmenting the optic disc and cup within fundus photographs, and more recently, within spectral-domain optical coherence tomography (SD-OCT) volumes, no approaches have been reported for the simultaneous segmentation of these structures within both modalities combined. In this work, a multimodal pixel-classification approach for the segmentation of the optic disc and cup within fundus photographs and SD-OCT volumes is presented. In particular, after segmentation of other important structures (such as the retinal layers and retinal blood vessels) and fundus-to-SD-OCT image registration, features are extracted from both modalities and a k-nearest-neighbor classification approach is used to classify each pixel as cup, rim, or background. The approach is evaluated on 70 multimodal image pairs from 35 subjects in a leave-10%-out fashion (by subject). A significant improvement in classification accuracy is obtained using the multimodal approach over that obtained from the corresponding unimodal approach (97.8% versus 95.2%; p < 0:05; paired t-test).

A Deep and Autoregressive Approach for Topic Modeling of Multimodal Data.

PubMed

Zheng, Yin; Zhang, Yu-Jin; Larochelle, Hugo

2016-06-01

Topic modeling based on latent Dirichlet allocation (LDA) has been a framework of choice to deal with multimodal data, such as in image annotation tasks. Another popular approach to model the multimodal data is through deep neural networks, such as the deep Boltzmann machine (DBM). Recently, a new type of topic model called the Document Neural Autoregressive Distribution Estimator (DocNADE) was proposed and demonstrated state-of-the-art performance for text document modeling. In this work, we show how to successfully apply and extend this model to multimodal data, such as simultaneous image classification and annotation. First, we propose SupDocNADE, a supervised extension of DocNADE, that increases the discriminative power of the learned hidden topic features and show how to employ it to learn a joint representation from image visual words, annotation words and class label information. We test our model on the LabelMe and UIUC-Sports data sets and show that it compares favorably to other topic models. Second, we propose a deep extension of our model and provide an efficient way of training the deep model. Experimental results show that our deep model outperforms its shallow version and reaches state-of-the-art performance on the Multimedia Information Retrieval (MIR) Flickr data set.

Two-channel highly sensitive sensors based on 4 × 4 multimode interference couplers

NASA Astrophysics Data System (ADS)

Le, Trung-Thanh

2017-12-01

We propose a new kind of microring resonators (MRR) based on 4 × 4 multimode interference (MMI) couplers for multichannel and highly sensitive chemical and biological sensors. The proposed sensor structure has advantages of compactness and high sensitivity compared with the reported sensing structures. By using the transfer matrix method (TMM) and numerical simulations, the designs of the sensor based on silicon waveguides are optimized and demonstrated in detail. We apply our structure to detect glucose and ethanol concentrations simultaneously. A high sensitivity of 9000 nm/RIU, detection limit of 2 × 10‒4 for glucose sensing and sensitivity of 6000 nm/RIU, detection limit of 1.3 × 10‒5 for ethanol sensing are achieved.

Multimodal nonlinear microscope based on a compact fiber-format laser source

NASA Astrophysics Data System (ADS)

Crisafi, Francesco; Kumar, Vikas; Perri, Antonio; Marangoni, Marco; Cerullo, Giulio; Polli, Dario

2018-01-01

We present a multimodal non-linear optical (NLO) laser-scanning microscope, based on a compact fiber-format excitation laser and integrating coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and two-photon-excitation fluorescence (TPEF) on a single platform. We demonstrate its capabilities in simultaneously acquiring CARS and SRS images of a blend of 6-μm poly(methyl methacrylate) beads and 3-μm polystyrene beads. We then apply it to visualize cell walls and chloroplast of an unprocessed fresh leaf of Elodea aquatic plant via SRS and TPEF modalities, respectively. The presented NLO microscope, developed in house using off-the-shelf components, offers full accessibility to the optical path and ensures its easy re-configurability and flexibility.

AMIDE: a free software tool for multimodality medical image analysis.

PubMed

Loening, Andreas Markus; Gambhir, Sanjiv Sam

2003-07-01

Amide's a Medical Image Data Examiner (AMIDE) has been developed as a user-friendly, open-source software tool for displaying and analyzing multimodality volumetric medical images. Central to the package's abilities to simultaneously display multiple data sets (e.g., PET, CT, MRI) and regions of interest is the on-demand data reslicing implemented within the program. Data sets can be freely shifted, rotated, viewed, and analyzed with the program automatically handling interpolation as needed from the original data. Validation has been performed by comparing the output of AMIDE with that of several existing software packages. AMIDE runs on UNIX, Macintosh OS X, and Microsoft Windows platforms, and it is freely available with source code under the terms of the GNU General Public License.

Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

DOE PAGES

Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth R.; ...

2016-02-05

Here, we developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray's superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioningmore » it.« less

Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth R.

Here, we developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray's superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioningmore » it.« less

Modal noise investigation in multimode polymer waveguides

NASA Astrophysics Data System (ADS)

Beals, Joseph, IV; Bamiedakis, Nikos; Penty, Richard V.; White, Ian H.; DeGroot, Jon V., Jr.; Clapp, Terry V.

2007-11-01

In this work the recent interest in waveguides for use in short optical links has motivated a study of the modal noise dependence on launch conditions in short-reach step-index multimode polymer waveguides. Short optical links, especially those with several connection interfaces and utilising a restricted launch are likely to be subject to a modal noise power penalty. We therefore experimentally study the modal noise impact of restricted launches for a short-reach optical link employing a 50 x 50 μm polymer multimode waveguide. Lens launches resulting in small diameter input spots are investigated as are restricted launches from an 8 μm core optical fibre. For a launch spot of 10 μm diameter no impairment is observed for up to 9 dBo of mode selective loss, and for a fibre launch with a dynamic input movement of 6 μm no impairment is seen for up to 8 dBo of mode selective loss.

Tunable all-fiber dissipative-soliton laser with a multimode interference filter.

PubMed

Zhang, Lei; Hu, Jinmeng; Wang, Jianhua; Feng, Yan

2012-09-15

We report on a tunable all-fiber dissipative-soliton laser with a multimode interference filter that consists of a multimode fiber spliced between two single-mode fibers. By carefully selecting the fiber parameters, a filter with a central wavelength at 1032 nm and a bandwidth of 7.6 nm is constructed and used for spectral filtering in an all-normal-dispersion mode-locked ytterbium-doped fiber laser based on nonlinear polarization evolution. The laser delivers 31 mW of average output power with positively chirped 7 ps pulses. The repetition rate of the pulses is 15.3 MHz, and pulse energy is 2.1 nJ. Tunable dissipative-soliton over 12 nm is achieved by applying tension to the single-mode-multimode-single-mode filter.

Total teleportation of a single-photon state

DOE Office of Scientific and Technical Information (OSTI.GOV)

Humble, Travis S; Bennink, Ryan S; Grice, Warren P

2008-01-01

Recent demonstrations of teleportation have transferred quantum information encoded into either polarization or field-quadrature degrees of freedom (DOFs), but an outstanding question is how to simultaneously teleport quantum information encoded into multiple DOFs. We describe how the transverse-spatial, spectral and polarization states of a single photon can be simultaneously teleported using a pair of multimode, polarization-entangled photons derived from spontaneous parametric down-conversion. Furthermore, when the initial photon pair is maximally entangled in the spatial, spectral, and polarization DOFs then the photon s full quantum state can be reliably teleported using a Bell-state measurement based on sum-frequency generation.

The sensory substrate of multimodal communication in brown-headed cowbirds: are females sensory 'specialists' or 'generalists'?

PubMed

Ronald, Kelly L; Sesterhenn, Timothy M; Fernandez-Juricic, Esteban; Lucas, Jeffrey R

2017-11-01

Many animals communicate with multimodal signals. While we have an understanding of multimodal signal production, we know relatively less about receiver filtering of multimodal signals and whether filtering capacity in one modality influences filtering in a second modality. Most multimodal signals contain a temporal element, such as change in frequency over time or a dynamic visual display. We examined the relationship in temporal resolution across two modalities to test whether females are (1) sensory 'specialists', where a trade-off exists between the sensory modalities, (2) sensory 'generalists', where a positive relationship exists between the modalities, or (3) whether no relationship exists between modalities. We used female brown-headed cowbirds (Molothrus ater) to investigate this question as males court females with an audiovisual display. We found a significant positive relationship between female visual and auditory temporal resolution, suggesting that females are sensory 'generalists'. Females appear to resolve information well across multiple modalities, which may select for males that signal their quality similarly across modalities.

Multi-Modality Phantom Development

DOE Office of Scientific and Technical Information (OSTI.GOV)

Huber, Jennifer S.; Peng, Qiyu; Moses, William W.

2009-03-20

Multi-modality imaging has an increasing role in the diagnosis and treatment of a large number of diseases, particularly if both functional and anatomical information are acquired and accurately co-registered. Hence, there is a resulting need for multi modality phantoms in order to validate image co-registration and calibrate the imaging systems. We present our PET-ultrasound phantom development, including PET and ultrasound images of a simple prostate phantom. We use agar and gelatin mixed with a radioactive solution. We also present our development of custom multi-modality phantoms that are compatible with PET, transrectal ultrasound (TRUS), MRI and CT imaging. We describe bothmore » our selection of tissue mimicking materials and phantom construction procedures. These custom PET-TRUS-CT-MRI prostate phantoms use agargelatin radioactive mixtures with additional contrast agents and preservatives. We show multi-modality images of these custom prostate phantoms, as well as discuss phantom construction alternatives. Although we are currently focused on prostate imaging, this phantom development is applicable to many multi-modality imaging applications.« less

A Place for Video Games: A Theoretical and Pedagogical Framework for Multiliteracies Learning in English Studies

ERIC Educational Resources Information Center

Jordan, Ethan T.

2011-01-01

Students are now involved in a vastly different textual landscape than many English scholars, one that relies on the "reading" and interpretation of multiple channels of simultaneous information. As a response to these new kinds of literate practices, my dissertation adds to the growing body of research on multimodal literacies, narratology in new…

Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data

PubMed Central

Ahn, Sangtae; Nguyen, Thien; Jang, Hyojung; Kim, Jae G.; Jun, Sung C.

2016-01-01

Investigations of the neuro-physiological correlates of mental loads, or states, have attracted significant attention recently, as it is particularly important to evaluate mental fatigue in drivers operating a motor vehicle. In this research, we collected multimodal EEG/ECG/EOG and fNIRS data simultaneously to develop algorithms to explore neuro-physiological correlates of drivers' mental states. Each subject performed simulated driving under two different conditions (well-rested and sleep-deprived) on different days. During the experiment, we used 68 electrodes for EEG/ECG/EOG and 8 channels for fNIRS recordings. We extracted the prominent features of each modality to distinguish between the well-rested and sleep-deprived conditions, and all multimodal features, except EOG, were combined to quantify mental fatigue during driving. Finally, a novel driving condition level (DCL) was proposed that distinguished clearly between the features of well-rested and sleep-deprived conditions. This proposed DCL measure may be applicable to real-time monitoring of the mental states of vehicle drivers. Further, the combination of methods based on each classifier yielded substantial improvements in the classification accuracy between these two conditions. PMID:27242483

Ambulatory diffuse optical tomography and multimodality physiological monitoring system for muscle and exercise applications

NASA Astrophysics Data System (ADS)

Hu, Gang; Zhang, Quan; Ivkovic, Vladimir; Strangman, Gary E.

2016-09-01

Ambulatory diffuse optical tomography (aDOT) is based on near-infrared spectroscopy (NIRS) and enables three-dimensional imaging of regional hemodynamics and oxygen consumption during a person's normal activities. Although NIRS has been previously used for muscle assessment, it has been notably limited in terms of the number of channels measured, the extent to which subjects can be ambulatory, and/or the ability to simultaneously acquire synchronized auxiliary data such as electromyography (EMG) or electrocardiography (ECG). We describe the development of a prototype aDOT system, called NINscan-M, capable of ambulatory tomographic imaging as well as simultaneous auxiliary multimodal physiological monitoring. Powered by four AA size batteries and weighing 577 g, the NINscan-M prototype can synchronously record 64-channel NIRS imaging data, eight channels of EMG, ECG, or other analog signals, plus force, acceleration, rotation, and temperature for 24+ h at up to 250 Hz. We describe the system's design, characterization, and performance characteristics. We also describe examples of isometric, cycle ergometer, and free-running ambulatory exercise to demonstrate tomographic imaging at 25 Hz. NINscan-M represents a multiuse tool for muscle physiology studies as well as clinical muscle assessment.

Compact spectrometer for precision studies of multimode behavior in an extended-cavity diode laser

NASA Astrophysics Data System (ADS)

Roach, Timothy; Golemi, Josian; Krueger, Thomas

2016-05-01

We have built a compact, inexpensive, high-precision spectrometer and used it to investigate the tuning behavior of a grating stabilized extended-cavity diode laser (ECDL). A common ECDL design uses a laser chip with an uncoated (partially reflecting) front facet, and the laser output exhibits a complicated pattern of mode hops as the frequency is tuned, in some cases even showing chaotic dynamics. Our grating spectrometer (based on a design by White & Scholten) monitors a span of 4000 GHz (8 nm at 780 nm) with a linewidth of 3 GHz, which with line-splitting gives a precision of 0.02 GHz in determining the frequency of a laser mode. We have studied multimode operation of the ECDL, tracking two or three simultaneous chip cavity modes (spacing ~ 30 GHz) during tuning via current or piezo control of the external cavity. Simultaneous output on adjacent external cavity modes (spacing ~ 5 GHz) is monitored by measuring an increase in the spectral linewidth. Computer-control of the spectrometer (for line-fitting and averaging) and of the ECDL (electronic tuning) allows rapid collection of spectral data sets, which we will use to test mathematical simulation models of the non-linear laser cavity interactions.

Joint inversion of high-frequency surface waves with fundamental and higher modes

USGS Publications Warehouse

Luo, Y.; Xia, J.; Liu, J.; Liu, Q.; Xu, S.

2007-01-01

Joint inversion of multimode surface waves for estimating the shear (S)-wave velocity has received much attention in recent years. In this paper, we first analyze sensitivity of phase velocities of multimodes of surface waves for a six-layer earth model, and then we invert surface-wave dispersion curves of the theoretical model and a real-world example. Sensitivity analysis shows that fundamental mode data are more sensitive to the S-wave velocities of shallow layers and are concentrated on a very narrow frequency band, while higher mode data are more sensitive to the parameters of relatively deeper layers and are distributed over a wider frequency band. These properties provide a foundation of using a multimode joint inversion to define S-wave velocities. Inversion results of both synthetic data and a real-world example demonstrate that joint inversion with the damped least-square method and the singular-value decomposition technique to invert high-frequency surface waves with fundamental and higher mode data simultaneously can effectively reduce the ambiguity and improve the accuracy of S-wave velocities. ?? 2007.

Multimodal digital color imaging system for facial skin lesion analysis

NASA Astrophysics Data System (ADS)

Bae, Youngwoo; Lee, Youn-Heum; Jung, Byungjo

2008-02-01

In dermatology, various digital imaging modalities have been used as an important tool to quantitatively evaluate the treatment effect of skin lesions. Cross-polarization color image was used to evaluate skin chromophores (melanin and hemoglobin) information and parallel-polarization image to evaluate skin texture information. In addition, UV-A induced fluorescent image has been widely used to evaluate various skin conditions such as sebum, keratosis, sun damages, and vitiligo. In order to maximize the evaluation efficacy of various skin lesions, it is necessary to integrate various imaging modalities into an imaging system. In this study, we propose a multimodal digital color imaging system, which provides four different digital color images of standard color image, parallel and cross-polarization color image, and UV-A induced fluorescent color image. Herein, we describe the imaging system and present the examples of image analysis. By analyzing the color information and morphological features of facial skin lesions, we are able to comparably and simultaneously evaluate various skin lesions. In conclusion, we are sure that the multimodal color imaging system can be utilized as an important assistant tool in dermatology.

Manifold Regularized Multitask Feature Learning for Multimodality Disease Classification

PubMed Central

Jie, Biao; Zhang, Daoqiang; Cheng, Bo; Shen, Dinggang

2015-01-01

Multimodality based methods have shown great advantages in classification of Alzheimer’s disease (AD) and its prodromal stage, that is, mild cognitive impairment (MCI). Recently, multitask feature selection methods are typically used for joint selection of common features across multiple modalities. However, one disadvantage of existing multimodality based methods is that they ignore the useful data distribution information in each modality, which is essential for subsequent classification. Accordingly, in this paper we propose a manifold regularized multitask feature learning method to preserve both the intrinsic relatedness among multiple modalities of data and the data distribution information in each modality. Specifically, we denote the feature learning on each modality as a single task, and use group-sparsity regularizer to capture the intrinsic relatedness among multiple tasks (i.e., modalities) and jointly select the common features from multiple tasks. Furthermore, we introduce a new manifold-based Laplacian regularizer to preserve the data distribution information from each task. Finally, we use the multikernel support vector machine method to fuse multimodality data for eventual classification. Conversely, we also extend our method to the semisupervised setting, where only partial data are labeled. We evaluate our method using the baseline magnetic resonance imaging (MRI), fluorodeoxyglucose positron emission tomography (FDG-PET), and cerebrospinal fluid (CSF) data of subjects from AD neuroimaging initiative database. The experimental results demonstrate that our proposed method can not only achieve improved classification performance, but also help to discover the disease-related brain regions useful for disease diagnosis. PMID:25277605

A triple hybrid micropower generator with simultaneous multi-mode energy harvesting

NASA Astrophysics Data System (ADS)

Uluşan, H.; Chamanian, S.; Pathirana, W. P. M. R.; Zorlu, Ö.; Muhtaroğlu, A.; Külah, H.

2018-01-01

This study presents a triple hybrid energy harvesting system that combines harvested power from thermoelectric (TE), vibration-based electromagnetic (EM) and piezoelectric (PZT) harvesters into a single DC supply. A power management circuit is designed and implemented in 180 nm standard CMOS technology based on the distinct requirements of each harvester, and is terminated with a Schottky diode to avoid reverse current flow. The system topology hence supports simultaneous power generation and delivery from low and high frequency vibrations as well as temperature differences in the environment. The ultra-low DC voltage harvested from TE generator is boosted with a cross-coupled charge-pump driven by an LC oscillator with fully-integrated center-tapped differential inductors. The EM harvester output was rectified with a self-powered and low drop-out AC/DC doubler circuit. The PZT interface electronics benefits from peak-to-peak cycle of the harvested voltage through a negative voltage converter followed by synchronous power extraction and DC-to-DC conversion through internal switches, and an external inductor. The hybrid system was tested with a wearable in-house EM energy harvester placed wrist of a jogger, a commercial low volume PZT harvester, and DC supply as the TE generator output. The system generates more than 1.2 V output for load resistances higher than 50 kΩ, which corresponds to 24 μW to power wearable sensors. Simultaneous multi-mode operation achieves higher voltage and power compared to stand-alone harvesting circuits, and generates up to 110 μW of output power. This is the first hybrid harvester circuit that simultaneously extracts energy from three independent sources, and delivers a single DC output.

Wind- and Rain-Induced Vibrations Impose Different Selection Pressures on Multimodal Signaling.

PubMed

Halfwerk, Wouter; Ryan, Michael J; Wilson, Preston S

2016-09-01

The world is a noisy place, and animals have evolved a myriad of strategies to communicate in it. Animal communication signals are, however, often multimodal; their components can be processed by multiple sensory systems, and noise can thus affect signal components across different modalities. We studied the effect of environmental noise on multimodal communication in the túngara frog (Physalaemus pustulosus). Males communicate with rivals using airborne sounds combined with call-induced water ripples. We tested males under control as well as noisy conditions in which we mimicked rain- and wind-induced vibrations on the water surface. Males responded more strongly to a multimodal playback in which sound and ripples were combined, compared to a unimodal sound-only playback, but only in the absence of rain and wind. Under windy conditions, males decreased their response to the multimodal playback, suggesting that wind noise interferes with the detection of rival ripples. Under rainy conditions, males increased their response, irrespective of signal playback, suggesting that different noise sources can have different impacts on communication. Our findings show that noise in an additional sensory channel can affect multimodal signal perception and thereby drive signal evolution, but not always in the expected direction.

Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception.

PubMed

Bänziger, Tanja; Mortillaro, Marcello; Scherer, Klaus R

2012-10-01

Research on the perception of emotional expressions in faces and voices is exploding in psychology, the neurosciences, and affective computing. This article provides an overview of some of the major emotion expression (EE) corpora currently available for empirical research and introduces a new, dynamic, multimodal corpus of emotion expressions, the Geneva Multimodal Emotion Portrayals Core Set (GEMEP-CS). The design features of the corpus are outlined and justified, and detailed validation data for the core set selection are presented and discussed. Finally, an associated database with microcoded facial, vocal, and body action elements, as well as observer ratings, is introduced.

Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan.

PubMed

Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

2016-12-20

The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of "precision medicine", "fusion imaging", "multimodality", and "tumor diagnosis and treatment". Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice.

Dynamic Graph Analytic Framework (DYGRAF): greater situation awareness through layered multi-modal network analysis

NASA Astrophysics Data System (ADS)

Margitus, Michael R.; Tagliaferri, William A., Jr.; Sudit, Moises; LaMonica, Peter M.

2012-06-01

Understanding the structure and dynamics of networks are of vital importance to winning the global war on terror. To fully comprehend the network environment, analysts must be able to investigate interconnected relationships of many diverse network types simultaneously as they evolve both spatially and temporally. To remove the burden from the analyst of making mental correlations of observations and conclusions from multiple domains, we introduce the Dynamic Graph Analytic Framework (DYGRAF). DYGRAF provides the infrastructure which facilitates a layered multi-modal network analysis (LMMNA) approach that enables analysts to assemble previously disconnected, yet related, networks in a common battle space picture. In doing so, DYGRAF provides the analyst with timely situation awareness, understanding and anticipation of threats, and support for effective decision-making in diverse environments.

Simultaneous separation and analysis of water- and fat-soluble vitamins on multi-modal reversed-phase weak anion exchange material by HPLC-UV.

PubMed

Dabre, Romain; Azad, Nazanin; Schwämmle, Achim; Lämmerhofer, Michael; Lindner, Wolfgang

2011-04-01

Several methods for the separation of vitamins on HPLC columns were already validated in the last 20 years. However, most of the techniques focus on separating either fat- or water-soluble vitamins and only few methods are intended to separate lipophilic and hydrophilic vitamins simultaneously. A mixed-mode reversed-phase weak anion exchange (RP-WAX) stationary phase was developed in our laboratory in order to address such mixture of analytes with different chemical characteristics, which are difficult to separate on standard columns. The high versatility in usage of the RP-WAX chromatographic material allowed a baseline separation of ten vitamins within a single run, seven water-soluble and three fat-soluble, using three different chromatographic modes: some positively charged vitamins are eluted in ion exclusion and ion repulsion modes whereas the negatively charged molecules are eluted in the ion exchange mechanism. The non-charged molecules are eluted in a classical reversed-phase mode, regarding their polarities. The method was validated for the vitamin analysis in tablets, evaluating selectivity, robustness, linearity, accuracy, and precision. The validated method was finally employed for the analysis of the vitamin content of some commercially available supplement tablets. Copyright © 2011 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Voluntary movement affects simultaneous perception of auditory and tactile stimuli presented to a non-moving body part.

PubMed

Hao, Qiao; Ora, Hiroki; Ogawa, Ken-Ichiro; Ogata, Taiki; Miyake, Yoshihiro

2016-09-13

The simultaneous perception of multimodal sensory information has a crucial role for effective reactions to the external environment. Voluntary movements are known to occasionally affect simultaneous perception of auditory and tactile stimuli presented to the moving body part. However, little is known about spatial limits on the effect of voluntary movements on simultaneous perception, especially when tactile stimuli are presented to a non-moving body part. We examined the effect of voluntary movement on the simultaneous perception of auditory and tactile stimuli presented to the non-moving body part. We considered the possible mechanism using a temporal order judgement task under three experimental conditions: voluntary movement, where participants voluntarily moved their right index finger and judged the temporal order of auditory and tactile stimuli presented to their non-moving left index finger; passive movement; and no movement. During voluntary movement, the auditory stimulus needed to be presented before the tactile stimulus so that they were perceived as occurring simultaneously. This subjective simultaneity differed significantly from the passive movement and no movement conditions. This finding indicates that the effect of voluntary movement on simultaneous perception of auditory and tactile stimuli extends to the non-moving body part.

MMX-I: A data-processing software for multi-modal X-ray imaging and tomography

NASA Astrophysics Data System (ADS)

Bergamaschi, A.; Medjoubi, K.; Messaoudi, C.; Marco, S.; Somogyi, A.

2017-06-01

Scanning hard X-ray imaging allows simultaneous acquisition of multimodal information, including X-ray fluorescence, absorption, phase and dark-field contrasts, providing structural and chemical details of the samples. Combining these scanning techniques with the infrastructure developed for fast data acquisition at Synchrotron Soleil permits to perform multimodal imaging and tomography during routine user experiments at the Nanoscopium beamline. A main challenge of such imaging techniques is the online processing and analysis of the generated very large volume (several hundreds of Giga Bytes) multimodal data-sets. This is especially important for the wide user community foreseen at the user oriented Nanoscopium beamline (e.g. from the fields of Biology, Life Sciences, Geology, Geobiology), having no experience in such data-handling. MMX-I is a new multi-platform open-source freeware for the processing and reconstruction of scanning multi-technique X-ray imaging and tomographic datasets. The MMX-I project aims to offer, both expert users and beginners, the possibility of processing and analysing raw data, either on-site or off-site. Therefore we have developed a multi-platform (Mac, Windows and Linux 64bit) data processing tool, which is easy to install, comprehensive, intuitive, extendable and user-friendly. MMX-I is now routinely used by the Nanoscopium user community and has demonstrated its performance in treating big data.

Primary Pediatric Care Psychopharmacology: Focus on medications for ADHD, depression and anxiety

PubMed Central

Strawn, Jeffrey R.; Dobson, Eric; Giles, Lisa

2016-01-01

The evidence base for psychopharmacologic interventions in youth with depressive and anxiety disorders as well as attention/deficit hyperactivity disorder (ADHD) has dramatically increased over the past two decades. Psychopharmacologic interventions commonly utilized in the pediatric primary care setting—selective serotonin (norepinephrine) reuptake inhibitors (SSRIs/SSNRIs), stimulants and α2 agonists—are reviewed. General pharmacologic principles are summarized along with class-related side effects and tolerability concerns (e.g., suicidality and activation in antidepressant-treated youth as well as insomnia, irritability, anorexia in stimulant-treated pediatric patients). Selected landmark trials of antidepressant medications in youth with depressive disorders (Treatment of Adolescent Depression Study [TADS] and the Treatment of SSRI-Resistant Depression Study [TADS]) and anxiety disorders (Child/Adolescent Anxiety Multimodal Study [CAMS] and Child/Adolescent Anxiety Multimodal Extended Long-term Study [CAMELS]) are described in addition to the Multimodal Treatment of ADHD Study. Finally, available data are presented that are related to prediction of treatment outcomes in youth with depressive disorders, anxiety disorders and ADHD. PMID:28043839

Simultaneous in vivo imaging of melanin and lipofuscin in the retina with photoacoustic ophthalmoscopy and autofluorescence imaging.

PubMed

Zhang, Xiangyang; Zhang, Hao F; Puliafito, Carmen A; Jiao, Shuliang

2011-08-01

We combined photoacoustic ophthalmoscopy (PAOM) with autofluorescence imaging for simultaneous in vivo imaging of dual molecular contrasts in the retina using a single light source. The dual molecular contrasts come from melanin and lipofuscin in the retinal pigment epithelium (RPE). Melanin and lipofuscin are two types of pigments and are believed to play opposite roles (protective versus exacerbate) in the RPE in the aging process. We have successfully imaged the retina of pigmented and albino rats at different ages. The experimental results showed that multimodal PAOM system can be a potentially powerful tool in the study of age-related degenerative retinal diseases.

Simultaneous in vivo imaging of melanin and lipofuscin in the retina with photoacoustic ophthalmoscopy and autofluorescence imaging

NASA Astrophysics Data System (ADS)

Zhang, Xiangyang; Zhang, Hao F.; Puliafito, Carmen A.; Jiao, Shuliang

2011-08-01

We combined photoacoustic ophthalmoscopy (PAOM) with autofluorescence imaging for simultaneous in vivo imaging of dual molecular contrasts in the retina using a single light source. The dual molecular contrasts come from melanin and lipofuscin in the retinal pigment epithelium (RPE). Melanin and lipofuscin are two types of pigments and are believed to play opposite roles (protective versus exacerbate) in the RPE in the aging process. We have successfully imaged the retina of pigmented and albino rats at different ages. The experimental results showed that multimodal PAOM system can be a potentially powerful tool in the study of age-related degenerative retinal diseases.

Simultaneous acquisition of magnetic resonance spectroscopy (MRS) data and positron emission tomography (PET) images with a prototype MR-compatible, small animal PET imager

NASA Astrophysics Data System (ADS)

Raylman, Raymond R.; Majewski, Stan; Velan, S. Sendhil; Lemieux, Susan; Kross, Brian; Popov, Vladimir; Smith, Mark F.; Weisenberger, Andrew G.

2007-06-01

Multi-modality imaging (such as PET-CT) is rapidly becoming a valuable tool in the diagnosis of disease and in the development of new drugs. Functional images produced with PET, fused with anatomical images created by MRI, allow the correlation of form with function. Perhaps more exciting than the combination of anatomical MRI with PET, is the melding of PET with MR spectroscopy (MRS). Thus, two aspects of physiology could be combined in novel ways to produce new insights into the physiology of normal and pathological processes. Our team is developing a system to acquire MRI images and MRS spectra, and PET images contemporaneously. The prototype MR-compatible PET system consists of two opposed detector heads (appropriate in size for small animal imaging), operating in coincidence mode with an active field-of-view of ˜14 cm in diameter. Each detector consists of an array of LSO detector elements coupled through a 2-m long fiber optic light guide to a single position-sensitive photomultiplier tube. The use of light guides allows these magnetic field-sensitive elements of the PET imager to be positioned outside the strong magnetic field of our 3T MRI scanner. The PET scanner imager was integrated with a 12-cm diameter, 12-leg custom, birdcage coil. Simultaneous MRS spectra and PET images were successfully acquired from a multi-modality phantom consisting of a sphere filled with 17 brain relevant substances and a positron-emitting radionuclide. There were no significant changes in MRI or PET scanner performance when both were present in the MRI magnet bore. This successful initial test demonstrates the potential for using such a multi-modality to obtain complementary MRS and PET data.

Random forest feature selection, fusion and ensemble strategy: Combining multiple morphological MRI measures to discriminate among healhy elderly, MCI, cMCI and alzheimer's disease patients: From the alzheimer's disease neuroimaging initiative (ADNI) database.

PubMed

Dimitriadis, S I; Liparas, Dimitris; Tsolaki, Magda N

2018-05-15

In the era of computer-assisted diagnostic tools for various brain diseases, Alzheimer's disease (AD) covers a large percentage of neuroimaging research, with the main scope being its use in daily practice. However, there has been no study attempting to simultaneously discriminate among Healthy Controls (HC), early mild cognitive impairment (MCI), late MCI (cMCI) and stable AD, using features derived from a single modality, namely MRI. Based on preprocessed MRI images from the organizers of a neuroimaging challenge, 3 we attempted to quantify the prediction accuracy of multiple morphological MRI features to simultaneously discriminate among HC, MCI, cMCI and AD. We explored the efficacy of a novel scheme that includes multiple feature selections via Random Forest from subsets of the whole set of features (e.g. whole set, left/right hemisphere etc.), Random Forest classification using a fusion approach and ensemble classification via majority voting. From the ADNI database, 60 HC, 60 MCI, 60 cMCI and 60 CE were used as a training set with known labels. An extra dataset of 160 subjects (HC: 40, MCI: 40, cMCI: 40 and AD: 40) was used as an external blind validation dataset to evaluate the proposed machine learning scheme. In the second blind dataset, we succeeded in a four-class classification of 61.9% by combining MRI-based features with a Random Forest-based Ensemble Strategy. We achieved the best classification accuracy of all teams that participated in this neuroimaging competition. The results demonstrate the effectiveness of the proposed scheme to simultaneously discriminate among four groups using morphological MRI features for the very first time in the literature. Hence, the proposed machine learning scheme can be used to define single and multi-modal biomarkers for AD. Copyright © 2017 Elsevier B.V. All rights reserved.

Multimodal swept-source spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography at 400 kHz

NASA Astrophysics Data System (ADS)

El-Haddad, Mohamed T.; Joos, Karen M.; Patel, Shriji N.; Tao, Yuankai K.

2017-02-01

Multimodal imaging systems that combine scanning laser ophthalmoscopy (SLO) and optical coherence tomography (OCT) have demonstrated the utility of concurrent en face and volumetric imaging for aiming, eye tracking, bulk motion compensation, mosaicking, and contrast enhancement. However, this additional functionality trades off with increased system complexity and cost because both SLO and OCT generally require dedicated light sources, galvanometer scanners, relay and imaging optics, detectors, and control and digitization electronics. We previously demonstrated multimodal ophthalmic imaging using swept-source spectrally encoded SLO and OCT (SS-SESLO-OCT). Here, we present system enhancements and a new optical design that increase our SS-SESLO-OCT data throughput by >7x and field-of-view (FOV) by >4x. A 200 kHz 1060 nm Axsun swept-source was optically buffered to 400 kHz sweep-rate, and SESLO and OCT were simultaneously digitized on dual input channels of a 4 GS/s digitizer at 1.2 GS/s per channel using a custom k-clock. We show in vivo human imaging of the anterior segment out to the limbus and retinal fundus over a >40° FOV. In addition, nine overlapping volumetric SS-SESLO-OCT volumes were acquired under video-rate SESLO preview and guidance. In post-processing, all nine SESLO images and en face projections of the corresponding OCT volumes were mosaicked to show widefield multimodal fundus imaging with a >80° FOV. Concurrent multimodal SS-SESLO-OCT may have applications in clinical diagnostic imaging by enabling aiming, image registration, and multi-field mosaicking and benefit intraoperative imaging by allowing for real-time surgical feedback, instrument tracking, and overlays of computationally extracted image-based surrogate biomarkers of disease.

Evolving Role of Local Anesthetics in Managing Postsurgical Analgesia.

PubMed

Golembiewski, Julie; Dasta, Joseph

2015-06-01

Opioid analgesics, the cornerstone of effective postsurgical pain management, may be associated with risk of opioid-related adverse drug events (ADEs) that may complicate the postsurgical experience. Perioperative multimodal analgesic regimens have the potential to improve postsurgical pain control and may permit use of lower analgesic doses and reduce the incidence of opioid-related ADEs. Utility of traditional local anesthetic formulations to provide analgesia over the entire postsurgical period is limited by their short duration of action. Liposome bupivacaine, a liposomal formulation of bupivacaine indicated for single-dose administration into the surgical site to produce postsurgical analgesia, was evaluated in multiple surgical models as part of multimodal analgesic regimens and was found in clinical trials to provide postsurgical analgesia for up to 72 hours. Here, we provide an overview of the available multimodal analgesic options and recent recommendations for optimal postsurgical pain management. A review of the literature was conducted, and results from recent clinical trials are included. The use of a multimodal analgesic regimen, including liposome bupivacaine, can extend the time to first postsurgical opioid use, may reduce postsurgical opioid consumption, and reduce hospital length of stay and costs compared with an opioid-only analgesic regimen. Use of multimodal analgesic regimens is a practical way to achieve good postsurgical analgesia while minimizing reliance on opioids and associated adverse events. Taken as a whole, evidence from the clinical studies of liposome bupivacaine suggests this local anesthetic formulation may be a useful component of multimodal analgesic regimens for managing postsurgical pain in select patients, with the potential to reduce opioid use and opioid-related ADEs in the postsurgical setting. As with bupivacaine, appropriate use of liposome bupivacaine to optimize clinical effects, economic implications, and patient tolerability will depend on appropriate patient selection, practitioner training, and institutional protocols. As a component of a multimodal analgesic regimen, liposome bupivacaine represents a new approach to extending the duration of postsurgical analgesia. Further studies across a range of surgical settings should help clarify the most appropriate roles for this prolonged-release formulation of bupivacaine. Copyright © 2015 Elsevier HS Journals, Inc. All rights reserved.

Efficacy of texture, shape, and intensity feature fusion for posterior-fossa tumor segmentation in MRI.

PubMed

Ahmed, Shaheen; Iftekharuddin, Khan M; Vossough, Arastoo

2011-03-01

Our previous works suggest that fractal texture feature is useful to detect pediatric brain tumor in multimodal MRI. In this study, we systematically investigate efficacy of using several different image features such as intensity, fractal texture, and level-set shape in segmentation of posterior-fossa (PF) tumor for pediatric patients. We explore effectiveness of using four different feature selection and three different segmentation techniques, respectively, to discriminate tumor regions from normal tissue in multimodal brain MRI. We further study the selective fusion of these features for improved PF tumor segmentation. Our result suggests that Kullback-Leibler divergence measure for feature ranking and selection and the expectation maximization algorithm for feature fusion and tumor segmentation offer the best results for the patient data in this study. We show that for T1 and fluid attenuation inversion recovery (FLAIR) MRI modalities, the best PF tumor segmentation is obtained using the texture feature such as multifractional Brownian motion (mBm) while that for T2 MRI is obtained by fusing level-set shape with intensity features. In multimodality fused MRI (T1, T2, and FLAIR), mBm feature offers the best PF tumor segmentation performance. We use different similarity metrics to evaluate quality and robustness of these selected features for PF tumor segmentation in MRI for ten pediatric patients.

Hyperspectral tomography based on multi-mode absorption spectroscopy (MUMAS)

NASA Astrophysics Data System (ADS)

Dai, Jinghang; O'Hagan, Seamus; Liu, Hecong; Cai, Weiwei; Ewart, Paul

2017-10-01

This paper demonstrates a hyperspectral tomographic technique that can recover the temperature and concentration field of gas flows based on multi-mode absorption spectroscopy (MUMAS). This method relies on the recently proposed concept of nonlinear tomography, which can take full advantage of the nonlinear dependency of MUMAS signals on temperature and enables 2D spatial resolution of MUMAS which is naturally a line-of-sight technique. The principles of MUMAS and nonlinear tomography, as well as the mathematical formulation of the inversion problem, are introduced. Proof-of-concept numerical demonstrations are presented using representative flame phantoms and assuming typical laser parameters. The results show that faithful reconstruction of temperature distribution is achievable when a signal-to-noise ratio of 20 is assumed. This method can potentially be extended to simultaneously reconstructing distributions of temperature and the concentration of multiple flame species.

Multimodal tuned dynamic absorber for split Stirling linear cryocooler

NASA Astrophysics Data System (ADS)

Veprik, A.; Tuito, A.

2017-02-01

Forthcoming low size, weight, power and price split Stirling linear cryocoolers may rely on electro-dynamically driven single-piston compressors and pneumatically driven expanders interconnected by the configurable transfer line. For compactness, compressor and expander units may be placed in a side-by-side manner, thus producing tonal vibration export comprising force and moment components. In vibration sensitive applications, this may result in excessive angular line of sight jitter and translational defocusing affecting the image quality. The authors present Multimodal Tuned Dynamic Absorber (MTDA), having one translational and two tilting modes essentially tuned to the driving frequency. The dynamic reactions (force and moment) produced by such a MTDA are simultaneously counterbalancing force and moment vibration export produced by the cryocooler. The authors reveal the design details, the method of fine modal tuning and outcomes of numerical simulation on attainable performance.

High performace silicon 2x2 optical switch based on a thermo-optically tunable multimode interference coupler and efficient electrodes.

PubMed

Rosa, Álvaro; Gutiérrez, Ana; Brimont, Antoine; Griol, Amadeu; Sanchis, Pablo

2016-01-11

Optical switches based on tunable multimode interference (MMI) couplers can simultaneously reduce the footprint and increase the tolerance against fabrication deviations. Here, a compact 2x2 silicon switch based on a thermo-optically tunable MMI structure with a footprint of only 0.005 mm(2) is proposed and demonstrated. The MMI structure has been optimized using a silica trench acting as a thermal isolator without introducing any substantial loss penalty or crosstalk degradation. Furthermore, the electrodes performance have significantly been improved via engineering the heater geometry and using two metallization steps. Thereby, a drastic power consumption reduction of around 90% has been demonstrated yielding to values as low as 24.9 mW. Furthermore, very fast switching times of only 1.19 µs have also been achieved.

Practical application of a bidirectional microwave photonic filter: simultaneous transmission of analog TV signals

NASA Astrophysics Data System (ADS)

Correa-Mena, Ana Gabriela; Zaldívar-Huerta, Ignacio E.; Abril García, Jose Humberto; García-Juárez, Alejandro; Vera-Marquina, Alicia

2016-10-01

A practical application of a bidirectional microwave photonic filter (MPF) to transmit simultaneous analog TV signals coded on microwave carriers is experimentally demonstrated. The frequency response of the bidirectional MPF is obtained by the interaction of an externally modulated multimode laser diode emitting at 1.55 μm associated to the free-spectral range of the optical source, the chromatic dispersion parameter of the optical fiber, as well as the length of the optical link. The filtered microwave bandpass window generated around 2 GHz is used as electrical carrier in order to simultaneously transmit TV signals of 67.25 and 61.25 MHz in both directions. The obtained signal-to-noise ratios for the transmitted signals of 67.25 and 61.25 MHz are 37.62 and 44.77 dB, respectively.

Combined analysis of whole human blood parameters by Raman spectroscopy and spectral-domain low-coherence interferometry

NASA Astrophysics Data System (ADS)

Gnyba, M.; Wróbel, M. S.; Karpienko, K.; Milewska, D.; Jedrzejewska-Szczerska, M.

2015-07-01

In this article the simultaneous investigation of blood parameters by complementary optical methods, Raman spectroscopy and spectral-domain low-coherence interferometry, is presented. Thus, the mutual relationship between chemical and physical properties may be investigated, because low-coherence interferometry measures optical properties of the investigated object, while Raman spectroscopy gives information about its molecular composition. A series of in-vitro measurements were carried out to assess sufficient accuracy for monitoring of blood parameters. A vast number of blood samples with various hematological parameters, collected from different donors, were measured in order to achieve a statistical significance of results and validation of the methods. Preliminary results indicate the benefits in combination of presented complementary methods and form the basis for development of a multimodal system for rapid and accurate optical determination of selected parameters in whole human blood. Future development of optical systems and multivariate calibration models are planned to extend the number of detected blood parameters and provide a robust quantitative multi-component analysis.

Multimode drug inducible CRISPR/Cas9 devices for transcriptional activation and genome editing

PubMed Central

Lu, Jia; Zhao, Chen; Zhao, Yingze; Zhang, Jingfang; Zhang, Yue; Chen, Li; Han, Qiyuan; Ying, Yue; Peng, Shuai; Ai, Runna; Wang, Yu

2018-01-01

Abstract Precise investigation and manipulation of dynamic biological processes often requires molecular modulation in a controlled inducible manner. The clustered, regularly interspaced, short palindromic repeats (CRISPR)/CRISPR associated protein 9 (Cas9) has emerged as a versatile tool for targeted gene editing and transcriptional programming. Here, we designed and vigorously optimized a series of Hybrid drug Inducible CRISPR/Cas9 Technologies (HIT) for transcriptional activation by grafting a mutated human estrogen receptor (ERT2) to multiple CRISPR/Cas9 systems, which renders them 4-hydroxytamoxifen (4-OHT) inducible for the access of genome. Further, extra functionality of simultaneous genome editing was achieved with one device we named HIT2. Optimized terminal devices herein delivered advantageous performances in comparison with several existing designs. They exerted selective, titratable, rapid and reversible response to drug induction. In addition, these designs were successfully adapted to an orthogonal Cas9. HIT systems developed in this study can be applied for controlled modulation of potentially any genomic loci in multiple modes. PMID:29237052

Development of fast parallel multi-technique scanning X-ray imaging at Synchrotron Soleil

NASA Astrophysics Data System (ADS)

Medjoubi, K.; Leclercq, N.; Langlois, F.; Buteau, A.; Lé, S.; Poirier, S.; Mercère, P.; Kewish, C. M.; Somogyi, A.

2013-10-01

A fast multimodal scanning X-ray imaging scheme is prototyped at Soleil Synchrotron. It permits the simultaneous acquisition of complementary information on the sample structure, composition and chemistry by measuring transmission, differential phase contrast, small-angle scattering, and X-ray fluorescence by dedicated detectors with ms dwell time per pixel. The results of the proof of principle experiments are presented in this paper.

Live animal myelin histomorphometry of the spinal cord with video-rate multimodal nonlinear microendoscopy

NASA Astrophysics Data System (ADS)

Bélanger, Erik; Crépeau, Joël; Laffray, Sophie; Vallée, Réal; De Koninck, Yves; Côté, Daniel

2012-02-01

In vivo imaging of cellular dynamics can be dramatically enabling to understand the pathophysiology of nervous system diseases. To fully exploit the power of this approach, the main challenges have been to minimize invasiveness and maximize the number of concurrent optical signals that can be combined to probe the interplay between multiple cellular processes. Label-free coherent anti-Stokes Raman scattering (CARS) microscopy, for example, can be used to follow demyelination in neurodegenerative diseases or after trauma, but myelin imaging alone is not sufficient to understand the complex sequence of events that leads to the appearance of lesions in the white matter. A commercially available microendoscope is used here to achieve minimally invasive, video-rate multimodal nonlinear imaging of cellular processes in live mouse spinal cord. The system allows for simultaneous CARS imaging of myelin sheaths and two-photon excitation fluorescence microendoscopy of microglial cells and axons. Morphometric data extraction at high spatial resolution is also described, with a technique for reducing motion-related imaging artifacts. Despite its small diameter, the microendoscope enables high speed multimodal imaging over wide areas of tissue, yet at resolution sufficient to quantify subtle differences in myelin thickness and microglial motility.

Multimodal label-free ex vivo imaging using a dual-wavelength microscope with axial chromatic aberration compensation.

PubMed

Filippi, Andrea; Dal Sasso, Eleonora; Iop, Laura; Armani, Andrea; Gintoli, Michele; Sandri, Marco; Gerosa, Gino; Romanato, Filippo; Borile, Giulia

2018-03-01

Label-free microscopy is a very powerful technique that can be applied to study samples with no need for exogenous fluorescent probes, keeping the main benefits of multiphoton microscopy, such as longer penetration depths and intrinsic optical sectioning while enabling serial multitechniques examinations on the same specimen. Among the many label-free microscopy methods, harmonic generation (HG) is one of the most intriguing methods due to its generally low photo-toxicity and relative ease of implementation. Today, HG and common two-photon microscopy (TPM) are well-established techniques, and are routinely used in several research fields. However, they require a significant amount of fine-tuning to be fully exploited, making them quite difficult to perform in parallel. Here, we present our designed multimodal microscope, capable of performing simultaneously TPM and HG without any kind of compromise thanks to two, separate, individually optimized laser sources with axial chromatic aberration compensation. We also apply our setup to the examination of a plethora of ex vivo samples to prove its capabilities and the significant advantages of a multimodal approach. (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE).

Multimodal biometric method that combines veins, prints, and shape of a finger

NASA Astrophysics Data System (ADS)

Kang, Byung Jun; Park, Kang Ryoung; Yoo, Jang-Hee; Kim, Jeong Nyeo

2011-01-01

Multimodal biometrics provides high recognition accuracy and population coverage by using various biometric features. A single finger contains finger veins, fingerprints, and finger geometry features; by using multimodal biometrics, information on these multiple features can be simultaneously obtained in a short time and their fusion can outperform the use of a single feature. This paper proposes a new finger recognition method based on the score-level fusion of finger veins, fingerprints, and finger geometry features. This research is novel in the following four ways. First, the performances of the finger-vein and fingerprint recognition are improved by using a method based on a local derivative pattern. Second, the accuracy of the finger geometry recognition is greatly increased by combining a Fourier descriptor with principal component analysis. Third, a fuzzy score normalization method is introduced; its performance is better than the conventional Z-score normalization method. Fourth, finger-vein, fingerprint, and finger geometry recognitions are combined by using three support vector machines and a weighted SUM rule. Experimental results showed that the equal error rate of the proposed method was 0.254%, which was lower than those of the other methods.

Multimodal molecular 3D imaging for the tumoral volumetric distribution assessment of folate-based biosensors.

PubMed

Ramírez-Nava, Gerardo J; Santos-Cuevas, Clara L; Chairez, Isaac; Aranda-Lara, Liliana

2017-12-01

The aim of this study was to characterize the in vivo volumetric distribution of three folate-based biosensors by different imaging modalities (X-ray, fluorescence, Cerenkov luminescence, and radioisotopic imaging) through the development of a tridimensional image reconstruction algorithm. The preclinical and multimodal Xtreme imaging system, with a Multimodal Animal Rotation System (MARS), was used to acquire bidimensional images, which were processed to obtain the tridimensional reconstruction. Images of mice at different times (biosensor distribution) were simultaneously obtained from the four imaging modalities. The filtered back projection and inverse Radon transformation were used as main image-processing techniques. The algorithm developed in Matlab was able to calculate the volumetric profiles of 99m Tc-Folate-Bombesin (radioisotopic image), 177 Lu-Folate-Bombesin (Cerenkov image), and FolateRSense™ 680 (fluorescence image) in tumors and kidneys of mice, and no significant differences were detected in the volumetric quantifications among measurement techniques. The imaging tridimensional reconstruction algorithm can be easily extrapolated to different 2D acquisition-type images. This characteristic flexibility of the algorithm developed in this study is a remarkable advantage in comparison to similar reconstruction methods.

Robustness of a multimodal piezoelectric damping involving the electrical analogue of a plate

NASA Astrophysics Data System (ADS)

Lossouarn, Boris; Cunefare, Kenneth A.; Aucejo, Mathieu; Deü, Jean-François

2016-04-01

Multimodal passive damping of a mechanical structure can be implemented by a coupling to a secondary structure exhibiting similar modal properties. When considering a piezoelectric coupling, the secondary structure is an electrical network. A suitable topology for such a network can be obtained by a finite difference formulation of the mechanical equations, followed by a direct electromechanical analogy. This procedure is applied to the Kirchhoff-Love theory in order to find the electrical analogue of a clamped plate. The passive electrical network is implemented with inductors, transformers and the inherent capacitance of the piezoelectric patches. The electrical resonances are tuned to approach those of several mechanical modes simultaneously. This yields a broadband reduction of the plate vibrations through the array of interconnected piezoelectric patches. The robustness of the control strategy is evaluated by introducing perturbations in the mechanical or electrical designs. A non-optimal tuning is considered by way of a uniform variation of the network inductance. Then, the effect of local or boundary modifications of the electromechanical system is observed experimentally. In the end, the use of an analogous electrical network appears as an efficient and robust solution for the multimodal control of a plate.

Divided multimodal attention sensory trace and context coding strategies in spatially congruent auditory and visual presentation.

PubMed

Kristjánsson, Tómas; Thorvaldsson, Tómas Páll; Kristjánsson, Arni

2014-01-01

Previous research involving both unimodal and multimodal studies suggests that single-response change detection is a capacity-free process while a discriminatory up or down identification is capacity-limited. The trace/context model assumes that this reflects different memory strategies rather than inherent differences between identification and detection. To perform such tasks, one of two strategies is used, a sensory trace or a context coding strategy, and if one is blocked, people will automatically use the other. A drawback to most preceding studies is that stimuli are presented at separate locations, creating the possibility of a spatial confound, which invites alternative interpretations of the results. We describe a series of experiments, investigating divided multimodal attention, without the spatial confound. The results challenge the trace/context model. Our critical experiment involved a gap before a change in volume and brightness, which according to the trace/context model blocks the sensory trace strategy, simultaneously with a roaming pedestal, which should block the context coding strategy. The results clearly show that people can use strategies other than sensory trace and context coding in the tasks and conditions of these experiments, necessitating changes to the trace/context model.

Large Margin Multi-Modal Multi-Task Feature Extraction for Image Classification.

PubMed

Yong Luo; Yonggang Wen; Dacheng Tao; Jie Gui; Chao Xu

2016-01-01

The features used in many image analysis-based applications are frequently of very high dimension. Feature extraction offers several advantages in high-dimensional cases, and many recent studies have used multi-task feature extraction approaches, which often outperform single-task feature extraction approaches. However, most of these methods are limited in that they only consider data represented by a single type of feature, even though features usually represent images from multiple modalities. We, therefore, propose a novel large margin multi-modal multi-task feature extraction (LM3FE) framework for handling multi-modal features for image classification. In particular, LM3FE simultaneously learns the feature extraction matrix for each modality and the modality combination coefficients. In this way, LM3FE not only handles correlated and noisy features, but also utilizes the complementarity of different modalities to further help reduce feature redundancy in each modality. The large margin principle employed also helps to extract strongly predictive features, so that they are more suitable for prediction (e.g., classification). An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging real-world image data sets demonstrate the effectiveness and superiority of the proposed method.

High-Resolution, Non-Invasive Imaging of Upper Vocal Tract Articulators Compatible with Human Brain Recordings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bouchard, Kristofer E.; Conant, David F.; Anumanchipalli, Gopala K.

A complete neurobiological understanding of speech motor control requires determination of the relationship between simultaneously recorded neural activity and the kinematics of the lips, jaw, tongue, and larynx. Many speech articulators are internal to the vocal tract, and therefore simultaneously tracking the kinematics of all articulators is nontrivial-especially in the context of human electrophysiology recordings. Here, we describe a noninvasive, multi-modal imaging system to monitor vocal tract kinematics, demonstrate this system in six speakers during production of nine American English vowels, and provide new analysis of such data. Classification and regression analysis revealed considerable variability in the articulator-to-acoustic relationship acrossmore » speakers. Non-negative matrix factorization extracted basis sets capturing vocal tract shapes allowing for higher vowel classification accuracy than traditional methods. Statistical speech synthesis generated speech from vocal tract measurements, and we demonstrate perceptual identification. We demonstrate the capacity to predict lip kinematics from ventral sensorimotor cortical activity. These results demonstrate a multi-modal system to non-invasively monitor articulator kinematics during speech production, describe novel analytic methods for relating kinematic data to speech acoustics, and provide the first decoding of speech kinematics from electrocorticography. These advances will be critical for understanding the cortical basis of speech production and the creation of vocal prosthetics.« less

High-Resolution, Non-Invasive Imaging of Upper Vocal Tract Articulators Compatible with Human Brain Recordings

PubMed Central

Anumanchipalli, Gopala K.; Dichter, Benjamin; Chaisanguanthum, Kris S.; Johnson, Keith; Chang, Edward F.

2016-01-01

A complete neurobiological understanding of speech motor control requires determination of the relationship between simultaneously recorded neural activity and the kinematics of the lips, jaw, tongue, and larynx. Many speech articulators are internal to the vocal tract, and therefore simultaneously tracking the kinematics of all articulators is nontrivial—especially in the context of human electrophysiology recordings. Here, we describe a noninvasive, multi-modal imaging system to monitor vocal tract kinematics, demonstrate this system in six speakers during production of nine American English vowels, and provide new analysis of such data. Classification and regression analysis revealed considerable variability in the articulator-to-acoustic relationship across speakers. Non-negative matrix factorization extracted basis sets capturing vocal tract shapes allowing for higher vowel classification accuracy than traditional methods. Statistical speech synthesis generated speech from vocal tract measurements, and we demonstrate perceptual identification. We demonstrate the capacity to predict lip kinematics from ventral sensorimotor cortical activity. These results demonstrate a multi-modal system to non-invasively monitor articulator kinematics during speech production, describe novel analytic methods for relating kinematic data to speech acoustics, and provide the first decoding of speech kinematics from electrocorticography. These advances will be critical for understanding the cortical basis of speech production and the creation of vocal prosthetics. PMID:27019106

Multiple foci of spatial attention in multimodal working memory.

PubMed

Katus, Tobias; Eimer, Martin

2016-11-15

The maintenance of sensory information in working memory (WM) is mediated by the attentional activation of stimulus representations that are stored in perceptual brain regions. Using event-related potentials (ERPs), we measured tactile and visual contralateral delay activity (tCDA/CDA components) in a bimodal WM task to concurrently track the attention-based maintenance of information stored in anatomically segregated (somatosensory and visual) brain areas. Participants received tactile and visual sample stimuli on both sides, and in different blocks, memorized these samples on the same side or on opposite sides. After a retention delay, memory was unpredictably tested for touch or vision. In the same side blocks, tCDA and CDA components simultaneously emerged over the same hemisphere, contralateral to the memorized tactile/visual sample set. In opposite side blocks, these two components emerged over different hemispheres, but had the same sizes and onset latencies as in the same side condition. Our results reveal distinct foci of tactile and visual spatial attention that were concurrently maintained on task-relevant stimulus representations in WM. The independence of spatially-specific biasing mechanisms for tactile and visual WM content suggests that multimodal information is stored in distributed perceptual brain areas that are activated through modality-specific processes that can operate simultaneously and largely independently of each other. Copyright © 2016 Elsevier Inc. All rights reserved.

Simultaneous ESI-APCI+ ionization and fragmentation pathways for nine benzodiazepines and zolpidem using single quadrupole LC-MS.

PubMed

Galaon, Toma; Vacaresteanu, Catalina; Anghel, Dan-Florin; David, Victor

2014-05-01

Nine important 1,4-benzodiazepines and zolpidem were characterized by liquid chromatography-mass spectrometry using a multimode ionization source able to generate ions using both electrospray ionization (ESI) and atmospheric pressure chemical ionization (APCI), and a single quadrupole mass analyzer. An optimum chromatographic separation was applied for all target compounds in less than 8 minutes using a Zorbax Eclipse Plus column (100 × 4.6 mm, 3.5 µm) kept at 35°C and a 0.3% HCOOH/ACN/IPA (61:34:5) mobile phase pumped at 1 ml/min. Optimization of LC-MS method generated low limit of quantitation (LOQ) values situated in the range 0.3-20.5 ng/ml. Comparison between differences in method sensitivity, under specified chromatographic conditions, when using ESI-only, APCI-only, and simultaneous ESI-APCI ionization with such a multimode source was discussed. Mixed ESI-APCI(+) mode proved to be the most sensitive ionization generating an average 35% detector response increase compared to ESI-only ionization and 350% detector response increase with respect to APCI-only ionization. Characterization of the nine benzodiazepines and zolpidem concerning their MS fragmentation pathway following 'in-source' collision-induced dissociation is discussed in detail and some general trends regarding these fragmentations are set. Copyright © 2013 John Wiley & Sons, Ltd.

High-Resolution, Non-Invasive Imaging of Upper Vocal Tract Articulators Compatible with Human Brain Recordings

DOE PAGES

Bouchard, Kristofer E.; Conant, David F.; Anumanchipalli, Gopala K.; ...

2016-03-28

A complete neurobiological understanding of speech motor control requires determination of the relationship between simultaneously recorded neural activity and the kinematics of the lips, jaw, tongue, and larynx. Many speech articulators are internal to the vocal tract, and therefore simultaneously tracking the kinematics of all articulators is nontrivial-especially in the context of human electrophysiology recordings. Here, we describe a noninvasive, multi-modal imaging system to monitor vocal tract kinematics, demonstrate this system in six speakers during production of nine American English vowels, and provide new analysis of such data. Classification and regression analysis revealed considerable variability in the articulator-to-acoustic relationship acrossmore » speakers. Non-negative matrix factorization extracted basis sets capturing vocal tract shapes allowing for higher vowel classification accuracy than traditional methods. Statistical speech synthesis generated speech from vocal tract measurements, and we demonstrate perceptual identification. We demonstrate the capacity to predict lip kinematics from ventral sensorimotor cortical activity. These results demonstrate a multi-modal system to non-invasively monitor articulator kinematics during speech production, describe novel analytic methods for relating kinematic data to speech acoustics, and provide the first decoding of speech kinematics from electrocorticography. These advances will be critical for understanding the cortical basis of speech production and the creation of vocal prosthetics.« less

Simultaneous determination of water-soluble vitamins in beverages and dietary supplements by LC-MS/MS.

PubMed

Kakitani, Ayano; Inoue, Tomonori; Matsumoto, Keiko; Watanabe, Jun; Nagatomi, Yasushi; Mochizuki, Naoki

2014-01-01

An LC-MS/MS method was developed for the simultaneous determination of 15 water-soluble vitamins that are widely used as additives in beverages and dietary supplements. This combined method involves the following simple pre-treatment procedures: dietary supplement samples were prepared by centrifugation and filtration after an extraction step, whereas beverage samples were diluted prior to injection. Chromatographic analysis in this method utilised a multi-mode ODS column, which provided reverse-phase, anion- and cation-exchange capacities, and therefore improved the retention of highly polar analytes such as water-soluble vitamins. Additionally, the multi-mode ODS column did not require adding ion pair reagents to the mobile phase. We optimised the chromatographic separation of 15 water-soluble vitamins by adjusting the mobile phase pH and the organic solvent. We also conducted an analysis of a NIST Standard Reference Material (SRM 3280 Multi-vitamin/Multi-element tablets) using this method to verify its accuracy. In addition, the method was applied to identify the vitamins in commercial beverages and dietary supplements. By comparing results with the label values and results obtained by official methods, it was concluded that the method could be used for quality control and to compose nutrition labels for vitamin-enriched products.

Adaptation to delayed auditory feedback induces the temporal recalibration effect in both speech perception and production.

PubMed

Yamamoto, Kosuke; Kawabata, Hideaki

2014-12-01

We ordinarily speak fluently, even though our perceptions of our own voices are disrupted by various environmental acoustic properties. The underlying mechanism of speech is supposed to monitor the temporal relationship between speech production and the perception of auditory feedback, as suggested by a reduction in speech fluency when the speaker is exposed to delayed auditory feedback (DAF). While many studies have reported that DAF influences speech motor processing, its relationship to the temporal tuning effect on multimodal integration, or temporal recalibration, remains unclear. We investigated whether the temporal aspects of both speech perception and production change due to adaptation to the delay between the motor sensation and the auditory feedback. This is a well-used method of inducing temporal recalibration. Participants continually read texts with specific DAF times in order to adapt to the delay. Then, they judged the simultaneity between the motor sensation and the vocal feedback. We measured the rates of speech with which participants read the texts in both the exposure and re-exposure phases. We found that exposure to DAF changed both the rate of speech and the simultaneity judgment, that is, participants' speech gained fluency. Although we also found that a delay of 200 ms appeared to be most effective in decreasing the rates of speech and shifting the distribution on the simultaneity judgment, there was no correlation between these measurements. These findings suggest that both speech motor production and multimodal perception are adaptive to temporal lag but are processed in distinct ways.

Expanding neurochemical investigations with multi-modal recording: simultaneous fast-scan cyclic voltammetry, iontophoresis, and patch clamp measurements.

PubMed

Kirkpatrick, D C; McKinney, C J; Manis, P B; Wightman, R M

2016-08-02

Multi-modal recording describes the simultaneous collection of information across distinct domains. Compared to isolated measurements, such studies can more easily determine relationships between varieties of phenomena. This is useful for neurochemical investigations which examine cellular activity in response to changes in the local chemical environment. In this study, we demonstrate a method to perform simultaneous patch clamp measurements with fast-scan cyclic voltammetry (FSCV) using optically isolated instrumentation. A model circuit simulating concurrent measurements was used to predict the electrical interference between instruments. No significant impact was anticipated between methods, and predictions were largely confirmed experimentally. One exception was due to capacitive coupling of the FSCV potential waveform into the patch clamp amplifier. However, capacitive transients measured in whole-cell current clamp recordings were well below the level of biological signals, which allowed the activity of cells to be easily determined. Next, the activity of medium spiny neurons (MSNs) was examined in the presence of an FSCV electrode to determine how the exogenous potential impacted nearby cells. The activities of both resting and active MSNs were unaffected by the FSCV waveform. Additionally, application of an iontophoretic current, used to locally deliver drugs and other neurochemicals, did not affect neighboring cells. Finally, MSN activity was monitored during iontophoretic delivery of glutamate, an excitatory neurotransmitter. Membrane depolarization and cell firing were observed concurrently with chemical changes around the cell resulting from delivery. In all, we show how combined electrophysiological and electrochemical measurements can relate information between domains and increase the power of neurochemical investigations.

Multimodal microscopy and the stepwise multi-photon activation fluorescence of melanin

NASA Astrophysics Data System (ADS)

Lai, Zhenhua

The author's work is divided into three aspects: multimodal microscopy, stepwise multi-photon activation fluorescence (SMPAF) of melanin, and customized-profile lenses (CPL) for on-axis laser scanners, which will be introduced respectively. A multimodal microscope provides the ability to image samples with multiple modalities on the same stage, which incorporates the benefits of all modalities. The multimodal microscopes developed in this dissertation are the Keck 3D fusion multimodal microscope 2.0 (3DFM 2.0), upgraded from the old 3DFM with improved performance and flexibility, and the multimodal microscope for targeting small particles (the "Target" system). The control systems developed for both microscopes are low-cost and easy-to-build, with all components off-the-shelf. The control system have not only significantly decreased the complexity and size of the microscope, but also increased the pixel resolution and flexibility. The SMPAF of melanin, activated by a continuous-wave (CW) mode near-infrared (NIR) laser, has potential applications for a low-cost and reliable method of detecting melanin. The photophysics of melanin SMPAF has been studied by theoretical analysis of the excitation process and investigation of the spectra, activation threshold, and photon number absorption of melanin SMPAF. SMPAF images of melanin in mouse hair and skin, mouse melanoma, and human black and white hairs are compared with images taken by conventional multi-photon fluorescence microscopy (MPFM) and confocal reflectance microscopy (CRM). SMPAF images significantly increase specificity and demonstrate the potential to increase sensitivity for melanin detection compared to MPFM images and CRM images. Employing melanin SMPAF imaging to detect melanin inside human skin in vivo has been demonstrated, which proves the effectiveness of melanin detection using SMPAF for medical purposes. Selective melanin ablation with micrometer resolution has been presented using the Target system. Compared to the traditional selective photothermolysis, this method demonstrates higher precision, higher specificity and deeper penetration. Therefore, the SMPAF guided selective ablation of melanin is a promising tool of removing melanin for both medical and cosmetic purposes. Three CPLs have been designed for low-cost linear-motion scanners, low-cost fast spinning scanners and high-precision fast spinning scanners. Each design has been tailored to the industrial manufacturing ability and market demands.

BNU-LSVED: a multimodal spontaneous expression database in educational environment

NASA Astrophysics Data System (ADS)

Sun, Bo; Wei, Qinglan; He, Jun; Yu, Lejun; Zhu, Xiaoming

2016-09-01

In the field of pedagogy or educational psychology, emotions are treated as very important factors, which are closely associated with cognitive processes. Hence, it is meaningful for teachers to analyze students' emotions in classrooms, thus adjusting their teaching activities and improving students ' individual development. To provide a benchmark for different expression recognition algorithms, a large collection of training and test data in classroom environment has become an acute problem that needs to be resolved. In this paper, we present a multimodal spontaneous database in real learning environment. To collect the data, students watched seven kinds of teaching videos and were simultaneously filmed by a camera. Trained coders made one of the five learning expression labels for each image sequence extracted from the captured videos. This subset consists of 554 multimodal spontaneous expression image sequences (22,160 frames) recorded in real classrooms. There are four main advantages in this database. 1) Due to recorded in the real classroom environment, viewer's distance from the camera and the lighting of the database varies considerably between image sequences. 2) All the data presented are natural spontaneous responses to teaching videos. 3) The multimodal database also contains nonverbal behavior including eye movement, head posture and gestures to infer a student ' s affective state during the courses. 4) In the video sequences, there are different kinds of temporal activation patterns. In addition, we have demonstrated the labels for the image sequences are in high reliability through Cronbach's alpha method.

A Multidimensional Approach to the Study of Emotion Recognition in Autism Spectrum Disorders

PubMed Central

Xavier, Jean; Vignaud, Violaine; Ruggiero, Rosa; Bodeau, Nicolas; Cohen, David; Chaby, Laurence

2015-01-01

Although deficits in emotion recognition have been widely reported in autism spectrum disorder (ASD), experiments have been restricted to either facial or vocal expressions. Here, we explored multimodal emotion processing in children with ASD (N = 19) and with typical development (TD, N = 19), considering uni (faces and voices) and multimodal (faces/voices simultaneously) stimuli and developmental comorbidities (neuro-visual, language and motor impairments). Compared to TD controls, children with ASD had rather high and heterogeneous emotion recognition scores but showed also several significant differences: lower emotion recognition scores for visual stimuli, for neutral emotion, and a greater number of saccades during visual task. Multivariate analyses showed that: (1) the difficulties they experienced with visual stimuli were partially alleviated with multimodal stimuli. (2) Developmental age was significantly associated with emotion recognition in TD children, whereas it was the case only for the multimodal task in children with ASD. (3) Language impairments tended to be associated with emotion recognition scores of ASD children in the auditory modality. Conversely, in the visual or bimodal (visuo-auditory) tasks, the impact of developmental coordination disorder or neuro-visual impairments was not found. We conclude that impaired emotion processing constitutes a dimension to explore in the field of ASD, as research has the potential to define more homogeneous subgroups and tailored interventions. However, it is clear that developmental age, the nature of the stimuli, and other developmental comorbidities must also be taken into account when studying this dimension. PMID:26733928

Method of multi-mode vibration control for the carbody of high-speed electric multiple unit trains

NASA Astrophysics Data System (ADS)

Gong, Dao; Zhou, Jinsong; Sun, Wenjing; Sun, Yu; Xia, Zhanghui

2017-11-01

A method of multi-mode vibration control for the carbody of high-speed electric multiple unit (EMU) trains by using the onboard and suspended equipments as dynamic vibration absorbers (DVAs) is proposed. The effect of the multi-mode vibration on the ride quality of a high-speed EMU train was studied, and the target modes of vibration control were determined. An equivalent mass identification method was used to determine the equivalent mass for the target modes at the device installation positions. To optimize the vibration acceleration response of the carbody, the natural frequencies and damping ratios of the lateral and vertical vibration were designed based on the theory of dynamic vibration absorption. In order to realize the optimized design values of the natural frequencies for the lateral and vertical vibrations simultaneously, a new type of vibration absorber was designed in which a belleville spring and conventional rubber parts are connected in parallel. This design utilizes the negative stiffness of the belleville spring. Results show that, as compared to rigid equipment connections, the proposed method effectively reduces the multi-mode vibration of a carbody in a high-speed EMU train, thereby achieving the control objectives. The ride quality in terms of the lateral and vertical vibration of the carbody is considerably improved. Moreover, the optimal value of the damping ratio is effective in dissipating the vibration energy, which reduces the vibration of both the carbody and the equipment.

Multimodal exercise intervention improves frontal cognitive functions and gait in Alzheimer's disease: a controlled trial.

PubMed

Coelho, Flávia Gomes de Melo; Andrade, Larissa Pires; Pedroso, Renata Valle; Santos-Galduroz, Ruth Ferreira; Gobbi, Sebastião; Costa, José Luiz Riani; Gobbi, Lilian Teresa Bucken

2013-01-01

The objective of the present study was to investigate the effect of a multimodal exercise intervention on frontal cognitive functions and kinematic gait parameters in patients with Alzheimer's disease. A sample of elderly patients with Alzheimer's disease (n=27) were assigned to a training group (n=14; aged 78.0±7.3 years) and a control group (n=13; aged 77.1±7.4 years). Multimodal exercise intervention includes motor activities and cognitive tasks simultaneously. The participants attended a 1-h session three times a week for 16 weeks, and the control participants maintained their regular daily activities during the same period. The frontal cognitive functions were evaluated using the Frontal Assessment Battery, the Clock Drawing Test and the Symbol Search Subtest. The kinematic parameters of gait-cadence, stride length and stride speed were analyzed under two conditions: (i) free gait (single task); and (ii) gait with frontal cognitive task (walking and counting down from 20--dual task). The patients in the intervention group significantly increased the scores in frontal cognitive variables, Frontal Assessment Battery (P<0.001) and Symbol Search Subtest (P<0.001) after the 16-week period. The control group decreased the scores in the Clock Drawing Test (P=0.001) and increased the number of counting errors during the dual task (P=0.008) after the same period. The multimodal exercise intervention improved the frontal cognitive functions in patients with Alzheimer's disease. © 2012 Japan Geriatrics Society.

Better together: Simultaneous presentation of speech and gesture in math instruction supports generalization and retention.

PubMed

Congdon, Eliza L; Novack, Miriam A; Brooks, Neon; Hemani-Lopez, Naureen; O'Keefe, Lucy; Goldin-Meadow, Susan

2017-08-01

When teachers gesture during instruction, children retain and generalize what they are taught (Goldin-Meadow, 2014). But why does gesture have such a powerful effect on learning? Previous research shows that children learn most from a math lesson when teachers present one problem-solving strategy in speech while simultaneously presenting a different, but complementary, strategy in gesture (Singer & Goldin-Meadow, 2005). One possibility is that gesture is powerful in this context because it presents information simultaneously with speech. Alternatively, gesture may be effective simply because it involves the body, in which case the timing of information presented in speech and gesture may be less important for learning. Here we find evidence for the importance of simultaneity: 3 rd grade children retain and generalize what they learn from a math lesson better when given instruction containing simultaneous speech and gesture than when given instruction containing sequential speech and gesture. Interpreting these results in the context of theories of multimodal learning, we find that gesture capitalizes on its synchrony with speech to promote learning that lasts and can be generalized.

Effects of urea on selectivity and protein-ligand interactions in multimodal cation exchange chromatography.

PubMed

Holstein, Melissa A; Parimal, Siddharth; McCallum, Scott A; Cramer, Steven M

2013-01-08

Nuclear magnetic resonance (NMR) and molecular dynamics (MD) simulations were employed in concert with chromatography to provide insight into the effect of urea on protein-ligand interactions in multimodal (MM) chromatography. Chromatographic experiments with a protein library in ion exchange (IEX) and MM systems indicated that, while urea had a significant effect on protein retention and selectivity for a range of proteins in MM systems, the effects were much less pronounced in IEX. NMR titration experiments carried out with a multimodal ligand, and isotopically enriched human ubiquitin indicated that, while the ligand binding face of ubiquitin remained largely intact in the presence of urea, the strength of binding was decreased. MD simulations were carried out to provide further insight into the effect of urea on MM ligand binding. These results indicated that, while the overall ligand binding face of ubiquitin remained the same, there was a reduction in the occupancy of the MM ligand interaction region along with subtle changes in the residues involved in these interactions. This work demonstrates the effectiveness of urea in enhancing selectivity in MM chromatographic systems and also provides an in-depth analysis of how MM ligand-protein interactions are altered in the presence of this fluid phase modifier.

A generative model for segmentation of tumor and organs-at-risk for radiation therapy planning of glioblastoma patients

NASA Astrophysics Data System (ADS)

Agn, Mikael; Law, Ian; Munck af Rosenschöld, Per; Van Leemput, Koen

2016-03-01

We present a fully automated generative method for simultaneous brain tumor and organs-at-risk segmentation in multi-modal magnetic resonance images. The method combines an existing whole-brain segmentation technique with a spatial tumor prior, which uses convolutional restricted Boltzmann machines to model tumor shape. The method is not tuned to any specific imaging protocol and can simultaneously segment the gross tumor volume, peritumoral edema and healthy tissue structures relevant for radiotherapy planning. We validate the method on a manually delineated clinical data set of glioblastoma patients by comparing segmentations of gross tumor volume, brainstem and hippocampus. The preliminary results demonstrate the feasibility of the method.

Wavevector multiplexed atomic quantum memory via spatially-resolved single-photon detection.

PubMed

Parniak, Michał; Dąbrowski, Michał; Mazelanik, Mateusz; Leszczyński, Adam; Lipka, Michał; Wasilewski, Wojciech

2017-12-15

Parallelized quantum information processing requires tailored quantum memories to simultaneously handle multiple photons. The spatial degree of freedom is a promising candidate to facilitate such photonic multiplexing. Using a single-photon resolving camera, we demonstrate a wavevector multiplexed quantum memory based on a cold atomic ensemble. Observation of nonclassical correlations between Raman scattered photons is confirmed by an average value of the second-order correlation function [Formula: see text] in 665 separated modes simultaneously. The proposed protocol utilizing the multimode memory along with the camera will facilitate generation of multi-photon states, which are a necessity in quantum-enhanced sensing technologies and as an input to photonic quantum circuits.

Stimulated Brillouin scattering in highly birefringent multimode tapered chalcogenide photonic crystal fiber for distributed optical sensors (Retraction Notice)

NASA Astrophysics Data System (ADS)

Baili, Amira; Cherif, Rim; Zghal, Mourad

2016-09-01

This paper, originally published on September 15, 2016, was retracted from the SPIE Digital Library on October 5, 2016, due to a high degree of similarity between specific portions of the text of the paper to the following publications: J. Tchahame, J. Beugnot, A. Kudlinski, and T. Sylvestre, "Multimode Brillouin spectrum in a long tapered birefringent photonic crystal fiber," Opt. Lett. 40, 4281-4284 (2015). doi: 10.1364/OL.40.004281 W. W. Ke, X. J. Wang and X. Tang, "Stimulated Brillouin Scattering Model in Multi-Mode Fiber Lasers," in IEEE Journal of Selected Topics in Quantum Electronics, vol. 20, no. 5, pp. 305-314, Sept.-Oct. 2014. doi: 10.1109/JSTQE.2014.2303256.

Entanglement and Wigner Function Negativity of Multimode Non-Gaussian States

NASA Astrophysics Data System (ADS)

Walschaers, Mattia; Fabre, Claude; Parigi, Valentina; Treps, Nicolas

2017-11-01

Non-Gaussian operations are essential to exploit the quantum advantages in optical continuous variable quantum information protocols. We focus on mode-selective photon addition and subtraction as experimentally promising processes to create multimode non-Gaussian states. Our approach is based on correlation functions, as is common in quantum statistical mechanics and condensed matter physics, mixed with quantum optics tools. We formulate an analytical expression of the Wigner function after the subtraction or addition of a single photon, for arbitrarily many modes. It is used to demonstrate entanglement properties specific to non-Gaussian states and also leads to a practical and elegant condition for Wigner function negativity. Finally, we analyze the potential of photon addition and subtraction for an experimentally generated multimode Gaussian state.

Entanglement and Wigner Function Negativity of Multimode Non-Gaussian States.

PubMed

Walschaers, Mattia; Fabre, Claude; Parigi, Valentina; Treps, Nicolas

2017-11-03

Non-Gaussian operations are essential to exploit the quantum advantages in optical continuous variable quantum information protocols. We focus on mode-selective photon addition and subtraction as experimentally promising processes to create multimode non-Gaussian states. Our approach is based on correlation functions, as is common in quantum statistical mechanics and condensed matter physics, mixed with quantum optics tools. We formulate an analytical expression of the Wigner function after the subtraction or addition of a single photon, for arbitrarily many modes. It is used to demonstrate entanglement properties specific to non-Gaussian states and also leads to a practical and elegant condition for Wigner function negativity. Finally, we analyze the potential of photon addition and subtraction for an experimentally generated multimode Gaussian state.

Sample-Poor Estimation of Order and Common Signal Subspace with Application to Fusion of Medical Imaging Data

PubMed Central

Levin-Schwartz, Yuri; Song, Yang; Schreier, Peter J.; Calhoun, Vince D.; Adalı, Tülay

2016-01-01

Due to their data-driven nature, multivariate methods such as canonical correlation analysis (CCA) have proven very useful for fusion of multimodal neurological data. However, being able to determine the degree of similarity between datasets and appropriate order selection are crucial to the success of such techniques. The standard methods for calculating the order of multimodal data focus only on sources with the greatest individual energy and ignore relations across datasets. Additionally, these techniques as well as the most widely-used methods for determining the degree of similarity between datasets assume sufficient sample support and are not effective in the sample-poor regime. In this paper, we propose to jointly estimate the degree of similarity between datasets and their order when few samples are present using principal component analysis and canonical correlation analysis (PCA-CCA). By considering these two problems simultaneously, we are able to minimize the assumptions placed on the data and achieve superior performance in the sample-poor regime compared to traditional techniques. We apply PCA-CCA to the pairwise combinations of functional magnetic resonance imaging (fMRI), structural magnetic resonance imaging (sMRI), and electroencephalogram (EEG) data drawn from patients with schizophrenia and healthy controls while performing an auditory oddball task. The PCA-CCA results indicate that the fMRI and sMRI datasets are the most similar, whereas the sMRI and EEG datasets share the least similarity. We also demonstrate that the degree of similarity obtained by PCA-CCA is highly predictive of the degree of significance found for components generated using CCA. PMID:27039696

Primary Pediatric Care Psychopharmacology: Focus on Medications for ADHD, Depression, and Anxiety.

PubMed

Strawn, Jeffrey R; Dobson, Eric T; Giles, Lisa L

2017-01-01

The evidence base for psychopharmacologic interventions in youth with depressive and anxiety disorders as well as attention/deficit hyperactivity disorder (ADHD) has dramatically increased over the past two decades. Psychopharmacologic interventions commonly utilized in the pediatric primary care setting-selective serotonin (norepinephrine) reuptake inhibitors (SSRIs/SSNRIs), stimulants and α 2 agonists-are reviewed. General pharmacologic principles are summarized along with class-related side effects and tolerability concerns (e.g., suicidality and activation in antidepressant-treated youth as well as insomnia, irritability, anorexia in stimulant-treated pediatric patients). Selected landmark trials of antidepressant medications in youth with depressive disorders [Treatment of Adolescent Depression Study (TADS) and the Treatment of SSRI-Resistant Depression Study (TADS)] and anxiety disorders [Child/Adolescent Anxiety Multimodal Study (CAMS) and Child/Adolescent Anxiety Multimodal Extended Long-term Study (CAMELS)] are described in addition to the Multimodal Treatment of ADHD Study. Finally, available data are presented that are related to prediction of treatment outcomes in youth with depressive disorders, anxiety disorders, and ADHD. Copyright © 2016 Mosby, Inc. All rights reserved.

How to select a chiropractor for the management of athletic conditions

PubMed Central

Hoskins, Wayne; Pollard, Henry; Garbutt, Peter

2009-01-01

Background Chiropractors are an integral part of the management of musculoskeletal injuries. A considerable communication gap between the chiropractic and medical professions exists. Subsequently referring allopathic practitioners lack confidence in picking a chiropractic practitioner with appropriate management strategies to adequately resolve sporting injuries. Subsequently, the question is often raised: "how do you find a good chiropractor?". Discussion Best practice guidelines are increasingly suggesting that musculoskeletal injuries should be managed with multimodal active and passive care strategies. Broadly speaking chiropractors may be subdivided into "modern multimodal" or "classical" (unimodal) in nature. The modern multimodal practitioner is better suited to managing sporting injuries by incorporating passive and active care management strategies to address three important phases of care in the continuum of injury from the acute inflammation/pain phase to the chronic/rehabilitation phase to the injury prevention phase. In contrast, the unimodal, manipulation only and typically spine only approach of the classical practitioner seems less suited to the challenges of the injured athlete. Identifying what part of the philosophical management spectrum a chiropractor falls is important as it is clearly not easily evident in most published material such as Yellow Pages advertisements. Summary Identifying a chiropractic practitioner who uses multimodal treatment of adequate duration, who incorporates active and passive components of therapy including exercise prescription whilst using medical terminology and diagnosis without mandatory x-rays or predetermined treatment schedules or prepaid contracts of care will likely result in selection of a chiropractor with the approach and philosophy suited to appropriately managing athletic conditions. Sporting organizations and associations should consider using similar criteria as a minimum standard to allow participation in health care team selections. PMID:19284539

How to select a chiropractor for the management of athletic conditions.

PubMed

Hoskins, Wayne; Pollard, Henry; Garbutt, Peter

2009-03-10

Chiropractors are an integral part of the management of musculoskeletal injuries. A considerable communication gap between the chiropractic and medical professions exists. Subsequently referring allopathic practitioners lack confidence in picking a chiropractic practitioner with appropriate management strategies to adequately resolve sporting injuries. Subsequently, the question is often raised: "how do you find a good chiropractor?". Best practice guidelines are increasingly suggesting that musculoskeletal injuries should be managed with multimodal active and passive care strategies. Broadly speaking chiropractors may be subdivided into "modern multimodal" or "classical" (unimodal) in nature. The modern multimodal practitioner is better suited to managing sporting injuries by incorporating passive and active care management strategies to address three important phases of care in the continuum of injury from the acute inflammation/pain phase to the chronic/rehabilitation phase to the injury prevention phase. In contrast, the unimodal, manipulation only and typically spine only approach of the classical practitioner seems less suited to the challenges of the injured athlete. Identifying what part of the philosophical management spectrum a chiropractor falls is important as it is clearly not easily evident in most published material such as Yellow Pages advertisements. Identifying a chiropractic practitioner who uses multimodal treatment of adequate duration, who incorporates active and passive components of therapy including exercise prescription whilst using medical terminology and diagnosis without mandatory x-rays or predetermined treatment schedules or prepaid contracts of care will likely result in selection of a chiropractor with the approach and philosophy suited to appropriately managing athletic conditions. Sporting organizations and associations should consider using similar criteria as a minimum standard to allow participation in health care team selections.

A novel multimode hybrid energy storage system and its energy management strategy for electric vehicles

NASA Astrophysics Data System (ADS)

Wang, Bin; Xu, Jun; Cao, Binggang; Zhou, Xuan

2015-05-01

This paper proposes a novel topology of multimode hybrid energy storage system (HESS) and its energy management strategy for electric vehicles (EVs). Compared to the conventional HESS, the proposed multimode HESS has more operating modes and thus it could in further enhance the efficiency of the system. The rule-based control strategy and the power-balancing strategy are developed for the energy management strategy to realize mode selection and power distribution. Generally, the DC-DC converter will operate at peak efficiency to convey the energy from the batteries to the UCs. Otherwise, the pure battery mode or the pure ultracapacitors (UCs) mode will be utilized without the DC-DC converter. To extend the battery life, the UCs have the highest priority to recycle the energy and the batteries are isolated from being recharged directly during regenerative braking. Simulations and experiments are established to validate the proposed multimode HESS and its energy management strategy. The results reveal that the energy losses in the DC-DC converter, the total energy consumption and the overall system efficiency of the proposed multimode HESS are improved compared to the conventional HESS.

Passively Q-switched dual-wavelength thulium-doped fiber laser based on a multimode interference filter and a semiconductor saturable absorber

NASA Astrophysics Data System (ADS)

Wang, M.; Huang, Y. J.; Ruan, S. C.

2018-04-01

In this paper, we have demonstrated a theta cavity passively Q-switched dual-wavelength fiber laser based on a multimode interference filter and a semiconductor saturable absorber. Relying on the properties of the fiber theta cavity, the laser can operate unidirectionally without an optical isolator. A semiconductor saturable absorber played the role of passive Q-switch while a section of single-mode-multimode-single-mode fiber structure served as an multimode interference filter and was used for selecting the lasing wavelengths. By suitably manipulating the polarization controller, stable dual-wavelength Q-switched operation was obtained at ~1946.8 nm and ~1983.8 nm with maximum output power and minimum pulse duration of ~47 mW and ~762.5 ns, respectively. The pulse repetition rate can be tuned from ~20.2 kHz to ~79.7 kHz by increasing the pump power from ~2.12 W to ~5.4 W.

Coherence properties of spontaneous parametric down-conversion pumped by a multi-mode cw diode laser.

PubMed

Kwon, Osung; Ra, Young-Sik; Kim, Yoon-Ho

2009-07-20

Coherence properties of the photon pair generated via spontaneous parametric down-conversion pumped by a multi-mode cw diode laser are studied with a Mach-Zehnder interferometer. Each photon of the pair enters a different input port of the interferometer and the biphoton coherence properties are studied with a two-photon detector placed at one output port. When the photon pair simultaneously enters the interferometer, periodic recurrence of the biphoton de Broglie wave packet is observed, closely resembling the coherence properties of the pump diode laser. With non-zero delays between the photons at the input ports, biphoton interference exhibits the same periodic recurrence but the wave packet shapes are shown to be dependent on both the input delay as well as the interferometer delay. These properties could be useful for building engineered entangled photon sources based on diode laser-pumped spontaneous parametric down-conversion.

Intrasubject multimodal groupwise registration with the conditional template entropy.

PubMed

Polfliet, Mathias; Klein, Stefan; Huizinga, Wyke; Paulides, Margarethus M; Niessen, Wiro J; Vandemeulebroucke, Jef

2018-05-01

Image registration is an important task in medical image analysis. Whereas most methods are designed for the registration of two images (pairwise registration), there is an increasing interest in simultaneously aligning more than two images using groupwise registration. Multimodal registration in a groupwise setting remains difficult, due to the lack of generally applicable similarity metrics. In this work, a novel similarity metric for such groupwise registration problems is proposed. The metric calculates the sum of the conditional entropy between each image in the group and a representative template image constructed iteratively using principal component analysis. The proposed metric is validated in extensive experiments on synthetic and intrasubject clinical image data. These experiments showed equivalent or improved registration accuracy compared to other state-of-the-art (dis)similarity metrics and improved transformation consistency compared to pairwise mutual information. Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

Temporal Multimode Storage of Entangled Photon Pairs

NASA Astrophysics Data System (ADS)

Tiranov, Alexey; Strassmann, Peter C.; Lavoie, Jonathan; Brunner, Nicolas; Huber, Marcus; Verma, Varun B.; Nam, Sae Woo; Mirin, Richard P.; Lita, Adriana E.; Marsili, Francesco; Afzelius, Mikael; Bussières, Félix; Gisin, Nicolas

2016-12-01

Multiplexed quantum memories capable of storing and processing entangled photons are essential for the development of quantum networks. In this context, we demonstrate and certify the simultaneous storage and retrieval of two entangled photons inside a solid-state quantum memory and measure a temporal multimode capacity of ten modes. This is achieved by producing two polarization-entangled pairs from parametric down-conversion and mapping one photon of each pair onto a rare-earth-ion-doped (REID) crystal using the atomic frequency comb (AFC) protocol. We develop a concept of indirect entanglement witnesses, which can be used as Schmidt number witnesses, and we use it to experimentally certify the presence of more than one entangled pair retrieved from the quantum memory. Our work puts forward REID-AFC as a platform compatible with temporal multiplexing of several entangled photon pairs along with a new entanglement certification method, useful for the characterization of multiplexed quantum memories.

Multiplexed electronically programmable multimode ionization detector for chromatography

DOEpatents

Wise, M.B.; Buchanan, M.V.

1988-05-19

Method and apparatus for detecting and differentiating organic compounds based on their electron affinity. An electron capture detector cell (ECD) is operated in a plurality of multiplexed electronically programmable operating modes to alter the detector response during a single sampling cycle to acquire multiple simultaneous chromatograms corresponding to each of the different operating modes. The cell is held at a constant subatmospheric pressure while the electron collection bias voltage applied to the cell is modulated electronically to allow acquisition of multiple chromatograms for a single sample elution from a chromatograph representing three distinctly different response modes. A system is provided which automatically controls the programmed application of bias pulses at different intervals and/or amplitudes to switch the detector from an ionization mode to the electron capture mode and various degrees therebetween to provide an improved means of tuning an ECD for multimode detection and improved specificity. 6 figs.

Multiplexed electronically programmable multimode ionization detector for chromatography

DOEpatents

Wise, Marcus B.; Buchanan, Michelle V.

1989-01-01

Method and apparatus for detecting and differentiating organic compounds based on their electron affinity. An electron capture detector cell (ECD) is operated in a plurality of multiplexed electroncially programmable operating modes to alter the detector response during a single sampling cycle to acquire multiple simultaneous chromatograms corresponding to each of the different operating modes. The cell is held at a constant subatmospheric pressure while the electron collection bias voltage applied to the cell is modulated electronically to allow acquisition of multiple chromatograms for a single sample elution from a chromatograph representing three distinctly different response modes. A system is provided which automatically controls the programmed application of bias pulses at different intervals and/or amplitudes to switch the detector from an ionization mode to the electron capture mode and various degrees therebetween to provide an improved means of tuning an ECD for multimode detection and improved specificity.

Fiber Fabry-Perot tip sensor based on multimode photonic crystal fiber

NASA Astrophysics Data System (ADS)

Wu, Di; Huang, Yu; Fu, Jian-Yu; Wang, Guo-Yin

2015-03-01

We propose a novel Fabry-Perot interferometer (FPI) sensor for simultaneous measurement of refractive index (RI) and temperature based on Fresnel reflection and the thermo-optic effect of silica. The sensor head consists of a short section of multimode photonic crystal fiber (MPCF) and a conventional single mode fiber (SMF), where two thin films are formed by collapsing the air holes of MPCF with a commercialized fusion splicer. Experimental results show that such a device has a linear RI sensitivity of ~21.52 dB/RIU (RI unit) and a linear optical path difference (OPD) temperature sensitivity of ~25 nm/°C. In addition, a high RI resolution of about ~1.7×10-5 is obtained by using the Fourier transformation to decompose the spectral response in different spatial frequencies. Low-cost, easy fabrication and high resolution make it appropriate for practical applications.

High spectral resolution lidar based on quad mach zehnder interferometer for aerosols and wind measurements on board space missions

NASA Astrophysics Data System (ADS)

Mariscal, Jean-François; Bruneau, Didier; Pelon, Jacques; Van Haecke, Mathilde; Blouzon, Frédéric; Montmessin, Franck; Chepfer, Hélène

2018-04-01

We present the measurement principle and the optical design of a Quad Mach Zehnder (QMZ) interferometer as HSRL technique, allowing simultaneous measurements of particle backscattering and wind velocity. Key features of this concept is to operate with a multimodal laser and do not require any frequency stabilization. These features are relevant especially for space applications for which high technical readiness level is required.

Brain PET and functional MRI: why simultaneously using hybrid PET/MR systems?

PubMed

Cecchin, Diego; Palombit, Alessandro; Castellaro, Marco; Silvestri, Erica; Bui, Franco; Barthel, Henryk; Sabri, Osama; Corbetta, Maurizio; Bertoldo, Alessandra

2017-12-01

In the last 20 years growing attention has been devoted to multimodal imaging. The recent literature is rich of clinical and research studies that have been performed using different imaging modalities on both separate and integrated positron emission tomography (PET) and magnetic resonance (MR) scanners. However, today, hybrid PET/MR systems measure signals related to brain structure, metabolism, neurochemistry, perfusion, and neuronal activity simultaneously, i.e. in the same physiological conditions. A frequently raised question at meeting and symposia is: "Do we really need a hybrid PET/MR system? Are there any advantages over acquiring sequential and separate PET and MR scans?" The present paper is an attempt to answer these questions specifically in relation to PET combined with functional magnetic resonance imaging (fMRI) and arterial spin labeling. We searched (last update: June 2017) the databases PubMed, PMC, Google Scholar and Medline. We also included additional studies if they were cited in the selected articles. No language restriction was applied to the search, but the reviewed articles were all in English. Among all the retrieved articles, we selected only those performed using a hybrid PET/MR system. We found a total of 17 papers that were selected and discussed in three main groups according to the main radiopharmaceutical used: 18F-fluorodeoxyglucose (18F-FDG) (N.=8), 15O-water (15O-H2O) (N.=3) and neuroreceptors (N.=6). Concerning studies using 18F-FDG, simultaneous PET/fMRI revealed that global aspects of functional organization (e.g. graph properties of functional connections) are partially associated with energy consumption. There are remarkable spatial and functional similarities across modalities, but also discrepant findings. More work is needed on this point. There are only a handful of papers comparing blood flow measurements with PET 15O-H2O and MR arterial spin label (ASL) measures, and they show significant regional CBF differences between these two modalities. However, at least in one study the correlation at the level of gray, white matter, and whole brain is rather good (r=0.94, 0.8, 0.81 respectively). Finally, receptor studies show that simultaneous PET/fMRI could be a useful tool to characterize functional connectivity along with dynamic neuroreceptor adaptation in several physiological (e.g. working memory) or pathological (e.g. pain) conditions, with or without drug administrations. The simultaneous acquisition of PET (using a number of radiotracers) and functional MRI (using a number of sequences) offers exciting opportunities that we are just beginning to explore. The results thus far are promising in the evaluation of cerebral metabolism/flow, neuroreceptor adaptation, and network's energetic demand.

Polymer Coated Echogenic Lipid Nanoparticles with Dual Release Triggers

PubMed Central

Nahire, Rahul; Haldar, Manas K.; Paul, Shirshendu; Mergoum, Anaas; Ambre, Avinash H.; Katti, Kalpana S.; Gange, Kara N.; Srivastava, D. K.; Sarkar, Kausik; Mallik, Sanku

2013-01-01

Although lipid nanoparticles are promising drug delivery vehicles, passive release of encapsulated contents at the target site is often slow. Herein, we report contents release from targeted, polymer coated, echogenic lipid nanoparticles in the cell cytoplasm by redox trigger and simultaneously enhanced by diagnostic frequency ultrasound. The lipid nanoparticles were polymerized on the external leaflet using a disulfide cross-linker. In the presence of cytosolic concentrations of glutathione, the lipid nanoparticles released 76% of encapsulated contents. Plasma concentrations of glutathione failed to release the encapsulated contents. Application of 3 MHz ultrasound for 2 minutes simultaneously with the reducing agent enhanced the release to 96%. Folic acid conjugated, doxorubicin loaded nanoparticles showed enhanced uptake and higher cytotoxicity in cancer cells overexpressing the folate receptor (compared to the control). With further developments, these lipid nanoparticles have the potential to be used as multimodal nanocarriers for simultaneous targeted drug delivery and ultrasound imaging. PMID:23394107

Combinatorial protein engineering of proteolytically resistant mesotrypsin inhibitors as candidates for cancer therapy.

PubMed

Cohen, Itay; Kayode, Olumide; Hockla, Alexandra; Sankaran, Banumathi; Radisky, Derek C; Radisky, Evette S; Papo, Niv

2016-05-15

Engineered protein therapeutics offer advantages, including strong target affinity, selectivity and low toxicity, but like natural proteins can be susceptible to proteolytic degradation, thereby limiting their effectiveness. A compelling therapeutic target is mesotrypsin, a protease up-regulated with tumour progression, associated with poor prognosis, and implicated in tumour growth and progression of many cancers. However, with its unique capability for cleavage and inactivation of proteinaceous inhibitors, mesotrypsin presents a formidable challenge to the development of biological inhibitors. We used a powerful yeast display platform for directed evolution, employing a novel multi-modal library screening strategy, to engineer the human amyloid precursor protein Kunitz protease inhibitor domain (APPI) simultaneously for increased proteolytic stability, stronger binding affinity and improved selectivity for mesotrypsin inhibition. We identified a triple mutant APPIM17G/I18F/F34V, with a mesotrypsin inhibition constant (Ki) of 89 pM, as the strongest mesotrypsin inhibitor yet reported; this variant displays 1459-fold improved affinity, up to 350 000-fold greater specificity and 83-fold improved proteolytic stability compared with wild-type APPI. We demonstrated that APPIM17G/I18F/F34V acts as a functional inhibitor in cell-based models of mesotrypsin-dependent prostate cancer cellular invasiveness. Additionally, by solving the crystal structure of the APPIM17G/I18F/F34V-mesotrypsin complex, we obtained new insights into the structural and mechanistic basis for improved binding and proteolytic resistance. Our study identifies a promising mesotrypsin inhibitor as a starting point for development of anticancer protein therapeutics and establishes proof-of-principle for a novel library screening approach that will be widely applicable for simultaneously evolving proteolytic stability in tandem with desired functionality for diverse protein scaffolds. © 2016 Authors; published by Portland Press Limited.

Development of ClearPEM-Sonic, a multimodal mammography system for PET and Ultrasound

NASA Astrophysics Data System (ADS)

Cucciati, G.; Auffray, E.; Bugalho, R.; Cao, L.; Di Vara, N.; Farina, F.; Felix, N.; Frisch, B.; Ghezzi, A.; Juhan, V.; Jun, D.; Lasaygues, P.; Lecoq, P.; Mensah, S.; Mundler, O.; Neves, J.; Paganoni, M.; Peter, J.; Pizzichemi, M.; Siles, P.; Silva, J. C.; Silva, R.; Tavernier, S.; Tessonnier, L.; Varela, J.

2014-03-01

ClearPEM-Sonic is an innovative imaging device specifically developed for breast cancer. The possibility to work in PEM-Ultrasound multimodality allows to obtain metabolic and morphological information increasing the specificity of the exam. The ClearPEM detector is developed to maximize the sensitivity and the spatial resolution as compared to Whole-Body PET scanners. It is coupled with a 3D ultrasound system, the SuperSonic Imagine Aixplorer that improves the specificity of the exam by providing a tissue elasticity map. This work describes the ClearPEM-Sonic project focusing on the technological developments it has required, the technical merits (and limits) and the first multimodal images acquired on a dedicated phantom. It finally presents selected clinical case studies that confirm the value of PEM information.

Frequency-domain photoacoustic and fluorescence microscopy: application on labeled and unlabeled cells

NASA Astrophysics Data System (ADS)

Langer, Gregor; Buchegger, Bianca; Jacak, Jaroslaw; Pfeffer, Karoline; Wohlfarth, Sven; Hannesschläger, Günther; Klar, Thomas A.; Berer, Thomas

2018-02-01

In this paper, multimodal optical-resolution frequency-domain photoacoustic and fluorescence scanning microscopy is presented on labeled and unlabeled cells. In many molecules, excited electrons relax radiatively and non-radiatively, leading to fluorescence and photoacoustic signals, respectively. Both signals can then be detected simultaneously. There also exist molecules, e.g. hemoglobin, which do not exhibit fluorescence, but provide photoacoustic signals solely. Other molecules, especially fluorescent dyes, preferentially exhibit fluorescence. The fluorescence quantum yield of a molecule and with it the strength of photoacoustic and fluorescence signals depends on the local environment, e.g. on the pH. Therefore, the local distribution of the simultaneously recorded photoacoustic and fluorescence signals may be used in order to obtain information about the local chemistry.

Simultaneous fast scanning XRF, dark field, phase-, and absorption contrast tomography

NASA Astrophysics Data System (ADS)

Medjoubi, Kadda; Bonissent, Alain; Leclercq, Nicolas; Langlois, Florent; Mercère, Pascal; Somogyi, Andrea

2013-09-01

Scanning hard X-ray nanoprobe imaging provides a unique tool for probing specimens with high sensitivity and large penetration depth. Moreover, the combination of complementary techniques such as X-ray fluorescence, absorption, phase contrast and dark field imaging gives complete quantitative information on the sample structure, composition and chemistry. The multi-technique "FLYSCAN" data acquisition scheme developed at Synchrotron SOLEIL permits to perform fast continuous scanning imaging and as such makes scanning tomography techniques feasible in a time-frame well-adapted to typical user experiments. Here we present the recent results of simultaneous fast scanning multi-technique tomography performed at Soleil. This fast scanning scheme will be implemented at the Nanoscopium beamline for large field of view 2D and 3D multimodal imaging.

Emotional sounds modulate early neural processing of emotional pictures

PubMed Central

Gerdes, Antje B. M.; Wieser, Matthias J.; Bublatzky, Florian; Kusay, Anita; Plichta, Michael M.; Alpers, Georg W.

2013-01-01

In our natural environment, emotional information is conveyed by converging visual and auditory information; multimodal integration is of utmost importance. In the laboratory, however, emotion researchers have mostly focused on the examination of unimodal stimuli. Few existing studies on multimodal emotion processing have focused on human communication such as the integration of facial and vocal expressions. Extending the concept of multimodality, the current study examines how the neural processing of emotional pictures is influenced by simultaneously presented sounds. Twenty pleasant, unpleasant, and neutral pictures of complex scenes were presented to 22 healthy participants. On the critical trials these pictures were paired with pleasant, unpleasant, and neutral sounds. Sound presentation started 500 ms before picture onset and each stimulus presentation lasted for 2 s. EEG was recorded from 64 channels and ERP analyses focused on the picture onset. In addition, valence and arousal ratings were obtained. Previous findings for the neural processing of emotional pictures were replicated. Specifically, unpleasant compared to neutral pictures were associated with an increased parietal P200 and a more pronounced centroparietal late positive potential (LPP), independent of the accompanying sound valence. For audiovisual stimulation, increased parietal P100 and P200 were found in response to all pictures which were accompanied by unpleasant or pleasant sounds compared to pictures with neutral sounds. Most importantly, incongruent audiovisual pairs of unpleasant pictures and pleasant sounds enhanced parietal P100 and P200 compared to pairings with congruent sounds. Taken together, the present findings indicate that emotional sounds modulate early stages of visual processing and, therefore, provide an avenue by which multimodal experience may enhance perception. PMID:24151476

Fluorine-18-labeled Gd3+/Yb3+/Er3+ co-doped NaYF4 nanophosphors for multimodality PET/MR/UCL imaging.

PubMed

Zhou, Jing; Yu, Mengxiao; Sun, Yun; Zhang, Xianzhong; Zhu, Xingjun; Wu, Zhanhong; Wu, Dongmei; Li, Fuyou

2011-02-01

Molecular imaging modalities provide a wealth of information that is highly complementary and rarely redundant. To combine the advantages of molecular imaging techniques, (18)F-labeled Gd(3+)/Yb(3+)/Er(3+) co-doped NaYF(4) nanophosphors (NPs) simultaneously possessing with radioactivity, magnetic, and upconversion luminescent properties have been fabricated for multimodality positron emission tomography (PET), magnetic resonance imaging (MRI), and laser scanning upconversion luminescence (UCL) imaging. Hydrophilic citrate-capped NaY(0.2)Gd(0.6)Yb(0.18)Er(0.02)F(4) nanophosphors (cit-NPs) were obtained from hydrophobic oleic acid (OA)-coated nanoparticles (OA-NPs) through a process of ligand exchange of OA with citrate, and were found to be monodisperse with an average size of 22 × 19 nm. The obtained hexagonal cit-NPs show intense UCL emission in the visible region and paramagnetic longitudinal relaxivity (r(1) = 0.405 s(-1)·(mM)(-1)). Through a facile inorganic reaction based on the strong binding between Y(3+) and F(-), (18)F-labeled NPs have been fabricated in high yield. The use of cit-NPs as a multimodal probe has been further explored for T(1)-weighted MR and PET imaging in vivo and UCL imaging of living cells and tissue slides. The results indicate that (18)F-labeled NaY(0.2)Gd(0.6)Yb(0.18)Er(0.02) is a potential candidate as a multimodal nanoprobe for ultra-sensitive molecular imaging from the cellular scale to whole-body evaluation. Copyright © 2010 Elsevier Ltd. All rights reserved.

Development of a multi-scale and multi-modality imaging system to characterize tumours and their microenvironment in vivo

NASA Astrophysics Data System (ADS)

Rouffiac, Valérie; Ser-Leroux, Karine; Dugon, Emilie; Leguerney, Ingrid; Polrot, Mélanie; Robin, Sandra; Salomé-Desnoulez, Sophie; Ginefri, Jean-Christophe; Sebrié, Catherine; Laplace-Builhé, Corinne

2015-03-01

In vivo high-resolution imaging of tumor development is possible through dorsal skinfold chamber implantable on mice model. However, current intravital imaging systems are weakly tolerated along time by mice and do not allow multimodality imaging. Our project aims to develop a new chamber for: 1- long-term micro/macroscopic visualization of tumor (vascular and cellular compartments) and tissue microenvironment; and 2- multimodality imaging (photonic, MRI and sonography). Our new experimental device was patented in March 2014 and was primarily assessed on 75 mouse engrafted with 4T1-Luc tumor cell line, and validated in confocal and multiphoton imaging after staining the mice vasculature using Dextran 155KDa-TRITC or Dextran 2000kDa-FITC. Simultaneously, a universal stage was designed for optimal removal of respiratory and cardiac artifacts during microscopy assays. Experimental results from optical, ultrasound (Bmode and pulse subtraction mode) and MRI imaging (anatomic sequences) showed that our patented design, unlike commercial devices, improves longitudinal monitoring over several weeks (35 days on average against 12 for the commercial chamber) and allows for a better characterization of the early and late tissue alterations due to tumour development. We also demonstrated the compatibility for multimodality imaging and the increase of mice survival was by a factor of 2.9, with our new skinfold chamber. Current developments include: 1- defining new procedures for multi-labelling of cells and tissue (screening of fluorescent molecules and imaging protocols); 2- developing ultrasound and MRI imaging procedures with specific probes; 3- correlating optical/ultrasound/MRI data for a complete mapping of tumour development and microenvironment.

Hybrid Core-Shell (HyCoS) Nanoparticles produced by Complex Coacervation for Multimodal Applications

NASA Astrophysics Data System (ADS)

Vecchione, D.; Grimaldi, A. M.; Forte, E.; Bevilacqua, Paolo; Netti, P. A.; Torino, E.

2017-03-01

Multimodal imaging probes can provide diagnostic information combining different imaging modalities. Nanoparticles (NPs) can contain two or more imaging tracers that allow several diagnostic techniques to be used simultaneously. In this work, a complex coacervation process to produce core-shell completely biocompatible polymeric nanoparticles (HyCoS) for multimodal imaging applications is described. Innovations on the traditional coacervation process are found in the control of the reaction temperature, allowing a speeding up of the reaction itself, and the production of a double-crosslinked system to improve the stability of the nanostructures in the presence of a clinically relevant contrast agent for MRI (Gd-DTPA). Through the control of the crosslinking behavior, an increase up to 6 times of the relaxometric properties of the Gd-DTPA is achieved. Furthermore, HyCoS can be loaded with a high amount of dye such as ATTO 633 or conjugated with a model dye such as FITC for in vivo optical imaging. The results show stable core-shell polymeric nanoparticles that can be used both for MRI and for optical applications allowing detection free from harmful radiation. Additionally, preliminary results about the possibility to trigger the release of a drug through a pH effect are reported.

Luminomagnetic Eu3+- and Dy3+-doped hydroxyapatite for multimodal imaging.

PubMed

Tesch, Annemarie; Wenisch, Christoph; Herrmann, Karl-Heinz; Reichenbach, Jürgen R; Warncke, Paul; Fischer, Dagmar; Müller, Frank A

2017-12-01

Multimodal imaging has recently attracted much attention due to the advantageous combination of different imaging modalities, like photoluminescence (PL) and magnetic resonance imaging (MRI). In the present study, luminescent and magnetic hydroxyapatites (HAp) were prepared via doping with europium (Eu 3+ ) and dysprosium (Dy 3+ ), respectively. Co-doping of Eu 3+ and Dy 3+ was used to combine the desired physical properties. Both lanthanide ions were successfully incorporated in the HAp crystal lattice, where they preferentially occupied calcium(I) sites. While Eu-doped HAp (Eu:HAp) exhibits dopant concentration dependent persistent PL properties, Dy-doped HAp (Dy:HAp) shows paramagnetic behavior due to the high magnetic moment of Dy 3+ . Co-doped HAp (Eu:Dy:HAp) nanoparticles combine both properties in one single crystal. Remarkably, multimodal co-doped HAp features enhanced PL properties due to an energy transfer from Dy 3+ sensitizer to Eu 3+ activator ions. Eu:Dy:HAp exhibits strong transverse relaxation effects with a maximum transverse relaxivity of 83.3L/(mmol·s). Due to their tunable PL, magnetic properties and cytocompatibility Eu:-, Dy:- and Eu:Dy:HAp represent promising biocompatible ceramic materials for luminescence imaging that simultaneously may serve as a contrast agent for MRI in permanent implants or functional coatings. Copyright © 2017 Elsevier B.V. All rights reserved.

Mixture-Tuned, Clutter Matched Filter for Remote Detection of Subpixel Spectral Signals

NASA Technical Reports Server (NTRS)

Thompson, David R.; Mandrake, Lukas; Green, Robert O.

2013-01-01

Mapping localized spectral features in large images demands sensitive and robust detection algorithms. Two aspects of large images that can harm matched-filter detection performance are addressed simultaneously. First, multimodal backgrounds may thwart the typical Gaussian model. Second, outlier features can trigger false detections from large projections onto the target vector. Two state-of-the-art approaches are combined that independently address outlier false positives and multimodal backgrounds. The background clustering models multimodal backgrounds, and the mixture tuned matched filter (MT-MF) addresses outliers. Combining the two methods captures significant additional performance benefits. The resulting mixture tuned clutter matched filter (MT-CMF) shows effective performance on simulated and airborne datasets. The classical MNF transform was applied, followed by k-means clustering. Then, each cluster s mean, covariance, and the corresponding eigenvalues were estimated. This yields a cluster-specific matched filter estimate as well as a cluster- specific feasibility score to flag outlier false positives. The technology described is a proof of concept that may be employed in future target detection and mapping applications for remote imaging spectrometers. It is of most direct relevance to JPL proposals for airborne and orbital hyperspectral instruments. Applications include subpixel target detection in hyperspectral scenes for military surveillance. Earth science applications include mineralogical mapping, species discrimination for ecosystem health monitoring, and land use classification.

PIRATE: pediatric imaging response assessment and targeting environment

NASA Astrophysics Data System (ADS)

Glenn, Russell; Zhang, Yong; Krasin, Matthew; Hua, Chiaho

2010-02-01

By combining the strengths of various imaging modalities, the multimodality imaging approach has potential to improve tumor staging, delineation of tumor boundaries, chemo-radiotherapy regime design, and treatment response assessment in cancer management. To address the urgent needs for efficient tools to analyze large-scale clinical trial data, we have developed an integrated multimodality, functional and anatomical imaging analysis software package for target definition and therapy response assessment in pediatric radiotherapy (RT) patients. Our software provides quantitative tools for automated image segmentation, region-of-interest (ROI) histogram analysis, spatial volume-of-interest (VOI) analysis, and voxel-wise correlation across modalities. To demonstrate the clinical applicability of this software, histogram analyses were performed on baseline and follow-up 18F-fluorodeoxyglucose (18F-FDG) PET images of nine patients with rhabdomyosarcoma enrolled in an institutional clinical trial at St. Jude Children's Research Hospital. In addition, we combined 18F-FDG PET, dynamic-contrast-enhanced (DCE) MR, and anatomical MR data to visualize the heterogeneity in tumor pathophysiology with the ultimate goal of adaptive targeting of regions with high tumor burden. Our software is able to simultaneously analyze multimodality images across multiple time points, which could greatly speed up the analysis of large-scale clinical trial data and validation of potential imaging biomarkers.

Rotational electrical impedance tomography using electrodes with limited surface coverage provides window for multimodal sensing

NASA Astrophysics Data System (ADS)

Lehti-Polojärvi, Mari; Koskela, Olli; Seppänen, Aku; Figueiras, Edite; Hyttinen, Jari

2018-02-01

Electrical impedance tomography (EIT) is an imaging method that could become a valuable tool in multimodal applications. One challenge in simultaneous multimodal imaging is that typically the EIT electrodes cover a large portion of the object surface. This paper investigates the feasibility of rotational EIT (rEIT) in applications where electrodes cover only a limited angle of the surface of the object. In the studied rEIT, the object is rotated a full 360° during a set of measurements to increase the information content of the data. We call this approach limited angle full revolution rEIT (LAFR-rEIT). We test LAFR-rEIT setups in two-dimensional geometries with computational and experimental data. We use up to 256 rotational measurement positions, which requires a new way to solve the forward and inverse problem of rEIT. For this, we provide a modification, available for EIDORS, in the supplementary material. The computational results demonstrate that LAFR-rEIT with eight electrodes produce the same image quality as conventional 16-electrode rEIT, when data from an adequate number of rotational measurement positions are used. Both computational and experimental results indicate that the novel LAFR-rEIT provides good EIT with setups with limited surface coverage and a small number of electrodes.

Ex vivo catheter-based imaging of coronary atherosclerosis using multimodality OCT and NIRAF excited at 633 nm

PubMed Central

Wang, Hao; Gardecki, Joseph A.; Ughi, Giovanni J.; Jacques, Paulino Vacas; Hamidi, Ehsan; Tearney, Guillermo J.

2015-01-01

While optical coherence tomography (OCT) has been shown to be capable of imaging coronary plaque microstructure, additional chemical/molecular information may be needed in order to determine which lesions are at risk of causing an acute coronary event. In this study, we used a recently developed imaging system and double-clad fiber (DCF) catheter capable of simultaneously acquiring both OCT and red excited near-infrared autofluorescence (NIRAF) images (excitation: 633 nm, emission: 680nm to 900nm). We found that NIRAF is elevated in lesions that contain necrotic core – a feature that is critical for vulnerable plaque diagnosis and that is not readily discriminated by OCT alone. We first utilized a DCF ball lens probe and a bench top setup to acquire en face NIRAF images of aortic plaques ex vivo (n = 20). In addition, we used the OCT-NIRAF system and fully assembled catheters to acquire multimodality images from human coronary arteries (n = 15) prosected from human cadaver hearts (n = 5). Comparison of these images with corresponding histology demonstrated that necrotic core plaques exhibited significantly higher NIRAF intensity than other plaque types. These results suggest that multimodality intracoronary OCT-NIRAF imaging technology may be used in the future to provide improved characterization of coronary artery disease in human patients. PMID:25909020

Improved multimodal biomarkers for Alzheimer's disease and mild cognitive impairment diagnosis: data from ADNI

NASA Astrophysics Data System (ADS)

Martinez-Torteya, Antonio; Treviño-Alvarado, Víctor; Tamez-Peña, José

2013-02-01

The accurate diagnosis of Alzheimer's disease (AD) and mild cognitive impairment (MCI) confers many clinical research and patient care benefits. Studies have shown that multimodal biomarkers provide better diagnosis accuracy of AD and MCI than unimodal biomarkers, but their construction has been based on traditional statistical approaches. The objective of this work was the creation of accurate AD and MCI diagnostic multimodal biomarkers using advanced bioinformatics tools. The biomarkers were created by exploring multimodal combinations of features using machine learning techniques. Data was obtained from the ADNI database. The baseline information (e.g. MRI analyses, PET analyses and laboratory essays) from AD, MCI and healthy control (HC) subjects with available diagnosis up to June 2012 was mined for case/controls candidates. The data mining yielded 47 HC, 83 MCI and 43 AD subjects for biomarker creation. Each subject was characterized by at least 980 ADNI features. A genetic algorithm feature selection strategy was used to obtain compact and accurate cross-validated nearest centroid biomarkers. The biomarkers achieved training classification accuracies of 0.983, 0.871 and 0.917 for HC vs. AD, HC vs. MCI and MCI vs. AD respectively. The constructed biomarkers were relatively compact: from 5 to 11 features. Those multimodal biomarkers included several widely accepted univariate biomarkers and novel image and biochemical features. Multimodal biomarkers constructed from previously and non-previously AD associated features showed improved diagnostic performance when compared to those based solely on previously AD associated features.

Confocal Rheology Probes the Structure and Mechanics of Collagen through the Sol-Gel Transition.

PubMed

Tran-Ba, Khanh-Hoa; Lee, Daniel J; Zhu, Jieling; Paeng, Keewook; Kaufman, Laura J

2017-10-17

Fibrillar type I collagen-based hydrogels are commonly used in tissue engineering and as matrices for biophysical studies. Mechanical and structural properties of these gels are known to be governed by the conditions under which fibrillogenesis occurs, exhibiting variation as a function of protein concentration, temperature, pH, and ionic strength. Deeper understanding of how macroscopic structure affects viscoelastic properties of collagen gels over the course of fibrillogenesis provides fundamental insight into biopolymer gel properties and promises enhanced control over the properties of such gels. Here, we investigate type I collagen fibrillogenesis using confocal rheology-simultaneous confocal reflectance microscopy, confocal fluorescence microscopy, and rheology. The multimodal approach allows direct comparison of how viscoelastic properties track the structural evolution of the gel on fiber and network length scales. Quantitative assessment and comparison of each imaging modality and the simultaneously collected rheological measurements show that the presence of a system-spanning structure occurs at a time similar to rheological determinants of gelation. Although this and some rheological measures are consistent with critical gelation through percolation, additional rheological and structural properties of the gel are found to be inconsistent with this theory. This study clarifies how structure sets viscoelasticity during collagen fibrillogenesis and more broadly highlights the utility of multimodal measurements as critical test-beds for theoretical descriptions of complex systems. Copyright © 2017 Biophysical Society. Published by Elsevier Inc. All rights reserved.

Improving Challenge/Skill Ratio in a Multimodal Interface by Simultaneously Adapting Game Difficulty and Haptic Assistance through Psychophysiological and Performance Feedback

PubMed Central

Rodriguez-Guerrero, Carlos; Knaepen, Kristel; Fraile-Marinero, Juan C.; Perez-Turiel, Javier; Gonzalez-de-Garibay, Valentin; Lefeber, Dirk

2017-01-01

In order to harmonize robotic devices with human beings, the robots should be able to perceive important psychosomatic impact triggered by emotional states such as frustration or boredom. This paper presents a new type of biocooperative control architecture, which acts toward improving the challenge/skill relation perceived by the user when interacting with a robotic multimodal interface in a cooperative scenario. In the first part of the paper, open-loop experiments revealed which physiological signals were optimal for inclusion in the feedback loop. These were heart rate, skin conductance level, and skin conductance response frequency. In the second part of the paper, the proposed controller, consisting of a biocooperative architecture with two degrees of freedom, simultaneously modulating game difficulty and haptic assistance through performance and psychophysiological feedback, is presented. With this setup, the perceived challenge can be modulated by means of the game difficulty and the perceived skill by means of the haptic assistance. A new metric (FlowIndex) is proposed to numerically quantify and visualize the challenge/skill relation. The results are contrasted with comparable previously published work and show that the new method afforded a higher FlowIndex (i.e., a superior challenge/skill relation) and an improved balance between augmented performance and user satisfaction (higher level of valence, i.e., a more enjoyable and satisfactory experience). PMID:28507503

Attenuation of cryocooler induced vibration using multimodal tuned dynamic absorbers

NASA Astrophysics Data System (ADS)

Veprik, Alexander; Babitsky, Vladimir; Tuito, Avi

2017-05-01

Modern infrared imagers often rely on split Stirling linear cryocoolers comprising compressor and expander, the relative position of which is governed by the optical design and packaging constraints. A force couple generated by imbalanced reciprocation of moving components inside both compressor and expander result in cryocooler induced vibration comprising angular and translational tonal components manifesting itself in the form of line of sight jitter and dynamic defocusing. Since linear cryocooler is usually driven at a fixed and precisely adjustable frequency, a tuned dynamic absorber is a well suited tool for vibration control. It is traditionally made in the form of lightweight single degree of freedom undamped mechanical resonator, the frequency of which is essentially matched with the driving frequency or vice versa. Unfortunately, the performance of such a traditional approach is limited in terms of simultaneous attenuating translational and angular components of cooler induced vibration. The authors are enhancing the traditional concept and consider multimodal tuned dynamic absorber made in the form of weakly damped mechanical resonator, where the frequencies of useful dynamic modes are essentially matched with the driving frequency. Dynamic analysis and experimental testing show that the dynamic reactions (forces and moments) produced by such a device may simultaneously attenuate both translational and angular components of cryocoolerinduced vibration. The authors are considering different embodiments and their suitability for different packaging concepts. The outcomes of theoretical predictions are supported by full scale experimentation.

Thermoresponsive core-shell magnetic nanoparticles for combined modalities of cancer therapy.

PubMed

Purushotham, S; Chang, P E J; Rumpel, H; Kee, I H C; Ng, R T H; Chow, P K H; Tan, C K; Ramanujan, R V

2009-07-29

Thermoresponsive polymer-coated magnetic nanoparticles loaded with anti-cancer drugs are of considerable interest for novel multi-modal cancer therapies. Such nanoparticles can be used for magnetic drug targeting followed by simultaneous hyperthermia and drug release. Gamma-Fe(2)O(3) iron oxide magnetic nanoparticles (MNP) with average sizes of 14, 19 and 43 nm were synthesized by high temperature decomposition. Composite magnetic nanoparticles (CNP) of 43 nm MNP coated with the thermoresponsive polymer poly-n-isopropylacrylamide (PNIPAM) were prepared by dispersion polymerization of n-isopropylacrylamide monomer in the presence of the MNP. In vitro drug release of doxorubicin-(dox) loaded dehydrated CNP at temperatures below and above the lower critical solution temperature of PNIPAM (34 degrees C) revealed a weak dependence of drug release on swelling behavior. The particles displayed Fickian diffusion release kinetics; the maximum dox release at 42 degrees C after 101 h was 41%. In vitro simultaneous hyperthermia and drug release of therapeutically relevant quantities of dox was achieved, 14.7% of loaded dox was released in 47 min at hyperthermia temperatures. In vivo magnetic targeting of dox-loaded CNP to hepatocellular carcinoma (HCC) in a buffalo rat model was studied by magnetic resonance imaging (MRI) and histology. In summary, the good in vitro and in vivo performance of the doxorubicin-loaded thermoresponsive polymer-coated magnetic nanoparticles suggests considerable promise for applications in multi-modal treatment of cancer.

Resonance-induced multimodal body-size distributions in ecosystems

PubMed Central

Lampert, Adam; Tlusty, Tsvi

2013-01-01

The size of an organism reflects its metabolic rate, growth rate, mortality, and other important characteristics; therefore, the distribution of body size is a major determinant of ecosystem structure and function. Body-size distributions often are multimodal, with several peaks of abundant sizes, and previous studies suggest that this is the outcome of niche separation: species from distinct peaks avoid competition by consuming different resources, which results in selection of different sizes in each niche. However, this cannot explain many ecosystems with several peaks competing over the same niche. Here, we suggest an alternative, generic mechanism underlying multimodal size distributions, by showing that the size-dependent tradeoff between reproduction and resource utilization entails an inherent resonance that may induce multiple peaks, all competing over the same niche. Our theory is well fitted to empirical data in various ecosystems, in which both model and measurements show a multimodal, periodically peaked distribution at larger sizes, followed by a smooth tail at smaller sizes. Moreover, we show a universal pattern of size distributions, manifested in the collapse of data from ecosystems of different scales: phytoplankton in a lake, metazoans in a stream, and arthropods in forests. The demonstrated resonance mechanism is generic, suggesting that multimodal distributions of numerous ecological characters emerge from the interplay between local competition and global migration. PMID:23248320

NaGdF4:Nd3+/Yb3+ Nanoparticles as Multimodal Imaging Agents

NASA Astrophysics Data System (ADS)

Pedraza, Francisco; Rightsell, Chris; Kumar, Ga; Giuliani, Jason; Monton, Car; Sardar, Dhiraj

Medical imaging is a fundamental tool used for the diagnosis of numerous ailments. Each imaging modality has unique advantages; however, they possess intrinsic limitations. Some of which include low spatial resolution, sensitivity, penetration depth, and radiation damage. To circumvent this problem, the combination of imaging modalities, or multimodal imaging, has been proposed, such as Near Infrared Fluorescence imaging (NIRF) and Magnetic Resonance Imaging (MRI). Combining individual advantages, specificity and selectivity of NIRF with the deep penetration and high spatial resolution of MRI, it is possible to circumvent their shortcomings for a more robust imaging technique. In addition, both imaging modalities are very safe and minimally invasive. Fluorescent nanoparticles, such as NaGdF4:Nd3 +/Yb3 +, are excellent candidates for NIRF/MRI multimodal imaging. The dopants, Nd and Yb, absorb and emit within the biological window; where near infrared light is less attenuated by soft tissue. This results in less tissue damage and deeper tissue penetration making it a viable candidate in biological imaging. In addition, the inclusion of Gd results in paramagnetic properties, allowing their use as contrast agents in multimodal imaging. The work presented will include crystallographic results, as well as full optical and magnetic characterization to determine the nanoparticle's viability in multimodal imaging.

Evaluation of a multimodal school-based depression and suicide prevention program among Dutch adolescents: design of a cluster-randomized controlled trial.

PubMed

Gijzen, Mandy W M; Creemers, Daan H M; Rasing, Sanne P A; Smit, Filip; Engels, Rutger C M E

2018-05-10

Since 2010, suicide has been the most important cause of mortality in youth aged 15 to 29 years in the Netherlands. Depression is an important risk factor for suicidal behaviors (i.e., suicide ideation, deliberate self-harm, planning, and suicide attempts) in adolescents. Adolescents who develop depressive symptoms, are also at risk for adult depression. This developmental continuity is especially noticeable in adolescents compared to other age groups; therefore, it is necessary to develop preventive strategies for teens. This study will test a multimodal school-based approach to suicide and depression prevention, which integrates universal and targeted approaches and includes various stakeholders (schools, adolescents, parents, and mental health professionals) simultaneously. We will perform a cluster randomized controlled trial (RCT) with an intervention and control condition to test the effectiveness of a school-based multimodal stepped-prevention program for depression and suicidal behaviors in adolescents. Adolescents in their second year of secondary education will participate in the study. The participants in the intervention condition will receive the entire multimodal stepped-preventive program comprising early screening and detection of suicidal behaviors and depressive symptoms, a safety net consisting of gatekeepers at school, followed by universal and indicated prevention. The participants in the control condition will undergo only the screening and the safety net of gatekeepers at schools. They will complete assessments at baseline, post-intervention, and 6, 12, and 24-month follow-up. Primary outcome will be suicidal behaviors measured at 12-months follow-up. Additionally, the present study will identify mechanisms that mediate and moderate the program effects and test the effect of the program on various secondary outcomes. If the school-based multimodal stepped-prevention program proves to be effective, it could be implemented in schools on a large scale. The study is registered in the Dutch Trial Register ( NTR6622 ).

Residual Shuffling Convolutional Neural Networks for Deep Semantic Image Segmentation Using Multi-Modal Data

NASA Astrophysics Data System (ADS)

Chen, K.; Weinmann, M.; Gao, X.; Yan, M.; Hinz, S.; Jutzi, B.; Weinmann, M.

2018-05-01

In this paper, we address the deep semantic segmentation of aerial imagery based on multi-modal data. Given multi-modal data composed of true orthophotos and the corresponding Digital Surface Models (DSMs), we extract a variety of hand-crafted radiometric and geometric features which are provided separately and in different combinations as input to a modern deep learning framework. The latter is represented by a Residual Shuffling Convolutional Neural Network (RSCNN) combining the characteristics of a Residual Network with the advantages of atrous convolution and a shuffling operator to achieve a dense semantic labeling. Via performance evaluation on a benchmark dataset, we analyze the value of different feature sets for the semantic segmentation task. The derived results reveal that the use of radiometric features yields better classification results than the use of geometric features for the considered dataset. Furthermore, the consideration of data on both modalities leads to an improvement of the classification results. However, the derived results also indicate that the use of all defined features is less favorable than the use of selected features. Consequently, data representations derived via feature extraction and feature selection techniques still provide a gain if used as the basis for deep semantic segmentation.

Multispectral scanning laser ophthalmoscopy combined with optical coherence tomography for simultaneous in vivo mouse retinal imaging

NASA Astrophysics Data System (ADS)

Zhang, Pengfei; Zam, Azhar; Jian, Yifan; Wang, Xinlei; Burns, Marie E.; Sarunic, Marinko V.; Pugh, Edward N.; Zawadzki, Robert J.

2015-03-01

A compact, non-invasive multi-modal system has been developed for in vivo mouse retina imaging. It is configured for simultaneously detecting green and red fluorescent protein signals with scanning laser ophthalmoscopy (SLO) back-scattered light from the SLO illumination beam, and depth information about different retinal layers by means of Optical Coherence Tomography (OCT). Simultaneous assessment of retinal characteristics with different modalities can provide a wealth of information about the structural and functional changes in the retinal neural tissue and chorio-retinal vasculature in vivo. Additionally, simultaneous acquisition of multiple channels facilitates analysis of the data of different modalities by automatic temporal and structural co-registration. As an example of the instrument's performance we imaged the retina of a mouse with constitutive expression of GFP in microglia cells (Cx3cr1GFP/+), and which also expressed the red fluorescent protein mCherry in Müller glial cells by means of adeno-associated virus delivery (AAV2) of an mCherry cDNA driven by the GFAP (glial fibrillary acid protein) promoter.

Parallel perceptual enhancement and hierarchic relevance evaluation in an audio-visual conjunction task.

PubMed

Potts, Geoffrey F; Wood, Susan M; Kothmann, Delia; Martin, Laura E

2008-10-21

Attention directs limited-capacity information processing resources to a subset of available perceptual representations. The mechanisms by which attention selects task-relevant representations for preferential processing are not fully known. Triesman and Gelade's [Triesman, A., Gelade, G., 1980. A feature integration theory of attention. Cognit. Psychol. 12, 97-136.] influential attention model posits that simple features are processed preattentively, in parallel, but that attention is required to serially conjoin multiple features into an object representation. Event-related potentials have provided evidence for this model showing parallel processing of perceptual features in the posterior Selection Negativity (SN) and serial, hierarchic processing of feature conjunctions in the Frontal Selection Positivity (FSP). Most prior studies have been done on conjunctions within one sensory modality while many real-world objects have multimodal features. It is not known if the same neural systems of posterior parallel processing of simple features and frontal serial processing of feature conjunctions seen within a sensory modality also operate on conjunctions between modalities. The current study used ERPs and simultaneously presented auditory and visual stimuli in three task conditions: Attend Auditory (auditory feature determines the target, visual features are irrelevant), Attend Visual (visual features relevant, auditory irrelevant), and Attend Conjunction (target defined by the co-occurrence of an auditory and a visual feature). In the Attend Conjunction condition when the auditory but not the visual feature was a target there was an SN over auditory cortex, when the visual but not auditory stimulus was a target there was an SN over visual cortex, and when both auditory and visual stimuli were targets (i.e. conjunction target) there were SNs over both auditory and visual cortex, indicating parallel processing of the simple features within each modality. In contrast, an FSP was present when either the visual only or both auditory and visual features were targets, but not when only the auditory stimulus was a target, indicating that the conjunction target determination was evaluated serially and hierarchically with visual information taking precedence. This indicates that the detection of a target defined by audio-visual conjunction is achieved via the same mechanism as within a single perceptual modality, through separate, parallel processing of the auditory and visual features and serial processing of the feature conjunction elements, rather than by evaluation of a fused multimodal percept.

Effective multimodality treatment for advanced epidermoid carcinoma of the female genital tract

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kalra, J.; Cortes, E.; Chen, S.

1985-07-01

Fifteen patients with advanced or recurrent squamous-cell carcinoma of the cervix, vulva, vagina, and urethra were treated with simultaneous combination chemotherapy (5-fluorouracil infusion and mitomycin C) and radiotherapy (3,000 rad for a period of three weeks). Three to four weeks after completion of radiotherapy, 13 of 15 patients achieved partial or complete tumor shrinkage. Nine of 15 patients are alive, eight of whom (at a median follow-up time of 24 months) have no evidence of disease. The longest survival time was 45 + months. There was minimal toxicity associated with this therapy. The results of this pilot study suggest thatmore » the simultaneous administration of radiation and chemotherapy is an effective method of treatment of advanced female genital tract carcinoma.« less

Transportation Safety Information Report : 1988 annual summary

DOT National Transportation Integrated Search

1989-12-01

The Report is a compendium of selected national-level transportation safety statistics for all modes of transportation and for multimodal transportation of hazardous materials. The report presents and compares data for transportation fatalities, acci...

Multimodal processing of emotional information in 9-month-old infants I: emotional faces and voices.

PubMed

Otte, R A; Donkers, F C L; Braeken, M A K A; Van den Bergh, B R H

2015-04-01

Making sense of emotions manifesting in human voice is an important social skill which is influenced by emotions in other modalities, such as that of the corresponding face. Although processing emotional information from voices and faces simultaneously has been studied in adults, little is known about the neural mechanisms underlying the development of this ability in infancy. Here we investigated multimodal processing of fearful and happy face/voice pairs using event-related potential (ERP) measures in a group of 84 9-month-olds. Infants were presented with emotional vocalisations (fearful/happy) preceded by the same or a different facial expression (fearful/happy). The ERP data revealed that the processing of emotional information appearing in human voice was modulated by the emotional expression appearing on the corresponding face: Infants responded with larger auditory ERPs after fearful compared to happy facial primes. This finding suggests that infants dedicate more processing capacities to potentially threatening than to non-threatening stimuli. Copyright © 2014 Elsevier Inc. All rights reserved.

Folic acid-targeted magnetic Tb-doped CeF3 fluorescent nanoparticles as bimodal probes for cellular fluorescence and magnetic resonance imaging.

PubMed

Ma, Zhi-Ya; Liu, Yu-Ping; Bai, Ling-Yu; An, Jie; Zhang, Lin; Xuan, Yang; Zhang, Xiao-Shuai; Zhao, Yuan-Di

2015-10-07

Magnetic fluorescent nanoparticles (NPs) have great potential applications for diagnostics, imaging and therapy. We developed a facile polyol method to synthesize multifunctional Fe3O4@CeF3:Tb@CeF3 NPs with small size (<20 nm), high water solubility and good biocompatibility. The NPs were modified by ligand exchange reactions with citric acid (CA) to obtain carboxyl-functionalized NPs (Fe3O4@CeF3:Tb@CeF3-COOH). Folic acid (FA) as an affinity ligand was then covalently conjugated onto NPs to yield Fe3O4@CeF3:Tb@CeF3-FA NPs. They were then applied as multimodal imaging agents for simultaneous in vitro targeted fluorescence imaging and magnetic resonance imaging (MRI) of HeLa cells with overexpressed folate receptors (FR). The results indicated that these NPs had strong luminescence and enhanced T2-weighted MR contrast and would be promising candidates as multimodal probes for both fluorescence and MRI imaging.

Multimodal discrimination of immune cells using a combination of Raman spectroscopy and digital holographic microscopy

NASA Astrophysics Data System (ADS)

McReynolds, Naomi; Cooke, Fiona G. M.; Chen, Mingzhou; Powis, Simon J.; Dholakia, Kishan

2017-03-01

The ability to identify and characterise individual cells of the immune system under label-free conditions would be a significant advantage in biomedical and clinical studies where untouched and unmodified cells are required. We present a multi-modal system capable of simultaneously acquiring both single point Raman spectra and digital holographic images of single cells. We use this combined approach to identify and discriminate between immune cell populations CD4+ T cells, B cells and monocytes. We investigate several approaches to interpret the phase images including signal intensity histograms and texture analysis. Both modalities are independently able to discriminate between cell subsets and dual-modality may therefore be used a means for validation. We demonstrate here sensitivities achieved in the range of 86.8% to 100%, and specificities in the range of 85.4% to 100%. Additionally each modality provides information not available from the other providing both a molecular and a morphological signature of each cell.

Predictive assessment of kidney functional recovery following ischemic injury using optical spectroscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Raman, Rajesh N.; Pivetti, Christopher D.; Ramsamooj, Rajendra

Functional changes in rat kidneys during the induced ischemic injury and recovery phases were explored using multimodal autofluorescence and light scattering imaging. We aim to evaluate the use of noncontact optical signatures for rapid assessment of tissue function and viability. Specifically, autofluorescence images were acquired in vivo under 355, 325, and 266 nm illumination while light scattering images were collected at the excitation wavelengths as well as using relatively narrowband light centered at 500 nm. The images were simultaneously recorded using a multimodal optical imaging system. We also analyzed to obtain time constants, which were correlated to kidney dysfunction asmore » determined by a subsequent survival study and histopathological analysis. This analysis of both the light scattering and autofluorescence images suggests that changes in tissue microstructure, fluorophore emission, and blood absorption spectral characteristics, coupled with vascular response, contribute to the behavior of the observed signal, which may be used to obtain tissue functional information and offer the ability to predict posttransplant kidney function.« less

Computer-aided, multi-modal, and compression diffuse optical studies of breast tissue

NASA Astrophysics Data System (ADS)

Busch, David Richard, Jr.

Diffuse Optical Tomography and Spectroscopy permit measurement of important physiological parameters non-invasively through ˜10 cm of tissue. I have applied these techniques in measurements of human breast and breast cancer. My thesis integrates three loosely connected themes in this context: multi-modal breast cancer imaging, automated data analysis of breast cancer images, and microvascular hemodynamics of breast under compression. As per the first theme, I describe construction, testing, and the initial clinical usage of two generations of imaging systems for simultaneous diffuse optical and magnetic resonance imaging. The second project develops a statistical analysis of optical breast data from many spatial locations in a population of cancers to derive a novel optical signature of malignancy; I then apply this data-derived signature for localization of cancer in additional subjects. Finally, I construct and deploy diffuse optical instrumentation to measure blood content and blood flow during breast compression; besides optics, this research has implications for any method employing breast compression, e.g., mammography.

A Multimode Optical Imaging System for Preclinical Applications In Vivo: Technology Development, Multiscale Imaging, and Chemotherapy Assessment

PubMed Central

Hwang, Jae Youn; Wachsmann-Hogiu, Sebastian; Ramanujan, V. Krishnan; Ljubimova, Julia; Gross, Zeev; Gray, Harry B.; Medina-Kauwe, Lali K.; Farkas, Daniel L.

2012-01-01

Purpose Several established optical imaging approaches have been applied, usually in isolation, to preclinical studies; however, truly useful in vivo imaging may require a simultaneous combination of imaging modalities to examine dynamic characteristics of cells and tissues. We developed a new multimode optical imaging system designed to be application-versatile, yielding high sensitivity, and specificity molecular imaging. Procedures We integrated several optical imaging technologies, including fluorescence intensity, spectral, lifetime, intravital confocal, two-photon excitation, and bioluminescence, into a single system that enables functional multiscale imaging in animal models. Results The approach offers a comprehensive imaging platform for kinetic, quantitative, and environmental analysis of highly relevant information, with micro-to-macroscopic resolution. Applied to small animals in vivo, this provides superior monitoring of processes of interest, represented here by chemo-/nanoconstruct therapy assessment. Conclusions This new system is versatile and can be optimized for various applications, of which cancer detection and targeted treatment are emphasized here. PMID:21874388

Separating Bulk and Surface Contributions to Electronic Excited-State Processes in Hybrid Mixed Perovskite Thin Films via Multimodal All-Optical Imaging.

PubMed

Simpson, Mary Jane; Doughty, Benjamin; Das, Sanjib; Xiao, Kai; Ma, Ying-Zhong

2017-07-20

A comprehensive understanding of electronic excited-state phenomena underlying the impressive performance of solution-processed hybrid halide perovskite solar cells requires access to both spatially resolved electronic processes and corresponding sample morphological characteristics. Here, we demonstrate an all-optical multimodal imaging approach that enables us to obtain both electronic excited-state and morphological information on a single optical microscope platform with simultaneous high temporal and spatial resolution. Specifically, images were acquired for the same region of interest in thin films of chloride containing mixed lead halide perovskites (CH 3 NH 3 PbI 3-x Cl x ) using femtosecond transient absorption, time-integrated photoluminescence, confocal reflectance, and transmission microscopies. Comprehensive image analysis revealed the presence of surface- and bulk-dominated contributions to the various images, which describe either spatially dependent electronic excited-state properties or morphological variations across the probed region of the thin films. These results show that PL probes effectively the species near or at the film surface.

Predictive assessment of kidney functional recovery following ischemic injury using optical spectroscopy

DOE PAGES

Raman, Rajesh N.; Pivetti, Christopher D.; Ramsamooj, Rajendra; ...

2017-05-03

Functional changes in rat kidneys during the induced ischemic injury and recovery phases were explored using multimodal autofluorescence and light scattering imaging. We aim to evaluate the use of noncontact optical signatures for rapid assessment of tissue function and viability. Specifically, autofluorescence images were acquired in vivo under 355, 325, and 266 nm illumination while light scattering images were collected at the excitation wavelengths as well as using relatively narrowband light centered at 500 nm. The images were simultaneously recorded using a multimodal optical imaging system. We also analyzed to obtain time constants, which were correlated to kidney dysfunction asmore » determined by a subsequent survival study and histopathological analysis. This analysis of both the light scattering and autofluorescence images suggests that changes in tissue microstructure, fluorophore emission, and blood absorption spectral characteristics, coupled with vascular response, contribute to the behavior of the observed signal, which may be used to obtain tissue functional information and offer the ability to predict posttransplant kidney function.« less

Ions doped melanin nanoparticle as a multiple imaging agent.

PubMed

Ha, Shin-Woo; Cho, Hee-Sang; Yoon, Young Il; Jang, Moon-Sun; Hong, Kwan Soo; Hui, Emmanuel; Lee, Jung Hee; Yoon, Tae-Jong

2017-10-10

Multimodal nanomaterials are useful for providing enhanced diagnostic information simultaneously for a variety of in vivo imaging methods. According to our research findings, these multimodal nanomaterials offer promising applications for cancer therapy. Melanin nanoparticles can be used as a platform imaging material and they can be simply produced by complexation with various imaging active ions. They are capable of specifically targeting epidermal growth factor receptor (EGFR)-expressing cancer cells by being anchored with a specific antibody. Ion-doped melanin nanoparticles were found to have high bioavailability with long-term stability in solution, without any cytotoxicity in both in vitro and in vivo systems. By combining different imaging modalities with melanin particles, we can use the complexes to obtain faster diagnoses by computed tomography deep-body imaging and greater detailed pathological diagnostic information by magnetic resonance imaging. The ion-doped melanin nanoparticles also have applications for radio-diagnostic treatment and radio imaging-guided surgery, warranting further proof of concept experimental.

A multimodal logistics service network design with time windows and environmental concerns

PubMed Central

Zhang, Dezhi; He, Runzhong; Wang, Zhongwei

2017-01-01

The design of a multimodal logistics service network with customer service time windows and environmental costs is an important and challenging issue. Accordingly, this work established a model to minimize the total cost of multimodal logistics service network design with time windows and environmental concerns. The proposed model incorporates CO2 emission costs to determine the optimal transportation mode combinations and investment selections for transfer nodes, which consider transport cost, transport time, carbon emission, and logistics service time window constraints. Furthermore, genetic and heuristic algorithms are proposed to set up the abovementioned optimal model. A numerical example is provided to validate the model and the abovementioned two algorithms. Then, comparisons of the performance of the two algorithms are provided. Finally, this work investigates the effects of the logistics service time windows and CO2 emission taxes on the optimal solution. Several important management insights are obtained. PMID:28934272

A multimodal logistics service network design with time windows and environmental concerns.

PubMed

Zhang, Dezhi; He, Runzhong; Li, Shuangyan; Wang, Zhongwei

2017-01-01

The design of a multimodal logistics service network with customer service time windows and environmental costs is an important and challenging issue. Accordingly, this work established a model to minimize the total cost of multimodal logistics service network design with time windows and environmental concerns. The proposed model incorporates CO2 emission costs to determine the optimal transportation mode combinations and investment selections for transfer nodes, which consider transport cost, transport time, carbon emission, and logistics service time window constraints. Furthermore, genetic and heuristic algorithms are proposed to set up the abovementioned optimal model. A numerical example is provided to validate the model and the abovementioned two algorithms. Then, comparisons of the performance of the two algorithms are provided. Finally, this work investigates the effects of the logistics service time windows and CO2 emission taxes on the optimal solution. Several important management insights are obtained.

Tunable dual-wavelength fiber laser based on an MMI filter in a cascaded Sagnac loop interferometer

NASA Astrophysics Data System (ADS)

Ma, Lin; Kang, Zexin; Qi, Yanhui; Jian, Shuisheng

2014-04-01

A widely tunable dual-wavelength erbium-doped fiber laser based on a cascaded Sagnac loop interferometer incorporating a multimode interference filter is proposed and experimentally demonstrated in this paper. The mode selection is implemented by using the cascaded Sagnac loop interferometer with two segments of polarization maintaining fibers, and the wavelength tuning was achieved by using the refractive index characteristic of multimode interference effects. The tunable dual-wavelength fiber laser has a wavelength tuning of about 40 nm with a signal-to-noise ratio of more than 50 dB.

Day-case surgery for total hip and knee replacement: How safe and effective is it?

PubMed

Lazic, Stefan; Boughton, Oliver; Kellett, Catherine F; Kader, Deiary F; Villet, Loïc; Rivière, Charles

2018-04-01

Multimodal protocols for pain control, blood loss management and thromboprophylaxis have been shown to benefit patients by being more effective and as safe (fewer iatrogenic complications) as conventional protocols.Proper patient selection and education, multimodal protocols and a well-defined clinical pathway are all key for successful day-case arthroplasty.By potentially being more effective, cheaper than and as safe as inpatient arthroplasty, day-case arthroplasty might be beneficial for patients and healthcare systems. Cite this article: EFORT Open Rev 2018;3:130-135. DOI: 10.1302/2058-5241.3.170031.

Investigation of photoplethysmographic signals and blood oxygen saturation values on healthy volunteers during cuff-induced hypoperfusion using a multimode PPG/SpO₂ sensor.

PubMed

Shafique, M; Kyriacou, P A; Pal, S K

2012-06-01

Photoplethysmography (PPG) is a technique widely used to monitor volumetric blood changes induced by cardiac pulsations. Pulse oximetry uses the technique of PPG to estimate arterial oxygen saturation values (SpO₂). In poorly perfused tissues, SpO₂ readings may be compromised due to the poor quality of the PPG signals. A multimode finger PPG probe that operates simultaneously in reflectance, transmittance and a combined mode called "transreflectance" was developed, in an effort to improve the quality of the PPG signals in states of hypoperfusion. Experiments on 20 volunteers were conducted to evaluate the performance of the multimode PPG sensor and compare the results with a commercial transmittance pulse oximeter. A brachial blood pressure cuff was used to induce artificial hypoperfusion. Results showed that the amplitude of the transreflectance AC PPG signals were significantly different (p < 0.05) than the AC PPG signals obtained from the other two conventional PPG sensors (reflectance and transmittance). At induced brachial pressures between 90 and 135 mmHg, the reflectance finger pulse oximeter failed 25 times (failure rate 42.2 %) to estimate SpO₂ values, whereas the transmittance pulse oximeter failed 8 times (failure rate 15.5 %). The transreflectance pulse oximeter failed only 3 times (failure rate 6.8 %) and the commercial pulse oximeter failed 17 times (failure rate 29.4 %).

vECTlab—A fully integrated multi-modality Monte Carlo simulation framework for the radiological imaging sciences

NASA Astrophysics Data System (ADS)

Peter, Jörg; Semmler, Wolfhard

2007-10-01

Alongside and in part motivated by recent advances in molecular diagnostics, the development of dual-modality instruments for patient and dedicated small animal imaging has gained attention by diverse research groups. The desire for such systems is high not only to link molecular or functional information with the anatomical structures, but also for detecting multiple molecular events simultaneously at shorter total acquisition times. While PET and SPECT have been integrated successfully with X-ray CT, the advance of optical imaging approaches (OT) and the integration thereof into existing modalities carry a high application potential, particularly for imaging small animals. A multi-modality Monte Carlo (MC) simulation approach at present has been developed that is able to trace high-energy (keV) as well as optical (eV) photons concurrently within identical phantom representation models. We show that the involved two approaches for ray-tracing keV and eV photons can be integrated into a unique simulation framework which enables both photon classes to be propagated through various geometry models representing both phantoms and scanners. The main advantage of such integrated framework for our specific application is the investigation of novel tomographic multi-modality instrumentation intended for in vivo small animal imaging through time-resolved MC simulation upon identical phantom geometries. Design examples are provided for recently proposed SPECT-OT and PET-OT imaging systems.

Biomedical applications of magneto-plasmonic nanoclusters (Conference Presentation)

NASA Astrophysics Data System (ADS)

Sokolov, Konstantin V.; Wu, Chun-Hsien; Cook, Jason; Zal, Tomasz; Emelianov, Stanislav

2016-03-01

Perhaps one of the most intriguing aspects of nanotechnology is the ability to create multimodal and multifunctional nanostructures that can open new venues in solving challenging biomedical problems. Here, we present multimodal magneto-plasmonic nanoparticles (MPNs) with a strong red-NIR absorbance, superparamagnetic properties and a high magnetic moment in an external magnetic field. Our design is based on self-assembly of 6 nm primary particles which consist of 5 nm diameter iron-oxide cores coated with a very thin ca. 0.5 nm gold shell. The assembly results in spherical highly uniform MPNs. We developed antibody targeted MPNs to address two highly challenging applications: (i) development of real-time assays for capture, enumeration and characterization of circulating tumor cells (CTCs), and (ii) enhancement of adoptive cell immunotherapy (ACT). Our results showed that MPNs can be used for simultaneous magnetic capture and photoacoustic (PA) detection of cancer cells in whole blood with no laborious processing steps. Furthermore, we demonstrated that MPNs conjugated with anti-CD8 antibodies, which are specific for cytotoxic T cells used in ATC, label CD8+ T cells with high specificity ex vivo and in vivo. Labeled T cells can be easily manipulated by a small magnet in suspension and under flow conditions. In addition, MPNs generate high contrast in MRI and PA imaging with the potential to detect just few cells per imaging voxel. These results show that immunotargeted MPNs can be explored for simultaneous visualization and magnetic guidance of T cell subsets in vivo for cancer treatment.

Imaging separation of neuronal from vascular effects of cocaine on rat cortical brain in vivo

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yuan, Z.; Du, C.; Yuan, Z.

MRI techniques to study brain function assume coupling between neuronal activity, metabolism and flow. However, recent evidence of physiological uncoupling between neuronal and cerebrovascular events highlights the need for methods to simultaneously measure these three properties. We report a multimodality optical approach that integrates dual-wavelength laser speckle imaging (measures changes in blood flow, blood volume and hemoglobin oxygenation), digital-frequency-ramping optical coherence tomography (images quantitative 3D vascular network) and Rhod2 fluorescence (images intracellular calcium for measure of neuronal activity) at high spatiotemporal resolutions (30 {micro}m, 10 Hz) and over a large field of view (3 x 5 mm{sup 2}). We applymore » it to assess cocaine's effects in rat cortical brain and show an immediate decrease 3.5 {+-} 0.9 min, phase (1) in the oxygen content of hemoglobin and the cerebral blood flow followed by an overshoot 7.1 {+-} 0.2 min, phase (2) lasting over 20 min whereas Ca{sup 2+} increased immediately (peaked at t = 4.1 {+-} 0.4 min) and remained elevated. This enabled us to identify a delay (2.9 {+-} 0.5 min) between peak neuronal and vascular responses in phase 2. The ability of this multimodality optical approach for simultaneous imaging at high spatiotemporal resolutions permits us to distinguish the vascular versus cellular changes of the brain, thus complimenting other neuroimaging modalities for brain functional studies (e. g., PET, fMRI).« less

Treatment of obsessive-compulsive disorder complicated by comorbid eating disorders.

PubMed

Simpson, H Blair; Wetterneck, Chad T; Cahill, Shawn P; Steinglass, Joanna E; Franklin, Martin E; Leonard, Rachel C; Weltzin, Theodore E; Riemann, Bradley C

2013-01-01

Eating disorders and obsessive-compulsive disorder (OCD) commonly co-occur, but there is little data for how to treat these complex cases. To address this gap, we examined the naturalistic outcome of 56 patients with both disorders, who received a multimodal treatment program designed to address both problems simultaneously. A residential treatment program developed a cognitive-behavioral approach for patients with both OCD and an eating disorder by integrating exposure and response prevention (ERP) treatment for OCD with ERP strategies targeting eating pathology. Patients also received a supervised eating plan, medication management, and social support. At admission and discharge, patients completed validated measures of OCD severity (the Yale-Brown Obsessive-Compulsive Scale--Self Report [Y-BOCS-SR]), eating disorder severity (the Eating Disorders Examination-Questionnaire), and depressive severity (the Beck Depression Inventory II [BDI-II]). Body mass index (BMI) was also measured. Paired-sample t-tests examined change on these measures. Between 2006 and 2011, 56 individuals completed all study measures at admission and discharge. Mean length of stay was 57 days (SD = 27). Most (89%) were on psychiatric medications. Significant decreases were observed in OCD severity, eating disorder severity, and depression. Those with bulimia nervosa showed more improvement than those with anorexia nervosa. BMI significantly increased, primarily among those underweight at admission. Simultaneous treatment of OCD and eating disorders using a multimodal approach that emphasizes ERP techniques for both OCD and eating disorders can be an effective treatment strategy for these complex cases.

Interactions of Multimodal Ligands with Proteins: Insights into Selectivity Using Molecular Dynamics Simulations.

PubMed

Parimal, Siddharth; Garde, Shekhar; Cramer, Steven M

2015-07-14

Fundamental understanding of protein-ligand interactions is important to the development of efficient bioseparations in multimodal chromatography. Here we employ molecular dynamics (MD) simulations to investigate the interactions of three different proteins--ubiquitin, cytochrome C, and α-chymotrypsinogen A, sampling a range of charge from +1e to +9e--with two multimodal chromatographic ligands containing similar chemical moieties--aromatic, carboxyl, and amide--in different structural arrangements. We use a spherical harmonic expansion to analyze ligand and individual moiety density profiles around the proteins. We find that the Capto MMC ligand, which contains an additional aliphatic group, displays stronger interactions than Nuvia CPrime ligand with all three proteins. Studying the ligand densities at the moiety level suggests that hydrophobic interactions play a major role in determining the locations of high ligand densities. Finally, the greater structural flexibility of the Capto MMC ligand compared to that of the Nuvia cPrime ligand allows for stronger structural complementarity and enables stronger hydrophobic interactions. These subtle and not-so-subtle differences in binding affinities and modalities for multimodal ligands can result in significantly different binding behavior towards proteins with important implications for bioprocessing.

Research notes : multimodal transportation funding, the ConnectOregon program.

DOT National Transportation Integrated Search

2009-08-01

The study examined the ConnectOregon I and II project selection processes, public outreach, and the review and approval processes. Throughout the programs phases, program participants and observers have offered ideas and suggestions for improving ...

Mode selecting switch using multimode interference for on-chip optical interconnects.

PubMed

Priti, Rubana B; Pishvai Bazargani, Hamed; Xiong, Yule; Liboiron-Ladouceur, Odile

2017-10-15

A novel mode selecting switch (MSS) is experimentally demonstrated for on-chip mode-division multiplexing (MDM) optical interconnects. The MSS consists of a Mach-Zehnder interferometer with tapered multi-mode interference couplers and TiN thermo-optic phase shifters for conversion and switching between the optical data encoded on the fundamental and first-order quasi-transverse electric (TE) modes. The C-band MSS exhibits a >25  dB switching extinction ratio and < -12 dB crosstalk. We validate the dynamic switching with a 25.8 kHz gating signal measuring switching times for both TE0 and TE1 modes of <10.9  μs. All channels exhibit less than 1.7 dB power penalty at a 10 -12 bit error rate, while switching the non-return-to-zero PRBS-31 data signals at 10  Gb/s.

Multimodal intraoperative neuromonitoring in corrective surgery for adolescent idiopathic scoliosis: Evaluation of 354 consecutive cases

PubMed Central

Kundnani, Vishal K; Zhu, Lisa; Tak, HH; Wong, HK

2010-01-01

Background: Multimodal intraoperative neuromonitoring is recommended during corrective spinal surgery, and has been widely used in surgery for spinal deformity with successful outcomes. Despite successful outcomes of corrective surgery due to increased safety of the patients with the usage of spinal cord monitoring in many large spine centers, this modality has not yet achieved widespread popularity. We report the analysis of prospectively collected intraoperative neurophysiological monitoring data of 354 consecutive patients undergoing corrective surgery for adolescent idiopathic scoliosis (AIS) to establish the efficacy of multimodal neuromonitoring and to evaluate comparative sensitivity and specificity. Materials and Methods: The study group consisted of 354 (female = 309; male = 45) patients undergoing spinal deformity corrective surgery between 2004 and 2008. Patients were monitored using electrophysiological methods including somatosensory-evoked potentials and motor-evoked potentials simultaneously. Results: Mean age of patients was 13.6 years (±2.3 years). The operative procedures involved were instrumented fusion of the thoracic/lumbar/both curves, Baseline somatosensory-evoked potentials (SSEP) and neurogenic motor-evoked potentials (NMEP) were recorded successfully in all cases. Thirteen cases expressed significant alert to prompt reversal of intervention. All these 13 cases with significant alert had detectable NMEP alerts, whereas significant SSEP alert was detected in 8 cases. Two patients awoke with new neurological deficit (0.56%) and had significant intraoperative SSEP + NMEP alerts. There were no false positives with SSEP (high specificity) but 5 patients with false negatives with SSEP (38%) reduced its sensitivity. There was no false negative with NMEP but 2 of 13 cases were false positive with NMEP (15%). The specificity of SSEP (100%) is higher than NMEP (96%); however, the sensitivity of NMEP (100%) is far better than SSEP (51%). Due to these results, the overall sensitivity, specificity and positive predictive value of combined multimodality neuromonitoring in this adult deformity series was 100, 98.5 and 85%, respectively. Conclusion: Neurogenic motor-evoked potential (NMEP) monitoring appears to be superior to conventional SSEP monitoring for identifying evolving spinal cord injury. Used in conjunction, the sensitivity and specificity of combined neuromonitoring may reach up to 100%. Multimodality monitoring with SSEP + NMEP should be the standard of care. PMID:20165679

A multimodal spatiotemporal cardiac motion atlas from MR and ultrasound data.

PubMed

Puyol-Antón, Esther; Sinclair, Matthew; Gerber, Bernhard; Amzulescu, Mihaela Silvia; Langet, Hélène; Craene, Mathieu De; Aljabar, Paul; Piro, Paolo; King, Andrew P

2017-08-01

Cardiac motion atlases provide a space of reference in which the motions of a cohort of subjects can be directly compared. Motion atlases can be used to learn descriptors that are linked to different pathologies and which can subsequently be used for diagnosis. To date, all such atlases have been formed and applied using data from the same modality. In this work we propose a framework to build a multimodal cardiac motion atlas from 3D magnetic resonance (MR) and 3D ultrasound (US) data. Such an atlas will benefit from the complementary motion features derived from the two modalities, and furthermore, it could be applied in clinics to detect cardiovascular disease using US data alone. The processing pipeline for the formation of the multimodal motion atlas initially involves spatial and temporal normalisation of subjects' cardiac geometry and motion. This step was accomplished following a similar pipeline to that proposed for single modality atlas formation. The main novelty of this paper lies in the use of a multi-view algorithm to simultaneously reduce the dimensionality of both the MR and US derived motion data in order to find a common space between both modalities to model their variability. Three different dimensionality reduction algorithms were investigated: principal component analysis, canonical correlation analysis and partial least squares regression (PLS). A leave-one-out cross validation on a multimodal data set of 50 volunteers was employed to quantify the accuracy of the three algorithms. Results show that PLS resulted in the lowest errors, with a reconstruction error of less than 2.3 mm for MR-derived motion data, and less than 2.5  mm for US-derived motion data. In addition, 1000 subjects from the UK Biobank database were used to build a large scale monomodal data set for a systematic validation of the proposed algorithms. Our results demonstrate the feasibility of using US data alone to analyse cardiac function based on a multimodal motion atlas. Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.

Centroid tracker and aimpoint selection

NASA Astrophysics Data System (ADS)

Venkateswarlu, Ronda; Sujata, K. V.; Venkateswara Rao, B.

1992-11-01

Autonomous fire and forget weapons have gained importance to achieve accurate first pass kill by hitting the target at an appropriate aim point. Centroid of the image presented by a target in the field of view (FOV) of a sensor is generally accepted as the aimpoint for these weapons. Centroid trackers are applicable only when the target image is of significant size in the FOV of the sensor but does not overflow the FOV. But as the range between the sensor and the target decreases the image of the target will grow and finally overflow the FOV at close ranges and the centroid point on the target will keep on changing which is not desirable. And also centroid need not be the most desired/vulnerable point on the target. For hardened targets like tanks, proper aimpoint selection and guidance up to almost zero range is essential to achieve maximum kill probability. This paper presents a centroid tracker realization. As centroid offers a stable tracking point, it can be used as a reference to select the proper aimpoint. The centroid and the desired aimpoint are simultaneously tracked to avoid jamming by flares and also to take care of the problems arising due to image overflow. Thresholding of gray level image to binary image is a crucial step in centroid tracker. Different thresholding algorithms are discussed and a suitable algorithm is chosen. The real-time hardware implementation of centroid tracker with a suitable thresholding technique is presented including the interfacing to a multimode tracker for autonomous target tracking and aimpoint selection. The hardware uses very high speed arithmetic and programmable logic devices to meet the speed requirement and a microprocessor based subsystem for the system control. The tracker has been evaluated in a field environment.

Multiple-output support vector machine regression with feature selection for arousal/valence space emotion assessment.

PubMed

Torres-Valencia, Cristian A; Álvarez, Mauricio A; Orozco-Gutiérrez, Alvaro A

2014-01-01

Human emotion recognition (HER) allows the assessment of an affective state of a subject. Until recently, such emotional states were described in terms of discrete emotions, like happiness or contempt. In order to cover a high range of emotions, researchers in the field have introduced different dimensional spaces for emotion description that allow the characterization of affective states in terms of several variables or dimensions that measure distinct aspects of the emotion. One of the most common of such dimensional spaces is the bidimensional Arousal/Valence space. To the best of our knowledge, all HER systems so far have modelled independently, the dimensions in these dimensional spaces. In this paper, we study the effect of modelling the output dimensions simultaneously and show experimentally the advantages in modeling them in this way. We consider a multimodal approach by including features from the Electroencephalogram and a few physiological signals. For modelling the multiple outputs, we employ a multiple output regressor based on support vector machines. We also include an stage of feature selection that is developed within an embedded approach known as Recursive Feature Elimination (RFE), proposed initially for SVM. The results show that several features can be eliminated using the multiple output support vector regressor with RFE without affecting the performance of the regressor. From the analysis of the features selected in smaller subsets via RFE, it can be observed that the signals that are more informative into the arousal and valence space discrimination are the EEG, Electrooculogram/Electromiogram (EOG/EMG) and the Galvanic Skin Response (GSR).

Highly Sensitive Liquid Core Temperature Sensor Based on Multimode Interference Effects

PubMed Central

Fuentes-Fuentes, Miguel A.; May-Arrioja, Daniel A.; Guzman-Sepulveda, José R.; Torres-Cisneros, Miguel; Sánchez-Mondragón, José J.

2015-01-01

A novel fiber optic temperature sensor based on a liquid-core multimode interference device is demonstrated. The advantage of such structure is that the thermo-optic coefficient (TOC) of the liquid is at least one order of magnitude larger than that of silica and this, combined with the fact that the TOC of silica and the liquid have opposite signs, provides a liquid-core multimode fiber (MMF) highly sensitive to temperature. Since the refractive index of the liquid can be easily modified, this allows us to control the modal properties of the liquid-core MMF at will and the sensor sensitivity can be easily tuned by selecting the refractive index of the liquid in the core of the device. The maximum sensitivity measured in our experiments is 20 nm/°C in the low-temperature regime up to 60 °C. To the best of our knowledge, to date, this is the largest sensitivity reported for fiber-based MMI temperature sensors. PMID:26512664

The prioritization of mobility improvements using a multicriteria prioritization algorithm : final report

DOT National Transportation Integrated Search

1998-07-01

A prioritization process has been prepared by the University of California, Davis, for use by the Oregon Department of Transportation (ODOT) in selecting multimodal mobility improvement projects to fund, given a budget constraint. The process involve...

Multi-Modal Traveler Information System - VMS/HAR State-of-the-Practice

DOT National Transportation Integrated Search

1997-05-30

The Gary-Chicago-Milwaukee (GCM) Corridor is one of the four "Priority Corridors" established by the United States Congress in the Inter-Modal Surface Transportation Efficiency Act (ISTEA). These corridors have been selected for special federal trans...

Liquid level and temperature sensing by using dual-wavelength fiber laser based on multimode interferometer and FBG in parallel

NASA Astrophysics Data System (ADS)

Sun, Chunran; Dong, Yue; Wang, Muguang; Jian, Shuisheng

2018-03-01

The detection of liquid level and temperature based on a fiber ring cavity laser sensing configuration is presented and demonstrated experimentally. The sensing head contains a fiber Bragg grating (FBG) and a single-mode-cladding-less-single-mode multimode interferometer, which also functions as wavelength-selective components of the fiber laser. When the liquid level or temperature is applied on the sensing head, the pass-band peaks of both multimode interference (MMI) filter and FBG filter vary and the two output wavelengths of the laser shift correspondingly. In the experiment, the corresponding sensitivities of the liquid level with four different refractive indices (RI) in the deep range from 0 mm to 40 mm are obtained and the sensitivity enhances with the RI of the liquid being measured. The maximum sensitivity of interferometer is 106.3 pm/mm with the RI of 1.391. For the temperature measurement, a sensitivity of 10.3 pm/°C and 13.8 pm/°C are achieved with the temperature ranging from 0 °C to 90 °C corresponding to the two lasing wavelengths selective by the MMI filter and FBG, respectively. In addition, the average RI sensitivity of 155.77 pm/mm/RIU is also obtained in the RI range of 1.333-1.391.

Behavior change, acceptance, and coping flexibility in highly distressed patients with rheumatic diseases: feasibility of a cognitive-behavioral therapy in multimodal rehabilitation.

PubMed

Vriezekolk, Johanna E; Geenen, Rinie; van den Ende, Cornelia H M; Slot, Helma; van Lankveld, Wim G J M; van Helmond, Toon

2012-05-01

To describe the development and feasibility of the integration of a cognitive-behavioral therapy (CBT) within a multimodal rehabilitation program for highly distressed patients with rheumatic diseases. Development included the detailed specification of the theoretical and empirical-based underpinnings of the CBT and the comprehensive description of its design and content. Feasibility was assessed by percentage of eligible patients, attrition and attendance rates, and patient satisfaction. The developed CBT component seeks to decrease psychological distress and improve activities and participation across multiple life domains by accomplishing behavior change, acceptance, and coping flexibility. Motivational interviewing was applied to endorse patients' own reasons to change. Forty percent (35/87) of the eligible patients were admitted to the program. Attendance rate (>95%) was high. Patient satisfaction ranged from 6.8 to 8.0 (10-point scale). Integrating CBT within a multimodal rehabilitation program is feasible. An acceptable proportion of the intended patient sample is eligible and patient's attendance and satisfaction is high. Patients with impaired physical and psychosocial functioning despite adequate medical treatment pose a great challenge. Their treatment outcome may be improved by screening and selecting highly distressed patients and offering them a CBT embedded in multimodal rehabilitation program. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

A 10-Week Multimodal Nutrition Education Intervention Improves Dietary Intake among University Students: Cluster Randomised Controlled Trial

PubMed Central

Wan Dali, Wan Putri Elena; Lua, Pei Lin

2013-01-01

The aim of the study was to evaluate the effectiveness of implementing multimodal nutrition education intervention (NEI) to improve dietary intake among university students. The design of study used was cluster randomised controlled design at four public universities in East Coast of Malaysia. A total of 417 university students participated in the study. They were randomly selected and assigned into two arms, that is, intervention group (IG) or control group (CG) according to their cluster. The IG received 10-week multimodal intervention using three modes (conventional lecture, brochures, and text messages) while CG did not receive any intervention. Dietary intake was assessed before and after intervention and outcomes reported as nutrient intakes as well as average daily servings of food intake. Analysis of covariance (ANCOVA) and adjusted effect size were used to determine difference in dietary changes between groups and time. Results showed that, compared to CG, participants in IG significantly improved their dietary intake by increasing their energy intake, carbohydrate, calcium, vitamin C and thiamine, fruits and 100% fruit juice, fish, egg, milk, and dairy products while at the same time significantly decreased their processed food intake. In conclusion, multimodal NEI focusing on healthy eating promotion is an effective approach to improve dietary intakes among university students. PMID:24069535

Recording event-related activity under hostile magnetic resonance environment: Is multimodal EEG/ERP-MRI recording possible?

PubMed

Karakaş, H M; Karakaş, S; Ozkan Ceylan, A; Tali, E T

2009-08-01

Event-related potentials (ERPs) have high temporal resolution, but insufficient spatial resolution; the converse is true for the functional imaging techniques. The purpose of the study was to test the utility of a multimodal EEG/ERP-MRI technique which combines electroencephalography (EEG) and magnetic resonance imaging (MRI) for a simultaneously high temporal and spatial resolution. The sample consisted of 32 healthy young adults of both sexes. Auditory stimuli were delivered according to the active and passive oddball paradigms in the MRI environment (MRI-e) and in the standard conditions of the electrophysiology laboratory environment (Lab-e). Tasks were presented in a fixed order. Participants were exposed to the recording environments in a counterbalanced order. EEG data were preprocessed for MRI-related artifacts. Source localization was made using a current density reconstruction technique. The ERP waveforms for the MRI-e were morphologically similar to those for the Lab-e. The effect of the recording environment, experimental paradigm and electrode location were analyzed using a 2x2x3 analysis of variance for repeated measures. The ERP components in the two environments showed parametric variations and characteristic topographical distributions. The calculated sources were in line with the related literature. The findings indicated effortful cognitive processing in MRI-e. The study provided preliminary data on the feasibility of the multimodal EEG/ERP-MRI technique. It also indicated lines of research that are to be pursued for a decisive testing of this technique and its implementation to clinical practice.

Multi-modal myocontrol: Testing combined force- and electromyography.

PubMed

Nowak, Markus; Eiband, Thomas; Castellini, Claudio

2017-07-01

Myocontrol, that is control of prostheses using bodily signals, has proved in the decades to be a surprisingly hard problem for the scientific community of assistive and rehabilitation robotics. In particular, traditional surface electromyography (sEMG) seems to be no longer enough to guarantee dexterity (i.e., control over several degrees of freedom) and, most importantly, reliability. Multi-modal myocontrol is concerned with the idea of using novel signal gathering techniques as a replacement of, or alongside, sEMG, to provide high-density and diverse signals to improve dexterity and make the control more reliable. In this paper we present an offline and online assessment of multi-modal sEMG and force myography (FMG) targeted at hand and wrist myocontrol. A total number of twenty sEMG and FMG sensors were used simultaneously, in several combined configurations, to predict opening/closing of the hand and activation of two degrees of freedom of the wrist of ten intact subjects. The analysis was targeted at determining the optimal sensor combination and control parameters; the experimental results indicate that sEMG sensors alone perform worst, yielding a nRMSE of 9.1%, while mixing FMG and sEMG or using FMG only reduces the nRMSE to 5.2-6.6%. To validate these results, we engaged the subject with median performance in an online goal-reaching task. Analysis of this further experiment reveals that the online behaviour is similar to the offline one.

Nanoelectronics enabled chronic multimodal neural platform in a mouse ischemic model.

PubMed

Luan, Lan; Sullender, Colin T; Li, Xue; Zhao, Zhengtuo; Zhu, Hanlin; Wei, Xiaoling; Xie, Chong; Dunn, Andrew K

2018-02-01

Despite significant advancements of optical imaging techniques for mapping hemodynamics in small animal models, it remains challenging to combine imaging with spatially resolved electrical recording of individual neurons especially for longitudinal studies. This is largely due to the strong invasiveness to the living brain from the penetrating electrodes and their limited compatibility with longitudinal imaging. We implant arrays of ultraflexible nanoelectronic threads (NETs) in mice for neural recording both at the brain surface and intracortically, which maintain great tissue compatibility chronically. By mounting a cranial window atop of the NET arrays that allows for chronic optical access, we establish a multimodal platform that combines spatially resolved electrical recording of neural activity and laser speckle contrast imaging (LSCI) of cerebral blood flow (CBF) for longitudinal studies. We induce peri-infarct depolarizations (PIDs) by targeted photothrombosis, and show the ability to detect its occurrence and propagation through spatiotemporal variations in both extracellular potentials and CBF. We also demonstrate chronic tracking of single-unit neural activity and CBF over days after photothrombosis, from which we observe reperfusion and increased firing rates. This multimodal platform enables simultaneous mapping of neural activity and hemodynamic parameters at the microscale for quantitative, longitudinal comparisons with minimal perturbation to the baseline neurophysiology. The ability to spatiotemporally resolve and chronically track CBF and neural electrical activity in the same living brain region has broad applications for studying the interplay between neural and hemodynamic responses in health and in cerebrovascular and neurological pathologies. Copyright © 2017 Elsevier B.V. All rights reserved.

The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS).

PubMed

Menze, Bjoern H; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-André; Arbel, Tal; Avants, Brian B; Ayache, Nicholas; Buendia, Patricia; Collins, D Louis; Cordier, Nicolas; Corso, Jason J; Criminisi, Antonio; Das, Tilak; Delingette, Hervé; Demiralp, Çağatay; Durst, Christopher R; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M; Jena, Raj; John, Nigel M; Konukoglu, Ender; Lashkari, Danial; Mariz, José Antonió; Meier, Raphael; Pereira, Sérgio; Precup, Doina; Price, Stephen J; Raviv, Tammy Riklin; Reza, Syed M S; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A; Sousa, Nuno; Subbanna, Nagesh K; Szekely, Gabor; Taylor, Thomas J; Thomas, Owen M; Tustison, Nicholas J; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen

2015-10-01

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients-manually annotated by up to four raters-and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

On the possible high +Gz tolerance increase by multimodal brain imaging controlled respiratory AFTE biofeedback training exercise

NASA Astrophysics Data System (ADS)

Smietanowski, Maciej; Achimowicz, Jerzy; Lorenc, Kamil; Nowicki, Grzegorz; Zalewska, Ewa; Truszczynski, Olaf

The experimental data related to Valsalva manouvers and short term voluntary apnea, available in the literature, suggest that the cerebral blood flow increase and reduction of the peripheral one may be expected if the specific AFTE based respiratory training is performed. The authors had verified this hypothesis by studying the relations between EEG measured subject relaxation combined with voluntary apnea by multimodal brain imaging technique (EEG mapping, Neuroscan and fMRI) in a group of healthy volunteers. The SPM analysis of respiratory related changes in cortical and subcortical BOLD signal has partially confirmed the hypothesis. The mechanism of this effect is probably based on the simultaneous blood pressure increase and total peripheral resistance increase. However the question is still open for further experimental verification if AFTE can be treated as the tool which can increase pilot/astronaut situation awareness in the extreme environment typical for aerospace operations where highly variable accelerations due to liftoff, rapid maneuvers, and vibrations can be expected in the critical phases of the mission.

The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)

PubMed Central

Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-André; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Hervé; Demiralp, Çağatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, José António; Meier, Raphael; Pereira, Sérgio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen

2016-01-01

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients—manually annotated by up to four raters—and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%–85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource. PMID:25494501

Multifunctional Magnetic and Upconverting Nanobeads as Dual Modal Imaging Tools.

PubMed

Materia, Maria Elena; Pernia Leal, Manuel; Scotto, Marco; Balakrishnan, Preethi Bala; Kumar Avugadda, Sahitya; García-Martín, María L; Cohen, Bruce E; Chan, Emory M; Pellegrino, Teresa

2017-11-15

We report the fabrication of aqueous multimodal imaging nanocomposites based on superparamagnetic nanoparticles (MNPs) and two different sizes of photoluminescent upconverting nanoparticles (UCNPs). The controlled and simultaneous incorporation of both types of nanoparticles (NPs) was obtained by controlling the solvent composition and the addition rate of the destabilizing solvent. The magnetic properties of the MNPs remained unaltered after their encapsulation into the polymeric beads as shown by the T2 relaxivity measurements. The UCNPs maintain photoluminescent properties even when embedded with the MNPs into the polymer bead. Moreover, the light emitted by the magnetic and upconverting nanobeads (MUCNBs) under NIR excitation (λ exc = 980 nm) was clearly observed through different thicknesses of agarose gel or through a mouse skin layer. The comparison with magnetic and luminescent nanobeads based on red-emitting quantum dots (QDs) demonstrated that while the QD-based beads show significant autofluorescence background from the skin, the signal obtained by the MUCNBs allows a decrease in this background. In summary, these results indicate that MUCNBs are good magnetic and optical probes for in vivo multimodal imaging sensors.

Fluorescent magnetic hybrid nanoprobe for multimodal bioimaging

PubMed Central

Bright, Vanessa

2011-01-01

A fluorescent magnetic hybrid imaging nanoprobe (HINP) was fabricated by conjugation of superparamagnetic Fe3O4 nanoparticles and visible light-emitting (~600 nm) fluorescent CdTe/CdS quantum dots (QDs). The assembly strategy used the covalent linking of the oxidized dextran shell of magnetic particles to the glutathione ligands of QDs. Synthesized HINP formed stable water-soluble colloidal dispersions. The structure and properties of the particles were characterized by transmission electron and atomic force microscopy, energy dispersive X-ray analysis and inductively coupled plasma optical emission spectroscopy, dynamic light scattering analysis, optical absorption and photoluminescence spectroscopy, and fluorescent imaging. The luminescence imaging region of the nanoprobe was extended to the near-infrared (NIR) (~800 nm) by conjugation of superparamagnetic nanoparticles with synthesized CdHgTe/CdS QDs. Cadmium, mercury based QDs in HINP can be easily replaced by novel water soluble glutathione stabilized AgInS2/ZnS QDs to present a new class of cadmium-free multimodal imaging agents. Observed NIR photoluminescence of fluorescent magnetic nanocomposites supports their use for bioimaging. The developed HINP provides dual-imaging channels for simultaneous optical and magnetic resonance imaging. PMID:21597146

Multi-modality molecular imaging: pre-clinical laboratory configuration

NASA Astrophysics Data System (ADS)

Wu, Yanjun; Wellen, Jeremy W.; Sarkar, Susanta K.

2006-02-01

In recent years, the prevalence of in vivo molecular imaging applications has rapidly increased. Here we report on the construction of a multi-modality imaging facility in a pharmaceutical setting that is expected to further advance existing capabilities for in vivo imaging of drug distribution and the interaction with their target. The imaging instrumentation in our facility includes a microPET scanner, a four wavelength time-domain optical imaging scanner, a 9.4T/30cm MRI scanner and a SPECT/X-ray CT scanner. An electronics shop and a computer room dedicated to image analysis are additional features of the facility. The layout of the facility was designed with a central animal preparation room surrounded by separate laboratory rooms for each of the major imaging modalities to accommodate the work-flow of simultaneous in vivo imaging experiments. This report will focus on the design of and anticipated applications for our microPET and optical imaging laboratory spaces. Additionally, we will discuss efforts to maximize the daily throughput of animal scans through development of efficient experimental work-flows and the use of multiple animals in a single scanning session.

Multimodal computational microscopy based on transport of intensity equation

NASA Astrophysics Data System (ADS)

Li, Jiaji; Chen, Qian; Sun, Jiasong; Zhang, Jialin; Zuo, Chao

2016-12-01

Transport of intensity equation (TIE) is a powerful tool for phase retrieval and quantitative phase imaging, which requires intensity measurements only at axially closely spaced planes without a separate reference beam. It does not require coherent illumination and works well on conventional bright-field microscopes. The quantitative phase reconstructed by TIE gives valuable information that has been encoded in the complex wave field by passage through a sample of interest. Such information may provide tremendous flexibility to emulate various microscopy modalities computationally without requiring specialized hardware components. We develop a requisite theory to describe such a hybrid computational multimodal imaging system, which yields quantitative phase, Zernike phase contrast, differential interference contrast, and light field moment imaging, simultaneously. It makes the various observations for biomedical samples easy. Then we give the experimental demonstration of these ideas by time-lapse imaging of live HeLa cell mitosis. Experimental results verify that a tunable lens-based TIE system, combined with the appropriate postprocessing algorithm, can achieve a variety of promising imaging modalities in parallel with the quantitative phase images for the dynamic study of cellular processes.

Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics

PubMed Central

Fernandino, Leonardo; Binder, Jeffrey R.; Desai, Rutvik H.; Pendl, Suzanne L.; Humphries, Colin J.; Gross, William L.; Conant, Lisa L.; Seidenberg, Mark S.

2016-01-01

Recent research indicates that sensory and motor cortical areas play a significant role in the neural representation of concepts. However, little is known about the overall architecture of this representational system, including the role played by higher level areas that integrate different types of sensory and motor information. The present study addressed this issue by investigating the simultaneous contributions of multiple sensory-motor modalities to semantic word processing. With a multivariate fMRI design, we examined activation associated with 5 sensory-motor attributes—color, shape, visual motion, sound, and manipulation—for 900 words. Regions responsive to each attribute were identified using independent ratings of the attributes' relevance to the meaning of each word. The results indicate that these aspects of conceptual knowledge are encoded in multimodal and higher level unimodal areas involved in processing the corresponding types of information during perception and action, in agreement with embodied theories of semantics. They also reveal a hierarchical system of abstracted sensory-motor representations incorporating a major division between object interaction and object perception processes. PMID:25750259

Multi-resonant electromagnetic shunt in base isolation for vibration damping and energy harvesting

NASA Astrophysics Data System (ADS)

Pei, Yalu; Liu, Yilun; Zuo, Lei

2018-06-01

This paper investigates multi-resonant electromagnetic shunts applied to base isolation for dual-function vibration damping and energy harvesting. Two multi-mode shunt circuit configurations, namely parallel and series, are proposed and optimized based on the H2 criteria. The root-mean-square (RMS) value of the relative displacement between the base and the primary structure is minimized. Practically, this will improve the safety of base-isolated buildings subjected the broad bandwidth ground acceleration. Case studies of a base-isolated building are conducted in both the frequency and time domains to investigate the effectiveness of multi-resonant electromagnetic shunts under recorded earthquake signals. It shows that both multi-mode shunt circuits outperform traditional single mode shunt circuits by suppressing the first and the second vibration modes simultaneously. Moreover, for the same stiffness ratio, the parallel shunt circuit is more effective at harvesting energy and suppressing vibration, and can more robustly handle parameter mistuning than the series shunt circuit. Furthermore, this paper discusses experimental validation of the effectiveness of multi-resonant electromagnetic shunts for vibration damping and energy harvesting on a scaled-down base isolation system.

Missing Modality Transfer Learning via Latent Low-Rank Constraint.

PubMed

Ding, Zhengming; Shao, Ming; Fu, Yun

2015-11-01

Transfer learning is usually exploited to leverage previously well-learned source domain for evaluating the unknown target domain; however, it may fail if no target data are available in the training stage. This problem arises when the data are multi-modal. For example, the target domain is in one modality, while the source domain is in another. To overcome this, we first borrow an auxiliary database with complete modalities, then consider knowledge transfer across databases and across modalities within databases simultaneously in a unified framework. The contributions are threefold: 1) a latent factor is introduced to uncover the underlying structure of the missing modality from the known data; 2) transfer learning in two directions allows the data alignment between both modalities and databases, giving rise to a very promising recovery; and 3) an efficient solution with theoretical guarantees to the proposed latent low-rank transfer learning algorithm. Comprehensive experiments on multi-modal knowledge transfer with missing target modality verify that our method can successfully inherit knowledge from both auxiliary database and source modality, and therefore significantly improve the recognition performance even when test modality is inaccessible in the training stage.

Bubble-generating nano-lipid carriers for ultrasound/CT imaging-guided efficient tumor therapy.

PubMed

Zhang, Nan; Li, Jia; Hou, Ruirui; Zhang, Jiangnan; Wang, Pei; Liu, Xinyang; Zhang, Zhenzhong

2017-12-20

Ideal therapeutic effectiveness of chemotherapy is obtained only when tumor cells are exposed to a maximal drug concentration, which is often hindered by dose-limiting toxicity. We designed a bubble-generating liposomal delivery system by introducing ammonium bicarbonate and gold nanorods into folic acid-conjugated liposomes to allow both multimodal imaging and the local release of drug (doxorubicin) with hyperthermia. The key component, ammonium bicarbonate, allows a controlled, rapid release of doxorubicin to provide an effective drug concentration in the tumor microenvironment. An in vitro temperature-triggered drug release study showed that cumulative release improved more than two-fold. In addition, in vitro and in vivo studies indicated that local heat treatment or ultrasonic cavitation enhanced the therapeutic efficiency greatly. The delivery system could also serve as an excellent contrast agent to allow ultrasonic imaging and computerized tomography imaging simultaneously to further achieve the aim of accurate diagnostics. Results of this study showed that this versatile bubble-generating liposome is a promising system to provide optimal therapeutic effects that are guided by multimodal imaging. Copyright © 2017 Elsevier B.V. All rights reserved.

Separating Bulk and Surface Contributions to Electronic Excited-State Processes in Hybrid Mixed Perovskite Thin Films via Multimodal All-Optical Imaging

DOE PAGES

Simpson, Mary Jane; Doughty, Benjamin; Das, Sanjib; ...

2017-07-04

A comprehensive understanding of electronic excited-state phenomena underlying the impressive performance of solution-processed hybrid halide perovskite solar cells requires access to both spatially resolved electronic processes and corresponding sample morphological characteristics. In this paper, we demonstrate an all-optical multimodal imaging approach that enables us to obtain both electronic excited-state and morphological information on a single optical microscope platform with simultaneous high temporal and spatial resolution. Specifically, images were acquired for the same region of interest in thin films of chloride containing mixed lead halide perovskites (CH 3NH 3PbI 3–xCl x) using femtosecond transient absorption, time-integrated photoluminescence, confocal reflectance, and transmissionmore » microscopies. Comprehensive image analysis revealed the presence of surface- and bulk-dominated contributions to the various images, which describe either spatially dependent electronic excited-state properties or morphological variations across the probed region of the thin films. Finally, these results show that PL probes effectively the species near or at the film surface.« less

"Clickable", trifunctional magnetite nanoparticles and their chemoselective biofunctionalization.

PubMed

Das, Manasmita; Bandyopadhyay, Debarati; Mishra, Debasish; Datir, Satyajit; Dhak, Prasanta; Jain, Sanyog; Maiti, Tapas Kumar; Basak, Amit; Pramanik, Panchanan

2011-06-15

A multifunctional iron oxide based nanoformulation for combined cancer-targeted therapy and multimodal imaging has been meticulously designed and synthesized using a chemoselective ligation approach. Novel superparamagnetic magnetite nanoparticles simultaneously functionalized with amine, carboxyl, and azide groups were fabricated through a sequence of stoichiometrically controllable partial succinylation and Cu (II) catalyzed diazo transfer on the reactive amine termini of 2-aminoethylphosphonate grafted magnetite nanoparticles (MNPs). Functional moieties associated with MNP surface were chemoselectively conjugated with rhodamine B isothiocyanate (RITC), propargyl folate (FA), and paclitaxel (PTX) via tandem nucleophic addition of amine to isothithiocyanates, Cu (I) catalyzed azide--alkyne click chemistry and carbodiimide-promoted esterification. An extensive in vitro study established that the bioactives chemoselectively appended to the magnetite core bequeathed multifunctionality to the nanoparticles without any loss of activity of the functional molecules. Multifunctional nanoparticles, developed in the course of the study, could selectively target and induce apoptosis to folate-receptor (FR) overexpressing cancer cells with enhanced efficacy as compared to the free drug. In addition, the dual optical and magnetic properties of the synthesized nanoparticles aided in the real-time tracking of their intracellular pathways also as apoptotic events through dual fluorescence and MR-based imaging.

Predictive brain networks for major depression in a semi-multimodal fusion hierarchical feature reduction framework.

PubMed

Yang, Jie; Yin, Yingying; Zhang, Zuping; Long, Jun; Dong, Jian; Zhang, Yuqun; Xu, Zhi; Li, Lei; Liu, Jie; Yuan, Yonggui

2018-02-05

Major depressive disorder (MDD) is characterized by dysregulation of distributed structural and functional networks. It is now recognized that structural and functional networks are related at multiple temporal scales. The recent emergence of multimodal fusion methods has made it possible to comprehensively and systematically investigate brain networks and thereby provide essential information for influencing disease diagnosis and prognosis. However, such investigations are hampered by the inconsistent dimensionality features between structural and functional networks. Thus, a semi-multimodal fusion hierarchical feature reduction framework is proposed. Feature reduction is a vital procedure in classification that can be used to eliminate irrelevant and redundant information and thereby improve the accuracy of disease diagnosis. Our proposed framework primarily consists of two steps. The first step considers the connection distances in both structural and functional networks between MDD and healthy control (HC) groups. By adding a constraint based on sparsity regularization, the second step fully utilizes the inter-relationship between the two modalities. However, in contrast to conventional multi-modality multi-task methods, the structural networks were considered to play only a subsidiary role in feature reduction and were not included in the following classification. The proposed method achieved a classification accuracy, specificity, sensitivity, and area under the curve of 84.91%, 88.6%, 81.29%, and 0.91, respectively. Moreover, the frontal-limbic system contributed the most to disease diagnosis. Importantly, by taking full advantage of the complementary information from multimodal neuroimaging data, the selected consensus connections may be highly reliable biomarkers of MDD. Copyright © 2017 Elsevier B.V. All rights reserved.

PCF-Based Cavity Enhanced Spectroscopic Sensors for Simultaneous Multicomponent Trace Gas Analysis

PubMed Central

Nakaema, Walter M.; Hao, Zuo-Qiang; Rohwetter, Philipp; Wöste, Ludger; Stelmaszczyk, Kamil

2011-01-01

A multiwavelength, multicomponent CRDS gas sensor operating on the basis of a compact photonic crystal fibre supercontinuum light source has been constructed. It features a simple design encompassing one radiation source, one cavity and one detection unit (a spectrograph with a fitted ICCD camera) that are common for all wavelengths. Multicomponent detection capability of the device is demonstrated by simultaneous measurements of the absorption spectra of molecular oxygen (spin-forbidden b-X branch) and water vapor (polyads 4v, 4v + δ) in ambient atmospheric air. Issues related to multimodal cavity excitation, as well as to obtaining the best signal-to-noise ratio are discussed together with methods for their practical resolution based on operating the cavity in a “quasi continuum” mode and setting long camera gate widths, respectively. A comprehensive review of multiwavelength CRDS techniques is also given. PMID:22319372

A multimodal biometric authentication system based on 2D and 3D palmprint features

NASA Astrophysics Data System (ADS)

Aggithaya, Vivek K.; Zhang, David; Luo, Nan

2008-03-01

This paper presents a new personal authentication system that simultaneously exploits 2D and 3D palmprint features. Here, we aim to improve the accuracy and robustness of existing palmprint authentication systems using 3D palmprint features. The proposed system uses an active stereo technique, structured light, to capture 3D image or range data of the palm and a registered intensity image simultaneously. The surface curvature based method is employed to extract features from 3D palmprint and Gabor feature based competitive coding scheme is used for 2D representation. We individually analyze these representations and attempt to combine them with score level fusion technique. Our experiments on a database of 108 subjects achieve significant improvement in performance (Equal Error Rate) with the integration of 3D features as compared to the case when 2D palmprint features alone are employed.

Simultaneous functional photoacoustic and ultrasonic endoscopy of internal organs in vivo.

PubMed

Yang, Joon-Mo; Favazza, Christopher; Chen, Ruimin; Yao, Junjie; Cai, Xin; Maslov, Konstantin; Zhou, Qifa; Shung, K Kirk; Wang, Lihong V

2012-08-01

At present, clinicians routinely apply ultrasound endoscopy in a variety of interventional procedures that provide treatment solutions for diseased organs. Ultrasound endoscopy not only produces high-resolution images, but also is safe for clinical use and broadly applicable. However, for soft tissue imaging, its mechanical wave-based image contrast fundamentally limits its ability to provide physiologically specific functional information. By contrast, photoacoustic endoscopy possesses a unique combination of functional optical contrast and high spatial resolution at clinically relevant depths, ideal for imaging soft tissues. With these attributes, photoacoustic endoscopy can overcome the current limitations of ultrasound endoscopy. Moreover, the benefits of photoacoustic imaging do not come at the expense of existing ultrasound functions; photoacoustic endoscopy systems are inherently compatible with ultrasound imaging, thereby enabling multimodality imaging with complementary contrast. Here we present simultaneous photoacoustic and ultrasonic dual-mode endoscopy and show its ability to image internal organs in vivo, thus illustrating its potential clinical application.

Simultaneous functional photoacoustic and ultrasonic endoscopy of internal organs in vivo

PubMed Central

Yang, Joon-Mo; Favazza, Christopher; Chen, Ruimin; Yao, Junjie; Cai, Xin; Maslov, Konstantin; Zhou, Qifa; Shung, K. Kirk; Wang, Lihong V.

2013-01-01

Presently, clinicians routinely apply ultrasound endoscopy in a variety of interventional procedures which provide treatment solutions for diseased organs. Ultrasound endoscopy not only produces high resolution images, it is also safe for clinical use and broadly applicable. However, for soft tissue imaging, its mechanical wave-based image contrast fundamentally limits its ability to provide physiologically-specific functional information. By contrast, photoacoustic endoscopy possesses a unique combination of functional optical contrast and high spatial resolution at clinically-relevant depths, ideal for soft tissue imaging. With these attributes, photoacoustic endoscopy can overcome the current limitations of ultrasound endoscopy. Moreover, the benefits of photoacoustic imaging do not come at the expense of existing ultrasound functions; photoacoustic endoscopy systems are inherently compatible with ultrasound imaging, enabling multi-modality imaging with complementary contrast. Here, we present simultaneous photoacoustic and ultrasonic dual-mode endoscopy and demonstrate its ability to image internal organs in vivo, illustrating its potential clinical application. PMID:22797808

Heartbeat detection in multimodal physiological signals using signal quality assessment based on sample entropy.

PubMed

Singh, Omkar; Sunkaria, Ramesh Kumar

2017-12-01

This paper presents a novel technique to identify heartbeats in multimodal data using electrocardiogram (ECG) and arterial blood pressure (ABP) signals. Multiple physiological signals such as ECG, ABP, and Respiration are often recorded in parallel from the activity of heart. These signals generally possess related information as they are generated by the same physical system. The ECG and ABP correspond to the same phenomenon of contraction and relaxation activity of heart. Multiple signals acquired from various sensors are generally processed independently, thus discarding the information from other measurements. In the estimation of heart rate and heart rate variability, the R peaks are generally identified from ECG signal. Efficient detection of R-peaks in electrocardiogram (ECG) is a key component in the estimation of clinically relevant parameters from ECG. However, when the signal is severely affected by undesired artifacts, this becomes a challenging task. Sometimes in clinical environment, other physiological signals reflecting the cardiac activity such as ABP signal are also acquired simultaneously. Under the availability of such multimodal signals, the accuracy of R peak detection methods can be improved using sensor-fusion techniques. In the proposed method, the sample entropy (SampEn) is used as a metric for assessing the noise content in the physiological signal and the R peaks in ECG and the systolic peaks in ABP signals are fused together to enhance the efficiency of heartbeat detection. The proposed method was evaluated on the 100 records from the computing in cardiology challenge 2014 training data set. The performance parameters are: sensitivity (Se) and positive predictivity (PPV). The unimodal R peaks detector achieved: Se gross = 99.40%, PPV gross = 99.29%, Se average = 99.37%, PPV average = 99.29%. Similarly unimodal BP delineator achieved Se gross = 99.93%, PPV gross = 99.99%, Se average = 99.93%, PPV average = 99.99% whereas, the proposed multimodal beat detector achieved: Se gross = 99.65%, PPV gross = 99.91%, Se average = 99.68%, PPV average = 99.91%.

Oxygen measurement by multimode diode lasers employing gas correlation spectroscopy.

PubMed

Lou, Xiutao; Somesfalean, Gabriel; Chen, Bin; Zhang, Zhiguo

2009-02-10

Multimode diode laser (MDL)-based correlation spectroscopy (COSPEC) was used to measure oxygen in ambient air, thereby employing a diode laser (DL) having an emission spectrum that overlaps the oxygen absorption lines of the A band. A sensitivity of 700 ppm m was achieved with good accuracy (2%) and linearity (R(2)=0.999). For comparison, measurements of ambient oxygen were also performed by tunable DL absorption spectroscopy (TDLAS) technique employing a vertical cavity surface emitting laser. We demonstrate that, despite slightly degraded sensitivity, the MDL-based COSPEC-based oxygen sensor has the advantages of high stability, low cost, ease-of-use, and relaxed requirements in component selection and instrument buildup compared with the TDLAS-based instrument.

Compact wavelength-selective optical switch based on digital optical phase conjugation.

PubMed

Li, Zhiyang; Claver, Havyarimana

2013-11-15

In this Letter, we show that digital optical phase conjugation might be utilized to construct a new kind of wavelength-selective switches. When incorporated with a multimode interferometer, these switches have wide bandwidth, high tolerance for fabrication error, and low polarization dependency. They might help to build large-scale multiwavelength nonblocking switching systems, or even to fabricate an optical cross-connecting or routing system on a chip.

Synergism and Antagonism of Proximate Mechanisms Enable and Constrain the Response to Simultaneous Selection on Body Size and Development Time: An Empirical Test Using Experimental Evolution.

PubMed

Davidowitz, Goggy; Roff, Derek; Nijhout, H Frederik

2016-11-01

Natural selection acts on multiple traits simultaneously. How mechanisms underlying such traits enable or constrain their response to simultaneous selection is poorly understood. We show how antagonism and synergism among three traits at the developmental level enable or constrain evolutionary change in response to simultaneous selection on two focal traits at the phenotypic level. After 10 generations of 25% simultaneous directional selection on all four combinations of body size and development time in Manduca sexta (Sphingidae), the changes in the three developmental traits predict 93% of the response of development time and 100% of the response of body size. When the two focal traits were under synergistic selection, the response to simultaneous selection was enabled by juvenile hormone and ecdysteroids and constrained by growth rate. When the two focal traits were under antagonistic selection, the response to selection was due primarily to change in growth rate and constrained by the two hormonal traits. The approach used here reduces the complexity of the developmental and endocrine mechanisms to three proxy traits. This generates explicit predictions for the evolutionary response to selection that are based on biologically informed mechanisms. This approach has broad applicability to a diverse range of taxa, including algae, plants, amphibians, mammals, and insects.

Human factors evaluation of the effectiveness of multi-modality displays in advanced traveler information systems

DOT National Transportation Integrated Search

1999-12-01

To achieve the goals for Advanced Traveler Information Systems (ATIS), significant information will necessarily be provided to the driver. A primary ATIS design issue is the display modality (i.e., visual, auditory, or the combination) selected for p...

Assessment of sidewalk/bicycle-lane gaps with safety and developing statewide pedestrian crash rates.

DOT National Transportation Integrated Search

2016-05-31

Pedestrian and bicycle safety have emerged to be of major concern to federal and selected states in the U.S. With the : increased emphasis on the multimodal transportation, pedestrian and bicycle safety has become more common for : governmental agenc...

Treatment of Childhood Depression: The State of the Art.

ERIC Educational Resources Information Center

Clarizio, Harvey F.

1986-01-01

This article reviews various aspects of seven approaches to the treatment of childhood depression--psychoanalytic, behavioral, cognitive, familial, rational-emotive, multimodal, and drug interventions. Implications for practitioners are considered in terms of target selection, choice of treatment methods, rational evaluation based on developmental…

An Interim Update to the 2035 Socioeconomic and Travel Demand Forecasts for Virginia

DOT National Transportation Integrated Search

2012-10-01

In support of the update to Virginias 2035 Statewide Multimodal Plan, this report provides an update to select : socioeconomic forecasts initially made in 2009 based on a review of data from national sources and the literature. Mobility : needs ex...

An interim update to the 2035 socioeconomic and travel demand forecasts for Virginia.

DOT National Transportation Integrated Search

2012-09-01

"In support of the update to Virginias 2035 Statewide Multimodal Plan, this report provides an update to select : socioeconomic forecasts initially made in 2009 based on a review of data from national sources and the literature. Mobility : needs e...

An interim update to the 2035 socioeconomic and travel demand forecasts for Virginia.

DOT National Transportation Integrated Search

2012-10-01

In support of the update to Virginias 2035 Statewide Multimodal Plan, this report provides an update to select : socioeconomic forecasts initially made in 2009 based on a review of data from national sources and the literature. Mobility : needs ex...

Feature and Score Fusion Based Multiple Classifier Selection for Iris Recognition

PubMed Central

Islam, Md. Rabiul

2014-01-01

The aim of this work is to propose a new feature and score fusion based iris recognition approach where voting method on Multiple Classifier Selection technique has been applied. Four Discrete Hidden Markov Model classifiers output, that is, left iris based unimodal system, right iris based unimodal system, left-right iris feature fusion based multimodal system, and left-right iris likelihood ratio score fusion based multimodal system, is combined using voting method to achieve the final recognition result. CASIA-IrisV4 database has been used to measure the performance of the proposed system with various dimensions. Experimental results show the versatility of the proposed system of four different classifiers with various dimensions. Finally, recognition accuracy of the proposed system has been compared with existing N hamming distance score fusion approach proposed by Ma et al., log-likelihood ratio score fusion approach proposed by Schmid et al., and single level feature fusion approach proposed by Hollingsworth et al. PMID:25114676

Feature and score fusion based multiple classifier selection for iris recognition.

PubMed

Islam, Md Rabiul

2014-01-01

The aim of this work is to propose a new feature and score fusion based iris recognition approach where voting method on Multiple Classifier Selection technique has been applied. Four Discrete Hidden Markov Model classifiers output, that is, left iris based unimodal system, right iris based unimodal system, left-right iris feature fusion based multimodal system, and left-right iris likelihood ratio score fusion based multimodal system, is combined using voting method to achieve the final recognition result. CASIA-IrisV4 database has been used to measure the performance of the proposed system with various dimensions. Experimental results show the versatility of the proposed system of four different classifiers with various dimensions. Finally, recognition accuracy of the proposed system has been compared with existing N hamming distance score fusion approach proposed by Ma et al., log-likelihood ratio score fusion approach proposed by Schmid et al., and single level feature fusion approach proposed by Hollingsworth et al.

Speckle POF sensor for detecting vital signs of patients

NASA Astrophysics Data System (ADS)

Lomer, M.; Rodriguez-Cobo, L.; Revilla, P.; Herrero, G.; Madruga, F.; Lopez-Higuera, J. M.

2014-05-01

In this work, both arterial pulse and respiratory rate have been successfully measured based on changes in speckle patterns of multimode fibers. Using two fiber-based transducers, one located on the wrist and another in the chest, both disturbances were transmitted to the fiber, varying the speckle pattern. These variations of the speckle pattern were captured using a commercial webcam and further processed using different methods. The achieved results have been presented and the simultaneous monitoring of both vital signs has been also discussed. The feasibility to use the proposed sensor system for this application is demonstrated.

FIBER OPTICS. ACOUSTOOPTICS: Amplification of semiconductor laser radiation in the wavelength range 1.24-1.3 μm by stimulated Raman scattering in an optical fiber

NASA Astrophysics Data System (ADS)

Belotitskiĭ, V. I.; Kuzin, E. A.; Ovsyannikov, D. V.; Petrov, Mikhail P.

1990-07-01

An investigation was made of the influence of weak semiconductor laser radiation on the spectrum of stimulated Raman scattering in a single-mode optical waveguide pumped by a YAG:Nd3+ laser emitting at 1.06 μm. The scattered radiation power increased by a factor exceeding 10 at the semiconductor laser wavelength. A small-signal dynamic gain reached 47 dB. Simultaneous amplification was observed of several modes of multimode semiconductor laser radiation with an intermode spectral interval of 1.3 nm.

Note: Motor-piezoelectricity coupling driven high temperature fatigue device

NASA Astrophysics Data System (ADS)

Ma, Z. C.; Du, X. J.; Zhao, H. W.; Ma, X. X.; Jiang, D. Y.; Liu, Y.; Ren, L. Q.

2018-01-01

The design and performance evaluation of a novel high temperature fatigue device simultaneously driven by servo motor and piezoelectric actuator is our focus. The device integrates monotonic and cyclic loading functions with a maximum tensile load of 1800 N, driving frequency of 50 Hz, alternating load of 95 N, and maximum service temperature of 1200 °C. Multimodal fatigue tests with arbitrary combinations of static and dynamic loads are achieved. At temperatures that range from RT to 1100 °C, the tensile and tensile-fatigue coupling mechanical behaviors of UM Co50 alloys are investigated to verify the feasibility of the device.

Nanoparticles for multimodal in vivo imaging in nanomedicine

PubMed Central

Key, Jaehong; Leary, James F

2014-01-01

While nanoparticles are usually designed for targeted drug delivery, they can also simultaneously provide diagnostic information by a variety of in vivo imaging methods. These diagnostic capabilities make use of specific properties of nanoparticle core materials. Near-infrared fluorescent probes provide optical detection of cells targeted by real-time nanoparticle-distribution studies within the organ compartments of live, anesthetized animals. By combining different imaging modalities, we can start with deep-body imaging by magnetic resonance imaging or computed tomography, and by using optical imaging, get down to the resolution required for real-time fluorescence-guided surgery. PMID:24511229

Three-dimensional/two-dimensional multiplanar stereotactic planning system: hardware and software configuration

NASA Astrophysics Data System (ADS)

Zamorano, Lucia J.; Dujovny, Manuel; Ausman, James I.

1990-01-01

"Real time" surgical treatment planning utilizing multimodality imaging (CT, MRI, DA) has been developed to provide the neurosurgeon with 2D multiplanar and 3D views of a patient's lesion for stereotactic planning. Both diagnostic and therapeutic stereotactic procedures have been implemented utilizing workstation (SUN 1/10) and specially developed software and hardware (developed in collaboration with TOMO Medical Imaging Technology, Southfield, MI). This provides complete 3D and 2D free-tilt views as part of the system instrumentation. The 2D Multiplanar includes reformatted sagittal, coronal, paraaxial and free tilt oblique vectors at any arbitrary plane of the patient's lesion. The 3D includes features for extracting a view of the target volume localized by a process including steps of automatic segmentation, thresholding, and/or boundary detection with 3D display of the volumes of interest. The system also includes the capability of interactive playback of reconstructed 3D movies, which can be viewed at any hospital network having compatible software on strategical locations or at remote sites through data transmission and record documentation by image printers. Both 2D and 3D menus include real time stereotactic coordinate measurements and trajectory definition capabilities as well as statistical functions for computing distances, angles, areas, and volumes. A combined interactive 3D-2D multiplanar menu allows simultaneous display of selected trajectory, final optimization, and multiformat 2D display of free-tilt reformatted images perpendicular to selected trajectory of the entire target volume.

Sexual selection in the squirrel treefrog Hyla squirella: the role of multimodal cue assessment in female choice

USGS Publications Warehouse

Taylor, Ryan C.; Buchanan, Bryant W.; Doherty, Jessie L.

2007-01-01

Anuran amphibians have provided an excellent system for the study of animal communication and sexual selection. Studies of female mate choice in anurans, however, have focused almost exclusively on the role of auditory signals. In this study, we examined the effect of both auditory and visual cues on female choice in the squirrel treefrog. Our experiments used a two-choice protocol in which we varied male vocalization properties, visual cues, or both, to assess female preferences for the different cues. Females discriminated against high-frequency calls and expressed a strong preference for calls that contained more energy per unit time (faster call rate). Females expressed a preference for the visual stimulus of a model of a calling male when call properties at the two speakers were held the same. They also showed a significant attraction to a model possessing a relatively large lateral body stripe. These data indicate that visual cues do play a role in mate attraction in this nocturnal frog species. Furthermore, this study adds to a growing body of evidence that suggests that multimodal signals play an important role in sexual selection.

Analysis of the Connect Oregon program through two project selection cycles : final report, August 2009.

DOT National Transportation Integrated Search

2009-08-01

The Oregon Legislature passed a law establishing the Multimodal Transportation Fund in 2005. The fund was part of what : became known as the ConnectOregon program, with the purpose of making public and private investments in aviation, : marine, rail,...

Multimodal human communication--targeting facial expressions, speech content and prosody.

PubMed

Regenbogen, Christina; Schneider, Daniel A; Gur, Raquel E; Schneider, Frank; Habel, Ute; Kellermann, Thilo

2012-05-01

Human communication is based on a dynamic information exchange of the communication channels facial expressions, prosody, and speech content. This fMRI study elucidated the impact of multimodal emotion processing and the specific contribution of each channel on behavioral empathy and its prerequisites. Ninety-six video clips displaying actors who told self-related stories were presented to 27 healthy participants. In two conditions, all channels uniformly transported only emotional or neutral information. Three conditions selectively presented two emotional channels and one neutral channel. Subjects indicated the actors' emotional valence and their own while fMRI was recorded. Activation patterns of tri-channel emotional communication reflected multimodal processing and facilitative effects for empathy. Accordingly, subjects' behavioral empathy rates significantly deteriorated once one source was neutral. However, emotionality expressed via two of three channels yielded activation in a network associated with theory-of-mind-processes. This suggested participants' effort to infer mental states of their counterparts and was accompanied by a decline of behavioral empathy, driven by the participants' emotional responses. Channel-specific emotional contributions were present in modality-specific areas. The identification of different network-nodes associated with human interactions constitutes a prerequisite for understanding dynamics that underlie multimodal integration and explain the observed decline in empathy rates. This task might also shed light on behavioral deficits and neural changes that accompany psychiatric diseases. Copyright © 2012 Elsevier Inc. All rights reserved.

The Intersection of Multimodality and Critical Perspective: Multimodality as Subversion

ERIC Educational Resources Information Center

Huang, Shin-ying

2015-01-01

This study explores the relevance of multimodality to critical media literacy. It is based on the understanding that communication is intrinsically multimodal and multimodal communication is inherently social and ideological. By analysing two English-language learners' multimodal ensembles, the study reports on how multimodality contributes to a…

Sulfonyl-containing modulators of serotonin 5-HT6 receptors and their pharmacophore models

NASA Astrophysics Data System (ADS)

Ivachtchenko, A. V.

2014-05-01

Data published in recent years on the synthesis of serotonin 5-HT6 receptor modulators are summarized. Modulators with high affinity for 5-HT6 receptors exhibiting different degrees of selectivity — from highly selective to semiselective and multimodal — are described. Clinical trial results are reported for the most promising serotonin 5-HT6 receptor modulators attracting special attention of medicinal chemists. The bibliography includes 128 references.

Introduction of a standardized multimodality image protocol for navigation-guided surgery of suspected low-grade gliomas.

PubMed

Mert, Aygül; Kiesel, Barbara; Wöhrer, Adelheid; Martínez-Moreno, Mauricio; Minchev, Georgi; Furtner, Julia; Knosp, Engelbert; Wolfsberger, Stefan; Widhalm, Georg

2015-01-01

OBJECT Surgery of suspected low-grade gliomas (LGGs) poses a special challenge for neurosurgeons due to their diffusely infiltrative growth and histopathological heterogeneity. Consequently, neuronavigation with multimodality imaging data, such as structural and metabolic data, fiber tracking, and 3D brain visualization, has been proposed to optimize surgery. However, currently no standardized protocol has been established for multimodality imaging data in modern glioma surgery. The aim of this study was therefore to define a specific protocol for multimodality imaging and navigation for suspected LGG. METHODS Fifty-one patients who underwent surgery for a diffusely infiltrating glioma with nonsignificant contrast enhancement on MRI and available multimodality imaging data were included. In the first 40 patients with glioma, the authors retrospectively reviewed the imaging data, including structural MRI (contrast-enhanced T1-weighted, T2-weighted, and FLAIR sequences), metabolic images derived from PET, or MR spectroscopy chemical shift imaging, fiber tracking, and 3D brain surface/vessel visualization, to define standardized image settings and specific indications for each imaging modality. The feasibility and surgical relevance of this new protocol was subsequently prospectively investigated during surgery with the assistance of an advanced electromagnetic navigation system in the remaining 11 patients. Furthermore, specific surgical outcome parameters, including the extent of resection, histological analysis of the metabolic hotspot, presence of a new postoperative neurological deficit, and intraoperative accuracy of 3D brain visualization models, were assessed in each of these patients. RESULTS After reviewing these first 40 cases of glioma, the authors defined a specific protocol with standardized image settings and specific indications that allows for optimal and simultaneous visualization of structural and metabolic data, fiber tracking, and 3D brain visualization. This new protocol was feasible and was estimated to be surgically relevant during navigation-guided surgery in all 11 patients. According to the authors' predefined surgical outcome parameters, they observed a complete resection in all resectable gliomas (n = 5) by using contour visualization with T2-weighted or FLAIR images. Additionally, tumor tissue derived from the metabolic hotspot showed the presence of malignant tissue in all WHO Grade III or IV gliomas (n = 5). Moreover, no permanent postoperative neurological deficits occurred in any of these patients, and fiber tracking and/or intraoperative monitoring were applied during surgery in the vast majority of cases (n = 10). Furthermore, the authors found a significant intraoperative topographical correlation of 3D brain surface and vessel models with gyral anatomy and superficial vessels. Finally, real-time navigation with multimodality imaging data using the advanced electromagnetic navigation system was found to be useful for precise guidance to surgical targets, such as the tumor margin or the metabolic hotspot. CONCLUSIONS In this study, the authors defined a specific protocol for multimodality imaging data in suspected LGGs, and they propose the application of this new protocol for advanced navigation-guided procedures optimally in conjunction with continuous electromagnetic instrument tracking to optimize glioma surgery.

Multimodal hyperspectral optical microscopy

DOE PAGES

Novikova, Irina V.; Smallwood, Chuck R.; Gong, Yu; ...

2017-09-02

We describe a unique and convenient approach to multimodal hyperspectral optical microscopy, herein achieved by coupling a portable and transferable hyperspectral imager to various optical microscopes. The experimental and data analysis schemes involved in recording spectrally and spatially resolved fluorescence, dark field, and optical absorption micrographs are illustrated through prototypical measurements targeting selected model systems. Namely, hyperspectral fluorescence micrographs of isolated fluorescent beads are employed to ensure spectral calibration of our detector and to gauge the attainable spatial resolution of our measurements; the recorded images are diffraction-limited. Moreover, spatially over-sampled absorption spectroscopy of a single lipid (18:1 Liss Rhod PE)more » layer reveals that optical densities on the order of 10-3 may be resolved by spatially averaging the recorded optical signatures. We also briefly illustrate two applications of our setup in the general areas of plasmonics and cell biology. Most notably, we deploy hyperspectral optical absorption microscopy to identify and image algal pigments within a single live Tisochrysis lutea cell. Overall, this work paves the way for multimodal multidimensional spectral imaging measurements spanning the realms of several scientific disciples.« less

Planar waveguide sensor of ammonia

NASA Astrophysics Data System (ADS)

Rogoziński, Roman; Tyszkiewicz, Cuma; Karasiński, Paweł; Izydorczyk, Weronika

2015-12-01

The paper presents the concept of forming ammonia sensor based on a planar waveguide structure. It is an amplitude sensor produced on the basis of the multimode waveguide. The technological base for this kind of structure is the ion exchange method and the sol-gel method. The planar multimode waveguide of channel type is produced in glass substrate (soda-lime glass of Menzel-Glaser company) by the selective Ag+↔Na+ ion exchange. On the surface of the glass substrate a porous (~40%) silica layer is produced by the sol-gel method. This layer is sensitized to the presence of ammonia in the surrounding atmosphere by impregnation with Bromocresol Purple (BCP) dye. Therefore it constitutes a sensor layer. Spectrophotometric tests carried out showed about 50% reduction of cross-transmission changes of such sensor layer for a wave λ=593 nm caused by the presence of 25% ammonia water vapor in its ambience. The radiation source used in this type of sensor structure is a light emitting diode LED. The gradient channel waveguide is designed for frontal connection (optical glue) with a standard multimode telecommunications waveguide 62.5/125μm.

Optimal Modality Selection for Cooperative Human-Robot Task Completion.

PubMed

Jacob, Mithun George; Wachs, Juan P

2016-12-01

Human-robot cooperation in complex environments must be fast, accurate, and resilient. This requires efficient communication channels where robots need to assimilate information using a plethora of verbal and nonverbal modalities such as hand gestures, speech, and gaze. However, even though hybrid human-robot communication frameworks and multimodal communication have been studied, a systematic methodology for designing multimodal interfaces does not exist. This paper addresses the gap by proposing a novel methodology to generate multimodal lexicons which maximizes multiple performance metrics over a wide range of communication modalities (i.e., lexicons). The metrics are obtained through a mixture of simulation and real-world experiments. The methodology is tested in a surgical setting where a robot cooperates with a surgeon to complete a mock abdominal incision and closure task by delivering surgical instruments. Experimental results show that predicted optimal lexicons significantly outperform predicted suboptimal lexicons (p <; 0.05) in all metrics validating the predictability of the methodology. The methodology is validated in two scenarios (with and without modeling the risk of a human-robot collision) and the differences in the lexicons are analyzed.

Non-responders to cardiac resynchronization therapy: Insights from multimodality imaging and electrocardiography. A brief review.

PubMed

Carità, Patrizia; Corrado, Egle; Pontone, Gianluca; Curnis, Antonio; Bontempi, Luca; Novo, Giuseppina; Guglielmo, Marco; Ciaramitaro, Gianfranco; Assennato, Pasquale; Novo, Salvatore; Coppola, Giuseppe

2016-12-15

Cardiac resynchronization therapy (CRT) is a successful strategy for heart failure (HF) patients. The pre-requisite for the response is the evidence of electrical dyssynchrony on the surface electrocardiogram usually as left bundle branch block (LBBB). Non-response to CRT is a significant problem in clinical practice. Patient selection, inadequate delivery and sub-optimal left ventricle lead position may be important causes. In an effort to improve CRT response multimodality imaging (especially echocardiography, computed tomography and cardiac magnetic resonance) could play a decisive role and extensive literature has been published on the matter. However, we are so far from routinary use in clinical practice. Electrocardiography (with respect to left ventricle capture and QRS narrowing) may represent a simple and low cost approach for early prediction of potential non-responder, with immediate practical implications. This brief review covers the current recommendations for CRT in HF patients with particular attention to the potential benefits of multimodality imaging and electrocardiography in improving response rate. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Multimodal hyperspectral optical microscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Novikova, Irina V.; Smallwood, Chuck R.; Gong, Yu

We describe a unique and convenient approach to multimodal hyperspectral optical microscopy, herein achieved by coupling a portable and transferable hyperspectral imager to various optical microscopes. The experimental and data analysis schemes involved in recording spectrally and spatially resolved fluorescence, dark field, and optical absorption micrographs are illustrated through prototypical measurements targeting selected model systems. Namely, hyperspectral fluorescence micrographs of isolated fluorescent beads are employed to ensure spectral calibration of our detector and to gauge the attainable spatial resolution of our measurements; the recorded images are diffraction-limited. Moreover, spatially over-sampled absorption spectroscopy of a single lipid (18:1 Liss Rhod PE)more » layer reveals that optical densities on the order of 10-3 may be resolved by spatially averaging the recorded optical signatures. We also briefly illustrate two applications of our setup in the general areas of plasmonics and cell biology. Most notably, we deploy hyperspectral optical absorption microscopy to identify and image algal pigments within a single live Tisochrysis lutea cell. Overall, this work paves the way for multimodal multidimensional spectral imaging measurements spanning the realms of several scientific disciples.« less

Nanoelectronics enabled chronic multimodal neural platform in a mouse ischemic model

PubMed Central

Luan, Lan; Sullender, Colin T.; Li, Xue; Zhao, Zhengtuo; Zhu, Hanlin; Wei, Xiaoling; Xie, Chong; Dunn, Andrew K.

2018-01-01

Background Despite significant advancements of optical imaging techniques for mapping hemodynamics in small animal models, it remains challenging to combine imaging with spatially resolved electrical recording of individual neurons especially for longitudinal studies. This is largely due to the strong invasiveness to the living brain from the penetrating electrodes and their limited compatibility with longitudinal imaging. New Method We implant arrays of ultraflexible nanoelectronic threads (NETs) in mice for neural recording both at the brain surface and intracortically, which maintain great tissue compatibility chronically. By mounting a cranial window atop of the NET arrays that allows for chronic optical access, we establish a multimodal platform that combines spatially resolved electrical recording of neural activity and laser speckle contrast imaging (LSCI) of cerebral blood flow (CBF) for longitudinal studies. Results We induce peri-infarct depolarizations (PIDs) by targeted photothrombosis, and show the ability to detect its occurrence and propagation through spatiotemporal variations in both extracellular potentials and CBF. We also demonstrate chronic tracking of single-unit neural activity and CBF over days after photothrombosis, from which we observe reperfusion and increased firing rates. Comparison with Existing Method(s) This multimodal platform enables simultaneous mapping of neural activity and hemodynamic parameters at the microscale for quantitative, longitudinal comparisons with minimal perturbation to the baseline neurophysiology. Conclusion The ability to spatiotemporally resolve and chronically track CBF and neural electrical activity in the same living brain region has broad applications for studying the interplay between neural and hemodynamic responses in health and in cerebrovascular and neurological pathologies. PMID:29203409

Tractography-Based Score for Learning Effective Connectivity From Multimodal Imaging Data Using Dynamic Bayesian Networks.

PubMed

Dang, Shilpa; Chaudhury, Santanu; Lall, Brejesh; Roy, Prasun K

2018-05-01

Effective connectivity (EC) is the methodology for determining functional-integration among the functionally active segregated regions of the brain. By definition EC is "the causal influence exerted by one neuronal group on another" which is constrained by anatomical connectivity (AC) (axonal connections). AC is necessary for EC but does not fully determine it, because synaptic communication occurs dynamically in a context-dependent fashion. Although there is a vast emerging evidence of structure-function relationship using multimodal imaging studies, till date only a few studies have done joint modeling of the two modalities: functional MRI (fMRI) and diffusion tensor imaging (DTI). We aim to propose a unified probabilistic framework that combines information from both sources to learn EC using dynamic Bayesian networks (DBNs). DBNs are probabilistic graphical temporal models that learn EC in an exploratory fashion. Specifically, we propose a novel anatomically informed (AI) score that evaluates fitness of a given connectivity structure to both DTI and fMRI data simultaneously. The AI score is employed in structure learning of DBN given the data. Experiments with synthetic-data demonstrate the face validity of structure learning with our AI score over anatomically uninformed counterpart. Moreover, real-data results are cross-validated by performing classification-experiments. EC inferred on real fMRI-DTI datasets is found to be consistent with previous literature and show promising results in light of the AC present as compared to other classically used techniques such as Granger-causality. Multimodal analyses provide a more reliable basis for differentiating brain under abnormal/diseased conditions than the single modality analysis.

Linked independent component analysis for multimodal data fusion.

PubMed

Groves, Adrian R; Beckmann, Christian F; Smith, Steve M; Woolrich, Mark W

2011-02-01

In recent years, neuroimaging studies have increasingly been acquiring multiple modalities of data and searching for task- or disease-related changes in each modality separately. A major challenge in analysis is to find systematic approaches for fusing these differing data types together to automatically find patterns of related changes across multiple modalities, when they exist. Independent Component Analysis (ICA) is a popular unsupervised learning method that can be used to find the modes of variation in neuroimaging data across a group of subjects. When multimodal data is acquired for the subjects, ICA is typically performed separately on each modality, leading to incompatible decompositions across modalities. Using a modular Bayesian framework, we develop a novel "Linked ICA" model for simultaneously modelling and discovering common features across multiple modalities, which can potentially have completely different units, signal- and contrast-to-noise ratios, voxel counts, spatial smoothnesses and intensity distributions. Furthermore, this general model can be configured to allow tensor ICA or spatially-concatenated ICA decompositions, or a combination of both at the same time. Linked ICA automatically determines the optimal weighting of each modality, and also can detect single-modality structured components when present. This is a fully probabilistic approach, implemented using Variational Bayes. We evaluate the method on simulated multimodal data sets, as well as on a real data set of Alzheimer's patients and age-matched controls that combines two very different types of structural MRI data: morphological data (grey matter density) and diffusion data (fractional anisotropy, mean diffusivity, and tensor mode). Copyright © 2010 Elsevier Inc. All rights reserved.

Fiber array based hyperspectral Raman imaging for chemical selective analysis of malaria-infected red blood cells.

PubMed

Brückner, Michael; Becker, Katja; Popp, Jürgen; Frosch, Torsten

2015-09-24

A new setup for Raman spectroscopic wide-field imaging is presented. It combines the advantages of a fiber array based spectral translator with a tailor-made laser illumination system for high-quality Raman chemical imaging of sensitive biological samples. The Gaussian-like intensity distribution of the illuminating laser beam is shaped by a square-core optical multimode fiber to a top-hat profile with very homogeneous intensity distribution to fulfill the conditions of Koehler. The 30 m long optical fiber and an additional vibrator efficiently destroy the polarization and coherence of the illuminating light. This homogeneous, incoherent illumination is an essential prerequisite for stable quantitative imaging of complex biological samples. The fiber array translates the two-dimensional lateral information of the Raman stray light into separated spectral channels with very high contrast. The Raman image can be correlated with a corresponding white light microscopic image of the sample. The new setup enables simultaneous quantification of all Raman spectra across the whole spatial area with very good spectral resolution and thus outperforms other Raman imaging approaches based on scanning and tunable filters. The unique capabilities of the setup for fast, gentle, sensitive, and selective chemical imaging of biological samples were applied for automated hemozoin analysis. A special algorithm was developed to generate Raman images based on the hemozoin distribution in red blood cells without any influence from other Raman scattering. The new imaging setup in combination with the robust algorithm provides a novel, elegant way for chemical selective analysis of the malaria pigment hemozoin in early ring stages of Plasmodium falciparum infected erythrocytes. Copyright © 2015 Elsevier B.V. All rights reserved.

On the feasibility of concurrent human TMS-EEG-fMRI measurements

PubMed Central

Reithler, Joel; Schuhmann, Teresa; de Graaf, Tom; Uludağ, Kâmil; Goebel, Rainer; Sack, Alexander T.

2013-01-01

Simultaneously combining the complementary assets of EEG, functional MRI (fMRI), and transcranial magnetic stimulation (TMS) within one experimental session provides synergetic results, offering insights into brain function that go beyond the scope of each method when used in isolation. The steady increase of concurrent EEG-fMRI, TMS-EEG, and TMS-fMRI studies further underlines the added value of such multimodal imaging approaches. Whereas concurrent EEG-fMRI enables monitoring of brain-wide network dynamics with high temporal and spatial resolution, the combination with TMS provides insights in causal interactions within these networks. Thus the simultaneous use of all three methods would allow studying fast, spatially accurate, and distributed causal interactions in the perturbed system and its functional relevance for intact behavior. Concurrent EEG-fMRI, TMS-EEG, and TMS-fMRI experiments are already technically challenging, and the three-way combination of TMS-EEG-fMRI might yield additional difficulties in terms of hardware strain or signal quality. The present study explored the feasibility of concurrent TMS-EEG-fMRI studies by performing safety and quality assurance tests based on phantom and human data combining existing commercially available hardware. Results revealed that combined TMS-EEG-fMRI measurements were technically feasible, safe in terms of induced temperature changes, allowed functional MRI acquisition with comparable image quality as during concurrent EEG-fMRI or TMS-fMRI, and provided artifact-free EEG before and from 300 ms after TMS pulse application. Based on these empirical findings, we discuss the conceptual benefits of this novel complementary approach to investigate the working human brain and list a number of precautions and caveats to be heeded when setting up such multimodal imaging facilities with current hardware. PMID:23221407

Compact fixed wavelength femtosecond oscillators as an add-on for tunable Ti:sapphire lasers extend the range of applications towards multimodal imaging and optogenetics

NASA Astrophysics Data System (ADS)

Hakulinen, T.; Klein, J.

2016-03-01

Two-photon (2P) microscopy based on tunable Ti:sapphire lasers has become a widespread tool for 3D imaging with sub-cellular resolution in living tissues. In recent years multi-photon microscopy with simpler fixed-wavelength femtosecond oscillators using Yb-doped tungstenates as gain material has raised increasing interest in life-sciences, because these lasers offer one order of magnitude more average power than Ti:sapphire lasers in the wavelength range around 1040 nm: Two-photon (2P) excitation of mainly red or yellow fluorescent dyes and proteins (e.g. YFP, mFruit series) simultaneously has been proven with a single IR laser wavelength. A new approach is to extend the usability of existing tunable Titanium sapphire lasers by adding a fixed IR wavelength with an Yb femtosecond oscillator. By that means a multitude of applications for multimodal imaging and optogenetics can be supported. Furthermore fs Yb-lasers are available with a repetition rate of typically 10 MHz and an average power of typically 5 W resulting in pulse energy of typically 500 nJ, which is comparably high for fs-oscillators. This makes them an ideal tool for two-photon spinning disk laser scanning microscopy and holographic patterning for simultaneous photoactivation of large cell populations. With this work we demonstrate that economical, small-footprint Yb fixed-wavelength lasers can present an interesting add-on to tunable lasers that are commonly used in multiphoton microscopy. The Yb fs-lasers hereby offer higher power for imaging of red fluorescent dyes and proteins, are ideally enhancing existing Ti:sapphire lasers with more power in the IR, and are supporting pulse energy and power hungry applications such as spinning disk microscopy and holographic patterning.

Perspectives on How Human Simultaneous Multi-Modal Imaging Adds Directionality to Spread Models of Alzheimer’s Disease

PubMed Central

Neitzel, Julia; Nuttall, Rachel; Sorg, Christian

2018-01-01

Previous animal research suggests that the spread of pathological agents in Alzheimer’s disease (AD) follows the direction of signaling pathways. Specifically, tau pathology has been suggested to propagate in an infection-like mode along axons, from transentorhinal cortices to medial temporal lobe cortices and consequently to other cortical regions, while amyloid-beta (Aβ) pathology seems to spread in an activity-dependent manner among and from isocortical regions into limbic and then subcortical regions. These directed connectivity-based spread models, however, have not been tested directly in AD patients due to the lack of an in vivo method to identify directed connectivity in humans. Recently, a new method—metabolic connectivity mapping (MCM)—has been developed and validated in healthy participants that uses simultaneous FDG-PET and resting-state fMRI data acquisition to identify directed intrinsic effective connectivity (EC). To this end, postsynaptic energy consumption (FDG-PET) is used to identify regions with afferent input from other functionally connected brain regions (resting-state fMRI). Here, we discuss how this multi-modal imaging approach allows quantitative, whole-brain mapping of signaling direction in AD patients, thereby pointing out some of the advantages it offers compared to other EC methods (i.e., Granger causality, dynamic causal modeling, Bayesian networks). Most importantly, MCM provides the basis on which models of pathology spread, derived from animal studies, can be tested in AD patients. In particular, future work should investigate whether tau and Aβ in humans propagate along the trajectories of directed connectivity in order to advance our understanding of the neuropathological mechanisms causing disease progression. PMID:29434570

Comprehensive framework for sustainable container ports development on the US east coast in the 21st century, year two

DOT National Transportation Integrated Search

2002-08-01

Building upon the conceptual framework developed during our year one research, a container port and multimodal transportation demand simulation model is applied. The model selects the least-cost (vessel-port-rail-truck) route from sources to markets,...

Experimental study on the statistic characteristics of a 3x3 RF MIMO channel over a single conventional multimode fiber.

PubMed

Lei, Yi; Li, Jianqiang; Wu, Rui; Fan, Yuting; Fu, Songnian; Yin, Feifei; Dai, Yitang; Xu, Kun

2017-06-01

Based on the observed random fluctuation phenomenon of speckle pattern across multimode fiber (MMF) facet and received optical power distribution across three output ports, we experimentally investigate the statistic characteristics of a 3×3 radio frequency multiple-input multiple-output (MIMO) channel enabled by mode division multiplexing in a conventional 50 µm MMF using non-mode-selective three-dimensional waveguide photonic lanterns as mode multiplexer and demultiplexer. The impacts of mode coupling on the MIMO channel coefficients, channel matrix, and channel capacity have been analyzed over different fiber lengths. The results indicate that spatial multiplexing benefits from the greater fiber length with stronger mode coupling, despite a higher optical loss.

Multimodal Interfaces: Literature Review of Ecological Interface Design, Multimodal Perception and Attention, and Intelligent Adaptive Multimodal Interfaces

DTIC Science & Technology

2010-05-01

Multimodal Interfaces Literature Review of Ecological Interface Design , Multimodal Perception and Attention, and Intelligent... Design , Multimodal Perception and Attention, and Intelligent Adaptive Multimodal Interfaces Wayne Giang, Sathya Santhakumaran, Ehsan Masnavi, Doug...Advanced Interface Design Laboratory, E2-1303N 200 University Avenue West Waterloo, Ontario Canada N2L 3G1 Contract Project Manager: Dr. Catherine

Laser a balayage spectral double-bande pour l'imagerie biomedicale multimodale

NASA Astrophysics Data System (ADS)

Goulamhoussen, Nadir

A novel swept laser providing simultaneous dual-band (780nm and 1 300 nm) wavelength scanning has been designed for use in multimodal imaging systems. The swept laser is based on two gain media : a fibered semiconductor optical amplifier (SOA) centered at 1 300nm and a free-space laser diode centered at 780 nm. Simultaneous wavelength tuning for both bands is obtained by separate wavelength filters set up around the same rotating polygonal mirror. For each band, a telescope in an infinite conjugate setup converges the wavelengths dispersed by a grating on the polygon. The polygon reflects back a narrow band of wavelengths for amplification in the gain medium. Rotating the polygon enables wavelength tuning and imaging at a rate of 6 000 to 30 000 spectral lines/s, or A-lines/s in Optical Coherence Tomography (OCT). The 780nm source has a bandwidth of 37 nm, a fibered output power of 54 mW and a coherence length of 11 mm. The 1 300nm source has a bandwidth of 75 nm, a fibered output power of 17mW and a coherence length of 7.2 mm. Three multimodal systems were designed to test the potential of the swept laser in biomedical imaging. A two color OCT which allows three-dimensional in depth imaging of biological tissues with good morphological contrast was first designed, including a novel arrangement for balanced detection in both bands. A simultaneous OCT and SECM instrument was also built in which spectrally encoded confocal microscopy (SECM) provides en face images of subcellular features with high resolution on top of the 3D high penetration image obtained by OCT. Finally, a system combining OCT with fluorescence was designed, thus adding functional imaging to structural OCT images. There are many prospective paths for these three modalities, first among them the adaptation of the systems such that they may be used with imaging probes. One potential solution would be the development of novel fiber components to combine the illumination of theses modalities while demultiplexing their detection, and as would be the development of new optomechanics to enable 3D real-time in vivo imaging.

A reprogrammable multifunctional chalcogenide guided-wave lens.

PubMed

Cao, Tun; Wei, Chen-Wei; Cen, Meng-Jia; Guo, Bao; Kim, Yong-June; Zhang, Shuang; Qiu, Cheng-Wei

2018-06-05

The transformation optics (TO) technique, which establishes an equivalence between a curved space and a spatial distribution of inhomogeneous constitutive parameters, has enabled an extraordinary paradigm for manipulating wave propagation. However, extreme constitutive parameters, as well as a static nature, inherently limit the simultaneous achievement of broadband performance, ultrafast reconfigurability and versatile reprogrammable functions. Here, we integrate the TO technique with an active phase-change chalcogenide to achieve a reconfigurable multi-mode guided-wave lens. The lens is made of a Rinehart-shaped curved waveguide with an effective refractive index gradient profile through partially crystallizing Ge2Sb2Te5. Upon changing the bias time of the external voltage imparted to the Ge2Sb2Te5 segments, the refractive index gradient profile can be tuned with a transformative platform for various functions for visible light. The electrically reprogrammable multi-mode guided-wave lens is capable of dynamically acquiring various functionalities with an ultrafast response time. Our findings may offer a significant step forward by providing a universal method to obtain ultrafast and highly versatile guided-wave manipulation, such as in Einstein rings, cloaking, Maxwell fish-eye lenses and Luneburg lenses.

CREMA-D: Crowd-sourced Emotional Multimodal Actors Dataset

PubMed Central

Cao, Houwei; Cooper, David G.; Keutmann, Michael K.; Gur, Ruben C.; Nenkova, Ani; Verma, Ragini

2014-01-01

People convey their emotional state in their face and voice. We present an audio-visual data set uniquely suited for the study of multi-modal emotion expression and perception. The data set consists of facial and vocal emotional expressions in sentences spoken in a range of basic emotional states (happy, sad, anger, fear, disgust, and neutral). 7,442 clips of 91 actors with diverse ethnic backgrounds were rated by multiple raters in three modalities: audio, visual, and audio-visual. Categorical emotion labels and real-value intensity values for the perceived emotion were collected using crowd-sourcing from 2,443 raters. The human recognition of intended emotion for the audio-only, visual-only, and audio-visual data are 40.9%, 58.2% and 63.6% respectively. Recognition rates are highest for neutral, followed by happy, anger, disgust, fear, and sad. Average intensity levels of emotion are rated highest for visual-only perception. The accurate recognition of disgust and fear requires simultaneous audio-visual cues, while anger and happiness can be well recognized based on evidence from a single modality. The large dataset we introduce can be used to probe other questions concerning the audio-visual perception of emotion. PMID:25653738

Large field of view, fast and low dose multimodal phase-contrast imaging at high x-ray energy.

PubMed

Astolfo, Alberto; Endrizzi, Marco; Vittoria, Fabio A; Diemoz, Paul C; Price, Benjamin; Haig, Ian; Olivo, Alessandro

2017-05-19

X-ray phase contrast imaging (XPCI) is an innovative imaging technique which extends the contrast capabilities of 'conventional' absorption based x-ray systems. However, so far all XPCI implementations have suffered from one or more of the following limitations: low x-ray energies, small field of view (FOV) and long acquisition times. Those limitations relegated XPCI to a 'research-only' technique with an uncertain future in terms of large scale, high impact applications. We recently succeeded in designing, realizing and testing an XPCI system, which achieves significant steps toward simultaneously overcoming these limitations. Our system combines, for the first time, large FOV, high energy and fast scanning. Importantly, it is capable of providing high image quality at low x-ray doses, compatible with or even below those currently used in medical imaging. This extends the use of XPCI to areas which were unpractical or even inaccessible to previous XPCI solutions. We expect this will enable a long overdue translation into application fields such as security screening, industrial inspections and large FOV medical radiography - all with the inherent advantages of the XPCI multimodality.

Design and implementation of a contactless multiple hand feature acquisition system

NASA Astrophysics Data System (ADS)

Zhao, Qiushi; Bu, Wei; Wu, Xiangqian; Zhang, David

2012-06-01

In this work, an integrated contactless multiple hand feature acquisition system is designed. The system can capture palmprint, palm vein, and palm dorsal vein images simultaneously. Moreover, the images are captured in a contactless manner, that is, users need not to touch any part of the device when capturing. Palmprint is imaged under visible illumination while palm vein and palm dorsal vein are imaged under near infrared (NIR) illumination. The capturing is controlled by computer and the whole process is less than 1 second, which is sufficient for online biometric systems. Based on this device, this paper also implements a contactless hand-based multimodal biometric system. Palmprint, palm vein, palm dorsal vein, finger vein, and hand geometry features are extracted from the captured images. After similarity measure, the matching scores are fused using weighted sum fusion rule. Experimental results show that although the verification accuracy of each uni-modality is not as high as that of state-of-the-art, the fusion result is superior to most of the existing hand-based biometric systems. This result indicates that the proposed device is competent in the application of contactless multimodal hand-based biometrics.

The biometric recognition on contactless multi-spectrum finger images

NASA Astrophysics Data System (ADS)

Kang, Wenxiong; Chen, Xiaopeng; Wu, Qiuxia

2015-01-01

This paper presents a novel multimodal biometric system based on contactless multi-spectrum finger images, which aims to deal with the limitations of unimodal biometrics. The chief merits of the system are the richness of the permissible texture and the ease of data access. We constructed a multi-spectrum instrument to simultaneously acquire three different types of biometrics from a finger: contactless fingerprint, finger vein, and knuckleprint. On the basis of the samples with these characteristics, a moderate database was built for the evaluation of our system. Considering the real-time requirements and the respective characteristics of the three biometrics, the block local binary patterns algorithm was used to extract features and match for the fingerprints and finger veins, while the Oriented FAST and Rotated BRIEF algorithm was applied for knuckleprints. Finally, score-level fusion was performed on the matching results from the aforementioned three types of biometrics. The experiments showed that our proposed multimodal biometric recognition system achieves an equal error rate of 0.109%, which is 88.9%, 94.6%, and 89.7% lower than the individual fingerprint, knuckleprint, and finger vein recognitions, respectively. Nevertheless, our proposed system also satisfies the real-time requirements of the applications.

How to Build a Hybrid Neurofeedback Platform Combining EEG and fMRI

PubMed Central

Mano, Marsel; Lécuyer, Anatole; Bannier, Elise; Perronnet, Lorraine; Noorzadeh, Saman; Barillot, Christian

2017-01-01

Multimodal neurofeedback estimates brain activity using information acquired with more than one neurosignal measurement technology. In this paper we describe how to set up and use a hybrid platform based on simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), then we illustrate how to use it for conducting bimodal neurofeedback experiments. The paper is intended for those willing to build a multimodal neurofeedback system, to guide them through the different steps of the design, setup, and experimental applications, and help them choose a suitable hardware and software configuration. Furthermore, it reports practical information from bimodal neurofeedback experiments conducted in our lab. The platform presented here has a modular parallel processing architecture that promotes real-time signal processing performance and simple future addition and/or replacement of processing modules. Various unimodal and bimodal neurofeedback experiments conducted in our lab showed high performance and accuracy. Currently, the platform is able to provide neurofeedback based on electroencephalography and functional magnetic resonance imaging, but the architecture and the working principles described here are valid for any other combination of two or more real-time brain activity measurement technologies. PMID:28377691

Sex allocation and investment into pre- and post-copulatory traits in simultaneous hermaphrodites: the role of polyandry and local sperm competition.

PubMed

Schärer, Lukas; Pen, Ido

2013-03-05

Sex allocation theory predicts the optimal allocation to male and female reproduction in sexual organisms. In animals, most work on sex allocation has focused on species with separate sexes and our understanding of simultaneous hermaphrodites is patchier. Recent theory predicts that sex allocation in simultaneous hermaphrodites should strongly be affected by post-copulatory sexual selection, while the role of pre-copulatory sexual selection is much less clear. Here, we review sex allocation and sexual selection theory for simultaneous hermaphrodites, and identify several strong and potentially unwarranted assumptions. We then present a model that treats allocation to sexually selected traits as components of sex allocation and explore patterns of allocation when some of these assumptions are relaxed. For example, when investment into a male sexually selected trait leads to skews in sperm competition, causing local sperm competition, this is expected to lead to a reduced allocation to sperm production. We conclude that understanding the evolution of sex allocation in simultaneous hermaphrodites requires detailed knowledge of the different sexual selection processes and their relative importance. However, little is currently known quantitatively about sexual selection in simultaneous hermaphrodites, about what the underlying traits are, and about what drives and constrains their evolution. Future work should therefore aim at quantifying sexual selection and identifying the underlying traits along the pre- to post-copulatory axis.

Sex allocation and investment into pre- and post-copulatory traits in simultaneous hermaphrodites: the role of polyandry and local sperm competition

PubMed Central

Schärer, Lukas; Pen, Ido

2013-01-01

Sex allocation theory predicts the optimal allocation to male and female reproduction in sexual organisms. In animals, most work on sex allocation has focused on species with separate sexes and our understanding of simultaneous hermaphrodites is patchier. Recent theory predicts that sex allocation in simultaneous hermaphrodites should strongly be affected by post-copulatory sexual selection, while the role of pre-copulatory sexual selection is much less clear. Here, we review sex allocation and sexual selection theory for simultaneous hermaphrodites, and identify several strong and potentially unwarranted assumptions. We then present a model that treats allocation to sexually selected traits as components of sex allocation and explore patterns of allocation when some of these assumptions are relaxed. For example, when investment into a male sexually selected trait leads to skews in sperm competition, causing local sperm competition, this is expected to lead to a reduced allocation to sperm production. We conclude that understanding the evolution of sex allocation in simultaneous hermaphrodites requires detailed knowledge of the different sexual selection processes and their relative importance. However, little is currently known quantitatively about sexual selection in simultaneous hermaphrodites, about what the underlying traits are, and about what drives and constrains their evolution. Future work should therefore aim at quantifying sexual selection and identifying the underlying traits along the pre- to post-copulatory axis. PMID:23339243

Artifact mitigation of ptychography integrated with on-the-fly scanning probe microscopy

DOE PAGES

Huang, Xiaojing; Yan, Hanfei; Ge, Mingyuan; ...

2017-07-11

In this paper, we report our experiences with conducting ptychography simultaneously with the X-ray fluorescence measurement using the on-the-fly mode for efficient multi-modality imaging. We demonstrate that the periodic artifact inherent to the raster scan pattern can be mitigated using a sufficiently fine scan step size to provide an overlap ratio of >70%. This allows us to obtain transmitted phase contrast images with enhanced spatial resolution from ptychography while maintaining the fluorescence imaging with continuous-motion scans on pixelated grids. Lastly, this capability will greatly improve the competence and throughput of scanning probe X-ray microscopy.

Tracking of multimodal therapeutic nanocomplexes targeting breast cancer in vivo.

PubMed

Bardhan, Rizia; Chen, Wenxue; Bartels, Marc; Perez-Torres, Carlos; Botero, Maria F; McAninch, Robin Ward; Contreras, Alejandro; Schiff, Rachel; Pautler, Robia G; Halas, Naomi J; Joshi, Amit

2010-12-08

Nanoparticle-based therapeutics with local delivery and external electromagnetic field modulation holds extraordinary promise for soft-tissue cancers such as breast cancer; however, knowledge of the distribution and fate of nanoparticles in vivo is crucial for clinical translation. Here we demonstrate that multiple diagnostic capabilities can be introduced in photothermal therapeutic nanocomplexes by simultaneously enhancing both near-infrared fluorescence and magnetic resonance imaging (MRI). We track nanocomplexes in vivo, examining the influence of HER2 antibody targeting on nanocomplex distribution over 72 h. This approach provides valuable, detailed information regarding the distribution and fate of complex nanoparticles designed for specific diagnostic and therapeutic functions.

Tissue-like phantoms

DOEpatents

Frangioni, John V.; De Grand, Alec M.

2007-10-30

The invention is based, in part, on the discovery that by combining certain components one can generate a tissue-like phantom that mimics any desired tissue, is simple and inexpensive to prepare, and is stable over many weeks or months. In addition, new multi-modal imaging objects (e.g., beads) can be inserted into the phantoms to mimic tissue pathologies, such as cancer, or merely to serve as calibration standards. These objects can be imaged using one, two, or more (e.g., four) different imaging modalities (e.g., x-ray computed tomography (CT), positron emission tomography (PET), single photon emission computed tomography (SPECT), and near-infrared (NIR) fluorescence) simultaneously.

Tracking of Multimodal Therapeutic Nanocomplexes Targeting Breast Cancer in Vivo

PubMed Central

Bardhan, Rizia; Chen, Wenxue; Bartels, Marc; Perez-Torres, Carlos; Botero, Maria F.; McAninch, Robin Ward; Contreras, Alejandro; Schiff, Rachel; Pautler, Robia G.; Halas, Naomi J.; Joshi, Amit

2014-01-01

Nanoparticle-based therapeutics with local delivery and external electromagnetic field modulation holds extraordinary promise for soft-tissue cancers such as breast cancer; however, knowledge of the distribution and fate of nanoparticles in vivo is crucial for clinical translation. Here we demonstrate that multiple diagnostic capabilities can be introduced in photothermal therapeutic nanocomplexes by simultaneously enhancing both near-infrared fluorescence and magnetic resonance imaging (MRI). We track nanocomplexes in vivo, examining the influence of HER2 antibody targeting on nanocomplex distribution over 72 h. This approach provides valuable, detailed information regarding the distribution and fate of complex nanoparticles designed for specific diagnostic and therapeutic functions. PMID:21090693

Observation of the immune response of cells and tissue through multimodal label-free microscopy

NASA Astrophysics Data System (ADS)

Pavillon, Nicolas; Smith, Nicholas I.

2017-02-01

We present applications of a label-free approach to assess the immune response based on the combination of interferometric microscopy and Raman spectroscopy, which makes it possible to simultaneously acquire morphological and molecular information of live cells. We employ this approach to derive statistical models for predicting the activation state of macrophage cells based both on morphological parameters extracted from the high-throughput full-field quantitative phase imaging, and on the molecular content information acquired through Raman spectroscopy. We also employ a system for 3D imaging based on coherence gating, enabling specific targeting of the Raman channel to structures of interest within tissue.

Joint MR-PET reconstruction using a multi-channel image regularizer

PubMed Central

Koesters, Thomas; Otazo, Ricardo; Bredies, Kristian; Sodickson, Daniel K

2016-01-01

While current state of the art MR-PET scanners enable simultaneous MR and PET measurements, the acquired data sets are still usually reconstructed separately. We propose a new multi-modality reconstruction framework using second order Total Generalized Variation (TGV) as a dedicated multi-channel regularization functional that jointly reconstructs images from both modalities. In this way, information about the underlying anatomy is shared during the image reconstruction process while unique differences are preserved. Results from numerical simulations and in-vivo experiments using a range of accelerated MR acquisitions and different MR image contrasts demonstrate improved PET image quality, resolution, and quantitative accuracy. PMID:28055827

Near-field optical technique applied for investigation of the characteristics of polymer fiber and waveguide structures.

PubMed

Ming, Hai; Tang, Lin; Sun, Xiaohong; Zhang, Jiangying; Wang, Pei; Lu, Yonghua; Bai, Ming; Guo, Yang; Xie, Aifang; Zhang, Zebo

2004-01-01

This article summarizes the near-field optical technique applied for investigating the characteristics of polymer fiber and waveguide structures. The near-field optical technique is used to analyze multimode interference structures of fiber. The localized fluctuation of the transmission caused by fractal cluster is carried out in Nd3+- and Eu3+-doped polymer fiber and film by means of a scanning near-field optical microscopy. The near-field optical spectrum of Nd3+-doped polymer fiber is investigated. The topography and near-field intensity images of Azo-polymer liquid crystal film for waveguide are obtained simultaneously.

Hierarchical Spatial Concept Formation Based on Multimodal Information for Human Support Robots.

PubMed

Hagiwara, Yoshinobu; Inoue, Masakazu; Kobayashi, Hiroyoshi; Taniguchi, Tadahiro

2018-01-01

In this paper, we propose a hierarchical spatial concept formation method based on the Bayesian generative model with multimodal information e.g., vision, position and word information. Since humans have the ability to select an appropriate level of abstraction according to the situation and describe their position linguistically, e.g., "I am in my home" and "I am in front of the table," a hierarchical structure of spatial concepts is necessary in order for human support robots to communicate smoothly with users. The proposed method enables a robot to form hierarchical spatial concepts by categorizing multimodal information using hierarchical multimodal latent Dirichlet allocation (hMLDA). Object recognition results using convolutional neural network (CNN), hierarchical k-means clustering result of self-position estimated by Monte Carlo localization (MCL), and a set of location names are used, respectively, as features in vision, position, and word information. Experiments in forming hierarchical spatial concepts and evaluating how the proposed method can predict unobserved location names and position categories are performed using a robot in the real world. Results verify that, relative to comparable baseline methods, the proposed method enables a robot to predict location names and position categories closer to predictions made by humans. As an application example of the proposed method in a home environment, a demonstration in which a human support robot moves to an instructed place based on human speech instructions is achieved based on the formed hierarchical spatial concept.

Hierarchical Spatial Concept Formation Based on Multimodal Information for Human Support Robots

PubMed Central

Hagiwara, Yoshinobu; Inoue, Masakazu; Kobayashi, Hiroyoshi; Taniguchi, Tadahiro

2018-01-01

In this paper, we propose a hierarchical spatial concept formation method based on the Bayesian generative model with multimodal information e.g., vision, position and word information. Since humans have the ability to select an appropriate level of abstraction according to the situation and describe their position linguistically, e.g., “I am in my home” and “I am in front of the table,” a hierarchical structure of spatial concepts is necessary in order for human support robots to communicate smoothly with users. The proposed method enables a robot to form hierarchical spatial concepts by categorizing multimodal information using hierarchical multimodal latent Dirichlet allocation (hMLDA). Object recognition results using convolutional neural network (CNN), hierarchical k-means clustering result of self-position estimated by Monte Carlo localization (MCL), and a set of location names are used, respectively, as features in vision, position, and word information. Experiments in forming hierarchical spatial concepts and evaluating how the proposed method can predict unobserved location names and position categories are performed using a robot in the real world. Results verify that, relative to comparable baseline methods, the proposed method enables a robot to predict location names and position categories closer to predictions made by humans. As an application example of the proposed method in a home environment, a demonstration in which a human support robot moves to an instructed place based on human speech instructions is achieved based on the formed hierarchical spatial concept. PMID:29593521

Multimodal control of sensors on multiple simulated unmanned vehicles.

PubMed

Baber, C; Morin, C; Parekh, M; Cahillane, M; Houghton, R J

2011-09-01

The use of multimodal (speech plus manual) control of the sensors on combinations of one, two, three or five simulated unmanned vehicles (UVs) is explored. Novice controllers of simulated UVs complete a series of target checking tasks. Two experiments compare speech and gamepad control for one, two, three or five UVs in a simulated environment. Increasing the number of UVs has an impact on subjective rating of workload (measured by NASA-Task Load Index), particularly when moving from one to three UVs. Objective measures of performance showed that the participants tended to issue fewer commands as the number of vehicles increased (when using the gamepad control), but, while performance with a single UV was superior to that of multiple UVs, there was little difference across two, three or five UVs. Participants with low spatial ability (measured by the Object Perspectives Test) showed an increase in time to respond to warnings when controlling five UVs. Combining speech with gamepad control of sensors on UVs leads to superior performance on a secondary (respond-to-warnings) task (implying a reduction in demand) and use of fewer commands on primary (move-sensors and classify-target) tasks (implying more efficient operation). STATEMENT OF RELEVANCE: Benefits of multimodal control for unmanned vehicles are demonstrated. When controlling sensors on multiple UVs, participants with low spatial orientation scores have problems. It is proposed that the findings of these studies have implications for selection of UV operators and suggests that future UV workstations could benefit from multimodal control.

Adaptive Annealed Importance Sampling for Multimodal Posterior Exploration and Model Selection with Application to Extrasolar Planet Detection

NASA Astrophysics Data System (ADS)

Liu, Bin

2014-07-01

We describe an algorithm that can adaptively provide mixture summaries of multimodal posterior distributions. The parameter space of the involved posteriors ranges in size from a few dimensions to dozens of dimensions. This work was motivated by an astrophysical problem called extrasolar planet (exoplanet) detection, wherein the computation of stochastic integrals that are required for Bayesian model comparison is challenging. The difficulty comes from the highly nonlinear models that lead to multimodal posterior distributions. We resort to importance sampling (IS) to estimate the integrals, and thus translate the problem to be how to find a parametric approximation of the posterior. To capture the multimodal structure in the posterior, we initialize a mixture proposal distribution and then tailor its parameters elaborately to make it resemble the posterior to the greatest extent possible. We use the effective sample size (ESS) calculated based on the IS draws to measure the degree of approximation. The bigger the ESS is, the better the proposal resembles the posterior. A difficulty within this tailoring operation lies in the adjustment of the number of mixing components in the mixture proposal. Brute force methods just preset it as a large constant, which leads to an increase in the required computational resources. We provide an iterative delete/merge/add process, which works in tandem with an expectation-maximization step to tailor such a number online. The efficiency of our proposed method is tested via both simulation studies and real exoplanet data analysis.

Primary Students' Understanding and Appreciation of the Artwork in Picturebooks

ERIC Educational Resources Information Center

Pantaleo, Sylvia

2016-01-01

One of the purposes of the classroom-based research featured in this article was to explore how the ongoing development of young children's understanding of elements of visual art and design would affect their comprehension, interpretation and analysis of the artwork in a selection of picturebooks. Social semiotics, multimodality, sociocultural…

Multi-mode acquisition (MMA): An MS/MS acquisition strategy for maximizing selectivity, specificity and sensitivity of DIA product ion spectra.

PubMed

Williams, Brad J; Ciavarini, Steve J; Devlin, Curt; Cohn, Steven M; Xie, Rong; Vissers, Johannes P C; Martin, LeRoy B; Caswell, Allen; Langridge, James I; Geromanos, Scott J

2016-08-01

In proteomics studies, it is generally accepted that depth of coverage and dynamic range is limited in data-directed acquisitions. The serial nature of the method limits both sensitivity and the number of precursor ions that can be sampled. To that end, a number of data-independent acquisition (DIA) strategies have been introduced with these methods, for the most part, immune to the sampling issue; nevertheless, some do have other limitations with respect to sensitivity. The major limitation with DIA approaches is interference, i.e., MS/MS spectra are highly chimeric and often incapable of being identified using conventional database search engines. Utilizing each available dimension of separation prior to ion detection, we present a new multi-mode acquisition (MMA) strategy multiplexing both narrowband and wideband DIA acquisitions in a single analytical workflow. The iterative nature of the MMA workflow limits the adverse effects of interference with minimal loss in sensitivity. Qualitative identification can be performed by selected ion chromatograms or conventional database search strategies. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Deterministic Integration of Quantum Dots into on-Chip Multimode Interference Beamsplitters Using in Situ Electron Beam Lithography

NASA Astrophysics Data System (ADS)

Schnauber, Peter; Schall, Johannes; Bounouar, Samir; Höhne, Theresa; Park, Suk-In; Ryu, Geun-Hwan; Heindel, Tobias; Burger, Sven; Song, Jin-Dong; Rodt, Sven; Reitzenstein, Stephan

2018-04-01

The development of multi-node quantum optical circuits has attracted great attention in recent years. In particular, interfacing quantum-light sources, gates and detectors on a single chip is highly desirable for the realization of large networks. In this context, fabrication techniques that enable the deterministic integration of pre-selected quantum-light emitters into nanophotonic elements play a key role when moving forward to circuits containing multiple emitters. Here, we present the deterministic integration of an InAs quantum dot into a 50/50 multi-mode interference beamsplitter via in-situ electron beam lithography. We demonstrate the combined emitter-gate interface functionality by measuring triggered single-photon emission on-chip with $g^{(2)}(0) = 0.13\\pm 0.02$. Due to its high patterning resolution as well as spectral and spatial control, in-situ electron beam lithography allows for integration of pre-selected quantum emitters into complex photonic systems. Being a scalable single-step approach, it paves the way towards multi-node, fully integrated quantum photonic chips.

Defining the property space for chromatographic ligands from a homologous series of mixed-mode ligands.

PubMed

Woo, James A; Chen, Hong; Snyder, Mark A; Chai, Yiming; Frost, Russell G; Cramer, Steven M

2015-08-14

A homologous ligand library based on the commercially-available Nuvia cPrime ligand was generated to systematically explore various features of a multimodal cation-exchange ligand and to identify structural variants that had significantly altered chromatographic selectivity. Substitution of the polar amide bond with more hydrophobic chemistries was found to enhance retention while remaining hydrophobically-selective for aromatic residues. In contrast, increasing the solvent exposure of the aromatic ring was observed to strengthen the ligand affinity for both types of hydrophobic residues. An optimal linker length between the charged and hydrophobic moieties was also observed to enhance retention, balancing the steric accessibility of the hydrophobic moiety with its ability to interact independently of the charged group. The weak pKa of the carboxylate charge group was found to have a notable impact on protein retention on Nuvia cPrime at lower pH, increasing hydrophobic interactions with the protein. Substituting the charged group with a sulfonic acid allowed this strong MM ligand to retain its electrostatic-dominant character in this lower pH range. pH gradient experiments were also carried out to further elucidate this pH dependent behavior. A single QSAR model was generated using this accumulated experimental data to predict protein retention across a range of multimodal and ion exchange systems. This model could correctly predict the retention of proteins on resins that were not included in the original model and could prove quite powerful as an in silico approach toward designing more effective and differentiated multimodal ligands. Copyright © 2015. Published by Elsevier B.V.

Multimodal nanoparticle imaging agents: design and applications

NASA Astrophysics Data System (ADS)

Burke, Benjamin P.; Cawthorne, Christopher; Archibald, Stephen J.

2017-10-01

Molecular imaging, where the location of molecules or nanoscale constructs can be tracked in the body to report on disease or biochemical processes, is rapidly expanding to include combined modality or multimodal imaging. No single imaging technique can offer the optimum combination of properties (e.g. resolution, sensitivity, cost, availability). The rapid technological advances in hardware to scan patients, and software to process and fuse images, are pushing the boundaries of novel medical imaging approaches, and hand-in-hand with this is the requirement for advanced and specific multimodal imaging agents. These agents can be detected using a selection from radioisotope, magnetic resonance and optical imaging, among others. Nanoparticles offer great scope in this area as they lend themselves, via facile modification procedures, to act as multifunctional constructs. They have relevance as therapeutics and drug delivery agents that can be tracked by molecular imaging techniques with the particular development of applications in optically guided surgery and as radiosensitizers. There has been a huge amount of research work to produce nanoconstructs for imaging, and the parameters for successful clinical translation and validation of therapeutic applications are now becoming much better understood. It is an exciting time of progress for these agents as their potential is closer to being realized with translation into the clinic. The coming 5-10 years will be critical, as we will see if the predicted improvement in clinical outcomes becomes a reality. Some of the latest advances in combination modality agents are selected and the progression pathway to clinical trials analysed. This article is part of the themed issue 'Challenges for chemistry in molecular imaging'.

A molecular modeling based method to predict elution behavior and binding patches of proteins in multimodal chromatography.

PubMed

Banerjee, Suvrajit; Parimal, Siddharth; Cramer, Steven M

2017-08-18

Multimodal (MM) chromatography provides a powerful means to enhance the selectivity of protein separations by taking advantage of multiple weak interactions that include electrostatic, hydrophobic and van der Waals interactions. In order to increase our understanding of such phenomena, a computationally efficient approach was developed that combines short molecular dynamics simulations and continuum solvent based coarse-grained free energy calculations in order to study the binding of proteins to Self Assembled Monolayers (SAM) presenting MM ligands. Using this method, the free energies of protein-MM SAM binding over a range of incident orientations of the protein can be determined. The resulting free energies were then examined to identify the more "strongly bound" orientations of different proteins with two multimodal surfaces. The overall free energy of protein-MM surface binding was then determined and correlated to retention factors from isocratic chromatography. This correlation, combined with analytical expressions from the literature, was then employed to predict protein gradient elution salt concentrations as well as selectivity reversals with different MM resin systems. Patches on protein surfaces that interacted strongly with MM surfaces were also identified by determining the frequency of heavy atom contacts with the atoms of the MM SAMs. A comparison of these patches to Electrostatic Potential and hydrophobicity maps indicated that while all of these patches contained significant positive charge, only the highest frequency sites also possessed hydrophobicity. The ability to identify key binding patches on proteins may have significant impact on process development for the separation of bioproduct related impurities. Copyright © 2017 Elsevier B.V. All rights reserved.

Simultaneous Multi-Scale Diffusion Estimation and Tractography Guided by Entropy Spectrum Pathways

PubMed Central

Galinsky, Vitaly L.; Frank, Lawrence R.

2015-01-01

We have developed a method for the simultaneous estimation of local diffusion and the global fiber tracts based upon the information entropy flow that computes the maximum entropy trajectories between locations and depends upon the global structure of the multi-dimensional and multi-modal diffusion field. Computation of the entropy spectrum pathways requires only solving a simple eigenvector problem for the probability distribution for which efficient numerical routines exist, and a straight forward integration of the probability conservation through ray tracing of the convective modes guided by a global structure of the entropy spectrum coupled with a small scale local diffusion. The intervoxel diffusion is sampled by multi b-shell multi q-angle DWI data expanded in spherical waves. This novel approach to fiber tracking incorporates global information about multiple fiber crossings in every individual voxel and ranks it in the most scientifically rigorous way. This method has potential significance for a wide range of applications, including studies of brain connectivity. PMID:25532167

Oscillatory frontal theta responses are increased upon bisensory stimulation.

PubMed

Sakowitz, O W; Schürmann, M; Başar, E

2000-05-01

To investigate the functional correlation of oscillatory EEG components with the interaction of sensory modalities following simultaneous audio-visual stimulation. In an experimental study (15 subjects) we compared auditory evoked potentials (AEPs) and visual evoked potentials (VEPs) to bimodal evoked potentials (BEPs; simultaneous auditory and visual stimulation). BEPs were assumed to be brain responses to complex stimuli as a marker for intermodal associative functioning. Frequency domain analysis of these EPs showed marked theta-range components in response to bimodal stimulation. These theta components could not be explained by linear addition of the unimodal responses in the time domain. Considering topography the increased theta-response showed a remarkable frontality in proximity to multimodal association cortices. Referring to methodology we try to demonstrate that, even if various behavioral correlates of brain oscillations exist, common patterns can be extracted by means of a systems-theoretical approach. Serving as an example of functionally relevant brain oscillations, theta responses could be interpreted as an indicator of associative information processing.

Explicit Encoding of Multimodal Percepts by Single Neurons in the Human Brain

PubMed Central

Quiroga, Rodrigo Quian; Kraskov, Alexander; Koch, Christof; Fried, Itzhak

2010-01-01

Summary Different pictures of Marilyn Monroe can evoke the same percept, even if greatly modified as in Andy Warhol’s famous portraits. But how does the brain recognize highly variable pictures as the same percept? Various studies have provided insights into how visual information is processed along the “ventral pathway,” via both single-cell recordings in monkeys [1, 2] and functional imaging in humans [3, 4]. Interestingly, in humans, the same “concept” of Marilyn Monroe can be evoked with other stimulus modalities, for instance by hearing or reading her name. Brain imaging studies have identified cortical areas selective to voices [5, 6] and visual word forms [7, 8]. However, how visual, text, and sound information can elicit a unique percept is still largely unknown. By using presentations of pictures and of spoken and written names, we show that (1) single neurons in the human medial temporal lobe (MTL) respond selectively to representations of the same individual across different sensory modalities; (2) the degree of multimodal invariance increases along the hierarchical structure within the MTL; and (3) such neuronal representations can be generated within less than a day or two. These results demonstrate that single neurons can encode percepts in an explicit, selective, and invariant manner, even if evoked by different sensory modalities. PMID:19631538

OPTOELECTRONICS, FIBER OPTICS, AND OTHER ASPECTS OF QUANTUM ELECTRONICS: Influence of the Rayleigh backscattering on the mode composition of radiation in multimode graded-index waveguides with a quadratic refractive-index profile

NASA Astrophysics Data System (ADS)

Esayan, G. L.; Krivoshlykov, S. G.

1989-08-01

A method of coherent states is used to describe the process of Rayleigh scattering in a multimode graded-index waveguide with a quadratic refractive-index profile. Explicit expressions are obtained for the coefficients representing excitation of Gaussian-Hermite backscattering modes in two cases of practical importance: excitation of a waveguide by an extended noncoherent light source and selective excitation of different modes at the entry to a waveguide. An analysis is also made of the coefficients of coupling between forward and backward modes. Explicit expressions for the coefficients representing capture of backscattered radiation by a waveguide are obtained for two special cases of excitation (extended light source and zeroth mode).

Directional multimode coupler for planar magnonics: Side-coupled magnetic stripes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sadovnikov, A. V., E-mail: sadovnikovav@gmail.com; Nikitov, S. A.; Kotel'nikov Institute of Radioengineering and Electronics, Russian Academy of Sciences, Moscow 125009

We experimentally demonstrate spin waves coupling in two laterally adjacent magnetic stripes. By the means of Brillouin light scattering spectroscopy, we show that the coupling efficiency depends both on the magnonic waveguides' geometry and the characteristics of spin-wave modes. In particular, the lateral confinement of coupled yttrium-iron-garnet stripes enables the possibility of control over the spin-wave propagation characteristics. Numerical simulations (in time domain and frequency domain) reveal the nature of intermodal coupling between two magnonic stripes. The proposed topology of multimode magnonic coupler can be utilized as a building block for fabrication of integrated parallel functional and logic devices suchmore » as the frequency selective directional coupler or tunable splitter, enabling a number of potential applications for planar magnonics.« less

Multimodal fusion imaging ensemble for targeted sentinel lymph node management: initial results of an innovative promising approach for anatomically difficult lymphatic drainage in different tumour entities.

PubMed

Maza, Sofiane; Taupitz, Mathias; Taymoorian, Kasra; Winzer, Klaus Jürgen; Rückert, Jens; Paschen, Christian; Räber, Gert; Schneider, Sylke; Trefzer, Uwe; Munz, Dieter L

2007-03-01

There are situations where exact identification and localisation of sentinel lymph nodes (SLNs) are very difficult using lymphoscintigraphy, a hand-held gamma probe and vital dye, either a priori or a posteriori. We developed a new method using a simultaneous injection of two lymphotropic agents for exact topographical tomographic localisation and biopsy of draining SLNs. The purpose of this prospective pilot study was to investigate the feasibility and efficacy of this method ensemble. Fourteen patients with different tumour entities were enrolled. A mixture of (99m)Tc-nanocolloid and a dissolved superparamagnetic iron oxide was injected interstitially. Dynamic, sequential static lymphoscintigraphy and SPECT served as pathfinders. MR imaging was performed 2 h after injection. SPECT, contrast MRI and, if necessary, CT scan data sets were fused and evaluated with special regard to the topographical location of SLNs. The day after injection, nine patients underwent SLN biopsy and, in the presence of SLN metastasis, an elective lymph node dissection. Twenty-five SLNs were localised in the 14 patients examined. A 100% fusion correlation was achieved in all patients. The anatomical sites of SLNs detected during surgery showed 100% agreement with those localised on the multimodal fusion images. SLNs could be excised in 11/14 patients, six of whom had nodal metastasis. Our novel approach of multimodal fusion imaging for targeted SLN management in primary tumours with lymphatic drainage to anatomically difficult regions enables SLN biopsy even in patients with lymphatic drainage to obscure regions. Currently, we are testing its validity in larger patient groups and other tumour entities.

Effect of a multimodality natural medicine program on carotid atherosclerosis in older subjects: a pilot trial of Maharishi Vedic Medicine.

PubMed

Fields, Jeremy Z; Walton, Kenneth G; Schneider, Robert H; Nidich, Sanford; Pomerantz, Rhoda; Suchdev, Parmi; Castillo-Richmond, Amparo; Payne, Kathleen; Clark, Elizabeth T; Rainforth, Maxwell

2002-04-15

Although the onset and progression of coronary heart disease (CHD) involve multiple risk factors, few intervention studies have attempted to modify these factors simultaneously. This pilot study tested the effect of a multimodality intervention involving dietary, exercise, herbal food supplement, and stress reduction approaches from a traditional system of natural medicine, Maharishi Vedic Medicine (MVM). The primary outcome measure was carotid intima-media thickness (IMT), a noninvasive measure of peripheral atherosclerosis and surrogate measure of coronary atherosclerosis. Comparison groups included modern medicine (conventional dietary, exercise, and multivitamin approaches) and usual care (no added intervention). Of 57 healthy seniors (mean age 74 years) randomized to the 3 treatment groups, 46 completed IMT post-testing. Carotid IMT was determined by B-mode ultrasound before and after 1 year of treatment. IMT decreased in a larger fraction of MVM subjects (16 of 20) than in the modern (5 of 9) and usual care (7 of 14) groups combined (i.e., 12 of 23; odds ratio 3.7, p = 0.05). For subjects with multiple CHD risk factors ("high-risk" subjects, n = 15), IMT decreased more in the MVM (-0.32 +/- 0.23 mm, mean +/- SD) than in the usual care (+0.022 +/- 0.085; p = 0.009) or modern (-0.082 +/- 0.095, p = 0.10) groups. Within-group reductions in IMT were significant for all MVM subjects (-0.15 +/- 0.21, n = 20, p = 0.004) and for high-risk MVM subjects (n = 6, p = 0.01). These results show that this multimodality traditional approach can attenuate atherosclerosis in older subjects, particularly those with marked CHD risk.

Nanoparticles in magnetic resonance imaging: from simple to dual contrast agents

PubMed Central

Estelrich, Joan; Sánchez-Martín, María Jesús; Busquets, Maria Antònia

2015-01-01

Magnetic resonance imaging (MRI) has become one of the most widely used and powerful tools for noninvasive clinical diagnosis owing to its high degree of soft tissue contrast, spatial resolution, and depth of penetration. MRI signal intensity is related to the relaxation times (T1, spin–lattice relaxation and T2, spin–spin relaxation) of in vivo water protons. To increase contrast, various inorganic nanoparticles and complexes (the so-called contrast agents) are administered prior to the scanning. Shortening T1 and T2 increases the corresponding relaxation rates, 1/T1 and 1/T2, producing hyperintense and hypointense signals respectively in shorter times. Moreover, the signal-to-noise ratio can be improved with the acquisition of a large number of measurements. The contrast agents used are generally based on either iron oxide nanoparticles or ferrites, providing negative contrast in T2-weighted images; or complexes of lanthanide metals (mostly containing gadolinium ions), providing positive contrast in T1-weighted images. Recently, lanthanide complexes have been immobilized in nanostructured materials in order to develop a new class of contrast agents with functions including blood-pool and organ (or tumor) targeting. Meanwhile, to overcome the limitations of individual imaging modalities, multimodal imaging techniques have been developed. An important challenge is to design all-in-one contrast agents that can be detected by multimodal techniques. Magnetoliposomes are efficient multimodal contrast agents. They can simultaneously bear both kinds of contrast and can, furthermore, incorporate targeting ligands and chains of polyethylene glycol to enhance the accumulation of nanoparticles at the site of interest and the bioavailability, respectively. Here, we review the most important characteristics of the nanoparticles or complexes used as MRI contrast agents. PMID:25834422

Multimodal technique to eliminate humidity interference for specific detection of ethanol.

PubMed

Jalal, Ahmed Hasnain; Umasankar, Yogeswaran; Gonzalez, Pablo J; Alfonso, Alejandro; Bhansali, Shekhar

2017-01-15

Multimodal electrochemical technique incorporating both open circuit potential (OCP) and amperometric techniques have been conceptualized and implemented to improve the detection of specific analyte in systems where more than one analyte is present. This approach has been demonstrated through the detection of ethanol while eliminating the contribution of water in a micro fuel cell sensor system. The sensor was interfaced with LMP91000 potentiostat, controlled through MSP430F5529LP microcontroller to implement an auto-calibration algorithm tailored to improve the detection of alcohol. The sensor was designed and fabricated as a three electrode system with Nafion as a proton exchange membrane (PEM). The electrochemical signal of the interfering phase (water) was eliminated by implementing the multimodal electrochemical detection technique. The results were validated by comparing sensor and potentiostat performances with a commercial sensor and potentiostat respectively. The results suggest that such a sensing system can detect ethanol at concentrations as low as 5ppm. The structure and properties such as low detection limit, selectivity and miniaturized size enables potential application of this device in wearable transdermal alcohol measurements. Copyright © 2016 Elsevier B.V. All rights reserved.

Multimodality imaging to plan and guide transcatheter tricuspid valve interventions.

PubMed

Prihadi, Edgard A; Delgado, Victoria; Bax, Jeroen J

2017-10-01

Tricuspid regurgitation (TR) is a highly prevalent valvular heart disease. The natural history of untreated significant TR portends an unfavorable outcome, but only a minority of patients is currently referred for surgical treatment. Organic TR (caused by primary abnormality of the leaflets) is relatively infrequent whereas secondary or functional TR (caused by dilatation of the tricuspid annulus, right ventricle [RV] and right atrium) is the predominant mechanism. The success of transcatheter therapies for left valvular heart disease over the last decade, has fueled similar development of novel transcatheter devices for the treatment of TR. Currently being tested in several clinical trials, each of these devices requires specific needs to define the procedural suitability. In addition, an accurate evaluation of the complex tricuspid anatomy, RV geometry and their relationship with the surrounding structures is mandatory. Therefore, accurate pre-procedural assessment using multimodality imaging techniques will undoubtedly play a pivotal role in achieving procedural success and safety. This review article provides a comprehensive overview on the etiology and different mechanisms of TR, and highlights the role of multimodality imaging techniques in the assessment of TR severity, RV dysfunction and fulfilment of device-specific selection criteria.

Efficacy of texture, shape, and intensity features for robust posterior-fossa tumor segmentation in MRI

NASA Astrophysics Data System (ADS)

Ahmed, S.; Iftekharuddin, K. M.; Ogg, R. J.; Laningham, F. H.

2009-02-01

Our previous works suggest that fractal-based texture features are very useful for detection, segmentation and classification of posterior-fossa (PF) pediatric brain tumor in multimodality MRI. In this work, we investigate and compare efficacy of our texture features such as fractal and multifractional Brownian motion (mBm), and intensity along with another useful level-set based shape feature in PF tumor segmentation. We study feature selection and ranking using Kullback -Leibler Divergence (KLD) and subsequent tumor segmentation; all in an integrated Expectation Maximization (EM) framework. We study the efficacy of all four features in both multimodality as well as disparate MRI modalities such as T1, T2 and FLAIR. Both KLD feature plots and information theoretic entropy measure suggest that mBm feature offers the maximum separation between tumor and non-tumor tissues in T1 and FLAIR MRI modalities. The same metrics show that intensity feature offers the maximum separation between tumor and non-tumor tissue in T2 MRI modality. The efficacies of these features are further validated in segmenting PF tumor using both single modality and multimodality MRI for six pediatric patients with over 520 real MR images.

Detail-enhanced multimodality medical image fusion based on gradient minimization smoothing filter and shearing filter.

PubMed

Liu, Xingbin; Mei, Wenbo; Du, Huiqian

2018-02-13

In this paper, a detail-enhanced multimodality medical image fusion algorithm is proposed by using proposed multi-scale joint decomposition framework (MJDF) and shearing filter (SF). The MJDF constructed with gradient minimization smoothing filter (GMSF) and Gaussian low-pass filter (GLF) is used to decompose source images into low-pass layers, edge layers, and detail layers at multiple scales. In order to highlight the detail information in the fused image, the edge layer and the detail layer in each scale are weighted combined into a detail-enhanced layer. As directional filter is effective in capturing salient information, so SF is applied to the detail-enhanced layer to extract geometrical features and obtain directional coefficients. Visual saliency map-based fusion rule is designed for fusing low-pass layers, and the sum of standard deviation is used as activity level measurement for directional coefficients fusion. The final fusion result is obtained by synthesizing the fused low-pass layers and directional coefficients. Experimental results show that the proposed method with shift-invariance, directional selectivity, and detail-enhanced property is efficient in preserving and enhancing detail information of multimodality medical images. Graphical abstract The detailed implementation of the proposed medical image fusion algorithm.

Wide range optofluidically tunable multimode interference fiber laser

NASA Astrophysics Data System (ADS)

Antonio-Lopez, J. E.; Sanchez-Mondragon, J. J.; LiKamWa, P.; May-Arrioja, D. A.

2014-08-01

An optofluidically tunable fiber laser based on multimode interference (MMI) effects with a wide tuning range is proposed and demonstrated. The tunable mechanism is based on an MMI fiber filter fabricated using a special fiber known as no-core fiber, which is a multimode fiber (MMF) without cladding. Therefore, when the MMI filter is covered by liquid the optical properties of the no-core fiber are modified, which allow us to tune the peak wavelength response of the MMI filter. Rather than applying the liquid on the entire no-core fiber, we change the liquid level along the no-core fiber, which provides a highly linear tuning response. In addition, by selecting the adequate refractive index of the liquid we can also choose the tuning range. We demonstrate the versatility of the optofluidically tunable MMI filter by wavelength tuning two different gain media, erbium doped fiber and a semiconductor optical amplifier, achieving tuning ranges of 55 and 90 nm respectively. In both cases, we achieve side-mode suppression ratios (SMSR) better than 50 dBm with output power variations of less than 0.76 dBm over the whole tuning range.

["Back pain coach". A project for patients with back pain].

PubMed

Lindena, G; Marnitz, U; Hartmann, P; Müller, G

2012-12-01

Back pain is a challenge for case management but is a health insurance fund (HIF) that identifies high risk patients and includes them in a back pain assessment and a multimodal program cost-effective? Case managers of a HIF contacted selected patients and requested information on pain and current perspectives. Patients in the intervention group were offered a multimodal assessment and, if applicable, a multimodal treatment program. Control group patients received verbal or written (back book) information. Cost data were evaluated with respect to the interview data 1 year prior and 1 year afterwards. Of the 800 insured persons contacted 621 were nationwide, 88 were regional controls and 91 were intervention patients. Inability to work was still rising in all groups but less in the intervention group versus both control groups. Drugs, hospital as well as cure/adjuvant costs were less for intervention patients than in both control groups. The investment for the program was thus more than refinanced. Case management was well accepted but the intervention was in need of training for case managers and the specific diagnostic and treatment option regionally. The HIF was responsible for the study investment and project partners shared the training of the HIF regional case managers.

Applications of Elpasolites as a Multimode Radiation Sensor

NASA Astrophysics Data System (ADS)

Guckes, Amber

This study consists of both computational and experimental investigations. The computational results enabled detector design selections and confirmed experimental results. The experimental results determined that the CLYC scintillation detector can be applied as a functional and field-deployable multimode radiation sensor. The computational study utilized MCNP6 code to investigate the response of CLYC to various incident radiations and to determine the feasibility of its application as a handheld multimode sensor and as a single-scintillator collimated directional detection system. These simulations include: • Characterization of the response of the CLYC scintillator to gamma-rays and neutrons; • Study of the isotopic enrichment of 7Li versus 6Li in the CLYC for optimal detection of both thermal neutrons and fast neutrons; • Analysis of collimator designs to determine the optimal collimator for the single CLYC sensor directional detection system to assay gamma rays and neutrons; Simulations of a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system with the optimized collimator to determine the feasibility of detecting nuclear materials that could be encountered during field operations. These nuclear materials include depleted uranium, natural uranium, low-enriched uranium, highly-enriched uranium, reactor-grade plutonium, and weapons-grade plutonium. The experimental study includes the design, construction, and testing of both a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system. Both were designed in the Inventor CAD software and based on results of the computational study to optimize its performance. The handheld CLYC multimode sensor is modular, scalable, low?power, and optimized for high count rates. Commercial?off?the?shelf components were used where possible in order to optimize size, increase robustness, and minimize cost. The handheld CLYC multimode sensor was successfully tested to confirm its ability for gamma-ray and neutron detection, and gamma?ray and neutron spectroscopy. The sensor utilizes wireless data transfer for possible radiation mapping and network?centric deployment. The handheld multimode sensor was tested by performing laboratory measurements with various gamma-ray sources and neutron sources. The single CLYC scintillator collimated directional detection system is portable, robust, and capable of source localization and identification. The collimator was designed based on the results of the computational study and is constructed with high density polyethylene (HDPE) and lead (Pb). The collimator design and construction allows for the directional detection of gamma rays and fast neutrons utilizing only one scintillator which is interchangeable. For this study, a CLYC-7 scintillator was used. The collimated directional detection system was tested by performing laboratory directional measurements with various gamma-ray sources, 252Cf and a 239PuBe source.

The role of multimodal signals in species recognition between tree-killing bark beetles in a narrow sympatric zone.

Treesearch

Deepa S. Pureswaran; Richard W. Hofstetter; Brian Sullivan; Kristen A. Potter

2016-01-01

When related species coexist, selection pressure should favor evolution of species recognition mechanisms to prevent interspecific pairing and wasteful reproductive encounters. We investigated the potential role of pheromone and acoustic signals in species recognition between two species of tree-killing bark beetles, the southern pine beetle, Dendroctonus frontalis...

Network Configurations in the Human Brain Reflect Choice Bias during Rapid Face Processing.

PubMed

Tu, Tao; Schneck, Noam; Muraskin, Jordan; Sajda, Paul

2017-12-13

Network interactions are likely to be instrumental in processes underlying rapid perception and cognition. Specifically, high-level and perceptual regions must interact to balance pre-existing models of the environment with new incoming stimuli. Simultaneous electroencephalography (EEG) and fMRI (EEG/fMRI) enables temporal characterization of brain-network interactions combined with improved anatomical localization of regional activity. In this paper, we use simultaneous EEG/fMRI and multivariate dynamical systems (MDS) analysis to characterize network relationships between constitute brain areas that reflect a subject's choice for a face versus nonface categorization task. Our simultaneous EEG and fMRI analysis on 21 human subjects (12 males, 9 females) identifies early perceptual and late frontal subsystems that are selective to the categorical choice of faces versus nonfaces. We analyze the interactions between these subsystems using an MDS in the space of the BOLD signal. Our main findings show that differences between face-choice and house-choice networks are seen in the network interactions between the early and late subsystems, and that the magnitude of the difference in network interaction positively correlates with the behavioral false-positive rate of face choices. We interpret this to reflect the role of saliency and expectations likely encoded in frontal "late" regions on perceptual processes occurring in "early" perceptual regions. SIGNIFICANCE STATEMENT Our choices are affected by our biases. In visual perception and cognition such biases can be commonplace and quite curious-e.g., we see a human face when staring up at a cloud formation or down at a piece of toast at the breakfast table. Here we use multimodal neuroimaging and dynamical systems analysis to measure whole-brain spatiotemporal dynamics while subjects make decisions regarding the type of object they see in rapidly flashed images. We find that the degree of interaction in these networks accounts for a substantial fraction of our bias to see faces. In general, our findings illustrate how the properties of spatiotemporal networks yield insight into the mechanisms of how we form decisions. Copyright © 2017 the authors 0270-6474/17/3712226-12$15.00/0.

Network Configurations in the Human Brain Reflect Choice Bias during Rapid Face Processing

PubMed Central

Schneck, Noam

2017-01-01

Network interactions are likely to be instrumental in processes underlying rapid perception and cognition. Specifically, high-level and perceptual regions must interact to balance pre-existing models of the environment with new incoming stimuli. Simultaneous electroencephalography (EEG) and fMRI (EEG/fMRI) enables temporal characterization of brain–network interactions combined with improved anatomical localization of regional activity. In this paper, we use simultaneous EEG/fMRI and multivariate dynamical systems (MDS) analysis to characterize network relationships between constitute brain areas that reflect a subject's choice for a face versus nonface categorization task. Our simultaneous EEG and fMRI analysis on 21 human subjects (12 males, 9 females) identifies early perceptual and late frontal subsystems that are selective to the categorical choice of faces versus nonfaces. We analyze the interactions between these subsystems using an MDS in the space of the BOLD signal. Our main findings show that differences between face-choice and house-choice networks are seen in the network interactions between the early and late subsystems, and that the magnitude of the difference in network interaction positively correlates with the behavioral false-positive rate of face choices. We interpret this to reflect the role of saliency and expectations likely encoded in frontal “late” regions on perceptual processes occurring in “early” perceptual regions. SIGNIFICANCE STATEMENT Our choices are affected by our biases. In visual perception and cognition such biases can be commonplace and quite curious—e.g., we see a human face when staring up at a cloud formation or down at a piece of toast at the breakfast table. Here we use multimodal neuroimaging and dynamical systems analysis to measure whole-brain spatiotemporal dynamics while subjects make decisions regarding the type of object they see in rapidly flashed images. We find that the degree of interaction in these networks accounts for a substantial fraction of our bias to see faces. In general, our findings illustrate how the properties of spatiotemporal networks yield insight into the mechanisms of how we form decisions. PMID:29118108

COSBID-M3: a platform for multimodal monitoring, data collection, and research in neurocritical care.

PubMed

Wilson, J Adam; Shutter, Lori A; Hartings, Jed A

2013-01-01

Neuromonitoring in patients with severe brain trauma and stroke is often limited to intracranial pressure (ICP); advanced neuroscience intensive care units may also monitor brain oxygenation (partial pressure of brain tissue oxygen, P(bt)O(2)), electroencephalogram (EEG), cerebral blood flow (CBF), or neurochemistry. For example, cortical spreading depolarizations (CSDs) recorded by electrocorticography (ECoG) are associated with delayed cerebral ischemia after subarachnoid hemorrhage and are an attractive target for novel therapeutic approaches. However, to better understand pathophysiologic relations and realize the potential of multimodal monitoring, a common platform for data collection and integration is needed. We have developed a multimodal system that integrates clinical, research, and imaging data into a single research and development (R&D) platform. Our system is adapted from the widely used BCI2000, a brain-computer interface tool which is written in the C++ language and supports over 20 data acquisition systems. It is optimized for real-time analysis of multimodal data using advanced time and frequency domain analyses and is extensible for research development using a combination of C++, MATLAB, and Python languages. Continuous streams of raw and processed data, including BP (blood pressure), ICP, PtiO2, CBF, ECoG, EEG, and patient video are stored in an open binary data format. Selected events identified in raw (e.g., ICP) or processed (e.g., CSD) measures are displayed graphically, can trigger alarms, or can be sent to researchers or clinicians via text message. For instance, algorithms for automated detection of CSD have been incorporated, and processed ECoG signals are projected onto three-dimensional (3D) brain models based on patient magnetic resonance imaging (MRI) and computed tomographic (CT) scans, allowing real-time correlation of pathoanatomy and cortical function. This platform will provide clinicians and researchers with an advanced tool to investigate pathophysiologic relationships and novel measures of cerebral status, as well as implement treatment algorithms based on such multimodal measures.

Selection of Wavelengths for Optimum Precision in Simultaneous Spectrophotometric Determinations.

ERIC Educational Resources Information Center

DiTusa, Michael R.; Schilt, Alfred A.

1985-01-01

Although many textbooks include a description of simultaneous determinations employing absorption spectrophotometry and treat the mathematics necessary for analytical quantitations, treatment of analytical wavelength selection has been mostly qualitative. Therefore, a general method for selecting wavelengths for optimum precision in simultaneous…

Multimodal full-field optical coherence tomography on biological tissue: toward all optical digital pathology

NASA Astrophysics Data System (ADS)

Harms, F.; Dalimier, E.; Vermeulen, P.; Fragola, A.; Boccara, A. C.

2012-03-01

Optical Coherence Tomography (OCT) is an efficient technique for in-depth optical biopsy of biological tissues, relying on interferometric selection of ballistic photons. Full-Field Optical Coherence Tomography (FF-OCT) is an alternative approach to Fourier-domain OCT (spectral or swept-source), allowing parallel acquisition of en-face optical sections. Using medium numerical aperture objective, it is possible to reach an isotropic resolution of about 1x1x1 ìm. After stitching a grid of acquired images, FF-OCT gives access to the architecture of the tissue, for both macroscopic and microscopic structures, in a non-invasive process, which makes the technique particularly suitable for applications in pathology. Here we report a multimodal approach to FF-OCT, combining two Full-Field techniques for collecting a backscattered endogeneous OCT image and a fluorescence exogeneous image in parallel. Considering pathological diagnosis of cancer, visualization of cell nuclei is of paramount importance. OCT images, even for the highest resolution, usually fail to identify individual nuclei due to the nature of the optical contrast used. We have built a multimodal optical microscope based on the combination of FF-OCT and Structured Illumination Microscopy (SIM). We used x30 immersion objectives, with a numerical aperture of 1.05, allowing for sub-micron transverse resolution. Fluorescent staining of nuclei was obtained using specific fluorescent dyes such as acridine orange. We present multimodal images of healthy and pathological skin tissue at various scales. This instrumental development paves the way for improvements of standard pathology procedures, as a faster, non sacrificial, operator independent digital optical method compared to frozen sections.

Molecular simulations of multimodal ligand-protein binding: elucidation of binding sites and correlation with experiments.

PubMed

Freed, Alexander S; Garde, Shekhar; Cramer, Steven M

2011-11-17

Multimodal chromatography, which employs more than one mode of interaction between ligands and proteins, has been shown to have unique selectivity and high efficacy for protein purification. To test the ability of free solution molecular dynamics (MD) simulations in explicit water to identify binding regions on the protein surface and to shed light on the "pseudo affinity" nature of multimodal interactions, we performed MD simulations of a model protein ubiquitin in aqueous solution of free ligands. Comparisons of MD with NMR spectroscopy of ubiquitin mutants in solutions of free ligands show a good agreement between the two with regard to the preferred binding region on the surface of the protein and several binding sites. MD simulations also identify additional binding sites that were not observed in the NMR experiments. "Bound" ligands were found to be sufficiently flexible and to access a number of favorable conformations, suggesting only a moderate loss of ligand entropy in the "pseudo affinity" binding of these multimodal ligands. Analysis of locations of chemical subunits of the ligand on the protein surface indicated that electrostatic interaction units were located on the periphery of the preferred binding region on the protein. The analysis of the electrostatic potential, the hydrophobicity maps, and the binding of both acetate and benzene probes were used to further study the localization of individual ligand moieties. These results suggest that water-mediated electrostatic interactions help the localization and orientation of the MM ligand to the binding region with additional stability provided by nonspecific hydrophobic interactions.

ADAPTIVE ANNEALED IMPORTANCE SAMPLING FOR MULTIMODAL POSTERIOR EXPLORATION AND MODEL SELECTION WITH APPLICATION TO EXTRASOLAR PLANET DETECTION

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Bin, E-mail: bins@ieee.org

2014-07-01

We describe an algorithm that can adaptively provide mixture summaries of multimodal posterior distributions. The parameter space of the involved posteriors ranges in size from a few dimensions to dozens of dimensions. This work was motivated by an astrophysical problem called extrasolar planet (exoplanet) detection, wherein the computation of stochastic integrals that are required for Bayesian model comparison is challenging. The difficulty comes from the highly nonlinear models that lead to multimodal posterior distributions. We resort to importance sampling (IS) to estimate the integrals, and thus translate the problem to be how to find a parametric approximation of the posterior.more » To capture the multimodal structure in the posterior, we initialize a mixture proposal distribution and then tailor its parameters elaborately to make it resemble the posterior to the greatest extent possible. We use the effective sample size (ESS) calculated based on the IS draws to measure the degree of approximation. The bigger the ESS is, the better the proposal resembles the posterior. A difficulty within this tailoring operation lies in the adjustment of the number of mixing components in the mixture proposal. Brute force methods just preset it as a large constant, which leads to an increase in the required computational resources. We provide an iterative delete/merge/add process, which works in tandem with an expectation-maximization step to tailor such a number online. The efficiency of our proposed method is tested via both simulation studies and real exoplanet data analysis.« less

Discriminating between intentional and unintentional gaze fixation using multimodal-based fuzzy logic algorithm for gaze tracking system with NIR camera sensor

NASA Astrophysics Data System (ADS)

Naqvi, Rizwan Ali; Park, Kang Ryoung

2016-06-01

Gaze tracking systems are widely used in human-computer interfaces, interfaces for the disabled, game interfaces, and for controlling home appliances. Most studies on gaze detection have focused on enhancing its accuracy, whereas few have considered the discrimination of intentional gaze fixation (looking at a target to activate or select it) from unintentional fixation while using gaze detection systems. Previous research methods based on the use of a keyboard or mouse button, eye blinking, and the dwell time of gaze position have various limitations. Therefore, we propose a method for discriminating between intentional and unintentional gaze fixation using a multimodal fuzzy logic algorithm applied to a gaze tracking system with a near-infrared camera sensor. Experimental results show that the proposed method outperforms the conventional method for determining gaze fixation.

Implementation and flight-test of a multi-mode rotorcraft flight-control system for single-pilot use in poor visibility

NASA Technical Reports Server (NTRS)

Hindson, William S.

1987-01-01

A flight investigation was conducted to evaluate a multi-mode flight control system designed according to the most recent recommendations for handling qualities criteria for new military helicopters. The modes and capabilities that were included in the system are those considered necessary to permit divided-attention (single-pilot) lowspeed and hover operations near the ground in poor visibility conditions. Design features included mode-selection and mode-blending logic, the use of an automatic position-hold mode that employed precision measurements of aircraft position, and a hover display which permitted manually-controlled hover flight tasks in simulated instrument conditions. Pilot evaluations of the system were conducted using a multi-segment evaluation task. Pilot comments concerning the use of the system are provided, and flight-test data are presented to show system performance.

Multimode Acoustic Research

NASA Technical Reports Server (NTRS)

Barmatz, M.

1985-01-01

There is a need for high temperature containerless processing facilities that can efficiently position and manipulate molten samples in the reduced gravity environment of space. The goal of the research is to develop sophisticated high temperature manipulation capabilities such as selection of arbitrary axes rotation and rapid sample cooling. This program will investigate new classes of acoustic levitation in rectangular, cylindrical and spherical geometries. The program tasks include calculating theoretical expressions of the acoustic forces in these geometries for the excitation of up to three acoustic modes (multimodes). These calculations are used to: (1) determine those acoustic modes that produce stable levitation, (2) isolate the levitation and rotation capabilities to produce more than one axis of rotation, and (3) develop methods to translate samples down long tube cylindrical chambers. Experimental levitators will then be constructed to verify the stable levitation and rotation predictions of the models.

In-fiber modal interferometer based on multimode and double cladding fiber segments for tunable fiber laser applications

NASA Astrophysics Data System (ADS)

Prieto-Cortés, P.; Álvarez-Tamayo, R. I.; Durán-Sánchez, M.; Castillo-Guzmán, A.; Salceda-Delgado, G.; Ibarra-Escamilla, B.; Kuzin, E. A.; Barcelata-Pinzón, A.; Selvas-Aguilar, R.

2018-02-01

We report an in-fiber structure based on the use of a multimode fiber segment and a double cladding fiber segment, and its application as spectral filter in an erbium-doped fiber laser for selection and tuning of the laser line wavelength. The output transmission of the proposed device exhibit spectrum modulation of the input signal with free spectral range of 21 nm and maximum visibility enhanced to more than 20 dB. The output spectrum of the in-fiber filter is wavelength displaced by bending application which allows a wavelength tuning of the generated laser line in a range of 12 nm. The use of the proposed in-fiber structure is demonstrated as a reliable, simple, and low-cost wavelength filter for tunable fiber lasers design and optical instrumentation applications.

Numerical study on simultaneous emission and transmission tomography in the MRI framework

NASA Astrophysics Data System (ADS)

Gjesteby, Lars; Cong, Wenxiang; Wang, Ge

2017-09-01

Multi-modality imaging methods are instrumental for advanced diagnosis and therapy. Specifically, a hybrid system that combines computed tomography (CT), nuclear imaging, and magnetic resonance imaging (MRI) will be a Holy Grail of medical imaging, delivering complementary structural/morphological, functional, and molecular information for precision medicine. A novel imaging method was recently demonstrated that takes advantage of radiotracer polarization to combine MRI principles with nuclear imaging. This approach allows the concentration of a polarized Υ-ray emitting radioisotope to be imaged with MRI resolution potentially outperforming the standard nuclear imaging mode at a sensitivity significantly higher than that of MRI. In our work, we propose to acquire MRI-modulated nuclear data for simultaneous image reconstruction of both emission and transmission parameters, suggesting the potential for simultaneous CT-SPECT-MRI. The synchronized diverse datasets allow excellent spatiotemporal registration and unique insight into physiological and pathological features. Here we describe the methodology involving the system design with emphasis on the formulation for tomographic images, even when significant radiotracer signals are limited to a region of interest (ROI). Initial numerical results demonstrate the feasibility of our approach for reconstructing concentration and attenuation images through a head phantom with various radio-labeled ROIs. Additional considerations regarding the radioisotope characteristics are also discussed.

Quantum-enhanced multiparameter estimation in multiarm interferometers

PubMed Central

Ciampini, Mario A.; Spagnolo, Nicolò; Vitelli, Chiara; Pezzè, Luca; Smerzi, Augusto; Sciarrino, Fabio

2016-01-01

Quantum metrology is the state-of-the-art measurement technology. It uses quantum resources to enhance the sensitivity of phase estimation over that achievable by classical physics. While single parameter estimation theory has been widely investigated, much less is known about the simultaneous estimation of multiple phases, which finds key applications in imaging and sensing. In this manuscript we provide conditions of useful particle (qudit) entanglement for multiphase estimation and adapt them to multiarm Mach-Zehnder interferometry. We theoretically discuss benchmark multimode Fock states containing useful qudit entanglement and overcoming the sensitivity of separable qudit states in three and four arm Mach-Zehnder-like interferometers - currently within the reach of integrated photonics technology. PMID:27381743

Amplitude Noise Reduction of Ion Lasers with Optical Feedback

NASA Technical Reports Server (NTRS)

Herring, Gregory C.

2011-01-01

A reduction in amplitude noise on the output of a multi-mode continuous-wave Ar-ion laser was previously demonstrated when a fraction of the output power was retroreflected back into the laser cavity. This result was reproduced in the present work and a Fabry-Perot etalon was used to monitor the longitudinal mode structure of the laser. A decrease in the number of operating longitudinal cavity modes was observed simultaneously with the introduction of the optical feedback and the onset of the amplitude noise reduction. The noise reduction is a result of a reduced number of lasing modes, resulting in less mode beating and amplitude fluctuations of the laser output power.

Real-Time Cognitive Computing Architecture for Data Fusion in a Dynamic Environment

NASA Technical Reports Server (NTRS)

Duong, Tuan A.; Duong, Vu A.

2012-01-01

A novel cognitive computing architecture is conceptualized for processing multiple channels of multi-modal sensory data streams simultaneously, and fusing the information in real time to generate intelligent reaction sequences. This unique architecture is capable of assimilating parallel data streams that could be analog, digital, synchronous/asynchronous, and could be programmed to act as a knowledge synthesizer and/or an "intelligent perception" processor. In this architecture, the bio-inspired models of visual pathway and olfactory receptor processing are combined as processing components, to achieve the composite function of "searching for a source of food while avoiding the predator." The architecture is particularly suited for scene analysis from visual data and odorant.

Analyzing multimodality tomographic images and associated regions of interest with MIDAS

NASA Astrophysics Data System (ADS)

Tsui, Wai-Hon; Rusinek, Henry; Van Gelder, Peter; Lebedev, Sergey

2001-07-01

This paper outlines the design and features incorporated in a software package for analyzing multi-modality tomographic images. The package MIDAS has been evolving for the past 15 years and is in wide use by researchers at New York University School of Medicine and a number of collaborating research sites. It was written in the C language and runs on Sun workstations and Intel PCs under the Solaris operating system. A unique strength of the MIDAS package lies in its ability to generate, manipulate and analyze a practically unlimited number of regions of interest (ROIs). These regions are automatically saved in an efficient data structure and linked to associated images. A wide selection of set theoretical (e.g. union, xor, difference), geometrical (e.g. move, rotate) and morphological (grow, peel) operators can be applied to an arbitrary selection of ROIs. ROIs are constructed as a result of image segmentation algorithms incorporated in MIDAS; they also can be drawn interactively. These ROI editing operations can be applied in either 2D or 3D mode. ROI statistics generated by MIDAS include means, standard deviations, centroids and histograms. Other image manipulation tools incorporated in MIDAS are multimodality and within modality coregistration methods (including landmark matching, surface fitting and Woods' correlation methods) and image reformatting methods (using nearest-neighbor, tri-linear or sinc interpolation). Applications of MIDAS include: (1) neuroanatomy research: marking anatomical structures in one orientation, reformatting marks to another orientation; (2) tissue volume measurements: brain structures (PET, MRI, CT), lung nodules (low dose CT), breast density (MRI); (3) analysis of functional (SPECT, PET) experiments by overlaying corresponding structural scans; (4) longitudinal studies: regional measurement of atrophy.

The effect of geometrical presentation of multimodal cation-exchange ligands on selective recognition of hydrophobic regions on protein surfaces.

PubMed

Woo, James; Parimal, Siddharth; Brown, Matthew R; Heden, Ryan; Cramer, Steven M

2015-09-18

The effects of spatial organization of hydrophobic and charged moieties on multimodal (MM) cation-exchange ligands were examined by studying protein retention behavior on two commercial chromatographic media, Capto™ MMC and Nuvia™ cPrime™. Proteins with extended regions of surface-exposed aliphatic residues were found to have enhanced retention on the Capto MMC system as compared to the Nuvia cPrime resin. The results further indicated that while the Nuvia cPrime ligand had a strong preference for interactions with aromatic groups, the Capto MMC ligand appeared to interact with both aliphatic and aromatic clusters on the protein surfaces. These observations were formalized into a new set of protein surface property descriptors, which quantified the local distribution of electrostatic and hydrophobic potentials as well as distinguishing between aromatic and aliphatic properties. Using these descriptors, high-performing quantitative structure-activity relationship (QSAR) models (R(2)>0.88) were generated for both the Capto MMC and Nuvia cPrime datasets at pH 5 and pH 6. Descriptors of electrostatic properties were generally common across the four models; however both Capto MMC models included descriptors that quantified regions of aliphatic-based hydrophobicity in addition to aromatic descriptors. Retention was generally reduced by lowering the ligand densities on both MM resins. Notably, elution order was largely unaffected by the change in surface density, but smaller and more aliphatic proteins tended to be more affected by this drop in ligand density. This suggests that modulating the exposure, shape and density of the hydrophobic moieties in multimodal chromatographic systems can alter the preference for surface exposed aliphatic or aromatic residues, thus providing an additional dimension for modulating the selectivity of MM protein separation systems. Copyright © 2015 Elsevier B.V. All rights reserved.

QSAR models for prediction of chromatographic behavior of homologous Fab variants.

PubMed

Robinson, Julie R; Karkov, Hanne S; Woo, James A; Krogh, Berit O; Cramer, Steven M

2017-06-01

While quantitative structure activity relationship (QSAR) models have been employed successfully for the prediction of small model protein chromatographic behavior, there have been few reports to date on the use of this methodology for larger, more complex proteins. Recently our group generated focused libraries of antibody Fab fragment variants with different combinations of surface hydrophobicities and electrostatic potentials, and demonstrated that the unique selectivities of multimodal resins can be exploited to separate these Fab variants. In this work, results from linear salt gradient experiments with these Fabs were employed to develop QSAR models for six chromatographic systems, including multimodal (Capto MMC, Nuvia cPrime, and two novel ligand prototypes), hydrophobic interaction chromatography (HIC; Capto Phenyl), and cation exchange (CEX; CM Sepharose FF) resins. The models utilized newly developed "local descriptors" to quantify changes around point mutations in the Fab libraries as well as novel cluster descriptors recently introduced by our group. Subsequent rounds of feature selection and linearized machine learning algorithms were used to generate robust, well-validated models with high training set correlations (R 2  > 0.70) that were well suited for predicting elution salt concentrations in the various systems. The developed models then were used to predict the retention of a deamidated Fab and isotype variants, with varying success. The results represent the first successful utilization of QSAR for the prediction of chromatographic behavior of complex proteins such as Fab fragments in multimodal chromatographic systems. The framework presented here can be employed to facilitate process development for the purification of biological products from product-related impurities by in silico screening of resin alternatives. Biotechnol. Bioeng. 2017;114: 1231-1240. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Comparison of the application of B-mode and strain elastography ultrasound in the estimation of lymph node metastasis of papillary thyroid carcinoma based on a radiomics approach.

PubMed

Liu, Tongtong; Ge, Xifeng; Yu, Jinhua; Guo, Yi; Wang, Yuanyuan; Wang, Wenping; Cui, Ligang

2018-06-21

B-mode ultrasound (B-US) and strain elastography ultrasound (SE-US) images have a potential to distinguish thyroid tumor with different lymph node (LN) status. The purpose of our study is to investigate whether the application of multi-modality images including B-US and SE-US can improve the discriminability of thyroid tumor with LN metastasis based on a radiomics approach. Ultrasound (US) images including B-US and SE-US images of 75 papillary thyroid carcinoma (PTC) cases were retrospectively collected. A radiomics approach was developed in this study to estimate LNs status of PTC patients. The approach included image segmentation, quantitative feature extraction, feature selection and classification. Three feature sets were extracted from B-US, SE-US, and multi-modality containing B-US and SE-US. They were used to evaluate the contribution of different modalities. A total of 684 radiomics features have been extracted in our study. We used sparse representation coefficient-based feature selection method with 10-bootstrap to reduce the dimension of feature sets. Support vector machine with leave-one-out cross-validation was used to build the model for estimating LN status. Using features extracted from both B-US and SE-US, the radiomics-based model produced an area under the receiver operating characteristic curve (AUC) [Formula: see text] 0.90, accuracy (ACC) [Formula: see text] 0.85, sensitivity (SENS) [Formula: see text] 0.77 and specificity (SPEC) [Formula: see text] 0.88, which was better than using features extracted from B-US or SE-US separately. Multi-modality images provided more information in radiomics study. Combining use of B-US and SE-US could improve the LN metastasis estimation accuracy for PTC patients.

A novel phoswich imaging detector for simultaneous beta and coincidence-gamma imaging of plant leaves.

PubMed

Wu, Heyu; Tai, Yuan-Chuan

2011-09-07

To meet the growing demand for functional imaging technology for use in studying plant biology, we are developing a novel technique that permits simultaneous imaging of escaped positrons and coincidence gammas from annihilation of positrons within an intake leaf. The multi-modality imaging system will include two planar detectors: one is a typical PET detector array and the other is a phoswich imaging detector that detects both beta and gamma. The novel phoswich detector is made of a plastic scintillator, a lutetium oxyorthosilicate (LSO) array, and a position sensitive photomultiplier tube (PS-PMT). The plastic scintillator serves as a beta detector, while the LSO array serves as a gamma detector and light guide that couples scintillation light from the plastic detector to the PMT. In our prototype, the PMT signal was fed into the Siemens QuickSilver electronics to achieve shaping and waveform sampling. Pulse-shape discrimination based on the detectors' decay times (2.1 ns for plastic and 40 ns for LSO) was used to differentiate beta and gamma events using the common PMT signals. Using our prototype phoswich detector, we simultaneously measured a beta image and gamma events (in single mode). The beta image showed a resolution of 1.6 mm full-width-at-half-maximum using F-18 line sources. Because this shows promise for plant-scale imaging, our future plans include development of a fully functional simultaneous beta-and-coincidence-gamma imager with sub-millimeter resolution imaging capability for both modalities.

Multimodality Imaging of RNA Interference

PubMed Central

Nayak, Tapas R.; Krasteva, Lazura K.; Cai, Weibo

2013-01-01

The discovery of small interfering RNAs (siRNAs) and their potential to knock down virtually any gene of interest has ushered in a new era of RNA interference (RNAi). Clinical use of RNAi faces severe limitations due to inefficiency delivery of siRNA or short hairpin RNA (shRNA). Many molecular imaging techniques have been adopted in RNAi-related research for evaluation of siRNA/shRNA delivery, biodistribution, pharmacokinetics, and the therapeutic effect. In this review article, we summarize the current status of in vivo imaging of RNAi. The molecular imaging techniques that have been employed include bioluminescence/fluorescence imaging, magnetic resonance imaging/spectroscopy, positron emission tomography, single-photon emission computed tomography, and various combinations of these techniques. Further development of non-invasive imaging strategies for RNAi, not only focusing on the delivery of siRNA/shRNA but also the therapeutic efficacy, is critical for future clinical translation. Rigorous validation will be needed to confirm that biodistribution of the carrier is correlated with that of siRNA/shRNA, since imaging only detects the label (e.g. radioisotopes) but not the gene or carrier themselves. It is also essential to develop multimodality imaging approaches for realizing the full potential of therapeutic RNAi, as no single imaging modality may be sufficient to simultaneously monitor both the gene delivery and silencing effect of RNAi. PMID:23745567

Facing the Problem: Impaired Emotion Recognition During Multimodal Social Information Processing in Borderline Personality Disorder.

PubMed

Niedtfeld, Inga; Defiebre, Nadine; Regenbogen, Christina; Mier, Daniela; Fenske, Sabrina; Kirsch, Peter; Lis, Stefanie; Schmahl, Christian

2017-04-01

Previous research has revealed alterations and deficits in facial emotion recognition in patients with borderline personality disorder (BPD). During interpersonal communication in daily life, social signals such as speech content, variation in prosody, and facial expression need to be considered simultaneously. We hypothesized that deficits in higher level integration of social stimuli contribute to difficulties in emotion recognition in BPD, and heightened arousal might explain this effect. Thirty-one patients with BPD and thirty-one healthy controls were asked to identify emotions in short video clips, which were designed to represent different combinations of the three communication channels: facial expression, speech content, and prosody. Skin conductance was recorded as a measure of sympathetic arousal, while controlling for state dissociation. Patients with BPD showed lower mean accuracy scores than healthy control subjects in all conditions comprising emotional facial expressions. This was true for the condition with facial expression only, and for the combination of all three communication channels. Electrodermal responses were enhanced in BPD only in response to auditory stimuli. In line with the major body of facial emotion recognition studies, we conclude that deficits in the interpretation of facial expressions lead to the difficulties observed in multimodal emotion processing in BPD.

Combining near-infrared spectroscopy with electroencephalography and repetitive transcranial magnetic stimulation

NASA Astrophysics Data System (ADS)

Näsi, Tiina; Kotilahti, Kalle; Mäki, Hanna; Nissilä, Ilkka; Meriläinen, Pekka

2009-07-01

The objective of the study was to assess the usability of a near-infrared spectroscopy (NIRS) device in multimodal measurements. We combined NIRS with electroencephalography (EEG) to record hemodynamic responses and evoked potentials simultaneously, and with transcranial magnetic stimulation (TMS) to investigate hemodynamic responses to repetitive TMS (rTMS). Hemodynamic responses and visual evoked potentials (VEPs) to 3, 6, and 12 s stimuli consisting of pattern-reversing checkerboards were successfully recorded in the NIRS/EEG measurement, and ipsi- and contralateral hemodynamic responses to 0.5, 1, and 2 Hz rTMS in the NIRS/TMS measurement. In the NIRS/EEG measurements, the amplitudes of the hemodynamic responses increased from 3- to 6-s stimulus, but not from 6- to 12-s stimulus, and the VEPs showed peaks N75, P100, and N135. In the NIRS/TMS measurements, the 2-Hz stimulus produced the strongest hemodynamic responses compared to the 0.5- and 1-Hz stimuli. In two subjects oxyhemoglobin concentration decreased and in one increased as a consequence of the 2-Hz rTMS. To locate the origin of the measured NIRS responses, methods have to be developed to investigate TMS-induced scalp muscle contractions. In the future, multimodal measurements may prove useful in monitoring or treating diseases such as stroke or Alzheimer's disease.

A system for simultaneous near-infrared reflectance and transillumination imaging of occlusal carious lesions

NASA Astrophysics Data System (ADS)

Simon, Jacob C.; Darling, Cynthia L.; Fried, Daniel

2016-02-01

Clinicians need technologies to improve the diagnosis of questionable occlusal carious lesions (QOC's) and determine if decay has penetrated to the underlying dentin. Assessing lesion depth from near-infrared (NIR) images holds great potential due to the high transparency of enamel and stain to NIR light at λ=1300-1700-nm, which allows direct visualization and quantified measurements of enamel demineralization. Unfortunately, NIR reflectance measurements alone are limited in utility for approximating occlusal lesion depth >200-μm due to light attenuation from the lesion body. Previous studies sought to combine NIR reflectance and transillumination measurements taken at λ=1300-nm in order to estimate QOC depth and severity. The objective of this study was to quantify the change in lesion contrast and size measured from multispectral NIR reflectance and transillumination images of natural occlusal carious lesions with increasing lesion depth and severity in order to determine the optimal multimodal wavelength combinations for estimating QOC depth. Extracted teeth with varying amounts of natural occlusal decay were measured using a multispectral-multimodal NIR imaging system at prominent wavelengths within the λ=1300-1700-nm spectral region. Image analysis software was used to calculate lesion contrast and area values between sound and carious enamel regions.

Direct estimation of evoked hemoglobin changes by multimodality fusion imaging

PubMed Central

Huppert, Theodore J.; Diamond, Solomon G.; Boas, David A.

2009-01-01

In the last two decades, both diffuse optical tomography (DOT) and blood oxygen level dependent (BOLD)-based functional magnetic resonance imaging (fMRI) methods have been developed as noninvasive tools for imaging evoked cerebral hemodynamic changes in studies of brain activity. Although these two technologies measure functional contrast from similar physiological sources, i.e., changes in hemoglobin levels, these two modalities are based on distinct physical and biophysical principles leading to both limitations and strengths to each method. In this work, we describe a unified linear model to combine the complimentary spatial, temporal, and spectroscopic resolutions of concurrently measured optical tomography and fMRI signals. Using numerical simulations, we demonstrate that concurrent optical and BOLD measurements can be used to create cross-calibrated estimates of absolute micromolar deoxyhemoglobin changes. We apply this new analysis tool to experimental data acquired simultaneously with both DOT and BOLD imaging during a motor task, demonstrate the ability to more robustly estimate hemoglobin changes in comparison to DOT alone, and show how this approach can provide cross-calibrated estimates of hemoglobin changes. Using this multimodal method, we estimate the calibration of the 3 tesla BOLD signal to be −0.55% ± 0.40% signal change per micromolar change of deoxyhemoglobin. PMID:19021411

Stereoscopic Integrated Imaging Goggles for Multimodal Intraoperative Image Guidance

PubMed Central

Mela, Christopher A.; Patterson, Carrie; Thompson, William K.; Papay, Francis; Liu, Yang

2015-01-01

We have developed novel stereoscopic wearable multimodal intraoperative imaging and display systems entitled Integrated Imaging Goggles for guiding surgeries. The prototype systems offer real time stereoscopic fluorescence imaging and color reflectance imaging capacity, along with in vivo handheld microscopy and ultrasound imaging. With the Integrated Imaging Goggle, both wide-field fluorescence imaging and in vivo microscopy are provided. The real time ultrasound images can also be presented in the goggle display. Furthermore, real time goggle-to-goggle stereoscopic video sharing is demonstrated, which can greatly facilitate telemedicine. In this paper, the prototype systems are described, characterized and tested in surgeries in biological tissues ex vivo. We have found that the system can detect fluorescent targets with as low as 60 nM indocyanine green and can resolve structures down to 0.25 mm with large FOV stereoscopic imaging. The system has successfully guided simulated cancer surgeries in chicken. The Integrated Imaging Goggle is novel in 4 aspects: it is (a) the first wearable stereoscopic wide-field intraoperative fluorescence imaging and display system, (b) the first wearable system offering both large FOV and microscopic imaging simultaneously, (c) the first wearable system that offers both ultrasound imaging and fluorescence imaging capacities, and (d) the first demonstration of goggle-to-goggle communication to share stereoscopic views for medical guidance. PMID:26529249

Multi-species sensing using multi-mode absorption spectroscopy with mid-infrared interband cascade lasers

NASA Astrophysics Data System (ADS)

O'Hagan, S.; Northern, J. H.; Gras, B.; Ewart, P.; Kim, C. S.; Kim, M.; Merritt, C. D.; Bewley, W. W.; Canedy, C. L.; Vurgaftman, I.; Meyer, J. R.

2016-06-01

The application of an interband cascade laser, ICL, to multi-mode absorption spectroscopy, MUMAS, in the mid-infrared region is reported. Measurements of individual mode linewidths of the ICL, derived from the pressure dependence of lineshapes in MUMAS signatures of single, isolated, lines in the spectrum of HCl, were found to be in the range 10-80 MHz. Multi-line spectra of methane were recorded using spectrally limited bandwidths, of approximate width 27 cm-1, defined by an interference filter, and consist of approximately 80 modes at spectral locations spanning the 100 cm-1 bandwidth of the ICL output. Calibration of the methane pressures derived from MUMAS data using a capacitance manometer provided measurements with an uncertainty of 1.1 %. Multi-species sensing is demonstrated by the simultaneous detection of methane, acetylene and formaldehyde in a gas mixture. Individual partial pressures of the three gases are derived from best fits of model MUMAS signatures to the data with an experimental error of 10 %. Using an ICL, with an inter-mode interval of ~10 GHz, MUMAS spectra were recorded at pressures in the range 1-10 mbar, and, based on the data, a potential minimum detection limit of the order of 100 ppmv is estimated for MUMAS at atmospheric pressure using an inter-mode interval of 80 GHz.

Simulating reading acquisition: The link between reading outcome and multimodal brain signatures of letter-speech sound learning in prereaders.

PubMed

Karipidis, Iliana I; Pleisch, Georgette; Brandeis, Daniel; Roth, Alexander; Röthlisberger, Martina; Schneebeli, Maya; Walitza, Susanne; Brem, Silvia

2018-05-08

During reading acquisition, neural reorganization of the human brain facilitates the integration of letters and speech sounds, which enables successful reading. Neuroimaging and behavioural studies have established that impaired audiovisual integration of letters and speech sounds is a core deficit in individuals with developmental dyslexia. This longitudinal study aimed to identify neural and behavioural markers of audiovisual integration that are related to future reading fluency. We simulated the first step of reading acquisition by performing artificial-letter training with prereading children at risk for dyslexia. Multiple logistic regressions revealed that our training provides new precursors of reading fluency at the beginning of reading acquisition. In addition, an event-related potential around 400 ms and functional magnetic resonance imaging activation patterns in the left planum temporale to audiovisual correspondences improved cross-validated prediction of future poor readers. Finally, an exploratory analysis combining simultaneously acquired electroencephalography and hemodynamic data suggested that modulation of temporoparietal brain regions depended on future reading skills. The multimodal approach demonstrates neural adaptations to audiovisual integration in the developing brain that are related to reading outcome. Despite potential limitations arising from the restricted sample size, our results may have promising implications both for identifying poor-reading children and for monitoring early interventions.

Apparatus and method for microwave processing of materials using field-perturbing tool

DOEpatents

Tucker, Denise A.; Fathi, Zakaryae; Lauf, Robert J.

2001-01-01

A variable frequency microwave heating apparatus designed to allow modulation of the frequency of the microwaves introduced into a multi-mode microwave cavity for heating or other selected applications. A field-perturbing tool is disposed within the cavity to perturb the microwave power distribution in order to apply a desired level of microwave power to the workpiece.

Multimodal Interactions in Sensory-Motor Processing

DTIC Science & Technology

1992-06-30

Luce & Green,1972; Wandell and Luce, 1978; Blake, Martens, Garrett & Westendorf , 1980; Fidell, 1970; Fournier & Eriksen, 1990; Rose, Blake and Holper...1988; i Westendorf and Blake, 1988) or at the level of response selection or execution (eg.,Diederich & Colonius, 1987; Eriksen and Schultz, 1977...Mathematical Statistics. Holden-Day, Inc. Oakland, CA. I Blake, R., Martens, W., Garrett, G., & Westendorf , D. (1980). Estimating probability summation for

Wideband Bandpass Filter with High Selectivity and an Adjustable Notched-band Adopting a Multi-mode Resonator

NASA Astrophysics Data System (ADS)

Ma, Xing-Bing; Jiang, Ting

2018-04-01

A wideband bandpass filter (BPF) with an adjustable notched-band and high selectivity is proposed. The proposed BPF consists of a multi-mode resonator (MMR), two λ/2 resonators, and I/O feed lines with 50 ohm characteristic impedance. The MMR, connected as a whole by a wide stub, is composed of one I-shaped resonator and two open-loop resonators. Tightly coupling is built between MMR and λ/2 resonators. I/O feed lines are directly connected with two λ/2 resonators, respectively. Due to the use of tapped-line coupling, one transmission zero (TZ) is formed near low-edge of aim passband. High-edge of passband with one attendant TZ can be tuned to desired location by adjusting bottom-side position of used wide stub or bottom-side length of I-shaped resonator in MMR. The top-side length of I-shaped resonator is applied to improve upper stopband performance and shift undesired resonant mode of MMR near high-edge of aim passband to proper frequency point. The notched-band in aim passband is dominated by top-side position of wide stub in MMR. Good agreement is observed between simulated and measured results.

Multi-Modality Imaging in the Evaluation and Treatment of Mitral Regurgitation.

PubMed

Bouchard, Marc-André; Côté-Laroche, Claudia; Beaudoin, Jonathan

2017-10-13

Mitral regurgitation (MR) is frequent and associated with increased mortality and morbidity when severe. It may be caused by intrinsic valvular disease (primary MR) or ventricular deformation (secondary MR). Imaging has a critical role to document the severity, mechanism, and impact of MR on heart function as selected patients with MR may benefit from surgery whereas other will not. In patients planned for a surgical intervention, imaging is also important to select candidates for mitral valve (MV) repair over replacement and to predict surgical success. Although standard transthoracic echocardiography is the first-line modality to evaluate MR, newer imaging modalities like three-dimensional (3D) transesophageal echocardiography, stress echocardiography, cardiac magnetic resonance (CMR), and computed tomography (CT) are emerging and complementary tools for MR assessment. While some of these modalities can provide insight into MR severity, others will help to determine its mechanism. Understanding the advantages and limitations of each imaging modality is important to appreciate their respective role for MR assessment and help to resolve eventual discrepancies between different diagnostic methods. With the increasing use of transcatheter mitral procedures (repair or replacement) for high-surgical-risk patients, multimodality imaging has now become even more important to determine eligibility, preinterventional planning, and periprocedural guidance.

Comparison of Virginia's multimodal transportation corridors using cost and demographic analyses.

DOT National Transportation Integrated Search

2006-01-01

This effort was performed in support of VTrans2025, Virginia's long-range multimodal transportation plan, and the VTrans2025 Multimodal Advisory Committee. The effort develops a preliminary approach to evaluating multimodal and highway-only corridor ...

Rational Design of a Triple Reporter Gene for Multimodality Molecular Imaging

PubMed Central

Hsieh, Ya-Ju; Ke, Chien-Chih; Yeh, Skye Hsin-Hsien; Lin, Chien-Feng; Chen, Fu-Du; Lin, Kang-Ping; Chen, Ran-Chou; Liu, Ren-Shyan

2014-01-01

Multimodality imaging using noncytotoxic triple fusion (TF) reporter genes is an important application for cell-based tracking, drug screening, and therapy. The firefly luciferase (fl), monomeric red fluorescence protein (mrfp), and truncated herpes simplex virus type 1 thymidine kinase SR39 mutant (ttksr39) were fused together to create TF reporter gene constructs with different order. The enzymatic activities of TF protein in vitro and in vivo were determined by luciferase reporter assay, H-FEAU cellular uptake experiment, bioluminescence imaging, and micropositron emission tomography (microPET). The TF construct expressed in H1299 cells possesses luciferase activity and red fluorescence. The tTKSR39 activity is preserved in TF protein and mediates high levels of H-FEAU accumulation and significant cell death from ganciclovir (GCV) prodrug activation. In living animals, the luciferase and tTKSR39 activities of TF protein have also been successfully validated by multimodality imaging systems. The red fluorescence signal is relatively weak for in vivo imaging but may expedite FACS-based selection of TF reporter expressing cells. We have developed an optimized triple fusion reporter construct DsRedm-fl-ttksr39 for more effective and sensitive in vivo animal imaging using fluorescence, bioluminescence, and PET imaging modalities, which may facilitate different fields of biomedical research and applications. PMID:24809057

Near-infrared light-triggered theranostics for tumor-specific enhanced multimodal imaging and photothermal therapy

PubMed Central

Wu, Bo; Wan, Bing; Lu, Shu-Ting; Deng, Kai; Li, Xiao-Qi; Wu, Bao-Lin; Li, Yu-Shuang; Liao, Ru-Fang; Huang, Shi-Wen; Xu, Hai-Bo

2017-01-01

The major challenge in current clinic contrast agents (CAs) and chemotherapy is the poor tumor selectivity and response. Based on the self-quench property of IR820 at high concentrations, and different contrast effect ability of Gd-DOTA between inner and outer of liposome, we developed “bomb-like” light-triggered CAs (LTCAs) for enhanced CT/MRI/FI multimodal imaging, which can improve the signal-to-noise ratio of tumor tissue specifically. IR820, Iohexol and Gd-chelates were firstly encapsulated into the thermal-sensitive nanocarrier with a high concentration. This will result in protection and fluorescence quenching. Then, the release of CAs was triggered by near-infrared (NIR) light laser irradiation, which will lead to fluorescence and MRI activation and enable imaging of inflammation. In vitro and in vivo experiments demonstrated that LTCAs with 808 nm laser irradiation have shorter T1 relaxation time in MRI and stronger intensity in FI compared to those without irradiation. Additionally, due to the high photothermal conversion efficiency of IR820, the injection of LTCAs was demonstrated to completely inhibit C6 tumor growth in nude mice up to 17 days after NIR laser irradiation. The results indicate that the LTCAs can serve as a promising platform for NIR-activated multimodal imaging and photothermal therapy. PMID:28670120

Skill training in multimodal virtual environments.

PubMed

Gopher, Daniel

2012-01-01

Multimodal, immersive, virtual reality (VR) techniques open new perspectives for perceptual-motor skill trainers. They also introduce new risks and dangers. This paper describes the benefits and pitfalls of multimodal training and the cognitive building blocks of a multimodal, VR training simulators.

Therapeutic approaches for patients with coexisting familial adenomatous polyposis and colorectal cancer.

PubMed

Inoue, Yasuhiro; Ishida, Hideyuki; Ueno, Hideki; Kobayashi, Hirotoshi; Yamaguchi, Tatsuro; Konishi, Tsuyoshi; Tomita, Naohiro; Matsubara, Nagahide; Ishida, Fumio; Hinoi, Takao; Kanemitsu, Yukihide; Watanabe, Toshiaki; Sugihara, Kenichi

2016-09-01

Colorectal cancer is a major cause of death in patients with familial adenomatous polyposis. Despite evidence for prophylactic colectomy, there is no ideal therapy for patients with coexisting familial adenomatous polyposis and colorectal cancer. We evaluated the correlation between surgery for familial adenomatous polyposis and multimodal treatment for colorectal cancer, and clarified prognosis of Japanese patients with familial adenomatous polyposis and colorectal cancer. We retrospectively reviewed data from 303 patients who underwent colorectal surgery for familial adenomatous polyposis between 2000 and 2012. Overall, 172 patients had colorectal cancer. The most common procedure for familial adenomatous polyposis was restorative proctocolectomy with ileal pouch anal anastomosis, irrespective of colorectal cancer. Partial colectomy was more frequent in patients with than without colorectal cancer (8.7% and 0%, respectively). Ileal pouch anal anastomosis was frequently (60.6%) performed in patients with Stage I-III colorectal cancer. Overall, 12 of 20 patients with Stage IV colorectal cancer underwent metastasectomy; six patients simultaneously and six metachronously. There were fewer cases of ileal pouch anal anastomosis, but more total colectomy with ileorectal anastomosis was performed metachronously, compared with simultaneous metastasectomy (P = 0.006). More cytotoxic (P = 0.006) and molecular (P = 0.03) agents were administered to the ileorectal anastomosis/partial colectomy patients, compared with total proctocolectomy/ileal pouch anal anastomosis patients. A 5-year overall survival was 100% in Stage 0/I, 89.8% in Stage II, 87.9% in Stage III and 48.4% in Stage IV. In patients with familial adenomatous polyposis and colorectal cancer, primary surgery, metastasectomy and chemotherapy could be compatible with standard surgical approaches for familial adenomatous polyposis . However, modifying surgical procedures for familial adenomatous polyposis might help multimodality therapy for Stage IV colorectal cancer to prolong survival. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Scanning ion conductance microscopy: a convergent high-resolution technology for multi-parametric analysis of living cardiovascular cells

PubMed Central

Miragoli, Michele; Moshkov, Alexey; Novak, Pavel; Shevchuk, Andrew; Nikolaev, Viacheslav O.; El-Hamamsy, Ismail; Potter, Claire M. F.; Wright, Peter; Kadir, S.H. Sheikh Abdul; Lyon, Alexander R.; Mitchell, Jane A.; Chester, Adrian H.; Klenerman, David; Lab, Max J.; Korchev, Yuri E.; Harding, Sian E.; Gorelik, Julia

2011-01-01

Cardiovascular diseases are complex pathologies that include alterations of various cell functions at the levels of intact tissue, single cells and subcellular signalling compartments. Conventional techniques to study these processes are extremely divergent and rely on a combination of individual methods, which usually provide spatially and temporally limited information on single parameters of interest. This review describes scanning ion conductance microscopy (SICM) as a novel versatile technique capable of simultaneously reporting various structural and functional parameters at nanometre resolution in living cardiovascular cells at the level of the whole tissue, single cells and at the subcellular level, to investigate the mechanisms of cardiovascular disease. SICM is a multimodal imaging technology that allows concurrent and dynamic analysis of membrane morphology and various functional parameters (cell volume, membrane potentials, cellular contraction, single ion-channel currents and some parameters of intracellular signalling) in intact living cardiovascular cells and tissues with nanometre resolution at different levels of organization (tissue, cellular and subcellular levels). Using this technique, we showed that at the tissue level, cell orientation in the inner and outer aortic arch distinguishes atheroprone and atheroprotected regions. At the cellular level, heart failure leads to a pronounced loss of T-tubules in cardiac myocytes accompanied by a reduction in Z-groove ratio. We also demonstrated the capability of SICM to measure the entire cell volume as an index of cellular hypertrophy. This method can be further combined with fluorescence to simultaneously measure cardiomyocyte contraction and intracellular calcium transients or to map subcellular localization of membrane receptors coupled to cyclic adenosine monophosphate production. The SICM pipette can be used for patch-clamp recordings of membrane potential and single channel currents. In conclusion, SICM provides a highly informative multimodal imaging platform for functional analysis of the mechanisms of cardiovascular diseases, which should facilitate identification of novel therapeutic strategies. PMID:21325316

Construction of Multimodal Transport Information Platform

NASA Astrophysics Data System (ADS)

Wang, Ya; Cheng, Yu; Zhao, Zhi

2018-06-01

With the rapid development of economy, the volume of transportation in China is increasing, the opening process of the market is accelerating, the scale of enterprises is expanding, the service quality is being improved, and the container multimodal transport is developing continuously.The hardware infrastructure of container multimodal transport is improved obviously, but the network platform construction of multimodal transport is still insufficient.Taking Shandong region of China as an example, the present situation of container multimodal transport in Shandong area can no longer meet the requirement of rapid development of container, and the construction of network platform needs to be solved urgently. Therefore, this paper will briefly describe the conception of construction of multimodal transport network platform in Shandong area.In order to achieve the rapid development of multimodal transport.

Laser tissue coagulation and concurrent optical coherence tomography through a double-clad fiber coupler.

PubMed

Beaudette, Kathy; Baac, Hyoung Won; Madore, Wendy-Julie; Villiger, Martin; Godbout, Nicolas; Bouma, Brett E; Boudoux, Caroline

2015-04-01

Double-clad fiber (DCF) is herein used in conjunction with a double-clad fiber coupler (DCFC) to enable simultaneous and co-registered optical coherence tomography (OCT) and laser tissue coagulation. The DCF allows a single channel fiber-optic probe to be shared: i.e. the core propagating the OCT signal while the inner cladding delivers the coagulation laser light. We herein present a novel DCFC designed and built to combine both signals within a DCF (>90% of single-mode transmission; >65% multimode coupling). Potential OCT imaging degradation mechanisms are also investigated and solutions to mitigate them are presented. The combined DCFC-based system was used to induce coagulation of an ex vivo swine esophagus allowing a real-time assessment of thermal dynamic processes. We therefore demonstrate a DCFC-based system combining OCT imaging with laser coagulation through a single fiber, thus enabling both modalities to be performed simultaneously and in a co-registered manner. Such a system enables endoscopic image-guided laser marking of superficial epithelial tissues or laser thermal therapy of epithelial lesions in pathologies such as Barrett's esophagus.

Towards Omni-Tomography—Grand Fusion of Multiple Modalities for Simultaneous Interior Tomography

PubMed Central

Wang, Ge; Zhang, Jie; Gao, Hao; Weir, Victor; Yu, Hengyong; Cong, Wenxiang; Xu, Xiaochen; Shen, Haiou; Bennett, James; Furth, Mark; Wang, Yue; Vannier, Michael

2012-01-01

We recently elevated interior tomography from its origin in computed tomography (CT) to a general tomographic principle, and proved its validity for other tomographic modalities including SPECT, MRI, and others. Here we propose “omni-tomography”, a novel concept for the grand fusion of multiple tomographic modalities for simultaneous data acquisition in a region of interest (ROI). Omni-tomography can be instrumental when physiological processes under investigation are multi-dimensional, multi-scale, multi-temporal and multi-parametric. Both preclinical and clinical studies now depend on in vivo tomography, often requiring separate evaluations by different imaging modalities. Over the past decade, two approaches have been used for multimodality fusion: Software based image registration and hybrid scanners such as PET-CT, PET-MRI, and SPECT-CT among others. While there are intrinsic limitations with both approaches, the main obstacle to the seamless fusion of multiple imaging modalities has been the bulkiness of each individual imager and the conflict of their physical (especially spatial) requirements. To address this challenge, omni-tomography is now unveiled as an emerging direction for biomedical imaging and systems biomedicine. PMID:22768108

Laser tissue coagulation and concurrent optical coherence tomography through a double-clad fiber coupler

PubMed Central

Beaudette, Kathy; Baac, Hyoung Won; Madore, Wendy-Julie; Villiger, Martin; Godbout, Nicolas; Bouma, Brett E.; Boudoux, Caroline

2015-01-01

Double-clad fiber (DCF) is herein used in conjunction with a double-clad fiber coupler (DCFC) to enable simultaneous and co-registered optical coherence tomography (OCT) and laser tissue coagulation. The DCF allows a single channel fiber-optic probe to be shared: i.e. the core propagating the OCT signal while the inner cladding delivers the coagulation laser light. We herein present a novel DCFC designed and built to combine both signals within a DCF (>90% of single-mode transmission; >65% multimode coupling). Potential OCT imaging degradation mechanisms are also investigated and solutions to mitigate them are presented. The combined DCFC-based system was used to induce coagulation of an ex vivo swine esophagus allowing a real-time assessment of thermal dynamic processes. We therefore demonstrate a DCFC-based system combining OCT imaging with laser coagulation through a single fiber, thus enabling both modalities to be performed simultaneously and in a co-registered manner. Such a system enables endoscopic image-guided laser marking of superficial epithelial tissues or laser thermal therapy of epithelial lesions in pathologies such as Barrett’s esophagus. PMID:25909013

Simultaneous neural and movement recording in large-scale immersive virtual environments.

PubMed

Snider, Joseph; Plank, Markus; Lee, Dongpyo; Poizner, Howard

2013-10-01

Virtual reality (VR) allows precise control and manipulation of rich, dynamic stimuli that, when coupled with on-line motion capture and neural monitoring, can provide a powerful means both of understanding brain behavioral relations in the high dimensional world and of assessing and treating a variety of neural disorders. Here we present a system that combines state-of-the-art, fully immersive, 3D, multi-modal VR with temporally aligned electroencephalographic (EEG) recordings. The VR system is dynamic and interactive across visual, auditory, and haptic interactions, providing sight, sound, touch, and force. Crucially, it does so with simultaneous EEG recordings while subjects actively move about a 20 × 20 ft² space. The overall end-to-end latency between real movement and its simulated movement in the VR is approximately 40 ms. Spatial precision of the various devices is on the order of millimeters. The temporal alignment with the neural recordings is accurate to within approximately 1 ms. This powerful combination of systems opens up a new window into brain-behavioral relations and a new means of assessment and rehabilitation of individuals with motor and other disorders.

Architecture for a PACS primary diagnosis workstation

NASA Astrophysics Data System (ADS)

Shastri, Kaushal; Moran, Byron

1990-08-01

A major factor in determining the overall utility of a medical Picture Archiving and Communications (PACS) system is the functionality of the diagnostic workstation. Meyer-Ebrecht and Wendler [1] have proposed a modular picture computer architecture with high throughput and Perry et.al [2] have defined performance requirements for radiology workstations. In order to be clinically useful, a primary diagnosis workstation must not only provide functions of current viewing systems (e.g. mechanical alternators [3,4]) such as acceptable image quality, simultaneous viewing of multiple images, and rapid switching of image banks; but must also provide a diagnostic advantage over the current systems. This includes window-level functions on any image, simultaneous display of multi-modality images, rapid image manipulation, image processing, dynamic image display (cine), electronic image archival, hardcopy generation, image acquisition, network support, and an easy user interface. Implementation of such a workstation requires an underlying hardware architecture which provides high speed image transfer channels, local storage facilities, and image processing functions. This paper describes the hardware architecture of the Siemens Diagnostic Reporting Console (DRC) which meets these requirements.

Simultaneous MRI and PET imaging of a rat brain

NASA Astrophysics Data System (ADS)

Raylman, Raymond R.; Majewski, Stan; Lemieux, Susan K.; Sendhil Velan, S.; Kross, Brian; Popov, Vladimir; Smith, Mark F.; Weisenberger, Andrew G.; Zorn, Carl; Marano, Gary D.

2006-12-01

Multi-modality imaging is rapidly becoming a valuable tool in the diagnosis of disease and in the development of new drugs. Functional images produced with PET fused with anatomical structure images created by MRI will allow the correlation of form with function. Our group is developing a system to acquire MRI and PET images contemporaneously. The prototype device consists of two opposed detector heads, operating in coincidence mode. Each MRI-PET detector module consists of an array of LSO detector elements coupled through a long fibre optic light guide to a single Hamamatsu flat panel position-sensitive photomultiplier tube (PSPMT). The use of light guides allows the PSPMTs to be positioned outside the bore of a 3T MRI scanner where the magnetic field is relatively small. To test the device, simultaneous MRI and PET images of the brain of a male Sprague Dawley rat injected with FDG were successfully obtained. The images revealed no noticeable artefacts in either image set. Future work includes the construction of a full ring PET scanner, improved light guides and construction of a specialized MRI coil to permit higher quality MRI imaging.

Polinsar Experiments of Multi-Mode X-Band Data Over South Area of China

NASA Astrophysics Data System (ADS)

Lu, L.; Yan, Q.; Duan, M.; Zhang, Y.

2012-08-01

This paper makes the polarimetric and polarimetric interferometric synthetic aperture radar (PolInSAR) experiments with the high-resolution X-band data acquired by Multi-mode airborne SAR system over an area around Linshui, south of China containing tropic vegetation and urban areas. Polarimetric analysis for typical tropic vegetations and man-made objects are presented, some polarimetric descriptors sensitive to vegetations and man-made objects are selected. Then, the PolInSAR information contained in the data is investigated, considering characteristics of the Multi-mode-XSAR dataset, a dual-baseline polarimetric interferometry method is proposed in this paper. The method both guarantees the high coherence on fully polarimetric data and combines the benefits of short and long baseline that helpful to the phase unwrapping and height sensitivity promotion. PolInSAR experiment results displayed demonstrates Multi-mode-XSAR datasets have intuitive capabilities for amount of application of land classification, objects detection and DSM mapping.

Advanced multimodality imaging of an anomalous vessel between the ascending aorta and main pulmonary artery in a dog

PubMed Central

Markovic, Lauren E.; Kellihan, Heidi B.; Roldán-Alzate, Alejandro; Drees, Randi; Bjorling, Dale E.; Francois, Chris J.

2014-01-01

A 1-year-old male German shorthaired pointer was referred for evaluation of tachypnea and hemoptysis. A grade VI/VI left basilar continuous murmur was ausculted. Multimodality imaging consisting of thoracic radiographs, transthoracic and transesophageal echocardiography, fluoroscopy-guided selective angiography, computed tomography angiogram (CTA) and magnetic resonance angiogram (MRA), was performed on this patient. The defect included a left-to-right shunting anomalous vessel between the ascending aorta and main pulmonary artery, along with a dissecting aneurysm of the main and right pulmonary artery. An MRA postprocessing technique (PC-VIPR) was used to allow for high resolution angiographic images and further assessment of the patient’s hemodynamics prior to surgical correction. This case report describes the clinical course of a canine patient with a rare form of congenital cardiac disease, and the multiple imaging modalities that were used to aid in diagnosis and treatment. PMID:24485987

Negotiating Multicollinearity with Spike-and-Slab Priors.

PubMed

Ročková, Veronika; George, Edward I

2014-08-01

In multiple regression under the normal linear model, the presence of multicollinearity is well known to lead to unreliable and unstable maximum likelihood estimates. This can be particularly troublesome for the problem of variable selection where it becomes more difficult to distinguish between subset models. Here we show how adding a spike-and-slab prior mitigates this difficulty by filtering the likelihood surface into a posterior distribution that allocates the relevant likelihood information to each of the subset model modes. For identification of promising high posterior models in this setting, we consider three EM algorithms, the fast closed form EMVS version of Rockova and George (2014) and two new versions designed for variants of the spike-and-slab formulation. For a multimodal posterior under multicollinearity, we compare the regions of convergence of these three algorithms. Deterministic annealing versions of the EMVS algorithm are seen to substantially mitigate this multimodality. A single simple running example is used for illustration throughout.

A Systematic Review of Biopsychosocial Training Programs for the Self-Management of Emotional Stress: Potential Applications for the Military

PubMed Central

Clausen, Shawn S.; Jonas, Wayne B.; Walter, Joan A. G.

2013-01-01

Combat-exposed troops and their family members are at risk for stress reactions and related disorders. Multimodal biopsychosocial training programs incorporating complementary and alternative self-management techniques have the potential to reduce stress-related symptoms and dysfunction. Such training can preempt or attenuate the posttraumatic stress response and may be effectively incorporated into the training cycle for deploying and redeploying troops and their families. A large systematic review was conducted to survey the literature on multimodal training programs for the self-management of emotional stress. This report is an overview of the randomized controlled trials (RCTs) identified in this systematic review. Select programs such as mindfulness-Based Stress Reduction, Cognitive Behavioral Stress Management, Autogenic Training, Relaxation Response Training, and other meditation and mind-body skills practices are highlighted, and the feasibility of their implementation within military settings is addressed. PMID:24174982

A systematic review of biopsychosocial training programs for the self-management of emotional stress: potential applications for the military.

PubMed

Crawford, Cindy; Wallerstedt, Dawn B; Khorsan, Raheleh; Clausen, Shawn S; Jonas, Wayne B; Walter, Joan A G

2013-01-01

Combat-exposed troops and their family members are at risk for stress reactions and related disorders. Multimodal biopsychosocial training programs incorporating complementary and alternative self-management techniques have the potential to reduce stress-related symptoms and dysfunction. Such training can preempt or attenuate the posttraumatic stress response and may be effectively incorporated into the training cycle for deploying and redeploying troops and their families. A large systematic review was conducted to survey the literature on multimodal training programs for the self-management of emotional stress. This report is an overview of the randomized controlled trials (RCTs) identified in this systematic review. Select programs such as mindfulness-Based Stress Reduction, Cognitive Behavioral Stress Management, Autogenic Training, Relaxation Response Training, and other meditation and mind-body skills practices are highlighted, and the feasibility of their implementation within military settings is addressed.

"Filming in Progress": New Spaces for Multimodal Designing

ERIC Educational Resources Information Center

Mills, Kathy A.

2010-01-01

Global trends call for new research to investigate multimodal designing mediated by new technologies and the implications for classroom spaces. This article addresses the relationship between new technologies, students' multimodal designing, and the social production of classroom spaces. Multimodal semiotics and sociological principles are applied…

IDH mutation assessment of glioma using texture features of multimodal MR images

NASA Astrophysics Data System (ADS)

Zhang, Xi; Tian, Qiang; Wu, Yu-Xia; Xu, Xiao-Pan; Li, Bao-Juan; Liu, Yi-Xiong; Liu, Yang; Lu, Hong-Bing

2017-03-01

Purpose: To 1) find effective texture features from multimodal MRI that can distinguish IDH mutant and wild status, and 2) propose a radiomic strategy for preoperatively detecting IDH mutation patients with glioma. Materials and Methods: 152 patients with glioma were retrospectively included from the Cancer Genome Atlas. Corresponding T1-weighted image before- and post-contrast, T2-weighted image and fluid-attenuation inversion recovery image from the Cancer Imaging Archive were analyzed. Specific statistical tests were applied to analyze the different kind of baseline information of LrGG patients. Finally, 168 texture features were derived from multimodal MRI per patient. Then the support vector machine-based recursive feature elimination (SVM-RFE) and classification strategy was adopted to find the optimal feature subset and build the identification models for detecting the IDH mutation. Results: Among 152 patients, 92 and 60 were confirmed to be IDH-wild and mutant, respectively. Statistical analysis showed that the patients without IDH mutation was significant older than patients with IDH mutation (p<0.01), and the distribution of some histological subtypes was significant different between IDH wild and mutant groups (p<0.01). After SVM-RFE, 15 optimal features were determined for IDH mutation detection. The accuracy, sensitivity, specificity, and AUC after SVM-RFE and parameter optimization were 82.2%, 85.0%, 78.3%, and 0.841, respectively. Conclusion: This study presented a radiomic strategy for noninvasively discriminating IDH mutation of patients with glioma. It effectively incorporated kinds of texture features from multimodal MRI, and SVM-based classification strategy. Results suggested that features selected from SVM-RFE were more potential to identifying IDH mutation. The proposed radiomics strategy could facilitate the clinical decision making in patients with glioma.

Multimodal exercise training in multiple sclerosis: A randomized controlled trial in persons with substantial mobility disability.

PubMed

Sandroff, Brian M; Bollaert, Rachel E; Pilutti, Lara A; Peterson, Melissa L; Baynard, Tracy; Fernhall, Bo; McAuley, Edward; Motl, Robert W

2017-10-01

Mobility disability is a common, debilitating feature of multiple sclerosis (MS). Exercise training has been identified as an approach to improve MS-related mobility disability. However, exercise randomized controlled trials (RCTs) on mobility in MS have generally not selectively targeted those with the onset of irreversible mobility disability. The current multi-site RCT compared the efficacy of 6-months of supervised, multimodal exercise training with an active control condition for improving mobility, gait, physical fitness, and cognitive outcomes in persons with substantial MS-related mobility disability. 83 participants with substantial MS-related mobility disability underwent initial mobility, gait, fitness, and cognitive processing speed assessments and were randomly assigned to 6-months of supervised multimodal (progressive aerobic, resistance, and balance) exercise training (intervention condition) or stretching-and-toning activities (control condition). Participants completed the same outcome assessments halfway through and immediately following the 6-month study period. There were statistically significant improvements in six-minute walk performance (F(2158)=3.12, p=0.05, η p 2 =0.04), peak power output (F(2150)=8.16, p<0.01, η p 2 =0.10), and Paced Auditory Serial Addition Test performance (F(2162)=4.67, p=0.01, η p 2 =0.05), but not gait outcomes, for those who underwent the intervention compared with those who underwent the control condition. This RCT provides novel, preliminary evidence that multimodal exercise training may improve endurance walking performance and cognitive processing speed, perhaps based on improvements in cardiorespiratory capacity, in persons with MS with substantial mobility disability. This is critical for informing the development of multi-site exercise rehabilitation programs in larger samples of persons with MS-related mobility disability. Copyright © 2017 Elsevier Inc. All rights reserved.

Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations.

PubMed

Meyer, C R; Boes, J L; Kim, B; Bland, P H; Zasadny, K R; Kison, P V; Koral, K; Frey, K A; Wahl, R L

1997-04-01

This paper applies and evaluates an automatic mutual information-based registration algorithm across a broad spectrum of multimodal volume data sets. The algorithm requires little or no pre-processing, minimal user input and easily implements either affine, i.e. linear or thin-plate spline (TPS) warped registrations. We have evaluated the algorithm in phantom studies as well as in selected cases where few other algorithms could perform as well, if at all, to demonstrate the value of this new method. Pairs of multimodal gray-scale volume data sets were registered by iteratively changing registration parameters to maximize mutual information. Quantitative registration errors were assessed in registrations of a thorax phantom using PET/CT and in the National Library of Medicine's Visible Male using MRI T2-/T1-weighted acquisitions. Registrations of diverse clinical data sets were demonstrated including rotate-translate mapping of PET/MRI brain scans with significant missing data, full affine mapping of thoracic PET/CT and rotate-translate mapping of abdominal SPECT/CT. A five-point thin-plate spline (TPS) warped registration of thoracic PET/CT is also demonstrated. The registration algorithm converged in times ranging between 3.5 and 31 min for affine clinical registrations and 57 min for TPS warping. Mean error vector lengths for rotate-translate registrations were measured to be subvoxel in phantoms. More importantly the rotate-translate algorithm performs well even with missing data. The demonstrated clinical fusions are qualitatively excellent at all levels. We conclude that such automatic, rapid, robust algorithms significantly increase the likelihood that multimodality registrations will be routinely used to aid clinical diagnoses and post-therapeutic assessment in the near future.

Quasi-interferometric scheme improved by fiber Bragg grating written on macrostructure defect in silica multimode optical fiber operating in a few-mode regime

NASA Astrophysics Data System (ADS)

Evtushenko, Alexander S.; Faskhutdinov, Lenar M.; Kafarova, Anastasia M.; Kuznetzov, Artem A.; Minaeva, Alina Yu.; Sevruk, Nikita L.; Nureev, Ilnur I.; Vasilets, Alexander A.; Andreev, Vladimir A.; Morozov, Oleg G.; Burdin, Vladimir A.; Bourdine, Anton V.

2017-04-01

This work presents results of experimental approbation of earlier on proposed modified fiber optic stress sensor based on a few-mode effects occurring during laser-excited optical signal propagation over silica multimode optical fiber (MMF). Modification is concerned with a passage to quasi-interferometric scheme realized by two multimode Y-couplers with equalized arm lengths improved by fiber Bragg grating (FBG) written on preliminary formed precision macrostructure defects in silica multimode graded-index optical fibers and special offset launching conditions providing laser-based excitation of higher-order modes. The "arms" of quasi-interferometer are two equalized lengths of MMF Cat. OM2 with great central dip of refractive index profile and strong pulse splitting due to high differential mode delay (DMD). We tested FBGs with Bragg wavelength both 1310 nm and 1550 nm written over tapers or up-tapers preliminary formed in short pieces of MMF Cat. OM2+/OM3 and further jointed to the end of one of the arms before output Y-coupler. Researches were focused on comparison analysis of pulse responses under changing of selected excited mode mixing and power diffusion processes due to stress distributed action to sensor fiber depending. Here we considered FBGs not only as particular wavelength reflector during spectral response measurement but also as local periodic microstructure defect which strongly effects on few-mode signal components mixing process also improved by combination with macro-defect like taper or up-taper that should provide response variation. Some results pulse response measurements produced for different scheme configuration and their comparison analysis are represented.

Towards a Multifunctional Electrochemical Sensing and Niosome Generation Lab-on-Chip Platform Based on a Plug-and-Play Concept.

PubMed

Kara, Adnane; Rouillard, Camille; Mathault, Jessy; Boisvert, Martin; Tessier, Frédéric; Landari, Hamza; Melki, Imene; Laprise-Pelletier, Myriam; Boisselier, Elodie; Fortin, Marc-André; Boilard, Eric; Greener, Jesse; Miled, Amine

2016-05-28

In this paper, we present a new modular lab on a chip design for multimodal neurotransmitter (NT) sensing and niosome generation based on a plug-and-play concept. This architecture is a first step toward an automated platform for an automated modulation of neurotransmitter concentration to understand and/or treat neurodegenerative diseases. A modular approach has been adopted in order to handle measurement or drug delivery or both measurement and drug delivery simultaneously. The system is composed of three fully independent modules: three-channel peristaltic micropumping system, a three-channel potentiostat and a multi-unit microfluidic system composed of pseudo-Y and cross-shape channels containing a miniature electrode array. The system was wirelessly controlled by a computer interface. The system is compact, with all the microfluidic and sensing components packaged in a 5 cm × 4 cm × 4 cm box. Applied to serotonin, a linear calibration curve down to 0.125 mM, with a limit of detection of 31 μ M was collected at unfunctionalized electrodes. Added sensitivity and selectivity was achieved by incorporating functionalized electrodes for dopamine sensing. Electrode functionalization was achieved with gold nanoparticles and using DNA and o-phenylene diamine polymer. The as-configured platform is demonstrated as a central component toward an "intelligent" drug delivery system based on a feedback loop to monitor drug delivery.

Towards a Multifunctional Electrochemical Sensing and Niosome Generation Lab-on-Chip Platform Based on a Plug-and-Play Concept

PubMed Central

Kara, Adnane; Rouillard, Camille; Mathault, Jessy; Boisvert, Martin; Tessier, Frédéric; Landari, Hamza; Melki, Imene; Laprise-Pelletier, Myriam; Boisselier, Elodie; Fortin, Marc-André; Boilard, Eric; Greener, Jesse; Miled, Amine

2016-01-01

In this paper, we present a new modular lab on a chip design for multimodal neurotransmitter (NT) sensing and niosome generation based on a plug-and-play concept. This architecture is a first step toward an automated platform for an automated modulation of neurotransmitter concentration to understand and/or treat neurodegenerative diseases. A modular approach has been adopted in order to handle measurement or drug delivery or both measurement and drug delivery simultaneously. The system is composed of three fully independent modules: three-channel peristaltic micropumping system, a three-channel potentiostat and a multi-unit microfluidic system composed of pseudo-Y and cross-shape channels containing a miniature electrode array. The system was wirelessly controlled by a computer interface. The system is compact, with all the microfluidic and sensing components packaged in a 5 cm × 4 cm × 4 cm box. Applied to serotonin, a linear calibration curve down to 0.125 mM, with a limit of detection of 31 μM was collected at unfunctionalized electrodes. Added sensitivity and selectivity was achieved by incorporating functionalized electrodes for dopamine sensing. Electrode functionalization was achieved with gold nanoparticles and using DNA and o-phenylene diamine polymer. The as-configured platform is demonstrated as a central component toward an “intelligent” drug delivery system based on a feedback loop to monitor drug delivery. PMID:27240377

Which kind of exercise is best in fibromyalgia therapeutic programmes? A practical review.

PubMed

Cazzola, M; Atzeni, F; Salaffi, F; Stisi, S; Cassisi, G; Sarzi-Puttini, P

2010-01-01

All of the specialists who deal in some way with fibromyalgia (FM) broadly agree that physical reconditioning programmes are useful, but it is not yet clear what type of physical activity is the most appropriate for different subsets of patients. The aim of this review was to examine the randomised controlled trials (RCTs) published between 1985 and August 2010 whose outcome measures indicate the effectiveness of different types of physical exercise (PE) on the main health domains affected by FM: pain, and physical and mental function. Studies that simultaneously used different types of PE or multimodal treatment strategies were excluded from the analysis, as were those in which the primary and secondary endpoints prevented any assessment of treatment efficacy in all three health domains. Twenty-seven studies were selected: 15 considered land-based physical aerobic exercise (PAE); seven exercises in water; and five muscle strengthening exercise (MSE). There was substantial uniformity in assessing the effectiveness of land- or water-based PAE and MSE in improving aerobic physical fitness (PF) and functional state. Water-based PAE offers some advantages over similarly intense land-based PAE in reducing spontaneous pain and improving depressive symptoms, but the data are insufficient to establish its overall superiority. Regardless of method, the latest findings concerning the neurophysiology of nociception indicate the fundamental importance of assigning workloads that do not exacerbate post-exercise pain.

Investigation on the impact of irregular fringe patterns of a single-fiber Mach-Zehnder interferometer on its sensing capabilities

NASA Astrophysics Data System (ADS)

Kumar, Naveen; Kumar, Ashish

2018-07-01

A novel single-mode single-fiber (SMSF) MZI formed by cascading of two non-adiabatic fiber tapers, with stable and repeatable spectrum, has been found to be useful in sensing applications in recent times. A multimode interference based novel simulation approach is proposed to predict the sensing characteristics of SMSF-MZI and is validated with experimental observation. The proposed method includes solving of simultaneous non-homogenous equations for determining the amplitudes of the interfering modes excited in the tapered section of the interferometer. The simulated fringe pattern and the experimental spectral response converge to some important comprehension reported for the first time. A linear shift in output spectral response, of SMSF-MZI, due to change in optical path length induced by temperature/strain etc., is likely to be characterized by three modes interference occurring in the interference region of the interferometer. Whereas if the spectral shift starts saturating at moderately higher temperature/strain, then the formation of interference fringes are possibly governed by two modes interference. Further, it was also explained that a SMSF-MZI with variable fringe widths in its spectral pattern exhibits higher sensitivity than that of the SMSF-MZI having wavelength spectrum with uniform free spectral range. These findings are useful in selecting and predicting the sensitivity of a given SMSF-MZI, based on its spectrum, for sensing applications.

Adaptive multimodal interaction in mobile augmented reality: A conceptual framework

NASA Astrophysics Data System (ADS)

Abidin, Rimaniza Zainal; Arshad, Haslina; Shukri, Saidatul A'isyah Ahmad

2017-10-01

Recently, Augmented Reality (AR) is an emerging technology in many mobile applications. Mobile AR was defined as a medium for displaying information merged with the real world environment mapped with augmented reality surrounding in a single view. There are four main types of mobile augmented reality interfaces and one of them are multimodal interfaces. Multimodal interface processes two or more combined user input modes (such as speech, pen, touch, manual gesture, gaze, and head and body movements) in a coordinated manner with multimedia system output. In multimodal interface, many frameworks have been proposed to guide the designer to develop a multimodal applications including in augmented reality environment but there has been little work reviewing the framework of adaptive multimodal interface in mobile augmented reality. The main goal of this study is to propose a conceptual framework to illustrate the adaptive multimodal interface in mobile augmented reality. We reviewed several frameworks that have been proposed in the field of multimodal interfaces, adaptive interface and augmented reality. We analyzed the components in the previous frameworks and measure which can be applied in mobile devices. Our framework can be used as a guide for designers and developer to develop a mobile AR application with an adaptive multimodal interfaces.

Analyzing a multimodal biometric system using real and virtual users

NASA Astrophysics Data System (ADS)

Scheidat, Tobias; Vielhauer, Claus

2007-02-01

Three main topics of recent research on multimodal biometric systems are addressed in this article: The lack of sufficiently large multimodal test data sets, the influence of cultural aspects and data protection issues of multimodal biometric data. In this contribution, different possibilities are presented to extend multimodal databases by generating so-called virtual users, which are created by combining single biometric modality data of different users. Comparative tests on databases containing real and virtual users based on a multimodal system using handwriting and speech are presented, to study to which degree the use of virtual multimodal databases allows conclusions with respect to recognition accuracy in comparison to real multimodal data. All tests have been carried out on databases created from donations from three different nationality groups. This allows to review the experimental results both in general and in context of cultural origin. The results show that in most cases the usage of virtual persons leads to lower accuracy than the usage of real users in terms of the measurement applied: the Equal Error Rate. Finally, this article will address the general question how the concept of virtual users may influence the data protection requirements for multimodal evaluation databases in the future.

Radiolabeled Nanoparticles for Multimodality Tumor Imaging

PubMed Central

Xing, Yan; Zhao, Jinhua; Conti, Peter S.; Chen, Kai

2014-01-01

Each imaging modality has its own unique strengths. Multimodality imaging, taking advantages of strengths from two or more imaging modalities, can provide overall structural, functional, and molecular information, offering the prospect of improved diagnostic and therapeutic monitoring abilities. The devices of molecular imaging with multimodality and multifunction are of great value for cancer diagnosis and treatment, and greatly accelerate the development of radionuclide-based multimodal molecular imaging. Radiolabeled nanoparticles bearing intrinsic properties have gained great interest in multimodality tumor imaging over the past decade. Significant breakthrough has been made toward the development of various radiolabeled nanoparticles, which can be used as novel cancer diagnostic tools in multimodality imaging systems. It is expected that quantitative multimodality imaging with multifunctional radiolabeled nanoparticles will afford accurate and precise assessment of biological signatures in cancer in a real-time manner and thus, pave the path towards personalized cancer medicine. This review addresses advantages and challenges in developing multimodality imaging probes by using different types of nanoparticles, and summarizes the recent advances in the applications of radiolabeled nanoparticles for multimodal imaging of tumor. The key issues involved in the translation of radiolabeled nanoparticles to the clinic are also discussed. PMID:24505237

Multimodal Career Education for Nursing Students.

ERIC Educational Resources Information Center

Southern, Stephen; Smith, Robert L.

A multimodal career education model entitled BEST IDEA was field tested as an approach to the problem of retaining skilled nurses in the work force. Using multimodal assessment and intervention strategies derived from the multimodal behavior therapy of Arnold Lazarus, researchers developed an individualized career development assessment and…

Locating the Semiotic Power of Multimodality

ERIC Educational Resources Information Center

Hull, Glynda A.; Nelson, Mark Evan

2005-01-01

This article reports research that attempts to characterize what is powerful about digital multimodal texts. Building from recent theoretical work on understanding the workings and implications of multimodal communication, the authors call for a continuing empirical investigation into the roles that digital multimodal texts play in real-world…

Device, Algorithm and Integrated Modeling Research for Performance-Drive Multi-Modal Optical Sensors

DTIC Science & Technology

2012-12-17

to!feature!aided!tracking! using !spectral! information .! ! !iii! •! A!novel!technique!for!spectral!waveband!selection!was!developed!and! used !as! part! of ... of !spectral! information ! using !the!tunable!single;pixel!spectrometer!concept.! •! A! database! was! developed! of ! spectral! reflectance! measurements...exploring! the! utility! of ! spectral! and! polarimetric! information !to!help!with!the!vehicle!tracking!application.!Through!the! use ! of ! both

Teaching of Psychology: Ideas and Innovations. Proceedings of the Annual Conference on Undergraduate Teaching of Psychology (5th, Ellenville, New York, March 13-15, 1991).

ERIC Educational Resources Information Center

Levine, Judith R., Ed.; Feist, Stanley C., Ed.

Selected proceedings are presented from the Fifth Annual Conference on Undergraduate Teaching of Psychology. The proceedings includes: (1) "Multimodal Self-Management: A Holistic Approach to Teaching Self-Improvement," by Edward J. O'Keefe and Donna Berger; (2) "Undergraduate Research: Statistics to Senior Presentations," by Glena L. N. Schubarth;…

A multimodal parallel architecture: A cognitive framework for multimodal interactions.

PubMed

Cohn, Neil

2016-01-01

Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

Guidelines for the prevention of ventilator-associated pneumonia and their implementation. The Spanish "Zero-VAP" bundle.

PubMed

Álvarez Lerma, F; Sánchez García, M; Lorente, L; Gordo, F; Añón, J M; Álvarez, J; Palomar, M; García, R; Arias, S; Vázquez-Calatayud, M; Jam, R

2014-05-01

"Zero-VAP" is a proposal for the implementation of a simultaneous multimodal intervention in Spanish intensive care units (ICU) consisting of a bundle of ventilator-associated pneumonia (VAP) prevention measures. An initiative of the Spanish Societies of Intensive Care Medicine and of Intensive Care Nurses, the project is supported by the Spanish Ministry of Health, and participation is voluntary. In addition to guidelines for VAP prevention, the "Zero-VAP" Project incorporates an integral patient safety program and continuous online validation of the application of the bundle. For the latter, VAP episodes and participation indices are entered into the web-based Spanish ICU Infection Surveillance Program "ENVIN-HELICS" database, which provides continuous information about local, regional and national VAP incidence rates. Implementation of the guidelines aims at the reduction of VAP to less than 9 episodes per 1000 days of mechanical ventilation. A total of 35 preventive measures were initially selected. A task force of experts used the Grading of Recommendations, Assessment, Development and Evaluation Working Group methodology to generate a list of 7 basic "mandatory" recommendations (education and training in airway management, strict hand hygiene for airway management, cuff pressure control, oral hygiene with chlorhexidine, semi-recumbent positioning, promoting measures that safely avoid or reduce time on ventilator, and discouraging scheduled changes of ventilator circuits, humidifiers and endotracheal tubes) and 3 additional "highly recommended" measures (selective decontamination of the digestive tract, aspiration of subglottic secretions, and a short course of iv antibiotic). We present the Spanish VAP prevention guidelines and describe the methodology used for the selection and implementation of the recommendations and the organizational structure of the project. Compared to conventional guideline documents, the associated safety assurance program, the online data recording and compliance control systems, as well as the existence of a pre-defined objective are the distinct features of "Zero VAP". Copyright © 2013 Elsevier España, S.L. and SEMICYUC. All rights reserved.

Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness

PubMed Central

Calhoun, Vince D; Sui, Jing

2016-01-01

It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness. PMID:27347565

Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness.

PubMed

Calhoun, Vince D; Sui, Jing

2016-05-01

It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness.

Female monozygotic twins with selective mutism--a case report.

PubMed

Sharkey, L; Mc Nicholas, F

2006-04-01

Selective mutism is a rare social anxiety disorder characterized by a total lack of speech in certain specific situations despite the ability to speak in others. Both genetic and psychosocial factors are thought to be involved in its presentation, persistence, and response to treatment. This case report describes a case of young female monozygotic twins who presented with selective mutism and their treatment spanning a 2-year period. It highlights the strong genetic association along with environmental factors such as social isolation and consequences of maternal social phobia, all contributing to treatment resistance, despite an intensive multimodal biopsychosocial approach. General issues related to the difficulties in treating monozygotic twins are also addressed.

Multimodal Discourse Analysis of the Movie "Argo"

ERIC Educational Resources Information Center

Bo, Xu

2018-01-01

Based on multimodal discourse theory, this paper makes a multimodal discourse analysis of some shots in the movie "Argo" from the perspective of context of culture, context of situation and meaning of image. Results show that this movie constructs multimodal discourse through particular context, language and image, and successfully…

The Work of Comics Collaborations: Considerations of Multimodal Composition for Writing Scholarship and Pedagogy

ERIC Educational Resources Information Center

Scanlon, Molly J.

2015-01-01

Though multimodality is increasingly incorporated into our pedagogies and scholarship, explorations of collaborative multimodal composition are lacking. Existing literature on collaborative writing focuses predominately on texts either composed in singular modes or by a single author, neglecting the ways in which multimodal texts are composed…

How Multimodality Works in Mathematical Activity: Young Children Graphing Motion

ERIC Educational Resources Information Center

Ferrara, Francesca

2014-01-01

This paper aims to contribute to discussions on the multimodal nature of cognition through an elaboration of the ways multimodal aspects of thinking are exploited by learners doing mathematics. Moving beyond the fact "that" multimodality occurs, this paper focuses on "how" it occurs, with particular attention drawn to the…

Designing Multimodal Texts about the Middle Ages

ERIC Educational Resources Information Center

Insulander, Eva; Lindstrand, Fredrik; Selander, Staffan

2017-01-01

Multimedial and multimodal communication arouse interest in many fields of research today. By contrast, little attention is paid to multimodality in relation to designs for learning, especially in relation to representations of knowledge on an aggregated level. By analyzing three multimodal texts about the Middle Ages, including a textbook, a film…

A framework for biomedical figure segmentation towards image-based document retrieval

PubMed Central

2013-01-01

The figures included in many of the biomedical publications play an important role in understanding the biological experiments and facts described within. Recent studies have shown that it is possible to integrate the information that is extracted from figures in classical document classification and retrieval tasks in order to improve their accuracy. One important observation about the figures included in biomedical publications is that they are often composed of multiple subfigures or panels, each describing different methodologies or results. The use of these multimodal figures is a common practice in bioscience, as experimental results are graphically validated via multiple methodologies or procedures. Thus, for a better use of multimodal figures in document classification or retrieval tasks, as well as for providing the evidence source for derived assertions, it is important to automatically segment multimodal figures into subfigures and panels. This is a challenging task, however, as different panels can contain similar objects (i.e., barcharts and linecharts) with multiple layouts. Also, certain types of biomedical figures are text-heavy (e.g., DNA sequences and protein sequences images) and they differ from traditional images. As a result, classical image segmentation techniques based on low-level image features, such as edges or color, are not directly applicable to robustly partition multimodal figures into single modal panels. In this paper, we describe a robust solution for automatically identifying and segmenting unimodal panels from a multimodal figure. Our framework starts by robustly harvesting figure-caption pairs from biomedical articles. We base our approach on the observation that the document layout can be used to identify encoded figures and figure boundaries within PDF files. Taking into consideration the document layout allows us to correctly extract figures from the PDF document and associate their corresponding caption. We combine pixel-level representations of the extracted images with information gathered from their corresponding captions to estimate the number of panels in the figure. Thus, our approach simultaneously identifies the number of panels and the layout of figures. In order to evaluate the approach described here, we applied our system on documents containing protein-protein interactions (PPIs) and compared the results against a gold standard that was annotated by biologists. Experimental results showed that our automatic figure segmentation approach surpasses pure caption-based and image-based approaches, achieving a 96.64% accuracy. To allow for efficient retrieval of information, as well as to provide the basis for integration into document classification and retrieval systems among other, we further developed a web-based interface that lets users easily retrieve panels containing the terms specified in the user queries. PMID:24565394

Aggressive Bimodal Communication in Domestic Dogs, Canis familiaris.

PubMed

Déaux, Éloïse C; Clarke, Jennifer A; Charrier, Isabelle

2015-01-01

Evidence of animal multimodal signalling is widespread and compelling. Dogs' aggressive vocalisations (growls and barks) have been extensively studied, but without any consideration of the simultaneously produced visual displays. In this study we aimed to categorize dogs' bimodal aggressive signals according to the redundant/non-redundant classification framework. We presented dogs with unimodal (audio or visual) or bimodal (audio-visual) stimuli and measured their gazing and motor behaviours. Responses did not qualitatively differ between the bimodal and two unimodal contexts, indicating that acoustic and visual signals provide redundant information. We could not further classify the signal as 'equivalent' or 'enhancing' as we found evidence for both subcategories. We discuss our findings in relation to the complex signal framework, and propose several hypotheses for this signal's function.

Multimodal doxorubicin loaded magnetic nanoparticles for VEGF targeted theranostics of breast cancer.

PubMed

Semkina, Alevtina S; Abakumov, Maxim A; Skorikov, Alexander S; Abakumova, Tatiana O; Melnikov, Pavel A; Grinenko, Nadejda F; Cherepanov, Sergey A; Vishnevskiy, Daniil A; Naumenko, Victor A; Ionova, Klavdiya P; Majouga, Alexander G; Chekhonin, Vladimir P

2018-05-03

In presented paper we have developed new system for cancer theranostics based on vascular endothelial growth factor (VEGF) targeted magnetic nanoparticles. Conjugation of anti-VEGF antibodies with bovine serum albumin coated PEGylated magnetic nanoparticles allows for improved binding with murine breast adenocarcinoma 4T1 cell line and facilitates doxorubicin delivery to tumor cells. It was shown that intravenous injection of doxorubicin loaded VEGF targeted nanoparticles increases median survival rate of mice bearing 4T1 tumors up to 50%. On the other hand magnetic resonance imaging (MRI) of 4T1 tumors 24 h after intravenous injection showed accumulation of nanoparticles in tumors, thus allowing simultaneous cancer therapy and diagnostics. Copyright © 2018. Published by Elsevier Inc.

Modeling of 1.5 μm range gated imaging for small surface vessel identification

NASA Astrophysics Data System (ADS)

Espinola, Richard L.; Steinvall, Ove; Elmquist, Magnus; Karlsson, Kjell

2010-10-01

Within the framework of the NATO group (NATO SET-132/RTG-72) on imaging ladars, a test was performed to collect simultaneous multi-mode LADAR signatures of maritime objects entering and leaving San Diego Harbor. Beside ladars, passive sensors were also employed during the test which occurred during April 2009 from Point Loma and the harbor in San Diego. This paper will report on 1.5 μm gated imaging on a number of small civilian surface vessels with the aim to present human perception experimental results and comparisons with sensor performance models developed by US Army RDECOM CERDEC NVESD. We use controlled human perception tests to measure target identification performance and compare the experimental results with model predictions.

In Vivo Deep Tissue Fluorescence and Magnetic Imaging Employing Hybrid Nanostructures.

PubMed

Ortgies, Dirk H; de la Cueva, Leonor; Del Rosal, Blanca; Sanz-Rodríguez, Francisco; Fernández, Nuria; Iglesias-de la Cruz, M Carmen; Salas, Gorka; Cabrera, David; Teran, Francisco J; Jaque, Daniel; Martín Rodríguez, Emma

2016-01-20

Breakthroughs in nanotechnology have made it possible to integrate different nanoparticles in one single hybrid nanostructure (HNS), constituting multifunctional nanosized sensors, carriers, and probes with great potential in the life sciences. In addition, such nanostructures could also offer therapeutic capabilities to achieve a wider variety of multifunctionalities. In this work, the encapsulation of both magnetic and infrared emitting nanoparticles into a polymeric matrix leads to a magnetic-fluorescent HNS with multimodal magnetic-fluorescent imaging abilities. The magnetic-fluorescent HNS are capable of simultaneous magnetic resonance imaging and deep tissue infrared fluorescence imaging, overcoming the tissue penetration limits of classical visible-light based optical imaging as reported here in living mice. Additionally, their applicability for magnetic heating in potential hyperthermia treatments is assessed.

Combined high contrast and wide field of view in the scanning laser ophthalmoscope through dual detection of light paths

NASA Astrophysics Data System (ADS)

Carles, Guillem; Muyo, Gonzalo; van Hemert, Jano; Harvey, Andrew R.

2017-11-01

We demonstrate a multimode detection system in a scanning laser ophthalmoscope (SLO) that enables simultaneous operation in confocal, indirect, and direct modes to permit an agile trade between image contrast and optical sensitivity across the retinal field of view to optimize the overall imaging performance, enabling increased contrast in very wide-field operation. We demonstrate the method on a wide-field SLO employing a hybrid pinhole at its image plane, to yield a twofold increase in vasculature contrast in the central retina compared to its conventional direct mode while retaining high-quality imaging across a wide field of the retina, of up to 200 deg and 20 μm on-axis resolution.

Adhesive bonding using variable frequency microwave energy

DOEpatents

Lauf, Robert J.; McMillan, April D.; Paulauskas, Felix L.; Fathi, Zakaryae; Wei, Jianghua

1998-01-01

Methods of facilitating the adhesive bonding of various components with variable frequency microwave energy are disclosed. The time required to cure a polymeric adhesive is decreased by placing components to be bonded via the adhesive in a microwave heating apparatus having a multimode cavity and irradiated with microwaves of varying frequencies. Methods of uniformly heating various articles having conductive fibers disposed therein are provided. Microwave energy may be selectively oriented to enter an edge portion of an article having conductive fibers therein. An edge portion of an article having conductive fibers therein may be selectively shielded from microwave energy.

Adhesive bonding using variable frequency microwave energy

DOEpatents

Lauf, R.J.; McMillan, A.D.; Paulauskas, F.L.; Fathi, Z.; Wei, J.

1998-08-25

Methods of facilitating the adhesive bonding of various components with variable frequency microwave energy are disclosed. The time required to cure a polymeric adhesive is decreased by placing components to be bonded via the adhesive in a microwave heating apparatus having a multimode cavity and irradiated with microwaves of varying frequencies. Methods of uniformly heating various articles having conductive fibers disposed therein are provided. Microwave energy may be selectively oriented to enter an edge portion of an article having conductive fibers therein. An edge portion of an article having conductive fibers therein may be selectively shielded from microwave energy. 26 figs.

Adhesive bonding using variable frequency microwave energy

DOEpatents

Lauf, R.J.; McMillan, A.D.; Paulauskas, F.L.; Fathi, Z.; Wei, J.

1998-09-08

Methods of facilitating the adhesive bonding of various components with variable frequency microwave energy are disclosed. The time required to cure a polymeric adhesive is decreased by placing components to be bonded via the adhesive in a microwave heating apparatus having a multimode cavity and irradiated with microwaves of varying frequencies. Methods of uniformly heating various articles having conductive fibers disposed therein are provided. Microwave energy may be selectively oriented to enter an edge portion of an article having conductive fibers therein. An edge portion of an article having conductive fibers therein may be selectively shielded from microwave energy. 26 figs.

Robust detection of heartbeats using association models from blood pressure and EEG signals.

PubMed

Jeon, Taegyun; Yu, Jongmin; Pedrycz, Witold; Jeon, Moongu; Lee, Boreom; Lee, Byeongcheol

2016-01-15

The heartbeat is fundamental cardiac activity which is straightforwardly detected with a variety of measurement techniques for analyzing physiological signals. Unfortunately, unexpected noise or contaminated signals can distort or cut out electrocardiogram (ECG) signals in practice, misleading the heartbeat detectors to report a false heart rate or suspend itself for a considerable length of time in the worst case. To deal with the problem of unreliable heartbeat detection, PhysioNet/CinC suggests a challenge in 2014 for developing robust heart beat detectors using multimodal signals. This article proposes a multimodal data association method that supplements ECG as a primary input signal with blood pressure (BP) and electroencephalogram (EEG) as complementary input signals when input signals are unreliable. If the current signal quality index (SQI) qualifies ECG as a reliable input signal, our method applies QRS detection to ECG and reports heartbeats. Otherwise, the current SQI selects the best supplementary input signal between BP and EEG after evaluating the current SQI of BP. When BP is chosen as a supplementary input signal, our association model between ECG and BP enables us to compute their regular intervals, detect characteristics BP signals, and estimate the locations of the heartbeat. When both ECG and BP are not qualified, our fusion method resorts to the association model between ECG and EEG that allows us to apply an adaptive filter to ECG and EEG, extract the QRS candidates, and report heartbeats. The proposed method achieved an overall score of 86.26 % for the test data when the input signals are unreliable. Our method outperformed the traditional method, which achieved 79.28 % using QRS detector and BP detector from PhysioNet. Our multimodal signal processing method outperforms the conventional unimodal method of taking ECG signals alone for both training and test data sets. To detect the heartbeat robustly, we have proposed a novel multimodal data association method of supplementing ECG with a variety of physiological signals and accounting for the patient-specific lag between different pulsatile signals and ECG. Multimodal signal detectors and data-fusion approaches such as those proposed in this article can reduce false alarms and improve patient monitoring.

Good Student/Bad Student: Situated Identities in the Figured Worlds of School and Creative Multimodal Production

ERIC Educational Resources Information Center

Jocius, Robin

2017-01-01

This study situates young adolescents' multimodal composing practices within two figured worlds--school and creative multimodal production. In a microanalysis of two focal students' multimodal processes and products, I trace how pedagogical, interactional, and semiotic resources both reified and challenged students' developing identities as…

Multimodal Hip Hop Productions as Media Literacies

ERIC Educational Resources Information Center

Turner, K. C. Nat

2012-01-01

This study draws on ethnographic data from a year-long multimodal media production (MMP) course and the experience of an African American female adolescent who used the production of multimodal Hip Hop texts to express her creativity and growing socially conscious view of the world. The study demonstrates how students made meaning multimodally and…

Towards an intelligent framework for multimodal affective data analysis.

PubMed

Poria, Soujanya; Cambria, Erik; Hussain, Amir; Huang, Guang-Bin

2015-03-01

An increasingly large amount of multimodal content is posted on social media websites such as YouTube and Facebook everyday. In order to cope with the growth of such so much multimodal data, there is an urgent need to develop an intelligent multi-modal analysis framework that can effectively extract information from multiple modalities. In this paper, we propose a novel multimodal information extraction agent, which infers and aggregates the semantic and affective information associated with user-generated multimodal data in contexts such as e-learning, e-health, automatic video content tagging and human-computer interaction. In particular, the developed intelligent agent adopts an ensemble feature extraction approach by exploiting the joint use of tri-modal (text, audio and video) features to enhance the multimodal information extraction process. In preliminary experiments using the eNTERFACE dataset, our proposed multi-modal system is shown to achieve an accuracy of 87.95%, outperforming the best state-of-the-art system by more than 10%, or in relative terms, a 56% reduction in error rate. Copyright © 2014 Elsevier Ltd. All rights reserved.

Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification.

PubMed

Rajagopal, Gayathri; Palaniswamy, Ramamoorthy

2015-01-01

This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis) is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database.

Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification

PubMed Central

Rajagopal, Gayathri; Palaniswamy, Ramamoorthy

2015-01-01

This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis) is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database. PMID:26640813

Practical multimodal care for cancer cachexia.

PubMed

Maddocks, Matthew; Hopkinson, Jane; Conibear, John; Reeves, Annie; Shaw, Clare; Fearon, Ken C H

2016-12-01

Cancer cachexia is common and reduces function, treatment tolerability and quality of life. Given its multifaceted pathophysiology a multimodal approach to cachexia management is advocated for, but can be difficult to realise in practice. We use a case-based approach to highlight practical approaches to the multimodal management of cachexia for patients across the cancer trajectory. Four cases with lung cancer spanning surgical resection, radical chemoradiotherapy, palliative chemotherapy and no anticancer treatment are presented. We propose multimodal care approaches that incorporate nutritional support, exercise, and anti-inflammatory agents, on a background of personalized oncology care and family-centred education. Collectively, the cases reveal that multimodal care is part of everyone's remit, often focuses on supported self-management, and demands buy-in from the patient and their family. Once operationalized, multimodal care approaches can be tested pragmatically, including alongside emerging pharmacological cachexia treatments. We demonstrate that multimodal care for cancer cachexia can be achieved using simple treatments and without a dedicated team of specialists. The sharing of advice between health professionals can help build collective confidence and expertise, moving towards a position in which every team member feels they can contribute towards multimodal care.

Simultaneous determination of dechloranes, polybrominated diphenyl ethers and novel brominated flame retardants in food and serum.

PubMed

Sales, Carlos; Poma, Giulia; Malarvannan, Govindan; Portolés, Tania; Beltrán, Joaquin; Covaci, Adrian

2017-07-01

A sensitive method for the simultaneous quantification of dechloranes, polybrominated diphenyl ethers (PBDEs) and novel brominated flame retardants (NBFRs) has been developed for gas chromatography (GC) coupled to tandem mass spectrometry operating in electron capture negative ionization (ECNI) mode. The major advance has been achieved by combining selected ion monitoring (SIM) and multiple reaction monitoring (MRM) modes in well-defined time windows, to determine dechloranes, PBDEs and NBFRs at picogram per gram level in one single analysis in complex matrix biological samples. From the chromatographic point of view, efforts were devoted to study several injection modes using multimode inlet (MMI) in order to obtain low instrumental detection limits, necessary for trace compounds such as Dechlorane Plus (DP) isomers. Method performance was also evaluated: calibration curves were linear from 20 fg μL -1 to 100 pg μL -1 for the studied compounds, with method detection limits at levels of 50 fg g -1 for DPs. Repeatability and reproducibility, expressed as relative standard deviation, were better than 5% even in solvent vent mode for the injection of standards. The application to a wide range of complex samples (including food, human and animal serum samples) indicated a sensitive and reliable way to quantify at the picogram per gram level 4 halogenated norbornenes (HNs), Dechlorane Plus (anti-DP and syn-DP) and 2 of their homologues (Dechlorane-602 and Dechlorane-603), 11 PBDE congeners (no. 28, 47, 49, 66, 85, 99, 100, 153, 154, 183 and 209) and 5 novel BFRs, i.e. decabromodiphenyl ethane (DBDPE), 1,2-bis(2,4,6-tribromophenoxy)ethane (BTBPE), hexabromobenzene (HBB), 2,3,4,5-tetrabromo-ethylhexyl-benzoate (TBB) and tetrabromophthalate (TBPH). Graphical Abstract GC-ECNI-MS/MS chromatograms showing the most sensitive transition for DPs when injecting 2 μL of a 16 fg/μL standard solution of s-DP and a-DP at three different source temperatures.

Simultaneous in vivo recording of local brain temperature and electrophysiological signals with a novel neural probe

NASA Astrophysics Data System (ADS)

Fekete, Z.; Csernai, M.; Kocsis, K.; Horváth, Á. C.; Pongrácz, A.; Barthó, P.

2017-06-01

Objective. Temperature is an important factor for neural function both in normal and pathological states, nevertheless, simultaneous monitoring of local brain temperature and neuronal activity has not yet been undertaken. Approach. In our work, we propose an implantable, calibrated multimodal biosensor that facilitates the complex investigation of thermal changes in both cortical and deep brain regions, which records multiunit activity of neuronal populations in mice. The fabricated neural probe contains four electrical recording sites and a platinum temperature sensor filament integrated on the same probe shaft within a distance of 30 µm from the closest recording site. The feasibility of the simultaneous functionality is presented in in vivo studies. The probe was tested in the thalamus of anesthetized mice while manipulating the core temperature of the animals. Main results. We obtained multiunit and local field recordings along with measurement of local brain temperature with accuracy of 0.14 °C. Brain temperature generally followed core body temperature, but also showed superimposed fluctuations corresponding to epochs of increased local neural activity. With the application of higher currents, we increased the local temperature by several degrees without observable tissue damage between 34-39 °C. Significance. The proposed multifunctional tool is envisioned to broaden our knowledge on the role of the thermal modulation of neuronal activity in both cortical and deeper brain regions.

Dual light-emitting diode-based multichannel microscopy for whole-slide multiplane, multispectral and phase imaging.

PubMed

Liao, Jun; Wang, Zhe; Zhang, Zibang; Bian, Zichao; Guo, Kaikai; Nambiar, Aparna; Jiang, Yutong; Jiang, Shaowei; Zhong, Jingang; Choma, Michael; Zheng, Guoan

2018-02-01

We report the development of a multichannel microscopy for whole-slide multiplane, multispectral and phase imaging. We use trinocular heads to split the beam path into 6 independent channels and employ a camera array for parallel data acquisition, achieving a maximum data throughput of approximately 1 gigapixel per second. To perform single-frame rapid autofocusing, we place 2 near-infrared light-emitting diodes (LEDs) at the back focal plane of the condenser lens to illuminate the sample from 2 different incident angles. A hot mirror is used to direct the near-infrared light to an autofocusing camera. For multiplane whole-slide imaging (WSI), we acquire 6 different focal planes of a thick specimen simultaneously. For multispectral WSI, we relay the 6 independent image planes to the same focal position and simultaneously acquire information at 6 spectral bands. For whole-slide phase imaging, we acquire images at 3 focal positions simultaneously and use the transport-of-intensity equation to recover the phase information. We also provide an open-source design to further increase the number of channels from 6 to 15. The reported platform provides a simple solution for multiplexed fluorescence imaging and multimodal WSI. Acquiring an instant focal stack without z-scanning may also enable fast 3-dimensional dynamic tracking of various biological samples. © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Self-assembled mPEG-PCL-g-PEI micelles for multifunctional nanoprobes of doxorubicin delivery and magnetic resonance imaging and optical imaging.

PubMed

Guo, Qingfa; Kuang, Lei; Cao, Hui; Li, Weizhong; Wei, Jing

2015-12-01

In this paper, a novel bifunctional nanoprobe based on polyethylene glycol(MPEG)-poly(ϵ-caprolactone)(ϵ-CL)-polyethylenimine(PEI) labeled with FITC (MPEG-PCL-PEI-FITC, PCIF) were prepared to provide tumor therapy and simultaneous diagnostic information via magnetic resonance imaging (MRI) and optical imaging. Superparamagnetic iron oxide (SPIO) and doxorubicin (DOX) loaded PCIF (PCIF/SPIO/DOX) nanoprobes were prepared by self-assembling into micelles, which had uniformly distributed particle size of 130 ± 5 nm and a zeta potential of +35 ± 2 mV. Transmission electronic microscopy(TEM) showed that SPIO NPs were loaded into PCIF micelles. The PCIF/SPIO/DOX nanoprobes were superparamagnetic at 300 K with saturated magnetization of 20.5 emu/g Fe by vibrating-sample-magnetomete (VSM). Studies on cellular uptake of PCIF/SPIO/DOX nanoprobes demonstrated that SPIO NPs, DOX and FITC labeled MPEG-PCL-PEI were simultaneously taken up by the breast cancer (4T1) cells. After intravenous injection of PCIF/SPIO/DOX nanoprobes in 4T1 tumor-bearing mice, SPIO NPs, DOX and FITC labeled MPEG-PCL-PEI micelles were simultaneously delivered into tumor tissue by histochemisty. This work is important for the applications to multimodal diagnostic and theragnosis as nanomedicine. Copyright © 2015 Elsevier B.V. All rights reserved.

Access Selection Algorithm of Heterogeneous Wireless Networks for Smart Distribution Grid Based on Entropy-Weight and Rough Set

NASA Astrophysics Data System (ADS)

Xiang, Min; Qu, Qinqin; Chen, Cheng; Tian, Li; Zeng, Lingkang

2017-11-01

To improve the reliability of communication service in smart distribution grid (SDG), an access selection algorithm based on dynamic network status and different service types for heterogeneous wireless networks was proposed. The network performance index values were obtained in real time by multimode terminal and the variation trend of index values was analyzed by the growth matrix. The index weights were calculated by entropy-weight and then modified by rough set to get the final weights. Combining the grey relational analysis to sort the candidate networks, and the optimum communication network is selected. Simulation results show that the proposed algorithm can implement dynamically access selection in heterogeneous wireless networks of SDG effectively and reduce the network blocking probability.

CT and Ultrasound Guided Stereotactic High Intensity Focused Ultrasound (HIFU)

NASA Astrophysics Data System (ADS)

Wood, Bradford J.; Yanof, J.; Frenkel, V.; Viswanathan, A.; Dromi, S.; Oh, K.; Kruecker, J.; Bauer, C.; Seip, R.; Kam, A.; Li, K. C. P.

2006-05-01

To demonstrate the feasibility of CT and B-mode Ultrasound (US) targeted HIFU, a prototype coaxial focused ultrasound transducer was registered and integrated to a CT scanner. CT and diagnostic ultrasound were used for HIFU targeting and monitoring, with the goals of both thermal ablation and non-thermal enhanced drug delivery. A 1 megahertz coaxial ultrasound transducer was custom fabricated and attached to a passive position-sensing arm and an active six degree-of-freedom robotic arm via a CT stereotactic frame. The outer therapeutic transducer with a 10 cm fixed focal zone was coaxially mounted to an inner diagnostic US transducer (2-4 megahertz, Philips Medical Systems). This coaxial US transducer was connected to a modified commercial focused ultrasound generator (Focus Surgery, Indianapolis, IN) with a maximum total acoustic power of 100 watts. This pre-clinical paradigm was tested for ability to heat tissue in phantoms with monitoring and navigation from CT and live US. The feasibility of navigation via image fusion of CT with other modalities such as PET and MRI was demonstrated. Heated water phantoms were tested for correlation between CT numbers and temperature (for ablation monitoring). The prototype transducer and integrated CT/US imaging system enabled simultaneous multimodality imaging and therapy. Pre-clinical phantom models validated the treatment paradigm and demonstrated integrated multimodality guidance and treatment monitoring. Temperature changes during phantom cooling corresponded to CT number changes. Contrast enhanced or non-enhanced CT numbers may potentially be used to monitor thermal ablation with HIFU. Integrated CT, diagnostic US, and therapeutic focused ultrasound bridges a gap between diagnosis and therapy. Preliminary results show that the multimodality system may represent a relatively inexpensive, accessible, and simple method of both targeting and monitoring HIFU effects. Small animal pre-clinical models may be translated to large animals and humans for HIFU-induced ablation and drug delivery. Integrated CT-guided focused ultrasound holds promise for tissue ablation, enhancing local drug delivery, and CT thermometry for monitoring ablation in near real-time.

The effects of video-game training on broad cognitive transfer in multiple sclerosis: A pilot randomized controlled trial.

PubMed

Janssen, Alisha; Boster, Aaron; Lee, HyunKyu; Patterson, Beth; Prakash, Ruchika Shaurya

2015-01-01

Multiple sclerosis (MS) is a neurodegenerative disease of the central nervous system that results in diffuse nerve damage and associated physical and cognitive impairments. Of the few comprehensive rehabilitation options that exist for populations with lower baseline cognitive functioning, those that have been successful at eliciting broad cognitive improvements have focused on a multimodal training approach, emphasizing complex cognitive processing that utilizes multiple domains simultaneously. The current study sought to determine the feasibility of an 8-week, hybrid-variable priority training (HVT) program, with a secondary aim to assess the success of this training paradigm at eliciting broad cognitive transfer effects. Capitalizing on the multimodal training modalities offered by the Space Fortress platform, we compared the HVT strategy-based intervention with a waitlist control group, to primarily assess skill acquisition and secondarily determine presence of cognitive transfer. Twenty-eight participants met inclusionary criteria for the study and were randomized to either training or waitlist control groups. To assess broad transfer effects, a battery of neuropsychological tests was administered pre- and post-intervention. The results indicated an overall improvement in skill acquisition and evidence for the feasibility of the intervention, but a lack of broad transfer to tasks of cognitive functioning. Participants in the training group, however, did show improvements on a measure of spatial short-term memory. The current investigation provided support for the feasibility of a multimodal training approach, using the HVT strategy, within the MS population, but lacked broad transfer to multiple domains of cognitive functioning. Future improvements to obtain greater cognitive transfer efficacy would include a larger sample size, a longer course of training to evoke greater game score improvement, the inclusion of only cognitively impaired individuals, and integration of subjective measures of improvement in addition to objective tests of cognitive performance.

New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

ERIC Educational Resources Information Center

Williams, Wendy R.

2014-01-01

This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

Multimode fiber devices with single-mode performance

NASA Astrophysics Data System (ADS)

Leon-Saval, S. G.; Birks, T. A.; Bland-Hawthorn, J.; Englund, M.

2005-10-01

A taper transition can couple light between a multimode fiber and several single-mode fibers. If the number of single-mode fibers matches the number of spatial modes in the multimode fiber, the transition can have low loss in both directions. This enables the high performance of single-mode fiber devices to be attained in multimode fibers. We report an experimental proof of concept by using photonic crystal fiber techniques to make the transitions, demonstrating a multimode fiber filter with the transmission spectrum of a single-mode fiber grating.

Adrenal vein sampling in primary aldosteronism: concordance of simultaneous vs sequential sampling.

PubMed

Almarzooqi, Mohamed-Karji; Chagnon, Miguel; Soulez, Gilles; Giroux, Marie-France; Gilbert, Patrick; Oliva, Vincent L; Perreault, Pierre; Bouchard, Louis; Bourdeau, Isabelle; Lacroix, André; Therasse, Eric

2017-02-01

Many investigators believe that basal adrenal venous sampling (AVS) should be done simultaneously, whereas others opt for sequential AVS for simplicity and reduced cost. This study aimed to evaluate the concordance of sequential and simultaneous AVS methods. Between 1989 and 2015, bilateral simultaneous sets of basal AVS were obtained twice within 5 min, in 188 consecutive patients (59 women and 129 men; mean age: 53.4 years). Selectivity was defined by adrenal-to-peripheral cortisol ratio ≥2, and lateralization was defined as an adrenal aldosterone-to-cortisol ratio ≥2, the contralateral side. Sequential AVS was simulated using right sampling at -5 min (t = -5) and left sampling at 0 min (t = 0). There was no significant difference in mean selectivity ratio (P = 0.12 and P = 0.42 for the right and left sides respectively) and in mean lateralization ratio (P = 0.93) between t = -5 and t = 0. Kappa for selectivity between 2 simultaneous AVS was 0.71 (95% CI: 0.60-0.82), whereas it was 0.84 (95% CI: 0.76-0.92) and 0.85 (95% CI: 0.77-0.93) between sequential and simultaneous AVS at respectively -5 min and at 0 min. Kappa for lateralization between 2 simultaneous AVS was 0.84 (95% CI: 0.75-0.93), whereas it was 0.86 (95% CI: 0.78-0.94) and 0.80 (95% CI: 0.71-0.90) between sequential AVS and simultaneous AVS at respectively -5 min at 0 min. Concordance between simultaneous and sequential AVS was not different than that between 2 repeated simultaneous AVS in the same patient. Therefore, a better diagnostic performance is not a good argument to select the AVS method. © 2017 European Society of Endocrinology.

Marine Transportation System Performance Measures Research

DTIC Science & Technology

2016-06-01

A. Protopapas, D. Bierling, L. E . Olson, B. Wang, and M. Khodakarami. 2014. Integrating MTS commerce data with multimodal freight transportation...suggests using ob- served data to develop models that explore a wide range of future scenar- ios and provide insight into potential effects on MTS...sources were the FT920 – U.S. Merchandise Trade: Selected Highlights (for total, water and air data , published by U.S. Department of Commerce , U.S

Practitioner review: Psychosocial interventions for children with selective mutism: a critical evaluation of the literature from 1990-2005.

PubMed

Cohan, Sharon L; Chavira, Denise A; Stein, Murray B

2006-11-01

There have been several reports of successful psychosocial interventions for children with selective mutism (SM), a disorder in which a child consistently fails to speak in one or more social settings (e.g., school) despite speaking normally in other settings (e.g., home). The present literature review was undertaken in order to provide an up-to-date summary and critique of the SM treatment literature published in the past fifteen years. PubMed, PsycINFO, and Web of Science databases were searched to identify SM treatment studies published in peer-reviewed journals between 1990 and 2005. A total of 23 studies were included in the present review. Of these, ten used a behavioral/cognitive behavioral approach, one used a behavioral language training approach, one used a family systems approach, five used a psychodynamic approach, and six used multimodal approaches to SM treatment. Although much of this literature is limited by methodological weaknesses, the existing research provides support for the use of behavioral and cognitive-behavioral interventions. Multimodal treatments also appear promising, but the essential components of these interventions have yet to be established. An outline of a cognitive-behavioral treatment package for a typical SM child is provided and the review concludes with suggestions for future research.

Improved Diagnostic Multimodal Biomarkers for Alzheimer's Disease and Mild Cognitive Impairment

PubMed Central

Martínez-Torteya, Antonio; Treviño, Víctor; Tamez-Peña, José G.

2015-01-01

The early diagnosis of Alzheimer's disease (AD) and mild cognitive impairment (MCI) is very important for treatment research and patient care purposes. Few biomarkers are currently considered in clinical settings, and their use is still optional. The objective of this work was to determine whether multimodal and nonpreviously AD associated features could improve the classification accuracy between AD, MCI, and healthy controls, which may impact future AD biomarkers. For this, Alzheimer's Disease Neuroimaging Initiative database was mined for case-control candidates. At least 652 baseline features extracted from MRI and PET analyses, biological samples, and clinical data up to February 2014 were used. A feature selection methodology that includes a genetic algorithm search coupled to a logistic regression classifier and forward and backward selection strategies was used to explore combinations of features. This generated diagnostic models with sizes ranging from 3 to 8, including well documented AD biomarkers, as well as unexplored image, biochemical, and clinical features. Accuracies of 0.85, 0.79, and 0.80 were achieved for HC-AD, HC-MCI, and MCI-AD classifications, respectively, when evaluated using a blind test set. In conclusion, a set of features provided additional and independent information to well-established AD biomarkers, aiding in the classification of MCI and AD. PMID:26106620

Multimodal biopanning of T7 phage-displayed peptides reveals angiomotin as a potential receptor of the anti-angiogenic macrolide Roxithromycin.

PubMed

Takakusagi, Kaori; Takakusagi, Yoichi; Suzuki, Takahiro; Toizaki, Aya; Suzuki, Aiko; Kawakatsu, Yaichi; Watanabe, Madoka; Saito, Yukihiro; Fukuda, Ryushi; Nakazaki, Atsuo; Kobayashi, Susumu; Sakaguchi, Kengo; Sugawara, Fumio

2015-01-27

Roxithromycin (RXM) is a semi-synthetic fourteen-membered macrolide antibiotic that shows anti-angiogenic activity in solid tumors. In the present study, we conducted biopanning of T7 phage-displayed peptides either on a 96-well formatted microplate, a flow injection-type quartz-crystal microbalance (QCM) biosensor, or a cuvette-type QCM. RXM-selected peptides of different sequence, length and number were obtained from each mode of screening. Subsequent bioinformatics analysis of the RXM-selected peptides consistently gave positive scores for the extracellular domain (E458-T596) of angiomotin (Amot), indicating that this may comprise a binding region for RXM. Bead pull down assay and QCM analysis confirmed that RXM directly interacts with Amot via the screen-guided region, which also corresponds to the binding site for the endogenous anti-angiogenic inhibitor angiostatin (Anst). Thus, multimodal biopanning of T7PD revealed that RXM binds to the extracellular domain on Amot as a common binding site with Anst, leading to inhibition of angiogenesis-dependent tumor growth and metastasis. These data might explain the molecular basis underlying the mechanism of action for the anti-angiogenic activity of RXM. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

Smooth and flat phase-locked Kerr frequency comb generation by higher order mode suppression

PubMed Central

Huang, S.-W.; Liu, H.; Yang, J.; Yu, M.; Kwong, D.-L.; Wong, C. W.

2016-01-01

High-Q microresonator is perceived as a promising platform for optical frequency comb generation, via dissipative soliton formation. In order to achieve a higher quality factor and obtain the necessary anomalous dispersion, multi-mode waveguides were previously implemented in Si3N4 microresonators. However, coupling between different transverse mode families in multi-mode waveguides results in periodic disruption of dispersion and quality factor, and consequently causes perturbation to dissipative soliton formation and amplitude modulation to the corresponding spectrum. Careful choice of pump wavelength to avoid the mode crossing region is thus critical in conventional Si3N4 microresonators. Here, we report a novel design of Si3N4 microresonator in which single-mode operation, high quality factor, and anomalous dispersion are attained simultaneously. The novel microresonator is consisted of uniform single-mode waveguides in the semi-circle region, to eliminate bending induced mode coupling, and adiabatically tapered waveguides in the straight region, to avoid excitation of higher order modes. The intrinsic quality factor of the microresonator reaches 1.36 × 106 while the group velocity dispersion remains to be anomalous at −50 fs2/mm. With this novel microresonator, we demonstrate that broadband phase-locked Kerr frequency combs with flat and smooth spectra can be generated by pumping at any resonances in the optical C-band. PMID:27181420

Stimulation of the basal and central amygdala in the mustached bat triggers echolocation and agonistic vocalizations within multimodal output

PubMed Central

Ma, Jie; Kanwal, Jagmeet S.

2014-01-01

The neural substrate for the perception of vocalizations is relatively well described, but how their timing and specificity are tightly coupled with accompanying physiological changes and context-appropriate behaviors remains unresolved. We hypothesized that temporally integrated vocal and emotive responses, especially the expression of fear, vigilance and aggression, originate within the amygdala. To test this hypothesis, we performed electrical microstimulation at 461 highly restricted loci within the basal and central amygdala in awake mustached bats. At a subset of these sites, high frequency stimulation with weak constant current pulses presented at near-threshold levels triggered vocalization of either echolocation pulses or social calls. At the vast majority of locations, microstimulation produced a constellation of changes in autonomic and somatomotor outputs. These changes included widespread co-activation of significant tachycardia and hyperventilation and/or rhythmic ear pinna movements (PMs). In a few locations, responses were constrained to vocalization and/or PMs despite increases in the intensity of stimulation. The probability of eliciting echolocation pulses vs. social calls decreased in a medial-posterior to anterolateral direction within the centrobasal amygdala. Microinjections of kainic acid (KA) at stimulation sites confirmed the contribution of cellular activity rather than fibers-of-passage in the control of multimodal outputs. The results suggest that localized clusters of neurons may simultaneously modulate the activity of multiple central pattern generators (CPGs) present within the brainstem. PMID:24624089

Stimulation of the basal and central amygdala in the mustached bat triggers echolocation and agonistic vocalizations within multimodal output.

PubMed

Ma, Jie; Kanwal, Jagmeet S

2014-01-01

The neural substrate for the perception of vocalizations is relatively well described, but how their timing and specificity are tightly coupled with accompanying physiological changes and context-appropriate behaviors remains unresolved. We hypothesized that temporally integrated vocal and emotive responses, especially the expression of fear, vigilance and aggression, originate within the amygdala. To test this hypothesis, we performed electrical microstimulation at 461 highly restricted loci within the basal and central amygdala in awake mustached bats. At a subset of these sites, high frequency stimulation with weak constant current pulses presented at near-threshold levels triggered vocalization of either echolocation pulses or social calls. At the vast majority of locations, microstimulation produced a constellation of changes in autonomic and somatomotor outputs. These changes included widespread co-activation of significant tachycardia and hyperventilation and/or rhythmic ear pinna movements (PMs). In a few locations, responses were constrained to vocalization and/or PMs despite increases in the intensity of stimulation. The probability of eliciting echolocation pulses vs. social calls decreased in a medial-posterior to anterolateral direction within the centrobasal amygdala. Microinjections of kainic acid (KA) at stimulation sites confirmed the contribution of cellular activity rather than fibers-of-passage in the control of multimodal outputs. The results suggest that localized clusters of neurons may simultaneously modulate the activity of multiple central pattern generators (CPGs) present within the brainstem.

Prediction of advertisement preference by fusing EEG response and sentiment analysis.

PubMed

Gauba, Himaanshu; Kumar, Pradeep; Roy, Partha Pratim; Singh, Priyanka; Dogra, Debi Prosad; Raman, Balasubramanian

2017-08-01

This paper presents a novel approach to predict rating of video-advertisements based on a multimodal framework combining physiological analysis of the user and global sentiment-rating available on the internet. We have fused Electroencephalogram (EEG) waves of user and corresponding global textual comments of the video to understand the user's preference more precisely. In our framework, the users were asked to watch the video-advertisement and simultaneously EEG signals were recorded. Valence scores were obtained using self-report for each video. A higher valence corresponds to intrinsic attractiveness of the user. Furthermore, the multimedia data that comprised of the comments posted by global viewers, were retrieved and processed using Natural Language Processing (NLP) technique for sentiment analysis. Textual contents from review comments were analyzed to obtain a score to understand sentiment nature of the video. A regression technique based on Random forest was used to predict the rating of an advertisement using EEG data. Finally, EEG based rating is combined with NLP-based sentiment score to improve the overall prediction. The study was carried out using 15 video clips of advertisements available online. Twenty five participants were involved in our study to analyze our proposed system. The results are encouraging and these suggest that the proposed multimodal approach can achieve lower RMSE in rating prediction as compared to the prediction using only EEG data. Copyright © 2017 Elsevier Ltd. All rights reserved.

Measurement of distributed strain and temperature based on higher order and higher mode Bragg conditions

NASA Technical Reports Server (NTRS)

Sirkis, James S. (Inventor); Sivanesan, Ponniah (Inventor); Venkat, Venki S. (Inventor)

2001-01-01

A Bragg grating sensor for measuring distributed strain and temperature at the same time comprises an optical fiber having a single mode operating wavelength region and below a cutoff wavelength of the fiber having a multimode operating wavelength region. A saturated, higher order Bragg grating having first and second order Bragg conditions is fabricated in the optical fiber. The first order of Bragg resonance wavelength of the Bragg grating is within the single mode operating wavelength region of the optical fiber and the second order of Bragg resonance wavelength is below the cutoff wavelength of the fiber within the multimode operating wavelength region. The reflectivities of the saturated Bragg grating at the first and second order Bragg conditions are less than two orders of magnitude of one another. In use, the first and second order Bragg conditions are simultaneously created in the sensor at the respective wavelengths and a signal from the sensor is demodulated with respect to each of the wavelengths corresponding to the first and second order Bragg conditions. Two Bragg conditions have different responsivities to strain and temperature, thus allowing two equations for axial strain and temperature to be found in terms of the measure shifts in the primary and second order Bragg wavelengths. This system of equations can be solved for strain and temperature.

Magnetic Nanoliposomes as in Situ Microbubble Bombers for Multimodality Image-Guided Cancer Theranostics.

PubMed

Liu, Yang; Yang, Fang; Yuan, Chuxiao; Li, Mingxi; Wang, Tuantuan; Chen, Bo; Jin, Juan; Zhao, Peng; Tong, Jiayi; Luo, Shouhua; Gu, Ning

2017-02-28

Nanosized drug delivery systems have offered promising approaches for cancer theranostics. However, few are effective to simultaneously maximize tumor-specific uptake, imaging, and therapy in a single nanoplatform. Here, we report a simple yet stimuli-responsive anethole dithiolethione (ADT)-loaded magnetic nanoliposome (AML) delivery system, which consists of ADT, hydrogen sulfide (H 2 S) pro-drug, doped in the lipid bilayer, and superparamagnetic nanoparticles encapsulated inside. HepG2 cells could be effectively bombed after 6 h co-incubation with AMLs. For in vivo applications, after preferentially targeting the tumor tissue when spatiotemporally navigated by an external magnetic field, the nanoscaled AMLs can intratumorally convert to microsized H 2 S bubbles. This dynamic process can be monitored by magnetic resonance and ultrasound dual modal imaging. Importantly, the intratumoral generated H 2 S bubbles imaged by real-time ultrasound imaging first can bomb to ablate the tumor tissue when exposed to higher acoustic intensity; then as gasotransmitters, intratumoral generated high-concentration H 2 S molecules can diffuse into the inner tumor regions to further have a synergetic antitumor effect. After 7-day follow-up observation, AMLs with magnetic field treatments have indicated extremely significantly higher inhibitions of tumor growth. Therefore, such elaborately designed intratumoral conversion of nanostructures to microstructures has exhibited an improved anticancer efficacy, which may be promising for multimodal image-guided accurate cancer therapy.

On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial.

PubMed

Andress, Sebastian; Johnson, Alex; Unberath, Mathias; Winkler, Alexander Felix; Yu, Kevin; Fotouhi, Javad; Weidert, Simon; Osgood, Greg; Navab, Nassir

2018-04-01

Fluoroscopic x-ray guidance is a cornerstone for percutaneous orthopedic surgical procedures. However, two-dimensional (2-D) observations of the three-dimensional (3-D) anatomy suffer from the effects of projective simplification. Consequently, many x-ray images from various orientations need to be acquired for the surgeon to accurately assess the spatial relations between the patient's anatomy and the surgical tools. We present an on-the-fly surgical support system that provides guidance using augmented reality and can be used in quasiunprepared operating rooms. The proposed system builds upon a multimodality marker and simultaneous localization and mapping technique to cocalibrate an optical see-through head mounted display to a C-arm fluoroscopy system. Then, annotations on the 2-D x-ray images can be rendered as virtual objects in 3-D providing surgical guidance. We quantitatively evaluate the components of the proposed system and, finally, design a feasibility study on a semianthropomorphic phantom. The accuracy of our system was comparable to the traditional image-guided technique while substantially reducing the number of acquired x-ray images as well as procedure time. Our promising results encourage further research on the interaction between virtual and real objects that we believe will directly benefit the proposed method. Further, we would like to explore the capabilities of our on-the-fly augmented reality support system in a larger study directed toward common orthopedic interventions.

Multimodal coherent anti-Stokes Raman scattering microscopy reveals microglia-associated myelin and axonal dysfunction in multiple sclerosis-like lesions in mice

PubMed Central

Imitola, Jaime; Côté, Daniel; Rasmussen, Stine; Xie, X. Sunney; Liu, Yingru; Chitnis, Tanuja; Sidman, Richard L.; Lin, Charles. P.; Khoury, Samia J.

2011-01-01

Myelin loss and axonal degeneration predominate in many neurological disorders; however, methods to visualize them simultaneously in live tissue are unavailable. We describe a new imaging strategy combining video rate reflectance and fluorescence confocal imaging with coherent anti-Stokes Raman scattering (CARS) microscopy tuned to CH2 vibration of myelin lipids, applied in live tissue of animals with chronic experimental autoimmune encephalomyelitis (EAE). Our method allows monitoring over time of demyelination and neurodegeneration in brain slices with high spatial resolution and signal-to-noise ratio. Local areas of severe loss of lipid signal indicative of demyelination and loss of the reflectance signal from axons were seen in the corpus callosum and spinal cord of EAE animals. Even in myelinated areas of EAE mice, the intensity of myelin lipid signals is significantly reduced. Using heterozygous knock-in mice in which green fluorescent protein replaces the CX3CR1 coding sequence that labels central nervous system microglia, we find areas of activated microglia colocalized with areas of altered reflectance and CARS signals reflecting axonal injury and demyelination. Our data demonstrate the use of multimodal CARS microscopy for characterization of demyelinating and neurodegenerative pathology in a mouse model of multiple sclerosis, and further confirm the critical role of microglia in chronic inflammatory neurodegeneration. PMID:21361672

Real-time trace gas sensor using a multimode diode laser and multiple-line integrated cavity enhanced absorption spectroscopy.

PubMed

Karpf, Andreas; Rao, Gottipaty N

2015-07-01

We describe and demonstrate a highly sensitive trace gas sensor based on a simplified design that is capable of measuring sub-ppb concentrations of NO2 in tens of milliseconds. The sensor makes use of a relatively inexpensive Fabry-Perot diode laser to conduct off-axis cavity enhanced spectroscopy. The broad frequency range of a multimode Fabry-Perot diode laser spans a large number of absorption lines, thereby removing the need for a single-frequency tunable laser source. The use of cavity enhanced absorption spectroscopy enhances the sensitivity of the sensor by providing a pathlength on the order of 1 km in a small volume. Off-axis alignment excites a large number of cavity modes simultaneously, thereby reducing the sensor's susceptibility to vibration. Multiple-line integrated absorption spectroscopy (where one integrates the absorption spectra over a large number of rovibronic transitions of the molecular species) further improves the sensitivity of detection. Relatively high laser power (∼400  mW) is used to compensate for the low coupling efficiency of a broad linewidth laser to the optical cavity. The approach was demonstrated using a 407 nm diode laser to detect trace quantities of NO2 in zero air. Sensitivities of 750 ppt, 110 ppt, and 65 ppt were achieved using integration times of 50 ms, 5 s, and 20 s respectively.