Multimodal nonlinear microscopy of biopsy specimen: towards intraoperative diagnostics (Conference Presentation)

NASA Astrophysics Data System (ADS)

Schmitt, Michael; Heuke, Sandro; Meyer, Tobias; Chernavskaia, Olga; Bocklitz, Thomas W.; Popp, Juergen

2016-03-01

The realization of label-free molecule specific imaging of morphology and chemical composition of tissue at subcellular spatial resolution in real time is crucial for many envisioned applications in medicine, e.g., precise surgical guidance and non-invasive histopathologic examination of tissue. Thus, new approaches for a fast and reliable in vivo and near in vivo (ex corpore in vivo) tissue characterization to supplement routine pathological diagnostics is needed. Spectroscopic imaging approaches are particularly important since they have the potential to provide a pathologist with adequate support in the form of clinically-relevant information under both ex vivo and in vivo conditions. In this contribution it is demonstrated, that multimodal nonlinear microscopy combining coherent anti-Stokes Raman scattering (CARS), two photon excited fluorescence (TPEF) and second harmonic generation (SHG) enables the detection of characteristic structures and the accompanying molecular changes of widespread diseases, particularly of cancer and atherosclerosis. The detailed images enable an objective evaluation of the tissue samples for an early diagnosis of the disease status. Increasing the spectral resolution and analyzing CARS images at multiple Raman resonances improves the chemical specificity. To facilitate handling and interpretation of the image data characteristic properties can be automatically extracted by advanced image processing algorithms, e.g., for tissue classification. Overall, the presented examples show the great potential of multimodal imaging to augment standard intraoperative clinical assessment with functional multimodal CARS/SHG/TPEF images to highlight functional activity and tumor boundaries. It ensures fast, label-free and non-invasive intraoperative tissue classification paving the way towards in vivo optical pathology.

Multimode nonlinear optical imaging of the dermis in ex vivo human skin based on the combination of multichannel mode and Lambda mode.

PubMed

Zhuo, Shuangmu; Chen, Jianxin; Luo, Tianshu; Zou, Dingsong

2006-08-21

A Multimode nonlinear optical imaging technique based on the combination of multichannel mode and Lambda mode is developed to investigate human dermis. Our findings show that this technique not only improves the image contrast of the structural proteins of extracellular matrix (ECM) but also provides an image-guided spectral analysis method to identify both cellular and ECM intrinsic components including collagen, elastin, NAD(P)H and flavin. By the combined use of multichannel mode and Lambda mode in tandem, the obtained in-depth two photon-excited fluorescence (TPEF) and second-harmonic generation (SHG) imaging and TPEF/SHG signals depth-dependence decay can offer a sensitive tool for obtaining quantitative tissue structural and biochemical information. These results suggest that the technique has the potential to provide more accurate information for determining tissue physiological and pathological states.

Mid-infrared supercontinuum generation in multimode step index chalcogenide fiber

NASA Astrophysics Data System (ADS)

Ben Khalifa, Ameni; Ben Salem, Amine; Cherif, Rim; Zghal, Mourad

2016-09-01

In this paper, we propose a design of a high numerical aperture multimode hybrid step-index fiber for mid-infrared (mid- IR) supercontinuum generation (SCG) where two chalcogenide glass compositions As40Se60 and Ge10As23.4Se66.6 for the core and the cladding are selected, respectively. Aiming to get accurate modeling of the SCG by the fundamental mode, we solve the multimode generalized nonlinear Schrödinger equations and demonstrate nonlinear coupling and energy transfer between high order modes. The proposed study points out the impact of nonlinear mode coupling that should be taken into account in order to successfully predict the mid-infrared supercontinuum generation in highly nonlinear multimode fibers.

Structured illumination multimodal 3D-resolved quantitative phase and fluorescence sub-diffraction microscopy

PubMed Central

Chowdhury, Shwetadwip; Eldridge, Will J.; Wax, Adam; Izatt, Joseph A.

2017-01-01

Sub-diffraction resolution imaging has played a pivotal role in biological research by visualizing key, but previously unresolvable, sub-cellular structures. Unfortunately, applications of far-field sub-diffraction resolution are currently divided between fluorescent and coherent-diffraction regimes, and a multimodal sub-diffraction technique that bridges this gap has not yet been demonstrated. Here we report that structured illumination (SI) allows multimodal sub-diffraction imaging of both coherent quantitative-phase (QP) and fluorescence. Due to SI’s conventionally fluorescent applications, we first demonstrate the principle of SI-enabled three-dimensional (3D) QP sub-diffraction imaging with calibration microspheres. Image analysis confirmed enhanced lateral and axial resolutions over diffraction-limited QP imaging, and established striking parallels between coherent SI and conventional optical diffraction tomography. We next introduce an optical system utilizing SI to achieve 3D sub-diffraction, multimodal QP/fluorescent visualization of A549 biological cells fluorescently tagged for F-actin. Our results suggest that SI has a unique utility in studying biological phenomena with significant molecular, biophysical, and biochemical components. PMID:28663887

Multimodal nonlinear microscope based on a compact fiber-format laser source

NASA Astrophysics Data System (ADS)

Crisafi, Francesco; Kumar, Vikas; Perri, Antonio; Marangoni, Marco; Cerullo, Giulio; Polli, Dario

2018-01-01

We present a multimodal non-linear optical (NLO) laser-scanning microscope, based on a compact fiber-format excitation laser and integrating coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and two-photon-excitation fluorescence (TPEF) on a single platform. We demonstrate its capabilities in simultaneously acquiring CARS and SRS images of a blend of 6-μm poly(methyl methacrylate) beads and 3-μm polystyrene beads. We then apply it to visualize cell walls and chloroplast of an unprocessed fresh leaf of Elodea aquatic plant via SRS and TPEF modalities, respectively. The presented NLO microscope, developed in house using off-the-shelf components, offers full accessibility to the optical path and ensures its easy re-configurability and flexibility.

Label-free imaging of acanthamoeba using multimodal nonlinear optical microscopy

NASA Astrophysics Data System (ADS)

Kobayashi, Tsubasa; Cha, Yu-Rok; Kaji, Yuichi; Oshika, Tetsuro; Leproux, Philippe; Couderc, Vincent; Kano, Hideaki

2018-02-01

Acanthamoeba keratitis is a disease in which amoebae named Acanthamoeba invade the cornea of an eye. To diagnose this disease before it becomes serious, it is important to detect the cyst state of Acanthamoeba in the early stage of infection. In the present study, we explored spectroscopic signitures of the cyst state of Acanthamoeba using multimodal nonlinear optical microscopy with the channels of multiplex coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG), and third harmonic generation (THG). A sharp band at around 1603 cm-1 in the CARS (Im[χ(3)]) spectrum was found at the cyst state of Acanthamoeba, which possibly originates from ergosterol and/or 7-dehydrostigmasterol. It can be used as a maker band of Acanthamoeba for medical treatment. Keyword: Acanthamoeba keratitis, coherent anti-Stokes Raman scattering, CARS, second harmonic generation, SHG, microspectroscopy, multiphoton microscopy

Multimodal optical workstation for simultaneous linear, nonlinear microscopy and nanomanipulation: upgrading a commercial confocal inverted microscope.

PubMed

Mathew, Manoj; Santos, Susana I C O; Zalvidea, Dobryna; Loza-Alvarez, Pablo

2009-07-01

In this work we propose and build a multimodal optical workstation that extends a commercially available confocal microscope (Nikon Confocal C1-Si) to include nonlinear/multiphoton microscopy and optical manipulation/stimulation tools such as nanosurgery. The setup allows both subsystems (confocal and nonlinear) to work independently and simultaneously. The workstation enables, for instance, nanosurgery along with simultaneous confocal and brightfield imaging. The nonlinear microscopy capabilities are added around the commercial confocal microscope by exploiting all the flexibility offered by this microscope and without need for any mechanical or electronic modification of the confocal microscope systems. As an example, the standard differential interference contrast condenser and diascopic detector in the confocal microscope are readily used as a forward detection mount for second harmonic generation imaging. The various capabilities of this workstation, as applied directly to biology, are demonstrated using the model organism Caenorhabditis elegans.

Multimodal nonlinear nanophotonics (Conference Presentation)

NASA Astrophysics Data System (ADS)

Kivshar, Yuri S.

2017-05-01

Nonlinear nanophotonics is a rapidly developing field of research with many potential applications for the design of nonlinear nanoantennas, light sources, nanolasers, and ultrafast miniature metadevices. A tight confinement of the local electromagnetic fields in resonant photonic nanostructures can boost nonlinear optical effects, thus offering versatile opportunities for the subwavelength control of light. To achieve the desired functionalities, it is essential to gain flexible control over the near- and far-field properties of nanostructures. To engineer nonlinear scattering from resonant nanoscale elements, both modal and multipolar control of the nonlinear response are widely exploited for enhancing the near-field interaction and optimizing the radiation directionality. Motivated by the recent progress of all-dielectric nanophotonics, where the electric and magnetic multipolar contributions may become comparable, here we review the advances in the recently emerged field of multipolar nonlinear nanophotonics, starting from earlier relevant studies of metallic and metal-dielectric structures supporting localized plasmonic resonances to then discussing the latest results for all-dielectric nanostructures driven by Mie-type multipolar resonances and optically induced magnetic response. These recent developments suggest intriguing opportunities for a design of nonlinear subwavelength light sources with reconfigurable radiation characteristics and engineering large effective optical nonlinearities at the nanoscale, which could have important implications for novel nonlinear photonic devices operating beyond the diffraction limit.

Quantitative reconstructions in multi-modal photoacoustic and optical coherence tomography imaging

NASA Astrophysics Data System (ADS)

Elbau, P.; Mindrinos, L.; Scherzer, O.

2018-01-01

In this paper we perform quantitative reconstruction of the electric susceptibility and the Grüneisen parameter of a non-magnetic linear dielectric medium using measurement of a multi-modal photoacoustic and optical coherence tomography system. We consider the mathematical model presented in Elbau et al (2015 Handbook of Mathematical Methods in Imaging ed O Scherzer (New York: Springer) pp 1169-204), where a Fredholm integral equation of the first kind for the Grüneisen parameter was derived. For the numerical solution of the integral equation we consider a Galerkin type method.

Multimodal Nonlinear Optical Imaging for Sensitive Detection of Multiple Pharmaceutical Solid-State Forms and Surface Transformations.

PubMed

Novakovic, Dunja; Saarinen, Jukka; Rojalin, Tatu; Antikainen, Osmo; Fraser-Miller, Sara J; Laaksonen, Timo; Peltonen, Leena; Isomäki, Antti; Strachan, Clare J

2017-11-07

Two nonlinear imaging modalities, coherent anti-Stokes Raman scattering (CARS) and sum-frequency generation (SFG), were successfully combined for sensitive multimodal imaging of multiple solid-state forms and their changes on drug tablet surfaces. Two imaging approaches were used and compared: (i) hyperspectral CARS combined with principal component analysis (PCA) and SFG imaging and (ii) simultaneous narrowband CARS and SFG imaging. Three different solid-state forms of indomethacin-the crystalline gamma and alpha forms, as well as the amorphous form-were clearly distinguished using both approaches. Simultaneous narrowband CARS and SFG imaging was faster, but hyperspectral CARS and SFG imaging has the potential to be applied to a wider variety of more complex samples. These methodologies were further used to follow crystallization of indomethacin on tablet surfaces under two storage conditions: 30 °C/23% RH and 30 °C/75% RH. Imaging with (sub)micron resolution showed that the approach allowed detection of very early stage surface crystallization. The surfaces progressively crystallized to predominantly (but not exclusively) the gamma form at lower humidity and the alpha form at higher humidity. Overall, this study suggests that multimodal nonlinear imaging is a highly sensitive, solid-state (and chemically) specific, rapid, and versatile imaging technique for understanding and hence controlling (surface) solid-state forms and their complex changes in pharmaceuticals.

Numerical investigation of nonlinear interactions between multimodal guided waves and delamination in composite structures

NASA Astrophysics Data System (ADS)

Shen, Yanfeng

2017-04-01

This paper presents a numerical investigation of the nonlinear interactions between multimodal guided waves and delamination in composite structures. The elastodynamic wave equations for anisotropic composite laminate were formulated using an explicit Local Interaction Simulation Approach (LISA). The contact dynamics was modeled using the penalty method. In order to capture the stick-slip contact motion, a Coulomb friction law was integrated into the computation procedure. A random gap function was defined for the contact pairs to model distributed initial closures or openings to approximate the nature of rough delamination interfaces. The LISA procedure was coded using the Compute Unified Device Architecture (CUDA), which enables the highly parallelized computation on powerful graphic cards. Several guided wave modes centered at various frequencies were investigated as the incident wave. Numerical case studies of different delamination locations across the thickness were carried out. The capability of different wave modes at various frequencies to trigger the Contact Acoustic Nonlinearity (CAN) was studied. The correlation between the delamination size and the signal nonlinearity was also investigated. Furthermore, the influence from the roughness of the delamination interfaces was discussed as well. The numerical investigation shows that the nonlinear features of wave delamination interactions can enhance the evaluation capability of guided wave Structural Health Monitoring (SHM) system. This paper finishes with discussion, concluding remarks, and suggestions for future work.

Live animal myelin histomorphometry of the spinal cord with video-rate multimodal nonlinear microendoscopy

NASA Astrophysics Data System (ADS)

Bélanger, Erik; Crépeau, Joël; Laffray, Sophie; Vallée, Réal; De Koninck, Yves; Côté, Daniel

2012-02-01

In vivo imaging of cellular dynamics can be dramatically enabling to understand the pathophysiology of nervous system diseases. To fully exploit the power of this approach, the main challenges have been to minimize invasiveness and maximize the number of concurrent optical signals that can be combined to probe the interplay between multiple cellular processes. Label-free coherent anti-Stokes Raman scattering (CARS) microscopy, for example, can be used to follow demyelination in neurodegenerative diseases or after trauma, but myelin imaging alone is not sufficient to understand the complex sequence of events that leads to the appearance of lesions in the white matter. A commercially available microendoscope is used here to achieve minimally invasive, video-rate multimodal nonlinear imaging of cellular processes in live mouse spinal cord. The system allows for simultaneous CARS imaging of myelin sheaths and two-photon excitation fluorescence microendoscopy of microglial cells and axons. Morphometric data extraction at high spatial resolution is also described, with a technique for reducing motion-related imaging artifacts. Despite its small diameter, the microendoscope enables high speed multimodal imaging over wide areas of tissue, yet at resolution sufficient to quantify subtle differences in myelin thickness and microglial motility.

Enhanced Broadband Vibration Energy Harvesting Using a Multimodal Nonlinear Magnetoelectric Converter

NASA Astrophysics Data System (ADS)

Lin, Zhiming; Yang, Jin; Zhao, Jiangxin; Zhao, Nian; Liu, Jun; Wen, Yumei; Li, Ping

2016-07-01

In this work, we present a multimodal wideband vibration energy harvester designed to scavenge energy from ambient vibrations over a wide frequency range. The harvester consists of a folded cantilever, three magnetoelectric (ME) transducers, and two magnetic circuits. The folded cantilever enables multi-resonant response formed by bending of each stage, and the nonlinear magnetic forces acting on the folded cantilever beam allow further broadening of the frequency response. We also investigate the effects of the position of the ME transducer on the electrical output in order to achieve optimal performance. The experimental results show that the vibration energy harvester exhibited three resonance peaks in a range of 5 Hz to 30 Hz, a wider working bandwidth of 10.1 Hz, and a maximum average power value of 31.58 μW at an acceleration of 0.6 g (with g = 9.8 m/s2).

Quantitative theory of driven nonlinear brain dynamics.

PubMed

Roberts, J A; Robinson, P A

2012-09-01

Strong periodic stimuli such as bright flashing lights evoke nonlinear responses in the brain and interact nonlinearly with ongoing cortical activity, but the underlying mechanisms for these phenomena are poorly understood at present. The dominant features of these experimentally observed dynamics are reproduced by the dynamics of a quantitative neural field model subject to periodic drive. Model power spectra over a range of drive frequencies show agreement with multiple features of experimental measurements, exhibiting nonlinear effects including entrainment over a range of frequencies around the natural alpha frequency f(α), subharmonic entrainment near 2f(α), and harmonic generation. Further analysis of the driven dynamics as a function of the drive parameters reveals rich nonlinear dynamics that is predicted to be observable in future experiments at high drive amplitude, including period doubling, bistable phase-locking, hysteresis, wave mixing, and chaos indicated by positive Lyapunov exponents. Moreover, photosensitive seizures are predicted for physiologically realistic model parameters yielding bistability between healthy and seizure dynamics. These results demonstrate the applicability of neural field models to the new regime of periodically driven nonlinear dynamics, enabling interpretation of experimental data in terms of specific generating mechanisms and providing new tests of the theory. Copyright © 2012 Elsevier Inc. All rights reserved.

Enabling the detection of UV signal in multimodal nonlinear microscopy with catalogue lens components.

PubMed

Vogel, Martin; Wingert, Axel; Fink, Rainer H A; Hagl, Christian; Ganikhanov, Feruz; Pfeffer, Christian P

2015-10-01

Using an optical system made from fused silica catalogue optical components, third-order nonlinear microscopy has been enabled on conventional Ti:sapphire laser-based multiphoton microscopy setups. The optical system is designed using two lens groups with straightforward adaptation to other microscope stands when one of the lens groups is exchanged. Within the theoretical design, the optical system collects and transmits light with wavelengths between the near ultraviolet and the near infrared from an object field of at least 1 mm in diameter within a resulting numerical aperture of up to 0.56. The numerical aperture can be controlled with a variable aperture stop between the two lens groups of the condenser. We demonstrate this new detection capability in third harmonic generation imaging experiments at the harmonic wavelength of ∼300 nm and in multimodal nonlinear optical imaging experiments using third-order sum frequency generation and coherent anti-Stokes Raman scattering microscopy so that the wavelengths of the detected signals range from ∼300 nm to ∼660 nm. © 2015 The Authors Journal of Microscopy © 2015 Royal Microscopical Society.

Multimodal imaging of ischemic wounds

NASA Astrophysics Data System (ADS)

Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Liu, Peng; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

2012-12-01

The wound healing process involves the reparative phases of inflammation, proliferation, and remodeling. Interrupting any of these phases may result in chronically unhealed wounds, amputation, or even patient death. Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, no method is available for noninvasive, simultaneous, and quantitative imaging of these tissue parameters. We integrated hyperspectral, laser speckle, and thermographic imaging modalities into a single setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Advanced algorithms were developed for accurate reconstruction of wound oxygenation and appropriate co-registration between different imaging modalities. The multimodal wound imaging system was validated by an ongoing clinical trials approved by OSU IRB. In the clinical trial, a wound of 3mm in diameter was introduced on a healthy subject's lower extremity and the healing process was serially monitored by the multimodal imaging setup. Our experiments demonstrated the clinical usability of multimodal wound imaging.

Evaluation of the role of CD207 on Langerhans cells in a murine model of atopic dermatitis by in situ imaging using Cr:forsterite laser-based multimodality nonlinear microscopy

NASA Astrophysics Data System (ADS)

Lee, Jyh-Hong; Tsai, Ming-Rung; Sun, Chi-Kuang; Chiang, Bor-Luen

2012-11-01

Atopic dermatitis (AD) is an allergic inflammatory disease of skin. It remains unclear that CD207 of Langerhans cells (LCs) plays a central role in the development of allergic sensitization. There is little data on LCs within the microenviroment in vivo. We used a murine model of epicutaneous (EC) ovalbumin (OVA) sensitization inducing an inflammatory skin resembling AD to explore the role of CD207 in the pathogenesis of AD. Cr:forsterite laser-based multimodality nonlinear microscopy was applied for in situ imaging. Peritoneal injections of Alexa Fluor 647-rat anti-mouse CD207 into mice were performed to specifically trace the LCs. Peritoneal injections of OVA-Alexa Fluor 647 conjugate into mice were performed to specifically trace the OVA. We found that combining Alexa Fluor fluorescent probes with multimodality nonlinear microscopy permitted the unequivocal in situ imaging of CD207-expressing LCs. The relevant time-course, expressional, and functional studies reveal that CD207 of LCs plays an essential role during the induction of EC sensitization. We establish and validate that Cr:forsterite laser-based multimodality nonlinear microscopy is applicable for the specific detection of labeled mAb-bound LCs and labeled antigen. We suggest that CD207-expressing LCs initiate the allergic response through the CD207 mediated epicutaneous sensitization associated with the development of AD.

Multimodal Deep Autoencoder for Human Pose Recovery.

PubMed

Hong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng

2015-12-01

Video-based human pose recovery is usually conducted by retrieving relevant poses using image features. In the retrieving process, the mapping between 2D images and 3D poses is assumed to be linear in most of the traditional methods. However, their relationships are inherently non-linear, which limits recovery performance of these methods. In this paper, we propose a novel pose recovery method using non-linear mapping with multi-layered deep neural network. It is based on feature extraction with multimodal fusion and back-propagation deep learning. In multimodal fusion, we construct hypergraph Laplacian with low-rank representation. In this way, we obtain a unified feature description by standard eigen-decomposition of the hypergraph Laplacian matrix. In back-propagation deep learning, we learn a non-linear mapping from 2D images to 3D poses with parameter fine-tuning. The experimental results on three data sets show that the recovery error has been reduced by 20%-25%, which demonstrates the effectiveness of the proposed method.

Multimodal nonlinear optical imaging of cartilage development in mouse model

NASA Astrophysics Data System (ADS)

He, Sicong; Xue, Wenqian; Sun, Qiqi; Li, Xuesong; Huang, Jiandong; Qu, Jianan Y.

2017-02-01

Kinesin-1 is a kind of motor protein responsible for intracellular transportation and has been studied in a variety of tissues. However, its roles in cartilage development are not clear. In this study, a kinesin-1 heavy chain (Kif5b) knockout mouse model is used to study the functions of kinesin-1 in the cartilage development. We developed a multimodal nonlinear optical (NLO) microscope system integrating stimulated Raman scattering (SRS), second harmonic generation (SHG) and two-photon excited fluorescence (TPEF) to investigate the morphological and biomedical characteristics of fresh tibial cartilage from normal and mutant mice at different developmental stages. The combined forward and backward SHG imaging resolved the fine structure of collagen fibrils in the extracellular matrix of cartilage. Meanwhile, the chondrocyte morphology in different zones of cartilage was visualized by label-free SRS and TPEF images. The results show that the fibrillar collagen in the superficial zone of cartilage in postnatal day 10 and 15 (P10 and P15) knockout mice was significantly less than that of control mice. Moreover, we observed distorted morphology and disorganization of columnar arrangement of chondrocytes in the growth plate cartilage of mutant mice. This study reveals the significant roles of kinesin-1 in collagen formation and chondrocyte morphogenesis.

Spatiotemporal light-beam compression from nonlinear mode coupling

NASA Astrophysics Data System (ADS)

Krupa, Katarzyna; Tonello, Alessandro; Couderc, Vincent; Barthélémy, Alain; Millot, Guy; Modotto, Daniele; Wabnitz, Stefan

2018-04-01

We experimentally demonstrate simultaneous spatial and temporal compression in the propagation of light pulses in multimode nonlinear optical fibers. We reveal that the spatial beam self-cleaning recently discovered in graded-index multimode fibers is accompanied by significant temporal reshaping and up to fourfold shortening of the injected subnanosecond laser pulses. Since the nonlinear coupling among the modes strongly depends on the instantaneous power, we explore the entire range of the nonlinear dynamics with a single optical pulse, where the optical power is continuously varied across the pulse profile.

Nonlinear dynamics and control of a vibrating rectangular plate

NASA Technical Reports Server (NTRS)

Shebalin, J. V.

1983-01-01

The von Karman equations of nonlinear elasticity are solved for the case of a vibrating rectangular plate by meams of a Fourier spectral transform method. The amplification of a particular Fourier mode by nonlinear transfer of energy is demonstrated for this conservative system. The multi-mode system is reduced to a minimal (two mode) system, retaining the qualitative features of the multi-mode system. The effect of a modal control law on the dynamics of this minimal nonlinear elastic system is examined.

Quantitative analysis of a frequency-domain nonlinearity indicator.

PubMed

Reichman, Brent O; Gee, Kent L; Neilsen, Tracianne B; Miller, Kyle G

2016-05-01

In this paper, quantitative understanding of a frequency-domain nonlinearity indicator is developed. The indicator is derived from an ensemble-averaged, frequency-domain version of the generalized Burgers equation, which can be rearranged in order to directly compare the effects of nonlinearity, absorption, and geometric spreading on the pressure spectrum level with frequency and distance. The nonlinear effect is calculated using pressure-squared-pressure quadspectrum. Further theoretical development has given an expression for the role of the normalized quadspectrum, referred to as Q/S by Morfey and Howell [AIAA J. 19, 986-992 (1981)], in the spatial rate of change of the pressure spectrum level. To explore this finding, an investigation of the change in level for initial sinusoids propagating as plane waves through inviscid and thermoviscous media has been conducted. The decibel change with distance, calculated through Q/S, captures the growth and decay of the harmonics and indicates that the most significant changes in level occur prior to sawtooth formation. At large distances, the inviscid case results in a spatial rate of change that is uniform across all harmonics. For thermoviscous media, large positive nonlinear gains are observed but offset by absorption, which leads to a greater overall negative spatial rate of change for higher harmonics.

Cross mode modulation in multimode fibers.

PubMed

Kroushkov, Dimitar I; Rademacher, Georg; Petermann, Klaus

2013-05-15

We show that Kerr nonlinearity induced intermodal power transfer in a particular mode group of a multimode fiber can be formulated by the same type of equation used to describe the effect of cross polarization modulation in single-mode fibers.

Nonlinear multimodal model for TLD of irregular tank geometry and small fluid depth

NASA Astrophysics Data System (ADS)

Love, J. S.; Tait, M. J.

2013-11-01

Tuned liquid dampers (TLDs) utilize sloshing fluid to absorb and dissipate structural vibrational energy. TLDs of irregular or complex tank geometry may be required in practice to avoid tank interference with fixed structural or mechanical components. The literature offers few analytical models to predict the response of this type of TLD, particularly when the fluid depth is small. In this paper, a multimodal model is developed utilizing a Boussinesq-type modal theory which is valid for small TLD fluid depths. The Bateman-Luke variational principle is employed to develop a system of coupled nonlinear ordinary differential equations which describe the fluid response when the tank is subjected to base excitation. Energy dissipation is incorporated into the model from the inclusion of damping screens. The fluid model is used to describe the response of a 2D structure-TLD system when the structure is subjected to external loading and the TLD tank geometry is irregular.

Radiolabeled Nanoparticles for Multimodality Tumor Imaging

PubMed Central

Xing, Yan; Zhao, Jinhua; Conti, Peter S.; Chen, Kai

2014-01-01

Each imaging modality has its own unique strengths. Multimodality imaging, taking advantages of strengths from two or more imaging modalities, can provide overall structural, functional, and molecular information, offering the prospect of improved diagnostic and therapeutic monitoring abilities. The devices of molecular imaging with multimodality and multifunction are of great value for cancer diagnosis and treatment, and greatly accelerate the development of radionuclide-based multimodal molecular imaging. Radiolabeled nanoparticles bearing intrinsic properties have gained great interest in multimodality tumor imaging over the past decade. Significant breakthrough has been made toward the development of various radiolabeled nanoparticles, which can be used as novel cancer diagnostic tools in multimodality imaging systems. It is expected that quantitative multimodality imaging with multifunctional radiolabeled nanoparticles will afford accurate and precise assessment of biological signatures in cancer in a real-time manner and thus, pave the path towards personalized cancer medicine. This review addresses advantages and challenges in developing multimodality imaging probes by using different types of nanoparticles, and summarizes the recent advances in the applications of radiolabeled nanoparticles for multimodal imaging of tumor. The key issues involved in the translation of radiolabeled nanoparticles to the clinic are also discussed. PMID:24505237

Proposal of ultra-compact NAND/NOR/XNOR all-optical logic gates based on a nonlinear 3x1 multimode interference

NASA Astrophysics Data System (ADS)

Tajaldini, Mehdi; Mat Jafri, M. Z.

2014-05-01

We present a highly miniaturized multimode interference (MMI) coupler based on nonlinear modal propagation analysis (NMPA) method as a novel design method and potential application for optical NAND, NOR and XNOR logic gates for Boolean logic signal processing devices. Crystalline polydiacetylene is used to allow the appearances of nonlinear effects in low input intensities and ultra- short length to control the MMI coupler as an active device to access light switching due to its high nonlinear susceptibility. We consider a 10x33 μm2 MMI structure with three inputs and one output. Notably, the access facets are single-mode waveguides with sub-micron width. The center input contributes to control the induced light propagation in MMI by intensity variation whereas others could be launched by particular intensity when they are ON and 0 in OFF. Output intensity is analyzed in various sets of inputs to show the capability of Boolean logic gates, the contrast between ON and OFF is calculated on mentioned gates to present the efficiency. Good operation in low intensity and highly miniaturized MMI coupler is observed. Furthermore, nonlinear effects could be realized through the modal interferences. The issue of high insertion loss is addressed with a 3×3 upgraded coupler. Furthermore, the main significant aspect of this paper is simulating an MMI coupler that is launched by three nonlinear inputs, simultaneously, whereas last presents have never studied more than one input in nonlinear regimes.

Multimodal imaging of cutaneous wound tissue

NASA Astrophysics Data System (ADS)

Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Ren, Wenqi; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

2015-01-01

Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, few methods are available for simultaneous assessment of these tissue parameters in a noninvasive and quantitative fashion. We integrated hyperspectral, laser speckle, and thermographic imaging modalities in a single-experimental setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Algorithms were developed for appropriate coregistration between wound images acquired by different imaging modalities at different times. The multimodal wound imaging system was validated in an occlusion experiment, where oxygenation and perfusion maps of a healthy subject's upper extremity were continuously monitored during a postocclusive reactive hyperemia procedure and compared with standard measurements. The system was also tested in a clinical trial where a wound of three millimeters in diameter was introduced on a healthy subject's lower extremity and the healing process was continuously monitored. Our in vivo experiments demonstrated the clinical feasibility of multimodal cutaneous wound imaging.

Nonlinear characterization of elasticity using quantitative optical coherence elastography.

PubMed

Qiu, Yi; Zaki, Farzana R; Chandra, Namas; Chester, Shawn A; Liu, Xuan

2016-11-01

Optical coherence elastography (OCE) has been used to perform mechanical characterization on biological tissue at the microscopic scale. In this work, we used quantitative optical coherence elastography (qOCE), a novel technology we recently developed, to study the nonlinear elastic behavior of biological tissue. The qOCE system had a fiber-optic probe to exert a compressive force to deform tissue under the tip of the probe. Using the space-division multiplexed optical coherence tomography (OCT) signal detected by a spectral domain OCT engine, we were able to simultaneously quantify the probe deformation that was proportional to the force applied, and to quantify the tissue deformation. In other words, our qOCE system allowed us to establish the relationship between mechanical stimulus and tissue response to characterize the stiffness of biological tissue. Most biological tissues have nonlinear elastic behavior, and the apparent stress-strain relationship characterized by our qOCE system was nonlinear an extended range of strain, for a tissue-mimicking phantom as well as biological tissues. Our experimental results suggested that the quantification of force in OCE was critical for accurate characterization of tissue mechanical properties and the qOCE technique was capable of differentiating biological tissues based on the elasticity of tissue that is generally nonlinear.

Quantitative Assessment of Arrhythmia Using Non-linear Approach: A Non-invasive Prognostic Tool

NASA Astrophysics Data System (ADS)

Chakraborty, Monisha; Ghosh, Dipak

2017-12-01

Accurate prognostic tool to identify severity of Arrhythmia is yet to be investigated, owing to the complexity of the ECG signal. In this paper, we have shown that quantitative assessment of Arrhythmia is possible using non-linear technique based on "Hurst Rescaled Range Analysis". Although the concept of applying "non-linearity" for studying various cardiac dysfunctions is not entirely new, the novel objective of this paper is to identify the severity of the disease, monitoring of different medicine and their dose, and also to assess the efficiency of different medicine. The approach presented in this work is simple which in turn will help doctors in efficient disease management. In this work, Arrhythmia ECG time series are collected from MIT-BIH database. Normal ECG time series are acquired using POLYPARA system. Both time series are analyzed in thelight of non-linear approach following the method "Rescaled Range Analysis". The quantitative parameter, "Fractal Dimension" (D) is obtained from both types of time series. The major finding is that Arrhythmia ECG poses lower values of D as compared to normal. Further, this information can be used to access the severity of Arrhythmia quantitatively, which is a new direction of prognosis as well as adequate software may be developed for the use of medical practice.

Quantitative Assessment of Arrhythmia Using Non-linear Approach: A Non-invasive Prognostic Tool

NASA Astrophysics Data System (ADS)

Chakraborty, Monisha; Ghosh, Dipak

2018-04-01

Accurate prognostic tool to identify severity of Arrhythmia is yet to be investigated, owing to the complexity of the ECG signal. In this paper, we have shown that quantitative assessment of Arrhythmia is possible using non-linear technique based on "Hurst Rescaled Range Analysis". Although the concept of applying "non-linearity" for studying various cardiac dysfunctions is not entirely new, the novel objective of this paper is to identify the severity of the disease, monitoring of different medicine and their dose, and also to assess the efficiency of different medicine. The approach presented in this work is simple which in turn will help doctors in efficient disease management. In this work, Arrhythmia ECG time series are collected from MIT-BIH database. Normal ECG time series are acquired using POLYPARA system. Both time series are analyzed in thelight of non-linear approach following the method "Rescaled Range Analysis". The quantitative parameter, "Fractal Dimension" (D) is obtained from both types of time series. The major finding is that Arrhythmia ECG poses lower values of D as compared to normal. Further, this information can be used to access the severity of Arrhythmia quantitatively, which is a new direction of prognosis as well as adequate software may be developed for the use of medical practice.

Quantitative Homogenization in Nonlinear Elasticity for Small Loads

NASA Astrophysics Data System (ADS)

Neukamm, Stefan; Schäffner, Mathias

2018-04-01

We study quantitative periodic homogenization of integral functionals in the context of nonlinear elasticity. Under suitable assumptions on the energy densities (in particular frame indifference; minimality, non-degeneracy and smoothness at the identity; {p ≥q d} -growth from below; and regularity of the microstructure), we show that in a neighborhood of the set of rotations, the multi-cell homogenization formula of non-convex homogenization reduces to a single-cell formula. The latter can be expressed with the help of correctors. We prove that the homogenized integrand admits a quadratic Taylor expansion in an open neighborhood of the rotations - a result that can be interpreted as the fact that homogenization and linearization commute close to the rotations. Moreover, for small applied loads, we provide an estimate on the homogenization error in terms of a quantitative two-scale expansion.

Multi-mode of Four and Six Wave Parametric Amplified Process

NASA Astrophysics Data System (ADS)

Zhu, Dayu; Yang, Yiheng; Zhang, Da; Liu, Ruizhou; Ma, Danmeng; Li, Changbiao; Zhang, Yanpeng

2017-03-01

Multiple quantum modes in correlated fields are essential for future quantum information processing and quantum computing. Here we report the generation of multi-mode phenomenon through parametric amplified four- and six-wave mixing processes in a rubidium atomic ensemble. The multi-mode properties in both frequency and spatial domains are studied. On one hand, the multi-mode behavior is dominantly controlled by the intensity of external dressing effect, or nonlinear phase shift through internal dressing effect, in frequency domain; on the other hand, the multi-mode behavior is visually demonstrated from the images of the biphoton fields directly, in spatial domain. Besides, the correlation of the two output fields is also demonstrated in both domains. Our approach supports efficient applications for scalable quantum correlated imaging.

Multi-mode of Four and Six Wave Parametric Amplified Process.

PubMed

Zhu, Dayu; Yang, Yiheng; Zhang, Da; Liu, Ruizhou; Ma, Danmeng; Li, Changbiao; Zhang, Yanpeng

2017-03-03

Multiple quantum modes in correlated fields are essential for future quantum information processing and quantum computing. Here we report the generation of multi-mode phenomenon through parametric amplified four- and six-wave mixing processes in a rubidium atomic ensemble. The multi-mode properties in both frequency and spatial domains are studied. On one hand, the multi-mode behavior is dominantly controlled by the intensity of external dressing effect, or nonlinear phase shift through internal dressing effect, in frequency domain; on the other hand, the multi-mode behavior is visually demonstrated from the images of the biphoton fields directly, in spatial domain. Besides, the correlation of the two output fields is also demonstrated in both domains. Our approach supports efficient applications for scalable quantum correlated imaging.

Multimodal non-linear optical imaging for the investigation of drug nano-/microcrystal-cell interactions.

PubMed

Darville, Nicolas; Saarinen, Jukka; Isomäki, Antti; Khriachtchev, Leonid; Cleeren, Dirk; Sterkens, Patrick; van Heerden, Marjolein; Annaert, Pieter; Peltonen, Leena; Santos, Hélder A; Strachan, Clare J; Van den Mooter, Guy

2015-10-01

Drug nano-/microcrystals are being used for sustained parenteral drug release, but safety and efficacy concerns persist as the knowledge of the in vivo fate of long-living particulates is limited. There is a need for techniques enabling the visualization of drug nano-/microcrystals in biological matrices. The aim of this work was to explore the potential of coherent anti-Stokes Raman scattering (CARS) microscopy, supported by other non-linear optical methods, as an emerging tool for the investigation of cellular and tissue interactions of unlabeled and non-fluorescent nano-/microcrystals. Raman and CARS spectra of the prodrug paliperidone palmitate (PP), paliperidone (PAL) and several suspension stabilizers were recorded. PP nano-/microcrystals were incubated with RAW 264.7 macrophages in vitro and their cellular disposition was investigated using a fully-integrated multimodal non-linear optical imaging platform. Suitable anti-Stokes shifts (CH stretching) were identified for selective CARS imaging. CARS microscopy was successfully applied for the selective three-dimensional, non-perturbative and real-time imaging of unlabeled PP nano-/microcrystals having dimensions larger than the optical lateral resolution of approximately 400nm, in relation to the cellular framework in cell cultures and ex vivo in histological sections. In conclusion, CARS microscopy enables the non-invasive and label-free imaging of (sub)micron-sized (pro-)drug crystals in complex biological matrices and could provide vital information on poorly understood nano-/microcrystal-cell interactions in future. Copyright © 2015 Elsevier B.V. All rights reserved.

An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions

NASA Astrophysics Data System (ADS)

Zhang, Jiangjiang; Lin, Guang; Li, Weixuan; Wu, Laosheng; Zeng, Lingzao

2018-03-01

Ensemble smoother (ES) has been widely used in inverse modeling of hydrologic systems. However, for problems where the distribution of model parameters is multimodal, using ES directly would be problematic. One popular solution is to use a clustering algorithm to identify each mode and update the clusters with ES separately. However, this strategy may not be very efficient when the dimension of parameter space is high or the number of modes is large. Alternatively, we propose in this paper a very simple and efficient algorithm, i.e., the iterative local updating ensemble smoother (ILUES), to explore multimodal distributions of model parameters in nonlinear hydrologic systems. The ILUES algorithm works by updating local ensembles of each sample with ES to explore possible multimodal distributions. To achieve satisfactory data matches in nonlinear problems, we adopt an iterative form of ES to assimilate the measurements multiple times. Numerical cases involving nonlinearity and multimodality are tested to illustrate the performance of the proposed method. It is shown that overall the ILUES algorithm can well quantify the parametric uncertainties of complex hydrologic models, no matter whether the multimodal distribution exists.

Developing single-laser sources for multimodal coherent anti-Stokes Raman scattering microscopy

NASA Astrophysics Data System (ADS)

Pegoraro, Adrian Frank

Coherent anti-Stokes Raman scattering (CARS) microscopy has developed rapidly and is opening the door to new types of experiments. This work describes the development of new laser sources for CARS microscopy and their use for different applications. It is specifically focused on multimodal nonlinear optical microscopy—the simultaneous combination of different imaging techniques. This allows us to address a diverse range of applications, such as the study of biomaterials, fluid inclusions, atherosclerosis, hepatitis C infection in cells, and ice formation in cells. For these applications new laser sources are developed that allow for practical multimodal imaging. For example, it is shown that using a single Ti:sapphire oscillator with a photonic crystal fiber, it is possible to develop a versatile multimodal imaging system using optimally chirped laser pulses. This system can perform simultaneous two photon excited fluorescence, second harmonic generation, and CARS microscopy. The versatility of the system is further demonstrated by showing that it is possible to probe different Raman modes using CARS microscopy simply by changing a time delay between the excitation beams. Using optimally chirped pulses also enables further simplification of the laser system required by using a single fiber laser combined with nonlinear optical fibers to perform effective multimodal imaging. While these sources are useful for practical multimodal imaging, it is believed that for further improvements in CARS microscopy sensitivity, new excitation schemes are necessary. This has led to the design of a new, high power, extended cavity oscillator that should be capable of implementing new excitation schemes for CARS microscopy as well as other techniques. Our interest in multimodal imaging has led us to other areas of research as well. For example, a fiber-coupling scheme for signal collection in the forward direction is demonstrated that allows for fluorescence lifetime imaging

Upper Mantle Shear Wave Structure Beneath North America From Multi-mode Surface Wave Tomography

NASA Astrophysics Data System (ADS)

Yoshizawa, K.; Ekström, G.

2008-12-01

The upper mantle structure beneath the North American continent has been investigated from measurements of multi-mode phase speeds of Love and Rayleigh waves. To estimate fundamental-mode and higher-mode phase speeds of surface waves from a single seismogram at regional distances, we have employed a method of nonlinear waveform fitting based on a direct model-parameter search using the neighbourhood algorithm (Yoshizawa & Kennett, 2002). The method of the waveform analysis has been fully automated by employing empirical quantitative measures for evaluating the accuracy/reliability of estimated multi-mode phase dispersion curves, and thus it is helpful in processing the dramatically increasing numbers of seismic data from the latest regional networks such as USArray. As a first step toward modeling the regional anisotropic shear-wave velocity structure of the North American upper mantle with extended vertical resolution, we have applied the method to long-period three-component records of seismic stations in North America, which mostly comprise the GSN and US regional networks as well as the permanent and transportable USArray stations distributed by the IRIS DMC. Preliminary multi-mode phase-speed models show large-scale patterns of isotropic heterogeneity, such as a strong velocity contrast between the western and central/eastern United States, which are consistent with the recent global and regional models (e.g., Marone, et al. 2007; Nettles & Dziewonski, 2008). We will also discuss radial anisotropy of shear wave speed beneath North America from multi-mode dispersion measurements of Love and Rayleigh waves.

Exploring infrared neural stimulation with multimodal nonlinear imaging (Conference Presentation)

NASA Astrophysics Data System (ADS)

Adams, Wilson R.; Mahadevan-Jansen, Anita

2017-02-01

Infrared neural stimulation (INS) provides optical control of neural excitability using near to mid-infrared (mid-IR) light, which allows for spatially selective, artifact-free excitation without the introduction of exogenous agents or genetic modification. Although neural excitability is mediated by a transient temperature increase due to water absorption of IR energy, the molecular nature of IR excitability in neural tissue remains unknown. Current research suggests that transient changes in local tissue temperature give rise to a myriad of cellular responses that have been individually attributed to IR mediated excitability. To further elucidate the underlying biophysical mechanisms, we have begun work towards employing a novel multimodal nonlinear imaging platform to probe the molecular underpinnings of INS. Our imaging system performs coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS), two-photon excitation fluorescence (TPEF), second-harmonic generation (SHG) and thermal imaging into a single platform that allows for unprecedented co-registration of thermal and biochemical information in real-time. Here, we present our work leveraging CARS and SRS in acute thalamocortical brain slice preparations. We observe the evolution of lipid and protein-specific Raman bands during INS and electrically evoked activity in real-time. Combined with two-photon fluorescence and second harmonic generation, we offer insight to cellular metabolism and membrane dynamics during INS. Thermal imaging allows for the coregistration of acquired biochemical information with temperature information. Our work previews the versatility and capabilities of coherent Raman imaging combined with multiphoton imaging to observe biophysical phenomena for neuroscience applications.

A Quantitative and Combinatorial Approach to Non-Linear Meanings of Multiplication

ERIC Educational Resources Information Center

Tillema, Erik; Gatza, Andrew

2016-01-01

We provide a conceptual analysis of how combinatorics problems have the potential to support students to establish non-linear meanings of multiplication (NLMM). The problems we analyze we have used in a series of studies with 6th, 8th, and 10th grade students. We situate the analysis in prior work on students' quantitative and multiplicative…

Versatile quantitative phase imaging system applied to high-speed, low noise and multimodal imaging (Conference Presentation)

NASA Astrophysics Data System (ADS)

Federici, Antoine; Aknoun, Sherazade; Savatier, Julien; Wattellier, Benoit F.

2017-02-01

Quadriwave lateral shearing interferometry (QWLSI) is a well-established quantitative phase imaging (QPI) technique based on the analysis of interference patterns of four diffraction orders by an optical grating set in front of an array detector [1]. As a QPI modality, this is a non-invasive imaging technique which allow to measure the optical path difference (OPD) of semi-transparent samples. We present a system enabling QWLSI with high-performance sCMOS cameras [2] and apply it to perform high-speed imaging, low noise as well as multimodal imaging. This modified QWLSI system contains a versatile optomechanical device which images the optical grating near the detector plane. Such a device is coupled with any kind of camera by varying its magnification. In this paper, we study the use of a sCMOS Zyla5.5 camera from Andor along with our modified QWLSI system. We will present high-speed live cell imaging, up to 200Hz frame rate, in order to follow intracellular fast motions while measuring the quantitative phase information. The structural and density information extracted from the OPD signal is complementary to the specific and localized fluorescence signal [2]. In addition, QPI detects cells even when the fluorophore is not expressed. This is very useful to follow a protein expression with time. The 10 µm spatial pixel resolution of our modified QWLSI associated to the high sensitivity of the Zyla5.5 enabling to perform high quality fluorescence imaging, we have carried out multimodal imaging revealing fine structures cells, like actin filaments, merged with the morphological information of the phase. References [1]. P. Bon, G. Maucort, B. Wattellier, and S. Monneret, "Quadriwave lateral shearing interferometry for quantitative phase microscopy of living cells," Opt. Express, vol. 17, pp. 13080-13094, 2009. [2] P. Bon, S. Lécart, E. Fort and S. Lévêque-Fort, "Fast label-free cytoskeletal network imaging in living mammalian cells," Biophysical journal, 106

Joint sparse representation for robust multimodal biometrics recognition.

PubMed

Shekhar, Sumit; Patel, Vishal M; Nasrabadi, Nasser M; Chellappa, Rama

2014-01-01

Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle nonlinearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that the proposed method compares favorably with competing fusion-based methods.

Object recognition through a multi-mode fiber

NASA Astrophysics Data System (ADS)

Takagi, Ryosuke; Horisaki, Ryoichi; Tanida, Jun

2017-04-01

We present a method of recognizing an object through a multi-mode fiber. A number of speckle patterns transmitted through a multi-mode fiber are provided to a classifier based on machine learning. We experimentally demonstrated binary classification of face and non-face targets based on the method. The measurement process of the experimental setup was random and nonlinear because a multi-mode fiber is a typical strongly scattering medium and any reference light was not used in our setup. Comparisons between three supervised learning methods, support vector machine, adaptive boosting, and neural network, are also provided. All of those learning methods achieved high accuracy rates at about 90% for the classification. The approach presented here can realize a compact and smart optical sensor. It is practically useful for medical applications, such as endoscopy. Also our study indicated a promising utilization of artificial intelligence, which has rapidly progressed, for reducing optical and computational costs in optical sensing systems.

A simultaneous multimodal imaging system for tissue functional parameters

NASA Astrophysics Data System (ADS)

Ren, Wenqi; Zhang, Zhiwu; Wu, Qiang; Zhang, Shiwu; Xu, Ronald

2014-02-01

Simultaneous and quantitative assessment of skin functional characteristics in different modalities will facilitate diagnosis and therapy in many clinical applications such as wound healing. However, many existing clinical practices and multimodal imaging systems are subjective, qualitative, sequential for multimodal data collection, and need co-registration between different modalities. To overcome these limitations, we developed a multimodal imaging system for quantitative, non-invasive, and simultaneous imaging of cutaneous tissue oxygenation and blood perfusion parameters. The imaging system integrated multispectral and laser speckle imaging technologies into one experimental setup. A Labview interface was developed for equipment control, synchronization, and image acquisition. Advanced algorithms based on a wide gap second derivative reflectometry and laser speckle contrast analysis (LASCA) were developed for accurate reconstruction of tissue oxygenation and blood perfusion respectively. Quantitative calibration experiments and a new style of skinsimulating phantom were designed to verify the accuracy and reliability of the imaging system. The experimental results were compared with a Moor tissue oxygenation and perfusion monitor. For In vivo testing, a post-occlusion reactive hyperemia (PORH) procedure in human subject and an ongoing wound healing monitoring experiment using dorsal skinfold chamber models were conducted to validate the usability of our system for dynamic detection of oxygenation and perfusion parameters. In this study, we have not only setup an advanced multimodal imaging system for cutaneous tissue oxygenation and perfusion parameters but also elucidated its potential for wound healing assessment in clinical practice.

Tunable all-fiber dissipative-soliton laser with a multimode interference filter.

PubMed

Zhang, Lei; Hu, Jinmeng; Wang, Jianhua; Feng, Yan

2012-09-15

We report on a tunable all-fiber dissipative-soliton laser with a multimode interference filter that consists of a multimode fiber spliced between two single-mode fibers. By carefully selecting the fiber parameters, a filter with a central wavelength at 1032 nm and a bandwidth of 7.6 nm is constructed and used for spectral filtering in an all-normal-dispersion mode-locked ytterbium-doped fiber laser based on nonlinear polarization evolution. The laser delivers 31 mW of average output power with positively chirped 7 ps pulses. The repetition rate of the pulses is 15.3 MHz, and pulse energy is 2.1 nJ. Tunable dissipative-soliton over 12 nm is achieved by applying tension to the single-mode-multimode-single-mode filter.

Quantitative verification of ab initio self-consistent laser theory.

PubMed

Ge, Li; Tandy, Robert J; Stone, A D; Türeci, Hakan E

2008-10-13

We generalize and test the recent "ab initio" self-consistent (AISC) time-independent semiclassical laser theory. This self-consistent formalism generates all the stationary lasing properties in the multimode regime (frequencies, thresholds, internal and external fields, output power and emission pattern) from simple inputs: the dielectric function of the passive cavity, the atomic transition frequency, and the transverse relaxation time of the lasing transition.We find that the theory gives excellent quantitative agreement with full time-dependent simulations of the Maxwell-Bloch equations after it has been generalized to drop the slowly-varying envelope approximation. The theory is infinite order in the non-linear hole-burning interaction; the widely used third order approximation is shown to fail badly.

Pseudo-circulator implemented as a multimode fiber coupler

NASA Astrophysics Data System (ADS)

Bulota, F.; Bélanger, P.; Leduc, M.; Boudoux, C.; Godbout, N.

2016-03-01

We present a linear all-fiber device exhibiting the functionality of a circulator, albeit for multimode fibers. We define a pseudo-circulator as a linear three-port component that transfers most of a multimode light signal from Port 1 to Port 2, and from Port 2 to Port 3. Unlike a traditional circulator which depends on a nonlinear phenomenon to achieve a non-reciprocal behavior, our device is a linear component that seemingly breaks the principle of reciprocity by exploiting the variations of etendue of the multimode fibers in the coupler. The pseudo-circulator is implemented as a 2x2 asymmetric multimode fiber coupler, fabricated using the fusion-tapering technique. The coupler is asymmetric in its transverse fused section. The two multimode fibers differ in area, thus favoring the transfer of light from the smaller to the bigger fiber. The desired difference of area is obtained by tapering one of the fiber before the fusion process. Using this technique, we have successfully fabricated a pseudo-circulator surpassing in efficiency a 50/50 beam-splitter. In all the visible and near-IR spectrum, the transmission ratio exceeds 77% from Port 1 to Port 2, and 80% from Port 2 to Port 3. The excess loss is less than 0.5 dB, regardless of the entry port.

Radioactive Nanomaterials for Multimodality Imaging

PubMed Central

Chen, Daiqin; Dougherty, Casey A.; Yang, Dongzhi; Wu, Hongwei; Hong, Hao

2016-01-01

Nuclear imaging techniques, including primarily positron emission tomography (PET) and single-photon emission computed tomography (SPECT), can provide quantitative information for a biological event in vivo with ultra-high sensitivity, however, the comparatively low spatial resolution is their major limitation in clinical application. By convergence of nuclear imaging with other imaging modalities like computed tomography (CT), magnetic resonance imaging (MRI) and optical imaging, the hybrid imaging platforms can overcome the limitations from each individual imaging technique. Possessing versatile chemical linking ability and good cargo-loading capacity, radioactive nanomaterials can serve as ideal imaging contrast agents. In this review, we provide a brief overview about current state-of-the-art applications of radioactive nanomaterials in the circumstances of multimodality imaging. We present strategies for incorporation of radioisotope(s) into nanomaterials along with applications of radioactive nanomaterials in multimodal imaging. Advantages and limitations of radioactive nanomaterials for multimodal imaging applications are discussed. Finally, a future perspective of possible radioactive nanomaterial utilization is presented for improving diagnosis and patient management in a variety of diseases. PMID:27227167

Naming Block Structures: A Multimodal Approach

ERIC Educational Resources Information Center

Cohen, Lynn; Uhry, Joanna

2011-01-01

This study describes symbolic representation in block play in a culturally diverse suburban preschool classroom. Block play is "multimodal" and can allow children to experiment with materials to represent the world in many forms of literacy. Combined qualitative and quantitative data from seventy-seven block structures were collected and analyzed.…

Numerical modelling of multimode fibre-optic communication lines

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sidelnikov, O S; Fedoruk, M P; Sygletos, S

The results of numerical modelling of nonlinear propagation of an optical signal in multimode fibres with a small differential group delay are presented. It is found that the dependence of the error vector magnitude (EVM) on the differential group delay can be reduced by increasing the number of ADC samples per symbol in the numerical implementation of the differential group delay compensation algorithm in the receiver. The possibility of using multimode fibres with a small differential group delay for data transmission in modern digital communication systems is demonstrated. It is shown that with increasing number of modes the strong couplingmore » regime provides a lower EVM level than the weak coupling one. (fibre-optic communication lines)« less

Exploring the cellular and tissue uptake of nanomaterials in a range of biological samples using multimodal nonlinear optical microscopy

NASA Astrophysics Data System (ADS)

Johnston, Helinor J.; Mouras, Rabah; Brown, David M.; Elfick, Alistair; Stone, Vicki

2015-12-01

The uptake of nanomaterials (NMs) by cells is critical in determining their potential biological impact, whether beneficial or detrimental. Thus, investigation of NM internalization by cells is a common consideration in hazard and efficacy studies. There are currently a number of approaches that are routinely used to investigate NM-cell interactions, each of which have their own advantages and limitations. Ideally, imaging modalities used to investigate NM uptake by cells should not require the NM to be labelled (e.g. with fluorophores) to facilitate its detection. We present a multimodal imaging approach employing a combination of label-free microscopies that can be used to investigate NM-cell interactions. Coherent anti-Stokes Raman scattering microscopy was used in combination with either two-photon photoluminescence or four-wave mixing (FWM) to visualize the uptake of gold or titanium dioxide NMs respectively. Live and fixed cell imaging revealed that NMs were internalized by J774 macrophage and C3A hepatocyte cell lines (15-31 μg ml-1). Sprague Dawley rats were exposed to NMs (intratracheal instillation, 62 μg) and NMs were detected in blood and lung leucocytes, lung and liver tissue, demonstrating that NMs could translocate from the exposure site. Obtained data illustrate that multimodal nonlinear optical microscopy may help overcome current challenges in the assessment of NM cellular uptake and biodistribution. It is therefore a powerful tool that can be used to investigate unlabelled NM cellular and tissue uptake in three dimensions, requires minimal sample preparation, and is applicable to live and fixed cells.

Joint Sparse Representation for Robust Multimodal Biometrics Recognition

DTIC Science & Technology

2014-01-01

comprehensive multimodal dataset and a face database are described in section V. Finally, in section VI, we discuss the computational complexity of...fingerprint, iris, palmprint , hand geometry and voice from subjects of different age, gender and ethnicity as described in Table I. It is a...Taylor, “Constructing nonlinear discriminants from multiple data views,” Machine Learning and Knowl- edge Discovery in Databases , pp. 328–343, 2010

The Intersection of Multimodality and Critical Perspective: Multimodality as Subversion

ERIC Educational Resources Information Center

Huang, Shin-ying

2015-01-01

This study explores the relevance of multimodality to critical media literacy. It is based on the understanding that communication is intrinsically multimodal and multimodal communication is inherently social and ideological. By analysing two English-language learners' multimodal ensembles, the study reports on how multimodality contributes to a…

Quantitative real-time in vivo detection of magnetic nanoparticles by their nonlinear magnetization

NASA Astrophysics Data System (ADS)

Nikitin, M. P.; Torno, M.; Chen, H.; Rosengart, A.; Nikitin, P. I.

2008-04-01

A novel method of highly sensitive quantitative detection of magnetic nanoparticles (MP) in biological tissues and blood system has been realized and tested in real time in vivo experiments. The detection method is based on nonlinear magnetic properties of MP and the related device can record a very small relative variation of nonlinear magnetic susceptibility up to 10-8 at room temperature, providing sensitivity of several nanograms of MP in 0.1ml volume. Real-time quantitative in vivo measurements of dynamics of MP concentration in blood flow have been performed. A catheter that carried the blood flow of a rat passed through the measuring device. After an MP injection, the quantity of MP in the circulating blood was continuously recorded. The method has also been used to evaluate the MP distribution between rat's organs. Its sensitivity was compared with detection of the radioactive MP based on isotope of Fe59. The comparison of magnetic and radioactive signals in the rat's blood and organ samples demonstrated similar sensitivity for both methods. However, the proposed magnetic method is much more convenient as it is safe, less expensive, and provides real-time measurements in vivo. Moreover, the sensitivity of the method can be further improved by optimization of the device geometry.

Quantitative multi-modal MRI of the Hippocampus and cognitive ability in community-dwelling older subjects.

PubMed

Aribisala, Benjamin S; Royle, Natalie A; Maniega, Susana Muñoz; Valdés Hernández, Maria C; Murray, Catherine; Penke, Lars; Gow, Alan; Starr, John M; Bastin, Mark E; Deary, Ian J; Wardlaw, Joanna M

2014-04-01

Hippocampal structural integrity is commonly quantified using volumetric measurements derived from brain magnetic resonance imaging (MRI). Previously reported associations with cognitive decline have not been consistent. We investigate hippocampal integrity using quantitative MRI techniques and its association with cognitive abilities in older age. Participants from the Lothian Birth Cohort 1936 underwent brain MRI at mean age 73 years. Longitudinal relaxation time (T1), magnetization transfer ratio (MTR), fractional anisotropy (FA) and mean diffusivity (MD) were measured in the hippocampus. General factors of fluid-type intelligence (g), cognitive processing speed (speed) and memory were obtained at age 73 years, as well as childhood IQ test results at age 11 years. Amongst 565 older adults, multivariate linear regression showed that, after correcting for ICV, gender and age 11 IQ, larger left hippocampal volume was significantly associated with better memory ability (β = .11, p = .003), but not with speed or g. Using quantitative MRI and after correcting for multiple testing, higher T1 and MD were significantly associated with lower scores of g (β range = -.11 to -.14, p < .001), speed (β range = -.15 to -.20, p < .001) and memory (β range = -.10 to -.12, p < .001). Higher MTR and FA in the hippocampus were also significantly associated with higher scores of g (β range = .17 to .18, p < .0001) and speed (β range = .10 to .15, p < .0001), but not memory. Quantitative multi-modal MRI assessments were more sensitive at detecting cognition-hippocampal integrity associations than volumetric measurements, resulting in stronger associations between MRI biomarkers and age-related cognition changes. Copyright © 2014. Published by Elsevier Ltd.

Multimodal integration of anatomy and physiology classes: How instructors utilize multimodal teaching in their classrooms

NASA Astrophysics Data System (ADS)

McGraw, Gerald M., Jr.

Multimodality is the theory of communication as it applies to social and educational semiotics (making meaning through the use of multiple signs and symbols). The term multimodality describes a communication methodology that includes multiple textual, aural, and visual applications (modes) that are woven together to create what is referred to as an artifact. Multimodal teaching methodology attempts to create a deeper meaning to course content by activating the higher cognitive areas of the student's brain, creating a more sustained retention of the information (Murray, 2009). The introduction of multimodality educational methodologies as a means to more optimally engage students has been documented within educational literature. However, studies analyzing the distribution and penetration into basic sciences, more specifically anatomy and physiology, have not been forthcoming. This study used a quantitative survey design to determine the degree to which instructors integrated multimodality teaching practices into their course curricula. The instrument used for the study was designed by the researcher based on evidence found in the literature and sent to members of three associations/societies for anatomy and physiology instructors: the Human Anatomy and Physiology Society; the iTeach Anatomy & Physiology Collaborate; and the American Physiology Society. Respondents totaled 182 instructor members of two- and four-year, private and public higher learning colleges collected from the three organizations collectively with over 13,500 members in over 925 higher learning institutions nationwide. The study concluded that the expansion of multimodal methodologies into anatomy and physiology classrooms is at the beginning of the process and that there is ample opportunity for expansion. Instructors continue to use lecture as their primary means of interaction with students. Email is still the major form of out-of-class communication for full-time instructors. Instructors with

Analytical insight into "breathing" crack-induced acoustic nonlinearity with an application to quantitative evaluation of contact cracks.

PubMed

Wang, Kai; Liu, Menglong; Su, Zhongqing; Yuan, Shenfang; Fan, Zheng

2018-08-01

To characterize fatigue cracks, in the undersized stage in particular, preferably in a quantitative and precise manner, a two-dimensional (2D) analytical model is developed for interpreting the modulation mechanism of a "breathing" crack on guided ultrasonic waves (GUWs). In conjunction with a modal decomposition method and a variational principle-based algorithm, the model is capable of analytically depicting the propagating and evanescent waves induced owing to the interaction of probing GUWs with a "breathing" crack, and further extracting linear and nonlinear wave features (e.g., reflection, transmission, mode conversion and contact acoustic nonlinearity (CAN)). With the model, a quantitative correlation between CAN embodied in acquired GUWs and crack parameters (e.g., location and severity) is obtained, whereby a set of damage indices is proposed via which the severity of the crack can be evaluated quantitatively. The evaluation, in principle, does not entail a benchmarking process against baseline signals. As validation, the results obtained from the analytical model are compared with those from finite element simulation, showing good consistency. This has demonstrated accuracy of the developed analytical model in interpreting contact crack-induced CAN, and spotlighted its application to quantitative evaluation of fatigue damage. Copyright © 2018 Elsevier B.V. All rights reserved.

A Physics-driven Neural Networks-based Simulation System (PhyNNeSS) for multimodal interactive virtual environments involving nonlinear deformable objects

PubMed Central

De, Suvranu; Deo, Dhannanjay; Sankaranarayanan, Ganesh; Arikatla, Venkata S.

2012-01-01

Background While an update rate of 30 Hz is considered adequate for real time graphics, a much higher update rate of about 1 kHz is necessary for haptics. Physics-based modeling of deformable objects, especially when large nonlinear deformations and complex nonlinear material properties are involved, at these very high rates is one of the most challenging tasks in the development of real time simulation systems. While some specialized solutions exist, there is no general solution for arbitrary nonlinearities. Methods In this work we present PhyNNeSS - a Physics-driven Neural Networks-based Simulation System - to address this long-standing technical challenge. The first step is an off-line pre-computation step in which a database is generated by applying carefully prescribed displacements to each node of the finite element models of the deformable objects. In the next step, the data is condensed into a set of coefficients describing neurons of a Radial Basis Function network (RBFN). During real-time computation, these neural networks are used to reconstruct the deformation fields as well as the interaction forces. Results We present realistic simulation examples from interactive surgical simulation with real time force feedback. As an example, we have developed a deformable human stomach model and a Penrose-drain model used in the Fundamentals of Laparoscopic Surgery (FLS) training tool box. Conclusions A unique computational modeling system has been developed that is capable of simulating the response of nonlinear deformable objects in real time. The method distinguishes itself from previous efforts in that a systematic physics-based pre-computational step allows training of neural networks which may be used in real time simulations. We show, through careful error analysis, that the scheme is scalable, with the accuracy being controlled by the number of neurons used in the simulation. PhyNNeSS has been integrated into SoFMIS (Software Framework for Multimodal

Hyperspectral tomography based on multi-mode absorption spectroscopy (MUMAS)

NASA Astrophysics Data System (ADS)

Dai, Jinghang; O'Hagan, Seamus; Liu, Hecong; Cai, Weiwei; Ewart, Paul

2017-10-01

This paper demonstrates a hyperspectral tomographic technique that can recover the temperature and concentration field of gas flows based on multi-mode absorption spectroscopy (MUMAS). This method relies on the recently proposed concept of nonlinear tomography, which can take full advantage of the nonlinear dependency of MUMAS signals on temperature and enables 2D spatial resolution of MUMAS which is naturally a line-of-sight technique. The principles of MUMAS and nonlinear tomography, as well as the mathematical formulation of the inversion problem, are introduced. Proof-of-concept numerical demonstrations are presented using representative flame phantoms and assuming typical laser parameters. The results show that faithful reconstruction of temperature distribution is achievable when a signal-to-noise ratio of 20 is assumed. This method can potentially be extended to simultaneously reconstructing distributions of temperature and the concentration of multiple flame species.

Multimodal Interfaces: Literature Review of Ecological Interface Design, Multimodal Perception and Attention, and Intelligent Adaptive Multimodal Interfaces

DTIC Science & Technology

2010-05-01

Multimodal Interfaces Literature Review of Ecological Interface Design , Multimodal Perception and Attention, and Intelligent... Design , Multimodal Perception and Attention, and Intelligent Adaptive Multimodal Interfaces Wayne Giang, Sathya Santhakumaran, Ehsan Masnavi, Doug...Advanced Interface Design Laboratory, E2-1303N 200 University Avenue West Waterloo, Ontario Canada N2L 3G1 Contract Project Manager: Dr. Catherine

General Linewidth Formula for Steady-State Multimode Lasing in Arbitrary Cavities

NASA Astrophysics Data System (ADS)

Chong, Y. D.; Stone, A. Douglas

2012-08-01

A formula for the laser linewidth of arbitrary cavities in the multimode nonlinear regime is derived from a scattering analysis of the solutions to semiclassical laser theory. The theory generalizes previous treatments of the effects of gain and openness described by the Petermann factor. The linewidth is expressed using quantities based on the nonlinear scattering matrix, which can be computed from steady-state ab initio laser theory; unlike previous treatments, no passive cavity or phenomenological parameters are involved. We find that low cavity quality factor, combined with significant dielectric dispersion, can cause substantial deviations from the Shawlow-Townes-Petermann theory.

Students' Multimodal Construction of the Work-Energy Concept

NASA Astrophysics Data System (ADS)

Tang, Kok-Sing; Chee Tan, Seng; Yeo, Jennifer

2011-09-01

This article examines the role of multimodalities in representing the concept of work-energy by studying the collaborative discourse of a group of ninth-grade physics students engaging in an inquiry-based instruction. Theorising a scientific concept as a network of meaning relationships across semiotic modalities situated in human activity, this article analyses the students' interactions through their use of natural language, mathematical symbolism, depiction, and gestures, and examines the intertextual meanings made through the integration of these modalities. Results indicate that the thematic integration of multimodalities is both difficult and necessary for students in order to construct a scientific understanding that is congruent with the physics curriculum. More significantly, the difficulties in multimodal integration stem from the subtle differences in the categorical, quantitative, and spatial meanings of the work-energy concept whose contrasts are often not made explicit to the students. The implications of these analyses and findings for science teaching and educational research are discussed.

Integrable pair-transition-coupled nonlinear Schrödinger equations.

PubMed

Ling, Liming; Zhao, Li-Chen

2015-08-01

We study integrable coupled nonlinear Schrödinger equations with pair particle transition between components. Based on exact solutions of the coupled model with attractive or repulsive interaction, we predict that some new dynamics of nonlinear excitations can exist, such as the striking transition dynamics of breathers, new excitation patterns for rogue waves, topological kink excitations, and other new stable excitation structures. In particular, we find that nonlinear wave solutions of this coupled system can be written as a linear superposition of solutions for the simplest scalar nonlinear Schrödinger equation. Possibilities to observe them are discussed in a cigar-shaped Bose-Einstein condensate with two hyperfine states. The results would enrich our knowledge on nonlinear excitations in many coupled nonlinear systems with transition coupling effects, such as multimode nonlinear fibers, coupled waveguides, and a multicomponent Bose-Einstein condensate system.

Broadband Energy Harvester Using Non-linear Polymer Spring and Electromagnetic/Triboelectric Hybrid Mechanism

PubMed Central

Gupta, Rahul Kumar; Shi, Qiongfeng; Dhakar, Lokesh; Wang, Tao; Heng, Chun Huat; Lee, Chengkuo

2017-01-01

Over the years, several approaches have been devised to widen the operating bandwidth, but most of them can only be triggered at high accelerations. In this work, we investigate a broadband energy harvester based on combination of non-linear stiffening effect and multimodal energy harvesting to obtain high bandwidth over wide range of accelerations (0.1 g–2.0 g). In order to achieve broadband behavior, a polymer based spring exhibiting multimodal energy harvesting is used. Besides, non-linear stiffening effect is introduced by using mechanical stoppers. At low accelerations (<0.5 g), the nearby mode frequencies of polymer spring contribute to broadening characteristics, while proof mass engages with mechanical stoppers to introduce broadening by non-linear stiffening at higher accelerations. The electromagnetic mechanism is employed in this design to enhance its output at low accelerations when triboelectric output is negligible. Our device displays bandwidth of 40 Hz even at low acceleration of 0.1 g and it is increased up to 68 Hz at 2 g. When non-linear stiffening is used along with multimodal energy-harvesting, the obtained bandwidth increases from 23 Hz to 68 Hz with percentage increment of 295% at 1.8 g. Further, we have demonstrated the triboelectric output measured as acceleration sensing signals in terms of voltage and current sensitivity of 4.7 Vg−1 and 19.7 nAg−1, respectively. PMID:28120924

Broadband Energy Harvester Using Non-linear Polymer Spring and Electromagnetic/Triboelectric Hybrid Mechanism

NASA Astrophysics Data System (ADS)

Gupta, Rahul Kumar; Shi, Qiongfeng; Dhakar, Lokesh; Wang, Tao; Heng, Chun Huat; Lee, Chengkuo

2017-01-01

Over the years, several approaches have been devised to widen the operating bandwidth, but most of them can only be triggered at high accelerations. In this work, we investigate a broadband energy harvester based on combination of non-linear stiffening effect and multimodal energy harvesting to obtain high bandwidth over wide range of accelerations (0.1 g-2.0 g). In order to achieve broadband behavior, a polymer based spring exhibiting multimodal energy harvesting is used. Besides, non-linear stiffening effect is introduced by using mechanical stoppers. At low accelerations (<0.5 g), the nearby mode frequencies of polymer spring contribute to broadening characteristics, while proof mass engages with mechanical stoppers to introduce broadening by non-linear stiffening at higher accelerations. The electromagnetic mechanism is employed in this design to enhance its output at low accelerations when triboelectric output is negligible. Our device displays bandwidth of 40 Hz even at low acceleration of 0.1 g and it is increased up to 68 Hz at 2 g. When non-linear stiffening is used along with multimodal energy-harvesting, the obtained bandwidth increases from 23 Hz to 68 Hz with percentage increment of 295% at 1.8 g. Further, we have demonstrated the triboelectric output measured as acceleration sensing signals in terms of voltage and current sensitivity of 4.7 Vg-1 and 19.7 nAg-1, respectively.

A meta-classifier for detecting prostate cancer by quantitative integration of in vivo magnetic resonance spectroscopy and magnetic resonance imaging

NASA Astrophysics Data System (ADS)

Viswanath, Satish; Tiwari, Pallavi; Rosen, Mark; Madabhushi, Anant

2008-03-01

Recently, in vivo Magnetic Resonance Imaging (MRI) and Magnetic Resonance Spectroscopy (MRS) have emerged as promising new modalities to aid in prostate cancer (CaP) detection. MRI provides anatomic and structural information of the prostate while MRS provides functional data pertaining to biochemical concentrations of metabolites such as creatine, choline and citrate. We have previously presented a hierarchical clustering scheme for CaP detection on in vivo prostate MRS and have recently developed a computer-aided method for CaP detection on in vivo prostate MRI. In this paper we present a novel scheme to develop a meta-classifier to detect CaP in vivo via quantitative integration of multimodal prostate MRS and MRI by use of non-linear dimensionality reduction (NLDR) methods including spectral clustering and locally linear embedding (LLE). Quantitative integration of multimodal image data (MRI and PET) involves the concatenation of image intensities following image registration. However multimodal data integration is non-trivial when the individual modalities include spectral and image intensity data. We propose a data combination solution wherein we project the feature spaces (image intensities and spectral data) associated with each of the modalities into a lower dimensional embedding space via NLDR. NLDR methods preserve the relationships between the objects in the original high dimensional space when projecting them into the reduced low dimensional space. Since the original spectral and image intensity data are divorced from their original physical meaning in the reduced dimensional space, data at the same spatial location can be integrated by concatenating the respective embedding vectors. Unsupervised consensus clustering is then used to partition objects into different classes in the combined MRS and MRI embedding space. Quantitative results of our multimodal computer-aided diagnosis scheme on 16 sets of patient data obtained from the ACRIN trial, for which

A multimodal parallel architecture: A cognitive framework for multimodal interactions.

PubMed

Cohn, Neil

2016-01-01

Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

Vestibular system: the many facets of a multimodal sense.

PubMed

Angelaki, Dora E; Cullen, Kathleen E

2008-01-01

Elegant sensory structures in the inner ear have evolved to measure head motion. These vestibular receptors consist of highly conserved semicircular canals and otolith organs. Unlike other senses, vestibular information in the central nervous system becomes immediately multisensory and multimodal. There is no overt, readily recognizable conscious sensation from these organs, yet vestibular signals contribute to a surprising range of brain functions, from the most automatic reflexes to spatial perception and motor coordination. Critical to these diverse, multimodal functions are multiple computationally intriguing levels of processing. For example, the need for multisensory integration necessitates vestibular representations in multiple reference frames. Proprioceptive-vestibular interactions, coupled with corollary discharge of a motor plan, allow the brain to distinguish actively generated from passive head movements. Finally, nonlinear interactions between otolith and canal signals allow the vestibular system to function as an inertial sensor and contribute critically to both navigation and spatial orientation.

Correction for isotopic interferences between analyte and internal standard in quantitative mass spectrometry by a nonlinear calibration function.

PubMed

Rule, Geoffrey S; Clark, Zlatuse D; Yue, Bingfang; Rockwood, Alan L

2013-04-16

Stable isotope-labeled internal standards are of great utility in providing accurate quantitation in mass spectrometry (MS). An implicit assumption has been that there is no "cross talk" between signals of the internal standard and the target analyte. In some cases, however, naturally occurring isotopes of the analyte do contribute to the signal of the internal standard. This phenomenon becomes more pronounced for isotopically rich compounds, such as those containing sulfur, chlorine, or bromine, higher molecular weight compounds, and those at high analyte/internal standard concentration ratio. This can create nonlinear calibration behavior that may bias quantitative results. Here, we propose the use of a nonlinear but more accurate fitting of data for these situations that incorporates one or two constants determined experimentally for each analyte/internal standard combination and an adjustable calibration parameter. This fitting provides more accurate quantitation in MS-based assays where contributions from analyte to stable labeled internal standard signal exist. It can also correct for the reverse situation where an analyte is present in the internal standard as an impurity. The practical utility of this approach is described, and by using experimental data, the approach is compared to alternative fits.

Quantitative changes in human epithelial cancers and osteogenesis imperfecta disease detected using nonlinear multicontrast microscopy

NASA Astrophysics Data System (ADS)

Adur, Javier; Pelegati, Vitor B.; de Thomaz, Andre A.; D'Souza-Li, Lilia; Assunção, Maria do Carmo; Bottcher-Luiz, Fátima; Andrade, Liliana A. L. A.; Cesar, Carlos L.

2012-08-01

We show that combined multimodal nonlinear optical (NLO) microscopies, including two-photon excitation fluorescence, second-harmonic generation (SHG), third harmonic generation, and fluorescence lifetime imaging microscopy (FLIM) can be used to detect morphological and metabolic changes associated with stroma and epithelial transformation during the progression of cancer and osteogenesis imperfecta (OI) disease. NLO microscopes provide complementary information about tissue microstructure, showing distinctive patterns for different types of human breast cancer, mucinous ovarian tumors, and skin dermis of patients with OI. Using a set of scoring methods (anisotropy, correlation, uniformity, entropy, and lifetime components), we found significant differences in the content, distribution and organization of collagen fibrils in the stroma of breast and ovary as well as in the dermis of skin. We suggest that our results provide a framework for using NLO techniques as a clinical diagnostic tool for human cancer and OI. We further suggest that the SHG and FLIM metrics described could be applied to other connective or epithelial tissue disorders that are characterized by abnormal cells proliferation and collagen assembly.

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

PubMed Central

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance. PMID:22778600

Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization.

PubMed

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

[Spectral quantitative analysis by nonlinear partial least squares based on neural network internal model for flue gas of thermal power plant].

PubMed

Cao, Hui; Li, Yao-Jiang; Zhou, Yan; Wang, Yan-Xia

2014-11-01

To deal with nonlinear characteristics of spectra data for the thermal power plant flue, a nonlinear partial least square (PLS) analysis method with internal model based on neural network is adopted in the paper. The latent variables of the independent variables and the dependent variables are extracted by PLS regression firstly, and then they are used as the inputs and outputs of neural network respectively to build the nonlinear internal model by train process. For spectra data of flue gases of the thermal power plant, PLS, the nonlinear PLS with the internal model of back propagation neural network (BP-NPLS), the non-linear PLS with the internal model of radial basis function neural network (RBF-NPLS) and the nonlinear PLS with the internal model of adaptive fuzzy inference system (ANFIS-NPLS) are compared. The root mean square error of prediction (RMSEP) of sulfur dioxide of BP-NPLS, RBF-NPLS and ANFIS-NPLS are reduced by 16.96%, 16.60% and 19.55% than that of PLS, respectively. The RMSEP of nitric oxide of BP-NPLS, RBF-NPLS and ANFIS-NPLS are reduced by 8.60%, 8.47% and 10.09% than that of PLS, respectively. The RMSEP of nitrogen dioxide of BP-NPLS, RBF-NPLS and ANFIS-NPLS are reduced by 2.11%, 3.91% and 3.97% than that of PLS, respectively. Experimental results show that the nonlinear PLS is more suitable for the quantitative analysis of glue gas than PLS. Moreover, by using neural network function which can realize high approximation of nonlinear characteristics, the nonlinear partial least squares method with internal model mentioned in this paper have well predictive capabilities and robustness, and could deal with the limitations of nonlinear partial least squares method with other internal model such as polynomial and spline functions themselves under a certain extent. ANFIS-NPLS has the best performance with the internal model of adaptive fuzzy inference system having ability to learn more and reduce the residuals effectively. Hence, ANFIS-NPLS is an

Multimodal optical imaging database from tumour brain human tissue: endogenous fluorescence from glioma, metastasis and control tissues

NASA Astrophysics Data System (ADS)

Poulon, Fanny; Ibrahim, Ali; Zanello, Marc; Pallud, Johan; Varlet, Pascale; Malouki, Fatima; Abi Lahoud, Georges; Devaux, Bertrand; Abi Haidar, Darine

2017-02-01

Eliminating time-consuming process of conventional biopsy is a practical improvement, as well as increasing the accuracy of tissue diagnoses and patient comfort. We addressed these needs by developing a multimodal nonlinear endomicroscope that allows real-time optical biopsies during surgical procedure. It will provide immediate information for diagnostic use without removal of tissue and will assist the choice of the optimal surgical strategy. This instrument will combine several means of contrast: non-linear fluorescence, second harmonic generation signal, reflectance, fluorescence lifetime and spectral analysis. Multimodality is crucial for reliable and comprehensive analysis of tissue. Parallel to the instrumental development, we currently improve our understanding of the endogeneous fluorescence signal with the different modalities that will be implemented in the stated. This endeavor will allow to create a database on the optical signature of the diseased and control brain tissues. This proceeding will present the preliminary results of this database on three types of tissues: cortex, metastasis and glioblastoma.

FIBER AND INTEGRATED OPTICS: Efficiency of nonstationary transformation of the spatial coherence of pulsed laser radiation in a multimode optical fibre upon self-phase modulation

NASA Astrophysics Data System (ADS)

Kitsak, M. A.; Kitsak, A. I.

2007-08-01

The model scheme of the nonlinear mechanism of transformation (decreasing) of the spatial coherence of a pulsed laser field in an extended multimode optical fibre upon nonstationary interaction with the fibre core is theoretically analysed. The case is considered when the spatial statistics of input radiation is caused by phase fluctuations. The analytic expression is obtained which relates the number of spatially coherent radiation modes with the spatially energy parameters on the initial radiation and fibre parameters. The efficiency of decorrelation of radiation upon excitation of the thermal and electrostriction nonlinearities in the fibre is estimated. Experimental studies are performed which revealed the basic properties of the transformation of the spatial coherence of a laser beam in a multimode fibre. The experimental results are compared with the predictions of the model of radiation transfer proposed in the paper. It is found that the spatial decorrelation of a light beam in a silica multimode fibre is mainly restricted by stimulated Raman scattering.

Bound vector solitons and soliton complexes for the coupled nonlinear Schrödinger equations.

PubMed

Sun, Zhi-Yuan; Gao, Yi-Tian; Yu, Xin; Liu, Wen-Jun; Liu, Ying

2009-12-01

Dynamic features describing the collisions of the bound vector solitons and soliton complexes are investigated for the coupled nonlinear Schrödinger (CNLS) equations, which model the propagation of the multimode soliton pulses under some physical situations in nonlinear fiber optics. Equations of such type have also been seen in water waves and plasmas. By the appropriate choices of the arbitrary parameters for the multisoliton solutions derived through the Hirota bilinear method, the periodic structures along the propagation are classified according to the relative relations of the real wave numbers. Furthermore, parameters are shown to control the intensity distributions and interaction patterns for the bound vector solitons and soliton complexes. Transformations of the soliton types (shape changing with intensity redistribution) during the collisions of those stationary structures with the regular one soliton are discussed, in which a class of inelastic properties is involved. Discussions could be expected to be helpful in interpreting such structures in the multimode nonlinear fiber optics and equally applied to other systems governed by the CNLS equations, e.g., the plasma physics and Bose-Einstein condensates.

Decoupling nonclassical nonlinear behavior of elastic wave types

DOE PAGES

Remillieux, Marcel C.; Guyer, Robert A.; Payan, Cedric; ...

2016-03-01

In this Letter, the tensorial nature of the nonequilibrium dynamics in nonlinear mesoscopic elastic materials is evidenced via multimode resonance experiments. In these experiments the dynamic response, including the spatial variations of velocities and strains, is carefully monitored while the sample is vibrated in a purely longitudinal or a purely torsional mode. By analogy with the fact that such experiments can decouple the elements of the linear elastic tensor, we demonstrate that the parameters quantifying the nonequilibrium dynamics of the material differ substantially for a compressional wave and for a shear wave. As a result, this could lead to furthermore » understanding of the nonlinear mechanical phenomena that arise in natural systems as well as to the design and engineering of nonlinear acoustic metamaterials.« less

High bandwidth all-optical 3×3 switch based on multimode interference structures

NASA Astrophysics Data System (ADS)

Le, Duy-Tien; Truong, Cao-Dung; Le, Trung-Thanh

2017-03-01

A high bandwidth all-optical 3×3 switch based on general interference multimode interference (GI-MMI) structure is proposed in this study. Two 3×3 multimode interference couplers are cascaded to realize an all-optical switch operating at both wavelengths of 1550 nm and 1310 nm. Two nonlinear directional couplers at two outer-arms of the structure are used as all-optical phase shifters to achieve all switching states and to control the switching states. Analytical expressions for switching operation using the transfer matrix method are presented. The beam propagation method (BPM) is used to design and optimize the whole structure. The optimal design of the all-optical phase shifters and 3×3 MMI couplers are carried out to reduce the switching power and loss.

Multimode optical dermoscopy (SkinSpect) analysis for skin with melanocytic nevus

NASA Astrophysics Data System (ADS)

Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf; Kelly, Kristen M.; Maly, Tyler; Chave, Robert; Booth, Nicholas; Durkin, Anthony J.; Farkas, Daniel L.

2016-04-01

We have developed a multimode dermoscope (SkinSpect™) capable of illuminating human skin samples in-vivo with spectrally-programmable linearly-polarized light at 33 wavelengths between 468nm and 857 nm. Diffusely reflected photons are separated into collinear and cross-polarized image paths and images captured for each illumination wavelength. In vivo human skin nevi (N = 20) were evaluated with the multimode dermoscope and melanin and hemoglobin concentrations were compared with Spatially Modulated Quantitative Spectroscopy (SMoQS) measurements. Both systems show low correlation between their melanin and hemoglobin concentrations, demonstrating the ability of the SkinSpect™ to separate these molecular signatures and thus act as a biologically plausible device capable of early onset melanoma detection.

Nonlinear microscopy of collagen fibers

NASA Astrophysics Data System (ADS)

Strupler, M.; Pena, A.-M.; Hernest, M.; Tharaux, P.-L.; Fabre, A.; Marchal-Somme, J.; Crestani, B.; Débarre, D.; Martin, J.-L.; Beaurepaire, E.; Schanne-Klein, M.-C.

2007-02-01

We used intrinsic Second Harmonic Generation (SHG) by fibrillar collagen to visualize the three-dimensional architecture of collagen fibrosis at the micrometer scale using laser scanning nonlinear microscopy. We showed that SHG signals are highly specific to fibrillar collagen and provide a sensitive probe of the micrometer-scale structural organization of collagen in tissues. Moreover, recording simultaneously other nonlinear optical signals in a multimodal setup, we visualized the tissue morphology using Two-Photon Excited Fluorescence (2PEF) signals from endogenous chromophores such as NADH or elastin. We then compared different methods to determine accurate indexes of collagen fibrosis using nonlinear microscopy, given that most collagen fibrils are smaller than the microscope resolution and that second harmonic generation is a coherent process. In order to define a robust method to process our three-dimensional images, we either calculated the fraction of the images occupied by a significant SHG signal, or averaged SHG signal intensities. We showed that these scores provide an estimation of the extension of renal and pulmonary fibrosis in murine models, and that they clearly sort out the fibrotic mice.

Multimodal Image Alignment via Linear Mapping between Feature Modalities.

PubMed

Jiang, Yanyun; Zheng, Yuanjie; Hou, Sujuan; Chang, Yuchou; Gee, James

2017-01-01

We propose a novel landmark matching based method for aligning multimodal images, which is accomplished uniquely by resolving a linear mapping between different feature modalities. This linear mapping results in a new measurement on similarity of images captured from different modalities. In addition, our method simultaneously solves this linear mapping and the landmark correspondences by minimizing a convex quadratic function. Our method can estimate complex image relationship between different modalities and nonlinear nonrigid spatial transformations even in the presence of heavy noise, as shown in our experiments carried out by using a variety of image modalities.

Nonlinear laser scanning microscopy of human vocal folds.

PubMed

Miri, Amir K; Tripathy, Umakanta; Mongeau, Luc; Wiseman, Paul W

2012-02-01

The purpose of this work was to apply nonlinear laser scanning microscopy (NLSM) for visualizing the morphology of extracellular matrix proteins within human vocal folds. This technique may potentially assist clinicians in making rapid diagnoses of vocal fold tissue disease or damage. Microstructural characterization based on NLSM provides valuable information for better understanding molecular mechanisms and tissue structure. Experimental, ex vivo human vocal fold. A custom-built multimodal nonlinear laser scanning microscope was used to scan fibrillar proteins in three 4% formaldehyde-fixed cadaveric samples. Collagen and elastin, key extracellular matrix proteins in the vocal fold lamina propria, were imaged by two nonlinear microscopy modalities: second harmonic generation (SHG) and two-photon fluorescence (TPF), respectively. An experimental protocol was introduced to characterize the geometrical properties of the imaged fibrous proteins. NLSM revealed the biomorphology of the human vocal fold fibrous proteins. No photobleaching was observed for the incident laser power of ∼60 mW before the excitation objective. Types I and III fibrillar collagen were imaged without label in the tissue by intrinsic SHG. Imaging while rotating the incident laser light-polarization direction confirmed a helical shape for the collagen fibers. The amplitude, periodicity, and overall orientation were then computed for the helically distributed collagen network. The elastin network was simultaneously imaged via TPF and found to have a basket-like structure. In some regions, particularly close to the epithelium, colocalization of both extracellular matrix components were observed. A benchmark study is presented for quantitative real-time, ex vivo, NLSM imaging of the extracellular macromolecules in human vocal fold lamina propria. The results are promising for clinical applications. Copyright © 2011 The American Laryngological, Rhinological, and Otological Society, Inc.

Learning multimodal dictionaries.

PubMed

Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

2007-09-01

Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

Influence of region-of-interest designs on quantitative measurement of multimodal imaging of MR non-enhancing gliomas.

PubMed

Takano, Koji; Kinoshita, Manabu; Arita, Hideyuki; Okita, Yoshiko; Chiba, Yasuyoshi; Kagawa, Naoki; Watanabe, Yoshiyuki; Shimosegawa, Eku; Hatazawa, Jun; Hashimoto, Naoya; Fujimoto, Yasunori; Kishima, Haruhiko

2018-05-01

A number of studies have revealed the usefulness of multimodal imaging in gliomas. Although the results have been heavily affected by the method used for region of interest (ROI) design, the most discriminatory method for setting the ROI remains unclear. The aim of the present study was to determine the most suitable ROI design for 18 F-fluorodeoxyglucose (FDG) and 11 C-methionine (MET) positron emission tomography (PET), apparent diffusion coefficient (ADC), and fractional anisotropy (FA) obtained by diffusion tensor imaging (DTI) from the viewpoint of grades of non-enhancing gliomas. A total of 31 consecutive patients with newly diagnosed, histologically confirmed magnetic resonance (MR) non-enhancing gliomas who underwent FDG-PET, MET-PET and DTI were retrospectively investigated. Quantitative measurements were performed using four different ROIs; hotspot/tumor center and whole tumor, constructed in either two-dimensional (2D) or three-dimensional (3D). Histopathological grading of the tumor was considered as empirical truth and the quantitative measurements obtained from each ROI was correlated with the grade of the tumor. The most discriminating ROI for non-enhancing glioma grading was different according to the different imaging modalities. 2D-hotspot/center ROI was most discriminating for FDG-PET (P=0.087), ADC map (P=0.0083), and FA map (P=0.25), whereas 3D-whole tumor ROI was best for MET-PET (P=0.0050). In the majority of scenarios, 2D-ROIs performed better than 3D-ROIs. Results from the image analysis using FDG-PET, MET-PET, ADC and FA may be affected by ROI design and the most discriminating ROI for non-enhancing glioma grading was different according to the imaging modality.

Multi-Modalities Sensor Science

DTIC Science & Technology

2015-02-28

enhanced multi-mode sensor science. bio -sensing, cross-discipling, multi-physics, nano-technology sailing He +46-8790 8465 1 Final Report for SOARD Project...spectroscopy, nano-technology, biophotonics and multi-physics modeling to produce adaptable bio -nanostructure enhanced multi-mode sensor science. 1...adaptable bio -nanostructure enhanced multi-mode sensor science. The accomplishments includes 1) A General Method for Designing a Radome to Enhance

Quantitative thickness measurement of polarity-inverted piezoelectric thin-film layer by scanning nonlinear dielectric microscopy

NASA Astrophysics Data System (ADS)

Odagawa, Hiroyuki; Terada, Koshiro; Tanaka, Yohei; Nishikawa, Hiroaki; Yanagitani, Takahiko; Cho, Yasuo

2017-10-01

A quantitative measurement method for a polarity-inverted layer in ferroelectric or piezoelectric thin film is proposed. It is performed nondestructively by scanning nonlinear dielectric microscopy (SNDM). In SNDM, linear and nonlinear dielectric constants are measured using a probe that converts the variation of capacitance related to these constants into the variation of electrical oscillation frequency. In this paper, we describe a principle for determining the layer thickness and some calculation results of the output signal, which are related to the radius of the probe tip and the thickness of the inverted layer. Moreover, we derive an equation that represents the relationship between the output signal and the oscillation frequency of the probe and explain how to determine the thickness from the measured frequency. Experimental results in Sc-doped AlN piezoelectric thin films that have a polarity-inverted layer with a thickness of 1.5 µm fabricated by radio frequency magnetron sputtering showed a fairly good value of 1.38 µm for the thickness of the polarity-inverted layer.

Coexistence of collapse and stable spatiotemporal solitons in multimode fibers

NASA Astrophysics Data System (ADS)

Shtyrina, Olga V.; Fedoruk, Mikhail P.; Kivshar, Yuri S.; Turitsyn, Sergei K.

2018-01-01

We analyze spatiotemporal solitons in multimode optical fibers and demonstrate the existence of stable solitons, in a sharp contrast to earlier predictions of collapse of multidimensional solitons in three-dimensional media. We discuss the coexistence of blow-up solutions and collapse stabilization by a low-dimensional external potential in graded-index media, and also predict the existence of stable higher-order nonlinear waves such as dipole-mode spatiotemporal solitons. To support the main conclusions of our numerical studies we employ a variational approach and derive analytically the stability criterion for input powers for the collapse stabilization.

Multimode Directional Coupler

NASA Technical Reports Server (NTRS)

Simons, Rainee N. (Inventor); Wintucky, Edwin G. (Inventor)

2016-01-01

A multimode directional coupler is provided. In some embodiments, the multimode directional coupler is configured to receive a primary signal and a secondary signal at a first port of a primary waveguide. The primary signal is configured to propagate through the primary waveguide and be outputted at a second port of the primary waveguide. The multimode directional coupler also includes a secondary waveguide configured to couple the secondary signal from the primary waveguide with no coupling of the primary signal into the secondary waveguide. The secondary signal is configured to propagate through the secondary waveguide and be outputted from a port of the secondary waveguide.

A novel structure-based multimode QSAR method affords predictive models for phosphodiesterase inhibitors.

PubMed

Dong, Xialan; Ebalunode, Jerry O; Cho, Sung Jin; Zheng, Weifan

2010-02-22

Quantitative structure-activity relationship (QSAR) methods aim to build quantitatively predictive models for the discovery of new molecules. It has been widely used in medicinal chemistry for drug discovery. Many QSAR techniques have been developed since Hansch's seminal work, and more are still being developed. Motivated by Hopfinger's receptor-dependent QSAR (RD-QSAR) formalism and the Lukacova-Balaz scheme to treat multimode issues, we have initiated studies that focus on a structure-based multimode QSAR (SBMM QSAR) method, where the structure of the target protein is used in characterizing the ligand, and the multimode issue of ligand binding is systematically treated with a modified Lukacova-Balaz scheme. All ligand molecules are first docked to the target binding pocket to obtain a set of aligned ligand poses. A structure-based pharmacophore concept is adopted to characterize the binding pocket. Specifically, we represent the binding pocket as a geometric grid labeled by pharmacophoric features. Each pose of the ligand is also represented as a labeled grid, where each grid point is labeled according to the atom types of nearby ligand atoms. These labeled grids or three-dimensional (3D) maps (both the receptor map (R-map) and the ligand map (L-map)) are compared to each other to derive descriptors for each pose of the ligand, resulting in a multimode structure-activity relationship (SAR) table. Iterative partial least-squares (PLS) is employed to build the QSAR models. When we applied this method to analyze PDE-4 inhibitors, predictive models have been developed, obtaining models with excellent training correlation (r(2) = 0.65-0.66), as well as test correlation (R(2) = 0.64-0.65). A comparative analysis with 4 other QSAR techniques demonstrates that this new method affords better models, in terms of the prediction power for the test set.

Multimodal Learning Clubs

ERIC Educational Resources Information Center

Casey, Heather

2012-01-01

Multimodal learning clubs link principles of motivation and engagement with 21st century technological tools and texts to support content area learning. The author describes how a sixth grade health teacher and his class incorporated multimodal learning clubs into a unit of study on human body systems. The students worked collaboratively online…

Spatiotemporal mode-locking in multimode fiber lasers

NASA Astrophysics Data System (ADS)

Wright, Logan G.; Christodoulides, Demetrios N.; Wise, Frank W.

2017-10-01

A laser is based on the electromagnetic modes of its resonator, which provides the feedback required for oscillation. Enormous progress has been made toward controlling the interactions of longitudinal modes in lasers with a single transverse mode. For example, the field of ultrafast science has been built on lasers that lock many longitudinal modes together to form ultrashort light pulses. However, coherent superposition of longitudinal and transverse modes in a laser has received little attention. We show that modal and chromatic dispersions in fiber lasers can be counteracted by strong spatial and spectral filtering. This allows locking of multiple transverse and longitudinal modes to create ultrashort pulses with a variety of spatiotemporal profiles. Multimode fiber lasers thus open new directions in studies of nonlinear wave propagation and capabilities for applications.

Dynamics and control of a multimode laser: Reduction of space-dependent rate equations to a low-dimensional system.

PubMed

Pyragas, K; Lange, F; Letz, T; Parisi, J; Kittel, A

2001-01-01

We suggest a quantitatively correct procedure for reducing the spatial degrees of freedom of the space-dependent rate equations of a multimode laser that describe the dynamics of the population inversion of the active medium and the mode intensities of the standing waves in the laser cavity. The key idea of that reduction is to take advantage of the small value of the parameter that defines the ratio between the population inversion decay rate and the cavity decay rate. We generalize the reduction procedure for the case of an intracavity frequency doubled laser. Frequency conversion performed by an optically nonlinear crystal placed inside the laser cavity may cause a pronounced instability in the laser performance, leading to chaotic oscillations of the output intensity. Based on the reduced equations, we analyze the dynamical properties of the system as well as the problem of stabilizing the steady state. The numerical analysis is performed considering the specific system of a Nd:YAG (neodymium-doped yttrium aluminum garnet) laser with an intracavity KTP (potassium titanyl phosphate) crystal.

Construction of Multimodal Transport Information Platform

NASA Astrophysics Data System (ADS)

Wang, Ya; Cheng, Yu; Zhao, Zhi

2018-06-01

With the rapid development of economy, the volume of transportation in China is increasing, the opening process of the market is accelerating, the scale of enterprises is expanding, the service quality is being improved, and the container multimodal transport is developing continuously.The hardware infrastructure of container multimodal transport is improved obviously, but the network platform construction of multimodal transport is still insufficient.Taking Shandong region of China as an example, the present situation of container multimodal transport in Shandong area can no longer meet the requirement of rapid development of container, and the construction of network platform needs to be solved urgently. Therefore, this paper will briefly describe the conception of construction of multimodal transport network platform in Shandong area.In order to achieve the rapid development of multimodal transport.

Tinnitus Multimodal Imaging

DTIC Science & Technology

2014-10-01

1 AWARD NUMBER: W81XWH-13-1-0494 TITLE: Tinnitus Multimodal Imaging PRINCIPAL INVESTIGATOR...TYPE Annual 3. DATES COVERED 30 Sept 2013 – 29 Oct 2014 4. TITLE AND SUBTITLE 5a. CONTRACT NUMBER Tinnitus Multimodal Imaging...AVAILABILITY STATEMENT Approved for Public Release; Distribution Unlimited 13. SUPPLEMENTARY NOTES 14. ABSTRACT Tinnitus is a common auditory

Quantitative evaluation method for nonlinear characteristics of piezoelectric transducers under high stress with complex nonlinear elastic constant

NASA Astrophysics Data System (ADS)

Miyake, Susumu; Kasashima, Takashi; Yamazaki, Masato; Okimura, Yasuyuki; Nagata, Hajime; Hosaka, Hiroshi; Morita, Takeshi

2018-07-01

The high power properties of piezoelectric transducers were evaluated considering a complex nonlinear elastic constant. The piezoelectric LCR equivalent circuit with nonlinear circuit parameters was utilized to measure them. The deformed admittance curve of piezoelectric transducers was measured under a high stress and the complex nonlinear elastic constant was calculated by curve fitting. Transducers with various piezoelectric materials, Pb(Zr,Ti)O3, (K,Na)NbO3, and Ba(Zr,Ti)O3–(Ba,Ca)TiO3, were investigated by the proposed method. The measured complex nonlinear elastic constant strongly depends on the linear elastic and piezoelectric constants. This relationship indicates that piezoelectric high power properties can be controlled by modifying the linear elastic and piezoelectric constants.

Quantitative local analysis of nonlinear systems

NASA Astrophysics Data System (ADS)

Topcu, Ufuk

This thesis investigates quantitative methods for local robustness and performance analysis of nonlinear dynamical systems with polynomial vector fields. We propose measures to quantify systems' robustness against uncertainties in initial conditions (regions-of-attraction) and external disturbances (local reachability/gain analysis). S-procedure and sum-of-squares relaxations are used to translate Lyapunov-type characterizations to sum-of-squares optimization problems. These problems are typically bilinear/nonconvex (due to local analysis rather than global) and their size grows rapidly with state/uncertainty space dimension. Our approach is based on exploiting system theoretic interpretations of these optimization problems to reduce their complexity. We propose a methodology incorporating simulation data in formal proof construction enabling more reliable and efficient search for robustness and performance certificates compared to the direct use of general purpose solvers. This technique is adapted both to region-of-attraction and reachability analysis. We extend the analysis to uncertain systems by taking an intentionally simplistic and potentially conservative route, namely employing parameter-independent rather than parameter-dependent certificates. The conservatism is simply reduced by a branch-and-hound type refinement procedure. The main thrust of these methods is their suitability for parallel computing achieved by decomposing otherwise challenging problems into relatively tractable smaller ones. We demonstrate proposed methods on several small/medium size examples in each chapter and apply each method to a benchmark example with an uncertain short period pitch axis model of an aircraft. Additional practical issues leading to a more rigorous basis for the proposed methodology as well as promising further research topics are also addressed. We show that stability of linearized dynamics is not only necessary but also sufficient for the feasibility of the

Observation of Geometric Parametric Instability Induced by the Periodic Spatial Self-Imaging of Multimode Waves

NASA Astrophysics Data System (ADS)

Krupa, Katarzyna; Tonello, Alessandro; Barthélémy, Alain; Couderc, Vincent; Shalaby, Badr Mohamed; Bendahmane, Abdelkrim; Millot, Guy; Wabnitz, Stefan

2016-05-01

Spatiotemporal mode coupling in highly multimode physical systems permits new routes for exploring complex instabilities and forming coherent wave structures. We present here the first experimental demonstration of multiple geometric parametric instability sidebands, generated in the frequency domain through resonant space-time coupling, owing to the natural periodic spatial self-imaging of a multimode quasi-continuous-wave beam in a standard graded-index multimode fiber. The input beam was launched in the fiber by means of an amplified microchip laser emitting sub-ns pulses at 1064 nm. The experimentally observed frequency spacing among sidebands agrees well with analytical predictions and numerical simulations. The first-order peaks are located at the considerably large detuning of 123.5 THz from the pump. These results open the remarkable possibility to convert a near-infrared laser directly into a broad spectral range spanning visible and infrared wavelengths, by means of a single resonant parametric nonlinear effect occurring in the normal dispersion regime. As further evidence of our strong space-time coupling regime, we observed the striking effect that all of the different sideband peaks were carried by a well-defined and stable bell-shaped spatial profile.

Computational method for multi-modal microscopy based on transport of intensity equation

NASA Astrophysics Data System (ADS)

Li, Jiaji; Chen, Qian; Sun, Jiasong; Zhang, Jialin; Zuo, Chao

2017-02-01

In this paper, we develop the requisite theory to describe a hybrid virtual-physical multi-modal imaging system which yields quantitative phase, Zernike phase contrast, differential interference contrast (DIC), and light field moment imaging simultaneously based on transport of intensity equation(TIE). We then give the experimental demonstration of these ideas by time-lapse imaging of live HeLa cell mitosis. Experimental results verify that a tunable lens based TIE system, combined with the appropriate post-processing algorithm, can achieve a variety of promising imaging modalities in parallel with the quantitative phase images for the dynamic study of cellular processes.

Virtual Chironomia: A Multimodal Study of Verbal and Non-Verbal Communication in a Virtual World

ERIC Educational Resources Information Center

Verhulsdonck, Gustav

2010-01-01

This mixed methods study examined the various aspects of multimodal use of non-verbal communication in virtual worlds during dyadic negotiations. Quantitative analysis uncovered a treatment effect whereby people with more rhetorical certainty used more neutral non-verbal communication; whereas people that were rhetorically less certain used more…

Skill training in multimodal virtual environments.

PubMed

Gopher, Daniel

2012-01-01

Multimodal, immersive, virtual reality (VR) techniques open new perspectives for perceptual-motor skill trainers. They also introduce new risks and dangers. This paper describes the benefits and pitfalls of multimodal training and the cognitive building blocks of a multimodal, VR training simulators.

Multimodal computational microscopy based on transport of intensity equation

NASA Astrophysics Data System (ADS)

Li, Jiaji; Chen, Qian; Sun, Jiasong; Zhang, Jialin; Zuo, Chao

2016-12-01

Transport of intensity equation (TIE) is a powerful tool for phase retrieval and quantitative phase imaging, which requires intensity measurements only at axially closely spaced planes without a separate reference beam. It does not require coherent illumination and works well on conventional bright-field microscopes. The quantitative phase reconstructed by TIE gives valuable information that has been encoded in the complex wave field by passage through a sample of interest. Such information may provide tremendous flexibility to emulate various microscopy modalities computationally without requiring specialized hardware components. We develop a requisite theory to describe such a hybrid computational multimodal imaging system, which yields quantitative phase, Zernike phase contrast, differential interference contrast, and light field moment imaging, simultaneously. It makes the various observations for biomedical samples easy. Then we give the experimental demonstration of these ideas by time-lapse imaging of live HeLa cell mitosis. Experimental results verify that a tunable lens-based TIE system, combined with the appropriate postprocessing algorithm, can achieve a variety of promising imaging modalities in parallel with the quantitative phase images for the dynamic study of cellular processes.

Multimodal nonlinear optical imaging of obesity-induced liver steatosis and fibrosis

NASA Astrophysics Data System (ADS)

Lin, Jian; Lu, Fake; Zheng, Wei; Tai, Dean C. S.; Yu, Hanry; Sheppard, Colin; Huang, Zhiwei

2011-03-01

Liver steatosis/fibrosis represents the major conditions and symptoms for many liver diseases. Nonlinear optical microscopy has emerged as a powerful tool for label-free tissue imaging with high sensitivity and chemical specificity for several typical biochemical compounds. Three nonlinear microscopy imaging modalities are implemented on the sectioned tissues from diseased livers induced by high fat diet (HFD). Coherent anti-Stokes Raman scattering (CARS) imaging visualizes and quantifies the lipid droplets accumulated in the liver, Second harmonic generation (SHG) is used to map the distribution of aggregated collagen fibers, and two-photon excitation fluorescence (TPEF) reveals the morphology of hepatic cells based on the autofluorescence signals from NADH and flavins within the hepatocytes. Our results demonstrate that obesity induces liver steatosis in the beginning stage, which may progress into liver fibrosis with high risk. There is a certain correlation between liver steatosis and fibrosis. This study may provide new insights into the understanding of the mechanisms of steatosis/fibrosis transformations at the cellular and molecular levels.

Fast and Robust Registration of Multimodal Remote Sensing Images via Dense Orientated Gradient Feature

NASA Astrophysics Data System (ADS)

Ye, Y.

2017-09-01

This paper presents a fast and robust method for the registration of multimodal remote sensing data (e.g., optical, LiDAR, SAR and map). The proposed method is based on the hypothesis that structural similarity between images is preserved across different modalities. In the definition of the proposed method, we first develop a pixel-wise feature descriptor named Dense Orientated Gradient Histogram (DOGH), which can be computed effectively at every pixel and is robust to non-linear intensity differences between images. Then a fast similarity metric based on DOGH is built in frequency domain using the Fast Fourier Transform (FFT) technique. Finally, a template matching scheme is applied to detect tie points between images. Experimental results on different types of multimodal remote sensing images show that the proposed similarity metric has the superior matching performance and computational efficiency than the state-of-the-art methods. Moreover, based on the proposed similarity metric, we also design a fast and robust automatic registration system for multimodal images. This system has been evaluated using a pair of very large SAR and optical images (more than 20000 × 20000 pixels). Experimental results show that our system outperforms the two popular commercial software systems (i.e. ENVI and ERDAS) in both registration accuracy and computational efficiency.

Practical multimodal care for cancer cachexia.

PubMed

Maddocks, Matthew; Hopkinson, Jane; Conibear, John; Reeves, Annie; Shaw, Clare; Fearon, Ken C H

2016-12-01

Cancer cachexia is common and reduces function, treatment tolerability and quality of life. Given its multifaceted pathophysiology a multimodal approach to cachexia management is advocated for, but can be difficult to realise in practice. We use a case-based approach to highlight practical approaches to the multimodal management of cachexia for patients across the cancer trajectory. Four cases with lung cancer spanning surgical resection, radical chemoradiotherapy, palliative chemotherapy and no anticancer treatment are presented. We propose multimodal care approaches that incorporate nutritional support, exercise, and anti-inflammatory agents, on a background of personalized oncology care and family-centred education. Collectively, the cases reveal that multimodal care is part of everyone's remit, often focuses on supported self-management, and demands buy-in from the patient and their family. Once operationalized, multimodal care approaches can be tested pragmatically, including alongside emerging pharmacological cachexia treatments. We demonstrate that multimodal care for cancer cachexia can be achieved using simple treatments and without a dedicated team of specialists. The sharing of advice between health professionals can help build collective confidence and expertise, moving towards a position in which every team member feels they can contribute towards multimodal care.

Multimodal Career Education for Nursing Students.

ERIC Educational Resources Information Center

Southern, Stephen; Smith, Robert L.

A multimodal career education model entitled BEST IDEA was field tested as an approach to the problem of retaining skilled nurses in the work force. Using multimodal assessment and intervention strategies derived from the multimodal behavior therapy of Arnold Lazarus, researchers developed an individualized career development assessment and…

Locating the Semiotic Power of Multimodality

ERIC Educational Resources Information Center

Hull, Glynda A.; Nelson, Mark Evan

2005-01-01

This article reports research that attempts to characterize what is powerful about digital multimodal texts. Building from recent theoretical work on understanding the workings and implications of multimodal communication, the authors call for a continuing empirical investigation into the roles that digital multimodal texts play in real-world…

Double-clad photonic crystal fiber coupler for compact nonlinear optical microscopy imaging.

PubMed

Fu, Ling; Gu, Min

2006-05-15

A 1 x 2 double-clad photonic crystal fiber coupler is fabricated by the fused tapered method, showing a low excess loss of 1.1 dB and a splitting ratio of 97/3 over the entire visible and near-infrared wavelength range. In addition to the property of splitting the laser power, the double-clad feature of the coupler facilitates the separation of a near-infrared single-mode beam from a visible multimode beam, which is ideal for nonlinear optical microscopy imaging. In conjunction with a gradient-index lens, this coupler is used to construct a miniaturized microscope based on two-photon fluorescence and second-harmonic generation. Three-dimensional nonlinear optical images demonstrate potential applications of the coupler to compact all-fiber and nonlinear optical microscopy and endoscopy.

Integrated approach to multimodal media content analysis

NASA Astrophysics Data System (ADS)

Zhang, Tong; Kuo, C.-C. Jay

1999-12-01

In this work, we present a system for the automatic segmentation, indexing and retrieval of audiovisual data based on the combination of audio, visual and textural content analysis. The video stream is demultiplexed into audio, image and caption components. Then, a semantic segmentation of the audio signal based on audio content analysis is conducted, and each segment is indexed as one of the basic audio types. The image sequence is segmented into shots based on visual information analysis, and keyframes are extracted from each shot. Meanwhile, keywords are detected from the closed caption. Index tables are designed for both linear and non-linear access to the video. It is shown by experiments that the proposed methods for multimodal media content analysis are effective. And that the integrated framework achieves satisfactory results for video information filtering and retrieval.

Tinnitus Multimodal Imaging

DTIC Science & Technology

2015-10-01

AWARD NUMBER: W81XWH-13-1-0494 TITLE: Tinnitus Multimodal Imaging PRINCIPAL INVESTIGATOR: Steven Wan Cheung CONTRACTING ORGANIZATION...NUMBER W81XWH-13-1-0494 Tinnitus Multimodal Imaging 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) 5d. PROJECT NUMBER Steven W. Cheung...13. SUPPLEMENTARY NOTES 14. ABSTRACT Tinnitus is a common auditory perceptual disorder whose neural substrates are under intense debate. This project

Multimodality Data Integration in Epilepsy

PubMed Central

Muzik, Otto; Chugani, Diane C.; Zou, Guangyu; Hua, Jing; Lu, Yi; Lu, Shiyong; Asano, Eishi; Chugani, Harry T.

2007-01-01

An important goal of software development in the medical field is the design of methods which are able to integrate information obtained from various imaging and nonimaging modalities into a cohesive framework in order to understand the results of qualitatively different measurements in a larger context. Moreover, it is essential to assess the various features of the data quantitatively so that relationships in anatomical and functional domains between complementing modalities can be expressed mathematically. This paper presents a clinically feasible software environment for the quantitative assessment of the relationship among biochemical functions as assessed by PET imaging and electrophysiological parameters derived from intracranial EEG. Based on the developed software tools, quantitative results obtained from individual modalities can be merged into a data structure allowing a consistent framework for advanced data mining techniques and 3D visualization. Moreover, an effort was made to derive quantitative variables (such as the spatial proximity index, SPI) characterizing the relationship between complementing modalities on a more generic level as a prerequisite for efficient data mining strategies. We describe the implementation of this software environment in twelve children (mean age 5.2 ± 4.3 years) with medically intractable partial epilepsy who underwent both high-resolution structural MR and functional PET imaging. Our experiments demonstrate that our approach will lead to a better understanding of the mechanisms of epileptogenesis and might ultimately have an impact on treatment. Moreover, our software environment holds promise to be useful in many other neurological disorders, where integration of multimodality data is crucial for a better understanding of the underlying disease mechanisms. PMID:17710251

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

PubMed

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

PubMed Central

Yang, Yong; Tong, Song; Huang, Shuying; Lin, Pan

2014-01-01

Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT) based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT), the fast discrete curvelet transform (FDCT), and the dual tree complex wavelet transform (DTCWT) based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images. PMID:25214889

Enhanced EDX images by fusion of multimodal SEM images using pansharpening techniques.

PubMed

Franchi, G; Angulo, J; Moreaud, M; Sorbier, L

2018-01-01

The goal of this paper is to explore the potential interest of image fusion in the context of multimodal scanning electron microscope (SEM) imaging. In particular, we aim at merging the backscattered electron images that usually have a high spatial resolution but do not provide enough discriminative information to physically classify the nature of the sample, with energy-dispersive X-ray spectroscopy (EDX) images that have discriminative information but a lower spatial resolution. The produced images are named enhanced EDX. To achieve this goal, we have compared the results obtained with classical pansharpening techniques for image fusion with an original approach tailored for multimodal SEM fusion of information. Quantitative assessment is obtained by means of two SEM images and a simulated dataset produced by a software based on PENELOPE. © 2017 The Authors Journal of Microscopy © 2017 Royal Microscopical Society.

Multi-mode horn antenna simulation

NASA Technical Reports Server (NTRS)

Dod, L. R.; Wolf, J. D.

1980-01-01

Radiation patterns were computed for a circular multimode horn antenna using waveguide electric field radiation expressions. The circular multimode horn was considered as a possible reflector feed antenna for the Large Antenna Multifrequency Microwave Radiometer (LAMMR). This horn antenna uses a summation of the TE sub 11 deg and TM sub 11 deg modes to generate far field primary radiation patterns with equal E and H plane beamwidths and low sidelobes. A computer program for the radiation field expressions using the summation of waveguide radiation modes is described. The sensitivity of the multimode horn antenna radiation patterns to phase variations between the two modes is given. Sample radiation pattern calculations for a reflector feed horn for LAMMR are shown. The multimode horn antenna provides a low noise feed suitable for radiometric applications.

Enhancing image classification models with multi-modal biomarkers

NASA Astrophysics Data System (ADS)

Caban, Jesus J.; Liao, David; Yao, Jianhua; Mollura, Daniel J.; Gochuico, Bernadette; Yoo, Terry

2011-03-01

Currently, most computer-aided diagnosis (CAD) systems rely on image analysis and statistical models to diagnose, quantify, and monitor the progression of a particular disease. In general, CAD systems have proven to be effective at providing quantitative measurements and assisting physicians during the decision-making process. As the need for more flexible and effective CADs continues to grow, questions about how to enhance their accuracy have surged. In this paper, we show how statistical image models can be augmented with multi-modal physiological values to create more robust, stable, and accurate CAD systems. In particular, this paper demonstrates how highly correlated blood and EKG features can be treated as biomarkers and used to enhance image classification models designed to automatically score subjects with pulmonary fibrosis. In our results, a 3-5% improvement was observed when comparing the accuracy of CADs that use multi-modal biomarkers with those that only used image features. Our results show that lab values such as Erythrocyte Sedimentation Rate and Fibrinogen, as well as EKG measurements such as QRS and I:40, are statistically significant and can provide valuable insights about the severity of the pulmonary fibrosis disease.

Multi-Modality Phantom Development

DOE Office of Scientific and Technical Information (OSTI.GOV)

Huber, Jennifer S.; Peng, Qiyu; Moses, William W.

2009-03-20

Multi-modality imaging has an increasing role in the diagnosis and treatment of a large number of diseases, particularly if both functional and anatomical information are acquired and accurately co-registered. Hence, there is a resulting need for multi modality phantoms in order to validate image co-registration and calibrate the imaging systems. We present our PET-ultrasound phantom development, including PET and ultrasound images of a simple prostate phantom. We use agar and gelatin mixed with a radioactive solution. We also present our development of custom multi-modality phantoms that are compatible with PET, transrectal ultrasound (TRUS), MRI and CT imaging. We describe bothmore » our selection of tissue mimicking materials and phantom construction procedures. These custom PET-TRUS-CT-MRI prostate phantoms use agargelatin radioactive mixtures with additional contrast agents and preservatives. We show multi-modality images of these custom prostate phantoms, as well as discuss phantom construction alternatives. Although we are currently focused on prostate imaging, this phantom development is applicable to many multi-modality imaging applications.« less

Multimodal sequence learning.

PubMed

Kemény, Ferenc; Meier, Beat

2016-02-01

While sequence learning research models complex phenomena, previous studies have mostly focused on unimodal sequences. The goal of the current experiment is to put implicit sequence learning into a multimodal context: to test whether it can operate across different modalities. We used the Task Sequence Learning paradigm to test whether sequence learning varies across modalities, and whether participants are able to learn multimodal sequences. Our results show that implicit sequence learning is very similar regardless of the source modality. However, the presence of correlated task and response sequences was required for learning to take place. The experiment provides new evidence for implicit sequence learning of abstract conceptual representations. In general, the results suggest that correlated sequences are necessary for implicit sequence learning to occur. Moreover, they show that elements from different modalities can be automatically integrated into one unitary multimodal sequence. Copyright © 2015 Elsevier B.V. All rights reserved.

Time-dependent, multimode interaction analysis of the gyroklystron amplifier

DOE Office of Scientific and Technical Information (OSTI.GOV)

Swati, M. V., E-mail: swati.mv.ece10@iitbhu.ac.in; Chauhan, M. S.; Jain, P. K.

2016-08-15

In this paper, a time-dependent multimode nonlinear analysis for the gyroklystron amplifier has been developed by extending the analysis of gyrotron oscillators by employing the self-consistent approach. The nonlinear analysis developed here has been validated by taking into account the reported experimental results for a 32.3 GHz, three cavity, second harmonic gyroklystron operating in the TE{sub 02} mode. The analysis has been used to estimate the temporal RF growth in the operating mode as well as the nearby competing modes. Device gain and bandwidth have been computed for different drive powers and frequencies. The effect of various beam parameters, such asmore » beam voltage, beam current, and pitch factor, has also been studied. The computational results have estimated the gyroklystron saturated RF power ∼319 kW at 32.3 GHz with efficiency ∼23% and gain ∼26.3 dB with device bandwidth ∼0.027% (8 MHz) for a 70 kV, 20 A electron beam. The computed results are found to be in agreement with the experimental values within 10%.« less

From Inverse Problems in Mathematical Physiology to Quantitative Differential Diagnoses

PubMed Central

Zenker, Sven; Rubin, Jonathan; Clermont, Gilles

2007-01-01

The improved capacity to acquire quantitative data in a clinical setting has generally failed to improve outcomes in acutely ill patients, suggesting a need for advances in computer-supported data interpretation and decision making. In particular, the application of mathematical models of experimentally elucidated physiological mechanisms could augment the interpretation of quantitative, patient-specific information and help to better target therapy. Yet, such models are typically complex and nonlinear, a reality that often precludes the identification of unique parameters and states of the model that best represent available data. Hypothesizing that this non-uniqueness can convey useful information, we implemented a simplified simulation of a common differential diagnostic process (hypotension in an acute care setting), using a combination of a mathematical model of the cardiovascular system, a stochastic measurement model, and Bayesian inference techniques to quantify parameter and state uncertainty. The output of this procedure is a probability density function on the space of model parameters and initial conditions for a particular patient, based on prior population information together with patient-specific clinical observations. We show that multimodal posterior probability density functions arise naturally, even when unimodal and uninformative priors are used. The peaks of these densities correspond to clinically relevant differential diagnoses and can, in the simplified simulation setting, be constrained to a single diagnosis by assimilating additional observations from dynamical interventions (e.g., fluid challenge). We conclude that the ill-posedness of the inverse problem in quantitative physiology is not merely a technical obstacle, but rather reflects clinical reality and, when addressed adequately in the solution process, provides a novel link between mathematically described physiological knowledge and the clinical concept of differential diagnoses

Investigation of a Nonlinear Control System

NASA Technical Reports Server (NTRS)

Flugge-Lotz, I; Taylor, C F; Lindberg, H E

1958-01-01

A discontinuous variation of coefficients of the differential equation describing the linear control system before nonlinear elements are added is studied in detail. The nonlinear feedback is applied to a second-order system. Simulation techniques are used to study performance of the nonlinear control system and to compare it with the linear system for a wide variety of inputs. A detailed quantitative study of the influence of relay delays and of a transport delay is presented.

Measurement and fitting techniques for the assessment of material nonlinearity using nonlinear Rayleigh waves

DOE Office of Scientific and Technical Information (OSTI.GOV)

Torello, David; Kim, Jin-Yeon; Qu, Jianmin

2015-03-31

This research considers the effects of diffraction, attenuation, and the nonlinearity of generating sources on measurements of nonlinear ultrasonic Rayleigh wave propagation. A new theoretical framework for correcting measurements made with air-coupled and contact piezoelectric receivers for the aforementioned effects is provided based on analytical models and experimental considerations. A method for extracting the nonlinearity parameter β{sub 11} is proposed based on a nonlinear least squares curve-fitting algorithm that is tailored for Rayleigh wave measurements. Quantitative experiments are conducted to confirm the predictions for the nonlinearity of the piezoelectric source and to demonstrate the effectiveness of the curve-fitting procedure. Thesemore » experiments are conducted on aluminum 2024 and 7075 specimens and a β{sub 11}{sup 7075}/β{sub 11}{sup 2024} measure of 1.363 agrees well with previous literature and earlier work.« less

Multimodal Discourse Analysis of the Movie "Argo"

ERIC Educational Resources Information Center

Bo, Xu

2018-01-01

Based on multimodal discourse theory, this paper makes a multimodal discourse analysis of some shots in the movie "Argo" from the perspective of context of culture, context of situation and meaning of image. Results show that this movie constructs multimodal discourse through particular context, language and image, and successfully…

Rectified diode response of a multimode quantum cascade laser integrated terahertz transceiver.

PubMed

Dyer, Gregory C; Norquist, Christopher D; Cich, Michael J; Grine, Albert D; Fuller, Charles T; Reno, John L; Wanke, Michael C

2013-02-25

We characterized the DC transport response of a diode embedded in a THz quantum cascade laser as the laser current was changed. The overall response is described by parallel contributions from the rectification of the laser field due to the non-linearity of the diode I-V and from thermally activated transport. Sudden jumps in the diode response when the laser changes from single mode to multi-mode operation, with no corresponding jumps in output power, suggest that the coupling between the diode and laser field depends on the spatial distribution of internal fields. The results demonstrate conclusively that the internal laser field couples directly to the integrated diode.

Designing Multimodal Texts about the Middle Ages

ERIC Educational Resources Information Center

Insulander, Eva; Lindstrand, Fredrik; Selander, Staffan

2017-01-01

Multimedial and multimodal communication arouse interest in many fields of research today. By contrast, little attention is paid to multimodality in relation to designs for learning, especially in relation to representations of knowledge on an aggregated level. By analyzing three multimodal texts about the Middle Ages, including a textbook, a film…

Multimode fiber devices with single-mode performance

NASA Astrophysics Data System (ADS)

Leon-Saval, S. G.; Birks, T. A.; Bland-Hawthorn, J.; Englund, M.

2005-10-01

A taper transition can couple light between a multimode fiber and several single-mode fibers. If the number of single-mode fibers matches the number of spatial modes in the multimode fiber, the transition can have low loss in both directions. This enables the high performance of single-mode fiber devices to be attained in multimode fibers. We report an experimental proof of concept by using photonic crystal fiber techniques to make the transitions, demonstrating a multimode fiber filter with the transmission spectrum of a single-mode fiber grating.

Towards automated segmentation of cells and cell nuclei in nonlinear optical microscopy.

PubMed

Medyukhina, Anna; Meyer, Tobias; Schmitt, Michael; Romeike, Bernd F M; Dietzek, Benjamin; Popp, Jürgen

2012-11-01

Nonlinear optical (NLO) imaging techniques based e.g. on coherent anti-Stokes Raman scattering (CARS) or two photon excited fluorescence (TPEF) show great potential for biomedical imaging. In order to facilitate the diagnostic process based on NLO imaging, there is need for an automated calculation of quantitative values such as cell density, nucleus-to-cytoplasm ratio, average nuclear size. Extraction of these parameters is helpful for the histological assessment in general and specifically e.g. for the determination of tumor grades. This requires an accurate image segmentation and detection of locations and boundaries of cells and nuclei. Here we present an image processing approach for the detection of nuclei and cells in co-registered TPEF and CARS images. The algorithm developed utilizes the gray-scale information for the detection of the nuclei locations and the gradient information for the delineation of the nuclear and cellular boundaries. The approach reported is capable for an automated segmentation of cells and nuclei in multimodal TPEF-CARS images of human brain tumor samples. The results are important for the development of NLO microscopy into a clinically relevant diagnostic tool. Copyright © 2012 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation

PubMed Central

Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

2015-01-01

The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6–8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multimodality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement. PMID:25562829

Multimodal Diffuse Optical Imaging

NASA Astrophysics Data System (ADS)

Intes, Xavier; Venugopal, Vivek; Chen, Jin; Azar, Fred S.

Diffuse optical imaging, particularly diffuse optical tomography (DOT), is an emerging clinical modality capable of providing unique functional information, at a relatively low cost, and with nonionizing radiation. Multimodal diffuse optical imaging has enabled a synergistic combination of functional and anatomical information: the quality of DOT reconstructions has been significantly improved by incorporating the structural information derived by the combined anatomical modality. In this chapter, we will review the basic principles of diffuse optical imaging, including instrumentation and reconstruction algorithm design. We will also discuss the approaches for multimodal imaging strategies that integrate DOI with clinically established modalities. The merit of the multimodal imaging approaches is demonstrated in the context of optical mammography, but the techniques described herein can be translated to other clinical scenarios such as brain functional imaging or muscle functional imaging.

Microscopy with multimode fibers

NASA Astrophysics Data System (ADS)

Moser, Christophe; Papadopoulos, Ioannis; Farahi, Salma; Psaltis, Demetri

2013-04-01

Microscopes are usually thought of comprising imaging elements such as objectives and eye-piece lenses. A different type of microscope, used for endoscopy, consists of waveguiding elements such as fiber bundles, where each fiber in the bundle transports the light corresponding to one pixel in the image. Recently a new type of microscope has emerged that exploits the large number of propagating modes in a single multimode fiber. We have successfully produced fluorescence images of neural cells with sub-micrometer resolution via a 200 micrometer core multimode fiber. The method for achieving imaging consists of using digital phase conjugation to reproduce a focal spot at the tip of the multimode fiber. The image is formed by scanning the focal spot digitally and collecting the fluorescence point by point.

Nonlinear High-Energy Pulse Propagation in Graded-Index Multimode Optical Fibers for Mode-Locked Fiber Lasers

DTIC Science & Technology

2014-12-23

coupled for d = 2λ . Results are shown for the TE polarization , where the transverse electric field vector is pointing in the vertical direction in these...16, 42–44 (1991). 6. D. U. Noske, N. Pandit, and J. R. Taylor, “Subpicosecond soliton pulse formation from self-mode- locked erbium fibre laser using...High-Energy Pulse Propagation in Graded-Index Multimode Optical Fibers for Mode- Locked Fiber Lasers 5a. CONTRACT NUMBER 5b. GRANT NUMBER FA9550-12-1

Multimodal Hip Hop Productions as Media Literacies

ERIC Educational Resources Information Center

Turner, K. C. Nat

2012-01-01

This study draws on ethnographic data from a year-long multimodal media production (MMP) course and the experience of an African American female adolescent who used the production of multimodal Hip Hop texts to express her creativity and growing socially conscious view of the world. The study demonstrates how students made meaning multimodally and…

Time skewing and amplitude nonlinearity mitigation by feedback equalization for 56 Gbps VCSEL-based PAM-4 links

NASA Astrophysics Data System (ADS)

You, Yue; Zhang, Wenjia; Sun, Lin; Du, Jiangbing; Liang, Chenyu; Yang, Fan; He, Zuyuan

2018-03-01

The vertical cavity surface emitting laser (VCSEL)-based multimode optical transceivers enabled by pulse amplitude modulation (PAM)-4 will be commercialized in near future to meet the 400-Gbps standard short reach optical interconnects. It is still challenging to achieve over 56/112-Gbps with the multilevel signaling as the multimode property of the device and link would introduce the nonlinear temporal response for the different levels. In this work, we scrutinize the distortions that relates to the multilevel feature of PAM-4 modulation, and propose an effective feedback equalization scheme for 56-Gbps VCSEL-based PAM-4 optical interconnects system to mitigate the distortions caused by eye timing-skew and nonlinear power-dependent noise. Level redistribution at Tx side is theoretically modeled and constructed to achieve equivalent symbol error ratios (SERs) of four levels and improved BER performance. The cause of the eye skewing and the mitigation approach are also simulated at 100-Gbps and experimentally investigated at 56-Gbps. The results indicate more than 2-dB power penalty improvement has been achieved by using such a distortion aware equalizer.

Behavioral and Functional Assays for Investigating Mechanisms of Noxious Cold Detection and Multimodal Sensory Processing in Drosophila Larvae

PubMed Central

Patel, Atit A.; Cox, Daniel N.

2017-01-01

To investigate cellular, molecular and behavioral mechanisms of noxious cold detection, we developed cold plate behavioral assays and quantitative means for evaluating the predominant noxious cold-evoked contraction behavior. To characterize neural activity in response to noxious cold, we implemented a GCaMP6-based calcium imaging assay enabling in vivo studies of intracellular calcium dynamics in intact Drosophila larvae. We identified Drosophila class III multidendritic (md) sensory neurons as multimodal sensors of innocuous mechanical and noxious cold stimuli and to dissect the mechanistic bases of multimodal sensory processing we developed two independent functional assays. First, we developed an optogenetic dose response assay to assess whether levels of neural activation contributes to the multimodal aspects of cold sensitive sensory neurons. Second, we utilized CaMPARI, a photo-switchable calcium integrator that stably converts fluorescence from green to red in presence of high intracellular calcium and photo-converting light, to assess in vivo functional differences in neural activation levels between innocuous mechanical and noxious cold stimuli. These novel assays enable investigations of behavioral and functional roles of peripheral sensory neurons and multimodal sensory processing in Drosophila larvae. PMID:28835907

Mothers' multimodal information processing is modulated by multimodal interactions with their infants.

PubMed

Tanaka, Yukari; Fukushima, Hirokata; Okanoya, Kazuo; Myowa-Yamakoshi, Masako

2014-10-17

Social learning in infancy is known to be facilitated by multimodal (e.g., visual, tactile, and verbal) cues provided by caregivers. In parallel with infants' development, recent research has revealed that maternal neural activity is altered through interaction with infants, for instance, to be sensitive to infant-directed speech (IDS). The present study investigated the effect of mother- infant multimodal interaction on maternal neural activity. Event-related potentials (ERPs) of mothers were compared to non-mothers during perception of tactile-related words primed by tactile cues. Only mothers showed ERP modulation when tactile cues were incongruent with the subsequent words, and only when the words were delivered with IDS prosody. Furthermore, the frequency of mothers' use of those words was correlated with the magnitude of ERP differentiation between congruent and incongruent stimuli presentations. These results suggest that mother-infant daily interactions enhance multimodal integration of the maternal brain in parenting contexts.

Passive signal processing for a miniature Fabry-Perot interferometric sensor with a multimode laser-diode source

NASA Astrophysics Data System (ADS)

Ezbiri, A.; Tatam, R. P.

1995-09-01

A passive signal-processing technique for addressing a miniature low-finesse fiber Fabry-Perot interferometric sensor with a multimode laser diode is reported. Two modes of a multimode laser diode separated by 3 nm are used to obtain quadrature outputs from an \\similar 20 - mu m cavity. Wavelength-division demultiplexing combined with digital signal processing is used to recover the measurand-induced phase change. The technique is demonstrated for the measurement of vibration. The signal-to-noise ratio is \\similar 70 dB at 500 Hz for \\similar pi /2 rad displacement of the mirror, which results in a minimum detectable signal of \\similar 200 mu rad H z-1/2 . A quantitative discussion of miscalibration and systematic errors is presented.

Ultrafast nonlinear dynamics of thin gold films due to an intrinsic delayed nonlinearity

NASA Astrophysics Data System (ADS)

Bache, Morten; Lavrinenko, Andrei V.

2017-09-01

Using long-range surface plasmon polaritons light can propagate in metal nano-scale waveguides for ultracompact opto-electronic devices. Gold is an important material for plasmonic waveguides, but although its linear optical properties are fairly well understood, the nonlinear response is still under investigation. We consider the propagation of pulses in ultrathin gold strip waveguides, modeled by the nonlinear Schrödinger equation. The nonlinear response of gold is accounted for by the two-temperature model, revealing it as a delayed nonlinearity intrinsic in gold. The consequence is that the measured nonlinearities are strongly dependent on pulse duration. This issue has so far only been addressed phenomenologically, but we provide an accurate estimate of the quantitative connection as well as a phenomenological theory to understand the enhanced nonlinear response as the gold thickness is reduced. In comparison with previous works, the analytical model for the power-loss equation has been improved, and can be applied now to cases with a high laser peak power. We show new fits to experimental data from the literature and provide updated values for the real and imaginary parts of the nonlinear susceptibility of gold for various pulse durations and gold layer thicknesses. Our simulations show that the nonlinear loss is inhibiting efficient nonlinear interaction with low-power laser pulses. We therefore propose to design waveguides suitable for the mid-IR, where the ponderomotive instantaneous nonlinearity can dominate over the delayed hot-electron nonlinearity and provide a suitable plasmonics platform for efficient ultrafast nonlinear optics.

Mothers' multimodal information processing is modulated by multimodal interactions with their infants

PubMed Central

Tanaka, Yukari; Fukushima, Hirokata; Okanoya, Kazuo; Myowa-Yamakoshi, Masako

2014-01-01

Social learning in infancy is known to be facilitated by multimodal (e.g., visual, tactile, and verbal) cues provided by caregivers. In parallel with infants' development, recent research has revealed that maternal neural activity is altered through interaction with infants, for instance, to be sensitive to infant-directed speech (IDS). The present study investigated the effect of mother- infant multimodal interaction on maternal neural activity. Event-related potentials (ERPs) of mothers were compared to non-mothers during perception of tactile-related words primed by tactile cues. Only mothers showed ERP modulation when tactile cues were incongruent with the subsequent words, and only when the words were delivered with IDS prosody. Furthermore, the frequency of mothers' use of those words was correlated with the magnitude of ERP differentiation between congruent and incongruent stimuli presentations. These results suggest that mother-infant daily interactions enhance multimodal integration of the maternal brain in parenting contexts. PMID:25322936

Monitoring femtosecond laser microscopic photothermolysis with multimodal microscopy (Conference Presentation)

NASA Astrophysics Data System (ADS)

Huang, Yimei; Lui, Harvey; Zhao, Jianhua; McLean, David I.; Zeng, Haishan

2016-02-01

Photothermolysis induced by femtosecond (fs) lasers may be a promising modality in dermatology because of its advantages of high precision due to multiphoton absorption and deeper penetration due to the use of near infrared wavelengths. Although multiphoton absorption nonlinear effects are capable of precision targeting, the femtosecond laser photothermolysis could still have effects beyond the targeted area if a sufficiently high dose of laser light is used. Such unintended effects could be minimized by real time monitoring photothermolysis during the treatment. Targeted photothermolytic treatment of ex vivo mouse skin dermis was performed with tightly focused fs laser beams. Images of reflectance confocal microscopy (RCM), second harmonic generation (SHG), and two-photon fluorescence (TPF) of the mouse skins were obtained with integrated multimodal microscopy before, during, and after the laser treatment. The RCM, SHG, and TPF signal intensities of the treatment areas changed after high power femtosecond laser irradiation. The intensities of the RCM and SHG signals decreased when the tissue was damaged, while the intensity of the TPF signal increased when the photothermolysis was achieved. Moreover, the TPF signal was more susceptible to the degree of the photothermolysis than the RCM and SHG signals. The results suggested that multimodal microscopy is a potentially useful tool to monitor and assess the femtosecond laser treatment of the skin to achieve microscopic photothermolysis with high precision.

"Filming in Progress": New Spaces for Multimodal Designing

ERIC Educational Resources Information Center

Mills, Kathy A.

2010-01-01

Global trends call for new research to investigate multimodal designing mediated by new technologies and the implications for classroom spaces. This article addresses the relationship between new technologies, students' multimodal designing, and the social production of classroom spaces. Multimodal semiotics and sociological principles are applied…

Robust Multimodal Dictionary Learning

PubMed Central

Cao, Tian; Jojic, Vladimir; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

2014-01-01

We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and re-finements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration. PMID:24505674

Intra-operative label-free multimodal multiphoton imaging of breast cancer margins and microenvironment (Conference Presentation)

NASA Astrophysics Data System (ADS)

Sun, Yi; You, Sixian; Tu, Haohua; Spillman, Darold R.; Marjanovic, Marina; Chaney, Eric J.; Liu, George Z.; Ray, Partha S.; Higham, Anna; Boppart, Stephen A.

2017-02-01

Label-free multi-photon imaging has been a powerful tool for studying tissue microstructures and biochemical distributions, particularly for investigating tumors and their microenvironments. However, it remains challenging for traditional bench-top multi-photon microscope systems to conduct ex vivo tumor tissue imaging in the operating room due to their bulky setups and laser sources. In this study, we designed, built, and clinically demonstrated a portable multi-modal nonlinear label-free microscope system that combined four modalities, including two- and three- photon fluorescence for studying the distributions of FAD and NADH, and second and third harmonic generation, respectively, for collagen fiber structures and the distribution of micro-vesicles found in tumors and the microenvironment. Optical realignments and switching between modalities were motorized for more rapid and efficient imaging and for a light-tight enclosure, reducing ambient light noise to only 5% within the brightly lit operating room. Using up to 20 mW of laser power after a 20x objective, this system can acquire multi-modal sets of images over 600 μm × 600 μm at an acquisition rate of 60 seconds using galvo-mirror scanning. This portable microscope system was demonstrated in the operating room for imaging fresh, resected, unstained breast tissue specimens, and for assessing tumor margins and the tumor microenvironment. This real-time label-free nonlinear imaging system has the potential to uniquely characterize breast cancer margins and the microenvironment of tumors to intraoperatively identify structural, functional, and molecular changes that could indicate the aggressiveness of the tumor.

Multimode-singlemode-multimode fiber sensor for alcohol sensing application

NASA Astrophysics Data System (ADS)

Rofi'ah, Iftihatur; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol is volatile and flammable liquid which is soluble substances both on polar and non polar substances that has been used in some industrial sectors. Alcohol detection method now widely used one of them is the optical fiber sensor. In this paper used fiber optic sensor based on Multimode-Single-mode-Multimode (MSM) to detect alcohol solution at a concentration range of 0-3%. The working principle of sensor utilizes the modal interference between the core modes and the cladding modes, thus make the sensor sensitive to environmental changes. The result showed that characteristic of the sensor not affect the length of the single-mode fiber (SMF). We obtain that the sensor with a length of 5 mm of single-mode can sensing the alcohol with a sensitivity of 0.107 dB/v%.

Non-linear quantitative structure-activity relationship for adenine derivatives as competitive inhibitors of adenosine deaminase

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sadat Hayatshahi, Sayyed Hamed; Abdolmaleki, Parviz; Safarian, Shahrokh

2005-12-16

Logistic regression and artificial neural networks have been developed as two non-linear models to establish quantitative structure-activity relationships between structural descriptors and biochemical activity of adenosine based competitive inhibitors, toward adenosine deaminase. The training set included 24 compounds with known k {sub i} values. The models were trained to solve two-class problems. Unlike the previous work in which multiple linear regression was used, the highest of positive charge on the molecules was recognized to be in close relation with their inhibition activity, while the electric charge on atom N1 of adenosine was found to be a poor descriptor. Consequently, themore » previously developed equation was improved and the newly formed one could predict the class of 91.66% of compounds correctly. Also optimized 2-3-1 and 3-4-1 neural networks could increase this rate to 95.83%.« less

Programmable multimode quantum networks

PubMed Central

Armstrong, Seiji; Morizur, Jean-François; Janousek, Jiri; Hage, Boris; Treps, Nicolas; Lam, Ping Koy; Bachor, Hans-A.

2012-01-01

Entanglement between large numbers of quantum modes is the quintessential resource for future technologies such as the quantum internet. Conventionally, the generation of multimode entanglement in optics requires complex layouts of beamsplitters and phase shifters in order to transform the input modes into entangled modes. Here we report the highly versatile and efficient generation of various multimode entangled states with the ability to switch between different linear optics networks in real time. By defining our modes to be combinations of different spatial regions of one beam, we may use just one pair of multi-pixel detectors in order to measure multiple entangled modes. We programme virtual networks that are fully equivalent to the physical linear optics networks they are emulating. We present results for N=2 up to N=8 entangled modes here, including N=2, 3, 4 cluster states. Our approach introduces the highly sought after attributes of flexibility and scalability to multimode entanglement. PMID:22929783

Multimodal digital color imaging system for facial skin lesion analysis

NASA Astrophysics Data System (ADS)

Bae, Youngwoo; Lee, Youn-Heum; Jung, Byungjo

2008-02-01

In dermatology, various digital imaging modalities have been used as an important tool to quantitatively evaluate the treatment effect of skin lesions. Cross-polarization color image was used to evaluate skin chromophores (melanin and hemoglobin) information and parallel-polarization image to evaluate skin texture information. In addition, UV-A induced fluorescent image has been widely used to evaluate various skin conditions such as sebum, keratosis, sun damages, and vitiligo. In order to maximize the evaluation efficacy of various skin lesions, it is necessary to integrate various imaging modalities into an imaging system. In this study, we propose a multimodal digital color imaging system, which provides four different digital color images of standard color image, parallel and cross-polarization color image, and UV-A induced fluorescent color image. Herein, we describe the imaging system and present the examples of image analysis. By analyzing the color information and morphological features of facial skin lesions, we are able to comparably and simultaneously evaluate various skin lesions. In conclusion, we are sure that the multimodal color imaging system can be utilized as an important assistant tool in dermatology.

The analysis of non-linear dynamic behavior (including snap-through) of postbuckled plates by simple analytical solution

NASA Technical Reports Server (NTRS)

Ng, C. F.

1988-01-01

Static postbuckling and nonlinear dynamic analysis of plates are usually accomplished by multimode analyses, although the methods are complicated and do not give straightforward understanding of the nonlinear behavior. Assuming single-mode transverse displacement, a simple formula is derived for the transverse load displacement relationship of a plate under in-plane compression. The formula is used to derive a simple analytical expression for the static postbuckling displacement and nonlinear dynamic responses of postbuckled plates under sinusoidal or random excitation. Regions with softening and hardening spring behavior are identified. Also, the highly nonlinear motion of snap-through and its effects on the overall dynamic response can be easily interpreted using the single-mode formula. Theoretical results are compared with experimental results obtained using a buckled aluminum panel, using discrete frequency and broadband point excitation. Some important effects of the snap-through motion on the dynamic response of the postbuckled plates are found.

Nanoparticles in Higher-Order Multimodal Imaging

NASA Astrophysics Data System (ADS)

Rieffel, James Ki

Imaging procedures are a cornerstone in our current medical infrastructure. In everything from screening, diagnostics, and treatment, medical imaging is perhaps our greatest tool in evaluating individual health. Recently, there has been tremendous increase in the development of multimodal systems that combine the strengths of complimentary imaging technologies to overcome their independent weaknesses. Clinically, this has manifested in the virtually universal manufacture of combined PET-CT scanners. With this push toward more integrated imaging, new contrast agents with multimodal functionality are needed. Nanoparticle-based systems are ideal candidates based on their unique size, properties, and diversity. In chapter 1, an extensive background on recent multimodal imaging agents capable of enhancing signal or contrast in three or more modalities is presented. Chapter 2 discusses the development and characterization of a nanoparticulate probe with hexamodal imaging functionality. It is my hope that the information contained in this thesis will demonstrate the many benefits of nanoparticles in multimodal imaging, and provide insight into the potential of fully integrated imaging.

Towards an intelligent framework for multimodal affective data analysis.

PubMed

Poria, Soujanya; Cambria, Erik; Hussain, Amir; Huang, Guang-Bin

2015-03-01

An increasingly large amount of multimodal content is posted on social media websites such as YouTube and Facebook everyday. In order to cope with the growth of such so much multimodal data, there is an urgent need to develop an intelligent multi-modal analysis framework that can effectively extract information from multiple modalities. In this paper, we propose a novel multimodal information extraction agent, which infers and aggregates the semantic and affective information associated with user-generated multimodal data in contexts such as e-learning, e-health, automatic video content tagging and human-computer interaction. In particular, the developed intelligent agent adopts an ensemble feature extraction approach by exploiting the joint use of tri-modal (text, audio and video) features to enhance the multimodal information extraction process. In preliminary experiments using the eNTERFACE dataset, our proposed multi-modal system is shown to achieve an accuracy of 87.95%, outperforming the best state-of-the-art system by more than 10%, or in relative terms, a 56% reduction in error rate. Copyright © 2014 Elsevier Ltd. All rights reserved.

Survey of statewide multimodal transportation planning practices.

DOT National Transportation Integrated Search

2002-01-01

Multimodal planning refers to planning for different modes of transportation (e.g., automobile, bus, bicycles, pedestrian, aviation, rail, waterways) and the connections among them. This study identified states thought to excel in multimodal planning...

PEDOT:PSS/QCM-based multimodal humidity and pressure sensor

DOE Office of Scientific and Technical Information (OSTI.GOV)

Muckley, Eric S.; Lynch, James; Kumar, Rajeev

A room-temperature multimodal sensor composed of PEDOT:PSS deposited on an AT-cut quartz crystalmicrobalance (QCM) crystal has been fabricated. The nonlinear resistive and frequency sensor responses aredeconvolved using an articial neural network (ANN), which allows the single sensor to function simultane-ously as a relative humidity (RH) sensor and a pressure sensor using only two electrodes. We demonstratethat the predictive ability of the sensor is highly inuenced by the data used to train the ANN. When trainingsets are tailored to resemble the operating conditions of the sensor, the sensor achieves an average resolutionof < 3% RH from 0-100% RH, even after Hmore » 2O saturation occurs on the surface. Our results indicate thatANNs show strong promise for improving the resolution of low cost gas sensors and for expanding the rangeof environmental conditions in which a given sensor can operate.« less

PEDOT:PSS/QCM-based multimodal humidity and pressure sensor

DOE PAGES

Muckley, Eric S.; Lynch, James; Kumar, Rajeev; ...

2016-05-11

A room-temperature multimodal sensor composed of PEDOT:PSS deposited on an AT-cut quartz crystalmicrobalance (QCM) crystal has been fabricated. The nonlinear resistive and frequency sensor responses aredeconvolved using an articial neural network (ANN), which allows the single sensor to function simultane-ously as a relative humidity (RH) sensor and a pressure sensor using only two electrodes. We demonstratethat the predictive ability of the sensor is highly inuenced by the data used to train the ANN. When trainingsets are tailored to resemble the operating conditions of the sensor, the sensor achieves an average resolutionof < 3% RH from 0-100% RH, even after Hmore » 2O saturation occurs on the surface. Our results indicate thatANNs show strong promise for improving the resolution of low cost gas sensors and for expanding the rangeof environmental conditions in which a given sensor can operate.« less

Quantitative comparison of electron temperature fluctuations to nonlinear gyrokinetic simulations in C-Mod Ohmic L-mode discharges

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sung, C., E-mail: csung@physics.ucla.edu; White, A. E.; Greenwald, M.

2016-04-15

Long wavelength turbulent electron temperature fluctuations (k{sub y}ρ{sub s} < 0.3) are measured in the outer core region (r/a > 0.8) of Ohmic L-mode plasmas at Alcator C-Mod [E. S. Marmar et al., Nucl. Fusion 49, 104014 (2009)] with a correlation electron cyclotron emission diagnostic. The relative amplitude and frequency spectrum of the fluctuations are compared quantitatively with nonlinear gyrokinetic simulations using the GYRO code [J. Candy and R. E. Waltz, J. Comput. Phys. 186, 545 (2003)] in two different confinement regimes: linear Ohmic confinement (LOC) regime and saturated Ohmic confinement (SOC) regime. When comparing experiment with nonlinear simulations, it is found that local,more » electrostatic ion-scale simulations (k{sub y}ρ{sub s} ≲ 1.7) performed at r/a ∼ 0.85 reproduce the experimental ion heat flux levels, electron temperature fluctuation levels, and frequency spectra within experimental error bars. In contrast, the electron heat flux is robustly under-predicted and cannot be recovered by using scans of the simulation inputs within error bars or by using global simulations. If both the ion heat flux and the measured temperature fluctuations are attributed predominantly to long-wavelength turbulence, then under-prediction of electron heat flux strongly suggests that electron scale turbulence is important for transport in C-Mod Ohmic L-mode discharges. In addition, no evidence is found from linear or nonlinear simulations for a clear transition from trapped electron mode to ion temperature gradient turbulence across the LOC/SOC transition, and also there is no evidence in these Ohmic L-mode plasmas of the “Transport Shortfall” [C. Holland et al., Phys. Plasmas 16, 052301 (2009)].« less

Patient-tailored multimodal neuroimaging, visualization and quantification of human intra-cerebral hemorrhage

NASA Astrophysics Data System (ADS)

Goh, Sheng-Yang M.; Irimia, Andrei; Vespa, Paul M.; Van Horn, John D.

2016-03-01

In traumatic brain injury (TBI) and intracerebral hemorrhage (ICH), the heterogeneity of lesion sizes and types necessitates a variety of imaging modalities to acquire a comprehensive perspective on injury extent. Although it is advantageous to combine imaging modalities and to leverage their complementary benefits, there are difficulties in integrating information across imaging types. Thus, it is important that efforts be dedicated to the creation and sustained refinement of resources for multimodal data integration. Here, we propose a novel approach to the integration of neuroimaging data acquired from human patients with TBI/ICH using various modalities; we also demonstrate the integrated use of multimodal magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) data for TBI analysis based on both visual observations and quantitative metrics. 3D models of healthy-appearing tissues and TBIrelated pathology are generated, both of which are derived from multimodal imaging data. MRI volumes acquired using FLAIR, SWI, and T2 GRE are used to segment pathology. Healthy tissues are segmented using user-supervised tools, and results are visualized using a novel graphical approach called a `connectogram', where brain connectivity information is depicted within a circle of radially aligned elements. Inter-region connectivity and its strength are represented by links of variable opacities drawn between regions, where opacity reflects the percentage longitudinal change in brain connectivity density. Our method for integrating, analyzing and visualizing structural brain changes due to TBI and ICH can promote knowledge extraction and enhance the understanding of mechanisms underlying recovery.

On the influence of zero-padding on the nonlinear operations in Quantitative Susceptibility Mapping

PubMed Central

Eskreis-Winkler, Sarah; Zhou, Dong; Liu, Tian; Gupta, Ajay; Gauthier, Susan A.; Wang, Yi; Spincemaille, Pascal

2016-01-01

Purpose Zero padding is a well-studied interpolation technique that improves image visualization without increasing image resolution. This interpolation is often performed as a last step before images are displayed on clinical workstations. Here, we seek to demonstrate the importance of zero padding before rather than after performing non-linear post-processing algorithms, such as Quantitative Susceptibility Mapping (QSM). To do so, we evaluate apparent spatial resolution, relative error and depiction of multiple sclerosis (MS) lesions on images that were zero padded prior to, in the middle of, and after the application of the QSM algorithm. Materials and Methods High resolution gradient echo (GRE) data were acquired on twenty MS patients, from which low resolution data were derived using k-space cropping. Pre-, mid-, and post-zero padded QSM images were reconstructed from these low resolution data by zero padding prior to field mapping, after field mapping, and after susceptibility mapping, respectively. Using high resolution QSM as the gold standard, apparent spatial resolution, relative error, and image quality of the pre-, mid-, and post-zero padded QSM images were measured and compared. Results Both the accuracy and apparent spatial resolution of the pre-zero padded QSM was higher than that of mid-zero padded QSM (p < 0.001; p < 0.001), which was higher than that of post-zero padded QSM (p < 0.001; p < 0.001). The image quality of pre-zero padded reconstructions was higher than that of mid- and post-zero padded reconstructions (p = 0.004; p < 0.001). Conclusion Zero padding of the complex GRE data prior to nonlinear susceptibility mapping improves image accuracy and apparent resolution compared to zero padding afterwards. It also provides better delineation of MS lesion geometry, which may improve lesion subclassification and disease monitoring in MS patients. PMID:27587225

On the influence of zero-padding on the nonlinear operations in Quantitative Susceptibility Mapping.

PubMed

Eskreis-Winkler, Sarah; Zhou, Dong; Liu, Tian; Gupta, Ajay; Gauthier, Susan A; Wang, Yi; Spincemaille, Pascal

2017-01-01

Zero padding is a well-studied interpolation technique that improves image visualization without increasing image resolution. This interpolation is often performed as a last step before images are displayed on clinical workstations. Here, we seek to demonstrate the importance of zero padding before rather than after performing non-linear post-processing algorithms, such as Quantitative Susceptibility Mapping (QSM). To do so, we evaluate apparent spatial resolution, relative error and depiction of multiple sclerosis (MS) lesions on images that were zero padded prior to, in the middle of, and after the application of the QSM algorithm. High resolution gradient echo (GRE) data were acquired on twenty MS patients, from which low resolution data were derived using k-space cropping. Pre-, mid-, and post-zero padded QSM images were reconstructed from these low resolution data by zero padding prior to field mapping, after field mapping, and after susceptibility mapping, respectively. Using high resolution QSM as the gold standard, apparent spatial resolution, relative error, and image quality of the pre-, mid-, and post-zero padded QSM images were measured and compared. Both the accuracy and apparent spatial resolution of the pre-zero padded QSM was higher than that of mid-zero padded QSM (p<0.001; p<0.001), which was higher than that of post-zero padded QSM (p<0.001; p<0.001). The image quality of pre-zero padded reconstructions was higher than that of mid- and post-zero padded reconstructions (p=0.004; p<0.001). Zero padding of the complex GRE data prior to nonlinear susceptibility mapping improves image accuracy and apparent resolution compared to zero padding afterwards. It also provides better delineation of MS lesion geometry, which may improve lesion subclassification and disease monitoring in MS patients. Copyright © 2016 Elsevier Inc. All rights reserved.

Spatial nonlinearities: Cascading effects in the earth system

USGS Publications Warehouse

Peters, Debra P.C.; Pielke, R.A.; Bestelmeyer, B.T.; Allen, Craig D.; Munson-McGee, Stuart; Havstad, K. M.; Canadell, Josep G.; Pataki, Diane E.; Pitelka, Louis F.

2006-01-01

Nonlinear behavior is prevalent in all aspects of the Earth System, including ecological responses to global change (Gallagher and Appenzeller 1999; Steffen et al. 2004). Nonlinear behavior refers to a large, discontinuous change in response to a small change in a driving variable (Rial et al. 2004). In contrast to linear systems where responses are smooth, well-behaved, continuous functions, nonlinear systems often undergo sharp or discontinuous transitions resulting from the crossing of thresholds. These nonlinear responses can result in surprising behavior that makes forecasting difficult (Kaplan and Glass 1995). Given that many system dynamics are nonlinear, it is imperative that conceptual and quantitative tools be developed to increase our understanding of the processes leading to nonlinear behavior in order to determine if forecasting can be improved under future environmental changes (Clark et al. 2001).

Volterra series based blind equalization for nonlinear distortions in short reach optical CAP system

NASA Astrophysics Data System (ADS)

Tao, Li; Tan, Hui; Fang, Chonghua; Chi, Nan

2016-12-01

In this paper, we propose a blind Volterra series based nonlinear equalization (VNLE) with low complexity for the nonlinear distortion mitigation in short reach optical carrierless amplitude and phase (CAP) modulation system. The principle of the blind VNLE is presented and the performance of its blind adaptive algorithms including the modified cascaded multi-mode algorithm (MCMMA) and direct detection LMS (DD-LMS) are investigated experimentally. Compared to the conventional VNLE using training symbols before demodulation, it is performed after matched filtering and downsampling, so shorter memory length is required but similar performance improvement is observed. About 1 dB improvement is observed at BER of 3.8×10-3 for 40 Gb/s CAP32 signal over 40 km standard single mode fiber.

Nonlinear photoacoustic spectroscopy of hemoglobin.

PubMed

Danielli, Amos; Maslov, Konstantin; Favazza, Christopher P; Xia, Jun; Wang, Lihong V

2015-05-18

As light intensity increases in photoacoustic imaging, the saturation of optical absorption and the temperature dependence of the thermal expansion coefficient result in a measurable nonlinear dependence of the photoacoustic (PA) signal on the excitation pulse fluence. Here, under controlled conditions, we investigate the intensity-dependent photoacoustic signals from oxygenated and deoxygenated hemoglobin at varied optical wavelengths and molecular concentrations. The wavelength and concentration dependencies of the nonlinear PA spectrum are found to be significantly greater in oxygenated hemoglobin than in deoxygenated hemoglobin. These effects are further influenced by the hemoglobin concentration. These nonlinear phenomena provide insights into applications of photoacoustics, such as measurements of average inter-molecular distances on a nm scale or with a tuned selection of wavelengths, a more accurate quantitative PA tomography.

Molecular brain imaging in the multimodality era

PubMed Central

Price, Julie C

2012-01-01

Multimodality molecular brain imaging encompasses in vivo visualization, evaluation, and measurement of cellular/molecular processes. Instrumentation and software developments over the past 30 years have fueled advancements in multimodality imaging platforms that enable acquisition of multiple complementary imaging outcomes by either combined sequential or simultaneous acquisition. This article provides a general overview of multimodality neuroimaging in the context of positron emission tomography as a molecular imaging tool and magnetic resonance imaging as a structural and functional imaging tool. Several image examples are provided and general challenges are discussed to exemplify complementary features of the modalities, as well as important strengths and weaknesses of combined assessments. Alzheimer's disease is highlighted, as this clinical area has been strongly impacted by multimodality neuroimaging findings that have improved understanding of the natural history of disease progression, early disease detection, and informed therapy evaluation. PMID:22434068

Evidence base for multimodal therapy in cachexia.

PubMed

Solheim, Tora S; Laird, Barry J A

2012-12-01

The lack of success of unimodal treatment studies in cachexia and the growing awareness that multiple components are responsible for the development of cachexia have led to the view that cachexia intervention should include multimodal treatment. The aim of this article is to examine the evidence for multimodal treatment in the management of cancer cachexia. There are some studies involving multimodal treatment that indicate significant effects on cachexia outcomes. There are, however, no randomized controlled trials to date that incorporate fully a structured exercise program, nutrition, good symptom treatment as well as drug treatment, to counteract the effects of altered metabolism. The effectiveness of any drug intervention for cancer cachexia probably will only be maximized if incorporated into multimodal treatment. Further, cachexia treatment trials should also aim to include patients at an early phase in their cachexia trajectory and use validated outcome measures.

Design Options for Multimodal Web Applications

NASA Astrophysics Data System (ADS)

Stanciulescu, Adrian; Vanderdonckt, Jean

The capabilities of multimodal applications running on the web are well de-lineated since they are mainly constrained by what their underlying standard mark up language offers, as opposed to hand-made multimodal applications. As the experience in developing such multimodal web applications is growing, the need arises to identify and define major design options of such application to pave the way to a structured development life cycle. This paper provides a design space of independent design options for multimodal web applications based on three types of modalities: graphical, vocal, tactile, and combined. On the one hand, these design options may provide designers with some explicit guidance on what to decide or not for their future user interface, while exploring various design alternatives. On the other hand, these design options have been implemented as graph transformations per-formed on a user interface model represented as a graph. Thanks to a transformation engine, it allows designers to play with the different values of each design option, to preview the results of the transformation, and to obtain the corresponding code on-demand

Application of a multicompartment dynamical model to multimodal optical imaging for investigating individual cerebrovascular properties

NASA Astrophysics Data System (ADS)

Desjardins, Michèle; Gagnon, Louis; Gauthier, Claudine; Hoge, Rick D.; Dehaes, Mathieu; Desjardins-Crépeau, Laurence; Bherer, Louis; Lesage, Frédéric

2009-02-01

Biophysical models of hemodynamics provide a tool for quantitative multimodal brain imaging by allowing a deeper understanding of the interplay between neural activity and blood oxygenation, volume and flow responses to stimuli. Multicompartment dynamical models that describe the dynamics and interactions of the vascular and metabolic components of evoked hemodynamic responses have been developed in the literature. In this work, multimodal data using near-infrared spectroscopy (NIRS) and diffuse correlation flowmetry (DCF) is used to estimate total baseline hemoglobin concentration (HBT0) in 7 adult subjects. A validation of the model estimate and investigation of the partial volume effect is done by comparing with time-resolved spectroscopy (TRS) measures of absolute HBT0. Simultaneous NIRS and DCF measurements during hypercapnia are then performed, but are found to be hardly reproducible. The results raise questions about the feasibility of an all-optical model-based estimation of individual vascular properties.

The Role of Multimodal Analgesia in Spine Surgery.

PubMed

Kurd, Mark F; Kreitz, Tyler; Schroeder, Gregory; Vaccaro, Alexander R

2017-04-01

Optimal postoperative pain control allows for faster recovery, reduced complications, and improved patient satisfaction. Historically, pain management after spine surgery relied heavily on opioid medications. Multimodal regimens were developed to reduce opioid consumption and associated adverse effects. Multimodal approaches used in orthopaedic surgery of the lower extremity, especially joint arthroplasty, have been well described and studies have shown reduced opioid consumption, improved pain and function, and decreased length of stay. A growing body of evidence supports multimodal analgesia in spine surgery. Methods include the use of preemptive analgesia, NSAIDs, the neuromodulatory agents gabapentin and pregabalin, acetaminophen, and extended-action local anesthesia. The development of a standard approach to multimodal analgesia in spine surgery requires extensive assessment of the literature. Because a substantial number of spine surgeries are performed annually, a standardized approach to multimodal analgesia may provide considerable benefits, particularly in the context of the increased emphasis on accountability within the healthcare system.

Visual influence on path integration in darkness indicates a multimodal representation of large-scale space

PubMed Central

Tcheang, Lili; Bülthoff, Heinrich H.; Burgess, Neil

2011-01-01

Our ability to return to the start of a route recently performed in darkness is thought to reflect path integration of motion-related information. Here we provide evidence that motion-related interoceptive representations (proprioceptive, vestibular, and motor efference copy) combine with visual representations to form a single multimodal representation guiding navigation. We used immersive virtual reality to decouple visual input from motion-related interoception by manipulating the rotation or translation gain of the visual projection. First, participants walked an outbound path with both visual and interoceptive input, and returned to the start in darkness, demonstrating the influences of both visual and interoceptive information in a virtual reality environment. Next, participants adapted to visual rotation gains in the virtual environment, and then performed the path integration task entirely in darkness. Our findings were accurately predicted by a quantitative model in which visual and interoceptive inputs combine into a single multimodal representation guiding navigation, and are incompatible with a model of separate visual and interoceptive influences on action (in which path integration in darkness must rely solely on interoceptive representations). Overall, our findings suggest that a combined multimodal representation guides large-scale navigation, consistent with a role for visual imagery or a cognitive map. PMID:21199934

Joint Sparse Representation for Robust Multimodal Biometrics Recognition

DTIC Science & Technology

2012-01-01

described in III. Experimental evaluations on a comprehensive multimodal dataset and a face database have been described in section V. Finally, in...WVU Multimodal Dataset The WVU multimodal dataset is a comprehensive collection of different biometric modalities such as fingerprint, iris, palmprint ...Martnez and R. Benavente, “The AR face database ,” CVC Technical Report, June 1998. [29] U. Park and A. Jain, “Face matching and retrieval using soft

Multimodal Trip Planner System final evaluation report.

DOT National Transportation Integrated Search

2011-05-01

This evaluation of the Multimodal Trip Planning System (MMTPS) is the culmination of a multi-year project evaluating the development and deployment of a multimodal trip planner in the Chicagoland area between 2004 and 2010. The report includes an ove...

Nonlinear ultrasonics for material state awareness

NASA Astrophysics Data System (ADS)

Jacobs, L. J.

2014-02-01

Predictive health monitoring of structural components will require the development of advanced sensing techniques capable of providing quantitative information on the damage state of structural materials. By focusing on nonlinear acoustic techniques, it is possible to measure absolute, strength based material parameters that can then be coupled with uncertainty models to enable accurate and quantitative life prediction. Starting at the material level, this review will present current research that involves a combination of sensing techniques and physics-based models to characterize damage in metallic materials. In metals, these nonlinear ultrasonic measurements can sense material state, before the formation of micro- and macro-cracks. Typically, cracks of a measurable size appear quite late in a component's total life, while the material's integrity in terms of toughness and strength gradually decreases due to the microplasticity (dislocations) and associated change in the material's microstructure. This review focuses on second harmonic generation techniques. Since these nonlinear acoustic techniques are acoustic wave based, component interrogation can be performed with bulk, surface and guided waves using the same underlying material physics; these nonlinear ultrasonic techniques provide results which are independent of the wave type used. Recent physics-based models consider the evolution of damage due to dislocations, slip bands, interstitials, and precipitates in the lattice structure, which can lead to localized damage.

Label-free hyperspectral nonlinear optical microscopy of the biofuel micro-algae Haematococcus Pluvialis

PubMed Central

Barlow, Aaron M.; Slepkov, Aaron D.; Ridsdale, Andrew; McGinn, Patrick J.; Stolow, Albert

2014-01-01

We consider multi-modal four-wave mixing microscopies to be ideal tools for the in vivo study of carotenoid distributions within the important biofuel microalgae Haematococcus pluvialis. We show that hyperspectral coherent anti-Stokes Raman scattering (CARS) microscopy generates non-invasive, quantitative real-time concentrations maps of intracellular carotenoid distributions in live algae. PMID:25360358

Detecting scaling in the period dynamics of multimodal signals: Application to Parkinsonian tremor

NASA Astrophysics Data System (ADS)

Sapir, Nir; Karasik, Roman; Havlin, Shlomo; Simon, Ely; Hausdorff, Jeffrey M.

2003-03-01

Patients with Parkinson’s disease exhibit tremor, involuntary movement of the limbs. The frequency spectrum of tremor typically has broad peaks at “harmonic” frequencies, much like that seen in other physical processes. In general, this type of harmonic structure in the frequency domain may be due to two possible mechanisms: a nonlinear oscillation or a superposition of (multiple) independent modes of oscillation. A broad peak spectrum generally indicates that a signal is semiperiodic with a fluctuating period. These fluctuations may posses intrinsic order that can be quantified using scaling analysis. We propose a method to extract the correlation (scaling) properties in the period dynamics of multimodal oscillations, in order to distinguish between a nonlinear oscillation and a superposition of individual modes of oscillation. The method is based on our finding that the information content of the temporal correlations in a fluctuating period of a single oscillator is contained in a finite frequency band in the power spectrum, allowing for decomposition of modes by bandpass filtering. Our simulations for a nonlinear oscillation show that harmonic modes possess the same scaling properties. In contrast, when the method is applied to tremor records from patients with Parkinson’s disease, the first two modes of oscillations yield different scaling patterns, suggesting that these modes may not be simple harmonics, as might be initially assumed.

Linear and Non-Linear Optical Imaging of Cancer Cells with Silicon Nanoparticles

PubMed Central

Tolstik, Elen; Osminkina, Liubov A.; Akimov, Denis; Gongalsky, Maksim B.; Kudryavtsev, Andrew A.; Timoshenko, Victor Yu.; Heintzmann, Rainer; Sivakov, Vladimir; Popp, Jürgen

2016-01-01

New approaches for visualisation of silicon nanoparticles (SiNPs) in cancer cells are realised by means of the linear and nonlinear optics in vitro. Aqueous colloidal solutions of SiNPs with sizes of about 10–40 nm obtained by ultrasound grinding of silicon nanowires were introduced into breast cancer cells (MCF-7 cell line). Further, the time-varying nanoparticles enclosed in cell structures were visualised by high-resolution structured illumination microscopy (HR-SIM) and micro-Raman spectroscopy. Additionally, the nonlinear optical methods of two-photon excited fluorescence (TPEF) and coherent anti-Stokes Raman scattering (CARS) with infrared laser excitation were applied to study the localisation of SiNPs in cells. Advantages of the nonlinear methods, such as rapid imaging, which prevents cells from overheating and larger penetration depth compared to the single-photon excited HR-SIM, are discussed. The obtained results reveal new perspectives of the multimodal visualisation and precise detection of the uptake of biodegradable non-toxic SiNPs by cancer cells and they are discussed in view of future applications for the optical diagnostics of cancer tumours. PMID:27626408

Optimal nonlinear filtering using the finite-volume method

NASA Astrophysics Data System (ADS)

Fox, Colin; Morrison, Malcolm E. K.; Norton, Richard A.; Molteno, Timothy C. A.

2018-01-01

Optimal sequential inference, or filtering, for the state of a deterministic dynamical system requires simulation of the Frobenius-Perron operator, that can be formulated as the solution of a continuity equation. For low-dimensional, smooth systems, the finite-volume numerical method provides a solution that conserves probability and gives estimates that converge to the optimal continuous-time values, while a Courant-Friedrichs-Lewy-type condition assures that intermediate discretized solutions remain positive density functions. This method is demonstrated in an example of nonlinear filtering for the state of a simple pendulum, with comparison to results using the unscented Kalman filter, and for a case where rank-deficient observations lead to multimodal probability distributions.

Multimodal pain stimulation of the gastrointestinal tract

PubMed Central

Drewes, Asbjørn Mohr; Gregersen, Hans

2006-01-01

Understanding and characterization of pain and other sensory symptoms are among the most important issues in the diagnosis and assessment of patient with gastrointestinal disorders. Methods to evoke and assess experimental pain have recently developed into a new area with the possibility for multimodal stimulation (e.g., electrical, mechanical, thermal and chemical stimulation) of different nerves and pain pathways in the human gut. Such methods mimic to a high degree the pain experienced in the clinic. Multimodal pain methods have increased our basic understanding of different peripheral receptors in the gut in health and disease. Together with advanced muscle analysis, the methods have increased our understanding of receptors sensitive to mechanical, chemical and temperature stimuli in diseases, such as systemic sclerosis and diabetes. The methods can also be used to unravel central pain mechanisms, such as those involved in allodynia, hyperalgesia and referred pain. Abnormalities in central pain mechanisms are often seen in patients with chronic gut pain and hence methods relying on multimodal pain stimulation may help to understand the symptoms in these patients. Sex differences have been observed in several diseases of the gut, and differences in central pain processing between males and females have been hypothesized using multimodal pain stimulations. Finally, multimodal methods have recently been used to gain more insight into the effect of drugs against pain in the GI tract. Hence, the multimodal methods undoubtedly represents a major step forward in the future characterization and treatment of patients with various diseases of the gut. PMID:16688791

Modeling of Nonlinear Beat Signals of TAE's

NASA Astrophysics Data System (ADS)

Zhang, Bo; Berk, Herbert; Breizman, Boris; Zheng, Linjin

2012-03-01

Experiments on Alcator C-Mod reveal Toroidal Alfven Eigenmodes (TAE) together with signals at various beat frequencies, including those at twice the mode frequency. The beat frequencies are sidebands driven by quadratic nonlinear terms in the MHD equations. These nonlinear sidebands have not yet been quantified by any existing codes. We extend the AEGIS code to capture nonlinear effects by treating the nonlinear terms as a driving source in the linear MHD solver. Our goal is to compute the spatial structure of the sidebands for realistic geometry and q-profile, which can be directly compared with experiment in order to interpret the phase contrast imaging diagnostic measurements and to enable the quantitative determination of the Alfven wave amplitude in the plasma core

Adaptive multimodal interaction in mobile augmented reality: A conceptual framework

NASA Astrophysics Data System (ADS)

Abidin, Rimaniza Zainal; Arshad, Haslina; Shukri, Saidatul A'isyah Ahmad

2017-10-01

Recently, Augmented Reality (AR) is an emerging technology in many mobile applications. Mobile AR was defined as a medium for displaying information merged with the real world environment mapped with augmented reality surrounding in a single view. There are four main types of mobile augmented reality interfaces and one of them are multimodal interfaces. Multimodal interface processes two or more combined user input modes (such as speech, pen, touch, manual gesture, gaze, and head and body movements) in a coordinated manner with multimedia system output. In multimodal interface, many frameworks have been proposed to guide the designer to develop a multimodal applications including in augmented reality environment but there has been little work reviewing the framework of adaptive multimodal interface in mobile augmented reality. The main goal of this study is to propose a conceptual framework to illustrate the adaptive multimodal interface in mobile augmented reality. We reviewed several frameworks that have been proposed in the field of multimodal interfaces, adaptive interface and augmented reality. We analyzed the components in the previous frameworks and measure which can be applied in mobile devices. Our framework can be used as a guide for designers and developer to develop a mobile AR application with an adaptive multimodal interfaces.

Analyzing a multimodal biometric system using real and virtual users

NASA Astrophysics Data System (ADS)

Scheidat, Tobias; Vielhauer, Claus

2007-02-01

Three main topics of recent research on multimodal biometric systems are addressed in this article: The lack of sufficiently large multimodal test data sets, the influence of cultural aspects and data protection issues of multimodal biometric data. In this contribution, different possibilities are presented to extend multimodal databases by generating so-called virtual users, which are created by combining single biometric modality data of different users. Comparative tests on databases containing real and virtual users based on a multimodal system using handwriting and speech are presented, to study to which degree the use of virtual multimodal databases allows conclusions with respect to recognition accuracy in comparison to real multimodal data. All tests have been carried out on databases created from donations from three different nationality groups. This allows to review the experimental results both in general and in context of cultural origin. The results show that in most cases the usage of virtual persons leads to lower accuracy than the usage of real users in terms of the measurement applied: the Equal Error Rate. Finally, this article will address the general question how the concept of virtual users may influence the data protection requirements for multimodal evaluation databases in the future.

Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification.

PubMed

Rajagopal, Gayathri; Palaniswamy, Ramamoorthy

2015-01-01

This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis) is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database.

Filter. Remix. Make.: Cultivating Adaptability through Multimodality

ERIC Educational Resources Information Center

Dusenberry, Lisa; Hutter, Liz; Robinson, Joy

2015-01-01

This article establishes traits of adaptable communicators in the 21st century, explains why adaptability should be a goal of technical communication educators, and shows how multimodal pedagogy supports adaptability. Three examples of scalable, multimodal assignments (infographics, research interviews, and software demonstrations) that evidence…

Characterization of Infrastructure Materials using Nonlinear Ultrasonics

NASA Astrophysics Data System (ADS)

Liu, Minghe

In order to improve the safety, reliability, cost, and performance of civil and mechanical structures/components, it is necessary to develop techniques that are capable of characterizing and quantifying the amount of distributed damage in engineering materials before any detectable discontinuities (cracks, delaminations, voids, etc.) appear. In this dissertation, novel nonlinear ultrasonic NDE methods are developed and applied to characterize cumulative damage such as fatigue damage in metallic materials and degradation of cement-based materials due to chemical reactions. First, nonlinear Rayleigh surface waves are used to measure the near-surface residual stresses in shot-peened aluminum alloy (AA 7075) samples. Results show that the nonlinear Rayleigh wave is very sensitive to near-surface residual stresses, and has the potential to quantitatively detect them. Second, a novel two-wave mixing method is theoretically developed and numerically verified. This method is then successfully applied to detect the fatigue damage in aluminum alloy (AA 6061) samples subjected to monotonic compression. In addition to its high sensitivity to fatigue damage, this collinear wave mixing method allows the measurement over a specific region of interest in the specimen, and this capability makes it possible to obtain spatial distribution of fatigue damage through the thickness direction of the sample by simply timing the transducers. Third, the nonlinear wave mixing method is used to characterize the degradation of cement-based materials caused by alkali-silica reaction (ASR). It is found that the nonlinear ultrasonic method is sensitive to detect ASR damage at very early stage, and has the potential to identify the different damage stages. Finally, a micromechanics-based chemo-mechanical model is developed which relates the acoustic nonlinearity parameter to ASR damage. This model provides a way to quantitatively predict the changes in the acoustic nonlinearity parameter due to ASR

Spectral embedding-based registration (SERg) for multimodal fusion of prostate histology and MRI

NASA Astrophysics Data System (ADS)

Hwuang, Eileen; Rusu, Mirabela; Karthigeyan, Sudha; Agner, Shannon C.; Sparks, Rachel; Shih, Natalie; Tomaszewski, John E.; Rosen, Mark; Feldman, Michael; Madabhushi, Anant

2014-03-01

Multi-modal image registration is needed to align medical images collected from different protocols or imaging sources, thereby allowing the mapping of complementary information between images. One challenge of multimodal image registration is that typical similarity measures rely on statistical correlations between image intensities to determine anatomical alignment. The use of alternate image representations could allow for mapping of intensities into a space or representation such that the multimodal images appear more similar, thus facilitating their co-registration. In this work, we present a spectral embedding based registration (SERg) method that uses non-linearly embedded representations obtained from independent components of statistical texture maps of the original images to facilitate multimodal image registration. Our methodology comprises the following main steps: 1) image-derived textural representation of the original images, 2) dimensionality reduction using independent component analysis (ICA), 3) spectral embedding to generate the alternate representations, and 4) image registration. The rationale behind our approach is that SERg yields embedded representations that can allow for very different looking images to appear more similar, thereby facilitating improved co-registration. Statistical texture features are derived from the image intensities and then reduced to a smaller set by using independent component analysis to remove redundant information. Spectral embedding generates a new representation by eigendecomposition from which only the most important eigenvectors are selected. This helps to accentuate areas of salience based on modality-invariant structural information and therefore better identifies corresponding regions in both the template and target images. The spirit behind SERg is that image registration driven by these areas of salience and correspondence should improve alignment accuracy. In this work, SERg is implemented using Demons

Nonlinear photoacoustic spectroscopy of hemoglobin

DOE Office of Scientific and Technical Information (OSTI.GOV)

Danielli, Amos; Maslov, Konstantin; Favazza, Christopher P.

2015-05-18

As light intensity increases in photoacoustic imaging, the saturation of optical absorption and the temperature dependence of the thermal expansion coefficient result in a measurable nonlinear dependence of the photoacoustic (PA) signal on the excitation pulse fluence. Here, under controlled conditions, we investigate the intensity-dependent photoacoustic signals from oxygenated and deoxygenated hemoglobin at varied optical wavelengths and molecular concentrations. The wavelength and concentration dependencies of the nonlinear PA spectrum are found to be significantly greater in oxygenated hemoglobin than in deoxygenated hemoglobin. These effects are further influenced by the hemoglobin concentration. These nonlinear phenomena provide insights into applications of photoacoustics,more » such as measurements of average inter-molecular distances on a nm scale or with a tuned selection of wavelengths, a more accurate quantitative PA tomography.« less

Nonlinear photoacoustic spectroscopy of hemoglobin

PubMed Central

Danielli, Amos; Maslov, Konstantin; Favazza, Christopher P.; Xia, Jun; Wang, Lihong V.

2015-01-01

As light intensity increases in photoacoustic imaging, the saturation of optical absorption and the temperature dependence of the thermal expansion coefficient result in a measurable nonlinear dependence of the photoacoustic (PA) signal on the excitation pulse fluence. Here, under controlled conditions, we investigate the intensity-dependent photoacoustic signals from oxygenated and deoxygenated hemoglobin at varied optical wavelengths and molecular concentrations. The wavelength and concentration dependencies of the nonlinear PA spectrum are found to be significantly greater in oxygenated hemoglobin than in deoxygenated hemoglobin. These effects are further influenced by the hemoglobin concentration. These nonlinear phenomena provide insights into applications of photoacoustics, such as measurements of average inter-molecular distances on a nm scale or with a tuned selection of wavelengths, a more accurate quantitative PA tomography. PMID:26045627

Multimodal Narrative Inquiry: Six Teacher Candidates Respond

ERIC Educational Resources Information Center

Morawski, Cynthia M.; Rottmann, Jennifer

2016-01-01

In this paper we present findings of a study on the implementation of a multimodal teacher narrative inquiry component, theoretically grounded by Rosenblatt's theory of transaction analysis, methodologically supported by action research and practically enacted by narrative inquiry and multimodal learning. In particular, the component offered…

New methods of multimode fiber interferometer signal processing

NASA Astrophysics Data System (ADS)

Vitrik, Oleg B.; Kulchin, Yuri N.; Maxaev, Oleg G.; Kirichenko, Oleg V.; Kamenev, Oleg T.; Petrov, Yuri S.

1995-06-01

New methods of multimode fiber interferometers signal processing are suggested. For scheme of single fiber multimode interferometers with two excited modes, the method based on using of special fiber unit is developed. This unit provides the modes interaction and further sum optical field filtering. As a result the amplitude of output signal is modulated by external influence on interferometer. The stabilization of interferometer sensitivity is achieved by using additional special modulation of output signal. For scheme of single fiber multimode interferometers with excitation of wide mode spectrum, the signal of intermode interference is registered by photodiode matrix and then special electronic unit performs correlation processing. For elimination of temperature destabilization, the registered signal is adopted to multimode interferometers optical signal temperature changes. The achieved parameters for double mode scheme: temporary stability--0.6% per hour, sensitivity to interferometer length deviations--3,2 nm; for multimode scheme: temperature stability--(0.5%)/(K), temporary nonstability--0.2% per hour, sensitivity to interferometer length deviations--20 nm, dynamic range--35 dB.

Enhancing resource coordination for multi-modal evacuation planning.

DOT National Transportation Integrated Search

2013-01-01

This research project seeks to increase knowledge about coordinating effective multi-modal evacuation for disasters. It does so by identifying, evaluating, and assessing : current transportation management approaches for multi-modal evacuation planni...

Adaptive Annealed Importance Sampling for Multimodal Posterior Exploration and Model Selection with Application to Extrasolar Planet Detection

NASA Astrophysics Data System (ADS)

Liu, Bin

2014-07-01

We describe an algorithm that can adaptively provide mixture summaries of multimodal posterior distributions. The parameter space of the involved posteriors ranges in size from a few dimensions to dozens of dimensions. This work was motivated by an astrophysical problem called extrasolar planet (exoplanet) detection, wherein the computation of stochastic integrals that are required for Bayesian model comparison is challenging. The difficulty comes from the highly nonlinear models that lead to multimodal posterior distributions. We resort to importance sampling (IS) to estimate the integrals, and thus translate the problem to be how to find a parametric approximation of the posterior. To capture the multimodal structure in the posterior, we initialize a mixture proposal distribution and then tailor its parameters elaborately to make it resemble the posterior to the greatest extent possible. We use the effective sample size (ESS) calculated based on the IS draws to measure the degree of approximation. The bigger the ESS is, the better the proposal resembles the posterior. A difficulty within this tailoring operation lies in the adjustment of the number of mixing components in the mixture proposal. Brute force methods just preset it as a large constant, which leads to an increase in the required computational resources. We provide an iterative delete/merge/add process, which works in tandem with an expectation-maximization step to tailor such a number online. The efficiency of our proposed method is tested via both simulation studies and real exoplanet data analysis.

Late-time growth rate, mixing, and anisotropy in the multimode narrowband Richtmyer-Meshkov instability: The θ-group collaboration

NASA Astrophysics Data System (ADS)

Thornber, B.; Griffond, J.; Poujade, O.; Attal, N.; Varshochi, H.; Bigdelou, P.; Ramaprabhu, P.; Olson, B.; Greenough, J.; Zhou, Y.; Schilling, O.; Garside, K. A.; Williams, R. J. R.; Batha, C. A.; Kuchugov, P. A.; Ladonkina, M. E.; Tishkin, V. F.; Zmitrenko, N. V.; Rozanov, V. B.; Youngs, D. L.

2017-10-01

Turbulent Richtmyer-Meshkov instability (RMI) is investigated through a series of high resolution three-dimensional simulations of two initial conditions with eight independent codes. The simulations are initialised with a narrowband perturbation such that instability growth is due to non-linear coupling/backscatter from the energetic modes, thus generating the lowest expected growth rate from a pure RMI. By independently assessing the results from each algorithm and computing ensemble averages of multiple algorithms, the results allow a quantification of key flow properties as well as the uncertainty due to differing numerical approaches. A new analytical model predicting the initial layer growth for a multimode narrowband perturbation is presented, along with two models for the linear and non-linear regimes combined. Overall, the growth rate exponent is determined as θ =0.292 ±0.009 , in good agreement with prior studies; however, the exponent is decaying slowly in time. Also, θ is shown to be relatively insensitive to the choice of mixing layer width measurements. The asymptotic integral molecular mixing measures Θ =0.792 ±0.014 , Ξ =0.800 ±0.014 , and Ψ =0.782 ±0.013 are lower than some experimental measurements but within the range of prior numerical studies. The flow field is shown to be persistently anisotropic for all algorithms, at the latest time having between 49% and 66% higher kinetic energy in the shock parallel direction compared to perpendicular and does not show any return to isotropy. The plane averaged volume fraction profiles at different time instants collapse reasonably well when scaled by the integral width, implying that the layer can be described by a single length scale and thus a single θ. Quantitative data given for both ensemble averages and individual algorithms provide useful benchmark results for future research.

Multimodal Freight Distribution to Support Increased Port Operations

DOT National Transportation Integrated Search

2016-10-01

To support improved port operations, three different aspects of multimodal freight distribution are investigated: (i) Efficient load planning for double stack trains at inland ports; (ii) Optimization of a multimodal network for environmental sustain...

Dynamic neural network-based methods for compensation of nonlinear effects in multimode communication lines

NASA Astrophysics Data System (ADS)

Sidelnikov, O. S.; Redyuk, A. A.; Sygletos, S.

2017-12-01

We consider neural network-based schemes of digital signal processing. It is shown that the use of a dynamic neural network-based scheme of signal processing ensures an increase in the optical signal transmission quality in comparison with that provided by other methods for nonlinear distortion compensation.

MULTIMODAL IMAGING OF SYPHILITIC MULTIFOCAL RETINITIS.

PubMed

Curi, Andre L; Sarraf, David; Cunningham, Emmett T

2015-01-01

To describe multimodal imaging of syphilitic multifocal retinitis. Observational case series. Two patients developed multifocal retinitis after treatment of unrecognized syphilitic uveitis with systemic corticosteroids in the absence of appropriate antibiotic therapy. Multimodal imaging localized the foci of retinitis within the retina in contrast to superficial retinal precipitates that accumulate on the surface of the retina in eyes with untreated syphilitic uveitis. Although the retinitis resolved after treatment with systemic penicillin in both cases, vision remained poor in the patient with multifocal retinitis involving the macula. Treatment of unrecognized syphilitic uveitis with corticosteroids in the absence of antitreponemal treatment can lead to the development of multifocal retinitis. Multimodal imaging, and optical coherence tomography in particular, can be used to distinguish multifocal retinitis from superficial retinal precipitates or accumulations.

Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification

PubMed Central

Rajagopal, Gayathri; Palaniswamy, Ramamoorthy

2015-01-01

This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis) is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database. PMID:26640813

A spectral approach for the quantitative description of cardiac collagen network from nonlinear optical imaging.

PubMed

Masè, Michela; Cristoforetti, Alessandro; Avogaro, Laura; Tessarolo, Francesco; Piccoli, Federico; Caola, Iole; Pederzolli, Carlo; Graffigna, Angelo; Ravelli, Flavia

2015-01-01

The assessment of collagen structure in cardiac pathology, such as atrial fibrillation (AF), is essential for a complete understanding of the disease. This paper introduces a novel methodology for the quantitative description of collagen network properties, based on the combination of nonlinear optical microscopy with a spectral approach of image processing and analysis. Second-harmonic generation (SHG) microscopy was applied to atrial tissue samples from cardiac surgery patients, providing label-free, selective visualization of the collagen structure. The spectral analysis framework, based on 2D-FFT, was applied to the SHG images, yielding a multiparametric description of collagen fiber orientation (angle and anisotropy indexes) and texture scale (dominant wavelength and peak dispersion indexes). The proof-of-concept application of the methodology showed the capability of our approach to detect and quantify differences in the structural properties of the collagen network in AF versus sinus rhythm patients. These results suggest the potential of our approach in the assessment of collagen properties in cardiac pathologies related to a fibrotic structural component.

Identifying Multimodal Intermediate Phenotypes between Genetic Risk Factors and Disease Status in Alzheimer’s Disease

PubMed Central

Hao, Xiaoke; Yao, Xiaohui; Yan, Jingwen; Risacher, Shannon L.; Saykin, Andrew J.; Zhang, Daoqiang; Shen, Li

2016-01-01

Neuroimaging genetics has attracted growing attention and interest, which is thought to be a powerful strategy to examine the influence of genetic variants (i.e., single nucleotide polymorphisms (SNPs)) on structures or functions of human brain. In recent studies, univariate or multivariate regression analysis methods are typically used to capture the effective associations between genetic variants and quantitative traits (QTs) such as brain imaging phenotypes. The identified imaging QTs, although associated with certain genetic markers, may not be all disease specific. A useful, but underexplored, scenario could be to discover only those QTs associated with both genetic markers and disease status for revealing the chain from genotype to phenotype to symptom. In addition, multimodal brain imaging phenotypes are extracted from different perspectives and imaging markers consistently showing up in multimodalities may provide more insights for mechanistic understanding of diseases (i.e., Alzheimer’s disease (AD)). In this work, we propose a general framework to exploit multi-modal brain imaging phenotypes as intermediate traits that bridge genetic risk factors and multi-class disease status. We applied our proposed method to explore the relation between the well-known AD risk SNP APOE rs429358 and three baseline brain imaging modalities (i.e., structural magnetic resonance imaging (MRI), fluorodeoxyglucose positron emission tomography (FDG-PET) and F-18 florbetapir PET scans amyloid imaging (AV45)) from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. The empirical results demonstrate that our proposed method not only helps improve the performances of imaging genetic associations, but also discovers robust and consistent regions of interests (ROIs) across multi-modalities to guide the disease-induced interpretation. PMID:27277494

How Multimodality Works in Mathematical Activity: Young Children Graphing Motion

ERIC Educational Resources Information Center

Ferrara, Francesca

2014-01-01

This paper aims to contribute to discussions on the multimodal nature of cognition through an elaboration of the ways multimodal aspects of thinking are exploited by learners doing mathematics. Moving beyond the fact "that" multimodality occurs, this paper focuses on "how" it occurs, with particular attention drawn to the…

Integrated scanning laser ophthalmoscopy and optical coherence tomography for quantitative multimodal imaging of retinal degeneration and autofluorescence

NASA Astrophysics Data System (ADS)

Issaei, Ali; Szczygiel, Lukasz; Hossein-Javaheri, Nima; Young, Mei; Molday, L. L.; Molday, R. S.; Sarunic, M. V.

2011-03-01

Scanning Laser Ophthalmoscopy (SLO) and Coherence Tomography (OCT) are complimentary retinal imaging modalities. Integration of SLO and OCT allows for both fluorescent detection and depth- resolved structural imaging of the retinal cell layers to be performed in-vivo. System customization is required to image rodents used in medical research by vision scientists. We are investigating multimodal SLO/OCT imaging of a rodent model of Stargardt's Macular Dystrophy which is characterized by retinal degeneration and accumulation of toxic autofluorescent lipofuscin deposits. Our new findings demonstrate the ability to track fundus autofluorescence and retinal degeneration concurrently.

Simultaneous fluorescence and quantitative phase microscopy with single-pixel detectors

NASA Astrophysics Data System (ADS)

Liu, Yang; Suo, Jinli; Zhang, Yuanlong; Dai, Qionghai

2018-02-01

Multimodal microscopy offers high flexibilities for biomedical observation and diagnosis. Conventional multimodal approaches either use multiple cameras or a single camera spatially multiplexing different modes. The former needs expertise demanding alignment and the latter suffers from limited spatial resolution. Here, we report an alignment-free full-resolution simultaneous fluorescence and quantitative phase imaging approach using single-pixel detectors. By combining reference-free interferometry with single-pixel detection, we encode the phase and fluorescence of the sample in two detection arms at the same time. Then we employ structured illumination and the correlated measurements between the sample and the illuminations for reconstruction. The recovered fluorescence and phase images are inherently aligned thanks to single-pixel detection. To validate the proposed method, we built a proof-of-concept setup for first imaging the phase of etched glass with the depth of a few hundred nanometers and then imaging the fluorescence and phase of the quantum dot drop. This method holds great potential for multispectral fluorescence microscopy with additional single-pixel detectors or a spectrometer. Besides, this cost-efficient multimodal system might find broad applications in biomedical science and neuroscience.

Comparison of Virginia's multimodal transportation corridors using cost and demographic analyses.

DOT National Transportation Integrated Search

2006-01-01

This effort was performed in support of VTrans2025, Virginia's long-range multimodal transportation plan, and the VTrans2025 Multimodal Advisory Committee. The effort develops a preliminary approach to evaluating multimodal and highway-only corridor ...

River multimodal scenario for rehabilitation robotics.

PubMed

Munih, Marko; Novak, Domen; Milavec, Maja; Ziherl, Jaka; Olenšek, Andrej; Mihelj, Matjaž

2011-01-01

This paper presents the novel "River" multimodal rehabilitation robotics scenario that includes video, audio and haptic modalities. Elements contributing to intrinsic motivation are carefully joined in the three modalities to increase motivation of the user. The user first needs to perform a motor action, then receives a cognitive challenge that is solved with adequate motor activity. Audio includes environmental sounds, music and spoken instructions or encouraging statements. Sounds and music were classified according to the arousal-valence space. The haptic modality can provide catching, grasping, tunnel or adaptive assistance, all depending on the user's needs. The scenario was evaluated in 16 stroke users, who responded to it favourably according to the Intrinsic Motivation Inventory questionnaire. Additionally, the river multimodal environment seems to elicit higher motivation than a simpler apple pick-and-place multimodal task. © 2011 IEEE

Bi-Objective Modelling for Hazardous Materials Road–Rail Multimodal Routing Problem with Railway Schedule-Based Space–Time Constraints

PubMed Central

Sun, Yan; Lang, Maoxiang; Wang, Danzhu

2016-01-01

The transportation of hazardous materials is always accompanied by considerable risk that will impact public and environment security. As an efficient and reliable transportation organization, a multimodal service should participate in the transportation of hazardous materials. In this study, we focus on transporting hazardous materials through the multimodal service network and explore the hazardous materials multimodal routing problem from the operational level of network planning. To formulate this problem more practicably, minimizing the total generalized costs of transporting the hazardous materials and the social risk along the planned routes are set as the optimization objectives. Meanwhile, the following formulation characteristics will be comprehensively modelled: (1) specific customer demands; (2) multiple hazardous material flows; (3) capacitated schedule-based rail service and uncapacitated time-flexible road service; and (4) environmental risk constraint. A bi-objective mixed integer nonlinear programming model is first built to formulate the routing problem that combines the formulation characteristics above. Then linear reformations are developed to linearize and improve the initial model so that it can be effectively solved by exact solution algorithms on standard mathematical programming software. By utilizing the normalized weighted sum method, we can generate the Pareto solutions to the bi-objective optimization problem for a specific case. Finally, a large-scale empirical case study from the Beijing–Tianjin–Hebei Region in China is presented to demonstrate the feasibility of the proposed methods in dealing with the practical problem. Various scenarios are also discussed in the case study. PMID:27483294

Multimode optical fibers: steady state mode exciter.

PubMed

Ikeda, M; Sugimura, A; Ikegami, T

1976-09-01

The steady state mode power distribution of the multimode graded index fiber was measured. A simple and effective steady state mode exciter was fabricated by an etching technique. Its insertion loss was 0.5 dB for an injection laser. Deviation in transmission characteristics of multimode graded index fibers can be avoided by using the steady state mode exciter.

Extending nonlinear analysis to short ecological time series.

PubMed

Hsieh, Chih-hao; Anderson, Christian; Sugihara, George

2008-01-01

Nonlinearity is important and ubiquitous in ecology. Though detectable in principle, nonlinear behavior is often difficult to characterize, analyze, and incorporate mechanistically into models of ecosystem function. One obvious reason is that quantitative nonlinear analysis tools are data intensive (require long time series), and time series in ecology are generally short. Here we demonstrate a useful method that circumvents data limitation and reduces sampling error by combining ecologically similar multispecies time series into one long time series. With this technique, individual ecological time series containing as few as 20 data points can be mined for such important information as (1) significantly improved forecast ability, (2) the presence and location of nonlinearity, and (3) the effective dimensionality (the number of relevant variables) of an ecological system.

Multi-modality imaging of tumor phenotype and response to therapy

NASA Astrophysics Data System (ADS)

Nyflot, Matthew J.

2011-12-01

Imaging and radiation oncology have historically been closely linked. However, the vast majority of techniques used in the clinic involve anatomical imaging. Biological imaging offers the potential for innovation in the areas of cancer diagnosis and staging, radiotherapy target definition, and treatment response assessment. Some relevant imaging techniques are FDG PET (for imaging cellular metabolism), FLT PET (proliferation), CuATSM PET (hypoxia), and contrast-enhanced CT (vasculature and perfusion). Here, a technique for quantitative spatial correlation of tumor phenotype is presented for FDG PET, FLT PET, and CuATSM PET images. Additionally, multimodality imaging of treatment response with FLT PET, CuATSM, and dynamic contrast-enhanced CT is presented, in a trial of patients receiving an antiangiogenic agent (Avastin) combined with cisplatin and radiotherapy. Results are also presented for translational applications in animal models, including quantitative assessment of proliferative response to cetuximab with FLT PET and quantification of vascular volume with a blood-pool contrast agent (Fenestra). These techniques have clear applications to radiobiological research and optimized treatment strategies, and may eventually be used for personalized therapy for patients.

Mid-infrared multi-mode absorption spectroscopy, MUMAS, using difference frequency generation

NASA Astrophysics Data System (ADS)

Northern, Henry; O'Hagan, Seamus; Hamilton, Michelle L.; Ewart, Paul

2015-03-01

Multi-mode absorption spectroscopy of ammonia and methane at 3.3 μm has been demonstrated using a source of multi-mode mid-infrared radiation based on difference frequency generation. Multi-mode radiation at 1.56 μm from a diode-pumped Er:Yb:glass laser was mixed with a single-mode Nd:YAG laser at 1.06 μm in a periodically poled lithium niobate crystal to produce multi-mode radiation in the region of 3.3 μm. Detection, by direct multi-mode absorption, of NH3 and CH4 is reported for each species individually and also simultaneously in mixtures allowing measurements of partial pressures of each species.

Nonlinear Acoustical Assessment of Precipitate Nucleation

NASA Technical Reports Server (NTRS)

Cantrell, John H.; Yost, William T.

2004-01-01

The purpose of the present work is to show that measurements of the acoustic nonlinearity parameter in heat treatable alloys as a function of heat treatment time can provide quantitative information about the kinetics of precipitate nucleation and growth in such alloys. Generally, information on the kinetics of phase transformations is obtained from time-sequenced electron microscopical examination and differential scanning microcalorimetry. The present nonlinear acoustical assessment of precipitation kinetics is based on the development of a multiparameter analytical model of the effects on the nonlinearity parameter of precipitate nucleation and growth in the alloy system. A nonlinear curve fit of the model equation to the experimental data is then used to extract the kinetic parameters related to the nucleation and growth of the targeted precipitate. The analytical model and curve fit is applied to the assessment of S' precipitation in aluminum alloy 2024 during artificial aging from the T4 to the T6 temper.

Critical Visual Literacy: Multimodal Communication across the Curriculum

ERIC Educational Resources Information Center

Duffelmeyer, Barb Blakely; Ellertson, Anthony

2005-01-01

"Critical Visual Literacy: Multimodal Communication Across the Curriculum" makes the case for expanding the pedagogical space and communication possibilities in undergraduate communication-intensive and linked (learning community) courses by allowing students to create multimodal texts that deal with civic and cultural and/or discipline…

Multimode entanglement in reconfigurable graph states using optical frequency combs

PubMed Central

Cai, Y.; Roslund, J.; Ferrini, G.; Arzani, F.; Xu, X.; Fabre, C.; Treps, N.

2017-01-01

Multimode entanglement is an essential resource for quantum information processing and quantum metrology. However, multimode entangled states are generally constructed by targeting a specific graph configuration. This yields to a fixed experimental setup that therefore exhibits reduced versatility and scalability. Here we demonstrate an optical on-demand, reconfigurable multimode entangled state, using an intrinsically multimode quantum resource and a homodyne detection apparatus. Without altering either the initial squeezing source or experimental architecture, we realize the construction of thirteen cluster states of various sizes and connectivities as well as the implementation of a secret sharing protocol. In particular, this system enables the interrogation of quantum correlations and fluctuations for any multimode Gaussian state. This initiates an avenue for implementing on-demand quantum information processing by only adapting the measurement process and not the experimental layout. PMID:28585530

ADAPTIVE ANNEALED IMPORTANCE SAMPLING FOR MULTIMODAL POSTERIOR EXPLORATION AND MODEL SELECTION WITH APPLICATION TO EXTRASOLAR PLANET DETECTION

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Bin, E-mail: bins@ieee.org

2014-07-01

We describe an algorithm that can adaptively provide mixture summaries of multimodal posterior distributions. The parameter space of the involved posteriors ranges in size from a few dimensions to dozens of dimensions. This work was motivated by an astrophysical problem called extrasolar planet (exoplanet) detection, wherein the computation of stochastic integrals that are required for Bayesian model comparison is challenging. The difficulty comes from the highly nonlinear models that lead to multimodal posterior distributions. We resort to importance sampling (IS) to estimate the integrals, and thus translate the problem to be how to find a parametric approximation of the posterior.more » To capture the multimodal structure in the posterior, we initialize a mixture proposal distribution and then tailor its parameters elaborately to make it resemble the posterior to the greatest extent possible. We use the effective sample size (ESS) calculated based on the IS draws to measure the degree of approximation. The bigger the ESS is, the better the proposal resembles the posterior. A difficulty within this tailoring operation lies in the adjustment of the number of mixing components in the mixture proposal. Brute force methods just preset it as a large constant, which leads to an increase in the required computational resources. We provide an iterative delete/merge/add process, which works in tandem with an expectation-maximization step to tailor such a number online. The efficiency of our proposed method is tested via both simulation studies and real exoplanet data analysis.« less

The Role of Multimodal Invasive Monitoring in Acute Traumatic Brain Injury.

PubMed

Lazaridis, Christos; Robertson, Claudia S

2016-10-01

This article reviews the role of modalities that directly monitor brain parenchyma in patients with severe traumatic brain injury. The physiology monitored involves compartmental and perfusion pressures, tissue oxygenation and metabolism, quantitative blood flow, pressure autoregulation, and electrophysiology. There are several proposed roles for this multimodality monitoring, such as to track, prevent, and treat the cascade of secondary brain injury; monitor the neurologically injured patient; integrate various data into a composite, patient-specific, and dynamic picture; apply protocolized, pathophysiology-driven intensive care; use as a prognostic marker; and understand pathophysiologic mechanisms involved in secondary brain injury to develop preventive and abortive therapies, and to inform future clinical trials. Copyright © 2016 Elsevier Inc. All rights reserved.

Multimodal Speaker Diarization.

PubMed

Noulas, A; Englebienne, G; Krose, B J A

2012-01-01

We present a novel probabilistic framework that fuses information coming from the audio and video modality to perform speaker diarization. The proposed framework is a Dynamic Bayesian Network (DBN) that is an extension of a factorial Hidden Markov Model (fHMM) and models the people appearing in an audiovisual recording as multimodal entities that generate observations in the audio stream, the video stream, and the joint audiovisual space. The framework is very robust to different contexts, makes no assumptions about the location of the recording equipment, and does not require labeled training data as it acquires the model parameters using the Expectation Maximization (EM) algorithm. We apply the proposed model to two meeting videos and a news broadcast video, all of which come from publicly available data sets. The results acquired in speaker diarization are in favor of the proposed multimodal framework, which outperforms the single modality analysis results and improves over the state-of-the-art audio-based speaker diarization.

Fiber Optic Temperature Sensor Based on Multimode Interference Effects

NASA Astrophysics Data System (ADS)

Aguilar-Soto, J. G.; Antonio-Lopez, J. E.; Sanchez-Mondragon, J. J.; May-Arrioja, D. A.

2011-01-01

A novel fiber optic temperature sensor based on multimode interference was designed, fabricated and tested. The sensor is very simple and inexpensive since we only need to splice a section of multimode fiber between two single mode fibers. Using this device a sensing range of 25°C to 375°C is demonstrated. We should also highlight that due to the pass-band filter response of MMI devices, multiplexing is rather simple by just changing the length of the multimode section.

Teaching Visual Texts with the Multimodal Analysis Software

ERIC Educational Resources Information Center

Lim Fei, Victor; O'Halloran, Kay L.; Tan, Sabine; E., Marissa K. L.

2015-01-01

This exploratory study introduces the systemic approach and the explicit teaching of a meta-language to provide conceptual tools for students for the analysis and interpretation of multimodal texts. Equipping students with a set of specialised vocabulary with conventionalised meanings associated with specific choices in multimodal texts empowers…

Multimodal Scaffolding in the Secondary English Classroom Curriculum

ERIC Educational Resources Information Center

Boche, Benjamin; Henning, Megan

2015-01-01

This article examines the topic of multimodal scaffolding in the secondary English classroom curriculum through the viewpoint of one teacher's experiences. With technology becoming more commonplace and readily available in the English classroom, we must pinpoint specific and tangible ways to help teachers use and teach multimodalities in their…

Model regulations and plan amendments for multimodal transportation districts

DOT National Transportation Integrated Search

2004-02-01

In 1999, the Florida legislature enabled local governments to establish Multimodal Transportation Districts (MMTD) in their comprehensive plan as a means of promoting a high quality multimodal environment within selected urban areas. The Florida Depa...

Nonlinear finite amplitude vibrations of sharp-edged beams in viscous fluids

NASA Astrophysics Data System (ADS)

Aureli, M.; Basaran, M. E.; Porfiri, M.

2012-03-01

In this paper, we study flexural vibrations of a cantilever beam with thin rectangular cross section submerged in a quiescent viscous fluid and undergoing oscillations whose amplitude is comparable with its width. The structure is modeled using Euler-Bernoulli beam theory and the distributed hydrodynamic loading is described by a single complex-valued hydrodynamic function which accounts for added mass and fluid damping experienced by the structure. We perform a parametric 2D computational fluid dynamics analysis of an oscillating rigid lamina, representative of a generic beam cross section, to understand the dependence of the hydrodynamic function on the governing flow parameters. We find that increasing the frequency and amplitude of the vibration elicits vortex shedding and convection phenomena which are, in turn, responsible for nonlinear hydrodynamic damping. We establish a manageable nonlinear correction to the classical hydrodynamic function developed for small amplitude vibration and we derive a computationally efficient reduced order modal model for the beam nonlinear oscillations. Numerical and theoretical results are validated by comparison with ad hoc designed experiments on tapered beams and multimodal vibrations and with data available in the literature. Findings from this work are expected to find applications in the design of slender structures of interest in marine applications, such as biomimetic propulsion systems and energy harvesting devices.

Multimodal freight investment criteria.

DOT National Transportation Integrated Search

2010-07-01

Literature was reviewed on multi-modal investment criteria for freight projects, examining measures and techniques for quantifying project benefits and costs, as well as ways to describe the economic importance of freight transportation. : A limited ...

Role of interbranch pumping on the quantum-statistical behavior of multi-mode magnons in ferromagnetic nanowires

NASA Astrophysics Data System (ADS)

Haghshenasfard, Zahra; Cottam, M. G.

2018-01-01

Theoretical studies are reported for the quantum-statistical properties of microwave-driven multi-mode magnon systems as represented by ferromagnetic nanowires with a stripe geometry. Effects of both the exchange and the dipole-dipole interactions, as well as a Zeeman term for an external applied field, are included in the magnetic Hamiltonian. The model also contains the time-dependent nonlinear effects due to parallel pumping with an electromagnetic field. Using a coherent magnon state representation in terms of creation and annihilation operators, we investigate the effects of parallel pumping on the temporal evolution of various nonclassical properties of the system. A focus is on the interbranch mixing produced by the pumping field when there are three or more modes. In particular, the occupation magnon number and the multi-mode cross correlations between magnon modes are studied. Manipulation of the collapse and revival phenomena of the average magnon occupation number and the control of the cross correlation between the magnon modes are demonstrated through tuning of the parallel pumping field amplitude and appropriate choices for the coherent magnon states. The cross correlations are a direct consequence of the interbranch pumping effects and do not appear in the corresponding one- or two-mode magnon systems.

Dynamic ELM and divertor control using resonant toroidal multi-mode magnetic fields in DIII-D and EAST

NASA Astrophysics Data System (ADS)

Sun, Youwen

2017-10-01

A rotating n = 2 Resonant Magnetic Perturbation (RMP) field combined with a stationary n = 3 RMP field has validated predictions that access to ELM suppression can be improved, while divertor heat and particle flux can also be dynamically controlled in DIII-D. Recent observations in the EAST tokamak indicate that edge magnetic topology changes, due to nonlinear plasma response to magnetic perturbations, play a critical role in accessing ELM suppression. MARS-F code MHD simulations, which include the plasma response to the RMP, indicate the nonlinear transition to ELM suppression is optimized by configuring the RMP coils to drive maximal edge stochasticity. Consequently, mixed toroidal multi-mode RMP fields, which produce more densely packed islands over a range of additional rational surfaces, improve access to ELM suppression, and further spread heat loading on the divertor. Beneficial effects of this multi-harmonic spectrum on ELM suppression have been validated in DIII-D. Here, the threshold current required for ELM suppression with a mixed n spectrum, where part of the n = 3 RMP field is replaced by an n = 2 field, is smaller than the case with pure n = 3 field. An important further benefit of this multi-mode approach is that significant changes of 3D particle flux footprint profiles on the divertor are found in the experiment during the application of a rotating n = 2 RMP field superimposed on a static n = 3 RMP field. This result was predicted by modeling studies of the edge magnetic field structure using the TOP2D code which takes into account plasma response from MARS-F code. These results expand physics understanding and potential effectiveness of the technique for reliably controlling ELMs and divertor power/particle loading distributions in future burning plasma devices such as ITER. Work supported by USDOE under DE-FC02-04ER54698 and NNSF of China under 11475224.

Fracturing Writing Spaces: Multimodal Storytelling Ignites Process Writing

ERIC Educational Resources Information Center

Lenters, Kimberly; Winters, Kari-Lynn

2013-01-01

In this paper, we explore the affordances of literature-based, arts-infused and digital media processes for students, as multimodal practices take centre stage in an English Language Arts unit on fractured fairy tales. The study takes up the challenge of addressing multimodal literacy instruction and research in ways that utilize a range of…

Generating Multimodal References

ERIC Educational Resources Information Center

van der Sluis, Ielka; Krahmer, Emiel

2007-01-01

This article presents a new computational model for the generation of multimodal referring expressions (REs), based on observations in human communication. The algorithm is an extension of the graph-based algorithm proposed by Krahmer, van Erk, and Verleg (2003) and makes use of a so-called Flashlight Model for pointing. The Flashlight Model…

Multimode waveguide speckle patterns for compressive sensing.

PubMed

Valley, George C; Sefler, George A; Justin Shaw, T

2016-06-01

Compressive sensing (CS) of sparse gigahertz-band RF signals using microwave photonics may achieve better performances with smaller size, weight, and power than electronic CS or conventional Nyquist rate sampling. The critical element in a CS system is the device that produces the CS measurement matrix (MM). We show that passive speckle patterns in multimode waveguides potentially provide excellent MMs for CS. We measure and calculate the MM for a multimode fiber and perform simulations using this MM in a CS system. We show that the speckle MM exhibits the sharp phase transition and coherence properties needed for CS and that these properties are similar to those of a sub-Gaussian MM with the same mean and standard deviation. We calculate the MM for a multimode planar waveguide and find dimensions of the planar guide that give a speckle MM with a performance similar to that of the multimode fiber. The CS simulations show that all measured and calculated speckle MMs exhibit a robust performance with equal amplitude signals that are sparse in time, in frequency, and in wavelets (Haar wavelet transform). The planar waveguide results indicate a path to a microwave photonic integrated circuit for measuring sparse gigahertz-band RF signals using CS.

Coupling efficiency of laser beam to multimode fiber

NASA Astrophysics Data System (ADS)

Niu, Jinfu; Xu, Jianqiu

2007-06-01

The coupling efficiency of laser beam to multimode fiber is given by geometrical optics, and the relation between the maximum coupling efficiency and the beam propagation factor M2 is analyzed. An equivalent factor MF2 for the multimode fiber is introduced to characterize the fiber coupling capability. The coupling efficiency of laser beam to multimode fiber is calculated in respect of the ratio M2/MF2 by the overlapping integral theory. The optimal coupling efficiency can be roughly estimated by the ratio of M2 to MF2 but with a large error range. The deviation comes from the lacks of information on the detail of phase and intensity profile in the beam factor M2.

Hybrid genetic algorithm with an adaptive penalty function for fitting multimodal experimental data: application to exchange-coupled non-Kramers binuclear iron active sites.

PubMed

Beaser, Eric; Schwartz, Jennifer K; Bell, Caleb B; Solomon, Edward I

2011-09-26

A Genetic Algorithm (GA) is a stochastic optimization technique based on the mechanisms of biological evolution. These algorithms have been successfully applied in many fields to solve a variety of complex nonlinear problems. While they have been used with some success in chemical problems such as fitting spectroscopic and kinetic data, many have avoided their use due to the unconstrained nature of the fitting process. In engineering, this problem is now being addressed through incorporation of adaptive penalty functions, but their transfer to other fields has been slow. This study updates the Nanakorrn Adaptive Penalty function theory, expanding its validity beyond maximization problems to minimization as well. The expanded theory, using a hybrid genetic algorithm with an adaptive penalty function, was applied to analyze variable temperature variable field magnetic circular dichroism (VTVH MCD) spectroscopic data collected on exchange coupled Fe(II)Fe(II) enzyme active sites. The data obtained are described by a complex nonlinear multimodal solution space with at least 6 to 13 interdependent variables and are costly to search efficiently. The use of the hybrid GA is shown to improve the probability of detecting the global optimum. It also provides large gains in computational and user efficiency. This method allows a full search of a multimodal solution space, greatly improving the quality and confidence in the final solution obtained, and can be applied to other complex systems such as fitting of other spectroscopic or kinetics data.

Use of multimodality imaging and artificial intelligence for diagnosis and prognosis of early stages of Alzheimer's disease.

PubMed

Liu, Xiaonan; Chen, Kewei; Wu, Teresa; Weidman, David; Lure, Fleming; Li, Jing

2018-04-01

Alzheimer's disease (AD) is a major neurodegenerative disease and the most common cause of dementia. Currently, no treatment exists to slow down or stop the progression of AD. There is converging belief that disease-modifying treatments should focus on early stages of the disease, that is, the mild cognitive impairment (MCI) and preclinical stages. Making a diagnosis of AD and offering a prognosis (likelihood of converting to AD) at these early stages are challenging tasks but possible with the help of multimodality imaging, such as magnetic resonance imaging (MRI), fluorodeoxyglucose (FDG)-positron emission topography (PET), amyloid-PET, and recently introduced tau-PET, which provides different but complementary information. This article is a focused review of existing research in the recent decade that used statistical machine learning and artificial intelligence methods to perform quantitative analysis of multimodality image data for diagnosis and prognosis of AD at the MCI or preclinical stages. We review the existing work in 3 subareas: diagnosis, prognosis, and methods for handling modality-wise missing data-a commonly encountered problem when using multimodality imaging for prediction or classification. Factors contributing to missing data include lack of imaging equipment, cost, difficulty of obtaining patient consent, and patient drop-off (in longitudinal studies). Finally, we summarize our major findings and provide some recommendations for potential future research directions. Copyright © 2018 Elsevier Inc. All rights reserved.

Multimodal Career Counseling: An Application of the "BASIC ID."

ERIC Educational Resources Information Center

Smith, Robert L.; Southern, Stephen

1980-01-01

The multimodal career counseling model is a logical extension of Lazarus' multimodal behavior therapy through the assessment of seven modalities that affect the career of the individual. Interventions may be directed at the early decision-making stage or when difficulties are encountered. (Author)

General description and understanding of the nonlinear dynamics of mode-locked fiber lasers.

PubMed

Wei, Huai; Li, Bin; Shi, Wei; Zhu, Xiushan; Norwood, Robert A; Peyghambarian, Nasser; Jian, Shuisheng

2017-05-02

As a type of nonlinear system with complexity, mode-locked fiber lasers are known for their complex behaviour. It is a challenging task to understand the fundamental physics behind such complex behaviour, and a unified description for the nonlinear behaviour and the systematic and quantitative analysis of the underlying mechanisms of these lasers have not been developed. Here, we present a complexity science-based theoretical framework for understanding the behaviour of mode-locked fiber lasers by going beyond reductionism. This hierarchically structured framework provides a model with variable dimensionality, resulting in a simple view that can be used to systematically describe complex states. Moreover, research into the attractors' basins reveals the origin of stochasticity, hysteresis and multistability in these systems and presents a new method for quantitative analysis of these nonlinear phenomena. These findings pave the way for dynamics analysis and system designs of mode-locked fiber lasers. We expect that this paradigm will also enable potential applications in diverse research fields related to complex nonlinear phenomena.

Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

DOE PAGES

Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth R.; ...

2016-02-05

Here, we developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray's superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioningmore » it.« less

Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth R.

Here, we developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray's superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioningmore » it.« less

Multimodal optoacoustic and multiphoton fluorescence microscopy

NASA Astrophysics Data System (ADS)

Sela, Gali; Razansky, Daniel; Shoham, Shy

2013-03-01

Multiphoton microscopy is a powerful imaging modality that enables structural and functional imaging with cellular and sub-cellular resolution, deep within biological tissues. Yet, its main contrast mechanism relies on extrinsically administered fluorescent indicators. Here we developed a system for simultaneous multimodal optoacoustic and multiphoton fluorescence 3D imaging, which attains both absorption and fluorescence-based contrast by integrating an ultrasonic transducer into a two-photon laser scanning microscope. The system is readily shown to enable acquisition of multimodal microscopic images of fluorescently labeled targets and cell cultures as well as intrinsic absorption-based images of pigmented biological tissue. During initial experiments, it was further observed that that detected optoacoustically-induced response contains low frequency signal variations, presumably due to cavitation-mediated signal generation by the high repetition rate (80MHz) near IR femtosecond laser. The multimodal system may provide complementary structural and functional information to the fluorescently labeled tissue, by superimposing optoacoustic images of intrinsic tissue chromophores, such as melanin deposits, pigmentation, and hemoglobin or other extrinsic particle or dye-based markers highly absorptive in the NIR spectrum.

Multimodal Estimation of Distribution Algorithms.

PubMed

Yang, Qiang; Chen, Wei-Neng; Li, Yun; Chen, C L Philip; Xu, Xiang-Min; Zhang, Jun

2016-02-15

Taking the advantage of estimation of distribution algorithms (EDAs) in preserving high diversity, this paper proposes a multimodal EDA. Integrated with clustering strategies for crowding and speciation, two versions of this algorithm are developed, which operate at the niche level. Then these two algorithms are equipped with three distinctive techniques: 1) a dynamic cluster sizing strategy; 2) an alternative utilization of Gaussian and Cauchy distributions to generate offspring; and 3) an adaptive local search. The dynamic cluster sizing affords a potential balance between exploration and exploitation and reduces the sensitivity to the cluster size in the niching methods. Taking advantages of Gaussian and Cauchy distributions, we generate the offspring at the niche level through alternatively using these two distributions. Such utilization can also potentially offer a balance between exploration and exploitation. Further, solution accuracy is enhanced through a new local search scheme probabilistically conducted around seeds of niches with probabilities determined self-adaptively according to fitness values of these seeds. Extensive experiments conducted on 20 benchmark multimodal problems confirm that both algorithms can achieve competitive performance compared with several state-of-the-art multimodal algorithms, which is supported by nonparametric tests. Especially, the proposed algorithms are very promising for complex problems with many local optima.

Composition at Washington State University: Building a Multimodal Bricolage

ERIC Educational Resources Information Center

Ericsson, Patricia; Hunter, Leeann Downing; Macklin, Tialitha Michelle; Edwards, Elizabeth Sue

2016-01-01

Multimodal pedagogy is increasingly accepted among composition scholars. However, putting such pedagogy into practice presents significant challenges. In this profile of Washington State University's first-year composition program, we suggest a multi-vocal and multi-theoretical approach to addressing the challenges of multimodal pedagogy. Patricia…

Non-linear optics of ultrastrongly coupled cavity polaritons

NASA Astrophysics Data System (ADS)

Crescimanno, Michael; Liu, Bin; McMaster, Michael; Singer, Kenneth

2016-05-01

Experiments at CWRU have developed organic cavity polaritons that display world-record vacuum Rabi splittings of more than an eV. This ultrastrongly coupled polaritonic matter is a new regime for exploring non-linear optical effects. We apply quantum optics theory to quantitatively determine various non-linear optical effects including types of low harmonic generation (SHG and THG) in single and double cavity polariton systems. Ultrastrongly coupled photon-matter systems such as these may be the foundation for technologies including low-power optical switching and computing.

Delivery of ultrashort spatially focused pulses through a multimode fiber

NASA Astrophysics Data System (ADS)

Morales-Delgado, Edgar E.; Papadopoulos, Ioannis N.; Farahi, Salma; Psaltis, Demetri; Moser, Christophe

2015-08-01

Multimode optical fibers potentially allow the transmission of larger amounts of information than their single mode counterparts because of their high number of supported modes. However, propagation of a light pulse through a multimode fiber suffers from spatial distortions due to the superposition of the various exited modes and from time broadening due to modal dispersion. We present a method based on digital phase conjugation to selectively excite in a multimode fiber specific optical fiber modes that follow similar optical paths as they travel through the fiber. The excited modes interfere constructively at the fiber output generating an ultrashort spatially focused pulse. The excitation of a limited number of modes following similar optical paths limits modal dispersion, allowing the transmission of the ultrashort pulse. We have experimentally demonstrated the delivery of a focused spot of pulse width equal to 500 fs through a 30 cm, 200 micrometer core step index multimode fiber. The results of this study show that two-photon imaging capability can be added to ultra-thin lensless endoscopy using commercial multimode fibers.

Multimode optical fiber

DOEpatents

Bigot-Astruc, Marianne; Molin, Denis; Sillard, Pierre

2014-11-04

A depressed graded-index multimode optical fiber includes a central core, an inner depressed cladding, a depressed trench, an outer depressed cladding, and an outer cladding. The central core has an alpha-index profile. The depressed claddings limit the impact of leaky modes on optical-fiber performance characteristics (e.g., bandwidth, core size, and/or numerical aperture).

Linearization improves the repeatability of quantitative dynamic contrast-enhanced MRI.

PubMed

Jones, Kyle M; Pagel, Mark D; Cárdenas-Rodríguez, Julio

2018-04-01

The purpose of this study was to compare the repeatabilities of the linear and nonlinear Tofts and reference region models (RRM) for dynamic contrast-enhanced MRI (DCE-MRI). Simulated and experimental DCE-MRI data from 12 rats with a flank tumor of C6 glioma acquired over three consecutive days were analyzed using four quantitative and semi-quantitative DCE-MRI metrics. The quantitative methods used were: 1) linear Tofts model (LTM), 2) non-linear Tofts model (NTM), 3) linear RRM (LRRM), and 4) non-linear RRM (NRRM). The following semi-quantitative metrics were used: 1) maximum enhancement ratio (MER), 2) time to peak (TTP), 3) initial area under the curve (iauc64), and 4) slope. LTM and NTM were used to estimate K trans , while LRRM and NRRM were used to estimate K trans relative to muscle (R Ktrans ). Repeatability was assessed by calculating the within-subject coefficient of variation (wSCV) and the percent intra-subject variation (iSV) determined with the Gage R&R analysis. The iSV for R Ktrans using LRRM was two-fold lower compared to NRRM at all simulated and experimental conditions. A similar trend was observed for the Tofts model, where LTM was at least 50% more repeatable than the NTM under all experimental and simulated conditions. The semi-quantitative metrics iauc64 and MER were as equally repeatable as K trans and R Ktrans estimated by LTM and LRRM respectively. The iSV for iauc64 and MER were significantly lower than the iSV for slope and TTP. In simulations and experimental results, linearization improves the repeatability of quantitative DCE-MRI by at least 30%, making it as repeatable as semi-quantitative metrics. Copyright © 2017 Elsevier Inc. All rights reserved.

Multimodal versus Unimodal Instruction in a Complex Learning Context.

ERIC Educational Resources Information Center

Gellevij, Mark; van der Meij, Hans; de Jong, Ton; Pieters, Jules

2002-01-01

Compared multimodal instruction with text and pictures with unimodal text-only instruction as 44 college students used a visual or textual manual to learn a complex software application. Results initially support dual coding theory and indicate that multimodal instruction led to better performance than unimodal instruction. (SLD)

Multimodal Pedagogies in Diverse Classrooms: Representation, Rights and Resources

ERIC Educational Resources Information Center

Stein, Pippa

2012-01-01

Multimodal Pedagogies in Diverse Classrooms examines how the classroom can become a democratic space founded on the integration of different histories, modes of representation, feelings, languages and discourses, and is essential reading for anyone interested in the connection between multimodality, pedagogy, democracy and social justice in…

Using a Multimodal Learning System to Support Music Instruction

ERIC Educational Resources Information Center

Yu, Pao-Ta; Lai, Yen-Shou; Tsai, Hung-Hsu; Chang, Yuan-Hou

2010-01-01

This paper describes a multimodality approach that helps primary-school students improve their learning performance during music instruction. Multimedia instruction is an effective way to help learners create meaningful knowledge and to make referential connections between mental representations. This paper proposes a multimodal, dual-channel,…

Individual Multimodal Therapy for Weight Loss: A Case Example.

ERIC Educational Resources Information Center

Kilmartin, Christopher; Robbins, Steven

1987-01-01

Presents a case study highlighting a treatment model based on a multimodal conceptualization. Suggests that individual multimodal therapy provides a comprehensive approach to the treatment of overeating, helping to target social and emotional issues related to eating disorders as well as the eating behaviors themselves. (Author/ABB)

The Study on the Optimization of Container Multimodal Transport Business Process in Shandong

NASA Astrophysics Data System (ADS)

Wang, Fengmei; Gong, Xiaoyi; Ni, Yingying; Zhan, Jun; Che, Huiping

2018-06-01

Shandong is a coastal city with good location advantages. As a hub port for international trade goods and a port of transhipment, shandong's demand for multimodal transport is more urgent. By selecting the suitable non-water port and the multimodal transport carrier to improve the efficiency of multimodal transport, the purpose of saving the time of logistics is achieved, thus reducing the logistics cost.It branch out through Shandongt, and it can reach the central region of China, can reach the Western remote area ,too. This paper puts forward the optimization scheme of the business process of container multimodal transport. The optimization of freight forwarding business process is analyzed. The multimodal transport model in Shandong was designed. Finally, the optimal approach of multimodal transport in Shandong is put forward.

Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

PubMed

Gao, Duyang; Yuan, Zhen

2017-01-01

Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

Quantitative analysis of Ni2+/Ni3+ in Li[NixMnyCoz]O2 cathode materials: Non-linear least-squares fitting of XPS spectra

NASA Astrophysics Data System (ADS)

Fu, Zewei; Hu, Juntao; Hu, Wenlong; Yang, Shiyu; Luo, Yunfeng

2018-05-01

Quantitative analysis of Ni2+/Ni3+ using X-ray photoelectron spectroscopy (XPS) is important for evaluating the crystal structure and electrochemical performance of Lithium-nickel-cobalt-manganese oxide (Li[NixMnyCoz]O2, NMC). However, quantitative analysis based on Gaussian/Lorentzian (G/L) peak fitting suffers from the challenges of reproducibility and effectiveness. In this study, the Ni2+ and Ni3+ standard samples and a series of NMC samples with different Ni doping levels were synthesized. The Ni2+/Ni3+ ratios in NMC were quantitatively analyzed by non-linear least-squares fitting (NLLSF). Two Ni 2p overall spectra of synthesized Li [Ni0.33Mn0.33Co0.33]O2(NMC111) and bulk LiNiO2 were used as the Ni2+ and Ni3+ reference standards. Compared to G/L peak fitting, the fitting parameters required no adjustment, meaning that the spectral fitting process was free from operator dependence and the reproducibility was improved. Comparison of residual standard deviation (STD) showed that the fitting quality of NLLSF was superior to that of G/L peaks fitting. Overall, these findings confirmed the reproducibility and effectiveness of the NLLSF method in XPS quantitative analysis of Ni2+/Ni3+ ratio in Li[NixMnyCoz]O2 cathode materials.

Tunable multimode-interference bandpass fiber filter.

PubMed

Antonio-Lopez, J E; Castillo-Guzman, A; May-Arrioja, D A; Selvas-Aguilar, R; Likamwa, P

2010-02-01

We report on a wavelength-tunable filter based on multimode interference (MMI) effects. A typical MMI filter consists of a multimode fiber (MMF) spliced between two single-mode fibers (SMF). The peak wavelength response of the filter exhibits a linear dependence when the length of the MMF is modified. Therefore a capillary tube filled with refractive-index-matching liquid is used to effectively increase the length of the MMF, and thus wavelength tuning is achieved. Using this filter a ring-based tunable erbium-doped fiber laser is demonstrated with a tunability of 30 nm, covering the full C-band.

Genetic study of multimodal imaging Alzheimer's disease progression score implicates novel loci.

PubMed

Scelsi, Marzia A; Khan, Raiyan R; Lorenzi, Marco; Christopher, Leigh; Greicius, Michael D; Schott, Jonathan M; Ourselin, Sebastien; Altmann, Andre

2018-05-30

Identifying genetic risk factors underpinning different aspects of Alzheimer's disease has the potential to provide important insights into pathogenesis. Moving away from simple case-control definitions, there is considerable interest in using quantitative endophenotypes, such as those derived from imaging as outcome measures. Previous genome-wide association studies of imaging-derived biomarkers in sporadic late-onset Alzheimer's disease focused only on phenotypes derived from single imaging modalities. In contrast, we computed a novel multi-modal neuroimaging phenotype comprising cortical amyloid burden and bilateral hippocampal volume. Both imaging biomarkers were used as input to a disease progression modelling algorithm, which estimates the biomarkers' long-term evolution curves from population-based longitudinal data. Among other parameters, the algorithm computes the shift in time required to optimally align a subjects' biomarker trajectories with these population curves. This time shift serves as a disease progression score and it was used as a quantitative trait in a discovery genome-wide association study with n = 944 subjects from the Alzheimer's Disease Neuroimaging Initiative database diagnosed as Alzheimer's disease, mild cognitive impairment or healthy at the time of imaging. We identified a genome-wide significant locus implicating LCORL (rs6850306, chromosome 4; P = 1.03 × 10-8). The top variant rs6850306 was found to act as an expression quantitative trait locus for LCORL in brain tissue. The clinical role of rs6850306 in conversion from healthy ageing to mild cognitive impairment or Alzheimer's disease was further validated in an independent cohort comprising healthy, older subjects from the National Alzheimer's Coordinating Center database. Specifically, possession of a minor allele at rs6850306 was protective against conversion from mild cognitive impairment to Alzheimer's disease in the National Alzheimer's Coordinating Center cohort (hazard

QIN DAWG Validation of Gradient Nonlinearity Bias Correction Workflow for Quantitative Diffusion-Weighted Imaging in Multicenter Trials.

PubMed

Malyarenko, Dariya I; Wilmes, Lisa J; Arlinghaus, Lori R; Jacobs, Michael A; Huang, Wei; Helmer, Karl G; Taouli, Bachir; Yankeelov, Thomas E; Newitt, David; Chenevert, Thomas L

2016-12-01

Previous research has shown that system-dependent gradient nonlinearity (GNL) introduces a significant spatial bias (nonuniformity) in apparent diffusion coefficient (ADC) maps. Here, the feasibility of centralized retrospective system-specific correction of GNL bias for quantitative diffusion-weighted imaging (DWI) in multisite clinical trials is demonstrated across diverse scanners independent of the scanned object. Using corrector maps generated from system characterization by ice-water phantom measurement completed in the previous project phase, GNL bias correction was performed for test ADC measurements from an independent DWI phantom (room temperature agar) at two offset locations in the bore. The precomputed three-dimensional GNL correctors were retrospectively applied to test DWI scans by the central analysis site. The correction was blinded to reference DWI of the agar phantom at magnet isocenter where the GNL bias is negligible. The performance was evaluated from changes in ADC region of interest histogram statistics before and after correction with respect to the unbiased reference ADC values provided by sites. Both absolute error and nonuniformity of the ADC map induced by GNL (median, 12%; range, -35% to +10%) were substantially reduced by correction (7-fold in median and 3-fold in range). The residual ADC nonuniformity errors were attributed to measurement noise and other non-GNL sources. Correction of systematic GNL bias resulted in a 2-fold decrease in technical variability across scanners (down to site temperature range). The described validation of GNL bias correction marks progress toward implementation of this technology in multicenter trials that utilize quantitative DWI.

QIN DAWG Validation of Gradient Nonlinearity Bias Correction Workflow for Quantitative Diffusion-Weighted Imaging in Multicenter Trials

PubMed Central

Malyarenko, Dariya I.; Wilmes, Lisa J.; Arlinghaus, Lori R.; Jacobs, Michael A.; Huang, Wei; Helmer, Karl G.; Taouli, Bachir; Yankeelov, Thomas E.; Newitt, David; Chenevert, Thomas L.

2017-01-01

Previous research has shown that system-dependent gradient nonlinearity (GNL) introduces a significant spatial bias (nonuniformity) in apparent diffusion coefficient (ADC) maps. Here, the feasibility of centralized retrospective system-specific correction of GNL bias for quantitative diffusion-weighted imaging (DWI) in multisite clinical trials is demonstrated across diverse scanners independent of the scanned object. Using corrector maps generated from system characterization by ice-water phantom measurement completed in the previous project phase, GNL bias correction was performed for test ADC measurements from an independent DWI phantom (room temperature agar) at two offset locations in the bore. The precomputed three-dimensional GNL correctors were retrospectively applied to test DWI scans by the central analysis site. The correction was blinded to reference DWI of the agar phantom at magnet isocenter where the GNL bias is negligible. The performance was evaluated from changes in ADC region of interest histogram statistics before and after correction with respect to the unbiased reference ADC values provided by sites. Both absolute error and nonuniformity of the ADC map induced by GNL (median, 12%; range, −35% to +10%) were substantially reduced by correction (7-fold in median and 3-fold in range). The residual ADC nonuniformity errors were attributed to measurement noise and other non-GNL sources. Correction of systematic GNL bias resulted in a 2-fold decrease in technical variability across scanners (down to site temperature range). The described validation of GNL bias correction marks progress toward implementation of this technology in multicenter trials that utilize quantitative DWI. PMID:28105469

A Multimodal Discourse Analysis of Tmall's Double Eleven Advertisement

ERIC Educational Resources Information Center

Hu, Chunyu; Luo, Mengxi

2016-01-01

From the 1990s, the multimodal turn in discourse studies makes multimodal discourse analysis a popular topic in linguistics and communication studies. An important approach to applying Systemic Functional Linguistics to non-verbal modes is Visual Grammar initially proposed by Kress and van Leeuwen (1996). Considering that commercial advertisement…

Optical/MRI Multimodality Molecular Imaging

NASA Astrophysics Data System (ADS)

Ma, Lixin; Smith, Charles; Yu, Ping

2007-03-01

Multimodality molecular imaging that combines anatomical and functional information has shown promise in development of tumor-targeted pharmaceuticals for cancer detection or therapy. We present a new multimodality imaging technique that combines fluorescence molecular tomography (FMT) and magnetic resonance imaging (MRI) for in vivo molecular imaging of preclinical tumor models. Unlike other optical/MRI systems, the new molecular imaging system uses parallel phase acquisition based on heterodyne principle. The system has a higher accuracy of phase measurements, reduced noise bandwidth, and an efficient modulation of the fluorescence diffuse density waves. Fluorescent Bombesin probes were developed for targeting breast cancer cells and prostate cancer cells. Tissue phantom and small animal experiments were performed for calibration of the imaging system and validation of the targeting probes.

Global optimization of multimode interference structure for ratiometric wavelength measurement

NASA Astrophysics Data System (ADS)

Wang, Qian; Farrell, Gerald; Hatta, Agus Muhamad

2007-07-01

The multimode interference structure is conventionally used as a splitter/combiner. In this paper, it is optimised as an edge filter for ratiometric wavelength measurement, which can be used in demodulation of fiber Bragg grating sensing. The global optimization algorithm-adaptive simulated annealing is introduced in the design of multimode interference structure including the length and width of the multimode waveguide section, and positions of the input and output waveguides. The designed structure shows a suitable spectral response for wavelength measurement and a good fabrication tolerance.

Multimodal registration via spatial-context mutual information.

PubMed

Yi, Zhao; Soatto, Stefano

2011-01-01

We propose a method to efficiently compute mutual information between high-dimensional distributions of image patches. This in turn is used to perform accurate registration of images captured under different modalities, while exploiting their local structure otherwise missed in traditional mutual information definition. We achieve this by organizing the space of image patches into orbits under the action of Euclidean transformations of the image plane, and estimating the modes of a distribution in such an orbit space using affinity propagation. This way, large collections of patches that are equivalent up to translations and rotations are mapped to the same representative, or "dictionary element". We then show analytically that computing mutual information for a joint distribution in this space reduces to computing mutual information between the (scalar) label maps, and between the transformations mapping each patch into its closest dictionary element. We show that our approach improves registration performance compared with the state of the art in multimodal registration, using both synthetic and real images with quantitative ground truth.

Multimodal Pressure-Flow Analysis: Application of Hilbert Huang Transform in Cerebral Blood Flow Regulation

NASA Astrophysics Data System (ADS)

Lo, Men-Tzung; Hu, Kun; Liu, Yanhui; Peng, C.-K.; Novak, Vera

2008-12-01

Quantification of nonlinear interactions between two nonstationary signals presents a computational challenge in different research fields, especially for assessments of physiological systems. Traditional approaches that are based on theories of stationary signals cannot resolve nonstationarity-related issues and, thus, cannot reliably assess nonlinear interactions in physiological systems. In this review we discuss a new technique called multimodal pressure flow (MMPF) method that utilizes Hilbert-Huang transformation to quantify interaction between nonstationary cerebral blood flow velocity (BFV) and blood pressure (BP) for the assessment of dynamic cerebral autoregulation (CA). CA is an important mechanism responsible for controlling cerebral blood flow in responses to fluctuations in systemic BP within a few heart-beats. The MMPF analysis decomposes BP and BFV signals into multiple empirical modes adaptively so that the fluctuations caused by a specific physiologic process can be represented in a corresponding empirical mode. Using this technique, we showed that dynamic CA can be characterized by specific phase delays between the decomposed BP and BFV oscillations, and that the phase shifts are significantly reduced in hypertensive, diabetics and stroke subjects with impaired CA. Additionally, the new technique can reliably assess CA using both induced BP/BFV oscillations during clinical tests and spontaneous BP/BFV fluctuations during resting conditions.

Quantitative validation of a nonlinear histology-MRI coregistration method using Generalized Q-sampling Imaging in complex human cortical white matter

PubMed Central

Gangolli, Mihika; Holleran, Laurena; Kim, Joong Hee; Stein, Thor D.; Alvarez, Victor; McKee, Ann C.; Brody, David L.

2017-01-01

Advanced diffusion MRI methods have recently been proposed for detection of pathologies such as traumatic axonal injury and chronic traumatic encephalopathy which commonly affect complex cortical brain regions. However, radiological-pathological correlations in human brain tissue that detail the relationship between the multi-component diffusion signal and underlying pathology are lacking. We present a nonlinear voxel based two dimensional coregistration method that is useful for matching diffusion signals to quantitative metrics of high resolution histological images. When validated in ex vivo human cortical tissue at a 250 × 250 × 500 micron spatial resolution, the method proved robust in correlations between generalized q-sampling imaging and histologically based white matter fiber orientations, with r = 0.94 for the primary fiber direction and r = 0.88 for secondary fiber direction in each voxel. Importantly, however, the correlation was substantially worse with reduced spatial resolution or with fiber orientations derived using a diffusion tensor model. Furthermore, we have detailed a quantitative histological metric of white matter fiber integrity termed power coherence capable of distinguishing between architecturally complex but intact white matter from disrupted white matter regions. These methods may allow for more sensitive and specific radiological-pathological correlations of neurodegenerative diseases affecting complex gray and white matter. PMID:28365421

Indigenous Ways with Literacies: Transgenerational, Multimodal, Placed, and Collective

ERIC Educational Resources Information Center

Mills, Kathy A.; Davis-Warra, John; Sewell, Marlene; Anderson, Mikayla

2016-01-01

This research describes some of the salient features of Indigenous ways of working with multimodal literacies in digital contexts of use that emerged within an Indigenous school community with the oversight of Aboriginal Elders. This is significant because the use of multimodal literacy practices among a growing number of Indigenous school…

Tinnitus Multimodal Imaging

DTIC Science & Technology

2016-12-01

images were segmented into gray and white matter images and spatially normalized to the MNI template (3 mm isotropic voxels) using the DARTEL toolbox in...AWARD NUMBER: W81XWH-13-1-0494 TITLE: Tinnitus Multimodal Imaging PRINCIPAL INVESTIGATOR: Steven Wan Cheung CONTRACTING ORGANIZATION... Medical Research and Materiel Command Fort Detrick, Maryland 21702-5012 DISTRIBUTION STATEMENT: Approved for Public Release; Distribution Unlimited

The dynamics of multimodal integration: The averaging diffusion model.

PubMed

Turner, Brandon M; Gao, Juan; Koenig, Scott; Palfy, Dylan; L McClelland, James

2017-12-01

We combine extant theories of evidence accumulation and multi-modal integration to develop an integrated framework for modeling multimodal integration as a process that unfolds in real time. Many studies have formulated sensory processing as a dynamic process where noisy samples of evidence are accumulated until a decision is made. However, these studies are often limited to a single sensory modality. Studies of multimodal stimulus integration have focused on how best to combine different sources of information to elicit a judgment. These studies are often limited to a single time point, typically after the integration process has occurred. We address these limitations by combining the two approaches. Experimentally, we present data that allow us to study the time course of evidence accumulation within each of the visual and auditory domains as well as in a bimodal condition. Theoretically, we develop a new Averaging Diffusion Model in which the decision variable is the mean rather than the sum of evidence samples and use it as a base for comparing three alternative models of multimodal integration, allowing us to assess the optimality of this integration. The outcome reveals rich individual differences in multimodal integration: while some subjects' data are consistent with adaptive optimal integration, reweighting sources of evidence as their relative reliability changes during evidence integration, others exhibit patterns inconsistent with optimality.

A Multimodal Discourse Analysis of a Yoruba Song-Drama

ERIC Educational Resources Information Center

Olateju, Moji. A.

2015-01-01

This paper presents a multimodal discourse analysis of a story that has been turned into a Yoruba song-drama, highlighting the ideational, interpersonal and textual aspects of the song-drama. The data is a short song-drama meant to teach children importunity, determination and hard work through persistence. The multimodal and narrative conventions…

Using waveform information in nonlinear data assimilation

NASA Astrophysics Data System (ADS)

Rey, Daniel; Eldridge, Michael; Morone, Uriel; Abarbanel, Henry D. I.; Parlitz, Ulrich; Schumann-Bischoff, Jan

2014-12-01

Information in measurements of a nonlinear dynamical system can be transferred to a quantitative model of the observed system to establish its fixed parameters and unobserved state variables. After this learning period is complete, one may predict the model response to new forces and, when successful, these predictions will match additional observations. This adjustment process encounters problems when the model is nonlinear and chaotic because dynamical instability impedes the transfer of information from the data to the model when the number of measurements at each observation time is insufficient. We discuss the use of information in the waveform of the data, realized through a time delayed collection of measurements, to provide additional stability and accuracy to this search procedure. Several examples are explored, including a few familiar nonlinear dynamical systems and small networks of Colpitts oscillators.

Kinetic theory of nonlinear diffusion in a weakly disordered nonlinear Schrödinger chain in the regime of homogeneous chaos.

PubMed

Basko, D M

2014-02-01

We study the discrete nonlinear Schröinger equation with weak disorder, focusing on the regime when the nonlinearity is, on the one hand, weak enough for the normal modes of the linear problem to remain well resolved but, on the other, strong enough for the dynamics of the normal mode amplitudes to be chaotic for almost all modes. We show that in this regime and in the limit of high temperature, the macroscopic density ρ satisfies the nonlinear diffusion equation with a density-dependent diffusion coefficient, D(ρ) = D(0)ρ(2). An explicit expression for D(0) is obtained in terms of the eigenfunctions and eigenvalues of the linear problem, which is then evaluated numerically. The role of the second conserved quantity (energy) in the transport is also quantitatively discussed.

Multimodal Behavior Therapy: Case Study of a High School Student.

ERIC Educational Resources Information Center

Seligman, Linda

1981-01-01

A case study of a high school student concerned with weight problems illustrates multimodal behavior therapy and its use in a high school setting. Multimodal therapy allows the school counselor to maximize referral sources while emphasizing growth and actualization. (JAC)

Process for Assembly of Multimode Hydrophone Ceramic Stack

DTIC Science & Technology

2016-09-20

PROCESS FOR ASSEMBLY OF MULTIMODE HYDROPHONE CERAMIC STACK STATEMENT OF GOVERNMENT INTEREST [0001] The invention described herein may be...invention relates to a method of assembly for a multimode acoustic hydrophone. (2) Description of the Prior Art [0004] An acoustic hydrophone can...performance difference of a hydrophone that does not have uniform axial stress/voltage on each ring, when the hydrophone is assembled and FIG. 13 thru FIG

Multimodal Image Registration through Simultaneous Segmentation.

PubMed

Aganj, Iman; Fischl, Bruce

2017-11-01

Multimodal image registration facilitates the combination of complementary information from images acquired with different modalities. Most existing methods require computation of the joint histogram of the images, while some perform joint segmentation and registration in alternate iterations. In this work, we introduce a new non-information-theoretical method for pairwise multimodal image registration, in which the error of segmentation - using both images - is considered as the registration cost function. We empirically evaluate our method via rigid registration of multi-contrast brain magnetic resonance images, and demonstrate an often higher registration accuracy in the results produced by the proposed technique, compared to those by several existing methods.

Content-based TV sports video retrieval using multimodal analysis

NASA Astrophysics Data System (ADS)

Yu, Yiqing; Liu, Huayong; Wang, Hongbin; Zhou, Dongru

2003-09-01

In this paper, we propose content-based video retrieval, which is a kind of retrieval by its semantical contents. Because video data is composed of multimodal information streams such as video, auditory and textual streams, we describe a strategy of using multimodal analysis for automatic parsing sports video. The paper first defines the basic structure of sports video database system, and then introduces a new approach that integrates visual stream analysis, speech recognition, speech signal processing and text extraction to realize video retrieval. The experimental results for TV sports video of football games indicate that the multimodal analysis is effective for video retrieval by quickly browsing tree-like video clips or inputting keywords within predefined domain.

Multi-Modal Hallucinations and Cognitive Function in Parkinson's Disease

PubMed Central

Katzen, Heather; Myerson, Connie; Papapetropoulos, Spiridon; Nahab, Fatta; Gallo, Bruno; Levin, Bonnie

2010-01-01

Background/Aims Hallucinations have been linked to a constellation of cognitive deficits in Parkinson's disease (PD), but it is not known whether multi-modal hallucinations are associated with greater neuropsychological dysfunction. Methods 152 idiopathic PD patients were categorized based on the presence or absence of hallucinations and then were further subdivided into visual-only (VHonly; n = 35) or multi-modal (VHplus; n = 12) hallucination groups. All participants underwent detailed neuropsychological assessment. Results Participants with hallucinations performed more poorly on select neuropsychological measures and exhibited more mood symptoms. There were no differences between VHonly and VHplus groups. Conclusions PD patients with multi-modal hallucinations are not at greater risk for neuropsychological impairment than those with single-modal hallucinations. PMID:20689283

Nonlinear damage detection in composite structures using bispectral analysis

NASA Astrophysics Data System (ADS)

Ciampa, Francesco; Pickering, Simon; Scarselli, Gennaro; Meo, Michele

2014-03-01

Literature offers a quantitative number of diagnostic methods that can continuously provide detailed information of the material defects and damages in aerospace and civil engineering applications. Indeed, low velocity impact damages can considerably degrade the integrity of structural components and, if not detected, they can result in catastrophic failure conditions. This paper presents a nonlinear Structural Health Monitoring (SHM) method, based on ultrasonic guided waves (GW), for the detection of the nonlinear signature in a damaged composite structure. The proposed technique, based on a bispectral analysis of ultrasonic input waveforms, allows for the evaluation of the nonlinear response due to the presence of cracks and delaminations. Indeed, such a methodology was used to characterize the nonlinear behaviour of the structure, by exploiting the frequency mixing of the original waveform acquired from a sparse array of sensors. The robustness of bispectral analysis was experimentally demonstrated on a damaged carbon fibre reinforce plastic (CFRP) composite panel, and the nonlinear source was retrieved with a high level of accuracy. Unlike other linear and nonlinear ultrasonic methods for damage detection, this methodology does not require any baseline with the undamaged structure for the evaluation of the nonlinear source, nor a priori knowledge of the mechanical properties of the specimen. Moreover, bispectral analysis can be considered as a nonlinear elastic wave spectroscopy (NEWS) technique for materials showing either classical or non-classical nonlinear behaviour.

A Framework and Toolkit for the Construction of Multimodal Learning Interfaces

DTIC Science & Technology

1998-04-29

human communication modalities in the context of a broad class of applications, specifically those that support state manipulation via parameterized actions. The multimodal semantic model is also the basis for a flexible, domain independent, incrementally trainable multimodal interpretation algorithm based on a connectionist network. The second major contribution is an application framework consisting of reusable components and a modular, distributed system architecture. Multimodal application developers can assemble the components in the framework into a new application,

Towards the future : the promise of intermodal and multimodal transportation systems

DOT National Transportation Integrated Search

1995-02-01

Issues relating to intermodal and multimodal transportation systems are introduced and defined. Intermodal and multimodal transportation solutons are assessed within the framework of legislative efforts such as Intermodal Surface Transportation Effic...

Relational Multimodal Freight Database Webinar

DOT National Transportation Integrated Search

2012-02-01

The relational Multimodal Freight Database (MFD) was developed as part of Texas Department : of Transportation (TxDOT) Research Project 0-6297 entitled Freight Planning Factors Impacting : Texas Commodity Flows, conducted by the Center for Transporta...

Using Multimodal Writing to Motivate Struggling Students to Write

ERIC Educational Resources Information Center

Darrington, Brett; Dousay, Tonia

2014-01-01

One of the reasons that many secondary students fail English classes is because they are not motivated to write. This literature review was conducted to look into the use of multimodal works to increase the motivation for struggling students to write. Change theory was used to evaluate the benefits of multimodal works compared to more traditional…

Osm-Oriented Method of Multimodal Route Planning

NASA Astrophysics Data System (ADS)

Li, X.; Wu, Q.; Chen, L.; Xiong, W.; Jing, N.

2015-07-01

With the increasing pervasiveness of basic facilitate of transportation and information, the need of multimodal route planning is becoming more essential in the fields of communication and transportation, urban planning, logistics management, etc. This article mainly described an OSM-oriented method of multimodal route planning. Firstly, it introduced how to extract the information we need from OSM data and build proper network model and storage model; then it analysed the accustomed cost standard adopted by most travellers; finally, we used shortest path algorithm to calculate the best route with multiple traffic means.

ITOHealth: a multimodal middleware-oriented integrated architecture for discovering medical entities.

PubMed

Alor-Hernández, Giner; Sánchez-Cervantes, José Luis; Juárez-Martínez, Ulises; Posada-Gómez, Rubén; Cortes-Robles, Guillermo; Aguilar-Laserre, Alberto

2012-03-01

Emergency healthcare is one of the emerging application domains for information services, which requires highly multimodal information services. The time of consuming pre-hospital emergency process is critical. Therefore, the minimization of required time for providing primary care and consultation to patients is one of the crucial factors when trying to improve the healthcare delivery in emergency situations. In this sense, dynamic location of medical entities is a complex process that needs time and it can be critical when a person requires medical attention. This work presents a multimodal location-based system for locating and assigning medical entities called ITOHealth. ITOHealth provides a multimodal middleware-oriented integrated architecture using a service-oriented architecture in order to provide information of medical entities in mobile devices and web browsers with enriched interfaces providing multimodality support. ITOHealth's multimodality is based on the use of Microsoft Agent Characters, the integration of natural language voice to the characters, and multi-language and multi-characters support providing an advantage for users with visual impairments.

An atlas-based multimodal registration method for 2D images with discrepancy structures.

PubMed

Lv, Wenchao; Chen, Houjin; Peng, Yahui; Li, Yanfeng; Li, Jupeng

2018-06-04

An atlas-based multimodal registration method for 2-dimension images with discrepancy structures was proposed in this paper. Atlas was utilized for complementing the discrepancy structure information in multimodal medical images. The scheme includes three steps: floating image to atlas registration, atlas to reference image registration, and field-based deformation. To evaluate the performance, a frame model, a brain model, and clinical images were employed in registration experiments. We measured the registration performance by the squared sum of intensity differences. Results indicate that this method is robust and performs better than the direct registration for multimodal images with discrepancy structures. We conclude that the proposed method is suitable for multimodal images with discrepancy structures. Graphical Abstract An Atlas-based multimodal registration method schematic diagram.

A new piezoelectric energy harvesting design concept: multimodal energy harvesting skin.

PubMed

Lee, Soobum; Youn, Byeng D

2011-03-01

This paper presents an advanced design concept for a piezoelectric energy harvesting (EH), referred to as multimodal EH skin. This EH design facilitates the use of multimodal vibration and enhances power harvesting efficiency. The multimodal EH skin is an extension of our previous work, EH skin, which was an innovative design paradigm for a piezoelectric energy harvester: a vibrating skin structure and an additional thin piezoelectric layer in one device. A computational (finite element) model of the multilayered assembly - the vibrating skin structure and piezoelectric layer - is constructed and the optimal topology and/or shape of the piezoelectric layer is found for maximum power generation from multiple vibration modes. A design rationale for the multimodal EH skin was proposed: designing a piezoelectric material distribution and external resistors. In the material design step, the piezoelectric material is segmented by inflection lines from multiple vibration modes of interests to minimize voltage cancellation. The inflection lines are detected using the voltage phase. In the external resistor design step, the resistor values are found for each segment to maximize power output. The presented design concept, which can be applied to any engineering system with multimodal harmonic-vibrating skins, was applied to two case studies: an aircraft skin and a power transformer panel. The excellent performance of multimodal EH skin was demonstrated, showing larger power generation than EH skin without segmentation or unimodal EH skin.

Multimodal Semiosis in Science Read-Alouds: Extending Beyond Text Delivery

NASA Astrophysics Data System (ADS)

Oliveira, Alandeom W.; Rivera, Seema; Glass, Rory; Mastroianni, Michael; Wizner, Francine; Amodeo, Vincent

2014-10-01

This study examines elementary teachers reading children's science books aloud to students in the US. Our findings show that science read-aloud semiosis (meaning-making) extends beyond text delivery. In addition to making a written text orally available to students, teachers also deploy different types of gestures (pointing and iconic gesticulation) and pictorial representations (narrative and conceptual) as they scaffold students' understandings. Further, teachers are shown to engage in two distinct forms of meaning-making: multimodal description and multimodal explanation. A conceptual framework is proposed that elementary science educators can use to systematically incorporate multimodality into aloud reading practices.

Increased discriminability of authenticity from multimodal laughter is driven by auditory information.

PubMed

Lavan, Nadine; McGettigan, Carolyn

2017-10-01

We present an investigation of the perception of authenticity in audiovisual laughter, in which we contrast spontaneous and volitional samples and examine the contributions of unimodal affective information to multimodal percepts. In a pilot study, we demonstrate that listeners perceive spontaneous laughs as more authentic than volitional ones, both in unimodal (audio-only, visual-only) and multimodal contexts (audiovisual). In the main experiment, we show that the discriminability of volitional and spontaneous laughter is enhanced for multimodal laughter. Analyses of relationships between affective ratings and the perception of authenticity show that, while both unimodal percepts significantly predict evaluations of audiovisual laughter, it is auditory affective cues that have the greater influence on multimodal percepts. We discuss differences and potential mismatches in emotion signalling through voices and faces, in the context of spontaneous and volitional behaviour, and highlight issues that should be addressed in future studies of dynamic multimodal emotion processing.

Multimodal Research: Addressing the Complexity of Multimodal Environments and the Challenges for CALL

ERIC Educational Resources Information Center

Tan, Sabine; O'Halloran, Kay L.; Wignell, Peter

2016-01-01

Multimodality, the study of the interaction of language with other semiotic resources such as images and sound resources, has significant implications for computer assisted language learning (CALL) with regards to understanding the impact of digital environments on language teaching and learning. In this paper, we explore recent manifestations of…

Interactivity in Educational Apps for Young Children: A Multimodal Analysis

ERIC Educational Resources Information Center

Blitz-Raith, Alexandra H.; Liu, Jianxin

2017-01-01

Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm…

Applications of Elpasolites as a Multimode Radiation Sensor

NASA Astrophysics Data System (ADS)

Guckes, Amber

This study consists of both computational and experimental investigations. The computational results enabled detector design selections and confirmed experimental results. The experimental results determined that the CLYC scintillation detector can be applied as a functional and field-deployable multimode radiation sensor. The computational study utilized MCNP6 code to investigate the response of CLYC to various incident radiations and to determine the feasibility of its application as a handheld multimode sensor and as a single-scintillator collimated directional detection system. These simulations include: • Characterization of the response of the CLYC scintillator to gamma-rays and neutrons; • Study of the isotopic enrichment of 7Li versus 6Li in the CLYC for optimal detection of both thermal neutrons and fast neutrons; • Analysis of collimator designs to determine the optimal collimator for the single CLYC sensor directional detection system to assay gamma rays and neutrons; Simulations of a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system with the optimized collimator to determine the feasibility of detecting nuclear materials that could be encountered during field operations. These nuclear materials include depleted uranium, natural uranium, low-enriched uranium, highly-enriched uranium, reactor-grade plutonium, and weapons-grade plutonium. The experimental study includes the design, construction, and testing of both a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system. Both were designed in the Inventor CAD software and based on results of the computational study to optimize its performance. The handheld CLYC multimode sensor is modular, scalable, low?power, and optimized for high count rates. Commercial?off?the?shelf components were used where possible in order to optimize size, increase robustness, and minimize cost. The handheld CLYC multimode

Nonlinear Ballistic Transport in an Atomically Thin Material.

PubMed

Boland, Mathias J; Sundararajan, Abhishek; Farrokhi, M Javad; Strachan, Douglas R

2016-01-26

Ultrashort devices that incorporate atomically thin components have the potential to be the smallest electronics. Such extremely scaled atomically thin devices are expected to show ballistic nonlinear behavior that could make them tremendously useful for ultrafast applications. While nonlinear diffusive electron transport has been widely reported, clear evidence for intrinsic nonlinear ballistic transport in the growing array of atomically thin conductors has so far been elusive. Here we report nonlinear electron transport of an ultrashort single-layer graphene channel that shows quantitative agreement with intrinsic ballistic transport. This behavior is shown to be distinctly different than that observed in similarly prepared ultrashort devices consisting, instead, of bilayer graphene channels. These results suggest that the addition of only one extra layer of an atomically thin material can make a significant impact on the nonlinear ballistic behavior of ultrashort devices, which is possibly due to the very different chiral tunneling of their charge carriers. The fact that we observe the nonlinear ballistic response at room temperature, with zero applied magnetic field, in non-ultrahigh vacuum conditions and directly on a readily accessible oxide substrate makes the nanogap technology we utilize of great potential for achieving extremely scaled high-speed atomically thin devices.

Diagnosis of major depressive disorder by combining multimodal information from heart rate dynamics and serum proteomics using machine-learning algorithm.

PubMed

Kim, Eun Young; Lee, Min Young; Kim, Se Hyun; Ha, Kyooseob; Kim, Kwang Pyo; Ahn, Yong Min

2017-06-02

Major depressive disorder (MDD) is a systemic and multifactorial disorder that involves abnormalities in multiple biochemical pathways and the autonomic nervous system. This study applied a machine-learning method to classify MDD and control groups by incorporating data from serum proteomic analysis and heart rate variability (HRV) analysis for the identification of novel peripheral biomarkers. The study subjects consisted of 25 drug-free female MDD patients and 25 age- and sex-matched healthy controls. First, quantitative serum proteome profiles were analyzed by liquid chromatography-tandem mass spectrometry using pooled serum samples from 10 patients and 10 controls. Next, candidate proteins were quantified with multiple reaction monitoring (MRM) in 50 subjects. We also analyzed 22 linear and nonlinear HRV parameters in 50 subjects. Finally, we identified a combined biomarker panel consisting of proteins and HRV indexes using a support vector machine with recursive feature elimination. A separation between MDD and control groups was achieved using five parameters (apolipoprotein B, group-specific component, ceruloplasmin, RMSSD, and SampEn) at 80.1% classification accuracy. A combination of HRV and proteomic data achieved better classification accuracy. A high classification accuracy can be achieved by combining multimodal information from heart rate dynamics and serum proteomics in MDD. Our approach can be helpful for accurate clinical diagnosis of MDD. Further studies using larger, independent cohorts are needed to verify the role of these candidate biomarkers for MDD diagnosis. Copyright © 2017 Elsevier Inc. All rights reserved.

Multimodal Imaging of the Normal Eye.

PubMed

Kawali, Ankush; Pichi, Francesco; Avadhani, Kavitha; Invernizzi, Alessandro; Hashimoto, Yuki; Mahendradas, Padmamalini

2017-10-01

Multimodal imaging is the concept of "bundling" images obtained from various imaging modalities, viz., fundus photograph, fundus autofluorescence imaging, infrared (IR) imaging, simultaneous fluorescein and indocyanine angiography, optical coherence tomography (OCT), and, more recently, OCT angiography. Each modality has its pros and cons as well as its limitations. Combination of multiple imaging techniques will overcome their individual weaknesses and give a comprehensive picture. Such approach helps in accurate localization of a lesion and understanding the pathology in posterior segment. It is important to know imaging of normal eye before one starts evaluating pathology. This article describes multimodal imaging modalities in detail and discusses healthy eye features as seen on various imaging modalities mentioned above.

Multimode-Optical-Fiber Imaging Probe

NASA Technical Reports Server (NTRS)

Jackson, Deborah

1999-01-01

Currently, endoscopic surgery uses single-mode fiber-bundles to obtain in vivo image information inside the orifices of the body. This limits their use to the larger natural orifices and to surgical procedures where there is plenty of room for manipulation. The knee joint, for example, can be easily viewed with a fiber optic viewer, but joints in the finger cannot. However, there are a host of smaller orifices where fiber endoscopy would play an important role if a cost effective fiber probe were developed with small enough dimensions (less than or equal to 250 microns). Examples of beneficiaries of micro-endoscopes are the treatment of the Eustatian tube of the middle ear, the breast ducts, tear ducts, coronary arteries, fallopian tubes, as well as the treatment of salivary duct parotid disease, and the neuro endoscopy of the ventricles and spinal canal. This work describes an approach for recovering images from tightly confined spaces using multimode. The concept draws upon earlier works that concentrated on image recovery after two-way transmission through a multimode fiber as well as work that demonstrated the recovery of images after one-way transmission through a multimode fiber. Both relied on generating a phase conjugated wavefront, which was predistorted with the characteristics of the fiber. The approach described here also relies on generating a phase conjugated wavefront, but utilizes two fibers to capture the image at some intermediate point (accessible by the fibers, but which is otherwise visually inaccessible).

New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

ERIC Educational Resources Information Center

Williams, Wendy R.

2014-01-01

This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

Sharing a Multimodal Corpus to Study Webcam-Mediated Language Teaching

ERIC Educational Resources Information Center

Guichon, Nicolas

2017-01-01

This article proposes a methodology to create a multimodal corpus that can be shared with a group of researchers in order to analyze synchronous online pedagogical interactions. Epistemological aspects involved in studying online interactions from a multimodal and semiotic perspective are addressed. Then, issues and challenges raised by corpus…

Toward multimodal signal detection of adverse drug reactions.

PubMed

Harpaz, Rave; DuMouchel, William; Schuemie, Martijn; Bodenreider, Olivier; Friedman, Carol; Horvitz, Eric; Ripple, Anna; Sorbello, Alfred; White, Ryen W; Winnenburg, Rainer; Shah, Nigam H

2017-12-01

Improving mechanisms to detect adverse drug reactions (ADRs) is key to strengthening post-marketing drug safety surveillance. Signal detection is presently unimodal, relying on a single information source. Multimodal signal detection is based on jointly analyzing multiple information sources. Building on, and expanding the work done in prior studies, the aim of the article is to further research on multimodal signal detection, explore its potential benefits, and propose methods for its construction and evaluation. Four data sources are investigated; FDA's adverse event reporting system, insurance claims, the MEDLINE citation database, and the logs of major Web search engines. Published methods are used to generate and combine signals from each data source. Two distinct reference benchmarks corresponding to well-established and recently labeled ADRs respectively are used to evaluate the performance of multimodal signal detection in terms of area under the ROC curve (AUC) and lead-time-to-detection, with the latter relative to labeling revision dates. Limited to our reference benchmarks, multimodal signal detection provides AUC improvements ranging from 0.04 to 0.09 based on a widely used evaluation benchmark, and a comparative added lead-time of 7-22 months relative to labeling revision dates from a time-indexed benchmark. The results support the notion that utilizing and jointly analyzing multiple data sources may lead to improved signal detection. Given certain data and benchmark limitations, the early stage of development, and the complexity of ADRs, it is currently not possible to make definitive statements about the ultimate utility of the concept. Continued development of multimodal signal detection requires a deeper understanding the data sources used, additional benchmarks, and further research on methods to generate and synthesize signals. Copyright © 2017 Elsevier Inc. All rights reserved.

Multimodality bonchoscopic imaging of tracheopathica osteochondroplastica

NASA Astrophysics Data System (ADS)

Colt, Henri; Murgu, Septimiu D.; Ahn, Yeh-Chan; Brenner, Matt

2009-05-01

Results of a commercial optical coherence tomography system used as part of a multimodality diagnostic bronchoscopy platform are presented for a 61-year-old patient with central airway obstruction from tracheopathica osteochondroplastica. Comparison to results of white-light bronchoscopy, histology, and endobronchial ultrasound examination are accompanied by a discussion of resolution, penetration depth, contrast, and field of view of these imaging modalities. White-light bronchoscopy revealed irregularly shaped, firm submucosal nodules along cartilaginous structures of the anterior and lateral walls of the trachea, sparing the muscular posterior membrane. Endobronchial ultrasound showed a hyperechoic density of 0.4 cm thickness. optical coherence tomography (OCT) was performed using a commercially available, compact time-domain OCT system (Niris System, Imalux Corp., Cleveland, Ohio) with a magnetically actuating probe (two-dimensional, front imaging, and inside actuation). Images showed epithelium, upper submucosa, and osseous submucosal nodule layers corresponding with histopathology. To our knowledge, this is the first time these commercially available systems are used as part of a multimodality bronchoscopy platform to study diagnostic imaging of a benign disease causing central airway obstruction. Further studies are needed to optimize these systems for pulmonary applications and to determine how new-generation imaging modalities will be integrated into a multimodality bronchoscopy platform.

Medical Image Retrieval: A Multimodal Approach

PubMed Central

Cao, Yu; Steffey, Shawn; He, Jianbiao; Xiao, Degui; Tao, Cui; Chen, Ping; Müller, Henning

2014-01-01

Medical imaging is becoming a vital component of war on cancer. Tremendous amounts of medical image data are captured and recorded in a digital format during cancer care and cancer research. Facing such an unprecedented volume of image data with heterogeneous image modalities, it is necessary to develop effective and efficient content-based medical image retrieval systems for cancer clinical practice and research. While substantial progress has been made in different areas of content-based image retrieval (CBIR) research, direct applications of existing CBIR techniques to the medical images produced unsatisfactory results, because of the unique characteristics of medical images. In this paper, we develop a new multimodal medical image retrieval approach based on the recent advances in the statistical graphic model and deep learning. Specifically, we first investigate a new extended probabilistic Latent Semantic Analysis model to integrate the visual and textual information from medical images to bridge the semantic gap. We then develop a new deep Boltzmann machine-based multimodal learning model to learn the joint density model from multimodal information in order to derive the missing modality. Experimental results with large volume of real-world medical images have shown that our new approach is a promising solution for the next-generation medical imaging indexing and retrieval system. PMID:26309389

Wavelength tuning of multimode interference bandpass filters by mechanical bending: experiment and theory in comparison

NASA Astrophysics Data System (ADS)

Walbaum, T.; Fallnich, C.

2012-07-01

We present the tuning of multimode interference bandpass filters made of standard fibers by mechanical bending. Our setup allows continuous adjustment of the bending radius from infinity down to about 5 cm. The impact of bending on the transmission spectrum and on polarization is investigated experimentally, and a filter with a continuous tuning range of 13.6 nm and 86 % peak transmission was realized. By use of numerical simulations employing a semi-analytical mode expansion approach, we obtain quantitative understanding of the underlying physics. Further breakdown of the governing equations enables us to identify the fiber parameters that are relevant for the design of customized filters.

Resonance-induced multimodal body-size distributions in ecosystems

PubMed Central

Lampert, Adam; Tlusty, Tsvi

2013-01-01

The size of an organism reflects its metabolic rate, growth rate, mortality, and other important characteristics; therefore, the distribution of body size is a major determinant of ecosystem structure and function. Body-size distributions often are multimodal, with several peaks of abundant sizes, and previous studies suggest that this is the outcome of niche separation: species from distinct peaks avoid competition by consuming different resources, which results in selection of different sizes in each niche. However, this cannot explain many ecosystems with several peaks competing over the same niche. Here, we suggest an alternative, generic mechanism underlying multimodal size distributions, by showing that the size-dependent tradeoff between reproduction and resource utilization entails an inherent resonance that may induce multiple peaks, all competing over the same niche. Our theory is well fitted to empirical data in various ecosystems, in which both model and measurements show a multimodal, periodically peaked distribution at larger sizes, followed by a smooth tail at smaller sizes. Moreover, we show a universal pattern of size distributions, manifested in the collapse of data from ecosystems of different scales: phytoplankton in a lake, metazoans in a stream, and arthropods in forests. The demonstrated resonance mechanism is generic, suggesting that multimodal distributions of numerous ecological characters emerge from the interplay between local competition and global migration. PMID:23248320

A multimodal image sensor system for identifying water stress in grapevines

NASA Astrophysics Data System (ADS)

Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

2012-11-01

Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

The influence of compressibility on nonlinear spectral energy transfer - Part 1: Fundamental mechanisms

NASA Astrophysics Data System (ADS)

Praturi, Divya Sri; Girimaji, Sharath

2017-11-01

Nonlinear spectral energy transfer by triadic interactions is one of the foundational processes in fluid turbulence. Much of our current knowledge of this process is contingent upon pressure being a Lagrange multiplier with the only function of re-orienting the velocity wave vector. In this study, we examine how the nonlinear spectral transfer is affected in compressible turbulence when pressure is a true thermodynamic variable with a wave character. We perform direct numerical simulations of multi-mode evolution at different turbulent Mach numbers of Mt = 0.03 , 0.6 . Simulations are performed with initial modes that are fully solenoidal, fully dilatational and mixed solenoidal-dilatational. It is shown that solenoidal-solenoidal interactions behave in canonical manner at all Mach numbers. However, dilatational and mixed mode interactions are profoundly different. This is due to the fact that wave-pressure leads to kinetic-internal energy exchange via the pressure-dilatation mechanism. An important consequence of this exchange is that the triple correlation term, responsible for spectral transfer, experiences non-monotonic behavior resulting in inefficient energy transfer to other modes.

Managing Multimodal Data in Virtual World Research for Language Learning

ERIC Educational Resources Information Center

Palomeque, Cristina; Pujolà, Joan-Tomàs

2018-01-01

The study of multimodality in communication has attracted the attention of researchers studying online multimodal environments such as virtual worlds. Specifically, 3D virtual worlds have especially attracted the interest of educators and academics due to the multiplicity of verbal channels, which are often comprised of text and voice channels, as…

Multiscale climate emulator of multimodal wave spectra: MUSCLE-spectra

NASA Astrophysics Data System (ADS)

Rueda, Ana; Hegermiller, Christie A.; Antolinez, Jose A. A.; Camus, Paula; Vitousek, Sean; Ruggiero, Peter; Barnard, Patrick L.; Erikson, Li H.; Tomás, Antonio; Mendez, Fernando J.

2017-02-01

Characterization of multimodal directional wave spectra is important for many offshore and coastal applications, such as marine forecasting, coastal hazard assessment, and design of offshore wave energy farms and coastal structures. However, the multivariate and multiscale nature of wave climate variability makes this complex problem tractable using computationally expensive numerical models. So far, the skill of statistical-downscaling model-based parametric (unimodal) wave conditions is limited in large ocean basins such as the Pacific. The recent availability of long-term directional spectral data from buoys and wave hindcast models allows for development of stochastic models that include multimodal sea-state parameters. This work introduces a statistical downscaling framework based on weather types to predict multimodal wave spectra (e.g., significant wave height, mean wave period, and mean wave direction from different storm systems, including sea and swells) from large-scale atmospheric pressure fields. For each weather type, variables of interest are modeled using the categorical distribution for the sea-state type, the Generalized Extreme Value (GEV) distribution for wave height and wave period, a multivariate Gaussian copula for the interdependence between variables, and a Markov chain model for the chronology of daily weather types. We apply the model to the southern California coast, where local seas and swells from both the Northern and Southern Hemispheres contribute to the multimodal wave spectrum. This work allows attribution of particular extreme multimodal wave events to specific atmospheric conditions, expanding knowledge of time-dependent, climate-driven offshore and coastal sea-state conditions that have a significant influence on local nearshore processes, coastal morphology, and flood hazards.

Multiscale Climate Emulator of Multimodal Wave Spectra: MUSCLE-spectra

NASA Astrophysics Data System (ADS)

Rueda, A.; Hegermiller, C.; Alvarez Antolinez, J. A.; Camus, P.; Vitousek, S.; Ruggiero, P.; Barnard, P.; Erikson, L. H.; Tomas, A.; Mendez, F. J.

2016-12-01

Characterization of multimodal directional wave spectra is important for many offshore and coastal applications, such as marine forecasting, coastal hazard assessment, and design of offshore wave energy farms and coastal structures. However, the multivariate and multiscale nature of wave climate variability makes this problem complex yet tractable using computationally-expensive numerical models. So far, the skill of statistical-downscaling models based parametric (unimodal) wave conditions is limited in large ocean basins such as the Pacific. The recent availability of long-term directional spectral data from buoys and wave hindcast models allows for development of stochastic models that include multimodal sea-state parameters. This work introduces a statistical-downscaling framework based on weather types to predict multimodal wave spectra (e.g., significant wave height, mean wave period, and mean wave direction from different storm systems, including sea and swells) from large-scale atmospheric pressure fields. For each weather type, variables of interest are modeled using the categorical distribution for the sea-state type, the Generalized Extreme Value (GEV) distribution for wave height and wave period, a multivariate Gaussian copula for the interdependence between variables, and a Markov chain model for the chronology of daily weather types. We apply the model to the Southern California coast, where local seas and swells from both the Northern and Southern Hemispheres contribute to the multimodal wave spectrum. This work allows attribution of particular extreme multimodal wave events to specific atmospheric conditions, expanding knowledge of time-dependent, climate-driven offshore and coastal sea-state conditions that have a significant influence on local nearshore processes, coastal morphology, and flood hazards.

Reliability of Travel Time: Challenges Posed by a Multimodal Transport Participation

NASA Astrophysics Data System (ADS)

Wanjek, Monika; Hauger, Georg

2017-10-01

Travel time reliability represents an essential component in individual decision making processes for transport participants, particularly regarding mode choices. As criteria that describe the quality of both transportation systems and transportation modes, travel time reliability is already frequently compiled, analysed and quoted as an argument. Currently, travel time reliability is solely mentioned on monomodal trips, while it has remained unconsidered on multimodal transport participation. Given the fact that multimodality gained significantly in importance, it is crucial to discuss how travel time reliability could be determined on multimodal trips. This paper points out the challenges that occur for applying travel time reliability on multimodal transport participation. Therefore, examples will be given within this paper. In order to illustrate theoretical ideas, trips and influencing factors that could be expected within the everyday transport behaviour of commuters in a (sub)urban area will be described.

Multimodality: a basis for augmentative and alternative communication--psycholinguistic, cognitive, and clinical/educational aspects.

PubMed

Loncke, Filip T; Campbell, Jamie; England, Amanda M; Haley, Tanya

2006-02-15

Message generating is a complex process involving a number of processes, including the selection of modes to use. When expressing a message, human communicators typically use a combination of modes. This phenomenon is often termed multimodality. This article explores the use of models that explain multimodality as an explanatory framework for augmentative and alternative communication (AAC). Multimodality is analysed from a communication, psycholinguistic, and cognitive perspective. Theoretical and applied topics within AAC can be explained or described within the multimodality framework considering iconicity, simultaneous communication, lexical organization, and compatibility of communication modes. Consideration of multimodality is critical to understanding underlying processes in individuals who use AAC and individuals who interact with them.

The Work of Comics Collaborations: Considerations of Multimodal Composition for Writing Scholarship and Pedagogy

ERIC Educational Resources Information Center

Scanlon, Molly J.

2015-01-01

Though multimodality is increasingly incorporated into our pedagogies and scholarship, explorations of collaborative multimodal composition are lacking. Existing literature on collaborative writing focuses predominately on texts either composed in singular modes or by a single author, neglecting the ways in which multimodal texts are composed…

An integrated GIS-based data model for multimodal urban public transportation analysis and management

NASA Astrophysics Data System (ADS)

Chen, Shaopei; Tan, Jianjun; Ray, C.; Claramunt, C.; Sun, Qinqin

2008-10-01

Diversity is one of the main characteristics of transportation data collected from multiple sources or formats, which can be extremely complex and disparate. Moreover, these multimodal transportation data are usually characterised by spatial and temporal properties. Multimodal transportation network data modelling involves both an engineering and research domain that has attracted the design of a number of spatio-temporal data models in the geographic information system (GIS). However, the application of these specific models to multimodal transportation network is still a challenging task. This research addresses this challenge from both integrated multimodal data organization and object-oriented modelling perspectives, that is, how a complex urban transportation network should be organized, represented and modeled appropriately when considering a multimodal point of view, and using object-oriented modelling method. We proposed an integrated GIS-based data model for multimodal urban transportation network that lays a foundation to enhance the multimodal transportation network analysis and management. This modelling method organizes and integrates multimodal transit network data, and supports multiple representations for spatio-temporal objects and relationship as both visual and graphic views. The data model is expressed by using a spatio-temporal object-oriented modelling method, i.e., the unified modelling language (UML) extended to spatial and temporal plug-in for visual languages (PVLs), which provides an essential support to the spatio-temporal data modelling for transportation GIS.

The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS).

PubMed

Menze, Bjoern H; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-André; Arbel, Tal; Avants, Brian B; Ayache, Nicholas; Buendia, Patricia; Collins, D Louis; Cordier, Nicolas; Corso, Jason J; Criminisi, Antonio; Das, Tilak; Delingette, Hervé; Demiralp, Çağatay; Durst, Christopher R; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M; Jena, Raj; John, Nigel M; Konukoglu, Ender; Lashkari, Danial; Mariz, José Antonió; Meier, Raphael; Pereira, Sérgio; Precup, Doina; Price, Stephen J; Raviv, Tammy Riklin; Reza, Syed M S; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A; Sousa, Nuno; Subbanna, Nagesh K; Szekely, Gabor; Taylor, Thomas J; Thomas, Owen M; Tustison, Nicholas J; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen

2015-10-01

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients-manually annotated by up to four raters-and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

Advanced Multimodal Solutions for Information Presentation

NASA Technical Reports Server (NTRS)

Wenzel, Elizabeth M.; Godfroy-Cooper, Martine

2018-01-01

High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a

Clinical Nonlinear Laser Imaging of Human Skin: A Review

PubMed Central

Pavone, Francesco Saverio

2014-01-01

Nonlinear optical microscopy has the potential of being used in vivo as a noninvasive imaging modality for both epidermal and dermal imaging. This paper reviews the capabilities of nonlinear microscopy as a noninvasive high-resolution tool for clinical skin inspection. In particular, we show that two-photon fluorescence microscopy can be used as a diagnostic tool for characterizing epidermal layers by means of a morphological examination. Additional functional information on the metabolic state of cells can be provided by measuring the fluorescence decay of NADH. This approach allows differentiating epidermal layers having different structural and cytological features and has the potential of diagnosing pathologies in a very early stage. Regarding therapy follow-up, we demonstrate that nonlinear microscopy could be successfully used for monitoring the effect of a treatment. In particular, combined two-photon fluorescence and second-harmonic generation microscopy were used in vivo for monitoring collagen remodeling after microablative fractional laser resurfacing and for quantitatively monitoring psoriasis on the basis of the morphology of epidermal cells and dermal papillae. We believe that the described microscopic modalities could find in the near future a stable place in a clinical dermatological setting for quantitative diagnostic purposes and as a monitoring method for various treatments. PMID:25250337

Remixing My Life: The Multimodal Literacy Memoir Assignment and STEM

ERIC Educational Resources Information Center

Pytash, Kristine E.; Kist, William; Testa, Elizabeth

2017-01-01

The authors explore the experiences and multimodal compositions of a student at a STEM (science, technology, engineering, and mathematics) high school who opted to take an elective course on multimodal autobiography. They document how her meaning making included her beliefs and perspectives about the world, as well as a finely developed aesthetic…

The Effects of Multimodality through Storytelling Using Various Movie Clips

ERIC Educational Resources Information Center

Kim, SoHee

2016-01-01

This study examines the salient multimodal approaches for communicative competence and learners' reactions through storytelling tasks with three different modes: a silent movie clip, a movie clip with only sound effects, and a movie clip with sound effects and dialogue. In order to measure different multimodal effects and to define better delivery…

Nonlinearity: The History and Philosophy of the Science

ERIC Educational Resources Information Center

Burke, Kenneth M.

2009-01-01

This article provides for a concise history of nonlinearity from the context of the changing assumptions in science throughout the turn of the twentieth century. Concerned with the development of an ethics of technology in higher education, it establishes a background for ongoing research on quantitative methods in the social sciences. The history…

A Multimodal Search Engine for Medical Imaging Studies.

PubMed

Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

2017-02-01

The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

Nonlinear mechanical behavior of thermoplastic matrix materials for advanced composites

NASA Technical Reports Server (NTRS)

Arenz, R. J.; Landel, R. F.

1989-01-01

Two recent theories of nonlinear mechanical response are quantitatively compared and related to experimental data. Computer techniques are formulated to handle the numerical integration and iterative procedures needed to solve the associated sets of coupled nonlinear differential equations. Problems encountered during these formulations are discussed and some open questions described. Bearing in mind these cautions, the consequences of changing parameters that appear in the formulations on the resulting engineering properties are discussed. Hence, engineering approaches to the analysis of thermoplastic matrix material can be suggested.

Sensei: A Multi-Modal Framework for Assessing Stress Resiliency

DTIC Science & Technology

2013-04-30

DATE MAY2013 2. REPORT TYPE 4. TITLE AND SUBTITLE Sensei: A Multi-Modal Framework for Assessing Stress Resiliency 6. AUTHOR(S) 7. PERFORMING...Report: Distribution A Page 1 of 3 SRI International (Sarnoff) Document Sensei: A Multi-Modal Framework for Assessing Stress Resiliency (April... Stress Markers in Real-Time in Lab Environment with graded exposure to ICT’s scenarios MAC 1-6 During this reporting period, we established

Optical sensor in planar configuration based on multimode interference

NASA Astrophysics Data System (ADS)

Blahut, Marek

2017-08-01

In the paper a numerical analysis of optical sensors based on multimode interference in planar one-dimensional step-index configuration is presented. The structure consists in single-mode input and output waveguides and multimode waveguide which guide only few modes. Material parameters discussed refer to a SU8 polymer waveguide on SiO2 substrate. The optical system described will be designed to the analysis of biological substances.

Multimode-Optical-Fiber Imaging Probe

NASA Technical Reports Server (NTRS)

Jackson, Deborah

2000-01-01

Currently, endoscopic surgery uses single-mode fiber-bundles to obtain in vivo image information inside orifices of the body. This limits their use to the larger natural bodily orifices and to surgical procedures where there is plenty of room for manipulation. The knee joint, for example can be easily viewed with a fiber optic viewer, but joints in the finger cannot. However, there are a host of smaller orifices where fiber endoscopy would play an important role if a cost effective fiber probe were developed with small enough dimensions (< 250 microns). Examples of beneficiaries of micro-endoscopes are the treatment of the Eustatian tube of the middle ear, the breast ducts, tear ducts, coronary arteries, fallopian tubes, as well as the treatment of salivary duct parotid disease, and the neuro endoscopy of the ventricles and spinal canal. To solve this problem, this work describes an approach for recovering images from. tightly confined spaces using multimode fibers and analytically demonstrates that the concept is sound. The proof of concept draws upon earlier works that concentrated on image recovery after two-way transmission through a multimode fiber as well as work that demonstrated the recovery of images after one-way transmission through a multimode fiber. Both relied on generating a phase conjugated wavefront which was predistorted with the characteristics of the fiber. The described approach also relies on generating a phase conjugated wavefront, but utilizes two fibers to capture the image at some intermediate point (accessible by the fibers, but which is otherwise visually unaccessible).

Chaos, patterns, coherent structures, and turbulence: Reflections on nonlinear science.

PubMed

Ecke, Robert E

2015-09-01

The paradigms of nonlinear science were succinctly articulated over 25 years ago as deterministic chaos, pattern formation, coherent structures, and adaptation/evolution/learning. For chaos, the main unifying concept was universal routes to chaos in general nonlinear dynamical systems, built upon a framework of bifurcation theory. Pattern formation focused on spatially extended nonlinear systems, taking advantage of symmetry properties to develop highly quantitative amplitude equations of the Ginzburg-Landau type to describe early nonlinear phenomena in the vicinity of critical points. Solitons, mathematically precise localized nonlinear wave states, were generalized to a larger and less precise class of coherent structures such as, for example, concentrated regions of vorticity from laboratory wake flows to the Jovian Great Red Spot. The combination of these three ideas was hoped to provide the tools and concepts for the understanding and characterization of the strongly nonlinear problem of fluid turbulence. Although this early promise has been largely unfulfilled, steady progress has been made using the approaches of nonlinear science. I provide a series of examples of bifurcations and chaos, of one-dimensional and two-dimensional pattern formation, and of turbulence to illustrate both the progress and limitations of the nonlinear science approach. As experimental and computational methods continue to improve, the promise of nonlinear science to elucidate fluid turbulence continues to advance in a steady manner, indicative of the grand challenge nature of strongly nonlinear multi-scale dynamical systems.

Investigation of protein selectivity in multimodal chromatography using in silico designed Fab fragment variants.

PubMed

Karkov, Hanne Sophie; Krogh, Berit Olsen; Woo, James; Parimal, Siddharth; Ahmadian, Haleh; Cramer, Steven M

2015-11-01

In this study, a unique set of antibody Fab fragments was designed in silico and produced to examine the relationship between protein surface properties and selectivity in multimodal chromatographic systems. We hypothesized that multimodal ligands containing both hydrophobic and charged moieties would interact strongly with protein surface regions where charged groups and hydrophobic patches were in close spatial proximity. Protein surface property characterization tools were employed to identify the potential multimodal ligand binding regions on the Fab fragment of a humanized antibody and to evaluate the impact of mutations on surface charge and hydrophobicity. Twenty Fab variants were generated by site-directed mutagenesis, recombinant expression, and affinity purification. Column gradient experiments were carried out with the Fab variants in multimodal, cation-exchange, and hydrophobic interaction chromatographic systems. The results clearly indicated that selectivity in the multimodal system was different from the other chromatographic modes examined. Column retention data for the reduced charge Fab variants identified a binding site comprising light chain CDR1 as the main electrostatic interaction site for the multimodal and cation-exchange ligands. Furthermore, the multimodal ligand binding was enhanced by additional hydrophobic contributions as evident from the results obtained with hydrophobic Fab variants. The use of in silico protein surface property analyses combined with molecular biology techniques, protein expression, and chromatographic evaluations represents a previously undescribed and powerful approach for investigating multimodal selectivity with complex biomolecules. © 2015 Wiley Periodicals, Inc.

Multimodal Neuroimaging in Schizophrenia: Description and Dissemination.

PubMed

Aine, C J; Bockholt, H J; Bustillo, J R; Cañive, J M; Caprihan, A; Gasparovic, C; Hanlon, F M; Houck, J M; Jung, R E; Lauriello, J; Liu, J; Mayer, A R; Perrone-Bizzozero, N I; Posse, S; Stephen, J M; Turner, J A; Clark, V P; Calhoun, Vince D

2017-10-01

In this paper we describe an open-access collection of multimodal neuroimaging data in schizophrenia for release to the community. Data were acquired from approximately 100 patients with schizophrenia and 100 age-matched controls during rest as well as several task activation paradigms targeting a hierarchy of cognitive constructs. Neuroimaging data include structural MRI, functional MRI, diffusion MRI, MR spectroscopic imaging, and magnetoencephalography. For three of the hypothesis-driven projects, task activation paradigms were acquired on subsets of ~200 volunteers which examined a range of sensory and cognitive processes (e.g., auditory sensory gating, auditory/visual multisensory integration, visual transverse patterning). Neuropsychological data were also acquired and genetic material via saliva samples were collected from most of the participants and have been typed for both genome-wide polymorphism data as well as genome-wide methylation data. Some results are also presented from the individual studies as well as from our data-driven multimodal analyses (e.g., multimodal examinations of network structure and network dynamics and multitask fMRI data analysis across projects). All data will be released through the Mind Research Network's collaborative informatics and neuroimaging suite (COINS).

Nanoelectronics enabled chronic multimodal neural platform in a mouse ischemic model

PubMed Central

Luan, Lan; Sullender, Colin T.; Li, Xue; Zhao, Zhengtuo; Zhu, Hanlin; Wei, Xiaoling; Xie, Chong; Dunn, Andrew K.

2018-01-01

Background Despite significant advancements of optical imaging techniques for mapping hemodynamics in small animal models, it remains challenging to combine imaging with spatially resolved electrical recording of individual neurons especially for longitudinal studies. This is largely due to the strong invasiveness to the living brain from the penetrating electrodes and their limited compatibility with longitudinal imaging. New Method We implant arrays of ultraflexible nanoelectronic threads (NETs) in mice for neural recording both at the brain surface and intracortically, which maintain great tissue compatibility chronically. By mounting a cranial window atop of the NET arrays that allows for chronic optical access, we establish a multimodal platform that combines spatially resolved electrical recording of neural activity and laser speckle contrast imaging (LSCI) of cerebral blood flow (CBF) for longitudinal studies. Results We induce peri-infarct depolarizations (PIDs) by targeted photothrombosis, and show the ability to detect its occurrence and propagation through spatiotemporal variations in both extracellular potentials and CBF. We also demonstrate chronic tracking of single-unit neural activity and CBF over days after photothrombosis, from which we observe reperfusion and increased firing rates. Comparison with Existing Method(s) This multimodal platform enables simultaneous mapping of neural activity and hemodynamic parameters at the microscale for quantitative, longitudinal comparisons with minimal perturbation to the baseline neurophysiology. Conclusion The ability to spatiotemporally resolve and chronically track CBF and neural electrical activity in the same living brain region has broad applications for studying the interplay between neural and hemodynamic responses in health and in cerebrovascular and neurological pathologies. PMID:29203409

A multimodal approach in the diagnosis of patients with hematopoietic disorders.

PubMed

Mark, H F; Gray, Y; Mark, Y; Khorsand, J; Sikov, W

1999-02-01

Myelodysplastic syndromes (MDS) are a group of relatively ill-defined hematopoietic disorders in which both qualitative and quantitative defects of the hematopoietic cells cause bone marrow dysfunction. With an incidence estimated to be approximately 1 per 100,000 persons per year, MDS mainly affects the elderly. Myelodysplastic syndromes share many features with acute nonlymphocytic leukemia; in fact, a proportion of patients with MDS eventually develop acute myeloid leukemia. To illustrate a multimodal approach in the diagnosis of patients with hematopoietic disorders, we describe a 66-year-old patient with a question of myelodysplastic syndrome, leukemia, and two translocations involving chromosome 10:t(5;10) and t(7;10). These structural rearrangements effectively gave rise to monosomy for part of the long arm of chromosome 5 and for the long arm of chromosome 7. Findings of del(5q) and del(7) in MDS have been reported in the literature. The results of chromosome morphometry, which was conducted to compare the lengths of all relevant chromosome segments, are consistent with the hypothesized chromosomal abnormalities. The investigational technique of fluorescence in situ hybridization (FISH), using both painting and alpha-satellite probes, was used as an adjunct to conventional cytogenetics to further delineate the nature of the chromosome abnormalities observed in the GTG-banded studies. Confirmatory studies utilizing the new technique of spectral karyotyping (SKY) were also carried out. Thus, the multimodal approach of hematopathology, GTG-banding, chromosome morphometry, FISH, and SKY can be very useful for delineating complex cytogenetic cases.

Nanoelectronics enabled chronic multimodal neural platform in a mouse ischemic model.

PubMed

Luan, Lan; Sullender, Colin T; Li, Xue; Zhao, Zhengtuo; Zhu, Hanlin; Wei, Xiaoling; Xie, Chong; Dunn, Andrew K

2018-02-01

Despite significant advancements of optical imaging techniques for mapping hemodynamics in small animal models, it remains challenging to combine imaging with spatially resolved electrical recording of individual neurons especially for longitudinal studies. This is largely due to the strong invasiveness to the living brain from the penetrating electrodes and their limited compatibility with longitudinal imaging. We implant arrays of ultraflexible nanoelectronic threads (NETs) in mice for neural recording both at the brain surface and intracortically, which maintain great tissue compatibility chronically. By mounting a cranial window atop of the NET arrays that allows for chronic optical access, we establish a multimodal platform that combines spatially resolved electrical recording of neural activity and laser speckle contrast imaging (LSCI) of cerebral blood flow (CBF) for longitudinal studies. We induce peri-infarct depolarizations (PIDs) by targeted photothrombosis, and show the ability to detect its occurrence and propagation through spatiotemporal variations in both extracellular potentials and CBF. We also demonstrate chronic tracking of single-unit neural activity and CBF over days after photothrombosis, from which we observe reperfusion and increased firing rates. This multimodal platform enables simultaneous mapping of neural activity and hemodynamic parameters at the microscale for quantitative, longitudinal comparisons with minimal perturbation to the baseline neurophysiology. The ability to spatiotemporally resolve and chronically track CBF and neural electrical activity in the same living brain region has broad applications for studying the interplay between neural and hemodynamic responses in health and in cerebrovascular and neurological pathologies. Copyright © 2017 Elsevier B.V. All rights reserved.

Quantum key distribution over an installed multimode optical fiber local area network.

PubMed

Namekata, Naoto; Mori, Shigehiko; Inoue, Shuichiro

2005-12-12

We have investigated the possibility of a multimode fiber link for a quantum channel. Transmission of light in an extremely underfilled mode distribution promises a single-mode-like behavior in the multimode fiber. To demonstrate the performance of the fiber link we performed quantum key distribution, on the basis of the BB84 four-state protocol, over 550 m of an installed multimode optical fiber local area network, and the quantum-bit-error rate of 1.09 percent was achieved.

Multimodality Image Fusion-Guided Procedures: Technique, Accuracy, and Applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Abi-Jaoudeh, Nadine, E-mail: naj@mail.nih.gov; Kruecker, Jochen, E-mail: jochen.kruecker@philips.com; Kadoury, Samuel, E-mail: samuel.kadoury@polymtl.ca

2012-10-15

Personalized therapies play an increasingly critical role in cancer care: Image guidance with multimodality image fusion facilitates the targeting of specific tissue for tissue characterization and plays a role in drug discovery and optimization of tailored therapies. Positron-emission tomography (PET), magnetic resonance imaging (MRI), and contrast-enhanced computed tomography (CT) may offer additional information not otherwise available to the operator during minimally invasive image-guided procedures, such as biopsy and ablation. With use of multimodality image fusion for image-guided interventions, navigation with advanced modalities does not require the physical presence of the PET, MRI, or CT imaging system. Several commercially available methodsmore » of image-fusion and device navigation are reviewed along with an explanation of common tracking hardware and software. An overview of current clinical applications for multimodality navigation is provided.« less

Field evaluation of a wearable multimodal soldier navigation system.

PubMed

Aaltonen, Iina; Laarni, Jari

2017-09-01

Challenging environments pose difficulties for terrain navigation, and therefore wearable and multimodal navigation systems have been proposed to overcome these difficulties. Few such navigation systems, however, have been evaluated in field conditions. We evaluated how a multimodal system can aid in navigating in a forest in the context of a military exercise. The system included a head-mounted display, headphones, and a tactile vibrating vest. Visual, auditory, and tactile modalities were tested and evaluated using unimodal, bimodal, and trimodal conditions. Questionnaires, interviews and observations were used to evaluate the advantages and disadvantages of each modality and their multimodal use. The guidance was considered easy to interpret and helpful in navigation. Simplicity of the displayed information was required, which was partially conflicting with the request for having both distance and directional information available. Copyright © 2017 Elsevier Ltd. All rights reserved.

Nonlinearity analysis of measurement model for vision-based optical navigation system

NASA Astrophysics Data System (ADS)

Li, Jianguo; Cui, Hutao; Tian, Yang

2015-02-01

In the autonomous optical navigation system based on line-of-sight vector observation, nonlinearity of measurement model is highly correlated with the navigation performance. By quantitatively calculating the degree of nonlinearity of the focal plane model and the unit vector model, this paper focuses on determining which optical measurement model performs better. Firstly, measurement equations and measurement noise statistics of these two line-of-sight measurement models are established based on perspective projection co-linearity equation. Then the nonlinear effects of measurement model on the filter performance are analyzed within the framework of the Extended Kalman filter, also the degrees of nonlinearity of two measurement models are compared using the curvature measure theory from differential geometry. Finally, a simulation of star-tracker-based attitude determination is presented to confirm the superiority of the unit vector measurement model. Simulation results show that the magnitude of curvature nonlinearity measurement is consistent with the filter performance, and the unit vector measurement model yields higher estimation precision and faster convergence properties.

Seeing Academically Marginalized Students' Multimodal Designs from a Position of Strength

ERIC Educational Resources Information Center

Anderson, Kate T.; Stewart, Olivia G.; Kachorsky, Dani

2017-01-01

This article examines multimodal texts created by a cohort of academically marginalized secondary school students in Singapore as part of a language arts unit on persuasive composition. Using an interpretivist qualitative approach, we examine students' multimodal designs to highlight opportunities taken up for expanding literacy practices…

Multimodal chemo-magnetic control of self-propelling microbots

NASA Astrophysics Data System (ADS)

Singh, Amit Kumar; Dey, Krishna Kanti; Chattopadhyay, Arun; Mandal, Tapas Kumar; Bandyopadhyay, Dipankar

2014-01-01

We report a controlled migration of an iron nanoparticle (FeNP) coated polymer micromotor. The otherwise diffusive motion of the motor was meticulously directed through an in situ pH-gradient and an external magnetic field. The self-propulsion owing to the asymmetric catalytic decomposition of peroxide fuel was directed through a pH gradient imposed across the motor-surface, while the magnetic field induced an external control on the movement and the speed of the motor. Interestingly, the sole influence of the pH gradient could move the motor as high as ~25 body lengths per second, which was further magnified by the external assistance from the magnetic field. Applying a magnetic field against the pH directed motion helped in the quantitative experimental estimation of the force-field required to arrest the chemotactic migration. The influence of the coupled internal and external fields could halt, steer or reverse the direction the motor inside a microchannel, rotate the motor around a target, and deliver the motor to a cluster of cells. This study showcases a multimodal chemical-magnetic field regulated migration of micro-machines for sensing, transport, and delivery inside a fluidic environment.We report a controlled migration of an iron nanoparticle (FeNP) coated polymer micromotor. The otherwise diffusive motion of the motor was meticulously directed through an in situ pH-gradient and an external magnetic field. The self-propulsion owing to the asymmetric catalytic decomposition of peroxide fuel was directed through a pH gradient imposed across the motor-surface, while the magnetic field induced an external control on the movement and the speed of the motor. Interestingly, the sole influence of the pH gradient could move the motor as high as ~25 body lengths per second, which was further magnified by the external assistance from the magnetic field. Applying a magnetic field against the pH directed motion helped in the quantitative experimental estimation of

Mean-trajectory approximation for electronic and vibrational-electronic nonlinear spectroscopy

NASA Astrophysics Data System (ADS)

Loring, Roger F.

2017-04-01

Mean-trajectory approximations permit the calculation of nonlinear vibrational spectra from semiclassically quantized trajectories on a single electronically adiabatic potential surface. By describing electronic degrees of freedom with classical phase-space variables and subjecting these to semiclassical quantization, mean-trajectory approximations may be extended to compute both nonlinear electronic spectra and vibrational-electronic spectra. A general mean-trajectory approximation for both electronic and nuclear degrees of freedom is presented, and the results for purely electronic and for vibrational-electronic four-wave mixing experiments are quantitatively assessed for harmonic surfaces with linear electronic-nuclear coupling.

Computation of Nonlinear Backscattering Using a High-Order Numerical Method

NASA Technical Reports Server (NTRS)

Fibich, G.; Ilan, B.; Tsynkov, S.

2001-01-01

The nonlinear Schrodinger equation (NLS) is the standard model for propagation of intense laser beams in Kerr media. The NLS is derived from the nonlinear Helmholtz equation (NLH) by employing the paraxial approximation and neglecting the backscattered waves. In this study we use a fourth-order finite-difference method supplemented by special two-way artificial boundary conditions (ABCs) to solve the NLH as a boundary value problem. Our numerical methodology allows for a direct comparison of the NLH and NLS models and for an accurate quantitative assessment of the backscattered signal.

The Effects of Multimodal Mobile Communications on Cooperative Team Interactions Executing Distributed Tasks

DTIC Science & Technology

2013-07-01

AFRL-RH-WP-TP-2013-0046 The Effects of Multimodal Mobile Communications on Cooperative Team Interactions Executing Distributed Tasks Gregory...3. DATES COVERED (From - To) 31-07-13 Interim 01 August 2011 – 01 August 2013 4. TITLE AND SUBTITLE The Effects of Multimodal Mobile... multimodal communication capabilities can con- tribute to the effectiveness and efficiency of real-time, task outcome and per- formance. In this paper, we

Semiconductor laser using multimode interference principle

NASA Astrophysics Data System (ADS)

Gong, Zisu; Yin, Rui; Ji, Wei; Wu, Chonghao

2018-01-01

Multimode interference (MMI) structure is introduced in semiconductor laser used in optical communication system to realize higher power and better temperature tolerance. Using beam propagation method (BPM), Multimode interference laser diode (MMI-LD) is designed and fabricated in InGaAsP/InP based material. As a comparison, conventional semiconductor laser using straight single-mode waveguide is also fabricated in the same wafer. With a low injection current (about 230 mA), the output power of the implemented MMI-LD is up to 2.296 mW which is about four times higher than the output power of the conventional semiconductor laser. The implemented MMI-LD exhibits stable output operating at the wavelength of 1.52 μm and better temperature tolerance when the temperature varies from 283.15 K to 293.15 K.

Fast, Nonlinear, Fully Probabilistic Inversion of Large Geophysical Problems

NASA Astrophysics Data System (ADS)

Curtis, A.; Shahraeeni, M.; Trampert, J.; Meier, U.; Cho, G.

2010-12-01

Almost all Geophysical inverse problems are in reality nonlinear. Fully nonlinear inversion including non-approximated physics, and solving for probability distribution functions (pdf’s) that describe the solution uncertainty, generally requires sampling-based Monte-Carlo style methods that are computationally intractable in most large problems. In order to solve such problems, physical relationships are usually linearized leading to efficiently-solved, (possibly iterated) linear inverse problems. However, it is well known that linearization can lead to erroneous solutions, and in particular to overly optimistic uncertainty estimates. What is needed across many Geophysical disciplines is a method to invert large inverse problems (or potentially tens of thousands of small inverse problems) fully probabilistically and without linearization. This talk shows how very large nonlinear inverse problems can be solved fully probabilistically and incorporating any available prior information using mixture density networks (driven by neural network banks), provided the problem can be decomposed into many small inverse problems. In this talk I will explain the methodology, compare multi-dimensional pdf inversion results to full Monte Carlo solutions, and illustrate the method with two applications: first, inverting surface wave group and phase velocities for a fully-probabilistic global tomography model of the Earth’s crust and mantle, and second inverting industrial 3D seismic data for petrophysical properties throughout and around a subsurface hydrocarbon reservoir. The latter problem is typically decomposed into 104 to 105 individual inverse problems, each solved fully probabilistically and without linearization. The results in both cases are sufficiently close to the Monte Carlo solution to exhibit realistic uncertainty, multimodality and bias. This provides far greater confidence in the results, and in decisions made on their basis.

Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems.

PubMed

Snelick, Robert; Uludag, Umut; Mink, Alan; Indovina, Michael; Jain, Anil

2005-03-01

We examine the performance of multimodal biometric authentication systems using state-of-the-art Commercial Off-the-Shelf (COTS) fingerprint and face biometric systems on a population approaching 1,000 individuals. The majority of prior studies of multimodal biometrics have been limited to relatively low accuracy non-COTS systems and populations of a few hundred users. Our work is the first to demonstrate that multimodal fingerprint and face biometric systems can achieve significant accuracy gains over either biometric alone, even when using highly accurate COTS systems on a relatively large-scale population. In addition to examining well-known multimodal methods, we introduce new methods of normalization and fusion that further improve the accuracy.

Multimodality Therapy and Liver Transplantation for Hepatocellular Carcinoma: A 14-Year Prospective Analysis of Outcomes

PubMed Central

Ramanathan, Rajesh; Sharma, Amit; Lee, David D; Behnke, Martha; Bornstein, Karen; Stravitz, R Todd; Sydnor, Malcolm; Fulcher, Ann; Cotterell, Adrian; Posner, Marc P; Fisher, Robert A

2014-01-01

Background Hepatocellular carcinoma is a major cause of death among patients with cirrhosis. A standardized approach of multimodality therapy with intent-to-treat by transplantation for all patients with hepatocellular carcinoma was instituted at our transplant center in 1997. Data were prospectively collected to evaluate the impact of multimodality therapy on post-transplant patient survival, tumor recurrence and patient survival without transplantation. Methods All patients with hepatocellular carcinoma were eligible for multimodality therapy. Multimodality therapy consisted of hepatic resection, radiofrequency ablation, transarterial chemoembolization, transarterial chemoinfusion, yttrium-90 microsphere radioembolization and sorafenib. Results 715 patients underwent multimodality therapy. 231 patients were included in the intent-to-treat with transplantation arm and 484 patients were treated with multimodality therapy or palliative therapy due to contraindications for transplantation. A 60.2% transplantation rate was achieved in the intent-to-treat with transplantation arm. Post-transplant survivals at 1- and 5-years were 97.1% and 72.5% respectively. Tumor recurrence rates at 1-, 3- and 5-years were 2.4%, 6.2% and 11.6% respectively. Patients with contraindications to transplant had increased 1- and 5-year survival from diagnosis with multimodality therapy compared to those not treated (73.1% and 46.5% vs. 15.5% and 4.4%, p<0.0001). Conclusions Using multimodality therapy prior to liver transplantation for hepatocellular carcinoma achieved low recurrence rates and post-transplant survival equivalent to patients with primary liver disease without hepatocellular carcinoma. Multimodality therapy may help identify patients with less active tumor biology and result in improved disease-free survival and organ utilization. PMID:24503764

Driver Education for New Multimodal Facilities

DOT National Transportation Integrated Search

2016-05-24

Local and state transportation agencies are redesigning roads to accommodate multimodal travel, including the addition of new configurations, infrastructures, and rules that may be unfamiliar to current drivers and other road users. Education and out...

Multimodal transmission property in a liquid-filled photonic crystal fiber

NASA Astrophysics Data System (ADS)

Lin, Wei; Miao, Yinping; Song, Binbin; Zhang, Hao; Liu, Bo; Liu, Yange; Yan, Donglin

2015-02-01

The multimode interference (MMI) effect in a liquid-filled photonic crystal fiber (PCF) has been experimentally demonstrated by fully infiltrating the air-hole cladding of a solid-core PCF with the refractive index (RI) matching liquid whose RI is close to the silica background. Due to the weak mode confinement capability of the cladding region, several high-order modes are excited to establish the multimode interference effect. The multimode interferometer shows a good temperature tunability of 12.30 nm/K, which makes it a good candidate for a highly tunable optical filtering as well as temperature sensing applications. Furthermore, this MMI effect would have great promise in various applications such as highly sensitive multi-parameter sensing, tunable optically filtering, and surface-enhanced Raman scattering.

An Emergent Bilingual Child's Multimodal Choices in Sociodramatic Play

ERIC Educational Resources Information Center

Bengochea, Alain; Sembiante, Sabrina F.; Gort, Mileidis

2018-01-01

In this case study, situated in a preschool classroom within an early childhood Spanish/English dual language programme, we examine how an emergent bilingual child engages with multimodal resources to participate in sociodramatic play discourses. Guided by sociocultural and critical discourse perspectives on multimodality, we analysed ways in…

Multimodal Composing in Classrooms: Learning and Teaching for the Digital World

ERIC Educational Resources Information Center

Miller, Suzanne M., Ed.; McVee, Mary B., Ed.

2012-01-01

Taking a close look at multimodal composing as an essential new literacy in schools, this volume draws from contextualized case studies across educational contexts to provide detailed portraits of teachers and students at work in classrooms. Authors elaborate key issues in transforming classrooms with student multimodal composing, including…

Multimodal hyperspectral optical microscopy

DOE PAGES

Novikova, Irina V.; Smallwood, Chuck R.; Gong, Yu; ...

2017-09-02

We describe a unique and convenient approach to multimodal hyperspectral optical microscopy, herein achieved by coupling a portable and transferable hyperspectral imager to various optical microscopes. The experimental and data analysis schemes involved in recording spectrally and spatially resolved fluorescence, dark field, and optical absorption micrographs are illustrated through prototypical measurements targeting selected model systems. Namely, hyperspectral fluorescence micrographs of isolated fluorescent beads are employed to ensure spectral calibration of our detector and to gauge the attainable spatial resolution of our measurements; the recorded images are diffraction-limited. Moreover, spatially over-sampled absorption spectroscopy of a single lipid (18:1 Liss Rhod PE)more » layer reveals that optical densities on the order of 10-3 may be resolved by spatially averaging the recorded optical signatures. We also briefly illustrate two applications of our setup in the general areas of plasmonics and cell biology. Most notably, we deploy hyperspectral optical absorption microscopy to identify and image algal pigments within a single live Tisochrysis lutea cell. Overall, this work paves the way for multimodal multidimensional spectral imaging measurements spanning the realms of several scientific disciples.« less

Multimodal hyperspectral optical microscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Novikova, Irina V.; Smallwood, Chuck R.; Gong, Yu

We describe a unique and convenient approach to multimodal hyperspectral optical microscopy, herein achieved by coupling a portable and transferable hyperspectral imager to various optical microscopes. The experimental and data analysis schemes involved in recording spectrally and spatially resolved fluorescence, dark field, and optical absorption micrographs are illustrated through prototypical measurements targeting selected model systems. Namely, hyperspectral fluorescence micrographs of isolated fluorescent beads are employed to ensure spectral calibration of our detector and to gauge the attainable spatial resolution of our measurements; the recorded images are diffraction-limited. Moreover, spatially over-sampled absorption spectroscopy of a single lipid (18:1 Liss Rhod PE)more » layer reveals that optical densities on the order of 10-3 may be resolved by spatially averaging the recorded optical signatures. We also briefly illustrate two applications of our setup in the general areas of plasmonics and cell biology. Most notably, we deploy hyperspectral optical absorption microscopy to identify and image algal pigments within a single live Tisochrysis lutea cell. Overall, this work paves the way for multimodal multidimensional spectral imaging measurements spanning the realms of several scientific disciples.« less

Multimodal, high-dimensional, model-based, Bayesian inverse problems with applications in biomechanics

NASA Astrophysics Data System (ADS)

Franck, I. M.; Koutsourelakis, P. S.

2017-01-01

This paper is concerned with the numerical solution of model-based, Bayesian inverse problems. We are particularly interested in cases where the cost of each likelihood evaluation (forward-model call) is expensive and the number of unknown (latent) variables is high. This is the setting in many problems in computational physics where forward models with nonlinear PDEs are used and the parameters to be calibrated involve spatio-temporarily varying coefficients, which upon discretization give rise to a high-dimensional vector of unknowns. One of the consequences of the well-documented ill-posedness of inverse problems is the possibility of multiple solutions. While such information is contained in the posterior density in Bayesian formulations, the discovery of a single mode, let alone multiple, poses a formidable computational task. The goal of the present paper is two-fold. On one hand, we propose approximate, adaptive inference strategies using mixture densities to capture multi-modal posteriors. On the other, we extend our work in [1] with regard to effective dimensionality reduction techniques that reveal low-dimensional subspaces where the posterior variance is mostly concentrated. We validate the proposed model by employing Importance Sampling which confirms that the bias introduced is small and can be efficiently corrected if the analyst wishes to do so. We demonstrate the performance of the proposed strategy in nonlinear elastography where the identification of the mechanical properties of biological materials can inform non-invasive, medical diagnosis. The discovery of multiple modes (solutions) in such problems is critical in achieving the diagnostic objectives.

Multimodality as a Sociolinguistic Resource

ERIC Educational Resources Information Center

Collister, Lauren Brittany

2013-01-01

This work explores the use of multimodal communication in a community of expert "World of Warcraft"® players and its impact on politeness, identity, and relationships. Players in the community regularly communicated using three linguistic modes quasi-simultaneously: text chat, voice chat, and face-to-face interaction. Using the…

Multimode-singlemode-multimode optical fiber sensor coated with novolac resin for detecting liquid phase alcohol

NASA Astrophysics Data System (ADS)

Marfu'ah, Amalia, Niza Rosyda; Hatta, Agus Muhamad; Pratama, Detak Yan

2018-04-01

Alcohol sensor based on multimode-singlemode-multimode (MSM) optical fiber with novolac resin as the external medium is proposed and demonstrated experimentally. Novolac resin swells when it is exposed by the alcohol. This effect causes a change in the polymer density leading to the refractive index's variation. The transmission light of the sensor depends on the refractive index of external medium. Based on the results, alcohol sensor based on MSM optical fiber structure using novolac resin has a higher sensitivity compared to the sensor without using novolac resin in the mixture of alcohol and distilled water. Alcohol sensor based on MSM optical fiber structure using novolac resin in the mixture of alcohol and distilled water with a singlemode fiber length of 5 mm has a sensitivity of 0.028972 dBm per % V/V, and in the mixture of alcohol and sugar solution of 10% w/w has a sensitivity of 0.005005 dBm per % V/V.

Wind- and Rain-Induced Vibrations Impose Different Selection Pressures on Multimodal Signaling.

PubMed

Halfwerk, Wouter; Ryan, Michael J; Wilson, Preston S

2016-09-01

The world is a noisy place, and animals have evolved a myriad of strategies to communicate in it. Animal communication signals are, however, often multimodal; their components can be processed by multiple sensory systems, and noise can thus affect signal components across different modalities. We studied the effect of environmental noise on multimodal communication in the túngara frog (Physalaemus pustulosus). Males communicate with rivals using airborne sounds combined with call-induced water ripples. We tested males under control as well as noisy conditions in which we mimicked rain- and wind-induced vibrations on the water surface. Males responded more strongly to a multimodal playback in which sound and ripples were combined, compared to a unimodal sound-only playback, but only in the absence of rain and wind. Under windy conditions, males decreased their response to the multimodal playback, suggesting that wind noise interferes with the detection of rival ripples. Under rainy conditions, males increased their response, irrespective of signal playback, suggesting that different noise sources can have different impacts on communication. Our findings show that noise in an additional sensory channel can affect multimodal signal perception and thereby drive signal evolution, but not always in the expected direction.

Multimode intravascular RF coil for MRI-guided interventions.

PubMed

Kurpad, Krishna N; Unal, Orhan

2011-04-01

To demonstrate the feasibility of using a single intravascular radiofrequency (RF) probe connected to the external magnetic resonance imaging (MRI) system via a single coaxial cable to perform active tip tracking and catheter visualization and high signal-to-noise ratio (SNR) intravascular imaging. A multimode intravascular RF coil was constructed on a 6F balloon catheter and interfaced to a 1.5T MRI scanner via a decoupling circuit. Bench measurements of coil impedances were followed by imaging experiments in saline and phantoms. The multimode coil behaves as an inductively coupled transmit coil. The forward-looking capability of 6 mm was measured. A greater than 3-fold increase in SNR compared to conventional imaging using optimized external coil was demonstrated. Simultaneous active tip tracking and catheter visualization was demonstrated. It is feasible to perform 1) active tip tracking, 2) catheter visualization, and 3) high SNR imaging using a single multimode intravascular RF coil that is connected to the external system via a single coaxial cable. Copyright © 2011 Wiley-Liss, Inc.

High-resolution multimodal clinical multiphoton tomography of skin

NASA Astrophysics Data System (ADS)

König, Karsten

2011-03-01

This review focuses on multimodal multiphoton tomography based on near infrared femtosecond lasers. Clinical multiphoton tomographs for 3D high-resolution in vivo imaging have been placed into the market several years ago. The second generation of this Prism-Award winning High-Tech skin imaging tool (MPTflex) was introduced in 2010. The same year, the world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph. In particular, non-fluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen has been imaged with submicron resolution in patients suffering from psoriasis. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution wide-field systems such as ultrasound, optoacoustical, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer, optimization of treatment strategies, and cosmetic research including long-term testing of sunscreen nanoparticles as well as anti-aging products.

Study on multimodal transport route under low carbon background

NASA Astrophysics Data System (ADS)

Liu, Lele; Liu, Jie

2018-06-01

Low-carbon environmental protection is the focus of attention around the world, scientists are constantly researching on production of carbon emissions and living carbon emissions. However, there is little literature about multimodal transportation based on carbon emission at home and abroad. Firstly, this paper introduces the theory of multimodal transportation, the multimodal transport models that didn't consider carbon emissions and consider carbon emissions are analyzed. On this basis, a multi-objective programming 0-1 programming model with minimum total transportation cost and minimum total carbon emission is proposed. The idea of weight is applied to Ideal point method for solving problem, multi-objective programming is transformed into a single objective function. The optimal solution of carbon emission to transportation cost under different weights is determined by a single objective function with variable weights. Based on the model and algorithm, an example is given and the results are analyzed.

Modelling multimodal expression of emotion in a virtual agent.

PubMed

Pelachaud, Catherine

2009-12-12

Over the past few years we have been developing an expressive embodied conversational agent system. In particular, we have developed a model of multimodal behaviours that includes dynamism and complex facial expressions. The first feature refers to the qualitative execution of behaviours. Our model is based on perceptual studies and encompasses several parameters that modulate multimodal behaviours. The second feature, the model of complex expressions, follows a componential approach where a new expression is obtained by combining facial areas of other expressions. Lately we have been working on adding temporal dynamism to expressions. So far they have been designed statically, typically at their apex. Only full-blown expressions could be modelled. To overcome this limitation, we have defined a representation scheme that describes the temporal evolution of the expression of an emotion. It is no longer represented by a static definition but by a temporally ordered sequence of multimodal signals.

Teachers' Integration of Multimodality into Classroom Practices for English Language Learners

ERIC Educational Resources Information Center

Choi, Jayoung; Yi, Youngjoo

2016-01-01

Despite the proven benefits of multimodal teaching and learning (i.e., through visual, sound, movement, print-based text, and technology) for students, little is known about how teachers of English language learners (ELLs) integrate multimodality into their existing curriculums. In this study, the authors examined how two teachers who had limited…

Fock expansion of multimode pure Gaussian states

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cariolaro, Gianfranco; Pierobon, Gianfranco, E-mail: gianfranco.pierobon@unipd.it

2015-12-15

The Fock expansion of multimode pure Gaussian states is derived starting from their representation as displaced and squeezed multimode vacuum states. The approach is new and appears to be simpler and more general than previous ones starting from the phase-space representation given by the characteristic or Wigner function. Fock expansion is performed in terms of easily evaluable two-variable Hermite–Kampé de Fériet polynomials. A relatively simple and compact expression for the joint statistical distribution of the photon numbers in the different modes is obtained. In particular, this result enables one to give a simple characterization of separable and entangled states, asmore » shown for two-mode and three-mode Gaussian states.« less

Multi-Modal Treatment of Nocturnal Enuresis.

ERIC Educational Resources Information Center

Mohr, Caroline; Sharpley, Christopher F.

1988-01-01

The article reports a multimodal treatment of nocturnal enuresis and anxious behavior in a mildly mentally retarded woman. Behavioral treatment and removal of caffeine from the subject's diet eliminated both nocturnal enuresis and anxious behavior. (Author/DB)

Multimodal solutions for large scale evacuations.

DOT National Transportation Integrated Search

2009-12-30

In this research, a multimodal transportation model was developed attending the needs of emergency situations, : and the solutions provided by the model could be used to moderate congestion during such events. : The model incorporated features such a...

Extrinsic Embryonic Sensory Stimulation Alters Multimodal Behavior and Cellular Activation

PubMed Central

Markham, Rebecca G.; Shimizu, Toru; Lickliter, Robert

2009-01-01

Embryonic vision is generated and maintained by spontaneous neuronal activation patterns, yet extrinsic stimulation also sculpts sensory development. Because the sensory and motor systems are interconnected in embryogenesis, how extrinsic sensory activation guides multimodal differentiation is an important topic. Further, it is unknown whether extrinsic stimulation experienced near sensory sensitivity onset contributes to persistent brain changes, ultimately affecting postnatal behavior. To determine the effects of extrinsic stimulation on multimodal development, we delivered auditory stimulation to bobwhite quail groups during early, middle, or late embryogenesis, and then tested postnatal behavioral responsiveness to auditory or visual cues. Auditory preference tendencies were more consistently toward the conspecific stimulus for animals stimulated during late embryogenesis. Groups stimulated during middle or late embryogenesis showed altered postnatal species-typical visual responsiveness, demonstrating a persistent multimodal effect. We also examined whether auditory-related brain regions are receptive to extrinsic input during middle embryogenesis by measuring postnatal cellular activation. Stimulated birds showed a greater number of ZENK-immunopositive cells per unit volume of brain tissue in deep optic tectum, a midbrain region strongly implicated in multimodal function. We observed similar results in the medial and caudomedial nidopallia in the telencephalon. There were no ZENK differences between groups in inferior colliculus or in caudolateral nidopallium, avian analog to prefrontal cortex. To our knowledge, these are the first results linking extrinsic stimulation delivered so early in embryogenesis to changes in postnatal multimodal behavior and cellular activation. The potential role of competitive interactions between the sensory and motor systems is discussed. PMID:18777564

On the effects of multimodal information integration in multitasking.

PubMed

Stock, Ann-Kathrin; Gohil, Krutika; Huster, René J; Beste, Christian

2017-07-07

There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

Correction of Gradient Nonlinearity Bias in Quantitative Diffusion Parameters of Renal Tissue with Intra Voxel Incoherent Motion.

PubMed

Malyarenko, Dariya I; Pang, Yuxi; Senegas, Julien; Ivancevic, Marko K; Ross, Brian D; Chenevert, Thomas L

2015-12-01

Spatially non-uniform diffusion weighting bias due to gradient nonlinearity (GNL) causes substantial errors in apparent diffusion coefficient (ADC) maps for anatomical regions imaged distant from magnet isocenter. Our previously-described approach allowed effective removal of spatial ADC bias from three orthogonal DWI measurements for mono-exponential media of arbitrary anisotropy. The present work evaluates correction feasibility and performance for quantitative diffusion parameters of the two-component IVIM model for well-perfused and nearly isotropic renal tissue. Sagittal kidney DWI scans of a volunteer were performed on a clinical 3T MRI scanner near isocenter and offset superiorly. Spatially non-uniform diffusion weighting due to GNL resulted both in shift and broadening of perfusion-suppressed ADC histograms for off-center DWI relative to unbiased measurements close to isocenter. Direction-average DW-bias correctors were computed based on the known gradient design provided by vendor. The computed bias maps were empirically confirmed by coronal DWI measurements for an isotropic gel-flood phantom. Both phantom and renal tissue ADC bias for off-center measurements was effectively removed by applying pre-computed 3D correction maps. Comparable ADC accuracy was achieved for corrections of both b -maps and DWI intensities in presence of IVIM perfusion. No significant bias impact was observed for IVIM perfusion fraction.

Correction of Gradient Nonlinearity Bias in Quantitative Diffusion Parameters of Renal Tissue with Intra Voxel Incoherent Motion

PubMed Central

Malyarenko, Dariya I.; Pang, Yuxi; Senegas, Julien; Ivancevic, Marko K.; Ross, Brian D.; Chenevert, Thomas L.

2015-01-01

Spatially non-uniform diffusion weighting bias due to gradient nonlinearity (GNL) causes substantial errors in apparent diffusion coefficient (ADC) maps for anatomical regions imaged distant from magnet isocenter. Our previously-described approach allowed effective removal of spatial ADC bias from three orthogonal DWI measurements for mono-exponential media of arbitrary anisotropy. The present work evaluates correction feasibility and performance for quantitative diffusion parameters of the two-component IVIM model for well-perfused and nearly isotropic renal tissue. Sagittal kidney DWI scans of a volunteer were performed on a clinical 3T MRI scanner near isocenter and offset superiorly. Spatially non-uniform diffusion weighting due to GNL resulted both in shift and broadening of perfusion-suppressed ADC histograms for off-center DWI relative to unbiased measurements close to isocenter. Direction-average DW-bias correctors were computed based on the known gradient design provided by vendor. The computed bias maps were empirically confirmed by coronal DWI measurements for an isotropic gel-flood phantom. Both phantom and renal tissue ADC bias for off-center measurements was effectively removed by applying pre-computed 3D correction maps. Comparable ADC accuracy was achieved for corrections of both b-maps and DWI intensities in presence of IVIM perfusion. No significant bias impact was observed for IVIM perfusion fraction. PMID:26811845

ADMultiImg: a novel missing modality transfer learning based CAD system for diagnosis of MCI due to AD using incomplete multi-modality imaging data

NASA Astrophysics Data System (ADS)

Liu, Xiaonan; Chen, Kewei; Wu, Teresa; Weidman, David; Lure, Fleming; Li, Jing

2018-02-01

Alzheimer's Disease (AD) is the most common cause of dementia and currently has no cure. Treatments targeting early stages of AD such as Mild Cognitive Impairment (MCI) may be most effective to deaccelerate AD, thus attracting increasing attention. However, MCI has substantial heterogeneity in that it can be caused by various underlying conditions, not only AD. To detect MCI due to AD, NIA-AA published updated consensus criteria in 2011, in which the use of multi-modality images was highlighted as one of the most promising methods. It is of great interest to develop a CAD system based on automatic, quantitative analysis of multi-modality images and machine learning algorithms to help physicians more adequately diagnose MCI due to AD. The challenge, however, is that multi-modality images are not universally available for many patients due to cost, access, safety, and lack of consent. We developed a novel Missing Modality Transfer Learning (MMTL) algorithm capable of utilizing whatever imaging modalities are available for an MCI patient to diagnose the patient's likelihood of MCI due to AD. Furthermore, we integrated MMTL with radiomics steps including image processing, feature extraction, and feature screening, and a post-processing for uncertainty quantification (UQ), and developed a CAD system called "ADMultiImg" to assist clinical diagnosis of MCI due to AD using multi-modality images together with patient demographic and genetic information. Tested on ADNI date, our system can generate a diagnosis with high accuracy even for patients with only partially available image modalities (AUC=0.94), and therefore may have broad clinical utility.

Highly Nonlinear Wave Propagation in Elastic Woodpile Periodic Structures

DTIC Science & Technology

2016-08-03

additional details including the experimental setup, the precise selection of the DEM pa- rameters and the quantitative nature of the agreement between theory ...by Dr. Farmer. [29] G. Iooss, G. James, Chaos 15, 015113 (2005). [30] J.P. Boyd, Nonlinearity 3, 177 (1990). [31] N. Lu, J. Diff. Eqs. 256, 745 (2014

Multimodal Representations: A Fifth-Grade Teacher Influences Students' Design and Production

ERIC Educational Resources Information Center

Shanahan, Lynn E.

2013-01-01

The purpose of this interpretive case study is to explore--through a close analysis of one fifth-grade class project--teacher's scaffolding and students' use of visual and linguistic modes when composing multimodally. Using Kress and van Leeuwen's multimodal theory of communication as a framework, this case study examines why teachers, whose…

Multimodal Solutions for Large Scale Evacuation

DOT National Transportation Integrated Search

2009-12-30

In this research, a multimodal transportation model was developed attending the needs of emergency situations, and the solutions provided by the model could be used to moderate congestion during such events. The model incorporated features such as la...

Optical Biomarkers of Serous and Mucinous Human Ovarian Tumor Assessed with Nonlinear Optics Microscopies

PubMed Central

Adur, Javier; Pelegati, Vitor B.; de Thomaz, Andre A.; Baratti, Mariana O.; Almeida, Diogo B.; Andrade, L. A. L. A.; Bottcher-Luiz, Fátima; Carvalho, Hernandes F.; Cesar, Carlos L.

2012-01-01

Background Nonlinear optical (NLO) microscopy techniques have potential to improve the early detection of epithelial ovarian cancer. In this study we showed that multimodal NLO microscopies, including two-photon excitation fluorescence (TPEF), second-harmonic generation (SHG), third-harmonic generation (THG) and fluorescence lifetime imaging microscopy (FLIM) can detect morphological and metabolic changes associated with ovarian cancer progression. Methodology/Principal Findings We obtained strong TPEF + SHG + THG signals from fixed samples stained with Hematoxylin & Eosin (H&E) and robust FLIM signal from fixed unstained samples. Particularly, we imaged 34 ovarian biopsies from different patients (median age, 49 years) including 5 normal ovarian tissue, 18 serous tumors and 11 mucinous tumors with the multimodal NLO platform developed in our laboratory. We have been able to distinguish adenomas, borderline, and adenocarcinomas specimens. Using a complete set of scoring methods we found significant differences in the content, distribution and organization of collagen fibrils in the stroma as well as in the morphology and fluorescence lifetime from epithelial ovarian cells. Conclusions/Significance NLO microscopes provide complementary information about tissue microstructure, showing distinctive patterns for serous and mucinous ovarian tumors. The results provide a basis to interpret future NLO images of ovarian tissue and lay the foundation for future in vivo optical evaluation of premature ovarian lesions. PMID:23056557

In Situ Study on the Evolution of Multimodal Particle Size Distributions of ZnO Quantum Dots: Some General Rules for the Occurrence of Multimodalities.

PubMed

Schindler, Torben; Walter, Johannes; Peukert, Wolfgang; Segets, Doris; Unruh, Tobias

2015-12-10

Properties of small semiconductor nanoparticles (NPs) are strongly governed by their size. Precise characterization is a key requirement for tailored dispersities and thus for high-quality devices. Results of a careful analysis of particle size distributions (PSDs) of ZnO are presented combining advantages of UV/vis absorption spectroscopy, analytical ultracentrifugation, and small-angle X-ray scattering (SAXS). Our study reveals that careful cross-validation of these different methods is mandatory to end up with reliable resolution. PSDs of ZnO NPs are multimodal on a size range of 2-8 nm, a finding that is not yet sufficiently addressed. In the second part of our work the evolution of PSDs was studied using in situ SAXS. General principles for the appearance of multimodalities covering a temperature range between 15 and 45 °C were found which are solely determined by the aging state indicated by the size of the medium-sized fraction. Whenever this fraction exceeds a critical diameter, a new multimodality is identified, independent of the particular time-temperature combination. A fraction of larger particles aggregates first before a fraction of smaller particles is detected. Fixed multimodalities have not yet been addressed adequately and could only be evidenced due to careful size analysis.

Connection Analysis of Different Modes in Multimodal Transport

NASA Astrophysics Data System (ADS)

Zhao, Zhi; Lu, Ya Ya; Liu, Xing Hua; Jiang, Ying; Zhang, Yan Zhou

2018-06-01

As the most advanced way of transport organization, container multimodal transport provides high quality and efficient systematic logistics transportation services in a wide range of freight transport activities. So it has been widely promoted worldwide. China is in a period of sustained and rapid economic development, which needs greater support from logistics, while the rationalization of multimodal transport enables the best transport area of each transportation mode to be reflected. This paper makes an analysis of the connection between united transportation of railway and highway, rail and water transport and untied transportation of highway and water.

Nonlinear spectral singularities for confined nonlinearities.

PubMed

Mostafazadeh, Ali

2013-06-28

We introduce a notion of spectral singularity that applies for a general class of nonlinear Schrödinger operators involving a confined nonlinearity. The presence of the nonlinearity does not break the parity-reflection symmetry of spectral singularities but makes them amplitude dependent. Nonlinear spectral singularities are, therefore, associated with a resonance effect that produces amplified waves with a specific amplitude-wavelength profile. We explore the consequences of this phenomenon for a complex δ-function potential that is subject to a general confined nonlinearity.

Effect of external index of refraction on multimode fiber couplers.

PubMed

Wang, G Z; Murphy, K A; Claus, R O

1995-12-20

The dependence of the performance of fused-taper multimode fiber couplers on the refractive index of the material surrounding the taper region has been investigated both theoretically and experimentally. It has been identified that for a 2 × 2 multimode fiber coupler there is a range of output-power-coupling ratios for which the effect of the external refractive index is negligible. When the coupler is tapered beyond this region, the performance becomes dependent on the external index of refraction and lossy. To analyze the multimode coupler-loss mechanism, we develop a two-dimensional ray-optics model that incorporates trapped cladding-mode loss and core-mode loss through frustrated total internal reflection.

Computer-simulation results support the experimental observations. Related issues such as coupler fabrication and packaging are also discussed.

EnviroLand: A Simple Computer Program for Quantitative Stream Assessment.

ERIC Educational Resources Information Center

Dunnivant, Frank; Danowski, Dan; Timmens-Haroldson, Alice; Newman, Meredith

2002-01-01

Introduces the Enviroland computer program which features lab simulations of theoretical calculations for quantitative analysis and environmental chemistry, and fate and transport models. Uses the program to demonstrate the nature of linear and nonlinear equations. (Author/YDS)

Nonlinear laser dynamics induced by frequency shifted optical feedback: application to vibration measurements.

PubMed

Girardeau, Vadim; Goloni, Carolina; Jacquin, Olivier; Hugon, Olivier; Inglebert, Mehdi; Lacot, Eric

2016-12-01

In this article, we study the nonlinear dynamics of a laser subjected to frequency shifted optical reinjection coming back from a vibrating target. More specifically, we study the nonlinear dynamical coupling between the carrier and the vibration signal. The present work shows how the nonlinear amplification of the vibration spectrum is related to the strength of the carrier and how it must be compensated to obtain accurate (i.e., without bias) vibration measurements. The theoretical predictions, confirmed by numerical simulations, are in good agreement with the experimental data. The main motivation of this study is the understanding of the nonlinear response of a laser optical feedback imaging sensor for quantitative phase measurements of small vibrations in the case of strong optical feedback.

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval

PubMed Central

Bonnici, Heidi M.; Richter, Franziska R.; Yazar, Yasemin

2016-01-01

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. SIGNIFICANCE STATEMENT Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (An

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval.

PubMed

Bonnici, Heidi M; Richter, Franziska R; Yazar, Yasemin; Simons, Jon S

2016-05-18

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (AnG) contribute to the retrieval of

Incorporation of Fixed Installation Costs into Optimization of Groundwater Remediation with a New Efficient Surrogate Nonlinear Mixed Integer Optimization Algorithm

NASA Astrophysics Data System (ADS)

Shoemaker, Christine; Wan, Ying

2016-04-01

Optimization of nonlinear water resources management issues which have a mixture of fixed (e.g. construction cost for a well) and variable (e.g. cost per gallon of water pumped) costs has been not well addressed because prior algorithms for the resulting nonlinear mixed integer problems have required many groundwater simulations (with different configurations of decision variable), especially when the solution space is multimodal. In particular heuristic methods like genetic algorithms have often been used in the water resources area, but they require so many groundwater simulations that only small systems have been solved. Hence there is a need to have a method that reduces the number of expensive groundwater simulations. A recently published algorithm for nonlinear mixed integer programming using surrogates was shown in this study to greatly reduce the computational effort for obtaining accurate answers to problems involving fixed costs for well construction as well as variable costs for pumping because of a substantial reduction in the number of groundwater simulations required to obtain an accurate answer. Results are presented for a US EPA hazardous waste site. The nonlinear mixed integer surrogate algorithm is general and can be used on other problems arising in hydrology with open source codes in Matlab and python ("pySOT" in Bitbucket).

Non-linear dynamic analysis of geared systems, part 2

NASA Technical Reports Server (NTRS)

Singh, Rajendra; Houser, Donald R.; Kahraman, Ahmet

1990-01-01

A good understanding of the steady state dynamic behavior of a geared system is required in order to design reliable and quiet transmissions. This study focuses on a system containing a spur gear pair with backlash and periodically time-varying mesh stiffness, and rolling element bearings with clearance type non-linearities. A dynamic finite element model of the linear time-invariant (LTI) system is developed. Effects of several system parameters, such as torsional and transverse flexibilities of the shafts and prime mover/load inertias, on free and force vibration characteristics are investigated. Several reduced order LTI models are developed and validated by comparing their eigen solution with the finite element model results. Several key system parameters such as mean load and damping ratio are identified and their effects on the non-linear frequency response are evaluated quantitatively. Other fundamental issues such as the dynamic coupling between non-linear modes, dynamic interactions between component non-linearities and time-varying mesh stiffness, and the existence of subharmonic and chaotic solutions including routes to chaos have also been examined in depth.

Collaboration of Miniature Multi-Modal Mobile Smart Robots over a Network

DTIC Science & Technology

2015-08-14

theoretical research on mathematics of failures in sensor-network-based miniature multimodal mobile robots and electromechanical systems. The views...theoretical research on mathematics of failures in sensor-network-based miniature multimodal mobile robots and electromechanical systems. The...independently evolving research directions based on physics-based models of mechanical, electromechanical and electronic devices, operational constraints

In vivo preclinical verification of a multimodal diffuse reflectance and correlation spectroscopy system for sensing tissue perfusion

NASA Astrophysics Data System (ADS)

Pakela, Julia M.; Lee, Seung Yup; Hedrick, Taylor L.; Vishwanath, Karthik; Helton, Michael C.; Chung, Yooree G.; Kolodziejski, Noah J.; Staples, Christopher J.; McAdams, Daniel R.; Fernandez, Daniel E.; Christian, James F.; O'Reilly, Jameson; Farkas, Dana; Ward, Brent B.; Feinberg, Stephen E.; Mycek, Mary-Ann

2017-02-01

In reconstructive surgery, impeded blood flow in microvascular free flaps due to a compromise in arterial or venous patency secondary to blood clots or vessel spasms can rapidly result in flap failures. Thus, the ability to detect changes in microvascular free flaps is critical. In this paper, we report progress on in vivo pre-clinical testing of a compact, multimodal, fiber-based diffuse correlation and reflectance spectroscopy system designed to quantitatively monitor tissue perfusion in a porcine model's surgically-grafted free flap. We also describe the device's sensitivity to incremental blood flow changes and discuss the prospects for continuous perfusion monitoring in future clinical translational studies.

Multi-mode Intravascular RF Coil for MRI-guided Interventions

PubMed Central

Kurpad, Krishna N.; Unal, Orhan

2011-01-01

Purpose To demonstrate the feasibility of using a single intravascular RF probe connected to the external MRI system via a single coaxial cable to perform active tip tracking and catheter visualization, and high SNR intravascular imaging. Materials and Methods A multi-mode intravascular RF coil was constructed on a 6F balloon catheter and interfaced to a 1.5T MRI scanner via a decoupling circuit. Bench measurements of coil impedances were followed by imaging experiments in saline and phantoms. Results The multi-mode coil behaves as an inductively-coupled transmit coil. Forward looking capability of 6mm is measured. Greater than 3-fold increase in SNR compared to conventional imaging using optimized external coil is demonstrated. Simultaneous active tip tracking and catheter visualization is demonstrated. Conclusions It is feasible to perform 1) active tip tracking, 2) catheter visualization, and 3) high SNR imaging using a single multi-mode intravascular RF coil that is connected to the external system via a single coaxial cable. PMID:21448969

Fluorescence Imaging Topography Scanning System for intraoperative multimodal imaging

PubMed Central

Quang, Tri T.; Kim, Hye-Yeong; Bao, Forrest Sheng; Papay, Francis A.; Edwards, W. Barry; Liu, Yang

2017-01-01

Fluorescence imaging is a powerful technique with diverse applications in intraoperative settings. Visualization of three dimensional (3D) structures and depth assessment of lesions, however, are oftentimes limited in planar fluorescence imaging systems. In this study, a novel Fluorescence Imaging Topography Scanning (FITS) system has been developed, which offers color reflectance imaging, fluorescence imaging and surface topography scanning capabilities. The system is compact and portable, and thus suitable for deployment in the operating room without disturbing the surgical flow. For system performance, parameters including near infrared fluorescence detection limit, contrast transfer functions and topography depth resolution were characterized. The developed system was tested in chicken tissues ex vivo with simulated tumors for intraoperative imaging. We subsequently conducted in vivo multimodal imaging of sentinel lymph nodes in mice using FITS and PET/CT. The PET/CT/optical multimodal images were co-registered and conveniently presented to users to guide surgeries. Our results show that the developed system can facilitate multimodal intraoperative imaging. PMID:28437441

Radionuclide Myocardial Perfusion Imaging for the Evaluation of Patients With Known or Suspected Coronary Artery Disease in the Era of Multimodality Cardiovascular Imaging

PubMed Central

Taqueti, Viviany R.; Di Carli, Marcelo F.

2018-01-01

Over the last several decades, radionuclide myocardial perfusion imaging (MPI) with single photon emission tomography and positron emission tomography has been a mainstay for the evaluation of patients with known or suspected coronary artery disease (CAD). More recently, technical advances in separate and complementary imaging modalities including coronary computed tomography angiography, computed tomography perfusion, cardiac magnetic resonance imaging, and contrast stress echocardiography have expanded the toolbox of diagnostic testing for cardiac patients. While the growth of available technologies has heralded an exciting era of multimodality cardiovascular imaging, coordinated and dispassionate utilization of these techniques is needed to implement the right test for the right patient at the right time, a promise of “precision medicine.” In this article, we review the maturing role of MPI in the current era of multimodality cardiovascular imaging, particularly in the context of recent advances in myocardial blood flow quantitation, and as applied to the evaluation of patients with known or suspected CAD. PMID:25770849

A Multimodal Approach to Counselor Supervision.

ERIC Educational Resources Information Center

Ponterotto, Joseph G.; Zander, Toni A.

1984-01-01

Represents an initial effort to apply Lazarus's multimodal approach to a model of counselor supervision. Includes continuously monitoring the trainee's behavior, affect, sensations, images, cognitions, interpersonal functioning, and when appropriate, biological functioning (diet and drugs) in the supervisory process. (LLL)

Features and functions of nonlinear spatial integration by retinal ganglion cells.

PubMed

Gollisch, Tim

2013-11-01

Ganglion cells in the vertebrate retina integrate visual information over their receptive fields. They do so by pooling presynaptic excitatory inputs from typically many bipolar cells, which themselves collect inputs from several photoreceptors. In addition, inhibitory interactions mediated by horizontal cells and amacrine cells modulate the structure of the receptive field. In many models, this spatial integration is assumed to occur in a linear fashion. Yet, it has long been known that spatial integration by retinal ganglion cells also incurs nonlinear phenomena. Moreover, several recent examples have shown that nonlinear spatial integration is tightly connected to specific visual functions performed by different types of retinal ganglion cells. This work discusses these advances in understanding the role of nonlinear spatial integration and reviews recent efforts to quantitatively study the nature and mechanisms underlying spatial nonlinearities. These new insights point towards a critical role of nonlinearities within ganglion cell receptive fields for capturing responses of the cells to natural and behaviorally relevant visual stimuli. In the long run, nonlinear phenomena of spatial integration may also prove important for implementing the actual neural code of retinal neurons when designing visual prostheses for the eye. Copyright © 2012 Elsevier Ltd. All rights reserved.

The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)

PubMed Central

Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-André; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Hervé; Demiralp, Çağatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, José António; Meier, Raphael; Pereira, Sérgio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen

2016-01-01

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients—manually annotated by up to four raters—and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%–85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource. PMID:25494501

2016 SmartWay Multimodal Carrier Tool Demonstration

EPA Pesticide Factsheets

This EPA presentation provides information on the SmartWay Transport Partnership Multimodal Tool; carrier categories, emission metrics, performance reports, completing the tool, data collection and usage, and the 2016 schedule.

[Principles of fast track surgery. Multimodal perioperative therapy programme].

PubMed

Kehlet, H

2009-08-01

Recent evidence has documented that a combination of single-modality evidence-based care principles into a multimodal effort to enhance postoperative recovery (the fast track methodology) has led to enhanced recovery with reduced medical morbidity, need for hospitalisation and convalescence. Nevertheless, general implementation of fast track surgery has been relatively slow despite concomitant economic benefits. Further improvement in postoperative outcome may be obtained by developments within each care principle with a specific focus on minimally invasive surgery, effective multimodal, non-opioid analgesia and pharmacological stress reduction.

Discrete diffraction managed solitons: Threshold phenomena and rapid decay for general nonlinearities

NASA Astrophysics Data System (ADS)

Choi, Mi-Ran; Hundertmark, Dirk; Lee, Young-Ran

2017-10-01

We prove a threshold phenomenon for the existence/non-existence of energy minimizing solitary solutions of the diffraction management equation for strictly positive and zero average diffraction. Our methods allow for a large class of nonlinearities; they are, for example, allowed to change sign, and the weakest possible condition, it only has to be locally integrable, on the local diffraction profile. The solutions are found as minimizers of a nonlinear and nonlocal variational problem which is translation invariant. There exists a critical threshold λcr such that minimizers for this variational problem exist if their power is bigger than λcr and no minimizers exist with power less than the critical threshold. We also give simple criteria for the finiteness and strict positivity of the critical threshold. Our proof of existence of minimizers is rather direct and avoids the use of Lions' concentration compactness argument. Furthermore, we give precise quantitative lower bounds on the exponential decay rate of the diffraction management solitons, which confirm the physical heuristic prediction for the asymptotic decay rate. Moreover, for ground state solutions, these bounds give a quantitative lower bound for the divergence of the exponential decay rate in the limit of vanishing average diffraction. For zero average diffraction, we prove quantitative bounds which show that the solitons decay much faster than exponentially. Our results considerably extend and strengthen the results of Hundertmark and Lee [J. Nonlinear Sci. 22, 1-38 (2012) and Commun. Math. Phys. 309(1), 1-21 (2012)].

Drusen Characterization with Multimodal Imaging

PubMed Central

Spaide, Richard F.; Curcio, Christine A.

2010-01-01

Summary Multimodal imaging findings and histological demonstration of soft drusen, cuticular drusen, and subretinal drusenoid deposits provided information used to develop a model explaining their imaging characteristics. Purpose To characterize the known appearance of cuticular drusen, subretinal drusenoid deposits (reticular pseudodrusen), and soft drusen as revealed by multimodal fundus imaging; to create an explanatory model that accounts for these observations. Methods Reported color, fluorescein angiographic, autofluorescence, and spectral domain optical coherence tomography (SD-OCT) images of patients with cuticular drusen, soft drusen, and subretinal drusenoid deposits were reviewed, as were actual images from affected eyes. Representative histological sections were examined. The geometry, location, and imaging characteristics of these lesions were evaluated. A hypothesis based on the Beer-Lambert Law of light absorption was generated to fit these observations. Results Cuticular drusen appear as numerous uniform round yellow-white punctate accumulations under the retinal pigment epithelium (RPE). Soft drusen are larger yellow-white dome-shaped mounds of deposit under the RPE. Subretinal drusenoid deposits are polymorphous light-grey interconnected accumulations above the RPE. Based on the model, both cuticular and soft drusen appear yellow due to the removal of shorter wavelength light by a double pass through the RPE. Subretinal drusenoid deposits, which are located on the RPE, are not subjected to short wavelength attenuation and therefore are more prominent when viewed with blue light. The location and morphology of extracellular material in relationship to the RPE, and associated changes to RPE morphology and pigmentation, appeared to be primary determinants of druse appearance in different imaging modalities. Conclusion Although cuticular drusen, subretinal drusenoid deposits, and soft drusen are composed of common components, they are distinguishable

Adhesion of multimode adhesives to enamel and dentin after one year of water storage.

PubMed

Vermelho, Paulo Moreira; Reis, André Figueiredo; Ambrosano, Glaucia Maria Bovi; Giannini, Marcelo

2017-06-01

This study aimed to evaluate the ultramorphological characteristics of tooth-resin interfaces and the bond strength (BS) of multimode adhesive systems to enamel and dentin. Multimode adhesives (Scotchbond Universal (SBU) and All-Bond Universal) were tested in both self-etch and etch-and-rinse modes and compared to control groups (Optibond FL and Clearfil SE Bond (CSB)). Adhesives were applied to human molars and composite blocks were incrementally built up. Teeth were sectioned to obtain specimens for microtensile BS and TEM analysis. Specimens were tested after storage for either 24 h or 1 year. SEM analyses were performed to classify the failure pattern of beam specimens after BS testing. Etching increased the enamel BS of multimode adhesives; however, BS decreased after storage for 1 year. No significant differences in dentin BS were noted between multimode and control in either evaluation period. Storage for 1 year only reduced the dentin BS for SBU in self-etch mode. TEM analysis identified hybridization and interaction zones in dentin and enamel for all adhesives. Silver impregnation was detected on dentin-resin interfaces after storage of specimens for 1 year only with the SBU and CSB. Storage for 1 year reduced enamel BS when adhesives are applied on etched surface; however, BS of multimode adhesives did not differ from those of the control group. In dentin, no significant difference was noted between the multimode and control group adhesives, regardless of etching mode. In general, multimode adhesives showed similar behavior when compared to traditional adhesive techniques. Multimode adhesives are one-step self-etching adhesives that can also be used after enamel/dentin phosphoric acid etching, but each product may work better in specific conditions.

Landmark Image Retrieval by Jointing Feature Refinement and Multimodal Classifier Learning.

PubMed

Zhang, Xiaoming; Wang, Senzhang; Li, Zhoujun; Ma, Shuai; Xiaoming Zhang; Senzhang Wang; Zhoujun Li; Shuai Ma; Ma, Shuai; Zhang, Xiaoming; Wang, Senzhang; Li, Zhoujun

2018-06-01

Landmark retrieval is to return a set of images with their landmarks similar to those of the query images. Existing studies on landmark retrieval focus on exploiting the geometries of landmarks for visual similarity matches. However, the visual content of social images is of large diversity in many landmarks, and also some images share common patterns over different landmarks. On the other side, it has been observed that social images usually contain multimodal contents, i.e., visual content and text tags, and each landmark has the unique characteristic of both visual content and text content. Therefore, the approaches based on similarity matching may not be effective in this environment. In this paper, we investigate whether the geographical correlation among the visual content and the text content could be exploited for landmark retrieval. In particular, we propose an effective multimodal landmark classification paradigm to leverage the multimodal contents of social image for landmark retrieval, which integrates feature refinement and landmark classifier with multimodal contents by a joint model. The geo-tagged images are automatically labeled for classifier learning. Visual features are refined based on low rank matrix recovery, and multimodal classification combined with group sparse is learned from the automatically labeled images. Finally, candidate images are ranked by combining classification result and semantic consistence measuring between the visual content and text content. Experiments on real-world datasets demonstrate the superiority of the proposed approach as compared to existing methods.

Good Student/Bad Student: Situated Identities in the Figured Worlds of School and Creative Multimodal Production

ERIC Educational Resources Information Center

Jocius, Robin

2017-01-01

This study situates young adolescents' multimodal composing practices within two figured worlds--school and creative multimodal production. In a microanalysis of two focal students' multimodal processes and products, I trace how pedagogical, interactional, and semiotic resources both reified and challenged students' developing identities as…

Volume curtaining: a focus+context effect for multimodal volume visualization

NASA Astrophysics Data System (ADS)

Fairfield, Adam J.; Plasencia, Jonathan; Jang, Yun; Theodore, Nicholas; Crawford, Neil R.; Frakes, David H.; Maciejewski, Ross

2014-03-01

In surgical preparation, physicians will often utilize multimodal imaging scans to capture complementary information to improve diagnosis and to drive patient-specific treatment. These imaging scans may consist of data from magnetic resonance imaging (MR), computed tomography (CT), or other various sources. The challenge in using these different modalities is that the physician must mentally map the two modalities together during the diagnosis and planning phase. Furthermore, the different imaging modalities will be generated at various resolutions as well as slightly different orientations due to patient placement during scans. In this work, we present an interactive system for multimodal data fusion, analysis and visualization. Developed with partners from neurological clinics, this work discusses initial system requirements and physician feedback at the various stages of component development. Finally, we present a novel focus+context technique for the interactive exploration of coregistered multi-modal data.

Counseling Mexican Americans: A Multimodal Approach.

ERIC Educational Resources Information Center

Ponterotto, Joseph G.

1987-01-01

Describes a culturally sensitive and relevant therapeutic framework for nonminority and minority counselors working with clients of Mexican-American heritage. Uses Lazarus's multimodal approach as the basis. Examines the current status of Mexican-American mental health service delivery and use. (Author/ABB)

A Novel Approach to Anharmonicity for a Wealth of Applications in Nonlinear Science Technologies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hanusse, Patrick

2011-04-19

We present a new theory of the anharmonicity of nonlinear oscillations that are exhibited by many physical systems. New physical quantities are introduced that describe the departure from linear or harmonic behavior and as far as extremely anharmonic situations. In order to solve the nonlinear phase equation, the key notion of our theory, which controls the anharmonic behavior, a new and fascinating nonlinear trigonometry is designed. These results provide a general and accurate yet compact description of such signals, by far better than the Fourier description, both quantitatively and qualitatively and will benefit many application fields.

Multimodal medical information retrieval with unsupervised rank fusion.

PubMed

Mourão, André; Martins, Flávio; Magalhães, João

2015-01-01

Modern medical information retrieval systems are paramount to manage the insurmountable quantities of clinical data. These systems empower health care experts in the diagnosis of patients and play an important role in the clinical decision process. However, the ever-growing heterogeneous information generated in medical environments poses several challenges for retrieval systems. We propose a medical information retrieval system with support for multimodal medical case-based retrieval. The system supports medical information discovery by providing multimodal search, through a novel data fusion algorithm, and term suggestions from a medical thesaurus. Our search system compared favorably to other systems in 2013 ImageCLEFMedical. Copyright © 2014 Elsevier Ltd. All rights reserved.

[A multimodal and multidisciplinary postoperative pain management concept].

PubMed

Ettrich, U; Seifert, J; Scharnagel, R; Günther, K P

2007-06-01

Under-treatment of acute postoperative pain can lead to chronic pain with neuronal plasticity and result in poor surgical outcomes. A multimodal approach is therefore necessary to reduce postoperative pain by combining various analgesics with a non-pharmacological strategy. The current use of multimodal approaches, even for the management of postoperative pain, can reduce the side effects of pharmaceutical therapy alone as well as reducing the length of hospital stay. Adequate pain control is an important prerequisite for the application of rehabilitation programmes and will thereby influence functional outcome. In addition, patient satisfaction, as a major benchmarking factor after surgical treatment, is significantly influenced by the quality of postoperative pain management.

2017 SmartWay Multimodal Carrier Tool Demonstration

EPA Pesticide Factsheets

This EPA presentation provides information on the SmartWay Multimodal Carrier Tool: its background and development, participation in the program, application process, emission metrics, tool demonstration, data collection, and schedule for 2017.

Multimodal Teacher Input and Science Learning in a Middle School Sheltered Classroom

ERIC Educational Resources Information Center

Zhang, Ying

2016-01-01

This article reports the results of an ethnographic research about the multimodal science discourse in a sixth-grade sheltered classroom involving English Language Learners (ELLs) only. Drawing from the perspective of multimodality, this study examines how science learning is constructed in science lectures through multiple semiotic resources,…

An Investigation on the Role of Multimodal Metaphors in e-Feedback Interfaces

ERIC Educational Resources Information Center

Rigas, Dimitrios; Alharbi, Abdulrhman

2011-01-01

Purpose: The purpose of this paper is to investigate the usability (effectiveness, efficiency and user satisfaction) of e-feedback interfaces. The experiment compares a traditional visual approach with a multimodal approach in order to determine the impact of multimodal metaphors upon the user's understanding, reasoning and engagement with the…

Readings and Experiences of Multimodality

ERIC Educational Resources Information Center

Leander, Kevin M.; Aziz, Seemi; Botzakis, Stergios; Ehret, Christian; Landry, David; Rowsell, Jennifer

2017-01-01

Our understanding of reading--including reading multimodal texts--is always constrained or opened up by what we consider to be a text, what aspects of a reader's embodied activity we focus on, and how we draw a boundary around a reading event. This article brings together five literacy researchers who respond to a human-scale graphic novel,…

Supervised learning based multimodal MRI brain tumour segmentation using texture features from supervoxels.

PubMed

Soltaninejad, Mohammadreza; Yang, Guang; Lambrou, Tryphon; Allinson, Nigel; Jones, Timothy L; Barrick, Thomas R; Howe, Franklyn A; Ye, Xujiong

2018-04-01

Accurate segmentation of brain tumour in magnetic resonance images (MRI) is a difficult task due to various tumour types. Using information and features from multimodal MRI including structural MRI and isotropic (p) and anisotropic (q) components derived from the diffusion tensor imaging (DTI) may result in a more accurate analysis of brain images. We propose a novel 3D supervoxel based learning method for segmentation of tumour in multimodal MRI brain images (conventional MRI and DTI). Supervoxels are generated using the information across the multimodal MRI dataset. For each supervoxel, a variety of features including histograms of texton descriptor, calculated using a set of Gabor filters with different sizes and orientations, and first order intensity statistical features are extracted. Those features are fed into a random forests (RF) classifier to classify each supervoxel into tumour core, oedema or healthy brain tissue. The method is evaluated on two datasets: 1) Our clinical dataset: 11 multimodal images of patients and 2) BRATS 2013 clinical dataset: 30 multimodal images. For our clinical dataset, the average detection sensitivity of tumour (including tumour core and oedema) using multimodal MRI is 86% with balanced error rate (BER) 7%; while the Dice score for automatic tumour segmentation against ground truth is 0.84. The corresponding results of the BRATS 2013 dataset are 96%, 2% and 0.89, respectively. The method demonstrates promising results in the segmentation of brain tumour. Adding features from multimodal MRI images can largely increase the segmentation accuracy. The method provides a close match to expert delineation across all tumour grades, leading to a faster and more reproducible method of brain tumour detection and delineation to aid patient management. Copyright © 2018 Elsevier B.V. All rights reserved.

Inducing in situ, nonlinear soil response applying an active source

USGS Publications Warehouse

Johnson, P.A.; Bodin, P.; Gomberg, J.; Pearce, F.; Lawrence, Z.; Menq, F.-Y.

2009-01-01

[1] It is well known that soil sites have a profound effect on ground motion during large earthquakes. The complex structure of soil deposits and the highly nonlinear constitutive behavior of soils largely control nonlinear site response at soil sites. Measurements of nonlinear soil response under natural conditions are critical to advancing our understanding of soil behavior during earthquakes. Many factors limit the use of earthquake observations to estimate nonlinear site response such that quantitative characterization of nonlinear behavior relies almost exclusively on laboratory experiments and modeling of wave propagation. Here we introduce a new method for in situ characterization of the nonlinear behavior of a natural soil formation using measurements obtained immediately adjacent to a large vibrator source. To our knowledge, we are the first group to propose and test such an approach. Employing a large, surface vibrator as a source, we measure the nonlinear behavior of the soil by incrementally increasing the source amplitude over a range of frequencies and monitoring changes in the output spectra. We apply a homodyne algorithm for measuring spectral amplitudes, which provides robust signal-to-noise ratios at the frequencies of interest. Spectral ratios are computed between the receivers and the source as well as receiver pairs located in an array adjacent to the source, providing the means to separate source and near-source nonlinearity from pervasive nonlinearity in the soil column. We find clear evidence of nonlinearity in significant decreases in the frequency of peak spectral ratios, corresponding to material softening with amplitude, observed across the array as the source amplitude is increased. The observed peak shifts are consistent with laboratory measurements of soil nonlinearity. Our results provide constraints for future numerical modeling studies of strong ground motion during earthquakes.

State deadbeat response and observability in multi-modal systems

NASA Technical Reports Server (NTRS)

Conner, L. T., Jr.; Stanford, D. P.

1984-01-01

Two aspects of multimodal systems are examined. It is shown that any completely controllable system with state dimension n not exceeding three allows a choice of feedback matrices resulting in a state deadbeat response. Some of the results presented here are valid for arbitrary n, and it is suggested that for all n the state deadbeat response can be obtained under the hypothesis of complete controllability. The controllability canonical form for a multimodal system is refined by introducing a notion of observability which is dual to controllability for these systems.

Interaction between visual and chemical cues in a Liolaemus lizard: a multimodal approach.

PubMed

Vicente, Natalin S; Halloy, Monique

2017-12-01

Multimodal communication involves the use of signals and cues across two or more sensory modalities. The genus Liolaemus (Iguania: Liolaemidae) offers a great potential for studies on the ecology and evolution of multimodal communication, including visual and chemical signals. In this study, we analyzed the response of male and female Liolaemus pacha to chemical, visual and combined (multimodal) stimuli. Using cue-isolation tests, we registered the number of tongue flicks and headbob displays from exposure to signals in each modality. Number of tongue flicks was greater when a chemical stimulus was presented alone than in the presence of visual or multimodal stimuli. In contrast, headbob displays were fewer in number with visual and chemical stimuli alone, but significantly higher in number when combined. Female signallers triggered significantly more tongue flicks than male signallers, suggesting that chemical cues are involved in sexual recognition. We did not find an inhibition between chemical and visual cues. On the contrary, we observed a dominance of the chemical modality, because when presented with visual stimuli, lizards also responded with more tongue flicks than headbob displays. The total response produced by multimodal stimuli was similar to that of the chemical stimuli alone, possibly suggesting non-redundancy. We discuss whether the visual component of a multimodal signal could attract attention at a distance, increasing the effectiveness of transmission and reception of the information in chemical cues. Copyright © 2017 Elsevier GmbH. All rights reserved.

Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness.

PubMed

Calhoun, Vince D; Sui, Jing

2016-05-01

It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness.

Femtosecond nonlinear ultrasonics in gold probed with ultrashort surface plasmons.

PubMed

Temnov, Vasily V; Klieber, Christoph; Nelson, Keith A; Thomay, Tim; Knittel, Vanessa; Leitenstorfer, Alfred; Makarov, Denys; Albrecht, Manfred; Bratschitsch, Rudolf

2013-01-01

Fundamental interactions induced by lattice vibrations on ultrafast time scales have become increasingly important for modern nanoscience and technology. Experimental access to the physical properties of acoustic phonons in the terahertz-frequency range and over the entire Brillouin zone is crucial for understanding electric and thermal transport in solids and their compounds. Here we report on the generation and nonlinear propagation of giant (1 per cent) acoustic strain pulses in hybrid gold/cobalt bilayer structures probed with ultrafast surface plasmon interferometry. This new technique allows for unambiguous characterization of arbitrary ultrafast acoustic transients. The giant acoustic pulses experience substantial nonlinear reshaping after a propagation distance of only 100 nm in a crystalline gold layer. Excellent agreement with the Korteveg-de Vries model points to future quantitative nonlinear femtosecond terahertz-ultrasonics at the nano-scale in metals at room temperature.

Multimodal transportation best practices and model element.

DOT National Transportation Integrated Search

2014-06-01

This report provides guidance in developing a multimodal transportation element of a local government comprehensive : plan. Two model elements were developed to address differences in statutory requirements for communities of different : sizes and pl...

Systemic multimodal approach to speech therapy treatment in autistic children.

PubMed

Tamas, Daniela; Marković, Slavica; Milankov, Vesela

2013-01-01

Conditions in which speech therapy treatment is applied in autistic children are often not in accordance with characteristics of opinions and learning of people with autism. A systemic multimodal approach means motivating autistic people to develop their language speech skill through the procedure which allows reliving of their personal experience according to the contents that are presented in the their natural social environment. This research was aimed at evaluating the efficiency of speech treatment based on the systemic multimodal approach to the work with autistic children. The study sample consisted of 34 children, aged from 8 to 16 years, diagnosed to have different autistic disorders, whose results showed a moderate and severe clinical picture of autism on the Childhood Autism Rating Scale. The applied instruments for the evaluation of ability were the Childhood Autism Rating Scale and Ganzberg II test. The study subjects were divided into two groups according to the type of treatment: children who were covered by the continuing treatment and systemic multimodal approach in the treatment, and children who were covered by classical speech treatment. It is shown that the systemic multimodal approach in teaching autistic children affects the stimulation of communication, socialization, self-service and work as well as that the progress achieved in these areas of functioning was retainable after long time, too. By applying the systemic multimodal approach when dealing with autistic children and by comparing their achievements on tests applied before, during and after the application of this mode, it has been concluded that certain improvement has been achieved in the functionality within the diagnosed category. The results point to a possible direction in the creation of new methods, plans and programs in dealing with autistic children based on empirical and interactive learning.

Evaluation of the Dawson College Shooting Psychological Intervention: Moving Toward a Multimodal Extensive Plan

PubMed Central

Séguin, Monique; Chawky, Nadia; Lesage, Alain; Boyer, Richard; Guay, Stéphane; Bleau, Pierre; Miquelon, Paule; Szkrumelak, Nadia; Steiner, Warren; Roy, Denise

2013-01-01

In 2006, following the shooting at Dawson College, the authorities implemented an intervention plan. This provided an opportunity to analyze the responses to services offered, and afforded a learning opportunity, which led to the proposal of an extensive multimodal short- and long-term psychological plan for future needs. Both quantitative and qualitative data were gathered 18 months after the event, involving the participation of 948 students and staff. Mental health problems and the perception of services offered after the shooting were investigated, using standardized measures. Second, focus groups and individual interviews were conducted among a subgroup of participants (support team members; teachers and employees; students and parents) and permitted to gather data on services received and services required. Individual report of events, the extent of psychological impact and services offered and received were analyzed in terms of the following dimensions: intervention philosophy, training, ongoing offer of services and finally, detection and outreach. A significant incidence of disorders and a high rate of exacerbation of preexisting mental disorders were observed within the 18 months following the shooting. Postimmediate and short-term intervention appeared adequate, but the long-term collective vision toward community support and availability of mental health services were lacking. Lessons learned from this evaluation and other school shootings suggest that preparedness and long-term community responses are often overlooked. A multimodal extensive plan is proposed based on a theoretical model from which interventions strategies could be drawn. PMID:24795790

Multimodal Event Detection in Twitter Hashtag Networks

DOE PAGES

Yilmaz, Yasin; Hero, Alfred O.

2016-07-01

In this study, event detection in a multimodal Twitter dataset is considered. We treat the hashtags in the dataset as instances with two modes: text and geolocation features. The text feature consists of a bag-of-words representation. The geolocation feature consists of geotags (i.e., geographical coordinates) of the tweets. Fusing the multimodal data we aim to detect, in terms of topic and geolocation, the interesting events and the associated hashtags. To this end, a generative latent variable model is assumed, and a generalized expectation-maximization (EM) algorithm is derived to learn the model parameters. The proposed method is computationally efficient, and lendsmore » itself to big datasets. Lastly, experimental results on a Twitter dataset from August 2014 show the efficacy of the proposed method.« less

Multimodality therapy of local regional esophageal cancer.

PubMed

Kelsen, David P

2005-12-01

Recent trials regarding the use of multimodality therapy for patients with cancers of the esophagus and gastroesophageal junction have not conclusively shown benefit. Regimens containing cisplatin and fluorouracil administered preoperatively appear to be tolerable and do not increase operative morbidity or mortality when compared with surgery alone. Yet clinical trials have not clearly shown that such regimens improve outcome as measured by survival. Likewise, trials of postoperative chemoradiation have not reported a significant improvement in median or overall survival. The reasons for the lack of clinical benefit from multimodality therapy are not completely understood, but improvements in systemic therapy will probably be necessary before disease-free or overall survival improves substantially. Some new single agents such as the taxanes (docetaxel or paclitaxel) and the camptothecan analog irinotecan have shown modest activity for palliative therapy.

Multimode interference tapered fiber refractive index sensors.

PubMed

Biazoli, Claudecir R; Silva, Susana; Franco, Marcos A R; Frazão, Orlando; Cordeiro, Cristiano M B

2012-08-20

Real-time monitoring of the fabrication process of tapering down a multimode-interference-based fiber structure is presented. The device is composed of a pure silica multimode fiber (MMF) with an initial 125 μm diameter spliced between two single-mode fibers. The process allows a thin MMF with adjustable parameters to obtain a high signal transmittance, arising from constructive interference among the guided modes at the output end of the MMF. Tapered structures with waist diameters as low as 55 μm were easily fabricated without the limitation of fragile splices or difficulty in controlling lateral fiber alignments. The sensing device is shown to be sensitive to the external environment, and a maximum sensitivity of 2946 nm/refractive index unit in the refractive index range of 1.42-1.43 was attained.

Aspergillus infection monitored by multimodal imaging in a rat model.

PubMed

Pluhacek, Tomas; Petrik, Milos; Luptakova, Dominika; Benada, Oldrich; Palyzova, Andrea; Lemr, Karel; Havlicek, Vladimir

2016-06-01

Although myriads of experimental approaches have been published in the field of fungal infection diagnostics, interestingly, in 21st century there is no satisfactory early noninvasive tool for Aspergillus diagnostics with good sensitivity and specificity. In this work, we for the first time described the fungal burden in rat lungs by multimodal imaging approach. The Aspergillus infection was monitored by positron emission tomography and light microscopy employing modified Grocott's methenamine silver staining and eosin counterstaining. Laser ablation inductively coupled plasma mass spectrometry imaging has revealed a dramatic iron increase in fungi-affected areas, which can be presumably attributed to microbial siderophores. Quantitative elemental data were inferred from matrix-matched standards prepared from rat lungs. The iron, silver, and gold MS images collected with variable laser foci revealed that particularly silver or gold can be used as excellent elements useful for sensitively tracking the Aspergillus infection. The limit of detection was determined for both (107) Ag and (197) Au as 0.03 μg/g (5 μm laser focus). The selective incorporation of (107) Ag and (197) Au into fungal cell bodies and low background noise from both elements were confirmed by energy dispersive X-ray scattering utilizing the submicron lateral resolving power of scanning electron microscopy. The low limits of detection and quantitation of both gold and silver make ICP-MS imaging monitoring a viable alternative to standard optical evaluation used in current clinical settings. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Nonlinear identification of the total baroreflex arc

PubMed Central

Moslehpour, Mohsen; Kawada, Toru; Sunagawa, Kenji; Sugimachi, Masaru

2015-01-01

The total baroreflex arc [the open-loop system relating carotid sinus pressure (CSP) to arterial pressure (AP)] is known to exhibit nonlinear behaviors. However, few studies have quantitatively characterized its nonlinear dynamics. The aim of this study was to develop a nonlinear model of the sympathetically mediated total arc without assuming any model form. Normal rats were studied under anesthesia. The vagal and aortic depressor nerves were sectioned, the carotid sinus regions were isolated and attached to a servo-controlled piston pump, and the AP and sympathetic nerve activity (SNA) were measured. CSP was perturbed using a Gaussian white noise signal. A second-order Volterra model was developed by applying nonparametric identification to the measurements. The second-order kernel was mainly diagonal, but the diagonal differed in shape from the first-order kernel. Hence, a reduced second-order model was similarly developed comprising a linear dynamic system in parallel with a squaring system in cascade with a slower linear dynamic system. This “Uryson” model predicted AP changes 12% better (P < 0.01) than a linear model in response to new Gaussian white noise CSP. The model also predicted nonlinear behaviors, including thresholding and mean responses to CSP changes about the mean. Models of the neural arc (the system relating CSP to SNA) and peripheral arc (the system relating SNA to AP) were likewise developed and tested. However, these models of subsystems of the total arc showed approximately linear behaviors. In conclusion, the validated nonlinear model of the total arc revealed that the system takes on an Uryson structure. PMID:26354845

Brain tissues atrophy is not always the best structural biomarker of physiological aging: A multimodal cross-sectional study.

PubMed

Cherubini, Andrea; Caligiuri, Maria Eugenia; Péran, Patrice; Sabatini, Umberto; Cosentino, Carlo; Amato, Francesco

2015-01-01

This study presents a voxel-based multiple regression analysis of different magnetic resonance image modalities, including anatomical T1-weighted, T2* relaxometry, and diffusion tensor imaging. Quantitative parameters sensitive to complementary brain tissue alterations, including morphometric atrophy, mineralization, microstructural damage, and anisotropy loss, were compared in a linear physiological aging model in 140 healthy subjects (range 20-74 years). The performance of different predictors and the identification of the best biomarker of age-induced structural variation were compared without a priori anatomical knowledge. The best quantitative predictors in several brain regions were iron deposition and microstructural damage, rather than macroscopic tissue atrophy. Age variations were best resolved with a combination of markers, suggesting that multiple predictors better capture age-induced tissue alterations. These findings highlight the importance of a combined evaluation of multimodal biomarkers for the study of aging and point to a number of novel applications for the method described.

Multimodal 2D Brain Computer Interface.

PubMed

Almajidy, Rand K; Boudria, Yacine; Hofmann, Ulrich G; Besio, Walter; Mankodiya, Kunal

2015-08-01

In this work we used multimodal, non-invasive brain signal recording systems, namely Near Infrared Spectroscopy (NIRS), disc electrode electroencephalography (EEG) and tripolar concentric ring electrodes (TCRE) electroencephalography (tEEG). 7 healthy subjects participated in our experiments to control a 2-D Brain Computer Interface (BCI). Four motor imagery task were performed, imagery motion of the left hand, the right hand, both hands and both feet. The signal slope (SS) of the change in oxygenated hemoglobin concentration measured by NIRS was used for feature extraction while the power spectrum density (PSD) of both EEG and tEEG in the frequency band 8-30Hz was used for feature extraction. Linear Discriminant Analysis (LDA) was used to classify different combinations of the aforementioned features. The highest classification accuracy (85.2%) was achieved by using features from all the three brain signals recording modules. The improvement in classification accuracy was highly significant (p = 0.0033) when using the multimodal signals features as compared to pure EEG features.

Multimodal emotion perception after anterior temporal lobectomy (ATL)

PubMed Central

Milesi, Valérie; Cekic, Sezen; Péron, Julie; Frühholz, Sascha; Cristinzio, Chiara; Seeck, Margitta; Grandjean, Didier

2014-01-01

In the context of emotion information processing, several studies have demonstrated the involvement of the amygdala in emotion perception, for unimodal and multimodal stimuli. However, it seems that not only the amygdala, but several regions around it, may also play a major role in multimodal emotional integration. In order to investigate the contribution of these regions to multimodal emotion perception, five patients who had undergone unilateral anterior temporal lobe resection were exposed to both unimodal (vocal or visual) and audiovisual emotional and neutral stimuli. In a classic paradigm, participants were asked to rate the emotional intensity of angry, fearful, joyful, and neutral stimuli on visual analog scales. Compared with matched controls, patients exhibited impaired categorization of joyful expressions, whether the stimuli were auditory, visual, or audiovisual. Patients confused joyful faces with neutral faces, and joyful prosody with surprise. In the case of fear, unlike matched controls, patients provided lower intensity ratings for visual stimuli than for vocal and audiovisual ones. Fearful faces were frequently confused with surprised ones. When we controlled for lesion size, we no longer observed any overall difference between patients and controls in their ratings of emotional intensity on the target scales. Lesion size had the greatest effect on intensity perceptions and accuracy in the visual modality, irrespective of the type of emotion. These new findings suggest that a damaged amygdala, or a disrupted bundle between the amygdala and the ventral part of the occipital lobe, has a greater impact on emotion perception in the visual modality than it does in either the vocal or audiovisual one. We can surmise that patients are able to use the auditory information contained in multimodal stimuli to compensate for difficulty processing visually conveyed emotion. PMID:24839437

Construction of a multimodal CT-video chest model

NASA Astrophysics Data System (ADS)

Byrnes, Patrick D.; Higgins, William E.

2014-03-01

Bronchoscopy enables a number of minimally invasive chest procedures for diseases such as lung cancer and asthma. For example, using the bronchoscope's continuous video stream as a guide, a physician can navigate through the lung airways to examine general airway health, collect tissue samples, or administer a disease treatment. In addition, physicians can now use new image-guided intervention (IGI) systems, which draw upon both three-dimensional (3D) multi-detector computed tomography (MDCT) chest scans and bronchoscopic video, to assist with bronchoscope navigation. Unfortunately, little use is made of the acquired video stream, a potentially invaluable source of information. In addition, little effort has been made to link the bronchoscopic video stream to the detailed anatomical information given by a patient's 3D MDCT chest scan. We propose a method for constructing a multimodal CT-video model of the chest. After automatically computing a patient's 3D MDCT-based airway-tree model, the method next parses the available video data to generate a positional linkage between a sparse set of key video frames and airway path locations. Next, a fusion/mapping of the video's color mucosal information and MDCT-based endoluminal surfaces is performed. This results in the final multimodal CT-video chest model. The data structure constituting the model provides a history of those airway locations visited during bronchoscopy. It also provides for quick visual access to relevant sections of the airway wall by condensing large portions of endoscopic video into representative frames containing important structural and textural information. When examined with a set of interactive visualization tools, the resulting fused data structure provides a rich multimodal data source. We demonstrate the potential of the multimodal model with both phantom and human data.

[Implementation of interdisciplinary multimodal pain therapy according to OPS 8‑918 : Recommendations of the ad hoc commission for interdisciplinary multimodal pain therapy of the German Pain Association].

PubMed

Arnold, B; Böger, A; Brinkschmidt, T; Casser, H-R; Irnich, D; Kaiser, U; Klimczyk, K; Lutz, J; Pfingsten, M; Sabatowski, R; Schiltenwolf, M; Söllner, W

2018-02-01

With the implementation of the German diagnosis-related groups (DRG) reimbursement system in hospitals, interdisciplinary multimodal pain therapy was incorporated into the associated catalogue of procedures (OPS 8‑918). Yet, the presented criteria describing the procedure of interdisciplinary multimodal pain therapy are neither precise nor unambiguous. This has led to discrepancies in the interpretation regarding the handling of the procedure-making it difficult for medical services of health insurance companies to evaluate the accordance between the delivered therapy and the required criteria. Since the number of pain units has increased in recent years, the number of examinations by the medical service of health insurance companies has increased. This article, published by the ad hoc commission for interdisciplinary multimodal pain therapy of the German Pain Association, provides specific recommendations for correct implementation of interdisciplinary multimodal pain therapy in routine care. The aim is to achieve a maximum level of accordance between health care providers and the requirements of the medical examiners from health insurance companies. More extensive criteria regarding interdisciplinary multimodal pain treatment in an in-patient setting, especially for patients with chronic and complex pain, are obviously needed. Thus, the authors further discuss specific aspects towards further development of the OPS-code. However, the application of the OPS-code still leaves room regarding treatment intensity and process quality. Therefore, the delivery of pain management in sufficient quantity and quality still remains the responsibility of each health care provider.

The Impact Of Multimode Fiber Chromatic Dispersion On Data Communications

NASA Astrophysics Data System (ADS)

Hackert, Michael J.

1990-01-01

Capability for the lowest cost is the goal of contemporary communications managers. With all of the competitive pressures that modern businesses are experiencing these days, communications needs must be met with the most information carrying capacity for the lowest cost. Optical fiber communication systems meet these requirements while providing reliability, system integrity, and potential future upgradability. Consequently, optical fiber is finding numerous applications in addition to its traditional telephony plant. Fiber based systems are meeting these requirements in building networks and computer interconnects at a lower cost than copper based systems. A fiber type being chosen by industry to meet these needs in standard systems such as FDDI, is multimode fiber. Multimode fiber systems offer cost advantages over single-mode fiber through lower fiber connection costs. Also, system designers can gain savings by using low cost, high reliability, wide spectral width sources such as LEDs instead of lasers and by operating at higher bit rates than used for multimode systems in the past. However, in order to maximize the cost savings while ensuring the system will operate as intended, the chromatic dispersion of the fiber must be taken into account. This paper explains how to do that and shows how to calculate multimode chromatic dispersion for each of the standard fiber sizes (50 μm, 62.5 μm, 85 μm, and 100μm core diameter).

Nonlinear phenomena in the vocalizations of North Atlantic right whales (Eubalaena glacialis) and killer whales (Orcinus orca).

PubMed

Tyson, Reny B; Nowacek, Douglas P; Miller, Patrick J O

2007-09-01

Nonlinear phenomena or nonlinearities in animal vocalizations include features such as subharmonics, deterministic chaos, biphonation, and frequency jumps that until recently were generally ignored in acoustic analyses. Recent documentation of these phenomena in several species suggests that they may play a communicative role, though the exact function is still under investigation. Here, qualitative descriptions and quantitative analyses of nonlinearities in the vocalizations of killer whales (Orcinus orca) and North Atlantic right whales (Eubalaena glacialis) are provided. All four nonlinear features were present in both species, with at least one feature occurring in 92.4% of killer and 65.7% of right whale vocalizations analyzed. Occurrence of biphonation varied the most between species, being present in 89.0% of killer whale vocalizations and only 20.4% of right whale vocalizations. Because deterministic chaos is qualitatively and quantitatively different than random or Gaussian noise, a program (TISEAN) designed specifically to identify deterministic chaos to confirm the presence of this nonlinearity was used. All segments tested in this software indicate that both species do indeed exhibit deterministic chaos. The results of this study provide confirmation that such features are common in the vocalizations of cetacean species and lay the groundwork for future studies.

Influence of Ultrasonic Nonlinear Propagation on Hydrophone Calibration Using Two-Transducer Reciprocity Method

NASA Astrophysics Data System (ADS)

Yoshioka, Masahiro; Sato, Sojun; Kikuchi, Tsuneo; Matsuda, Yoichi

2006-05-01

In this study, the influence of ultrasonic nonlinear propagation on hydrophone calibration by the two-transducer reciprocity method is investigated quantitatively using the Khokhlov-Zabolotskaya-Kuznetsov (KZK) equation. It is proposed that the correction for the diffraction and attenuation of ultrasonic waves used in two-transducer reciprocity calibration can be derived using the KZK equation to remove the influence of nonlinear propagation. The validity of the correction is confirmed by comparing the sensitivities calibrated by the two-transducer reciprocity method and laser interferometry.

Multimodality and interactivity: connecting properties of serious games with educational outcomes.

PubMed

Ritterfeld, Ute; Shen, Cuihua; Wang, Hua; Nocera, Luciano; Wong, Wee Ling

2009-12-01

Serious games have become an important genre of digital media and are often acclaimed for their potential to enhance deeper learning because of their unique technological properties. Yet the discourse has largely remained at a conceptual level. For an empirical evaluation of educational games, extra effort is needed to separate intertwined and confounding factors in order to manipulate and thus attribute the outcome to one property independent of another. This study represents one of the first attempts to empirically test the educational impact of two important properties of serious games, multimodality and interactivity, through a partial 2 x 3 (interactive, noninteractive by high, moderate, low in multimodality) factorial between-participants follow-up experiment. Results indicate that both multimodality and interactivity contribute to educational outcomes individually. Implications for educational strategies and future research directions are discussed.

Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness

PubMed Central

Calhoun, Vince D; Sui, Jing

2016-01-01

It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness. PMID:27347565

Multi-focus beam shaping of high power multimode lasers

NASA Astrophysics Data System (ADS)

Laskin, Alexander; Volpp, Joerg; Laskin, Vadim; Ostrun, Aleksei

2017-08-01

Beam shaping of powerful multimode fiber lasers, fiber-coupled solid-state and diode lasers is of great importance for improvements of industrial laser applications. Welding, cladding with millimetre scale working spots benefit from "inverseGauss" intensity profiles; performance of thick metal sheet cutting, deep penetration welding can be enhanced when distributing the laser energy along the optical axis as more efficient usage of laser energy, higher edge quality and reduction of the heat affected zone can be achieved. Building of beam shaping optics for multimode lasers encounters physical limitations due to the low beam spatial coherence of multimode fiber-coupled lasers resulting in big Beam Parameter Products (BPP) or M² values. The laser radiation emerging from a multimode fiber presents a mixture of wavefronts. The fiber end can be considered as a light source which optical properties are intermediate between a Lambertian source and a single mode laser beam. Imaging of the fiber end, using a collimator and a focusing objective, is a robust and widely used beam delivery approach. Beam shaping solutions are suggested in form of optics combining fiber end imaging and geometrical separation of focused spots either perpendicular to or along the optical axis. Thus, energy of high power lasers is distributed among multiple foci. In order to provide reliable operation with multi-kW lasers and avoid damages the optics are designed as refractive elements with smooth optical surfaces. The paper presents descriptions of multi-focus optics as well as examples of intensity profile measurements of beam caustics and application results.

Fatigue crack damage detection using subharmonic component with nonlinear boundary condition

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wu, Weiliang, E-mail: wwl@whu.edu.cn; Qu, Wenzhong, E-mail: qwz@whu.edu.cn, E-mail: xiaoli6401@126.com; Xiao, Li, E-mail: qwz@whu.edu.cn, E-mail: xiaoli6401@126.com

In recent years, researchers have focused on structural health monitoring (SHM) and damage detection techniques using nonlinear vibration and nonlinear ultrasonic methods. Fatigue cracks may exhibit contact acoustic nonlinearity (CAN) with distinctive features such as superharmonics and subharmonics in the power spectrum of the sensing signals. However, challenges have been noticed in the practical applications of the harmonic methods. For instance, superharmonics can also be generated by the piezoelectric transducers and the electronic equipment; super/subharmonics may also stem from the nonlinear boundary conditions such as structural fixtures and joints. It is hard to tell whether the nonlinear features come frommore » the structural damage or the intrinsic nonlinear boundary conditions. The objective of this paper is to demonstrate the application of nonlinear ultrasonic subharmonic method for detecting fatigue cracks with nonlinear boundary conditions. The fatigue crack was qualitatively modeled as a single-degree-of-freedom (SDOF) system with non-classical hysteretic nonlinear interface forces at both sides of the crack surfaces. The threshold of subharmonic generation was studied, and the influence of crack interface parameters on the subharmonic resonance condition was investigated. The different threshold behaviors between the nonlinear boundary condition and the fatigue crack was found, which can be used to distinguish the source of nonlinear subharmonic features. To evaluate the proposed method, experiments of an aluminum plate with a fatigue crack were conducted to quantitatively verify the subharmonic resonance range. Two surface-bonded piezoelectric transducers were used to generate and receive ultrasonic wave signals. The fatigue damage was characterized in terms of a subharmonic damage index. The experimental results demonstrated that the subharmonic component of the sensing signal can be used to detect the fatigue crack and further distinguish it

Fatigue crack damage detection using subharmonic component with nonlinear boundary condition

NASA Astrophysics Data System (ADS)

Wu, Weiliang; Shen, Yanfeng; Qu, Wenzhong; Xiao, Li; Giurgiutiu, Victor

2015-03-01

In recent years, researchers have focused on structural health monitoring (SHM) and damage detection techniques using nonlinear vibration and nonlinear ultrasonic methods. Fatigue cracks may exhibit contact acoustic nonlinearity (CAN) with distinctive features such as superharmonics and subharmonics in the power spectrum of the sensing signals. However, challenges have been noticed in the practical applications of the harmonic methods. For instance, superharmonics can also be generated by the piezoelectric transducers and the electronic equipment; super/subharmonics may also stem from the nonlinear boundary conditions such as structural fixtures and joints. It is hard to tell whether the nonlinear features come from the structural damage or the intrinsic nonlinear boundary conditions. The objective of this paper is to demonstrate the application of nonlinear ultrasonic subharmonic method for detecting fatigue cracks with nonlinear boundary conditions. The fatigue crack was qualitatively modeled as a single-degree-of-freedom (SDOF) system with non-classical hysteretic nonlinear interface forces at both sides of the crack surfaces. The threshold of subharmonic generation was studied, and the influence of crack interface parameters on the subharmonic resonance condition was investigated. The different threshold behaviors between the nonlinear boundary condition and the fatigue crack was found, which can be used to distinguish the source of nonlinear subharmonic features. To evaluate the proposed method, experiments of an aluminum plate with a fatigue crack were conducted to quantitatively verify the subharmonic resonance range. Two surface-bonded piezoelectric transducers were used to generate and receive ultrasonic wave signals. The fatigue damage was characterized in terms of a subharmonic damage index. The experimental results demonstrated that the subharmonic component of the sensing signal can be used to detect the fatigue crack and further distinguish it from

Nonlinear Chemical Dynamics and Synchronization

NASA Astrophysics Data System (ADS)

Li, Ning

Alan Turing's work on morphogenesis, more than half a century ago, continues to motivate and inspire theoretical and experimental biologists even today. That said, there are very few experimental systems for which Turing's theory is applicable. In this thesis we present an experimental reaction-diffusion system ideally suited for testing Turing's ideas in synthetic "cells" consisting of microfluidically produced surfactant-stabilized emulsions in which droplets containing the Belousov-Zhabotinsky (BZ) oscillatory chemical reactants are dispersed in oil. The BZ reaction has become the prototype of nonlinear dynamics in chemistry and a preferred system for exploring the behavior of coupled nonlinear oscillators. Our system consists of a surfactant stabilized monodisperse emulsion of drops of aqueous BZ solution dispersed in a continuous phase of oil. In contrast to biology, here the chemistry is understood, rate constants are measured and interdrop coupling is purely diffusive. We explore a large set of parameters through control of rate constants, drop size, spacing, and spatial arrangement of the drops in lines and rings in one-dimension (1D) and hexagonal arrays in two-dimensions (2D). The Turing model is regarded as a metaphor for morphogenesis in biology but not for prediction. Here, we develop a quantitative and falsifiable reaction-diffusion model that we experimentally test with synthetic cells. We quantitatively establish the extent to which the Turing model in 1D describes both stationary pattern formation and temporal synchronization of chemical oscillators via reaction-diffusion and in 2D demonstrate that chemical morphogenesis drives physical differentiation in synthetic cells.

Marveling at "The Man Called Nova": Comics as Sponsors of Multimodal Literacy

ERIC Educational Resources Information Center

Jacobs, Dale

2007-01-01

This essay theorizes the ways in which comics, and Marvel Comics in particular, acted as sponsors of multimodal literacy for the author. In doing so, the essay demonstrates the possibilities that exist in examining comics more closely and in thinking about how literacy sponsorship happens in multimodal texts. (Contains 1 figure and 13 notes.)

Melanoma detection using smartphone and multimode hyperspectral imaging

NASA Astrophysics Data System (ADS)

MacKinnon, Nicholas; Vasefi, Fartash; Booth, Nicholas; Farkas, Daniel L.

2016-04-01

This project's goal is to determine how to effectively implement a technology continuum from a low cost, remotely deployable imaging device to a more sophisticated multimode imaging system within a standard clinical practice. In this work a smartphone is used in conjunction with an optical attachment to capture cross-polarized and collinear color images of a nevus that are analyzed to quantify chromophore distribution. The nevus is also imaged by a multimode hyperspectral system, our proprietary SkinSpect™ device. Relative accuracy and biological plausibility of the two systems algorithms are compared to assess aspects of feasibility of in-home or primary care practitioner smartphone screening prior to rigorous clinical analysis via the SkinSpect.

Automated multimodal spectral histopathology for quantitative diagnosis of residual tumour during basal cell carcinoma surgery.

PubMed

Boitor, Radu; Kong, Kenny; Shipp, Dustin; Varma, Sandeep; Koloydenko, Alexey; Kulkarni, Kusum; Elsheikh, Somaia; Schut, Tom Bakker; Caspers, Peter; Puppels, Gerwin; van der Wolf, Martin; Sokolova, Elena; Nijsten, T E C; Salence, Brogan; Williams, Hywel; Notingher, Ioan

2017-12-01

Multimodal spectral histopathology (MSH), an optical technique combining tissue auto-fluorescence (AF) imaging and Raman micro-spectroscopy (RMS), was previously proposed for detection of residual basal cell carcinoma (BCC) at the surface of surgically-resected skin tissue. Here we report the development of a fully-automated prototype instrument based on MSH designed to be used in the clinic and operated by a non-specialist spectroscopy user. The algorithms for the AF image processing and Raman spectroscopy classification had been first optimised on a manually-operated laboratory instrument and then validated on the automated prototype using skin samples from independent patients. We present results on a range of skin samples excised during Mohs micrographic surgery, and demonstrate consistent diagnosis obtained in repeat test measurement, in agreement with the reference histopathology diagnosis. We also show that the prototype instrument can be operated by clinical users (a skin surgeon and a core medical trainee, after only 1-8 hours of training) to obtain consistent results in agreement with histopathology. The development of the new automated prototype and demonstration of inter-instrument transferability of the diagnosis models are important steps on the clinical translation path: it allows the testing of the MSH technology in a relevant clinical environment in order to evaluate its performance on a sufficiently large number of patients.

Tunable multiwavelength Tm-doped fiber laser based on the multimode interference effect.

PubMed

Zhang, Peng; Wang, Tianshu; Ma, Wanzhuo; Dong, Keyan; Jiang, Huilin

2015-05-20

A simple multiwavelength Tm-doped fiber laser at the 2 μm band based on multimode interference (MMI) is proposed and experimentally demonstrated. In this scheme, a 4 m Tm-doped single-mode fiber is pumped by a 1568 nm laser, and a single-mode-multimode-single-mode (SMS) fiber structure is used as an MMI filter in which the multimode fiber is used to tune the laser. Laser operation of up to three wavelengths is obtained based on the MMI filter. The wavelengths can be tuned by adjusting the polarization controller and rotating the multimode fiber in the SMS structure, and the tuning region is about 24 nm, i.e., 1892-1916 nm. The side-mode suppression ratio of the laser is about 54 dB. The 3 dB linewidth is less than 0.04 nm. Peak fluctuation at each wavelength is analyzed, and the results show that the power fluctuation is less than 3 dB around the average power.

Z-scan theory for nonlocal nonlinear media with simultaneous nonlinear refraction and nonlinear absorption.

PubMed

Rashidian Vaziri, Mohammad Reza

2013-07-10

In this paper, the Z-scan theory for nonlocal nonlinear media has been further developed when nonlinear absorption and nonlinear refraction appear simultaneously. To this end, the nonlinear photoinduced phase shift between the impinging and outgoing Gaussian beams from a nonlocal nonlinear sample has been generalized. It is shown that this kind of phase shift will reduce correctly to its known counterpart for the case of pure refractive nonlinearity. Using this generalized form of phase shift, the basic formulas for closed- and open-aperture beam transmittances in the far field have been provided, and a simple procedure for interpreting the Z-scan results has been proposed. In this procedure, by separately performing open- and closed-aperture Z-scan experiments and using the represented relations for the far-field transmittances, one can measure the nonlinear absorption coefficient and nonlinear index of refraction as well as the order of nonlocality. Theoretically, it is shown that when the absorptive nonlinearity is present in addition to the refractive nonlinearity, the sample nonlocal response can noticeably suppress the peak and enhance the valley of the Z-scan closed-aperture transmittance curves, which is due to the nonlocal action's ability to change the beam transverse dimensions.

Empowering Prospective Teachers to Become Active Sense-Makers: Multimodal Modeling of the Seasons

ERIC Educational Resources Information Center

Kim, Mi Song

2015-01-01

Situating science concepts in concrete and authentic contexts, using information and communications technologies, including multimodal modeling tools, is important for promoting the development of higher-order thinking skills in learners. However, teachers often struggle to integrate emergent multimodal models into a technology-rich informal…

Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

PubMed Central

Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

2009-01-01

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

Interventions for Detrusor Overactivity: The Case for Multimodal Therapy

PubMed Central

Dmochowski, Roger

2002-01-01

Viable therapeutic alternatives for the management of overactive bladder (OAB) have recently evolved that provide satisfactory symptomatic control for the majority of patients. However, the presupposition that interventions exist as stand-alone entities is not representative of experience in unique populations with the therapeutic benefit of combination therapy, using components drawn from behavioral, physiotherapeutic, neuromodulatory, and, if necessary, surgical alternatives. Even in populations relatively refractory to therapy, the use of multimodal therapy yields additive benefits for patients with OAB symptoms. Herein is detailed the evidence supporting the concept that multimodal therapy provides optimal benefit to patients suffering from this symptom complex. PMID:16986017

Quantitative fluorescence tomography using a trimodality system: in vivo validation

PubMed Central

Lin, Yuting; Barber, William C.; Iwanczyk, Jan S.; Roeck, Werner W.; Nalcioglu, Orhan; Gulsen, Gultekin

2010-01-01

A fully integrated trimodality fluorescence, diffuse optical, and x-ray computed tomography (FT∕DOT∕XCT) system for small animal imaging is reported in this work. The main purpose of this system is to obtain quantitatively accurate fluorescence concentration images using a multimodality approach. XCT offers anatomical information, while DOT provides the necessary background optical property map to improve FT image accuracy. The quantitative accuracy of this trimodality system is demonstrated in vivo. In particular, we show that a 2-mm-diam fluorescence inclusion located 8 mm deep in a nude mouse can only be localized when functional a priori information from DOT is available. However, the error in the recovered fluorophore concentration is nearly 87%. On the other hand, the fluorophore concentration can be accurately recovered within 2% error when both DOT functional and XCT structural a priori information are utilized together to guide and constrain the FT reconstruction algorithm. PMID:20799770

Empowering Prospective Teachers to Become Active Sense-Makers: Multimodal Modeling of the Seasons

NASA Astrophysics Data System (ADS)

Kim, Mi Song

2015-10-01

Situating science concepts in concrete and authentic contexts, using information and communications technologies, including multimodal modeling tools, is important for promoting the development of higher-order thinking skills in learners. However, teachers often struggle to integrate emergent multimodal models into a technology-rich informal learning environment. Our design-based research co-designs and develops engaging, immersive, and interactive informal learning activities called "Embodied Modeling-Mediated Activities" (EMMA) to support not only Singaporean learners' deep learning of astronomy but also the capacity of teachers. As part of the research on EMMA, this case study describes two prospective teachers' co-design processes involving multimodal models for teaching and learning the concept of the seasons in a technology-rich informal learning setting. Our study uncovers four prominent themes emerging from our data concerning the contextualized nature of learning and teaching involving multimodal models in informal learning contexts: (1) promoting communication and emerging questions, (2) offering affordances through limitations, (3) explaining one concept involving multiple concepts, and (4) integrating teaching and learning experiences. This study has an implication for the development of a pedagogical framework for teaching and learning in technology-enhanced learning environments—that is empowering teachers to become active sense-makers using multimodal models.

Generation Mechanism of Nonlinear Rayleigh Surface Waves for Randomly Distributed Surface Micro-Cracks.

PubMed

Ding, Xiangyan; Li, Feilong; Zhao, Youxuan; Xu, Yongmei; Hu, Ning; Cao, Peng; Deng, Mingxi

2018-04-23

This paper investigates the propagation of Rayleigh surface waves in structures with randomly distributed surface micro-cracks using numerical simulations. The results revealed a significant ultrasonic nonlinear effect caused by the surface micro-cracks, which is mainly represented by a second harmonic with even more distinct third/quadruple harmonics. Based on statistical analysis from the numerous results of random micro-crack models, it is clearly found that the acoustic nonlinear parameter increases linearly with micro-crack density, the proportion of surface cracks, the size of micro-crack zone, and the excitation frequency. This study theoretically reveals that nonlinear Rayleigh surface waves are feasible for use in quantitatively identifying the physical characteristics of surface micro-cracks in structures.

Generation Mechanism of Nonlinear Rayleigh Surface Waves for Randomly Distributed Surface Micro-Cracks

PubMed Central

Ding, Xiangyan; Li, Feilong; Xu, Yongmei; Cao, Peng; Deng, Mingxi

2018-01-01

This paper investigates the propagation of Rayleigh surface waves in structures with randomly distributed surface micro-cracks using numerical simulations. The results revealed a significant ultrasonic nonlinear effect caused by the surface micro-cracks, which is mainly represented by a second harmonic with even more distinct third/quadruple harmonics. Based on statistical analysis from the numerous results of random micro-crack models, it is clearly found that the acoustic nonlinear parameter increases linearly with micro-crack density, the proportion of surface cracks, the size of micro-crack zone, and the excitation frequency. This study theoretically reveals that nonlinear Rayleigh surface waves are feasible for use in quantitatively identifying the physical characteristics of surface micro-cracks in structures. PMID:29690580

Digital Multimodal Texts and Their Role in Project Work: Opportunities and Dilemmas

ERIC Educational Resources Information Center

Wikan, Gerd; Molster, Terje; Faugli, Bjorn; Hope, Rafael

2010-01-01

This paper explores how and to what extent digital multimodal text production can play a role in project work. The focus is upon describing and understanding how teachers and learners view multimodal text production as part of a learning process. Group-based project work has been used extensively in Norwegian schools since the 1970s. One criticism…

3D multimodal MRI brain glioma tumor and edema segmentation: a graph cut distribution matching approach.

PubMed

Njeh, Ines; Sallemi, Lamia; Ayed, Ismail Ben; Chtourou, Khalil; Lehericy, Stephane; Galanaud, Damien; Hamida, Ahmed Ben

2015-03-01

This study investigates a fast distribution-matching, data-driven algorithm for 3D multimodal MRI brain glioma tumor and edema segmentation in different modalities. We learn non-parametric model distributions which characterize the normal regions in the current data. Then, we state our segmentation problems as the optimization of several cost functions of the same form, each containing two terms: (i) a distribution matching prior, which evaluates a global similarity between distributions, and (ii) a smoothness prior to avoid the occurrence of small, isolated regions in the solution. Obtained following recent bound-relaxation results, the optima of the cost functions yield the complement of the tumor region or edema region in nearly real-time. Based on global rather than pixel wise information, the proposed algorithm does not require an external learning from a large, manually-segmented training set, as is the case of the existing methods. Therefore, the ensuing results are independent of the choice of a training set. Quantitative evaluations over the publicly available training and testing data set from the MICCAI multimodal brain tumor segmentation challenge (BraTS 2012) demonstrated that our algorithm yields a highly competitive performance for complete edema and tumor segmentation, among nine existing competing methods, with an interesting computing execution time (less than 0.5s per image). Copyright © 2014 Elsevier Ltd. All rights reserved.

Nanoengineered multimodal contrast agent for medical image guidance

NASA Astrophysics Data System (ADS)

Perkins, Gregory J.; Zheng, Jinzi; Brock, Kristy; Allen, Christine; Jaffray, David A.

2005-04-01

Multimodality imaging has gained momentum in radiation therapy planning and image-guided treatment delivery. Specifically, computed tomography (CT) and magnetic resonance (MR) imaging are two complementary imaging modalities often utilized in radiation therapy for visualization of anatomical structures for tumour delineation and accurate registration of image data sets for volumetric dose calculation. The development of a multimodal contrast agent for CT and MR with prolonged in vivo residence time would provide long-lasting spatial and temporal correspondence of the anatomical features of interest, and therefore facilitate multimodal image registration, treatment planning and delivery. The multimodal contrast agent investigated consists of nano-sized stealth liposomes encapsulating conventional iodine and gadolinium-based contrast agents. The average loading achieved was 33.5 +/- 7.1 mg/mL of iodine for iohexol and 9.8 +/- 2.0 mg/mL of gadolinium for gadoteridol. The average liposome diameter was 46.2 +/- 13.5 nm. The system was found to be stable in physiological buffer over a 15-day period, releasing 11.9 +/- 1.1% and 11.2 +/- 0.9% of the total amounts of iohexol and gadoteridol loaded, respectively. 200 minutes following in vivo administration, the contrast agent maintained a relative contrast enhancement of 81.4 +/- 13.05 differential Hounsfield units (ΔHU) in CT (40% decrease from the peak signal value achieved 3 minutes post-injection) and 731.9 +/- 144.2 differential signal intensity (ΔSI) in MR (46% decrease from the peak signal value achieved 3 minutes post-injection) in the blood (aorta), a relative contrast enhancement of 38.0 +/- 5.1 ΔHU (42% decrease from the peak signal value achieved 3 minutes post-injection) and 178.6 +/- 41.4 ΔSI (62% decrease from the peak signal value achieved 3 minutes post-injection) in the liver (parenchyma), a relative contrast enhancement of 9.1 +/- 1.7 ΔHU (94% decrease from the peak signal value achieved 3 minutes

New developments in multimodal clinical multiphoton tomography

NASA Astrophysics Data System (ADS)

König, Karsten

2011-03-01

80 years ago, the PhD student Maria Goeppert predicted in her thesis in Goettingen, Germany, two-photon effects. It took 30 years to prove her theory, and another three decades to realize the first two-photon microscope. With the beginning of this millennium, first clinical multiphoton tomographs started operation in research institutions, hospitals, and in the cosmetic industry. The multiphoton tomograph MPTflexTM with its miniaturized flexible scan head became the Prism-Award 2010 winner in the category Life Sciences. Multiphoton tomographs with its superior submicron spatial resolution can be upgraded to 5D imaging tools by adding spectral time-correlated single photon counting units. Furthermore, multimodal hybrid tomographs provide chemical fingerprinting and fast wide-field imaging. The world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph in spring 2010. In particular, nonfluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen have been imaged in patients with dermatological disorders. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution imaging tools such as ultrasound, optoacoustic, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer (malignant melanoma), optimization of treatment strategies (wound healing, dermatitis), and cosmetic research including long-term biosafety tests of ZnO sunscreen nanoparticles and the measurement of the stimulated biosynthesis of collagen by anti-ageing products.

A Multimodal Approach to Elimination of Stuttering.

ERIC Educational Resources Information Center

Beaty, David T.

1980-01-01

The case of a 15-year-old stutterer is presented to illustrate A. Lazarus's multimodal behavior therapy model, proposed to integrate various procedures. A combination of role playing, metronome use, biofeedback training, and assertion training was used. (CL)

Nonlinear dynamics of motor learning.

PubMed

Mayer-Kress, Gottfried; Newell, Karl M; Liu, Yeou-Teh

2009-01-01

In this paper we review recent work from our studies of a nonlinear dynamics of motor learning that is grounded in the construct of an evolving attractor landscape. With the assumption that learning is goal-directed, we can quantify the observed performance as a score or measure of the distance to the learning goal. The structure of the dynamics of how the goal is approached has been traditionally studied through an analysis of learning curves. Recent years have seen a gradual paradigm shift from a 'universal power law of practice' to an analysis of performance dynamics that reveals multiple processes that include adaption and learning as well as changes in performance due to factors such as fatigue. Evidence has also been found for nonlinear phenomena such as bifurcations, hysteresis and even a form of self-organized criticality. Finally, we present a quantitative measure for the dual concepts of skill and difficulty that allows us to unfold a learning process in order to study universal properties of learning transitions.

Multimode optomechanical system in the quantum regime

NASA Astrophysics Data System (ADS)

Hvidtfelt Padkær Nielsen, William; Tsaturyan, Yeghishe; Møller, Christoffer Bo; Polzik, Eugene S.; Schliesser, Albert

2017-01-01

We realize a simple and robust optomechanical system with a multitude of long-lived (Q > 107) mechanical modes in a phononic-bandgap shielded membrane resonator. An optical mode of a compact Fabry-Perot resonator detects these modes’ motion with a measurement rate (96 kHz) that exceeds the mechanical decoherence rates already at moderate cryogenic temperatures (10 K). Reaching this quantum regime entails, inter alia, quantum measurement backaction exceeding thermal forces and thus strong optomechanical quantum correlations. In particular, we observe ponderomotive squeezing of the output light mediated by a multitude of mechanical resonator modes, with quantum noise suppression up to -2.4 dB (-3.6 dB if corrected for detection losses) and bandwidths ≲90 kHz. The multimode nature of the membrane and Fabry-Perot resonators will allow multimode entanglement involving electromagnetic, mechanical, and spin degrees of freedom.

Comparative imaging study in ultrasound, MRI, CT, and DSA using a multimodality renal artery phantom

DOE Office of Scientific and Technical Information (OSTI.GOV)

King, Deirdre M.; Fagan, Andrew J.; Moran, Carmel M.

2011-02-15

Purpose: A range of anatomically realistic multimodality renal artery phantoms consisting of vessels with varying degrees of stenosis was developed and evaluated using four imaging techniques currently used to detect renal artery stenosis (RAS). The spatial resolution required to visualize vascular geometry and the velocity detection performance required to adequately characterize blood flow in patients suffering from RAS are currently ill-defined, with the result that no one imaging modality has emerged as a gold standard technique for screening for this disease. Methods: The phantoms, which contained a range of stenosis values (0%, 30%, 50%, 70%, and 85%), were designed formore » use with ultrasound, magnetic resonance imaging, x-ray computed tomography, and x-ray digital subtraction angiography. The construction materials used were optimized with respect to their ultrasonic speed of sound and attenuation coefficient, MR relaxometry (T{sub 1},T{sub 2}) properties, and Hounsfield number/x-ray attenuation coefficient, with a design capable of tolerating high-pressure pulsatile flow. Fiducial targets, incorporated into the phantoms to allow for registration of images among modalities, were chosen to minimize geometric distortions. Results: High quality distortion-free images of the phantoms with good contrast between vessel lumen, fiducial markers, and background tissue to visualize all stenoses were obtained with each modality. Quantitative assessments of the grade of stenosis revealed significant discrepancies between modalities, with each underestimating the stenosis severity for the higher-stenosed phantoms (70% and 85%) by up to 14%, with the greatest discrepancy attributable to DSA. Conclusions: The design and construction of a range of anatomically realistic renal artery phantoms containing varying degrees of stenosis is described. Images obtained using the main four diagnostic techniques used to detect RAS were free from artifacts and exhibited adequate

Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

PubMed

Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

2017-12-01

How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

Multimode cavity-assisted quantum storage via continuous phase-matching control

NASA Astrophysics Data System (ADS)

Kalachev, Alexey; Kocharovskaya, Olga

2013-09-01

A scheme for spatial multimode quantum memory is developed such that spatial-temporal structure of a weak signal pulse can be stored and recalled via cavity-assisted off-resonant Raman interaction with a strong angular-modulated control field in an extended Λ-type atomic ensemble. It is shown that effective multimode storage is possible when the Raman coherence spatial grating involves wave vectors with different longitudinal components relative to the paraxial signal field. The possibilities of implementing the scheme in the solid-state materials are discussed.

Ridge-branch-based blood vessel detection algorithm for multimodal retinal images

NASA Astrophysics Data System (ADS)

Li, Y.; Hutchings, N.; Knighton, R. W.; Gregori, G.; Lujan, B. J.; Flanagan, J. G.

2009-02-01

Automatic detection of retinal blood vessels is important to medical diagnoses and imaging. With the development of imaging technologies, various modals of retinal images are available. Few of currently published algorithms are applied to multimodal retinal images. Besides, the performance of algorithms with pathologies is expected to be improved. The purpose of this paper is to propose an automatic Ridge-Branch-Based (RBB) detection algorithm of blood vessel centerlines and blood vessels for multimodal retinal images (color fundus photographs, fluorescein angiograms, fundus autofluorescence images, SLO fundus images and OCT fundus images, for example). Ridges, which can be considered as centerlines of vessel-like patterns, are first extracted. The method uses the connective branching information of image ridges: if ridge pixels are connected, they are more likely to be in the same class, vessel ridge pixels or non-vessel ridge pixels. Thanks to the good distinguishing ability of the designed "Segment-Based Ridge Features", the classifier and its parameters can be easily adapted to multimodal retinal images without ground truth training. We present thorough experimental results on SLO images, color fundus photograph database and other multimodal retinal images, as well as comparison between other published algorithms. Results showed that the RBB algorithm achieved a good performance.

A new approach of building 3D visualization framework for multimodal medical images display and computed assisted diagnosis

NASA Astrophysics Data System (ADS)

Li, Zhenwei; Sun, Jianyong; Zhang, Jianguo

2012-02-01

As more and more CT/MR studies are scanning with larger volume of data sets, more and more radiologists and clinician would like using PACS WS to display and manipulate these larger data sets of images with 3D rendering features. In this paper, we proposed a design method and implantation strategy to develop 3D image display component not only with normal 3D display functions but also with multi-modal medical image fusion as well as compute-assisted diagnosis of coronary heart diseases. The 3D component has been integrated into the PACS display workstation of Shanghai Huadong Hospital, and the clinical practice showed that it is easy for radiologists and physicians to use these 3D functions such as multi-modalities' (e.g. CT, MRI, PET, SPECT) visualization, registration and fusion, and the lesion quantitative measurements. The users were satisfying with the rendering speeds and quality of 3D reconstruction. The advantages of the component include low requirements for computer hardware, easy integration, reliable performance and comfortable application experience. With this system, the radiologists and the clinicians can manipulate with 3D images easily, and use the advanced visualization tools to facilitate their work with a PACS display workstation at any time.

Multimode Surface Plasmon Excitations on Organic Thin Film/Metallic Diffraction Grating

NASA Astrophysics Data System (ADS)

Baba, Akira; Kanda, Kenji; Ohno, Tsutomu; Ohdaira, Yasuo; Shinbo, Kazunari; Kato, Keizo; Kaneko, Futao

2010-01-01

In this work, we demonstrate multimode surface plasmon (SP) excitations by white light irradiation on metallic diffraction grating/plastic substrates. Recordable compact discs were used as the diffraction grating substrates on which silver films were deposited by vacuum evaporation. Since the grating pitch (1.6 µm) was larger than that of diffraction gratings commonly used for the excitation of SPs, multimode SP excitations due to several diffraction orders were observed simultaneously in the wavelength region from 400 to 800 nm. The obtained SP excitations were then compared with the calculated SP dispersion on the grating. The multimode SP excitations were further studied on spin-coated poly[2-methoxy-5-(2'-ethyl-hexyloxy)-1,4-phenylene vinylene] (MEH-PPV) thin film/silver grating substrates. An increased photoluminescence intensity due to SP excitations was observed on MEH-PPV/silver grating surfaces.

Contemporary Multi-Modal Historical Representations and the Teaching of Disciplinary Understandings in History

ERIC Educational Resources Information Center

Donnelly, Debra J.

2018-01-01

Traditional privileging of the printed text has been considerably eroded by rapid technological advancement and in Australia, as elsewhere, many History teaching programs feature an array of multi-modal historical representations. Research suggests that engagement with the visual and multi-modal constructs has the potential to enrich the pedagogy…

Exploring the Multimodality of EFL Textbooks for Chinese College Students: A Comparative Study

ERIC Educational Resources Information Center

Liu, Xiqin; Qu, Dianning

2014-01-01

To explore the multimodality of two representative EFL textbook series for Chinese college students, their visual and verbal semiotic modes were compared. The target textbooks are "Experiencing English" and "New Century College English". Through multimodal discourse analysis, the study aims to shed some light on how to develop…

Teaching Poetry through Collaborative Art: An Analysis of Multimodal Ensembles for Transformative Learning

ERIC Educational Resources Information Center

Wandera, David B.

2016-01-01

This study is anchored on two positions: that every communication is multimodal and that different modalities within multimodal communication have particular affordances. Written and oral language and other modalities, such as body language and audio/visual media, are interwoven in classroom communication. What might it look like to strategically…

Multimodal retrieval of autobiographical memories: sensory information contributes differently to the recollection of events.

PubMed

Willander, Johan; Sikström, Sverker; Karlsson, Kristina

2015-01-01

Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality). However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities) are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, or multimodal. The results showed that the peak of the distributions depends on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems

PubMed Central

Rodriguez-Fernandez, Maria; Egea, Jose A; Banga, Julio R

2006-01-01

Background We consider the problem of parameter estimation (model calibration) in nonlinear dynamic models of biological systems. Due to the frequent ill-conditioning and multi-modality of many of these problems, traditional local methods usually fail (unless initialized with very good guesses of the parameter vector). In order to surmount these difficulties, global optimization (GO) methods have been suggested as robust alternatives. Currently, deterministic GO methods can not solve problems of realistic size within this class in reasonable computation times. In contrast, certain types of stochastic GO methods have shown promising results, although the computational cost remains large. Rodriguez-Fernandez and coworkers have presented hybrid stochastic-deterministic GO methods which could reduce computation time by one order of magnitude while guaranteeing robustness. Our goal here was to further reduce the computational effort without loosing robustness. Results We have developed a new procedure based on the scatter search methodology for nonlinear optimization of dynamic models of arbitrary (or even unknown) structure (i.e. black-box models). In this contribution, we describe and apply this novel metaheuristic, inspired by recent developments in the field of operations research, to a set of complex identification problems and we make a critical comparison with respect to the previous (above mentioned) successful methods. Conclusion Robust and efficient methods for parameter estimation are of key importance in systems biology and related areas. The new metaheuristic presented in this paper aims to ensure the proper solution of these problems by adopting a global optimization approach, while keeping the computational effort under reasonable values. This new metaheuristic was applied to a set of three challenging parameter estimation problems of nonlinear dynamic biological systems, outperforming very significantly all the methods previously used for these benchmark

Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems.

PubMed

Rodriguez-Fernandez, Maria; Egea, Jose A; Banga, Julio R

2006-11-02

We consider the problem of parameter estimation (model calibration) in nonlinear dynamic models of biological systems. Due to the frequent ill-conditioning and multi-modality of many of these problems, traditional local methods usually fail (unless initialized with very good guesses of the parameter vector). In order to surmount these difficulties, global optimization (GO) methods have been suggested as robust alternatives. Currently, deterministic GO methods can not solve problems of realistic size within this class in reasonable computation times. In contrast, certain types of stochastic GO methods have shown promising results, although the computational cost remains large. Rodriguez-Fernandez and coworkers have presented hybrid stochastic-deterministic GO methods which could reduce computation time by one order of magnitude while guaranteeing robustness. Our goal here was to further reduce the computational effort without loosing robustness. We have developed a new procedure based on the scatter search methodology for nonlinear optimization of dynamic models of arbitrary (or even unknown) structure (i.e. black-box models). In this contribution, we describe and apply this novel metaheuristic, inspired by recent developments in the field of operations research, to a set of complex identification problems and we make a critical comparison with respect to the previous (above mentioned) successful methods. Robust and efficient methods for parameter estimation are of key importance in systems biology and related areas. The new metaheuristic presented in this paper aims to ensure the proper solution of these problems by adopting a global optimization approach, while keeping the computational effort under reasonable values. This new metaheuristic was applied to a set of three challenging parameter estimation problems of nonlinear dynamic biological systems, outperforming very significantly all the methods previously used for these benchmark problems.

Optimisation of micro-perforated cylindrical silencers in linear and nonlinear regimes

NASA Astrophysics Data System (ADS)

Bravo, Teresa; Maury, Cédric; Pinhède, Cédric

2016-02-01

This paper describes analytical and experimental studies conducted to understand the potential of lightweight non-fibrous alternatives to dissipative mufflers for in-duct noise control problems, especially under high sound pressure levels (SPLs) and in the low frequency domain. The cost-efficient multi-modal propagation method has been extended to predict nonlinear effects in the dissipation and the transmission loss (TL) of micro-perforated cylindrical liners with sub-millimetric holes diameter. A validation experiment was performed in a standing wave tube to measure the power dissipated and transmitted by a nonlocally reacting liner under moderate and high SPLs. Although nonlinear effects significantly reduce the dissipation and TL around the liner maximum damping frequency, these power quantities may be enhanced below the half-bandwidth resonance. An optimal value of the in-hole peak particle velocity has been found that maximizes the TL of locally reacting liners at low frequencies. Optimisation studies based on dissipation or TL maximization showed the sensitivity of the liner constituting parameters to variations in the design target range such as the center frequency, the levels of acoustic excitation and the nature of the surface impedance (locally or nonlocally reacting). An analysis is proposed of the deviation observed at low frequencies between the optimum impedance of the locally reacting liner under moderate SPLs and Cremer's optimum impedances.

Adiabatically tapered splice for selective excitation of the fundamental mode in a multimode fiber.

PubMed

Jung, Yongmin; Jeong, Yoonchan; Brambilla, Gilberto; Richardson, David J

2009-08-01

We propose a simple and effective method to selectively excite the fundamental mode of a multimode fiber by adiabatically tapering a fusion splice to a single-mode fiber. We experimentally demonstrate the method by adiabatically tapering splice (taper waist=15 microm, uniform length=40 mm) between single-mode and multimode fiber and show that it provides a successful mode conversion/connection and allows for almost perfect fundamental mode excitation in the multimode fiber. Excellent beam quality (M(2) approximately 1.08) was achieved with low loss and high environmental stability.

Multimodal Discriminative Binary Embedding for Large-Scale Cross-Modal Retrieval.

PubMed

Wang, Di; Gao, Xinbo; Wang, Xiumei; He, Lihuo; Yuan, Bo

2016-10-01

Multimodal hashing, which conducts effective and efficient nearest neighbor search across heterogeneous data on large-scale multimedia databases, has been attracting increasing interest, given the explosive growth of multimedia content on the Internet. Recent multimodal hashing research mainly aims at learning the compact binary codes to preserve semantic information given by labels. The overwhelming majority of these methods are similarity preserving approaches which approximate pairwise similarity matrix with Hamming distances between the to-be-learnt binary hash codes. However, these methods ignore the discriminative property in hash learning process, which results in hash codes from different classes undistinguished, and therefore reduces the accuracy and robustness for the nearest neighbor search. To this end, we present a novel multimodal hashing method, named multimodal discriminative binary embedding (MDBE), which focuses on learning discriminative hash codes. First, the proposed method formulates the hash function learning in terms of classification, where the binary codes generated by the learned hash functions are expected to be discriminative. And then, it exploits the label information to discover the shared structures inside heterogeneous data. Finally, the learned structures are preserved for hash codes to produce similar binary codes in the same class. Hence, the proposed MDBE can preserve both discriminability and similarity for hash codes, and will enhance retrieval accuracy. Thorough experiments on benchmark data sets demonstrate that the proposed method achieves excellent accuracy and competitive computational efficiency compared with the state-of-the-art methods for large-scale cross-modal retrieval task.

Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

NASA Astrophysics Data System (ADS)

Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

2016-03-01

Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

Multipulse technique exploiting the intermodulation of ultrasound waves in a nonlinear medium.

PubMed

Biagi, Elena; Breschi, Luca; Vannacci, Enrico; Masotti, Leonardo

2009-03-01

In recent years, the nonlinear properties of materials have attracted much interest in nondestructive testing and in ultrasound diagnostic applications. Acoustic nonlinear parameters represent an opportunity to improve the information that can be extracted from a medium such as structural organization and pathologic status of tissue. In this paper, a method called pulse subtraction intermodulation (PSI), based on a multipulse technique, is presented and investigated both theoretically and experimentally. This method allows separation of the intermodulation products, which arise when 2 separate frequencies are transmitted in a nonlinear medium, from fundamental and second harmonic components, making them available for improved imaging techniques or signal processing algorithms devoted to tissue characterization. The theory of intermodulation product generation was developed according the Khokhlov-Zabolotskaya-Kuznetsov (KZK) nonlinear propagation equation, which is consistent with experimental results. The description of the proposed method, characterization of the intermodulation spectral contents, and quantitative results coming from in vitro experimentation are reported and discussed in this paper.

Non-linear osmosis

PubMed Central

Diamond, Jared M.

1966-01-01

1. The relation between osmotic gradient and rate of osmotic water flow has been measured in rabbit gall-bladder by a gravimetric procedure and by a rapid method based on streaming potentials. Streaming potentials were directly proportional to gravimetrically measured water fluxes. 2. As in many other tissues, water flow was found to vary with gradient in a markedly non-linear fashion. There was no consistent relation between the water permeability and either the direction or the rate of water flow. 3. Water flow in response to a given gradient decreased at higher osmolarities. The resistance to water flow increased linearly with osmolarity over the range 186-825 m-osM. 4. The resistance to water flow was the same when the gall-bladder separated any two bathing solutions with the same average osmolarity, regardless of the magnitude of the gradient. In other words, the rate of water flow is given by the expression (Om — Os)/[Ro′ + ½k′ (Om + Os)], where Ro′ and k′ are constants and Om and Os are the bathing solution osmolarities. 5. Of the theories advanced to explain non-linear osmosis in other tissues, flow-induced membrane deformations, unstirred layers, asymmetrical series-membrane effects, and non-osmotic effects of solutes could not explain the results. However, experimental measurements of water permeability as a function of osmolarity permitted quantitative reconstruction of the observed water flow—osmotic gradient curves. Hence non-linear osmosis in rabbit gall-bladder is due to a decrease in water permeability with increasing osmolarity. 6. The results suggest that aqueous channels in the cell membrane behave as osmometers, shrinking in concentrated solutions of impermeant molecules and thereby increasing membrane resistance to water flow. A mathematical formulation of such a membrane structure is offered. PMID:5945254

Use of anomolous thermal imaging effects for multi-mode systems control during crystal growth

NASA Technical Reports Server (NTRS)

Wargo, Michael J.

1989-01-01

Real time image processing techniques, combined with multitasking computational capabilities are used to establish thermal imaging as a multimode sensor for systems control during crystal growth. Whereas certain regions of the high temperature scene are presently unusable for quantitative determination of temperature, the anomalous information thus obtained is found to serve as a potentially low noise source of other important systems control output. Using this approach, the light emission/reflection characteristics of the crystal, meniscus and melt system are used to infer the crystal diameter and a linear regression algorithm is employed to determine the local diameter trend. This data is utilized as input for closed loop control of crystal shape. No performance penalty in thermal imaging speed is paid for this added functionality. Approach to secondary (diameter) sensor design and systems control structure is discussed. Preliminary experimental results are presented.

Pulmonary nodule characterization, including computer analysis and quantitative features.

PubMed

Bartholmai, Brian J; Koo, Chi Wan; Johnson, Geoffrey B; White, Darin B; Raghunath, Sushravya M; Rajagopalan, Srinivasan; Moynagh, Michael R; Lindell, Rebecca M; Hartman, Thomas E

2015-03-01

Pulmonary nodules are commonly detected in computed tomography (CT) chest screening of a high-risk population. The specific visual or quantitative features on CT or other modalities can be used to characterize the likelihood that a nodule is benign or malignant. Visual features on CT such as size, attenuation, location, morphology, edge characteristics, and other distinctive "signs" can be highly suggestive of a specific diagnosis and, in general, be used to determine the probability that a specific nodule is benign or malignant. Change in size, attenuation, and morphology on serial follow-up CT, or features on other modalities such as nuclear medicine studies or MRI, can also contribute to the characterization of lung nodules. Imaging analytics can objectively and reproducibly quantify nodule features on CT, nuclear medicine, and magnetic resonance imaging. Some quantitative techniques show great promise in helping to differentiate benign from malignant lesions or to stratify the risk of aggressive versus indolent neoplasm. In this article, we (1) summarize the visual characteristics, descriptors, and signs that may be helpful in management of nodules identified on screening CT, (2) discuss current quantitative and multimodality techniques that aid in the differentiation of nodules, and (3) highlight the power, pitfalls, and limitations of these various techniques.

Multimodal system for the planning and guidance of bronchoscopy

NASA Astrophysics Data System (ADS)

Higgins, William E.; Cheirsilp, Ronnarit; Zang, Xiaonan; Byrnes, Patrick

2015-03-01

Many technical innovations in multimodal radiologic imaging and bronchoscopy have emerged recently in the effort against lung cancer. Modern X-ray computed-tomography (CT) scanners provide three-dimensional (3D) high-resolution chest images, positron emission tomography (PET) scanners give complementary molecular imaging data, and new integrated PET/CT scanners combine the strengths of both modalities. State-of-the-art bronchoscopes permit minimally invasive tissue sampling, with vivid endobronchial video enabling navigation deep into the airway-tree periphery, while complementary endobronchial ultrasound (EBUS) reveals local views of anatomical structures outside the airways. In addition, image-guided intervention (IGI) systems have proven their utility for CT-based planning and guidance of bronchoscopy. Unfortunately, no IGI system exists that integrates all sources effectively through the complete lung-cancer staging work flow. This paper presents a prototype of a computer-based multimodal IGI system that strives to fill this need. The system combines a wide range of automatic and semi-automatic image-processing tools for multimodal data fusion and procedure planning. It also provides a flexible graphical user interface for follow-on guidance of bronchoscopy/EBUS. Human-study results demonstrate the system's potential.

Nonlinear identification of the total baroreflex arc.

PubMed

Moslehpour, Mohsen; Kawada, Toru; Sunagawa, Kenji; Sugimachi, Masaru; Mukkamala, Ramakrishna

2015-12-15

The total baroreflex arc [the open-loop system relating carotid sinus pressure (CSP) to arterial pressure (AP)] is known to exhibit nonlinear behaviors. However, few studies have quantitatively characterized its nonlinear dynamics. The aim of this study was to develop a nonlinear model of the sympathetically mediated total arc without assuming any model form. Normal rats were studied under anesthesia. The vagal and aortic depressor nerves were sectioned, the carotid sinus regions were isolated and attached to a servo-controlled piston pump, and the AP and sympathetic nerve activity (SNA) were measured. CSP was perturbed using a Gaussian white noise signal. A second-order Volterra model was developed by applying nonparametric identification to the measurements. The second-order kernel was mainly diagonal, but the diagonal differed in shape from the first-order kernel. Hence, a reduced second-order model was similarly developed comprising a linear dynamic system in parallel with a squaring system in cascade with a slower linear dynamic system. This "Uryson" model predicted AP changes 12% better (P < 0.01) than a linear model in response to new Gaussian white noise CSP. The model also predicted nonlinear behaviors, including thresholding and mean responses to CSP changes about the mean. Models of the neural arc (the system relating CSP to SNA) and peripheral arc (the system relating SNA to AP) were likewise developed and tested. However, these models of subsystems of the total arc showed approximately linear behaviors. In conclusion, the validated nonlinear model of the total arc revealed that the system takes on an Uryson structure. Copyright © 2015 the American Physiological Society.

Single and low order mode interrogation of a multimode sapphire fiber Bragg grating sensor with tapered fibers

NASA Astrophysics Data System (ADS)

Grobnic, Dan; Mihailov, Stephen J.; Ding, H.; Bilodeau, F.; Smelser, Christopher W.

2005-05-01

Multimode sapphire fiber Bragg gratings (SFBG) made with an IR femtosecond laser and a phase mask were probed using tapered single mode fibers of different taper diameters producing single and low order mode reflection/transmission responses. A configuration made of an input single mode tapered fiber and multimode silica fiber used for output coupling was also tested and has delivered a filtered multimode transmission spectrum. The tapered coupling improved the spectral resolution of the SFBG as compared to its multimode responses previously reported. Such improvements facilitate the utilization of the SFBG as a high temperature sensor. Wavelength shifts of the single mode response were monitored as a function of temperature up to 1500 °C and were consistent with the measurement obtained from the multimode response published previously.

Exact steady state of a Kerr resonator with one- and two-photon driving and dissipation: Controllable Wigner-function multimodality and dissipative phase transitions

NASA Astrophysics Data System (ADS)

Bartolo, Nicola; Minganti, Fabrizio; Casteels, Wim; Ciuti, Cristiano

2016-09-01

We present exact results for the steady-state density matrix of a general class of driven-dissipative systems consisting of a nonlinear Kerr resonator in the presence of both coherent (one-photon) and parametric (two-photon) driving and dissipation. Thanks to the analytical solution, obtained via the complex P -representation formalism, we are able to explore any regime, including photon blockade, multiphoton resonant effects, and a mesoscopic regime with large photon density and quantum correlations. We show how the interplay between one- and two-photon driving provides a way to control the multimodality of the Wigner function in regimes where the semiclassical theory exhibits multistability. We also study the emergence of dissipative phase transitions in the thermodynamic limit of large photon numbers.

OpenLMD, multimodal monitoring and control of LMD processing

NASA Astrophysics Data System (ADS)

Rodríguez-Araújo, Jorge; García-Díaz, Antón

2017-02-01

This paper presents OpenLMD, a novel open-source solution for on-line multimodal monitoring of Laser Metal Deposition (LMD). The solution is also applicable to a wider range of laser-based applications that require on-line control (e.g. laser welding). OpenLMD is a middleware that enables the orchestration and virtualization of a LMD robot cell, using several open-source frameworks (e.g. ROS, OpenCV, PCL). The solution also allows reconfiguration by easy integration of multiple sensors and processing equipment. As a result, OpenLMD delivers significant advantages over existing monitoring and control approaches, such as improved scalability, and multimodal monitoring and data sharing capabilities.

Multimodal far-field acoustic radiation pattern: An approximate equation

NASA Technical Reports Server (NTRS)

Rice, E. J.

1977-01-01

The far-field sound radiation theory for a circular duct was studied for both single mode and multimodal inputs. The investigation was intended to develop a method to determine the acoustic power produced by turbofans as a function of mode cut-off ratio. With reasonable simplifying assumptions the single mode radiation pattern was shown to be reducible to a function of mode cut-off ratio only. With modal cut-off ratio as the dominant variable, multimodal radiation patterns can be reduced to a simple explicit expression. This approximate expression provides excellent agreement with an exact calculation of the sound radiation pattern using equal acoustic power per mode.

Optimal reconfiguration strategy for a degradable multimodule computing system

NASA Technical Reports Server (NTRS)

Lee, Yann-Hang; Shin, Kang G.

1987-01-01

The present quantitative approach to the problem of reconfiguring a degradable multimode system assigns some modules to computation and arranges others for reliability. By using expected total reward as the optimal criterion, there emerges an active reconfiguration strategy based not only on the occurrence of failure but the progression of the given mission. This reconfiguration strategy requires specification of the times at which the system should undergo reconfiguration, and the configurations to which the system should change. The optimal reconfiguration problem is converted to integer nonlinear knapsack and fractional programming problems.

A study of vocal nonlinearities in humpback whale songs: from production mechanisms to acoustic analysis.

PubMed

Cazau, Dorian; Adam, Olivier; Aubin, Thierry; Laitman, Jeffrey T; Reidenberg, Joy S

2016-10-10

Although mammalian vocalizations are predominantly harmonically structured, they can exhibit an acoustic complexity with nonlinear vocal sounds, including deterministic chaos and frequency jumps. Such sounds are normative events in mammalian vocalizations, and can be directly traceable to the nonlinear nature of vocal-fold dynamics underlying typical mammalian sound production. In this study, we give qualitative descriptions and quantitative analyses of nonlinearities in the song repertoire of humpback whales from the Ste Marie channel (Madagascar) to provide more insight into the potential communication functions and underlying production mechanisms of these features. A low-dimensional biomechanical modeling of the whale's U-fold (vocal folds homolog) is used to relate specific vocal mechanisms to nonlinear vocal features. Recordings of living humpback whales were searched for occurrences of vocal nonlinearities (instabilities). Temporal distributions of nonlinearities were assessed within sound units, and between different songs. The anatomical production sources of vocal nonlinearities and the communication context of their occurrences in recordings are discussed. Our results show that vocal nonlinearities may be a communication strategy that conveys information about the whale's body size and physical fitness, and thus may be an important component of humpback whale songs.

A study of vocal nonlinearities in humpback whale songs: from production mechanisms to acoustic analysis

NASA Astrophysics Data System (ADS)

Cazau, Dorian; Adam, Olivier; Aubin, Thierry; Laitman, Jeffrey T.; Reidenberg, Joy S.

2016-10-01

Although mammalian vocalizations are predominantly harmonically structured, they can exhibit an acoustic complexity with nonlinear vocal sounds, including deterministic chaos and frequency jumps. Such sounds are normative events in mammalian vocalizations, and can be directly traceable to the nonlinear nature of vocal-fold dynamics underlying typical mammalian sound production. In this study, we give qualitative descriptions and quantitative analyses of nonlinearities in the song repertoire of humpback whales from the Ste Marie channel (Madagascar) to provide more insight into the potential communication functions and underlying production mechanisms of these features. A low-dimensional biomechanical modeling of the whale’s U-fold (vocal folds homolog) is used to relate specific vocal mechanisms to nonlinear vocal features. Recordings of living humpback whales were searched for occurrences of vocal nonlinearities (instabilities). Temporal distributions of nonlinearities were assessed within sound units, and between different songs. The anatomical production sources of vocal nonlinearities and the communication context of their occurrences in recordings are discussed. Our results show that vocal nonlinearities may be a communication strategy that conveys information about the whale’s body size and physical fitness, and thus may be an important component of humpback whale songs.

3D hierarchical spatial representation and memory of multimodal sensory data

NASA Astrophysics Data System (ADS)

Khosla, Deepak; Dow, Paul A.; Huber, David J.

2009-04-01

This paper describes an efficient method and system for representing, processing and understanding multi-modal sensory data. More specifically, it describes a computational method and system for how to process and remember multiple locations in multimodal sensory space (e.g., visual, auditory, somatosensory, etc.). The multimodal representation and memory is based on a biologically-inspired hierarchy of spatial representations implemented with novel analogues of real representations used in the human brain. The novelty of the work is in the computationally efficient and robust spatial representation of 3D locations in multimodal sensory space as well as an associated working memory for storage and recall of these representations at the desired level for goal-oriented action. We describe (1) A simple and efficient method for human-like hierarchical spatial representations of sensory data and how to associate, integrate and convert between these representations (head-centered coordinate system, body-centered coordinate, etc.); (2) a robust method for training and learning a mapping of points in multimodal sensory space (e.g., camera-visible object positions, location of auditory sources, etc.) to the above hierarchical spatial representations; and (3) a specification and implementation of a hierarchical spatial working memory based on the above for storage and recall at the desired level for goal-oriented action(s). This work is most useful for any machine or human-machine application that requires processing of multimodal sensory inputs, making sense of it from a spatial perspective (e.g., where is the sensory information coming from with respect to the machine and its parts) and then taking some goal-oriented action based on this spatial understanding. A multi-level spatial representation hierarchy means that heterogeneous sensory inputs (e.g., visual, auditory, somatosensory, etc.) can map onto the hierarchy at different levels. When controlling various machine

A hybrid method for determination of the acoustic impedance of an unflanged cylindrical duct for multimode wave

NASA Astrophysics Data System (ADS)

Snakowska, Anna; Jurkiewicz, Jerzy; Gorazd, Łukasz

2017-05-01

The paper presents derivation of the impedance matrix based on the rigorous solution of the wave equation obtained by the Wiener-Hopf technique for a semi-infinite unflanged cylindrical duct. The impedance matrix allows, in turn, calculate the acoustic impedance along the duct and, as a special case, the radiation impedance. The analysis is carried out for a multimode incident wave accounting for modes coupling on the duct outlet not only qualitatively but also quantitatively for a selected source operating inside. The quantitative evaluation of the acoustic impedance requires setting of modes amplitudes which has been obtained applying the mode decomposition method to the far-field pressure radiation measurements and theoretical formulae for single mode directivity characteristics for an unflanged duct. Calculation of the acoustic impedance for a non-uniform distribution of the sound pressure and the sound velocity on a duct cross section requires determination of the acoustic power transmitted along/radiated from a duct. In the paper, the impedance matrix, the power, and the acoustic impedance were derived as functions of Helmholtz number and distance from the outlet.

Fostering Students' Science Inquiry through App Affordances of Multimodality, Collaboration, Interactivity, and Connectivity

ERIC Educational Resources Information Center

Beach, Richard; O'Brien, David

2015-01-01

This study examined 6th graders' use of the VoiceThread app as part of a science inquiry project on photosynthesis and carbon dioxide emissions in terms of their ability to engage in causal reasoning and their use of the affordances of multimodality, collaboration, interactivity, and connectivity. Students employed multimodal production using…

Riding the Lines and Overwriting in the Margins: Affect and Multimodal Literacy Practices

ERIC Educational Resources Information Center

Lenters, Kimberly

2016-01-01

This case study examines the multimodal literacy practices of 11-year-old Nigel as he plays with assemblages of people, objects, and practices in his storywriting. The study asks "How does following the seemingly off-task multimodal literacy practices of one pre-adolescent youth across his home-community-school terrain provide insight into…

The Multimodalities of Globalization: Teaching a YouTube Video in an EAP Classroom

ERIC Educational Resources Information Center

Chun, Christian W.

2012-01-01

This article examines the ways in which a multimodal text--a YouTube video on globalization and business--was mediated in two English for Academic Purposes (EAP) classrooms, and how these mediations shaped the instructor's and her students' meaning-making in specific ways. I first explore the complex multimodal discourses involved with this…

"Seeing It from a Different Light": Adolescents' Video Reflections about Their Multimodal Compositions

ERIC Educational Resources Information Center

Smith, Blaine E.; Dalton, Bridget

2016-01-01

Although research emphasizes the importance of reflection for productive learning, much of this work has focused on writing as the preferred mode. The goal of this study was to examine how two adolescent composers reflected on their multimodal visions and processes through multimodal means--in particular, how the students remixed research-provided…

Multimode optomechanical system in the quantum regime

PubMed Central

Nielsen, William Hvidtfelt Padkær; Tsaturyan, Yeghishe; Møller, Christoffer Bo; Polzik, Eugene S.; Schliesser, Albert

2017-01-01

We realize a simple and robust optomechanical system with a multitude of long-lived (Q > 107) mechanical modes in a phononic-bandgap shielded membrane resonator. An optical mode of a compact Fabry–Perot resonator detects these modes’ motion with a measurement rate (96 kHz) that exceeds the mechanical decoherence rates already at moderate cryogenic temperatures (10 K). Reaching this quantum regime entails, inter alia, quantum measurement backaction exceeding thermal forces and thus strong optomechanical quantum correlations. In particular, we observe ponderomotive squeezing of the output light mediated by a multitude of mechanical resonator modes, with quantum noise suppression up to −2.4 dB (−3.6 dB if corrected for detection losses) and bandwidths ≲90 kHz. The multimode nature of the membrane and Fabry–Perot resonators will allow multimode entanglement involving electromagnetic, mechanical, and spin degrees of freedom. PMID:27999182

Multimode optomechanical system in the quantum regime.

PubMed

Nielsen, William Hvidtfelt Padkær; Tsaturyan, Yeghishe; Møller, Christoffer Bo; Polzik, Eugene S; Schliesser, Albert

2017-01-03

We realize a simple and robust optomechanical system with a multitude of long-lived (Q > 10 7 ) mechanical modes in a phononic-bandgap shielded membrane resonator. An optical mode of a compact Fabry-Perot resonator detects these modes' motion with a measurement rate (96 kHz) that exceeds the mechanical decoherence rates already at moderate cryogenic temperatures (10 K). Reaching this quantum regime entails, inter alia, quantum measurement backaction exceeding thermal forces and thus strong optomechanical quantum correlations. In particular, we observe ponderomotive squeezing of the output light mediated by a multitude of mechanical resonator modes, with quantum noise suppression up to -2.4 dB (-3.6 dB if corrected for detection losses) and bandwidths ≲90 kHz. The multimode nature of the membrane and Fabry-Perot resonators will allow multimode entanglement involving electromagnetic, mechanical, and spin degrees of freedom.

Multimodal approach to seismic pavement testing

USGS Publications Warehouse

Ryden, N.; Park, C.B.; Ulriksen, P.; Miller, R.D.

2004-01-01

A multimodal approach to nondestructive seismic pavement testing is described. The presented approach is based on multichannel analysis of all types of seismic waves propagating along the surface of the pavement. The multichannel data acquisition method is replaced by multichannel simulation with one receiver. This method uses only one accelerometer-receiver and a light hammer-source, to generate a synthetic receiver array. This data acquisition technique is made possible through careful triggering of the source and results in such simplification of the technique that it is made generally available. Multiple dispersion curves are automatically and objectively extracted using the multichannel analysis of surface waves processing scheme, which is described. Resulting dispersion curves in the high frequency range match with theoretical Lamb waves in a free plate. At lower frequencies there are several branches of dispersion curves corresponding to the lower layers of different stiffness in the pavement system. The observed behavior of multimodal dispersion curves is in agreement with theory, which has been validated through both numerical modeling and the transfer matrix method, by solving for complex wave numbers. ?? ASCE / JUNE 2004.

Photonic lantern with multimode fibers embedded

NASA Astrophysics Data System (ADS)

Yu, Hai-Jiao; Yan, Qi; Huang, Zong-Jun; Tian, He; Jiang, Yu; Liu, Yong-Jun; Zhang, Jian-Zhong; Sun, Wei-Min

2014-08-01

A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined.

Entanglement enhancement in multimode integrated circuits

NASA Astrophysics Data System (ADS)

Léger, Zacharie M.; Brodutch, Aharon; Helmy, Amr S.

2018-06-01

The faithful distribution of entanglement in continuous-variable systems is essential to many quantum information protocols. As such, entanglement distillation and enhancement schemes are a cornerstone of many applications. The photon subtraction scheme offers enhancement with a relatively simple setup and has been studied in various scenarios. Motivated by recent advances in integrated optics, particularly the ability to build stable multimode interferometers with squeezed input states, a multimodal extension to the enhancement via photon subtraction protocol is studied. States generated with multiple squeezed input states, rather than a single input source, are shown to be more sensitive to the enhancement protocol, leading to increased entanglement at the output. Numerical results show the gain in entanglement is not monotonic with the number of modes or the degree of squeezing in the additional modes. Consequently, the advantage due to having multiple squeezed input states can be maximized when the number of modes is still relatively small (e.g., four). The requirement for additional squeezing is within the current realm of implementation, making this scheme achievable with present technologies.

Practical estimate of gradient nonlinearity for implementation of apparent diffusion coefficient bias correction.

PubMed

Malkyarenko, Dariya I; Chenevert, Thomas L

2014-12-01

To describe an efficient procedure to empirically characterize gradient nonlinearity and correct for the corresponding apparent diffusion coefficient (ADC) bias on a clinical magnetic resonance imaging (MRI) scanner. Spatial nonlinearity scalars for individual gradient coils along superior and right directions were estimated via diffusion measurements of an isotropicic e-water phantom. Digital nonlinearity model from an independent scanner, described in the literature, was rescaled by system-specific scalars to approximate 3D bias correction maps. Correction efficacy was assessed by comparison to unbiased ADC values measured at isocenter. Empirically estimated nonlinearity scalars were confirmed by geometric distortion measurements of a regular grid phantom. The applied nonlinearity correction for arbitrarily oriented diffusion gradients reduced ADC bias from 20% down to 2% at clinically relevant offsets both for isotropic and anisotropic media. Identical performance was achieved using either corrected diffusion-weighted imaging (DWI) intensities or corrected b-values for each direction in brain and ice-water. Direction-average trace image correction was adequate only for isotropic medium. Empiric scalar adjustment of an independent gradient nonlinearity model adequately described DWI bias for a clinical scanner. Observed efficiency of implemented ADC bias correction quantitatively agreed with previous theoretical predictions and numerical simulations. The described procedure provides an independent benchmark for nonlinearity bias correction of clinical MRI scanners.

Optimizing multimodality treatment for head and neck cancer in rural India.

PubMed

Trivedi, N P; Trivedi, P; Trivedi, H; Trivedi, S; Trivedi, N

2012-01-01

Multimodality treatment of head and neck cancer in rural India is not always feasible due to lack of infrastructure and logistics. To demonstrate the feasibility of multimodality treatment for head and neck cancer in a community setting in rural India. Community cancer center, retrospective review. This article focuses on practice environment in a cancer clinic in rural India. We evaluated patient profile, treatment protocols, infrastructure availability, factors impacting treatment decisions, cost estimations, completion of treatment, and major treatment-related complications for the patient population treated in our clinic for a 2-year period. A total of 230 head and neck cancer patients were treated with curative intent. Infrastructure support included basic operating room facility (cautery machine, suction, drill system, microscope, and anesthesia machine without ventilator support), blood bank, histopathology laboratory, and computerized tomography machine. Radiation therapy (RT) facility was available in a nearby city, about 75 km away. One hundred and fifty-four (67%) patients presented at an advanced stage, with 138 (60%) receiving multimodality treatment. One hundred and eighty-four (80%) patients underwent primary surgery and 167 (73%) received radiotherapy. Two hundred and twelve (92%) patients completed the treatment, 60 (26%) were lost to follow-up at 18-month median follow-up (range 12-26 months), with 112 patients (66%) being alive, disease free. Totally 142 were major head neck surgeries with 25 free flap reconstructions and 41 regional flaps. There were 15 (6%) major post-op complications and two perioperative mortalities. Average cost of treatment for single modality treatment was approximately 40,000 INR and for multimodality treatment was 80,000 INR. This study demonstrates that it is feasible to provide basic multimodality treatment to head and neck cancer patients in the community.

Multimodal compared to pharmacologic treatments for chronic tension-type headache in adolescents.

PubMed

Przekop, Peter; Przekop, Allison; Haviland, Mark G

2016-10-01

Chronic tension-type headache (CTTH) in children and adolescents is a serious medical condition, with considerable morbidity and few effective, evidence-based treatments. We performed a chart review of 83 adolescents (age range = 13-18 years; 67 girls and 16 boys) diagnosed with CTTH. Two treatment protocols were compared: multimodal (osteopathic manipulative treatments, mindfulness, and qi gong) and pharmacologic (amitriptyline or gabapentin). Four outcomes (headache frequency, pain intensity, general health, and health interference) were assessed at three time points (baseline, 3 months, and 6 months). A fifth outcome, number of bilateral tender points, was recorded at baseline and 6 months. All five were evaluated statistically with a linear mixed model. Although both multimodal and pharmacologic treatments were effective for CTTH (time effects for all measures were significant at p < .001), results from each analysis favored multimodal treatment (the five group by time interaction effects were significant at or below the p < .001 level). Headache frequency in the pharmacologic group, for example, reduced from a monthly average (95% Confidence Interval shown in parentheses) of 23.9 (21.8, 26.0) to 16.4 (14.3, 18.6) and in the multimodal group from 22.3 (20.1, 24.5) to 4.9 (2.6, 7.2) (a substantial group difference). Pain intensity (worst in the last 24 hours, 0-10 scale) was reduced in the pharmacologic group from 6.2 (5.6, 6.9) to 3.4 (2.7, 4.1) and from 6.1 (5.4, 6.8) to 2.0 (1.2, 2.7) in the multimodal group (a less substantial difference). Across the other three assessments, group differences were larger for general health and number of tender points and less so for pain restriction. Multimodal treatment for adolescent CTTH appears to be effective. Randomized controlled trials are needed to confirm these promising results. Copyright © 2015 Elsevier Ltd. All rights reserved.

Remote sensing of multimodal transportation systems : research brief.

DOT National Transportation Integrated Search

2016-09-01

Remote Sensing of Multimodal Transportation Systems : Rapid condition monitoring and performance evaluations of the vast and vulnerable transportation infrastructure has been elusive. The framework and models developed in this research will enable th...

Distributed flow estimation and closed-loop control of an underwater vehicle with a multi-modal artificial lateral line.

PubMed

DeVries, Levi; Lagor, Francis D; Lei, Hong; Tan, Xiaobo; Paley, Derek A

2015-03-25

Bio-inspired sensing modalities enhance the ability of autonomous vehicles to characterize and respond to their environment. This paper concerns the lateral line of cartilaginous and bony fish, which is sensitive to fluid motion and allows fish to sense oncoming flow and the presence of walls or obstacles. The lateral line consists of two types of sensing modalities: canal neuromasts measure approximate pressure gradients, whereas superficial neuromasts measure local flow velocities. By employing an artificial lateral line, the performance of underwater sensing and navigation strategies is improved in dark, cluttered, or murky environments where traditional sensing modalities may be hindered. This paper presents estimation and control strategies enabling an airfoil-shaped unmanned underwater vehicle to assimilate measurements from a bio-inspired, multi-modal artificial lateral line and estimate flow properties for feedback control. We utilize potential flow theory to model the fluid flow past a foil in a uniform flow and in the presence of an upstream obstacle. We derive theoretically justified nonlinear estimation strategies to estimate the free stream flowspeed, angle of attack, and the relative position of an upstream obstacle. The feedback control strategy uses the estimated flow properties to execute bio-inspired behaviors including rheotaxis (the tendency of fish to orient upstream) and station-holding (the tendency of fish to position behind an upstream obstacle). A robotic prototype outfitted with a multi-modal artificial lateral line composed of ionic polymer metal composite and embedded pressure sensors experimentally demonstrates the distributed flow sensing and closed-loop control strategies.

Multimodal Teaching and Learning with the Use of Technology: Meanings, Practices and Discourses

ERIC Educational Resources Information Center

Papageorgiou, Vasiliki; Lameras, Petros

2017-01-01

The aim of this paper is to report on teachers' experiences of, and approaches to, multimodality in teaching and learning. A small-scale online survey with closed and semi-structured questions has been deployed to school and university teachers (n = 68) for eliciting their experiences in multimodal teaching and learning. Thematic analysis has been…

Multiplexed single-mode wavelength-to-time mapping of multimode light

PubMed Central

Chandrasekharan, Harikumar K; Izdebski, Frauke; Gris-Sánchez, Itandehui; Krstajić, Nikola; Walker, Richard; Bridle, Helen L.; Dalgarno, Paul A.; MacPherson, William N.; Henderson, Robert K.; Birks, Tim A.; Thomson, Robert R.

2017-01-01

When an optical pulse propagates along an optical fibre, different wavelengths travel at different group velocities. As a result, wavelength information is converted into arrival-time information, a process known as wavelength-to-time mapping. This phenomenon is most cleanly observed using a single-mode fibre transmission line, where spatial mode dispersion is not present, but the use of such fibres restricts possible applications. Here we demonstrate that photonic lanterns based on tapered single-mode multicore fibres provide an efficient way to couple multimode light to an array of single-photon avalanche detectors, each of which has its own time-to-digital converter for time-correlated single-photon counting. Exploiting this capability, we demonstrate the multiplexed single-mode wavelength-to-time mapping of multimode light using a multicore fibre photonic lantern with 121 single-mode cores, coupled to 121 detectors on a 32 × 32 detector array. This work paves the way to efficient multimode wavelength-to-time mapping systems with the spectral performance of single-mode systems. PMID:28120822

The integration of emotional and symbolic components in multimodal communication

PubMed Central

Mehu, Marc

2015-01-01

Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g., verbal and denotative signals) are well suited to transfer conceptual information, emotional components (e.g., non-verbal signals that are difficult to manipulate voluntarily) likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by non-verbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals. PMID:26217280