Science.gov

Sample records for multimodality imaging findings

  1. Multimodality Imaging Findings of a Renal Aspergilloma

    PubMed Central

    Bulakçı, Mesut; Kartal, Merve Gülbiz; Çelenk, Erhan; Tunçer, Sena; Kılıçaslan, Işın

    2016-01-01

    Background Renal aspergillosis is a rare infection that usually occurs in persons with a predisposition for this condition. Its differential diagnosis includes primary and metastatic renal malignancies, pyelonephritis and secondary abscess formation, granulomatous disorders, and renal infarction. We aim to stress the role of multimodality imaging and percutaneous biopsy in the diagnosis of this condition. Case Report We present diffusion weighted imaging (DWI) and positron emission tomography-computed tomography (PET-CT) findings in addition to conventional imaging modalities in a 55-year-old man with secondary renal aspergilloma. Conclusion Radiological imaging methods are an integral part of diagnostic workup for renal aspergillosis. A definitive diagnosis is made by histopathological and/or microbiological examination of the material obtained via percutaneous biopsy under guidance of imaging methods. PMID:27994929

  2. QUININE TOXICITY: MULTIMODAL RETINAL IMAGING AND ELECTRORETINOGRAPHY FINDINGS.

    PubMed

    Su, Daniel; Robson, Anthony G; Xu, David; Lightman, Susan; Sarraf, David

    2017-01-01

    To report the multimodal retinal imaging and electroretinography (ERG) findings of two cases with quinine toxicity. Retrospective case series describing the retinal imaging and ERG findings in two patients with retinal toxicity due to remote quinine exposure. Color fundus photography, fundus autofluorescence, spectral domain optical coherence tomography, and full-field ERG findings are described. Two patients with longstanding decreased vision were found to have bilateral optic disk pallor and retinal vascular attenuation indicative of chronic sequela after acute quinine toxicity. Inner retinal atrophy was identified on spectral domain optical coherence tomography, and full-field ERG was consistent with generalized inner retinal dysfunction in both patients. Fundus autofluorescence failed to demonstrate any evidence of outer retinal or retinal pigment epithelial abnormalities. Quinine toxicity may be associated with vision loss secondary to inner retinal atrophy. We report two cases with a clear history of acute quinine exposure leading to similar retinal imaging findings and distinctive ERG abnormalities. Clinicians should be aware of this uncommon condition as ingestion history may be remote.

  3. Desmoid Tumor of the Chest Wall Mimicking Recurrent Breast Cancer: Multimodality Imaging Findings

    PubMed Central

    Choi, Kyeong A; An, Yeong Yi

    2016-01-01

    Desmoid tumor of breast is a rare benign, locally aggressive tumor with a high recurrence rate. It has been associated with scar from previous breast surgery or trauma. Especially in breast cancer patients with previous operation history, it may simulate recurrent breast cancer clinically and radiologically. We presented multimodality imaging findings (ultrasound, computed tomography, magnetic resonance imaging and positron emission tomography/computed tomography) of chest wall desmoid tumor mimicking recurrent breast cancer in a 38-year-old patient with a history of left modified mastectomy. The desmoid tumor is a rare benign tumor that should be considered in the differential diagnosis of malignant local tumor recurrence after breast cancer operation. Biopsy was required for accurate diagnosis and wide local excision was its appropriate surgical management. PMID:27895871

  4. Medial prefrontal cortex pathology in schizophrenia as revealed by convergent findings from multimodal imaging

    PubMed Central

    Pomarol-Clotet, E; Canales-Rodríguez, E J; Salvador, R; Sarró, S; Gomar, J J; Vila, F; Ortiz-Gil, J; Iturria-Medina, Y; Capdevila, A; McKenna, P J

    2010-01-01

    Neuroimaging studies have found evidence of altered brain structure and function in schizophrenia, but have had complex findings regarding the localization of abnormality. We applied multimodal imaging (voxel-based morphometry (VBM), functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI) combined with tractography) to 32 chronic schizophrenic patients and matched healthy controls. At a conservative threshold of P=0.01 corrected, structural and functional imaging revealed overlapping regions of abnormality in the medial frontal cortex. DTI found that white matter abnormality predominated in the anterior corpus callosum, and analysis of the anatomical connectivity of representative seed regions again implicated fibres projecting to the medial frontal cortex. There was also evidence of convergent abnormality in the dorsolateral prefrontal cortex, although here the laterality was less consistent across techniques. The medial frontal region identified by these three imaging techniques corresponds to the anterior midline node of the default mode network, a brain system which is believed to support internally directed thought, a state of watchfulness, and/or the maintenance of one's sense of self, and which is of considerable current interest in neuropsychiatric disorders. PMID:20065955

  5. Multimodality imaging techniques.

    PubMed

    Martí-Bonmatí, Luis; Sopena, Ramón; Bartumeus, Paula; Sopena, Pablo

    2010-01-01

    In multimodality imaging, the need to combine morphofunctional information can be approached by either acquiring images at different times (asynchronous), and fused them through digital image manipulation techniques or simultaneously acquiring images (synchronous) and merging them automatically. The asynchronous post-processing solution presents various constraints, mainly conditioned by the different positioning of the patient in the two scans acquired at different times in separated machines. The best solution to achieve consistency in time and space is obtained by the synchronous image acquisition. There are many multimodal technologies in molecular imaging. In this review we will focus on those multimodality image techniques more commonly used in the field of diagnostic imaging (SPECT-CT, PET-CT) and new developments (as PET-MR). The technological innovations and development of new tracers and smart probes are the main key points that will condition multimodality image and diagnostic imaging professionals' future. Although SPECT-CT and PET-CT are standard in most clinical scenarios, MR imaging has some advantages, providing excellent soft-tissue contrast and multidimensional functional, structural and morphological information. The next frontier is to develop efficient detectors and electronics systems capable of detecting two modality signals at the same time. Not only PET-MR but also MR-US or optic-PET will be introduced in clinical scenarios. Even more, MR diffusion-weighted, pharmacokinetic imaging, spectroscopy or functional BOLD imaging will merge with PET tracers to further increase molecular imaging as a relevant medical discipline. Multimodality imaging techniques will play a leading role in relevant clinical applications. The development of new diagnostic imaging research areas, mainly in the field of oncology, cardiology and neuropsychiatry, will impact the way medicine is performed today. Both clinical and experimental multimodality studies, in

  6. Multimodal Biomedical Imaging Systems

    NASA Astrophysics Data System (ADS)

    Liang, Rongguang

    Optical imaging technologies can provide real-time images of tissues in vivo and have the potential to reveal biochemical and/or molecular information; therefore, they can significantly improve identification of malignancy at early stages. The ability to obtain tissue architectural morphology and molecular information in vivo, without the need for tissue excision, offers advancement in disease diagnostics and therapy. Multimodal imaging systems combining multiple imaging modalities for complementary tissue information offer a number of advantages compared with a single imaging modality and improve the diagnosis and treatment of diseases using distinct imaging techniques.

  7. Multimodality image display station

    NASA Astrophysics Data System (ADS)

    Myers, H. Joseph

    1990-07-01

    The Multi-modality Image Display Station (MIDS) is designed for the use of physicians outside of the radiology department. Connected to a local area network or a host computer, it provides speedy access to digitized radiology images and written diagnostics needed by attending and consulting physicians near the patient bedside. Emphasis has been placed on low cost, high performance and ease of use. The work is being done as a joint study with the University of Texas Southwestern Medical Center at Dallas, and as part of a joint development effort with the Mayo Clinic. MIDS is a prototype, and should not be assumed to be an IBM product.

  8. The Imaging Findings of Erdheim–Chester Disease: A Multimodality Approach to Diagnosis and Staging

    PubMed Central

    Martineau, Patrick; Pelletier-Galarneau, Matthieu; Zeng, Wanzhen

    2017-01-01

    Erdheim–Chester disease (ECD) is a rare, non-Langerhans histiocytic disorder. The most common manifestations consist of polyostotic sclerotic lesions with the majority of cases also demonstrating soft tissue involvement of the sinuses, retroperitoneum, large vessels, heart, lungs, and central nervous system. Nuclear medicine can play an important role in assessing the extent of the disease with bone scintigraphy and fluorodeoxyglucose (FDG)-positron emission tomography (PET). We present the case of a middle-aged female who initially presented with tooth pain. She subsequently underwent imaging including plain film, bone scan, computed tomography (CT), magnetic resonance imaging (MRI), and FDG-PET/CT, which showed characteristic bony involvement. Biopsy results confirmed the diagnosis of ECD. PMID:28217025

  9. Drusen Characterization with Multimodal Imaging

    PubMed Central

    Spaide, Richard F.; Curcio, Christine A.

    2010-01-01

    Summary Multimodal imaging findings and histological demonstration of soft drusen, cuticular drusen, and subretinal drusenoid deposits provided information used to develop a model explaining their imaging characteristics. Purpose To characterize the known appearance of cuticular drusen, subretinal drusenoid deposits (reticular pseudodrusen), and soft drusen as revealed by multimodal fundus imaging; to create an explanatory model that accounts for these observations. Methods Reported color, fluorescein angiographic, autofluorescence, and spectral domain optical coherence tomography (SD-OCT) images of patients with cuticular drusen, soft drusen, and subretinal drusenoid deposits were reviewed, as were actual images from affected eyes. Representative histological sections were examined. The geometry, location, and imaging characteristics of these lesions were evaluated. A hypothesis based on the Beer-Lambert Law of light absorption was generated to fit these observations. Results Cuticular drusen appear as numerous uniform round yellow-white punctate accumulations under the retinal pigment epithelium (RPE). Soft drusen are larger yellow-white dome-shaped mounds of deposit under the RPE. Subretinal drusenoid deposits are polymorphous light-grey interconnected accumulations above the RPE. Based on the model, both cuticular and soft drusen appear yellow due to the removal of shorter wavelength light by a double pass through the RPE. Subretinal drusenoid deposits, which are located on the RPE, are not subjected to short wavelength attenuation and therefore are more prominent when viewed with blue light. The location and morphology of extracellular material in relationship to the RPE, and associated changes to RPE morphology and pigmentation, appeared to be primary determinants of druse appearance in different imaging modalities. Conclusion Although cuticular drusen, subretinal drusenoid deposits, and soft drusen are composed of common components, they are distinguishable

  10. Multispectral analysis of multimodal images.

    PubMed

    Kvinnsland, Yngve; Brekke, Njål; Taxt, Torfinn M; Grüner, Renate

    2009-01-01

    An increasing number of multimodal images represent a valuable increase in available image information, but at the same time it complicates the extraction of diagnostic information across the images. Multispectral analysis (MSA) has the potential to simplify this problem substantially as unlimited number of images can be combined, and tissue properties across the images can be extracted automatically. We have developed a software solution for MSA containing two algorithms for unsupervised classification, an EM-algorithm finding multinormal class descriptions and the k-means clustering algorithm, and two for supervised classification, a Bayesian classifier using multinormal class descriptions and a kNN-algorithm. The software has an efficient user interface for the creation and manipulation of class descriptions, and it has proper tools for displaying the results. The software has been tested on different sets of images. One application is to segment cross-sectional images of brain tissue (T1- and T2-weighted MR images) into its main normal tissues and brain tumors. Another interesting set of images are the perfusion maps and diffusion maps, derived images from raw MR images. The software returns segmentations that seem to be sensible. The MSA software appears to be a valuable tool for image analysis with multimodal images at hand. It readily gives a segmentation of image volumes that visually seems to be sensible. However, to really learn how to use MSA, it will be necessary to gain more insight into what tissues the different segments contain, and the upcoming work will therefore be focused on examining the tissues through for example histological sections.

  11. Multimodal imaging findings of SAPHO syndrome with no skin lesions: A report of three cases and review of the literature.

    PubMed

    Duan, Na; Chen, Xiao; Liu, Yongkang; Wang, Jianhua; Wang, Zhongqiu

    2016-10-01

    Synovitis, acne, palmoplantar pustulosis, hyperostosis and osteitis syndrome (SAPHO) is a rare syndrome that affects the skin, bones and joints. Diagnosis of SAPHO syndrome is established on clinical appearance and imaging features. The present case report described the imaging features of three cases of SAPHO with sternoclavicular joint arthritis but without skin manifestations using multiple imaging modalities, including computed tomography (CT), magnetic resonance imaging (MRI) and bone scintigraphy. The first case was a 52-year-old male who suffered from progressive sternoclavicular arthritis for 2 years. The second case was a 62-year-old female with arthritis in the larger joints for 5 years, particularly on the right thoracic area. The third case was a 44-year-old male who exhibited a slight bulge accompanied by pain in the upper anterior chest wall for 4 years. All of them lacked cutaneous lesions. CT demonstrated sclerosis and hyperostosis with subchondral erosions in the sternocostoclavicular joints. MRI revealed bone marrow edema that was slightly hypointense on T1-weighted imaging, and hyperintense on T2-weighted imaging. Typical 'bull head' signs were observed in bone scintigraphy images. The present case study demonstrated that SAPHO syndrome should be suspected in patients with multifocal osteitis or arthritis affecting the chest wall that lack skin manifestations. Multimodal imaging modalities in combination are helpful for SAPHO diagnosis.

  12. Multimodal imaging findings of SAPHO syndrome with no skin lesions: A report of three cases and review of the literature

    PubMed Central

    Duan, Na; Chen, Xiao; Liu, Yongkang; Wang, Jianhua; Wang, Zhongqiu

    2016-01-01

    Synovitis, acne, palmoplantar pustulosis, hyperostosis and osteitis syndrome (SAPHO) is a rare syndrome that affects the skin, bones and joints. Diagnosis of SAPHO syndrome is established on clinical appearance and imaging features. The present case report described the imaging features of three cases of SAPHO with sternoclavicular joint arthritis but without skin manifestations using multiple imaging modalities, including computed tomography (CT), magnetic resonance imaging (MRI) and bone scintigraphy. The first case was a 52-year-old male who suffered from progressive sternoclavicular arthritis for 2 years. The second case was a 62-year-old female with arthritis in the larger joints for 5 years, particularly on the right thoracic area. The third case was a 44-year-old male who exhibited a slight bulge accompanied by pain in the upper anterior chest wall for 4 years. All of them lacked cutaneous lesions. CT demonstrated sclerosis and hyperostosis with subchondral erosions in the sternocostoclavicular joints. MRI revealed bone marrow edema that was slightly hypointense on T1-weighted imaging, and hyperintense on T2-weighted imaging. Typical ‘bull head’ signs were observed in bone scintigraphy images. The present case study demonstrated that SAPHO syndrome should be suspected in patients with multifocal osteitis or arthritis affecting the chest wall that lack skin manifestations. Multimodal imaging modalities in combination are helpful for SAPHO diagnosis. PMID:27698770

  13. Multimodality imaging in cranial blastomycosis, a great mimicker: Case-based illustration with review of clinical and imaging findings.

    PubMed

    Kochar, Puneet S; Lath, Chinar O; Klein, Andrew P; Ulmer, John L

    2016-01-01

    We describe the clinical, laboratory, and imaging data of three patients who are proven cases of blastomycosis with cranial involvement. In this review, we discuss the imaging features of cranial blastomycosis with relevant clinical case examples including computed tomography (CT), magnetic resonance imaging (MRI), and advanced MR imaging techniques like magnetic resonance spectroscopy (MRS) and MR perfusion. Literature is reviewed for modern-day diagnosis and treatment of this fatal intracranial infection, if not diagnosed promptly and managed effectively.

  14. Multimodality imaging in cranial blastomycosis, a great mimicker: Case-based illustration with review of clinical and imaging findings

    PubMed Central

    Kochar, Puneet S; Lath, Chinar O; Klein, Andrew P; Ulmer, John L

    2016-01-01

    We describe the clinical, laboratory, and imaging data of three patients who are proven cases of blastomycosis with cranial involvement. In this review, we discuss the imaging features of cranial blastomycosis with relevant clinical case examples including computed tomography (CT), magnetic resonance imaging (MRI), and advanced MR imaging techniques like magnetic resonance spectroscopy (MRS) and MR perfusion. Literature is reviewed for modern-day diagnosis and treatment of this fatal intracranial infection, if not diagnosed promptly and managed effectively. PMID:27081235

  15. Multimodal imaging of ischemic wounds

    NASA Astrophysics Data System (ADS)

    Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Liu, Peng; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

    2012-12-01

    The wound healing process involves the reparative phases of inflammation, proliferation, and remodeling. Interrupting any of these phases may result in chronically unhealed wounds, amputation, or even patient death. Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, no method is available for noninvasive, simultaneous, and quantitative imaging of these tissue parameters. We integrated hyperspectral, laser speckle, and thermographic imaging modalities into a single setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Advanced algorithms were developed for accurate reconstruction of wound oxygenation and appropriate co-registration between different imaging modalities. The multimodal wound imaging system was validated by an ongoing clinical trials approved by OSU IRB. In the clinical trial, a wound of 3mm in diameter was introduced on a healthy subject's lower extremity and the healing process was serially monitored by the multimodal imaging setup. Our experiments demonstrated the clinical usability of multimodal wound imaging.

  16. Radioactive Nanomaterials for Multimodality Imaging

    PubMed Central

    Chen, Daiqin; Dougherty, Casey A.; Yang, Dongzhi; Wu, Hongwei; Hong, Hao

    2016-01-01

    Nuclear imaging techniques, including primarily positron emission tomography (PET) and single-photon emission computed tomography (SPECT), can provide quantitative information for a biological event in vivo with ultra-high sensitivity, however, the comparatively low spatial resolution is their major limitation in clinical application. By convergence of nuclear imaging with other imaging modalities like computed tomography (CT), magnetic resonance imaging (MRI) and optical imaging, the hybrid imaging platforms can overcome the limitations from each individual imaging technique. Possessing versatile chemical linking ability and good cargo-loading capacity, radioactive nanomaterials can serve as ideal imaging contrast agents. In this review, we provide a brief overview about current state-of-the-art applications of radioactive nanomaterials in the circumstances of multimodality imaging. We present strategies for incorporation of radioisotope(s) into nanomaterials along with applications of radioactive nanomaterials in multimodal imaging. Advantages and limitations of radioactive nanomaterials for multimodal imaging applications are discussed. Finally, a future perspective of possible radioactive nanomaterial utilization is presented for improving diagnosis and patient management in a variety of diseases. PMID:27227167

  17. Advances in multimodality molecular imaging

    PubMed Central

    Zaidi, Habib; Prasad, Rameshwar

    2009-01-01

    Multimodality molecular imaging using high resolution positron emission tomography (PET) combined with other modalities is now playing a pivotal role in basic and clinical research. The introduction of combined PET/CT systems in clinical setting has revolutionized the practice of diagnostic imaging. The complementarity between the intrinsically aligned anatomic (CT) and functional or metabolic (PET) information provided in a “one-stop shop” and the possibility to use CT images for attenuation correction of the PET data has been the driving force behind the success of this technology. On the other hand, combining PET with Magnetic Resonance Imaging (MRI) in a single gantry is technically more challenging owing to the strong magnetic fields. Nevertheless, significant progress has been made resulting in the design of few preclinical PET systems and one human prototype dedicated for simultaneous PET/MR brain imaging. This paper discusses recent advances in PET instrumentation and the advantages and challenges of multimodality imaging systems. Future opportunities and the challenges facing the adoption of multimodality imaging instrumentation will also be addressed. PMID:20098557

  18. IMAGING DIAGNOSIS-MULTIMODALITY FINDINGS IN AN ADULT DOG WITH PRIMARY SARCOMA OF THE PULMONARY ARTERY AND MYOCARDIAL METASTASES.

    PubMed

    Stieger-Vanegas, Susanne M; Bottorff, Bryan; Sisson, David; Löhr, Christiane V

    2016-07-01

    Intravascular pulmonary artery sarcomas in combination with myocardial metastasis are rare in dogs. We describe the radiographic, echocardiographic, and electrocardiographic-gated (ECG-gated) computed tomographic angiography (CTA) findings in a dog with pulmonary artery sarcoma. All imaging studies demonstrated severe main pulmonary artery enlargement. Echocardiography and ECG-gated CTA revealed a mass occluding the lumen of the right pulmonary artery. In addition, CTA revealed focal left ventricular myocardial contrast enhancement and parenchymal lung changes. Postmortem examination confirmed the presence of a large thrombus associated with arteriosclerosis and an intravascular sarcoma in the right pulmonary artery with metastases to the myocardium, lungs and brain.

  19. Multimodal Imaging in Sympathetic Ophthalmia.

    PubMed

    Mahajan, Sarakshi; Invernizzi, Alessandro; Agrawal, Rupesh; Biswas, Jyotirmay; Rao, Narsing A; Gupta, Vishali

    2017-04-01

    To show the current status of multimodal imaging and its role in supporting an early diagnosis of sympathetic ophthalmia. The diagnosis is mainly clinical supported with ancillary investigations; mainly fluorescein angiography and others, including indocyanine angiography optical coherence tomography (OCT), OCT enhanced depth imaging, autofluorescence imaging, and ultrasonography. Various imaging modalities such as OCT, autofluorescence imaging and angiography are critical in the diagnosis and management of sympathetic ophthalmia. The clinician must make adequate use of such ancillary investigations in the management of the patients. Sympathetic ophthalmia is a rare, bilateral inflammation of the uveal tract following penetrating trauma or surgery in one eye. The intraocular inflammation requires a prompt diagnosis so that the treatment can be initiated as early as possible.

  20. Multimode imaging device

    DOEpatents

    Mihailescu, Lucian; Vetter, Kai M

    2013-08-27

    Apparatus for detecting and locating a source of gamma rays of energies ranging from 10-20 keV to several MeV's includes plural gamma ray detectors arranged in a generally closed extended array so as to provide Compton scattering imaging and coded aperture imaging simultaneously. First detectors are arranged in a spaced manner about a surface defining the closed extended array which may be in the form a circle, a sphere, a square, a pentagon or higher order polygon. Some of the gamma rays are absorbed by the first detectors closest to the gamma source in Compton scattering, while the photons that go unabsorbed by passing through gaps disposed between adjacent first detectors are incident upon second detectors disposed on the side farthest from the gamma ray source, where the first spaced detectors form a coded aperture array for two or three dimensional gamma ray source detection.

  1. Radiolabeled Nanoparticles for Multimodality Tumor Imaging

    PubMed Central

    Xing, Yan; Zhao, Jinhua; Conti, Peter S.; Chen, Kai

    2014-01-01

    Each imaging modality has its own unique strengths. Multimodality imaging, taking advantages of strengths from two or more imaging modalities, can provide overall structural, functional, and molecular information, offering the prospect of improved diagnostic and therapeutic monitoring abilities. The devices of molecular imaging with multimodality and multifunction are of great value for cancer diagnosis and treatment, and greatly accelerate the development of radionuclide-based multimodal molecular imaging. Radiolabeled nanoparticles bearing intrinsic properties have gained great interest in multimodality tumor imaging over the past decade. Significant breakthrough has been made toward the development of various radiolabeled nanoparticles, which can be used as novel cancer diagnostic tools in multimodality imaging systems. It is expected that quantitative multimodality imaging with multifunctional radiolabeled nanoparticles will afford accurate and precise assessment of biological signatures in cancer in a real-time manner and thus, pave the path towards personalized cancer medicine. This review addresses advantages and challenges in developing multimodality imaging probes by using different types of nanoparticles, and summarizes the recent advances in the applications of radiolabeled nanoparticles for multimodal imaging of tumor. The key issues involved in the translation of radiolabeled nanoparticles to the clinic are also discussed. PMID:24505237

  2. Histology image search using multimodal fusion.

    PubMed

    Caicedo, Juan C; Vanegas, Jorge A; Páez, Fabian; González, Fabio A

    2014-10-01

    This work proposes a histology image indexing strategy based on multimodal representations obtained from the combination of visual features and associated semantic annotations. Both data modalities are complementary information sources for an image retrieval system, since visual features lack explicit semantic information and semantic terms do not usually describe the visual appearance of images. The paper proposes a novel strategy to build a fused image representation using matrix factorization algorithms and data reconstruction principles to generate a set of multimodal features. The methodology can seamlessly recover the multimodal representation of images without semantic annotations, allowing us to index new images using visual features only, and also accepting single example images as queries. Experimental evaluations on three different histology image data sets show that our strategy is a simple, yet effective approach to building multimodal representations for histology image search, and outperforms the response of the popular late fusion approach to combine information.

  3. Cardiac sarcoidosis diagnosed by multimodality imaging.

    PubMed

    Fujikura, Kana; Garcia, Mario J

    2017-09-01

    A 66-year-old woman presented with frequent premature ventricular contractions (PVC) and akinesis of the basal septum on echocardiography. Coronary angiography was normal. Cardiac magnetic resonance showed mid-wall enhancement. Positron emission tomography showed a perfusion defect at the same location using 13N-ammonia, but increased 18-fluorodeoxyglucose uptake. These findings supported the diagnosis of cardiac sarcoidosis. High-dose steroids initially reduced frequency of PVCs but had to be withdrawn due to severe side effects. An ICD was implanted. Our case demonstrates the utility of multimodality imaging to diagnose and guide management of this entity. © 2017, Wiley Periodicals, Inc.

  4. Multimodal imaging measures predict rearrest

    PubMed Central

    Steele, Vaughn R.; Claus, Eric D.; Aharoni, Eyal; Vincent, Gina M.; Calhoun, Vince D.; Kiehl, Kent A.

    2015-01-01

    Rearrest has been predicted by hemodynamic activity in the anterior cingulate cortex (ACC) during error-processing (Aharoni et al., 2013). Here, we evaluate the predictive power after adding an additional imaging modality in a subsample of 45 incarcerated males from Aharoni et al. (2013). Event-related potentials (ERPs) and hemodynamic activity were collected during a Go/NoGo response inhibition task. Neural measures of error-processing were obtained from the ACC and two ERP components, the error-related negativity (ERN/Ne) and the error positivity (Pe). Measures from the Pe and ACC differentiated individuals who were and were not subsequently rearrested. Cox regression, logistic regression, and support vector machine (SVM) neuroprediction models were calculated. Each of these models proved successful in predicting rearrest and SVM provided the strongest results. Multimodal neuroprediction SVM models with out of sample cross-validating accurately predicted rearrest (83.33%). Offenders with increased Pe amplitude and decreased ACC activation, suggesting abnormal error-processing, were at greatest risk of rearrest. PMID:26283947

  5. "Multimodal Contrast" from the Multivariate Analysis of Hyperspectral CARS Images

    NASA Astrophysics Data System (ADS)

    Tabarangao, Joel T.

    The typical contrast mechanism employed in multimodal CARS microscopy involves the use of other nonlinear imaging modalities such as two-photon excitation fluorescence (TPEF) microscopy and second harmonic generation (SHG) microscopy to produce a molecule-specific pseudocolor image. In this work, I explore the use of unsupervised multivariate statistical analysis tools such as Principal Component Analysis (PCA) and Vertex Component Analysis (VCA) to provide better contrast using the hyperspectral CARS data alone. Using simulated CARS images, I investigate the effects of the quadratic dependence of CARS signal on concentration on the pixel clustering and classification and I find that a normalization step is necessary to improve pixel color assignment. Using an atherosclerotic rabbit aorta test image, I show that the VCA algorithm provides pseudocolor contrast that is comparable to multimodal imaging, thus showing that much of the information gleaned from a multimodal approach can be sufficiently extracted from the CARS hyperspectral stack itself.

  6. Multimodal imaging of cutaneous wound tissue

    NASA Astrophysics Data System (ADS)

    Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Ren, Wenqi; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

    2015-01-01

    Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, few methods are available for simultaneous assessment of these tissue parameters in a noninvasive and quantitative fashion. We integrated hyperspectral, laser speckle, and thermographic imaging modalities in a single-experimental setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Algorithms were developed for appropriate coregistration between wound images acquired by different imaging modalities at different times. The multimodal wound imaging system was validated in an occlusion experiment, where oxygenation and perfusion maps of a healthy subject's upper extremity were continuously monitored during a postocclusive reactive hyperemia procedure and compared with standard measurements. The system was also tested in a clinical trial where a wound of three millimeters in diameter was introduced on a healthy subject's lower extremity and the healing process was continuously monitored. Our in vivo experiments demonstrated the clinical feasibility of multimodal cutaneous wound imaging.

  7. Multimodality imaging in nanomedicine and nanotheranostics

    PubMed Central

    Li, Xue; Zhang, Xue-Ning; Li, Xiao-Dong; Chang, Jin

    2016-01-01

    Accurate diagnosis of tumors needs much detailed information. However, available single imaging modality cannot provide complete or comprehensive data. Nanomedicine is the application of nanotechnology to medicine, and multimodality imaging based on nanoparticles has been receiving extensive attention. This new hybrid imaging technology could provide complementary information from different imaging modalities using only a single injection of contrast agent. In this review, we introduce recent developments in multifunctional nanoparticles and their biomedical applications to multimodal imaging and theragnosis as nanomedicine. Most of the reviewed studies are based on the intrinsic properties of nanoparticles and their application in clinical imaging technology. The imaging techniques include positron emission tomography, single-photon emission computed tomography, computerized tomography, magnetic resonance imaging, optical imaging, and ultrasound imaging. PMID:27807501

  8. Monomolecular multimodal fluorescence-radioisotope imaging agents.

    PubMed

    Zhang, Zongren; Liang, Kexian; Bloch, Sharon; Berezin, Mikhail; Achilefu, Samuel

    2005-01-01

    Diagnosis of diseases by different imaging methods can provide complementary information about the functional status of diseased tissues or organs. To overcome the current difficulties in coregistering images from different imaging modalities with a high degree of accuracy, we prepared near-infrared (NIR) monomolecular multimodal imaging agents (MOMIAs) consisting of a heptamethine carbocyanine and 111In-DOTA chelate that served as antennae for optical and scintigraphic imaging, respectively. Their spectral properties clearly show that coordination of indium to MOMIA increased the fluorescence intensity of the compounds. The MOMIAs are exceptionally stable in biological media and serum up to 24 h at 37 degrees C. Biodistribution of the compounds in mice obtained by fluorescence photon and gamma-counts demonstrated a similar distribution trend of the molecular probe in different tissues, suggesting that the detected fluorescence and gamma-emissions emanated from the same source (MOMIA). At 24 h postinjection, the MOMIAs were excreted by the renal and hepatobiliary systems and the blood level of a representative MOMIA was very low, thereby reducing background noise caused by circulating molecular probes. These findings demonstrate the feasibility of preparing single molecules with the capacity to emit discernible and diagnostic fluorescent and gamma-radiations for optical and nuclear imaging of living organisms.

  9. Instrumentation challenges in multi-modality imaging

    NASA Astrophysics Data System (ADS)

    Brasse, D.; Boisson, F.

    2016-02-01

    Based on different physical principles, imaging procedures currently used in both clinical and preclinical applications present different performance that allow researchers to achieve a large number of studies. However, the relevance of obtaining a maximum of information relating to the same subject is undeniable. The last two decades have thus seen the advent of a full-fledged research axis, the multimodal in vivo imaging. Whether from an instrumentation point of view, for medical research or the development of new probes, all these research works illustrate the growing interest of the scientific community for multimodal imaging, which can be approached with different backgrounds and perspectives from engineers to end-users point of views. In the present review, we discuss the multimodal imaging concept, which focuses not only on PET/CT and PET/MRI instrumentation but also on recent investigations of what could become a possible future in the field.

  10. Nanoparticles in Higher-Order Multimodal Imaging

    NASA Astrophysics Data System (ADS)

    Rieffel, James Ki

    Imaging procedures are a cornerstone in our current medical infrastructure. In everything from screening, diagnostics, and treatment, medical imaging is perhaps our greatest tool in evaluating individual health. Recently, there has been tremendous increase in the development of multimodal systems that combine the strengths of complimentary imaging technologies to overcome their independent weaknesses. Clinically, this has manifested in the virtually universal manufacture of combined PET-CT scanners. With this push toward more integrated imaging, new contrast agents with multimodal functionality are needed. Nanoparticle-based systems are ideal candidates based on their unique size, properties, and diversity. In chapter 1, an extensive background on recent multimodal imaging agents capable of enhancing signal or contrast in three or more modalities is presented. Chapter 2 discusses the development and characterization of a nanoparticulate probe with hexamodal imaging functionality. It is my hope that the information contained in this thesis will demonstrate the many benefits of nanoparticles in multimodal imaging, and provide insight into the potential of fully integrated imaging.

  11. Quantitative multimodality imaging in cancer research and therapy.

    PubMed

    Yankeelov, Thomas E; Abramson, Richard G; Quarles, C Chad

    2014-11-01

    Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET-CT and single-photon emission CT (SPECT-CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET-MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein.

  12. Quantitative multimodality imaging in cancer research and therapy

    PubMed Central

    Yankeelov, Thomas E.; Abramson, Richard G.; Quarles, C. Chad

    2016-01-01

    Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET–CT and single-photon emission CT (SPECT–CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET–MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein. PMID:25113842

  13. Exostosis Bursata - Multimodality Imaging Approach.

    PubMed

    Ali, Asik Ali Mohamed; Sharma, Praveen; Rege, Rujuta; Seena, C R; Rajesh, Saveetha

    2016-09-01

    Osteochondromas or exostosis are common benign bone tumours, commonly arising from the metaphyseal region of long bones (femur, humerus, tibia). Osteochondroma of the scapula are rare and cause mechanical irritation leading to bursal formation. We hereby report a case of 30-year-old man who presented with painful chest wall swelling and its multimodality approach to establish the diagnosis.

  14. Medical Image Retrieval: A Multimodal Approach

    PubMed Central

    Cao, Yu; Steffey, Shawn; He, Jianbiao; Xiao, Degui; Tao, Cui; Chen, Ping; Müller, Henning

    2014-01-01

    Medical imaging is becoming a vital component of war on cancer. Tremendous amounts of medical image data are captured and recorded in a digital format during cancer care and cancer research. Facing such an unprecedented volume of image data with heterogeneous image modalities, it is necessary to develop effective and efficient content-based medical image retrieval systems for cancer clinical practice and research. While substantial progress has been made in different areas of content-based image retrieval (CBIR) research, direct applications of existing CBIR techniques to the medical images produced unsatisfactory results, because of the unique characteristics of medical images. In this paper, we develop a new multimodal medical image retrieval approach based on the recent advances in the statistical graphic model and deep learning. Specifically, we first investigate a new extended probabilistic Latent Semantic Analysis model to integrate the visual and textual information from medical images to bridge the semantic gap. We then develop a new deep Boltzmann machine-based multimodal learning model to learn the joint density model from multimodal information in order to derive the missing modality. Experimental results with large volume of real-world medical images have shown that our new approach is a promising solution for the next-generation medical imaging indexing and retrieval system. PMID:26309389

  15. Multimodality imaging of adult gastric emergencies: A pictorial review

    PubMed Central

    Sunnapwar, Abhijit; Ojili, Vijayanadh; Katre, Rashmi; Shah, Hardik; Nagar, Arpit

    2017-01-01

    Acute gastric emergencies require urgent surgical or nonsurgical intervention because they are associated with high morbidity and mortality. Imaging plays an important role in diagnosis since the clinical symptoms are often nonspecific and radiologist may be the first one to suggest a diagnosis as the imaging findings are often characteristic. The purpose of this article is to provide a comprehensive review of multimodality imaging (plain radiograph, fluoroscopy, and computed tomography) of various life threatening gastric emergencies. PMID:28515579

  16. MULTIMODAL IMAGING IN VORTEX VEIN VARICES.

    PubMed

    Veronese, Chiara; Staurenghi, Giovanni; Pellegrini, Marco; Maiolo, Chiara; Primavera, Laura; Morara, Mariachiara; Armstrong, Grayson W; Ciardella, Antonio P

    2017-03-22

    patients. On fluorescein angiography, all lesions were initially hyperfluorescent with a hypofluorescent ring, with the lesion becoming hyperfluorescent after injection of dye. Indocyanine green angiography demonstrated dilation of the vortex vein ampullae in all patients. Spectral-domain enhanced depth imaging optical coherence tomography demonstrated dilated choroidal vessels and a hyporeflective cavity without subretinal fluid in all patients. Ultra-widefield fluorescein angiography and ultra-widefield indocyanine angiography demonstrated disappearance of all retinal lesions when pressure was applied to the globe. Findings are consistent with the diagnosis of vortex vein varix in all eight patients, with six patients (75%) exhibiting a single varix and two patients (25%) exhibiting a double varix. The diagnosis of vortex vein varices can be confirmed through clinical examination through the use of digital pressure to the globe during ophthalmoscopic examination. Adjunctive multimodal imaging (fundus color photography, near-infrared reflectance imaging, fundus autofluorescence, fluorescein angiography, indocyanine angiography, and spectral-domain enhanced depth imaging optical coherence tomography) was useful in the diagnosis of vortex vein varices in the authors' clinical cases. However, in more challenging clinical cases, the authors' novel use of the ultra-widefield contact lens for application of ocular pressure with a resulting resolution of the varix proved to be a useful and easy diagnostic imaging method for confirming the presence of vortex vein varices.

  17. A Multimodal Nanocomposite for Biomedical Imaging

    PubMed Central

    Wu, Aiguo; Paunesku, Tatjana; Zhang, Zhuoli; Vogt, Stefan; Lai, Barry; Maser, Jörg; Yaghmai, Vahid; Li, Debiao; Omary, Reed A.; Woloschak, Gayle E.

    2013-01-01

    A multimodal nanocomposite was designed, synthesized with super-paramagnetic core (CoFe2O4), noble metal corona (Au), and semiconductor shell (TiO2). The sizes of core, core-corona, and core-corona-shell particles were determined by TEM. This multimodal nanocrystal showed promise as a contrast agent for two of the most widely used biomedical imaging techniques: magnetic resonance imaging (MRI) and X-ray computed tomography (CT). Finally, these nanocomposites were coated with a peptide SN-50. This led to their ready uptake by the cultured cells and targeted the nanocomposites to the pores of nuclear membrane. Inside cells, this nanocomposite retained its integrity as shown by X-ray fluorescence microscopy (XFM). Inside cells imaged by XFM we found the complex elemental signature of nanoconjugates (Ti-Co-Fe-Au) always co-registered in the 2D elemental map of the cell. PMID:24817775

  18. A Multimodal Nanocomposite for Biomedical Imaging

    NASA Astrophysics Data System (ADS)

    Wu, A.; Paunesku, T.; Zhang, Z.; Vogt, S.; Lai, B.; Maser, J.; Yaghmai, V.; Li, D.; Omary, R. A.; Woloschak, G. E.

    2011-09-01

    A multimodal nanocomposite was designed, synthesized with super-paramagnetic core (CoFe2O4), noble metal corona (Au), and semiconductor shell (TiO2). The sizes of core, core-corona, and core-corona-shell particles were determined by TEM. This multimodal nanocrystal showed promise as a contrast agent for two of the most widely used biomedical imaging techniques: magnetic resonance imaging (MRI) and x-ray computed tomography (CT). Finally, these nanocomposites were coated with a peptide SN-50. This led to their ready uptake by the cultured cells and targeted the nanocomposites to the pores of nuclear membrane. Inside cells, this nanocomposite retained its integrity as shown by x-ray fluorescence microscopy (XFM). Inside cells imaged by XFM we found the complex elemental signature of nanoconjugates (Ti-Co-Fe-Au) always co-registered in the 2D elemental map of the cell.

  19. Multimode-Optical-Fiber Imaging Probe

    NASA Technical Reports Server (NTRS)

    Jackson, Deborah

    1999-01-01

    Currently, endoscopic surgery uses single-mode fiber-bundles to obtain in vivo image information inside the orifices of the body. This limits their use to the larger natural orifices and to surgical procedures where there is plenty of room for manipulation. The knee joint, for example, can be easily viewed with a fiber optic viewer, but joints in the finger cannot. However, there are a host of smaller orifices where fiber endoscopy would play an important role if a cost effective fiber probe were developed with small enough dimensions (less than or equal to 250 microns). Examples of beneficiaries of micro-endoscopes are the treatment of the Eustatian tube of the middle ear, the breast ducts, tear ducts, coronary arteries, fallopian tubes, as well as the treatment of salivary duct parotid disease, and the neuro endoscopy of the ventricles and spinal canal. This work describes an approach for recovering images from tightly confined spaces using multimode. The concept draws upon earlier works that concentrated on image recovery after two-way transmission through a multimode fiber as well as work that demonstrated the recovery of images after one-way transmission through a multimode fiber. Both relied on generating a phase conjugated wavefront, which was predistorted with the characteristics of the fiber. The approach described here also relies on generating a phase conjugated wavefront, but utilizes two fibers to capture the image at some intermediate point (accessible by the fibers, but which is otherwise visually inaccessible).

  20. Multimodality bonchoscopic imaging of tracheopathica osteochondroplastica

    NASA Astrophysics Data System (ADS)

    Colt, Henri; Murgu, Septimiu D.; Ahn, Yeh-Chan; Brenner, Matt

    2009-05-01

    Results of a commercial optical coherence tomography system used as part of a multimodality diagnostic bronchoscopy platform are presented for a 61-year-old patient with central airway obstruction from tracheopathica osteochondroplastica. Comparison to results of white-light bronchoscopy, histology, and endobronchial ultrasound examination are accompanied by a discussion of resolution, penetration depth, contrast, and field of view of these imaging modalities. White-light bronchoscopy revealed irregularly shaped, firm submucosal nodules along cartilaginous structures of the anterior and lateral walls of the trachea, sparing the muscular posterior membrane. Endobronchial ultrasound showed a hyperechoic density of 0.4 cm thickness. optical coherence tomography (OCT) was performed using a commercially available, compact time-domain OCT system (Niris System, Imalux Corp., Cleveland, Ohio) with a magnetically actuating probe (two-dimensional, front imaging, and inside actuation). Images showed epithelium, upper submucosa, and osseous submucosal nodule layers corresponding with histopathology. To our knowledge, this is the first time these commercially available systems are used as part of a multimodality bronchoscopy platform to study diagnostic imaging of a benign disease causing central airway obstruction. Further studies are needed to optimize these systems for pulmonary applications and to determine how new-generation imaging modalities will be integrated into a multimodality bronchoscopy platform.

  1. Multimodal imaging of cutaneous wound tissue

    PubMed Central

    Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Ren, Wenqi; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

    2015-01-01

    Abstract. Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, few methods are available for simultaneous assessment of these tissue parameters in a noninvasive and quantitative fashion. We integrated hyperspectral, laser speckle, and thermographic imaging modalities in a single-experimental setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Algorithms were developed for appropriate coregistration between wound images acquired by different imaging modalities at different times. The multimodal wound imaging system was validated in an occlusion experiment, where oxygenation and perfusion maps of a healthy subject’s upper extremity were continuously monitored during a postocclusive reactive hyperemia procedure and compared with standard measurements. The system was also tested in a clinical trial where a wound of three millimeters in diameter was introduced on a healthy subject’s lower extremity and the healing process was continuously monitored. Our in vivo experiments demonstrated the clinical feasibility of multimodal cutaneous wound imaging. PMID:25604545

  2. Multimodality Cardiovascular Molecular Imaging Technology

    PubMed Central

    O’Donnell, Matthew; McVeigh, Elliot R.; Strauss, H. William; Tanaka, Atsushi; Bouma, Brett E.; Tearney, Guillermo J.; Guttman, Michael A.; Garcia, Ernest V.

    2010-01-01

    Cardiovascular molecular imaging is a new discipline that integrates scientific advances in both functional imaging and molecular probes to improve our understanding of the molecular basis of the cardiovascular system. These advances are driven by in vivo imaging of molecular processes in animals, usually small animals, and are rapidly moving toward clinical applications. Molecular imaging has the potential to revolutionize the diagnosis and treatment of cardiovascular disease. The 2 key components of all molecular imaging systems are the molecular contrast agents and the imaging system providing spatial and temporal localization of these agents within the body. They must deliver images with the appropriate sensitivity and specificity to drive clinical applications. As work in molecular contrast agents matures and highly sensitive and specific probes are developed, these systems will provide the imaging technologies required for translation into clinical tools. This is the promise of molecular medicine. PMID:20457794

  3. Enhancing impedance imaging through multimodal tomography.

    PubMed

    Gürsoy, Doğa; Mamatjan, Yasin; Adler, Andy; Scharfetter, Hermann

    2011-11-01

    Several noninvasive modalities including electrical impedance tomography (EIT), magnetic induction tomography (MIT), and induced-current EIT (ICEIT) have been developed for imaging the electrical conductivity distribution within a human body. Although these modalities differ in how the excitation and detection circuitry (electrodes or coils) are implemented, they share a number of common principles not only within the image reconstruction approaches but also with respect to the basic principle of generating a current density distribution inside a body and recording the resultant electric fields. In this paper, we are interested in comparing differences between these modalities and in theoretically understanding the compromises involved, despite the increased hardware cost and complexity that such a multimodal system brings along. To systematically assess the merits of combining data, we performed 3-D simulations for each modality and for the multimodal system by combining all available data. The normalized sensitivity matrices were computed for each modality based on the finite element method, and singular value decomposition was performed on the resultant matrices. We used both global and regional quality measures to evaluate and compare different modalities. This study has shown that the condition number of the sensitivity matrix obtained from the multimodal tomography with 16-electrode and 16-coil is much lower than the condition number produced in the conventional 16-channel EIT and MIT systems, and thus, produced promising results in terms of image stability. An improvement of about 20% in image resolution can be achieved considering feasible signal-to-noise ratio levels.

  4. Laplacian eigenmaps for multimodal groupwise image registration

    NASA Astrophysics Data System (ADS)

    Polfliet, Mathias; Klein, Stefan; Niessen, Wiro J.; Vandemeulebroucke, Jef

    2017-02-01

    Multimodal groupwise registration has been of growing interest to the image processing community due to developments in scanner technologies (e.g. multiparametric MRI, DCE-CT or PET-MR) that increased both the number of modalities and number of images under consideration. In this work a novel methodology is presented for multimodal groupwise registration that is based on Laplacian eigenmaps, a nonlinear dimensionality reduction technique. Compared to recently proposed dissimilarity metrics based on principal component analysis, the proposed metric should enable a better capture of the intensity relationships between different images in the group. The metric is constructed to be the second smallest eigenvalue from the eigenvector problem defined in Laplacian eigenmaps. The method was validated in three distinct experiments: a non-linear synthetic registration experiment, the registration of quantitative MRI data of the carotid artery, and the registration of multimodal data of the brain (RIRE). The results show increased accuracy and robustness compared to other state-of-the-art groupwise registration methodologies.

  5. Advances in multimodal molecular imaging.

    PubMed

    Auletta, Luigi; Gramanzini, Matteo; Gargiulo, Sara; Albanese, Sandra; Salvatore, Marco; Greco, Adelaide

    2017-03-01

    Preclinical molecular imaging is an emerging field. Improving the ability of scientists to study the molecular basis of human pathology in animals is of the utmost importance for future advances in all fields of human medicine. Moreover, the possibility of developing new imaging techniques or of implementing old ones adapted to the clinic is a significant area. Cardiology, neurology, immunology and oncology have all been studied with preclinical molecular imaging. The functional techniques of photoacoustic imaging (PAI), fluorescence molecular tomography (FMT), positron emission tomography (PET), and single photon emission computed tomography (SPECT) in association with each other or with the anatomic reference provided by computed tomography (CT) as well as with anatomic and functional information provided by magnetic resonance (MR) have all been proficiently applied to animal models of human disease. All the above-mentioned imaging techniques have shown their ability to explore the molecular mechanisms involved in animal models of disease. The clinical translatability of most of the techniques motivates the ongoing study of their possible fields of application. The ability to combine two or more techniques allows obtaining as much information as possible on the molecular processes involved in pathologies, reducing the number of animals necessary in each experiment. Merging molecular probes compatible with various imaging technique will further expand the capability to achieve the best results.

  6. Multimodality imaging for resuscitated sudden cardiac death.

    PubMed

    Chen, Yingming Amy; Deva, Djeven; Kirpalani, Anish; Prabhudesai, Vikram; Marcuzzi, Danny W; Graham, John J; Verma, Subodh; Jimenez-Juan, Laura; Yan, Andrew T

    2015-01-01

    We present a case that elegantly illustrates the utility of two novel noninvasive imaging techniques, computed tomography (CT) coronary angiography and cardiac MRI, in the diagnosis and management of a 27-year-old man with exertion-induced cardiac arrest caused by an anomalous right coronary artery. CT coronary angiography with 3D reformatting delineated the interarterial course of an anomalous right coronary artery compressed between the aorta and pulmonary artery, whereas cardiac MRI showed a small myocardial infarction in the right coronary artery territory not detected on echocardiography. This case highlights the value of novel multimodality imaging techniques in the risk stratification and management of patients with resuscitated cardiac arrest.

  7. Hadamard multimode optical imaging transceiver

    DOEpatents

    Cooke, Bradly J; Guenther, David C; Tiee, Joe J; Kellum, Mervyn J; Olivas, Nicholas L; Weisse-Bernstein, Nina R; Judd, Stephen L; Braun, Thomas R

    2012-10-30

    Disclosed is a method and system for simultaneously acquiring and producing results for multiple image modes using a common sensor without optical filtering, scanning, or other moving parts. The system and method utilize the Walsh-Hadamard correlation detection process (e.g., functions/matrix) to provide an all-binary structure that permits seamless bridging between analog and digital domains. An embodiment may capture an incoming optical signal at an optical aperture, convert the optical signal to an electrical signal, pass the electrical signal through a Low-Noise Amplifier (LNA) to create an LNA signal, pass the LNA signal through one or more correlators where each correlator has a corresponding Walsh-Hadamard (WH) binary basis function, calculate a correlation output coefficient for each correlator as a function of the corresponding WH binary basis function in accordance with Walsh-Hadamard mathematical principles, digitize each of the correlation output coefficient by passing each correlation output coefficient through an Analog-to-Digital Converter (ADC), and performing image mode processing on the digitized correlation output coefficients as desired to produce one or more image modes. Some, but not all, potential image modes include: multi-channel access, temporal, range, three-dimensional, and synthetic aperture.

  8. Multimode-Optical-Fiber Imaging Probe

    NASA Technical Reports Server (NTRS)

    Jackson, Deborah

    2000-01-01

    Currently, endoscopic surgery uses single-mode fiber-bundles to obtain in vivo image information inside orifices of the body. This limits their use to the larger natural bodily orifices and to surgical procedures where there is plenty of room for manipulation. The knee joint, for example can be easily viewed with a fiber optic viewer, but joints in the finger cannot. However, there are a host of smaller orifices where fiber endoscopy would play an important role if a cost effective fiber probe were developed with small enough dimensions (< 250 microns). Examples of beneficiaries of micro-endoscopes are the treatment of the Eustatian tube of the middle ear, the breast ducts, tear ducts, coronary arteries, fallopian tubes, as well as the treatment of salivary duct parotid disease, and the neuro endoscopy of the ventricles and spinal canal. To solve this problem, this work describes an approach for recovering images from. tightly confined spaces using multimode fibers and analytically demonstrates that the concept is sound. The proof of concept draws upon earlier works that concentrated on image recovery after two-way transmission through a multimode fiber as well as work that demonstrated the recovery of images after one-way transmission through a multimode fiber. Both relied on generating a phase conjugated wavefront which was predistorted with the characteristics of the fiber. The described approach also relies on generating a phase conjugated wavefront, but utilizes two fibers to capture the image at some intermediate point (accessible by the fibers, but which is otherwise visually unaccessible).

  9. Multimode-Optical-Fiber Imaging Probe

    NASA Technical Reports Server (NTRS)

    Jackson, Deborah

    2000-01-01

    Currently, endoscopic surgery uses single-mode fiber-bundles to obtain in vivo image information inside orifices of the body. This limits their use to the larger natural bodily orifices and to surgical procedures where there is plenty of room for manipulation. The knee joint, for example can be easily viewed with a fiber optic viewer, but joints in the finger cannot. However, there are a host of smaller orifices where fiber endoscopy would play an important role if a cost effective fiber probe were developed with small enough dimensions (< 250 microns). Examples of beneficiaries of micro-endoscopes are the treatment of the Eustatian tube of the middle ear, the breast ducts, tear ducts, coronary arteries, fallopian tubes, as well as the treatment of salivary duct parotid disease, and the neuro endoscopy of the ventricles and spinal canal. To solve this problem, this work describes an approach for recovering images from. tightly confined spaces using multimode fibers and analytically demonstrates that the concept is sound. The proof of concept draws upon earlier works that concentrated on image recovery after two-way transmission through a multimode fiber as well as work that demonstrated the recovery of images after one-way transmission through a multimode fiber. Both relied on generating a phase conjugated wavefront which was predistorted with the characteristics of the fiber. The described approach also relies on generating a phase conjugated wavefront, but utilizes two fibers to capture the image at some intermediate point (accessible by the fibers, but which is otherwise visually unaccessible).

  10. Prospective Evaluation of Multimodal Optical Imaging with Automated Image Analysis to Detect Oral Neoplasia In Vivo.

    PubMed

    Quang, Timothy; Tran, Emily Q; Schwarz, Richard A; Williams, Michelle D; Vigneswaran, Nadarajah; Gillenwater, Ann M; Richards-Kortum, Rebecca

    2017-10-01

    The 5-year survival rate for patients with oral cancer remains low, in part because diagnosis often occurs at a late stage. Early and accurate identification of oral high-grade dysplasia and cancer can help improve patient outcomes. Multimodal optical imaging is an adjunctive diagnostic technique in which autofluorescence imaging is used to identify high-risk regions within the oral cavity, followed by high-resolution microendoscopy to confirm or rule out the presence of neoplasia. Multimodal optical images were obtained from 206 sites in 100 patients. Histologic diagnosis, either from a punch biopsy or an excised surgical specimen, was used as the gold standard for all sites. Histopathologic diagnoses of moderate dysplasia or worse were considered neoplastic. Images from 92 sites in the first 30 patients were used as a training set to develop automated image analysis methods for identification of neoplasia. Diagnostic performance was evaluated prospectively using images from 114 sites in the remaining 70 patients as a test set. In the training set, multimodal optical imaging with automated image analysis correctly classified 95% of nonneoplastic sites and 94% of neoplastic sites. Among the 56 sites in the test set that were biopsied, multimodal optical imaging correctly classified 100% of nonneoplastic sites and 85% of neoplastic sites. Among the 58 sites in the test set that corresponded to a surgical specimen, multimodal imaging correctly classified 100% of nonneoplastic sites and 61% of neoplastic sites. These findings support the potential of multimodal optical imaging to aid in the early detection of oral cancer. Cancer Prev Res; 10(10); 563-70. ©2017 AACR. ©2017 American Association for Cancer Research.

  11. Image registration techniques for multimodal sensors

    NASA Astrophysics Data System (ADS)

    Altinalev, Tevfik; Cetin, Enis A.; Yardimci, Yasemin C.

    2002-08-01

    Image registration refers to the problem of spatially aligning two or more images. A challenging problem in this area is the registration of images obtained by different types of sensors. In general such images have different gray level characteristics and commonly used techniques such as those based on area correlations cannot be applied directly. On the other hand, contours representing the region boundaries are preserved in most cases. Therefore, contour based registration techniques are applicable to multimodal sensors. In this paper, various registration techniques based on subband decomposition and projection along x and y directions are introduced. The effect of binarization is investigated. Unknown translation and scaling parameters are computed using cross-correlation methods over the projections. Performance of the algorithms is compared.

  12. Normalized entropy measure for multimodality image alignment

    NASA Astrophysics Data System (ADS)

    Studholme, Colin; Hawkes, David J.; Hill, Derek L.

    1998-06-01

    Automated multi-modality 3D medical image alignment has been an active area of research for many years. There have been a number of recent papers proposing and investigating the use of entropy derived measures of brain image alignment. Any registration measure must allow us to choose between transformation estimates based on the similarity of images within their volume of overlap. Since 3D medical images often have a limited extent and overlap, the similarity measure for the two transformation estimates may be derived from two very different regions within the images. Direct measures of information such as the joint entropy and mutual information will therefore be a function of, not only image similarity in the region of overlap, but also of the local image content within the overlap. In this paper we present a new measure, normalized mutual information, which is simply the ratio of the sum of the marginal entropies and the joint entropy. The effect of changing overlap on current entropy measures and this normalized measure are compared using a simple image model and experiments on clinical MR-PET and MR-CT image data. Results indicate that the normalized entropy measure provides significantly improved behavior over a range of imaged fields of view.

  13. Fluorescence Imaging Topography Scanning System for intraoperative multimodal imaging

    PubMed Central

    Quang, Tri T.; Kim, Hye-Yeong; Bao, Forrest Sheng; Papay, Francis A.; Edwards, W. Barry; Liu, Yang

    2017-01-01

    Fluorescence imaging is a powerful technique with diverse applications in intraoperative settings. Visualization of three dimensional (3D) structures and depth assessment of lesions, however, are oftentimes limited in planar fluorescence imaging systems. In this study, a novel Fluorescence Imaging Topography Scanning (FITS) system has been developed, which offers color reflectance imaging, fluorescence imaging and surface topography scanning capabilities. The system is compact and portable, and thus suitable for deployment in the operating room without disturbing the surgical flow. For system performance, parameters including near infrared fluorescence detection limit, contrast transfer functions and topography depth resolution were characterized. The developed system was tested in chicken tissues ex vivo with simulated tumors for intraoperative imaging. We subsequently conducted in vivo multimodal imaging of sentinel lymph nodes in mice using FITS and PET/CT. The PET/CT/optical multimodal images were co-registered and conveniently presented to users to guide surgeries. Our results show that the developed system can facilitate multimodal intraoperative imaging. PMID:28437441

  14. Multi-modality molecular imaging for gastric cancer research

    NASA Astrophysics Data System (ADS)

    Liang, Jimin; Chen, Xueli; Liu, Junting; Hu, Hao; Qu, Xiaochao; Wang, Fu; Nie, Yongzhan

    2011-12-01

    Because of the ability of integrating the strengths of different modalities and providing fully integrated information, multi-modality molecular imaging techniques provide an excellent solution to detecting and diagnosing earlier cancer, which remains difficult to achieve by using the existing techniques. In this paper, we present an overview of our research efforts on the development of the optical imaging-centric multi-modality molecular imaging platform, including the development of the imaging system, reconstruction algorithms and preclinical biomedical applications. Primary biomedical results show that the developed optical imaging-centric multi-modality molecular imaging platform may provide great potential in the preclinical biomedical applications and future clinical translation.

  15. Multimodal imaging system for dental caries detection

    NASA Astrophysics Data System (ADS)

    Liang, Rongguang; Wong, Victor; Marcus, Michael; Burns, Peter; McLaughlin, Paul

    2007-02-01

    Dental caries is a disease in which minerals of the tooth are dissolved by surrounding bacterial plaques. A caries process present for some time may result in a caries lesion. However, if it is detected early enough, the dentist and dental professionals can implement measures to reverse and control caries. Several optical, nonionized methods have been investigated and used to detect dental caries in early stages. However, there is not a method that can singly detect the caries process with both high sensitivity and high specificity. In this paper, we present a multimodal imaging system that combines visible reflectance, fluorescence, and Optical Coherence Tomography (OCT) imaging. This imaging system is designed to obtain one or more two-dimensional images of the tooth (reflectance and fluorescence images) and a three-dimensional OCT image providing depth and size information of the caries. The combination of two- and three-dimensional images of the tooth has the potential for highly sensitive and specific detection of dental caries.

  16. Towards a compact fiber laser for multimodal imaging

    NASA Astrophysics Data System (ADS)

    Nie, Bai; Saytashev, Ilyas; Dantus, Marcos

    2014-03-01

    We report on multimodal depth-resolved imaging of unstained living Drosophila Melanogaster larva using sub-50 fs pulses centered at 1060 nm wavelength. Both second harmonic and third harmonic generation imaging modalities are demonstrated.

  17. Manifold learning based registration algorithms applied to multimodal images.

    PubMed

    Azampour, Mohammad Farid; Ghaffari, Aboozar; Hamidinekoo, Azam; Fatemizadeh, Emad

    2014-01-01

    Manifold learning algorithms are proposed to be used in image processing based on their ability in preserving data structures while reducing the dimension and the exposure of data structure in lower dimension. Multi-modal images have the same structure and can be registered together as monomodal images if only structural information is shown. As a result, manifold learning is able to transform multi-modal images to mono-modal ones and subsequently do the registration using mono-modal methods. Based on this application, in this paper novel similarity measures are proposed for multi-modal images in which Laplacian eigenmaps are employed as manifold learning algorithm and are tested against rigid registration of PET/MR images. Results show the feasibility of using manifold learning as a way of calculating the similarity between multimodal images.

  18. Multimodality molecular imaging--from target description to clinical studies.

    PubMed

    Schober, O; Rahbar, K; Riemann, B

    2009-02-01

    This highlight lecture was presented at the closing session of the Annual Congress of the European Association of Nuclear Medicine (EANM) in Munich on 15 October 2008. The Congress was a great success: there were more than 4,000 participants, and 1,597 abstracts were submitted. Of these, 1,387 were accepted for oral or poster presentation, with a rejection rate of 14%. In this article a choice was made from 100 of the 500 lectures which received the highest scores by the scientific review panel. This article outlines the major findings and trends at the EANM 2008, and is only a brief summary of the large number of outstanding abstracts presented. Among the great number of oral and poster presentations covering nearly all fields of nuclear medicine some headlines have to be defined highlighting the development of nuclear medicine in the 21st century. This review focuses on the increasing impact of molecular and multimodality imaging in the field of nuclear medicine. In addition, the question may be asked as to whether the whole spectrum of nuclear medicine is nothing other than molecular imaging and therapy. Furthermore, molecular imaging will and has to go ahead to multimodality imaging. In view of this background the review was structured according to the single steps of molecular imaging, i.e. from target description to clinical studies. The following topics are addressed: targets, radiochemistry and radiopharmacy, devices and computer science, animals and preclinical evaluations, and patients and clinical evaluations.

  19. Hypoxemia and Right-to-Left-Shunt in Patient with Antiphospholipid Syndrome: A Case Report with Multimodality Imaging Findings and Literature Review.

    PubMed

    Bin Saeedan, Mnahi; Alrujaib, Mashael; Fathala, Ahmed L

    2016-01-01

    This is a case report of an extremely rare cause of superior vena cava syndrome with systemic-to-pulmonary venous shunts, illustrated using different imaging modalities with successful SVC and IVC dilatation and stenting.

  20. Expanding Perspectives for Comprehending Visual Images in Multimodal Texts

    ERIC Educational Resources Information Center

    Serafini, Frank

    2011-01-01

    The texts that adolescents encounter today are often multimodal, meaning they incorporate a variety of modes, including visual images, hypertext, and graphic design elements along with written text. Expanding the perspectives readers use to make sense of the multimodal texts is an important aspect of comprehension instruction. Moving beyond the…

  1. Expanding Perspectives for Comprehending Visual Images in Multimodal Texts

    ERIC Educational Resources Information Center

    Serafini, Frank

    2011-01-01

    The texts that adolescents encounter today are often multimodal, meaning they incorporate a variety of modes, including visual images, hypertext, and graphic design elements along with written text. Expanding the perspectives readers use to make sense of the multimodal texts is an important aspect of comprehension instruction. Moving beyond the…

  2. In vivo multimodal nonlinear optical imaging of mucosal tissue

    NASA Astrophysics Data System (ADS)

    Sun, Ju; Shilagard, Tuya; Bell, Brent; Motamedi, Massoud; Vargas, Gracie

    2004-05-01

    We present a multimodal nonlinear imaging approach to elucidate microstructures and spectroscopic features of oral mucosa and submucosa in vivo. The hamster buccal pouch was imaged using 3-D high resolution multiphoton and second harmonic generation microscopy. The multimodal imaging approach enables colocalization and differentiation of prominent known spectroscopic and structural features such as keratin, epithelial cells, and submucosal collagen at various depths in tissue. Visualization of cellular morphology and epithelial thickness are in excellent agreement with histological observations. These results suggest that multimodal nonlinear optical microscopy can be an effective tool for studying the physiology and pathology of mucosal tissue.

  3. Quantitative multimodal multiparametric imaging in Alzheimer's disease.

    PubMed

    Zhao, Qian; Chen, Xueqi; Zhou, Yun

    2016-03-01

    Alzheimer's disease (AD) is a progressive neurodegenerative disorder, causing changes in memory, thinking, and other dysfunction of brain functions. More and more people are suffering from the disease. Early neuroimaging techniques of AD are needed to develop. This review provides a preliminary summary of the various neuroimaging techniques that have been explored for in vivo imaging of AD. Recent advances in magnetic resonance (MR) techniques, such as functional MR imaging (fMRI) and diffusion MRI, give opportunities to display not only anatomy and atrophy of the medial temporal lobe, but also at microstructural alterations or perfusion disturbance within the AD lesions. Positron emission tomography (PET) imaging has become the subject of intense research for the diagnosis and facilitation of drug development of AD in both animal models and human trials due to its non-invasive and translational characteristic. Fluorodeoxyglucose (FDG) PET and amyloid PET are applied in clinics and research departments. Amyloid beta (Aβ) imaging using PET has been recognized as one of the most important methods for the early diagnosis of AD, and numerous candidate compounds have been tested for Aβ imaging. Besides in vivo imaging method, a lot of ex vivo modalities are being used in the AD researches. Multiphoton laser scanning microscopy, neuroimaging of metals, and several metal bioimaging methods are also mentioned here. More and more multimodality and multiparametric neuroimaging techniques should improve our understanding of brain function and open new insights into the pathophysiology of AD. We expect exciting results will emerge from new neuroimaging applications that will provide scientific and medical benefits.

  4. Multimodal CT in stroke imaging: new concepts.

    PubMed

    Ledezma, Carlos J; Wintermark, Max

    2009-01-01

    A multimodal CT protocol provides a comprehensive noninvasive survey of acute stroke patients with accurate demonstration of the site of arterial occlusion and its hemodynamic tissue status. It combines widespread availability with the ability to provide functional characterization of cerebral ischemia, and could potentially allow more accurate selection of candidates for acute stroke reperfusion therapy. This article discusses the individual components of multimodal CT and addresses the potential role of a combined multimodal CT stroke protocol in acute stroke therapy.

  5. Three-dimensional multimodal image-guidance for neurosurgery

    SciTech Connect

    Peters, T.; Munger, P.; Comeau, R.; Evans, A.; Olivier, A.; Davey, B.

    1996-04-01

    The authors address the use of multimodality imaging as an aid to the planning and guidance of neurosurgical procedures, and discuss the integration of anatomical (CT and MRI), vascular (DSA), and functional (PET) data for presentation to the surgeon during surgery. The workstation is an enhancement of a commercially available system, and in addition to the guidance offered via a hand-held probe, it incorporates the use of multimodality imaging and adds enhanced realism to the surgeon through the use of a stereoscopic three-dimensional (3-D) image display. The probe may be visualized stereoscopically in single or multimodality images. The integration of multimodality data in this manner provides the surgeon with a complete overview of brain structures on which he is performing surgery, or through which he is passing probes or cannulas, enabling him to avoid critical vessels and/or structures of functional significance.

  6. Stereoscopic Integrated Imaging Goggles for Multimodal Intraoperative Image Guidance.

    PubMed

    Mela, Christopher A; Patterson, Carrie; Thompson, William K; Papay, Francis; Liu, Yang

    2015-01-01

    We have developed novel stereoscopic wearable multimodal intraoperative imaging and display systems entitled Integrated Imaging Goggles for guiding surgeries. The prototype systems offer real time stereoscopic fluorescence imaging and color reflectance imaging capacity, along with in vivo handheld microscopy and ultrasound imaging. With the Integrated Imaging Goggle, both wide-field fluorescence imaging and in vivo microscopy are provided. The real time ultrasound images can also be presented in the goggle display. Furthermore, real time goggle-to-goggle stereoscopic video sharing is demonstrated, which can greatly facilitate telemedicine. In this paper, the prototype systems are described, characterized and tested in surgeries in biological tissues ex vivo. We have found that the system can detect fluorescent targets with as low as 60 nM indocyanine green and can resolve structures down to 0.25 mm with large FOV stereoscopic imaging. The system has successfully guided simulated cancer surgeries in chicken. The Integrated Imaging Goggle is novel in 4 aspects: it is (a) the first wearable stereoscopic wide-field intraoperative fluorescence imaging and display system, (b) the first wearable system offering both large FOV and microscopic imaging simultaneously, (c) the first wearable system that offers both ultrasound imaging and fluorescence imaging capacities, and (d) the first demonstration of goggle-to-goggle communication to share stereoscopic views for medical guidance.

  7. Multimodality Image Fusion-Guided Procedures: Technique, Accuracy, and Applications

    SciTech Connect

    Abi-Jaoudeh, Nadine; Kruecker, Jochen; Kadoury, Samuel; Kobeiter, Hicham; Venkatesan, Aradhana M. Levy, Elliot Wood, Bradford J.

    2012-10-15

    Personalized therapies play an increasingly critical role in cancer care: Image guidance with multimodality image fusion facilitates the targeting of specific tissue for tissue characterization and plays a role in drug discovery and optimization of tailored therapies. Positron-emission tomography (PET), magnetic resonance imaging (MRI), and contrast-enhanced computed tomography (CT) may offer additional information not otherwise available to the operator during minimally invasive image-guided procedures, such as biopsy and ablation. With use of multimodality image fusion for image-guided interventions, navigation with advanced modalities does not require the physical presence of the PET, MRI, or CT imaging system. Several commercially available methods of image-fusion and device navigation are reviewed along with an explanation of common tracking hardware and software. An overview of current clinical applications for multimodality navigation is provided.

  8. [Multimodal medical image registration using cubic spline interpolation method].

    PubMed

    He, Yuanlie; Tian, Lianfang; Chen, Ping; Wang, Lifei; Ye, Guangchun; Mao, Zongyuan

    2007-12-01

    Based on the characteristic of the PET-CT multimodal image series, a novel image registration and fusion method is proposed, in which the cubic spline interpolation method is applied to realize the interpolation of PET-CT image series, then registration is carried out by using mutual information algorithm and finally the improved principal component analysis method is used for the fusion of PET-CT multimodal images to enhance the visual effect of PET image, thus satisfied registration and fusion results are obtained. The cubic spline interpolation method is used for reconstruction to restore the missed information between image slices, which can compensate for the shortage of previous registration methods, improve the accuracy of the registration, and make the fused multimodal images more similar to the real image. Finally, the cubic spline interpolation method has been successfully applied in developing 3D-CRT (3D Conformal Radiation Therapy) system.

  9. Clinical and multimodal biomarker correlates of ADNI neuropathological findings

    PubMed Central

    2013-01-01

    Background Autopsy series commonly report a high percentage of coincident pathologies in demented patients, including patients with a clinical diagnosis of dementia of the Alzheimer type (DAT). However many clinical and biomarker studies report cases with a single neurodegenerative disease. We examined multimodal biomarker correlates of the consecutive series of the first 22 Alzheimer’s Disease Neuroimaging Initiative autopsies. Clinical data, neuropsychological measures, cerebrospinal fluid Aβ, total and phosphorylated tau and α-synuclein and MRI and FDG-PET scans. Results Clinical diagnosis was either probable DAT or Alzheimer’s disease (AD)-type mild cognitive impairment (MCI) at last evaluation prior to death. All patients had a pathological diagnosis of AD, but only four had pure AD. A coincident pathological diagnosis of dementia with Lewy bodies (DLB), medial temporal lobe pathology (TDP-43 proteinopathy, argyrophilic grain disease and hippocampal sclerosis), referred to collectively here as MTL, and vascular pathology were present in 45.5%, 40.0% and 22.7% of these patients, respectively. Hallucinations were a strong predictor of coincident DLB (100% specificity) and a more severe dysexecutive profile was also a useful predictor of coincident DLB (80.0% sensitivity and 83.3% specificity). Occipital FDG-PET hypometabolism accurately classified coincident DLB (80% sensitivity and 100% specificity). Subjects with coincident MTL showed lower hippocampal volume. Conclusions Biomarkers can be used to independently predict coincident AD and DLB pathology, a common finding in amnestic MCI and DAT patients. Cohorts with comprehensive neuropathological assessments and multimodal biomarkers are needed to characterize independent predictors for the different neuropathological substrates of cognitive impairment. PMID:24252435

  10. Multimodal imaging of white and dark without pressure fundus lesions.

    PubMed

    Fawzi, Amani A; Nielsen, Jared S; Mateo-Montoya, Aranzazu; Somkijrungroj, Thanapong; Li, Helen K; Gonzales, John; Mauget-Faÿsse, Martine; Jampol, Lee M

    2014-12-01

    To describe multimodal imaging findings in patients with dark or white without pressure lesions of the fundus. Retrospective observational case series of 10 patients with white or dark without pressure lesions. We analyzed multimodal imaging using spectral domain optical coherence tomography, color and near-infrared fundus photography, and fundus autofluorescence imaging to explore the findings associated with these lesions. All patients had geographic dark or white lesions on clinical examination and color photography, which were either hyporeflective or hyperreflective on near-infrared reflectance imaging, respectively. On optical coherence tomography, these lesions correlated with an abrupt change of the photoreceptor reflectivity, with relative hyporeflectivity of photoreceptor zones (ellipsoid and interdigitation zones, as well as outer segments) within the dark, and relative hyperreflectivity within white lesions. Ten patients underwent fundus autofluorescence, which showed well-defined zones of relative hypo-autofluorescence within the lesion, compared with neighboring uninvolved regions, whether dark or white without pressure. In two patients who had a lesion combining white and dark without pressure, we observed the transition in photoreceptor reflectivity from the dark lesion (hyporeflective) to the white lesion (hyperreflective), relative to the surrounding retina. Both white and dark without pressure lesions are associated with changes in outer retinal reflectivity on optical coherence tomography, which occur in opposite directions compared with the surrounding unaffected areas. In the face of normal visual field testing to date, the clinical significance of this finding remains uncertain. Recognition of the optical coherence tomography appearance will help clinicians avoid unnecessary workup of these patients for outer retinal dystrophy or degeneration.

  11. Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan.

    PubMed

    Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

    2016-12-20

    The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of "precision medicine", "fusion imaging", "multimodality", and "tumor diagnosis and treatment". Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice.

  12. Mono- and multimodal registration of optical breast images

    NASA Astrophysics Data System (ADS)

    Pearlman, Paul C.; Adams, Arthur; Elias, Sjoerd G.; Mali, Willem P. Th. M.; Viergever, Max A.; Pluim, Josien P. W.

    2012-08-01

    Optical breast imaging offers the possibility of noninvasive, low cost, and high sensitivity imaging of breast cancers. Poor spatial resolution and a lack of anatomical landmarks in optical images of the breast make interpretation difficult and motivate registration and fusion of these data with subsequent optical images and other breast imaging modalities. Methods used for registration and fusion of optical breast images are reviewed. Imaging concerns relevant to the registration problem are first highlighted, followed by a focus on both monomodal and multimodal registration of optical breast imaging. Where relevant, methods pertaining to other imaging modalities or imaged anatomies are presented. The multimodal registration discussion concerns digital x-ray mammography, ultrasound, magnetic resonance imaging, and positron emission tomography.

  13. Multimodal imaging in a case of deferoxamine induced maculopathy

    PubMed Central

    Gelman, Rony; Kiss, Szilard; Tsang, Stephen H.

    2014-01-01

    Purpose To report a case of deferoxomine induced maculopathy and present the use of multimodal retinal imaging to study this disease entity. Methods Observational case report of one patient. Multimodal imaging with fundus autofluorescence (FAF), infrared imaging (IR), and spectral-domain optical coherence tomography (SD-OCT) was used to investigate the macular changes induced by deferoxamine toxicity. Results A 53 year-old male with a history of beta-thalassemia presented with decreased vision in both eyes one month after initiating deferoxamine therapy. IR imaging showed areas of increased stippled infrared intensity through the macula. FAF revealed diffuse areas of stippled hyperautofluorescence and hypoautofluorescence. SD-OCT changes included disruption of the ellipsoid zone, attenuation of the photoreceptors, and deposits within the retinal pigment epithelium. Conclusions We describe a case of deferoxomine induced maculopathy and present the use of multimodal retinal imaging to study this disease entity. PMID:25372534

  14. Multifunctional nanostructured materials for multimodal cancer imaging and therapy.

    PubMed

    Liao, Jinfeng; Qi, Tingting; Chu, Bingyang; Peng, Jinrong; Luo, Feng; Qian, Zhiyong

    2014-01-01

    This paper reviews the recent research and development of multifunctional nanostructured materials for multimodal imaging and therapy. The biomedical applications for multifunctional imaging, diagnosis and therapy are discussed for several nanostructured materials such as polymeric nanoparticles, magnetic nanoparticles, gold nanomaterials, carbon materials, quantum dots and silica nanoparticles. Due to the unique features of nanostructured materials including the large surface area, structural diversity, multifunctionality, and long circulation time in blood, these materials have emerged as attractive preferences for optimized therapy. Multimodal imaging can be introduced to nanostructured materials for precise and fast diagnosis of cancer, which overcomes the shortcoming of single-imaging modality. Meanwhile, nanostructured materials can be also used to deliver therapeutic agents to the disease site in order to accomplish multimodal imaging and simultaneous diagnosis and therapy.

  15. Recent Advances in Higher-Order, Multimodal, Biomedical Imaging Agents.

    PubMed

    Rieffel, James; Chitgupi, Upendra; Lovell, Jonathan F

    2015-09-16

    Advances in biomedical imaging have spurred the development of integrated multimodal scanners, usually capable of two simultaneous imaging modes. The long-term vision of higher-order multimodality is to improve diagnostics or guidance through the analysis of complementary, data-rich, co-registered images. Synergies achieved through combined modalities could enable researchers to better track diverse physiological and structural events, analyze biodistribution and treatment efficacy, and compare established and emerging modalities. Higher-order multimodal approaches stand to benefit from molecular imaging probes and, in recent years, contrast agents that have hypermodal characteristics have increasingly been reported in preclinical studies. Given the chemical requirements for contrast agents representing various modalities to be integrated into a single entity, the higher-order multimodal agents reported so far tend to be of nanoparticulate form. To date, the majority of reported nanoparticles have included components that are active for magnetic resonance. Herein, recent progress in higher-order multimodal imaging agents is reviewed, spanning a range of material and structural classes, and demonstrating utility in three (or more) imaging modalities.

  16. Exploiting Multimodal Context in Image Retrieval.

    ERIC Educational Resources Information Center

    Srihari, Rohini K.; Zhang, Zhongfei

    1999-01-01

    Finding information on the Web without encountering numerous false positives poses a challenge to multimedia information retrieval systems (MMIR). This research focuses on improving precision and recall in an MMIR system by interactively combining text processing with image processing in both the indexing and retrieval phases. A picture search…

  17. Multimodality imaging of renal inflammatory lesions

    PubMed Central

    Das, Chandan J; Ahmad, Zohra; Sharma, Sanjay; Gupta, Arun K

    2014-01-01

    Spectrum of acute renal infections includes acute pyelonephritis, renal and perirenal abscesses, pyonephrosis, emphysematous pyelonephritis and emphysematous cystitis. The chronic renal infections that we routinely encounter encompass chronic pyelonephritis, xanthogranulomatous pyelonephritis, and eosinophilic cystitis. Patients with diabetes, malignancy and leukaemia are frequently immunocompromised and more prone to fungal infections viz. angioinvasive aspergillus, candida and mucor. Tuberculosis and parasitic infestation of the kidney is common in tropical countries. Imaging is not routinely indicated in uncomplicated renal infections as clinical findings and laboratory data are generally sufficient for making a diagnosis. However, imaging plays a crucial role under specific situations like immunocompromised patients, treatment non-responders, equivocal clinical diagnosis, congenital anomaly evaluation, transplant imaging and for evaluating extent of disease. We aim to review in this article the varied imaging spectrum of renal inflammatory lesions. PMID:25431641

  18. Multimodality imaging of renal inflammatory lesions.

    PubMed

    Das, Chandan J; Ahmad, Zohra; Sharma, Sanjay; Gupta, Arun K

    2014-11-28

    Spectrum of acute renal infections includes acute pyelonephritis, renal and perirenal abscesses, pyonephrosis, emphysematous pyelonephritis and emphysematous cystitis. The chronic renal infections that we routinely encounter encompass chronic pyelonephritis, xanthogranulomatous pyelonephritis, and eosinophilic cystitis. Patients with diabetes, malignancy and leukaemia are frequently immunocompromised and more prone to fungal infections viz. angioinvasive aspergillus, candida and mucor. Tuberculosis and parasitic infestation of the kidney is common in tropical countries. Imaging is not routinely indicated in uncomplicated renal infections as clinical findings and laboratory data are generally sufficient for making a diagnosis. However, imaging plays a crucial role under specific situations like immunocompromised patients, treatment non-responders, equivocal clinical diagnosis, congenital anomaly evaluation, transplant imaging and for evaluating extent of disease. We aim to review in this article the varied imaging spectrum of renal inflammatory lesions.

  19. Sound effects: Multimodal input helps infants find displaced objects.

    PubMed

    Shinskey, Jeanne L

    2017-09-01

    Before 9 months, infants use sound to retrieve a stationary object hidden by darkness but not one hidden by occlusion, suggesting auditory input is more salient in the absence of visual input. This article addresses how audiovisual input affects 10-month-olds' search for displaced objects. In AB tasks, infants who previously retrieved an object at A subsequently fail to find it after it is displaced to B, especially following a delay between hiding and retrieval. Experiment 1 manipulated auditory input by keeping the hidden object audible versus silent, and visual input by presenting the delay in the light versus dark. Infants succeeded more at B with audible than silent objects and, unexpectedly, more after delays in the light than dark. Experiment 2 presented both the delay and search phases in darkness. The unexpected light-dark difference disappeared. Across experiments, the presence of auditory input helped infants find displaced objects, whereas the absence of visual input did not. Sound might help by strengthening object representation, reducing memory load, or focusing attention. This work provides new evidence on when bimodal input aids object processing, corroborates claims that audiovisual processing improves over the first year of life, and contributes to multisensory approaches to studying cognition. Statement of contribution What is already known on this subject Before 9 months, infants use sound to retrieve a stationary object hidden by darkness but not one hidden by occlusion. This suggests they find auditory input more salient in the absence of visual input in simple search tasks. After 9 months, infants' object processing appears more sensitive to multimodal (e.g., audiovisual) input. What does this study add? This study tested how audiovisual input affects 10-month-olds' search for an object displaced in an AB task. Sound helped infants find displaced objects in both the presence and absence of visual input. Object processing becomes more

  20. A simultaneous multimodal imaging system for tissue functional parameters

    NASA Astrophysics Data System (ADS)

    Ren, Wenqi; Zhang, Zhiwu; Wu, Qiang; Zhang, Shiwu; Xu, Ronald

    2014-02-01

    Simultaneous and quantitative assessment of skin functional characteristics in different modalities will facilitate diagnosis and therapy in many clinical applications such as wound healing. However, many existing clinical practices and multimodal imaging systems are subjective, qualitative, sequential for multimodal data collection, and need co-registration between different modalities. To overcome these limitations, we developed a multimodal imaging system for quantitative, non-invasive, and simultaneous imaging of cutaneous tissue oxygenation and blood perfusion parameters. The imaging system integrated multispectral and laser speckle imaging technologies into one experimental setup. A Labview interface was developed for equipment control, synchronization, and image acquisition. Advanced algorithms based on a wide gap second derivative reflectometry and laser speckle contrast analysis (LASCA) were developed for accurate reconstruction of tissue oxygenation and blood perfusion respectively. Quantitative calibration experiments and a new style of skinsimulating phantom were designed to verify the accuracy and reliability of the imaging system. The experimental results were compared with a Moor tissue oxygenation and perfusion monitor. For In vivo testing, a post-occlusion reactive hyperemia (PORH) procedure in human subject and an ongoing wound healing monitoring experiment using dorsal skinfold chamber models were conducted to validate the usability of our system for dynamic detection of oxygenation and perfusion parameters. In this study, we have not only setup an advanced multimodal imaging system for cutaneous tissue oxygenation and perfusion parameters but also elucidated its potential for wound healing assessment in clinical practice.

  1. Exostosis Bursata – Multimodality Imaging Approach

    PubMed Central

    Sharma, Praveen; Rege, Rujuta; Seena, CR; Rajesh, Saveetha

    2016-01-01

    Osteochondromas or exostosis are common benign bone tumours, commonly arising from the metaphyseal region of long bones (femur, humerus, tibia). Osteochondroma of the scapula are rare and cause mechanical irritation leading to bursal formation. We hereby report a case of 30-year-old man who presented with painful chest wall swelling and its multimodality approach to establish the diagnosis. PMID:27790547

  2. Multi-modality image registration using the decomposition model

    NASA Astrophysics Data System (ADS)

    Ibrahim, Mazlinda; Chen, Ke

    2017-04-01

    In medical image analysis, image registration is one of the crucial steps required to facilitate automatic segmentation, treatment planning and other application involving imaging machines. Image registration, also known as image matching, aims to align two or more images so that information obtained can be compared and combined. Different imaging modalities and their characteristics make the task more challenging. We propose a decomposition model combining parametric and non-parametric deformation for multi-modality image registration. Numerical results show that the normalised gradient field perform better than the mutual information with the decomposition model.

  3. Multimodality cardiac imaging in Turner syndrome.

    PubMed

    Mortensen, Kristian H; Gopalan, Deepa; Nørgaard, Bjarne L; Andersen, Niels H; Gravholt, Claus H

    2016-06-01

    Congenital and acquired cardiovascular diseases contribute significantly to the threefold elevated risk of premature death in Turner syndrome. A multitude of cardiovascular anomalies and disorders, many of which deleteriously impact morbidity and mortality, is frequently left undetected and untreated because of poor adherence to screening programmes and complex clinical presentations. Imaging is essential for timely and effective primary and secondary disease prophylaxis that may alleviate the severe impact of cardiovascular disease in Turner syndrome. This review illustrates how cardiovascular disease in Turner syndrome manifests in a complex manner that ranges in severity from incidental findings to potentially fatal anomalies. Recommendations regarding the use of imaging for screening and surveillance of cardiovascular disease in Turner syndrome are made, emphasising the key role of non-invasive and invasive cardiovascular imaging to the management of all patients with Turner syndrome.

  4. Discrimination of skin diseases using the multimodal imaging approach

    NASA Astrophysics Data System (ADS)

    Vogler, N.; Heuke, S.; Akimov, D.; Latka, I.; Kluschke, F.; Röwert-Huber, H.-J.; Lademann, J.; Dietzek, B.; Popp, J.

    2012-06-01

    Optical microspectroscopic tools reveal great potential for dermatologic diagnostics in the clinical day-to-day routine. To enhance the diagnostic value of individual nonlinear optical imaging modalities such as coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) or two-photon excited fluorescence (TPF), the approach of multimodal imaging has recently been developed. Here, we present an application of nonlinear optical multimodal imaging with Raman-scattering microscopy to study sizable human-tissue cross-sections. The samples investigated contain both healthy tissue and various skin tumors. This contribution details the rich information content, which can be obtained from the multimodal approach: While CARS microscopy, which - in contrast to spontaneous Raman-scattering microscopy - is not hampered by single-photon excited fluorescence, is used to monitor the lipid and protein distribution in the samples, SHG imaging selectively highlights the distribution of collagen structures within the tissue. This is due to the fact, that SHG is only generated in structures which lack inversion geometry. Finally, TPF reveals the distribution of autofluorophores in tissue. The combination of these techniques, i.e. multimodal imaging, allows for recording chemical images of large area samples and is - as this contribution will highlight - of high clinically diagnostic value.

  5. Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

    NASA Astrophysics Data System (ADS)

    Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

    2016-03-01

    Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

  6. Delineating melanoma using multimodal polarized light imaging.

    PubMed

    Tannous, Zeina; Al-Arashi, Munir; Shah, Sonali; Yaroslavsky, Anna N

    2009-01-01

    Melanoma accounts for 3% of all skin cancers but causes 83% of skin cancer deaths. The first step in treatment of melanoma is the removal of the lesions, usually by surgical excision. Currently most lesions are removed without intraoperative margin control. Post-operative methods inspect 1-2% of the surgical margin and are prone to sampling errors. In this study we evaluate the use of reflectance and fluorescence polarization imaging for the demarcation of melanoma in thick fresh skin excisions. Pigmented lesions clinically suspicious for melanoma were elliptically excised with proper margins. Elliptical surgical excisions were vertically bisected along the short axis of the specimen into two halves in the middle of the pigmented lesions. The vertically bisected tumor face was imaged. After that, one half of the sample was briefly stained in aqueous 2 mg/ml solution of tetracycline, whereas another half was stained in 0.2 mg/ml aqueous solution of methylene blue. Then both specimens were reimaged. Reflectance images were acquired in the spectral range between 390 and 750 nm. Fluorescence images of the tetracycline-stained tissue were excited at 390 nm and registered between 450 and 700 nm. Fluorescence of the methylene blue-stained samples was excited at 630 nm and registered between 650 and 750 nm. After imaging, the tissue was processed for standard H&E histopathology. The resulting histological and optical images were compared to each other. Our findings demonstrate that both tetracycline and methylene blue are suitable for imaging dysplastic and benign nevi. Melanoma is better delineated in the samples stained in methylene blue. Accurate and rapid delineation of melanoma in standard fresh surgical excisions appears feasible.

  7. MULTIMODALITY IMAGING: BEYOND PET/CT AND SPECT/CT

    PubMed Central

    Cherry, Simon R.

    2009-01-01

    Multimodality imaging with PET/CT and SPECT/CT has become commonplace in clinical practice and in preclinical and basic medical research. Do other combinations of imaging modalities have a similar potential to impact medical science and clinical medicine? The combination of PET or SPECT with MRI is an area of active research at the present time, while other, perhaps less obvious combinations, including CT/MR and PET/optical also are being studied. In addition to the integration of the instrumentation, there are parallel developments in synthesizing imaging agents that can be viewed by multiple imaging modalities. Is the fusion of PET and SPECT with CT the ultimate answer in multimodality imaging, or is it just the first example of a more general trend towards harnessing the complementary nature of the different modalities on integrated imaging platforms? PMID:19646559

  8. Integration of multimodality images: success and future directions

    NASA Astrophysics Data System (ADS)

    Chen, Chin-Tu

    1993-07-01

    The concept of multi-modality image integration, in which images obtained from different sensors are co-registered spatially and various aspects of object characteristics revealed by individual imaging techniques are synergistically fused in order to yield new information, has received considerable attention in recent years. The initial success was made in visualizing integrated brain images which show the overlay of physiological information from PET or SPECT with anatomical information from CT or MRI, providing new knowledge of correlates of brain function and brain structure that was difficult to access previously. Extension of this concept to cardiac and pulmonary imaging is still in its infancy. One additional difficulty in dealing with cardiac/pulmonary data sets is the issue of motion. However, some features in periodic motion may offer additional information for the purpose of spatial co-registration. In addition to visualization of the fused image data in 2-D and 3-D, future directions in the arena of image integration from multiple modalities include multi-modal image reconstruction, multi-modal image segmentation and feature extraction, and other image analysis tasks that incorporate information available from multiple sources.

  9. Biofunctionalized Prussian Blue Nanoparticles for Multimodal Molecular Imaging Applications

    PubMed Central

    Vojtech, Jennifer M.; Cano-Mejia, Juliana; Dumont, Matthieu F.; Sze, Raymond W.; Fernandes, Rohan

    2015-01-01

    Multimodal, molecular imaging allows the visualization of biological processes at cellular, subcellular, and molecular-level resolutions using multiple, complementary imaging techniques. These imaging agents facilitate the real-time assessment of pathways and mechanisms in vivo, which enhance both diagnostic and therapeutic efficacy. This article presents the protocol for the synthesis of biofunctionalized Prussian blue nanoparticles (PB NPs) - a novel class of agents for use in multimodal, molecular imaging applications. The imaging modalities incorporated in the nanoparticles, fluorescence imaging and magnetic resonance imaging (MRI), have complementary features. The PB NPs possess a core-shell design where gadolinium and manganese ions incorporated within the interstitial spaces of the PB lattice generate MRI contrast, both in T1 and T2-weighted sequences. The PB NPs are coated with fluorescent avidin using electrostatic self-assembly, which enables fluorescence imaging. The avidin-coated nanoparticles are modified with biotinylated ligands that confer molecular targeting capabilities to the nanoparticles. The stability and toxicity of the nanoparticles are measured, as well as their MRI relaxivities. The multimodal, molecular imaging capabilities of these biofunctionalized PB NPs are then demonstrated by using them for fluorescence imaging and molecular MRI in vitro. PMID:25993028

  10. Multimodal targeted high relaxivity thermosensitive liposome for in vivo imaging

    PubMed Central

    Kuijten, Maayke M. P.; Hannah Degeling, M.; Chen, John W.; Wojtkiewicz, Gregory; Waterman, Peter; Weissleder, Ralph; Azzi, Jamil; Nicolay, Klaas; Tannous, Bakhos A.

    2015-01-01

    Liposomes are spherical, self-closed structures formed by lipid bilayers that can encapsulate drugs and/or imaging agents in their hydrophilic core or within their membrane moiety, making them suitable delivery vehicles. We have synthesized a new liposome containing gadolinium-DOTA lipid bilayer, as a targeting multimodal molecular imaging agent for magnetic resonance and optical imaging. We showed that this liposome has a much higher molar relaxivities r1 and r2 compared to a more conventional liposome containing gadolinium-DTPA-BSA lipid. By incorporating both gadolinium and rhodamine in the lipid bilayer as well as biotin on its surface, we used this agent for multimodal imaging and targeting of tumors through the strong biotin-streptavidin interaction. Since this new liposome is thermosensitive, it can be used for ultrasound-mediated drug delivery at specific sites, such as tumors, and can be guided by magnetic resonance imaging. PMID:26610702

  11. Multi-modal image registration using structural features.

    PubMed

    Kasiri, Keyvan; Clausi, David A; Fieguth, Paul

    2014-01-01

    Multi-modal image registration has been a challenging task in medical images because of the complex intensity relationship between images to be aligned. Registration methods often rely on the statistical intensity relationship between the images which suffers from problems such as statistical insufficiency. The proposed registration method works based on extracting structural features by utilizing the complex phase and gradient-based information. By employing structural relationships between different modalities instead of complex similarity measures, the multi-modal registration problem is converted into a mono-modal one. Therefore, conventional mono-modal similarity measures can be utilized to evaluate the registration results. This new registration paradigm has been tested on magnetic resonance (MR) brain images of different modes. The method has been evaluated based on target registration error (TRE) to determine alignment accuracy. Quantitative results demonstrate that the proposed method is capable of achieving comparable registration accuracy compared to the conventional mutual information.

  12. Multimodal targeted high relaxivity thermosensitive liposome for in vivo imaging

    NASA Astrophysics Data System (ADS)

    Kuijten, Maayke M. P.; Hannah Degeling, M.; Chen, John W.; Wojtkiewicz, Gregory; Waterman, Peter; Weissleder, Ralph; Azzi, Jamil; Nicolay, Klaas; Tannous, Bakhos A.

    2015-11-01

    Liposomes are spherical, self-closed structures formed by lipid bilayers that can encapsulate drugs and/or imaging agents in their hydrophilic core or within their membrane moiety, making them suitable delivery vehicles. We have synthesized a new liposome containing gadolinium-DOTA lipid bilayer, as a targeting multimodal molecular imaging agent for magnetic resonance and optical imaging. We showed that this liposome has a much higher molar relaxivities r1 and r2 compared to a more conventional liposome containing gadolinium-DTPA-BSA lipid. By incorporating both gadolinium and rhodamine in the lipid bilayer as well as biotin on its surface, we used this agent for multimodal imaging and targeting of tumors through the strong biotin-streptavidin interaction. Since this new liposome is thermosensitive, it can be used for ultrasound-mediated drug delivery at specific sites, such as tumors, and can be guided by magnetic resonance imaging.

  13. Multimodal Imaging of Photoreceptor Structure in Choroideremia

    PubMed Central

    Johnson, Ryan D.; Williams, Vesper; Summerfelt, Phyllis; Dubra, Alfredo; Weinberg, David V.; Stepien, Kimberly E.; Fishman, Gerald A.; Carroll, Joseph

    2016-01-01

    Purpose Choroideremia is a progressive X-linked recessive dystrophy, characterized by degeneration of the retinal pigment epithelium (RPE), choroid, choriocapillaris, and photoreceptors. We examined photoreceptor structure in a series of subjects with choroideremia with particular attention to areas bordering atrophic lesions. Methods Twelve males with clinically-diagnosed choroideremia and confirmed hemizygous mutations in the CHM gene were examined. High-resolution images of the retina were obtained using spectral domain optical coherence tomography (SD-OCT) and both confocal and non-confocal split-detector adaptive optics scanning light ophthalmoscope (AOSLO) techniques. Results Eleven CHM gene mutations (3 novel) were identified; three subjects had the same mutation and one subject had two mutations. SD-OCT findings included interdigitation zone (IZ) attenuation or loss in 10/12 subjects, often in areas with intact ellipsoid zones; RPE thinning in all subjects; interlaminar bridges in the imaged areas of 10/12 subjects; and outer retinal tubulations (ORTs) in 10/12 subjects. Only split-detector AOSLO could reliably resolve cones near lesion borders, and such cones were abnormally heterogeneous in morphology, diameter and density. On split-detector imaging, the cone mosaic terminated sharply at lesion borders in 5/5 cases examined. Split-detector imaging detected remnant cone inner segments within ORTs, which were generally contiguous with a central patch of preserved retina. Conclusions Early IZ dropout and RPE thinning on SD-OCT are consistent with previously published results. Evidence of remnant cone inner segments within ORTs and the continuity of the ORTs with preserved retina suggests that these may represent an intermediate state of retinal degeneration prior to complete atrophy. Taken together, these results supports a model of choroideremia in which the RPE degenerates before photoreceptors. PMID:27936069

  14. Multimodal digital color imaging system for facial skin lesion analysis

    NASA Astrophysics Data System (ADS)

    Bae, Youngwoo; Lee, Youn-Heum; Jung, Byungjo

    2008-02-01

    In dermatology, various digital imaging modalities have been used as an important tool to quantitatively evaluate the treatment effect of skin lesions. Cross-polarization color image was used to evaluate skin chromophores (melanin and hemoglobin) information and parallel-polarization image to evaluate skin texture information. In addition, UV-A induced fluorescent image has been widely used to evaluate various skin conditions such as sebum, keratosis, sun damages, and vitiligo. In order to maximize the evaluation efficacy of various skin lesions, it is necessary to integrate various imaging modalities into an imaging system. In this study, we propose a multimodal digital color imaging system, which provides four different digital color images of standard color image, parallel and cross-polarization color image, and UV-A induced fluorescent color image. Herein, we describe the imaging system and present the examples of image analysis. By analyzing the color information and morphological features of facial skin lesions, we are able to comparably and simultaneously evaluate various skin lesions. In conclusion, we are sure that the multimodal color imaging system can be utilized as an important assistant tool in dermatology.

  15. Recent advances in molecular, multimodal and theranostic ultrasound imaging.

    PubMed

    Kiessling, Fabian; Fokong, Stanley; Bzyl, Jessica; Lederle, Wiltrud; Palmowski, Moritz; Lammers, Twan

    2014-06-01

    Ultrasound (US) imaging is an exquisite tool for the non-invasive and real-time diagnosis of many different diseases. In this context, US contrast agents can improve lesion delineation, characterization and therapy response evaluation. US contrast agents are usually micrometer-sized gas bubbles, stabilized with soft or hard shells. By conjugating antibodies to the microbubble (MB) surface, and by incorporating diagnostic agents, drugs or nucleic acids into or onto the MB shell, molecular, multimodal and theranostic MBs can be generated. We here summarize recent advances in molecular, multimodal and theranostic US imaging, and introduce concepts how such advanced MB can be generated, applied and imaged. Examples are given for their use to image and treat oncological, cardiovascular and neurological diseases. Furthermore, we discuss for which therapeutic entities incorporation into (or conjugation to) MB is meaningful, and how US-mediated MB destruction can increase their extravasation, penetration, internalization and efficacy.

  16. Melanoma detection using smartphone and multimode hyperspectral imaging

    NASA Astrophysics Data System (ADS)

    MacKinnon, Nicholas; Vasefi, Fartash; Booth, Nicholas; Farkas, Daniel L.

    2016-04-01

    This project's goal is to determine how to effectively implement a technology continuum from a low cost, remotely deployable imaging device to a more sophisticated multimode imaging system within a standard clinical practice. In this work a smartphone is used in conjunction with an optical attachment to capture cross-polarized and collinear color images of a nevus that are analyzed to quantify chromophore distribution. The nevus is also imaged by a multimode hyperspectral system, our proprietary SkinSpect™ device. Relative accuracy and biological plausibility of the two systems algorithms are compared to assess aspects of feasibility of in-home or primary care practitioner smartphone screening prior to rigorous clinical analysis via the SkinSpect.

  17. Recent Advances in Molecular, Multimodal and Theranostic Ultrasound Imaging

    PubMed Central

    Kiessling, Fabian; Fokong, Stanley; Bzyl, Jessica; Lederle, Wiltrud; Palmowski, Moritz; Lammers, Twan

    2014-01-01

    Ultrasound (US) imaging is an exquisite tool for the non-invasive and real-time diagnosis of many different diseases. In this context, US contrast agents can improve lesion delineation, characterization and therapy response evaluation. US contrast agents are usually micrometer-sized gas bubbles, stabilized with soft or hard shells. By conjugating antibodies to the microbubble (MB) surface, and by incorporating diagnostic agents, drugs or nucleic acids into or onto the MB shell, molecular, multimodal and theranostic MB can be generated. We here summarize recent advances in molecular, multimodal and theranostic US imaging, and introduce concepts how such advanced MB can be generated, applied and imaged. Examples are given for their use to image and treat oncological, cardiovascular and neurological diseases. Furthermore, we discuss for which therapeutic entities incorporation into (or conjugation to) MB is meaningful, and how US-mediated MB destruction can increase their extravasation, penetration, internalization and efficacy. PMID:24316070

  18. Automatic identification of reticular pseudodrusen using multimodal retinal image analysis.

    PubMed

    van Grinsven, Mark J J P; Buitendijk, Gabriëlle H S; Brussee, Corina; van Ginneken, Bram; Hoyng, Carel B; Theelen, Thomas; Klaver, Caroline C W; Sánchez, Clara I

    2015-01-08

    To examine human performance and agreement on reticular pseudodrusen (RPD) detection and quantification by using single- and multimodality grading protocols and to describe and evaluate a machine learning system for the automatic detection and quantification of reticular pseudodrusen by using single- and multimodality information. Color fundus, fundus autofluoresence, and near-infrared images of 278 eyes from 230 patients with or without presence of RPD were used in this study. All eyes were scored for presence of RPD during single- and multimodality setups by two experienced observers and a developed machine learning system. Furthermore, automatic quantification of RPD area was performed by the proposed system and compared with human delineations. Observers obtained a higher performance and better interobserver agreement for RPD detection with multimodality grading, achieving areas under the receiver operating characteristic (ROC) curve of 0.940 and 0.958, and a κ agreement of 0.911. The proposed automatic system achieved an area under the ROC of 0.941 with a multimodality setup. Automatic RPD quantification resulted in an intraclass correlation (ICC) value of 0.704, which was comparable with ICC values obtained between single-modality manual delineations. Observer performance and agreement for RPD identification improved significantly by using a multimodality grading approach. The developed automatic system showed similar performance as observers, and automatic RPD area quantification was in concordance with manual delineations. The proposed automatic system allows for a fast and accurate identification and quantification of RPD, opening the way for efficient quantitative imaging biomarkers in large data set analysis. Copyright 2015 The Association for Research in Vision and Ophthalmology, Inc.

  19. Multimodal images of chronic branch retinal vein occlusion

    PubMed Central

    Schwartz, Stephen G; Monroig, Armando; Flynn, Harry W

    2017-01-01

    Two illustrative cases of chronic branch retinal vein occlusion are presented with multimodal imaging, including commercially available optical coherence tomography angiography. In these two patients, retinal ischemia and collateral vessels were well imaged without the need to use traditional fluorescein angiography. Optical coherence tomography angiography provides useful information for the diagnosis and management of patients with branch retinal vein occlusion and other retinal vascular diseases. PMID:28496373

  20. Sorted self-similarity for multi-modal image registration.

    PubMed

    Kasiri, Keyvan; Fieguth, Paul; Clausi, David A

    2016-08-01

    In medical image analysis, registration of multimodal images has been challenging due to the complex intensity relationship between images. Classical multi-modal registration approaches evaluate the degree of the alignment by measuring the statistical dependency of the intensity values between images to be aligned. Employing statistical similarity measures, such as mutual information, is not promising in those cases with complex and spatially dependent intensity relations. A new similarity measure is proposed based on the assessing the similarity of pixels within an image, based on the idea that similar structures in an image are more probable to undergo similar intensity transformations. The most significant pixel similarity values are considered to transmit the most significant self-similarity information. The proposed method is employed in a framework to register different modalities of real brain scans and the performance of the method is compared to the conventional multi-modal registration approach. Quantitative evaluation of the method demonstrates the better registration accuracy in both rigid and non-rigid deformations.

  1. Multimodality imaging for precise localization of craniofacial osteomyelitis.

    PubMed

    Strumas, Nick; Antonyshyn, Oleh; Caldwell, Curtis B; Mainprize, James

    2003-03-01

    Functional imaging identifies areas of abnormal bone turnover, providing a useful adjunct in the treatment of osteomyelitis and bone tumors. The low resolution and lack of anatomical detail limit the application of bone scans in craniofacial surgery, however. Multimodality image registration addresses this problem by fusing functional images (single photon emission computed tomography [SPECT]) to high-resolution structural images (computed tomography [CT]) for precise anatomical delineation of bone activity. This article describes a technique for spatial registration of CT and SPECT images to provide precise anatomical delineation of abnormal bone turnover, thereby guiding the extent of resection in the management of craniofacial osteomyelitis. Standard CT and SPECT imaging protocols were used in imaging the skull from the vertex to the mentum. Image data were imported into Analyze (Biomedical Imaging Resource; Mayo Foundation, Rochester, MN) on a dedicated Windows NT (Microsoft Corporation, Redmond, WA) workstation. Using the CT data, the craniofacial skeleton, osteotomy segments, and bone grafts were interactively mapped out. Consecutive axial slices were then reconstructed to form a three-dimensional volume of interest. The CT-derived volume of interest was registered to the technetium Tc 99m-methylene diphosphonate SPECT scan using the Analyze program to provide a fused multimodality image. The imaging technique was used to localize osteomyelitis in a complex craniofacial reconstruction. The fused images guided the extent of resection during surgery, and postoperative microbiological and histological testing confirmed the diagnosis. Multimodality image registration provides a readily available method to relate facial skeletal anatomy and physiology. This technique is valuable in planning and monitoring therapeutic interventions in clinical conditions in which bone turnover is abnormal.

  2. Imaging Neurodegeneration: Steps Toward Brain Network-Based Pathophysiology and Its Potential for Multi-modal Imaging Diagnostics.

    PubMed

    Sorg, C; Göttler, J; Zimmer, C

    2015-10-01

    Multi-modal brain imaging provides different in vivo windows into the human brain and thereby different ways to characterize brain disorders. Particularly, resting-state functional magnetic resonance imaging facilitates the study of macroscopic intrinsic brain networks, which are critical for development and spread of neurodegenerative processes in different neurodegenerative diseases. The aim of the current study is to present and highlight some paradigmatic findings in intrinsic network-based pathophysiology of neurodegenerative diseases and its potential for new network-based multimodal tools in imaging diagnostics. Qualitative review of selected multi-modal imaging studies in neurodegenerative diseases particularly in Alzheimer's disease (AD). Functional connectivity of intrinsic brain networks is selectively and progressively impaired in AD, with changes likely starting before the onset of symptoms in fronto-parietal key networks such as default mode or attention networks. Patterns of distribution and development of both amyloid-β plaques and atrophy are linked with network connectivity changes, suggesting that start and spread of pathology interacts with network connectivity. Qualitatively similar findings have been observed in other neurodegenerative disorders, suggesting shared mechanisms of network-based pathophysiology across diseases. Spread of neurodegeneration is intimately linked with the functional connectivity of intrinsic brain networks. These pathophysiological insights pave the way for new multi-modal network-based tools to detect and characterize neurodegeneration in individual patients.

  3. Multimodal optical molecular image reconstruction with frequency domain measurements.

    PubMed

    Bartels, M; Chen, W; Bardhan, R; Ke, S; Halas, N J; Wareing, T; McGhee, J; Joshi, A

    2009-01-01

    Multimodality molecular imaging is becoming more and more important to understand both the structural and the functional characteristics of tissue, organs and tumors. So far, invasive nuclear methods utilizing ionizing radiation have been the "gold standard" of molecular imaging. We investigate non-contact, non-invasive, patient-tolerant and inexpensive near infrared (NIR) frequency domain optical tomography (FDOT) as a functional complement to structural X-ray computed tomography (CT) data. We show a novel multifrequency NIR FDOT approach both in transmission and reflectance mode and employ radiative transport equation (RTE) for 3D reconstruction of a target with novel fluorescent gold nanoshell indocyanine green (NS ICG) in an ex vivo nude mouse. The results demonstrate that gold NS ICG with multifrequency NIR FDOT is a promising fluorophore for multimodal optical molecular image reconstruction.

  4. A Multimodality Hybrid Gamma-Optical Camera for Intraoperative Imaging

    PubMed Central

    Lees, John E.; Bugby, Sarah L.; Alqahtani, Mohammed S.; Jambi, Layal K.; Dawood, Numan S.; McKnight, William R.; Ng, Aik H.; Perkins, Alan C.

    2017-01-01

    The development of low profile gamma-ray detectors has encouraged the production of small field of view (SFOV) hand-held imaging devices for use at the patient bedside and in operating theatres. Early development of these SFOV cameras was focussed on a single modality—gamma ray imaging. Recently, a hybrid system—gamma plus optical imaging—has been developed. This combination of optical and gamma cameras enables high spatial resolution multi-modal imaging, giving a superimposed scintigraphic and optical image. Hybrid imaging offers new possibilities for assisting clinicians and surgeons in localising the site of uptake in procedures such as sentinel node detection. The hybrid camera concept can be extended to a multimodal detector design which can offer stereoscopic images, depth estimation of gamma-emitting sources, and simultaneous gamma and fluorescence imaging. Recent improvements to the hybrid camera have been used to produce dual-modality images in both laboratory simulations and in the clinic. Hybrid imaging of a patient who underwent thyroid scintigraphy is reported. In addition, we present data which shows that the hybrid camera concept can be extended to estimate the position and depth of radionuclide distribution within an object and also report the first combined gamma and Near-Infrared (NIR) fluorescence images. PMID:28282957

  5. The new frontiers of multimodality and multi-isotope imaging

    NASA Astrophysics Data System (ADS)

    Behnam Azad, Babak; Nimmagadda, Sridhar

    2014-06-01

    Technological advances in imaging systems and the development of target specific imaging tracers has been rapidly growing over the past two decades. Recent progress in "all-in-one" imaging systems that allow for automated image coregistration has significantly added to the growth of this field. These developments include ultra high resolution PET and SPECT scanners that can be integrated with CT or MR resulting in PET/CT, SPECT/CT, SPECT/PET and PET/MRI scanners for simultaneous high resolution high sensitivity anatomical and functional imaging. These technological developments have also resulted in drastic enhancements in image quality and acquisition time while eliminating cross compatibility issues between modalities. Furthermore, the most cutting edge technology, though mostly preclinical, also allows for simultaneous multimodality multi-isotope image acquisition and image reconstruction based on radioisotope decay characteristics. These scientific advances, in conjunction with the explosion in the development of highly specific multimodality molecular imaging agents, may aid in realizing simultaneous imaging of multiple biological processes and pave the way towards more efficient diagnosis and improved patient care.

  6. Pulmonary talcosis: imaging findings.

    PubMed

    Marchiori, Edson; Lourenço, Sílvia; Gasparetto, Taisa Davaus; Zanetti, Gláucia; Mano, Cláudia Mauro; Nobre, Luiz Felipe

    2010-04-01

    Talc is a mineral widely used in the ceramic, paper, plastics, rubber, paint, and cosmetic industries. Four distinct forms of pulmonary disease caused by talc have been defined. Three of them (talcosilicosis, talcoasbestosis, and pure talcosis) are associated with aspiration and differ in the composition of the inhaled substance. The fourth form, a result of intravenous administration of talc, is seen in drug users who inject medications intended for oral use. The disease most commonly affects men, with a mean age in the fourth decade of life. Presentation of patients with talc granulomatosis can range from asymptomatic to fulminant disease. Symptomatic patients typically present with nonspecific complaints, including progressive exertional dyspnea, and cough. Late complications include chronic respiratory failure, emphysema, pulmonary arterial hypertension, and cor pulmonale. History of occupational exposure or of drug addiction is the major clue to the diagnosis. The high-resolution computed tomography (HRCT) finding of small centrilobular nodules associated with heterogeneous conglomerate masses containing high-density amorphous areas, with or without panlobular emphysema in the lower lobes, is highly suggestive of pulmonary talcosis. The characteristic histopathologic feature in talc pneumoconiosis is the striking appearance of birefringent, needle-shaped particles of talc seen within the giant cells and in the areas of pulmonary fibrosis with the use of polarized light. In conclusion, computed tomography can play an important role in the diagnosis of pulmonary talcosis, since suggestive patterns may be observed. The presence of these patterns in drug abusers or in patients with an occupational history of exposure to talc is highly suggestive of pulmonary talcosis.

  7. Nanoengineered multimodal contrast agent for medical image guidance

    NASA Astrophysics Data System (ADS)

    Perkins, Gregory J.; Zheng, Jinzi; Brock, Kristy; Allen, Christine; Jaffray, David A.

    2005-04-01

    Multimodality imaging has gained momentum in radiation therapy planning and image-guided treatment delivery. Specifically, computed tomography (CT) and magnetic resonance (MR) imaging are two complementary imaging modalities often utilized in radiation therapy for visualization of anatomical structures for tumour delineation and accurate registration of image data sets for volumetric dose calculation. The development of a multimodal contrast agent for CT and MR with prolonged in vivo residence time would provide long-lasting spatial and temporal correspondence of the anatomical features of interest, and therefore facilitate multimodal image registration, treatment planning and delivery. The multimodal contrast agent investigated consists of nano-sized stealth liposomes encapsulating conventional iodine and gadolinium-based contrast agents. The average loading achieved was 33.5 +/- 7.1 mg/mL of iodine for iohexol and 9.8 +/- 2.0 mg/mL of gadolinium for gadoteridol. The average liposome diameter was 46.2 +/- 13.5 nm. The system was found to be stable in physiological buffer over a 15-day period, releasing 11.9 +/- 1.1% and 11.2 +/- 0.9% of the total amounts of iohexol and gadoteridol loaded, respectively. 200 minutes following in vivo administration, the contrast agent maintained a relative contrast enhancement of 81.4 +/- 13.05 differential Hounsfield units (ΔHU) in CT (40% decrease from the peak signal value achieved 3 minutes post-injection) and 731.9 +/- 144.2 differential signal intensity (ΔSI) in MR (46% decrease from the peak signal value achieved 3 minutes post-injection) in the blood (aorta), a relative contrast enhancement of 38.0 +/- 5.1 ΔHU (42% decrease from the peak signal value achieved 3 minutes post-injection) and 178.6 +/- 41.4 ΔSI (62% decrease from the peak signal value achieved 3 minutes post-injection) in the liver (parenchyma), a relative contrast enhancement of 9.1 +/- 1.7 ΔHU (94% decrease from the peak signal value achieved 3 minutes

  8. Multi-modality imaging of small animals

    NASA Astrophysics Data System (ADS)

    Kastis, Georgios Anthony

    Over the last few years there has been a great demand for noninvasive, dedicated, small-animal imaging systems for biomedical research applications. In this dissertation we will discuss the development and performance of two gamma-ray systems and a dual modality CT/SPECT system. Initially we introduce FASTSPECT, a stationary, scintillator-based, single-photon emission computed tomography (SPECT) system that was originally built as a brain imager. We discuss its transformation into a small-animal imaging system and validate its performance by presenting high-resolution images of phantoms and animals. Furthermore, we discuss the development of an in vivo imaging protocol for rat myocardial models using FASTSPECT. The infarct size obtained from the images is quantified and compared with the myocardial infarct size measured from histology. Semiconductor detectors can exhibit good spatial and energy resolution, and therefore offer a promising alternative to scintillation technology. We discuss the performance of a semiconductor detector system, previously developed in our group, for planar and tomographic imaging of small animals. The same gamma-ray detector is used in a dual modality system for imaging mice. The system combines an anatomical imaging modality, x-ray CT, with a functional modality, SPECT. We present the development of the CT/SPECT system and illustrate its performance by presenting high-resolution images of phantoms and mice. Finally, we introduce a procedure for evaluating estimation methods without the use of a gold standard.

  9. Multimodal medical image fusion using improved multi-channel PCNN.

    PubMed

    Zhao, Yaqian; Zhao, Qinping; Hao, Aimin

    2014-01-01

    Multimodal medical image fusion is a method of integrating information from multiple image formats. Its aim is to provide useful and accurate information for doctors. Multi-channel pulse coupled neural network (m-PCNN) is a recently proposed fusion model. Compared with previous methods, this network can effectively manage various types of medical images. However, it has two drawbacks: lack of control to feed function and low-level automation. The improved multi-channel PCNN proposed in this paper can adjust the impact of feed function by linking strength and adaptively compute the weighting coefficients for each pixel. Experimental results demonstrated the effectiveness of the improved m-PCNN fusion model.

  10. Multimodality imaging of early heterotopic bone formation.

    PubMed

    Laurin, N R; Powe, J E; Pavlosky, W F; Driedger, A A

    1990-04-01

    An atypical heterotopic bone formation that was difficult to diagnose presented in a young paraplegic patient as an acute deep vein thrombosis. A number of imaging methods, including contrast venography, ultrasonography, conventional radiography, bone scanning, leukocyte scanning, computed tomography, and magnetic resonance imaging, were used to arrive eventually at the final diagnosis. Early bone scanning remains a sensitive and effective method of diagnosis. Computed tomography can be useful in difficult cases, but the role of other imaging studies appears limited.

  11. Multimodal registration of remotely sensed images based on Jeffrey's divergence

    NASA Astrophysics Data System (ADS)

    Xu, Xiaocong; Li, Xia; Liu, Xiaoping; Shen, Huanfeng; Shi, Qian

    2016-12-01

    Entropy-based measures (e.g., mutual information, also known as Kullback-Leiber divergence), which quantify the similarity between two signals, are widely used as similarity measures for image registration. Although they are proven superior to many classical statistical measures, entropy-based measures, such as mutual information, may fail to yield the optimum registration if the multimodal image pair has insufficient scene overlap region. To overcome this challenge, we proposed using the symmetric form of Kullback-Leiber divergence, namely Jeffrey's divergence, as the similarity measure in practical multimodal image registration tasks. Mathematical analysis was performed to investigate the causes accounting for the limitation of mutual information when dealing with insufficient scene overlap image pairs. Experimental registrations of SPOT image, Landsat TM image, ALOS PalSAR image, and DEM data were carried out to compare the performance of Jeffrey's divergence and mutual information. Results indicate that Jeffrey's divergence is capable of providing larger feasible search space, which is favorable for exploring optimum transformation parameters in a larger range. This superiority of Jeffrey's divergence was further confirmed by a series of paradigms. Thus, the proposed model is more applicable for registering image pairs that are greatly misaligned or have an insufficient scene overlap region.

  12. Imaging collagen remodeling and sensing transplanted autologous fibroblast metabolism in mouse dermis using multimode nonlinear optical imaging

    NASA Astrophysics Data System (ADS)

    Zhuo, Shuangmu; Chen, Jianxin; Cao, Ning; Jiang, Xingshan; Xie, Shusen; Xiong, Shuyuan

    2008-06-01

    Collagen remodeling and transplanted autologous fibroblast metabolic states in mouse dermis after cellular injection are investigated using multimode nonlinear optical imaging. Our findings show that the technique can image the progress of collagen remodeling in mouse dermis. It can also image transplanted autologous fibroblasts in their collagen matrix environment in the dermis, because of metabolic activity. It was also found that the approach can provide two-photon ratiometric redox fluorometry based on autologous fibroblast fluorescence from reduced nicotinamide adenine dinucleotide coenzyme and oxidized flavoproteins for sensing the autologous fibroblast metabolic state. These results show that the multimode nonlinear optical imaging technique may have potential in a clinical setting as an in vivo diagnostic and monitoring system for cellular therapy in plastic surgery.

  13. A Multimodal Search Engine for Medical Imaging Studies.

    PubMed

    Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

    2017-02-01

    The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

  14. Multimodality Molecular Imaging of Stem Cells Therapy for Stroke

    PubMed Central

    Zhang, Hong; Tian, Mei

    2013-01-01

    Stem cells have been proposed as a promising therapy for treating stroke. While several studies have demonstrated the therapeutic benefits of stem cells, the exact mechanism remains elusive. Molecular imaging provides the possibility of the visual representation of biological processes at the cellular and molecular level. In order to facilitate research efforts to understand the stem cells therapeutic mechanisms, we need to further develop means of monitoring these cells noninvasively, longitudinally and repeatedly. Because of tissue depth and the blood-brain barrier (BBB), in vivo imaging of stem cells therapy for stroke has unique challenges. In this review, we describe existing methods of tracking transplanted stem cells in vivo, including magnetic resonance imaging (MRI), nuclear medicine imaging, and optical imaging (OI). Each of the imaging techniques has advantages and drawbacks. Finally, we describe multimodality imaging strategies as a more comprehensive and potential method to monitor transplanted stem cells for stroke. PMID:24222920

  15. Multimodality molecular imaging of stem cells therapy for stroke.

    PubMed

    Chao, Fangfang; Shen, Yehua; Zhang, Hong; Tian, Mei

    2013-01-01

    Stem cells have been proposed as a promising therapy for treating stroke. While several studies have demonstrated the therapeutic benefits of stem cells, the exact mechanism remains elusive. Molecular imaging provides the possibility of the visual representation of biological processes at the cellular and molecular level. In order to facilitate research efforts to understand the stem cells therapeutic mechanisms, we need to further develop means of monitoring these cells noninvasively, longitudinally and repeatedly. Because of tissue depth and the blood-brain barrier (BBB), in vivo imaging of stem cells therapy for stroke has unique challenges. In this review, we describe existing methods of tracking transplanted stem cells in vivo, including magnetic resonance imaging (MRI), nuclear medicine imaging, and optical imaging (OI). Each of the imaging techniques has advantages and drawbacks. Finally, we describe multimodality imaging strategies as a more comprehensive and potential method to monitor transplanted stem cells for stroke.

  16. Feature-based Alignment of Volumetric Multi-modal Images

    PubMed Central

    Toews, Matthew; Zöllei, Lilla; Wells, William M.

    2014-01-01

    This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modalities. The encoding method is incorporated into a probabilistic feature-based model for multi-modal image alignment. The model parameters are estimated via a group-wise alignment algorithm, that iteratively alternates between estimating a feature-based model from feature data, then realigning feature data to the model, converging to a stable alignment solution with few pre-processing or pre-alignment requirements. The resulting model can be used to align multi-modal image data with the benefits of invariant feature correspondence: globally optimal solutions, high efficiency and low memory usage. The method is tested on the difficult RIRE data set of CT, T1, T2, PD and MP-RAGE brain images of subjects exhibiting significant inter-subject variability due to pathology. PMID:24683955

  17. [Multimodalities imaging for target volume definition in radiotherapy].

    PubMed

    Daisne, Jean-François; Grégoire, Vincent

    2006-12-01

    Modern radiotherapy delivery nowadays relies on tridimensional, conformal techniques. The aim is to better target the tumor while decreasing the dose administered to surrounding normal tissues. Gold standard imaging modality remains computed-tomography (CT) scanner. However, the intrinsic lack of contrast between soft tissues leads to high variabilities in target definition. The risks are : a geographical miss with tumor underirradiation on the one hand, and a tumor overestimation with undue normal tissues irradiation on the other hand. Alternative imaging modalities like magnetic resonance imaging and functional positron emission tomography could theoretically overcome the lack of soft tissues contrast of CT. However, the fusion of the different imaging modalities images requires the use of sophisticated computer algorithms. We will briefly review them. We will then review the different clinical results reported with multi-modalities imaging for tumors of the head, neck, lung, esophagus, cervix and lymphomas. Finally, we will briefly give practical recommendations for multi-modality imaging in radiotherapy treatment planning process.

  18. Synthesis and radiolabeling of a somatostatin analog for multimodal imaging

    NASA Astrophysics Data System (ADS)

    Edwards, W. Barry; Liang, Kexian; Xu, Baogang; Anderson, Carolyn J.; Achilefu, Samuel

    2006-02-01

    A new multimodal imaging agent for imaging the somatostatin receptor has been synthesized and evaluated in vitro and in vivo. A somatostatin analog, conjugated to both 1,4,7,10-tetraazacyclododecane-1,4,7,10-tetraaceticacid (DOTA) and cypate (BS-296), was synthesized entirely on the solid phase (Fmoc) and purified by RP-HPLC. DOTA was added as a ligand for radiometals such as 64Cu or 177Lu for either radio-imaging or radiotherapy respectively. Cytate, a cypatesomatostatin analog conjugate, has previously demonstrated the ability to visualize somatostatin receptor rich tumor xenografts and natural organs by optical imaging techniques. BS-296 exhibited low nanomolar inhibitory capacity toward the binding of radiolabeled somatostatin analogs in cell membranes enriched in the somatostatin receptor, demonstrating the high affinity of this multimodal imaging peptide and indicating its potential as a molecular imaging agent. 64Cu, an isotope for diagnostic imaging and radiotherapy, was selected as the isotope for radiolabeling BS-296. BS-296 was radiolabeled with 64Cu in high specific activity (200 μCi/μg) in 90% radiochemical yield. Addition of 2,5-dihydroxybenzoic acid (gentisic acid) prevented radiolysis of the sample, allowing for study of the 64Cu -BS-296 the day following radiolabeling. Furthermore, inclusion of DMSO at a level of 20% was found not to interfere with radiolabeling yields and prevented the adherence of 64Cu -BS-296 to the walls of the reaction vessel.

  19. Advanced capabilities of the multimodal adaptive optics imager

    NASA Astrophysics Data System (ADS)

    Hammer, Daniel X.; Ferguson, R. D.; Mujat, Mircea; Biss, David P.; Iftimia, Nicusor V.; Patel, Ankit H.; Plumb, Emily; Campbell, Melanie; Norris, Jennifer L.; Dubra, Alfredo; Chui, Toco Y. P.; Akula, James D.; Fulton, Anne B.

    2011-03-01

    We recently developed several versions of a multimodal adaptive optics (AO) retinal imager, which includes highresolution scanning laser ophthalmoscopy (SLO) and Fourier domain optical coherence tomography (FDOCT) imaging channels as well as an auxiliary wide-field line scanning ophthalmoscope (LSO). Some versions have also been equipped with a fluorescence channel and a retinal tracker. We describe the performance of three key features of the multimodal AO system including: simultaneous SLO/OCT imaging, which allows SLO/OCT co-registration; a small animal imaging port, which adjusts the beam diameter at the pupil from 7.5 to 2.5 mm for use with small animals ubiquitous in biological research or for extended depth-of-focus imaging in humans; and slow scan Doppler flowmetry imaging using the wide field auxiliary LSO imaging channel. The systems are currently deployed in several ophthalmology clinics and research laboratories and several investigations have commenced on patients with a variety of retinal diseases and animals in vision research.

  20. Multimodality Plant Imaging of Small Molecules

    SciTech Connect

    DeJesus, Onofre T.

    2015-03-12

    Positron emission tomography (PET) is a non-invasive imaging technique used to diagnose disease and monitor therapy. PET imaging has had tremendous impact in healthcare delivery resulting in improved outcomes and reduced costs. The discovery and development of PET is one of the achievements of the Department of Energy’s (DOE) support of the peaceful uses of the atom. This project is a logical extension of the use of the PET technique to live plant imaging to advance DOE’s biological and environmental initiatives.

  1. Multimodality Imaging of the Peripheral Venous System

    PubMed Central

    Gaitini, Diana

    2007-01-01

    The purpose of this article is to review the spectrum of image-based diagnostic tools used in the investigation of suspected deep vein thrombosis (DVT). Summary of the experience gained by the author as well as relevant publications, regarding vein imaging modalities taken from a computerized database, was reviewed. The imaging modalities reviewed include phlebography, color Doppler duplex ultrasonography (CDDUS), computerized tomography angiography (CTA) and venography (CTV), magnetic resonance venography (MRV), and radionuclide venography (RNV). CDDUS is recommended as the modality of choice for the diagnosis of DVT. A strategy combining clinical score and D-dimer test refines the selection of patients. Phlebography is reserved for discrepant noninvasive studies. PMID:18521181

  2. Multimodal Correlative Preclinical Whole Body Imaging and Segmentation

    PubMed Central

    Akselrod-Ballin, Ayelet; Dafni, Hagit; Addadi, Yoseph; Biton, Inbal; Avni, Reut; Brenner, Yafit; Neeman, Michal

    2016-01-01

    Segmentation of anatomical structures and particularly abdominal organs is a fundamental problem for quantitative image analysis in preclinical research. This paper presents a novel approach for whole body segmentation of small animals in a multimodal setting of MR, CT and optical imaging. The algorithm integrates multiple imaging sequences into a machine learning framework, which generates supervoxels by an efficient hierarchical agglomerative strategy and utilizes multiple SVM-kNN classifiers each constrained by a heatmap prior region to compose the segmentation. We demonstrate results showing segmentation of mice images into several structures including the heart, lungs, liver, kidneys, stomach, vena cava, bladder, tumor, and skeleton structures. Experimental validation on a large set of mice and organs, indicated that our system outperforms alternative state of the art approaches. The system proposed can be generalized to various tissues and imaging modalities to produce automatic atlas-free segmentation, thereby enabling a wide range of applications in preclinical studies of small animal imaging. PMID:27325178

  3. Multimodal Imaging of Dynamic Functional Connectivity

    PubMed Central

    Tagliazucchi, Enzo; Laufs, Helmut

    2015-01-01

    The study of large-scale functional interactions in the human brain with functional magnetic resonance imaging (fMRI) extends almost to the first applications of this technology. Due to historical reasons and preconceptions about the limitations of this brain imaging method, most studies have focused on assessing connectivity over extended periods of time. It is now clear that fMRI can resolve the temporal dynamics of functional connectivity, like other faster imaging techniques such as electroencephalography and magnetoencephalography (albeit on a different temporal scale). However, the indirect nature of fMRI measurements can hinder the interpretability of the results. After briefly summarizing recent advances in the field, we discuss how the simultaneous combination of fMRI with electrophysiological activity measurements can contribute to a better understanding of dynamic functional connectivity in humans both during rest and task, wakefulness, and other brain states. PMID:25762977

  4. Multimodal Task-Driven Dictionary Learning for Image Classification

    DTIC Science & Technology

    2015-12-18

    36]. This is achieved by formulating it as a bilevel optimization problem [37], [38]. In particular, a stochastic gradient descent algorithm has...multimodal dictionary learning is smooth and can be solved using a stochastic 3 gradient descent algorithm. 1 • Flexible feature-level fusion: An extension of...efficient online algorithm is proposed in [19] to find the dictionary D as the minimizer of the following stochastic cost over the convex set D: g (D

  5. OSIRIX: open source multimodality image navigation software

    NASA Astrophysics Data System (ADS)

    Rosset, Antoine; Pysher, Lance; Spadola, Luca; Ratib, Osman

    2005-04-01

    The goal of our project is to develop a completely new software platform that will allow users to efficiently and conveniently navigate through large sets of multidimensional data without the need of high-end expensive hardware or software. We also elected to develop our system on new open source software libraries allowing other institutions and developers to contribute to this project. OsiriX is a free and open-source imaging software designed manipulate and visualize large sets of medical images: http://homepage.mac.com/rossetantoine/osirix/

  6. Multimodal Imaging Evaluations of Focal Choroidal Excavations in Eyes with Central Serous Chorioretinopathy

    PubMed Central

    Chen, Zhi-Qing; Wang, Wei

    2016-01-01

    Purpose. To investigate the prevalence and characteristics of focal choroidal excavation (FCE) concurrent with central serous chorioretinopathy (CSC) using multimodal imaging. Methods. This was a retrospective single-institution study. Clinical features and multimodal imaging findings were analyzed in eyes with CSC and FCEs, using imaging methods including optical coherence tomography (OCT), OCT angiography (OCTA), fluorescein angiography (FA), indocyanine green angiography (ICGA), fundus autofluorescence (FAF), and multispectral imaging. Results. Seventeen patients (4.8%) with 21 FCEs (19 eyes) were found among 351 consecutive Chinese patients with CSC. Chronic CSC represented 47.1% of those cases. Window defects in 12 lesions identified through FA and hypoautofluorescence in 13 lesions identified through FAF revealed retinal pigment epithelial attenuation. Choroidal hemodynamic disturbances characterized by localized filling defects at the excavation and circumferential hyperperfusion were validated by both ICGA and OCTA, which were similar to the angiographic features of normal chronic CSC. The hyperreflective tissue beneath FCE, observed on B-scan OCT, presented as intensive choroidal flow signals on OCTA. Conclusions. FCE is not uncommon in patients with CSC. Multimodal imaging suggested that the aberrant choroidal circulation might be a contribution factor for leakage from the dysfunctional retinal pigment epithelium at the area of excavation. PMID:27437148

  7. MR imaging findings of endophthalmitis

    PubMed Central

    Radhakrishnan, Rupa; Cornelius, Rebecca; Cunnane, Mary Beth; Golnik, Karl

    2016-01-01

    Endophthalmitis is a sight-threatening ophthalmologic emergency. The clinical diagnosis is often challenging, and delayed diagnosis may exacerbate the poor visual prognosis. B-scan ultrasonography or spectral domain optical coherence tomography are imaging aids at the clinician’s office. Cross-sectional imaging such as CT and particularly MRI can also help in the assessment of disease extent or complications. MR imaging findings are rarely described in the literature. Here, we discuss the spectrum of imaging findings of endophthalmitis and correlate them with key anatomic and pathophysiologic details of the globe. Early disease is often subtle on MR imaging with thick uveal enhancement, while advanced disease demonstrates retinal/choroidal detachment, vitreal exudates and peribulbar inflammation. Other noninfectious inflammatory diseases of the globe can show similar findings; however, MR diffusion-weighted images help identify infectious exudates and evaluate response to therapy. Knowledge of the spectrum of imaging findings of this disease is important for radiologists and help in the management decision process. PMID:26915896

  8. Multimodal x-ray scatter imaging

    NASA Astrophysics Data System (ADS)

    Bunk, O.; Bech, M.; Jensen, T. H.; Feidenhans'l, R.; Binderup, T.; Menzel, A.; Pfeiffer, F.

    2009-12-01

    We describe a small-angle x-ray scattering-based imaging technique that reveals the distribution and orientation of nano-scale structures over extended areas. By combining two measurement and analysis schemes, complementary structural information is available which renders the technique suitable for a broad range of applications, e.g. in materials science and bio-imaging. Through a combination of current techniques and on-line analysis schemes, measurements with a so far unprecedented combination of speed, dynamic range and point density became feasible. This is illustrated by data recorded for a section of a mouse soleus muscle visualizing fine muscle and Achilles tendon structures down to the 10 nm range over a 10 mm2 sample area.

  9. Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan

    PubMed Central

    Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

    2016-01-01

    Objective: The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. Date Sources: The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of “precision medicine”, “fusion imaging”, “multimodality”, and “tumor diagnosis and treatment”. Study Selection: Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Results: Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Conclusion: Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice. PMID:27958232

  10. Multimodality Imaging of the Right Ventricle.

    PubMed

    Abouzeid, Christiane M; Shah, Tara; Johri, Ansh; Weinsaft, Jonathan W; Kim, Jiwon

    2017-09-25

    Right ventricular (RV) structure and function is clinically important in a wide range of conditions. While conventional echocardiography (echo) methods are widely used, its limitations in RV assessment due its complex geometry are well recognized. New applications of traditional echo methods as well as emerging echo techniques including 3-dimensional (3D) echo and speckle tracking strain have the potential to overcome limitations of conventional echo, though widespread clinical use remains to be seen. Volumetric methods using cardiac magnetic resonance (CMR) and computed tomography (CT) provide accurate assessment of RV function without geometric assumptions. In addition, tissue characterization imaging for myocardial scar and fat using CMR and CT provides important information regarding the RV beyond structure and function alone and has clinical applications for diagnosis and prognosis in a broad range of pathologies. Limitations also exist for these two advanced modalities including availability and patient suitability for CMR and need for contrast and radiation exposure for CT. The complementary role of each modality for the RV as well as emerging evidence for the use of each imaging method in diagnosis and management of RV pathologies is outlined in this study.

  11. Multimodality imaging of hypoxia in preclinical settings

    PubMed Central

    Mason, Ralph P.; Zhao, Dawen; Pacheco-Torres, Jesús; Cui, Weina; Kodibagkar, Vikram D.; Gulaka, Praveen K.; Hao, Guiyang; Thorpe, Philip; Hahn, Eric W.; Peschke, Peter

    2011-01-01

    Hypoxia has long been recognized to influence solid tumor response to therapy. Increasingly, hypoxia has also been implicated in tumor aggressiveness, including growth, development and metastatic potential. Thus, there is a fundamental, as well as a clinical interest, in assessing in situ tumor hypoxia. This review will examine diverse approaches focusing on the pre-clinical setting, particularly, in rodents. The strategies are inevitably a compromise in terms of sensitivity, precision, temporal and spatial resolution, as well as cost, feasibility, ease and robustness of implementation. We will review capabilities of multiple modalities and examine what makes them particularly suitable for investigating specific aspects of tumor pathophysiology. Current approaches range from nuclear imaging to magnetic resonance and optical, with varying degrees of invasiveness and ability to examine spatial heterogeneity, as well as dynamic response to interventions. Ideally, measurements would be non-invasive, exploiting endogenous reporters to reveal quantitatively local oxygen tension dynamics. A primary focus of this review is magnetic resonance imaging (MRI) based techniques, such as 19F MRI oximetry, which reveals not only hypoxia in vivo, but more significantly, spatial distribution of pO2 quantitatively, with a precision relevant to radiobiology. It should be noted that pre-clinical methods may have very different criteria for acceptance, as compared with potential investigations for prognostic radiology or predictive biomarkers suitable for use in patients. PMID:20639813

  12. Multimodal optical imaging of mouse Ischemic cortex

    NASA Astrophysics Data System (ADS)

    Jones, Phillip B.; Shin, Hwa Kyuong; Dunn, Andrew K.; Hyman, Bradley T.; Boas, David A.; Moskowitz, Michael A.; Ayata, Cenk

    2005-11-01

    Real time investigation of cerebral blood flow (CBF), and oxy/deoxy hemoglobin volume (HbO,HbR) dynamics has been difficult until recently due to limited spatial and temporal resolution of techniques like laser Doppler flowmetry and MRI. This is especially true for studies of disease models in small animals, owing to the fine structure of the cerebral vasculature. The combination of laser speckle flowmetry (LSF) and multi-spectral reflectance imaging (MSRI) yields high resolution spatio-temporal maps of hemodynamic changes in response to events such as sensory stimuli or arterial occlusion. Ischemia was induced by distal occlusion of the medial cerebral artery (dMCAO). Rapid changes in CBF, HbO, and HbR during the acute phase were captured with high temporal and spatial resolution through the intact skull. Hemodynamic changes that were correlated with vasoconstrictive events, peri-infarct spreading depressions (PISD), were observed. These experiments demonstrate the utility of LSF and Multi-spectral reflectance imaging (MSRI) in mouse disease models.

  13. Dye-Enhanced Multimodal Confocal Imaging of Brain Cancers

    NASA Astrophysics Data System (ADS)

    Wirth, Dennis; Snuderl, Matija; Sheth, Sameer; Curry, William; Yaroslavsky, Anna

    2011-04-01

    Background and Significance: Accurate high resolution intraoperative detection of brain tumors may result in improved patient survival and better quality of life. The goal of this study was to evaluate dye enhanced multimodal confocal imaging for discriminating normal and cancerous brain tissue. Materials and Methods: Fresh thick brain specimens were obtained from the surgeries. Normal and cancer tissues were investigated. Samples were stained in methylene blue and imaged. Reflectance and fluorescence signals were excited at 658nm. Fluorescence emission and polarization were registered from 670 nm to 710 nm. The system provided lateral resolution of 0.6 μm and axial resolution of 7 μm. Normal and cancer specimens exhibited distinctively different characteristics. H&E histopathology was processed from each imaged sample. Results and Conclusions: The analysis of normal and cancerous tissues indicated clear differences in appearance in both the reflectance and fluorescence responses. These results confirm the feasibility of multimodal confocal imaging for intraoperative detection of small cancer nests and cells.

  14. Enhancing image classification models with multi-modal biomarkers

    NASA Astrophysics Data System (ADS)

    Caban, Jesus J.; Liao, David; Yao, Jianhua; Mollura, Daniel J.; Gochuico, Bernadette; Yoo, Terry

    2011-03-01

    Currently, most computer-aided diagnosis (CAD) systems rely on image analysis and statistical models to diagnose, quantify, and monitor the progression of a particular disease. In general, CAD systems have proven to be effective at providing quantitative measurements and assisting physicians during the decision-making process. As the need for more flexible and effective CADs continues to grow, questions about how to enhance their accuracy have surged. In this paper, we show how statistical image models can be augmented with multi-modal physiological values to create more robust, stable, and accurate CAD systems. In particular, this paper demonstrates how highly correlated blood and EKG features can be treated as biomarkers and used to enhance image classification models designed to automatically score subjects with pulmonary fibrosis. In our results, a 3-5% improvement was observed when comparing the accuracy of CADs that use multi-modal biomarkers with those that only used image features. Our results show that lab values such as Erythrocyte Sedimentation Rate and Fibrinogen, as well as EKG measurements such as QRS and I:40, are statistically significant and can provide valuable insights about the severity of the pulmonary fibrosis disease.

  15. Magnetically engineered semiconductor quantum dots as multimodal imaging probes.

    PubMed

    Jing, Lihong; Ding, Ke; Kershaw, Stephen V; Kempson, Ivan M; Rogach, Andrey L; Gao, Mingyuan

    2014-10-08

    Light-emitting semiconductor quantum dots (QDs) combined with magnetic resonance imaging contrast agents within a single nanoparticle platform are considered to perform as multimodal imaging probes in biomedical research and related clinical applications. The principles of their rational design are outlined and contemporary synthetic strategies are reviewed (heterocrystalline growth; co-encapsulation or assembly of preformed QDs and magnetic nanoparticles; conjugation of magnetic chelates onto QDs; and doping of QDs with transition metal ions), identifying the strengths and weaknesses of different approaches. Some of the opportunities and benefits that arise through in vivo imaging using these dual-mode probes are highlighted where tumor location and delineation is demonstrated in both MRI and fluorescence modality. Work on the toxicological assessments of QD/magnetic nanoparticles is also reviewed, along with progress in reducing their toxicological side effects for eventual clinical use. The review concludes with an outlook for future biomedical imaging and the identification of key challenges in reaching clinical applications.

  16. Echocardiography in the Era of Multimodality Cardiovascular Imaging

    PubMed Central

    Shah, Benoy Nalin

    2013-01-01

    Echocardiography remains the most frequently performed cardiac imaging investigation and is an invaluable tool for detailed and accurate evaluation of cardiac structure and function. Echocardiography, nuclear cardiology, cardiac magnetic resonance imaging, and cardiovascular-computed tomography comprise the subspeciality of cardiovascular imaging, and these techniques are often used together for a multimodality, comprehensive assessment of a number of cardiac diseases. This paper provides the general cardiologist and physician with an overview of state-of-the-art modern echocardiography, summarising established indications as well as highlighting advances in stress echocardiography, three-dimensional echocardiography, deformation imaging, and contrast echocardiography. Strengths and limitations of echocardiography are discussed as well as the growing role of real-time three-dimensional echocardiography in the guidance of structural heart interventions in the cardiac catheter laboratory. PMID:23878804

  17. Multimodal image registration based on binary gradient angle descriptor.

    PubMed

    Jiang, Dongsheng; Shi, Yonghong; Yao, Demin; Fan, Yifeng; Wang, Manning; Song, Zhijian

    2017-08-31

    Multimodal image registration plays an important role in image-guided interventions/therapy and atlas building, and it is still a challenging task due to the complex intensity variations in different modalities. The paper addresses the problem and proposes a simple, compact, fast and generally applicable modality-independent binary gradient angle descriptor (BGA) based on the rationale of gradient orientation alignment. The BGA can be easily calculated at each voxel by coding the quadrant in which a local gradient vector falls, and it has an extremely low computational complexity, requiring only three convolutions, two multiplication operations and two comparison operations. Meanwhile, the binarized encoding of the gradient orientation makes the BGA more resistant to image degradations compared with conventional gradient orientation methods. The BGA can extract similar feature descriptors for different modalities and enable the use of simple similarity measures, which makes it applicable within a wide range of optimization frameworks. The results for pairwise multimodal and monomodal registrations between various images (T1, T2, PD, T1c, Flair) consistently show that the BGA significantly outperforms localized mutual information. The experimental results also confirm that the BGA can be a reliable alternative to the sum of absolute difference in monomodal image registration. The BGA can also achieve an accuracy of [Formula: see text], similar to that of the SSC, for the deformable registration of inhale and exhale CT scans. Specifically, for the highly challenging deformable registration of preoperative MRI and 3D intraoperative ultrasound images, the BGA achieves a similar registration accuracy of [Formula: see text] compared with state-of-the-art approaches, with a computation time of 18.3 s per case. The BGA improves the registration performance in terms of both accuracy and time efficiency. With further acceleration, the framework has the potential for

  18. Imaging findings of Pott's disease.

    PubMed

    Rivas-Garcia, Antonio; Sarria-Estrada, Silvana; Torrents-Odin, Carme; Casas-Gomila, Lourdes; Franquet, Elisa

    2013-06-01

    Tuberculosis (TB) continues to be an important public health problem in developed countries especially in deprived socioeconomic groups, older people, immunocompromised patients, drug-therapy resistant cases and the immigrant population. The spine is the most frequent location of musculoskeletal TB. The wide range of clinical presentations results in difficulties and delays in diagnosis. Advanced disease mimics other infections and malignancy. The diagnosis of spinal infections relies on three main factors: clinical symptoms, imaging and bacteriological culture. Advanced imaging such as Magnetic Resonance Imaging (MRI), Multidetector Computed Tomography (MDCT) and Fluor18-Deoxiglucose Positron Emission Tomography combined with CT (F-18 FDG PET-CT) demonstrate lesion extent, serve as guide for biopsy with aspiration for culture, assist surgery planning and contribute to follow-up. Diagnosis of TB cannot be established solely on the basis of clinical tests or imaging findings and biopsy may be required. Differential diagnosis between tuberculous and pyogenic spondylitis is of clinical importance, but may be difficult on the basis of radiological findings alone. Findings not pathognomonic but favoring tuberculous etiology include: slow progression of lesions with late preservation of disk space, involvement of several contiguous segments, large intraosseous and paraspinal abscesses containing calcifications, and body collapse with kyphotic deformity. In this essay the highlights of TB imaging are reviewed through published literature. In addition, we review retrospectively the radiological findings of 48 patients with tuberculous spondylitis treated from 1993 to 2010. There were 23 male and 25 female patients with a mean age of 53 years.

  19. Multimodality Imaging of a Silent Cardiac Hemangioma

    PubMed Central

    Cresti, Alberto; Chiavarelli, Mario; Munezero Butorano, Marie Aimèe Gloria; Franci, Luca

    2015-01-01

    A 74-year-old man underwent echocardiographic exam for hypertension screening. A fixed plurilobulated mass originating from the right ventricular lateral wall and occupying half of the cavity was incidentally diagnosed. On cardiac magnetic resonance (CMR) it appeared homogeneous, intermediate-to-high signal on T1-weighted, and diffusely hyperintense on T2-weighted images. First pass enhancement was late and heterogeneous and no late gadolinium enhancement was present. Computed tomography (CT) showed no extracardiac infiltration, the feeding artery was a branch of therightcoronary artery. The tumor was excised and histological examination demonstrated a hemangioma of the cavernous type. The postoperative course was uneventful. From 1998 to 2014, four cardiac hemangiomas have been diagnosed in our Department, accounting for 8.7% of all primary cardiac tumors and for 9.5% of all benign forms; estimated population prevalence was 0.11/100.000 inhabitants/year. The hemodynamic consequences of unoperated cardiac hemangiomas cannot be predicted and therefore, resection is recommended. PMID:28465926

  20. Design and applications of a multimodality image data warehouse framework.

    PubMed

    Wong, Stephen T C; Hoo, Kent Soo; Knowlton, Robert C; Laxer, Kenneth D; Cao, Xinhau; Hawkins, Randall A; Dillon, William P; Arenson, Ronald L

    2002-01-01

    A comprehensive data warehouse framework is needed, which encompasses imaging and non-imaging information in supporting disease management and research. The authors propose such a framework, describe general design principles and system architecture, and illustrate a multimodality neuroimaging data warehouse system implemented for clinical epilepsy research. The data warehouse system is built on top of a picture archiving and communication system (PACS) environment and applies an iterative object-oriented analysis and design (OOAD) approach and recognized data interface and design standards. The implementation is based on a Java CORBA (Common Object Request Broker Architecture) and Web-based architecture that separates the graphical user interface presentation, data warehouse business services, data staging area, and backend source systems into distinct software layers. To illustrate the practicality of the data warehouse system, the authors describe two distinct biomedical applications--namely, clinical diagnostic workup of multimodality neuroimaging cases and research data analysis and decision threshold on seizure foci lateralization. The image data warehouse framework can be modified and generalized for new application domains.

  1. Electrophysiological features and multimodal imaging in ritonavir-related maculopathy.

    PubMed

    Faure, Céline; Paques, Michel; Audo, Isabelle

    2017-09-12

    The purpose of this study is to report a case of ritonavir-related retinal toxicity followed over a year. Electrophysiological features and multimodal imaging, including adaptive optics, are provided and discussed. Electrophysiological recordings and multimodal imaging were performed and repeated over 1 year. Fundus examination revealed crystalline maculopathy in conjunction with pigment disruption. Spectral domain optical coherence tomography displayed thinning of the macula without cysts. Autofluorescence imaging revealed a mixed pattern of complete loss of the autofluorescence in the area of retinal pigment deposit and an increased transmission of the autofluorescence in the area of retinal thinning. Fluorescein angiography ruled out parafoveal telangiectasia. Indocyanine green angiography was not contributive. Increased spacing of the macular cone mosaic, crystal deposits and pigment migrations were seen with adaptive optics. Full-field electroretinogram was slightly reduced for both eyes, especially in the light-adapted responses, and mfERG confirmed bilateral maculopathy. Functional and structural abnormalities did not change with follow-up besides constant pigmentary changes monitored with adaptive optics. Ritonavir-related retinal toxicity is a maculopathy with peculiar features including crystalline and pigment migration associated with central or temporofoveolar thinning and inconstant macular telangiectasia. Despite drug cessation, retinal remodelling continues to progress.

  2. Design and Applications of a Multimodality Image Data Warehouse Framework

    PubMed Central

    Wong, Stephen T.C.; Hoo, Kent Soo; Knowlton, Robert C.; Laxer, Kenneth D.; Cao, Xinhau; Hawkins, Randall A.; Dillon, William P.; Arenson, Ronald L.

    2002-01-01

    A comprehensive data warehouse framework is needed, which encompasses imaging and non-imaging information in supporting disease management and research. The authors propose such a framework, describe general design principles and system architecture, and illustrate a multimodality neuroimaging data warehouse system implemented for clinical epilepsy research. The data warehouse system is built on top of a picture archiving and communication system (PACS) environment and applies an iterative object-oriented analysis and design (OOAD) approach and recognized data interface and design standards. The implementation is based on a Java CORBA (Common Object Request Broker Architecture) and Web-based architecture that separates the graphical user interface presentation, data warehouse business services, data staging area, and backend source systems into distinct software layers. To illustrate the practicality of the data warehouse system, the authors describe two distinct biomedical applications—namely, clinical diagnostic workup of multimodality neuroimaging cases and research data analysis and decision threshold on seizure foci lateralization. The image data warehouse framework can be modified and generalized for new application domains. PMID:11971885

  3. Multimodality imaging in an orthotopic mammary window chamber model

    NASA Astrophysics Data System (ADS)

    Schafer, Rachel; Leung, Hui Min; Gmitro, Arthur F.

    2013-02-01

    Window chamber models have been utilized for many years to investigate cancer development and the tumor microenvironment. Orthotopic mammary window chamber model have been developed for detailed study of breast cancer. Orthotopic window chamber models, due to the native environment, support more realistic growth and tumor behavior than ectopic models. The work by other groups thus far utilizing mammary window chamber models has focused solely on optical imaging techniques, limited to probing the first millimeter or less of tissue. These techniques do not take full advantage of the unrestricted, three-dimensional tumor growth the model supports. We have developed a custom plastic structure compatible with multimodality imaging. We present in this work the implementation of our custom window chamber in a mouse model and the successful imaging of the window chamber cancer model with MRI, nuclear imaging, and optical techniques. MRI provides a full three-dimensional view of the tumor growth and allows for additional, potentially clinically translatable, approaches to be utilized in investigating the cancer microenvironment. Nuclear imaging is accomplished using the Beta Imager, which is a novel approach to nuclear imaging of window chambers. The Beta Imager detects photons after the interaction of a single positron with a scintillator, instead of the coincidence detection of annihilation gamma ray pairs. We utilized the radioisotope glucose analog, 2-deoxy-2- (18F)fluoro-D-glucose or FDG, with the Beta Imager to obtain information on the glycolytic metabolism of the tumor and surrounding region.

  4. TOPICAL REVIEW: Multimodality imaging of structure and function

    NASA Astrophysics Data System (ADS)

    Townsend, D. W.

    2008-02-01

    Historically, medical devices to image either anatomical structure or functional processes have developed along somewhat independent paths. The recognition that combining images from different modalities can nevertheless offer significant diagnostic advantages gave rise to sophisticated software techniques to coregister structure and function. Recently, alternatives to retrospective software-based fusion have become available through instrumentation that combines two imaging modalities within a single device, an approach that has since been termed hardware fusion. As a result, following their recent introduction into the clinic, combined PET/CT and SPECT/CT devices are now playing an increasingly important role in the diagnosis and staging of human disease. Recently, although limited to the brain, the first clinical MR scanner with a PET insert, a technically-challenging design, has been undergoing evaluation. This review will follow the development of multimodality instrumentation for clinical use from conception to present-day technology and assess the status and future potential for such devices.

  5. Longitudinal, multimodal functional imaging of microvascular response to photothermal therapy

    PubMed Central

    Bui, Albert K.; Teves, Kathleen M.; Indrawan, Elmer; Jia, Wangcun; Choi, Bernard

    2012-01-01

    Although studies have shown that photothermal therapy can coagulate selectively abnormal vasculature, the ability of this method to achieve consistent, complete removal of the vasculature is questionable. We present the use of multimodal, wide-field functional imaging to study, in greater detail, the biological response to selective laser injury. Specifically, a single-platform instrument capable of coregistered fluorescence imaging and laser speckle imaging was utilized to monitor vascular endothelial growth factor gene expression and blood flow, respectively, in a transgenic rodent model. Collectively, the longitudinal, in vivo data collected with our instrument suggest that the biological response to selective laser injury involves early-stage redistribution of blood flow, followed by increased vascular endothelial growth factor promoter activity to stimulate pro-angiogenic events. PMID:20890338

  6. Multimodal nonlinear imaging of arabidopsis thaliana root cell

    NASA Astrophysics Data System (ADS)

    Jang, Bumjoon; Lee, Sung-Ho; Woo, Sooah; Park, Jong-Hyun; Lee, Myeong Min; Park, Seung-Han

    2017-07-01

    Nonlinear optical microscopy has enabled the possibility to explore inside the living organisms. It utilizes ultrashort laser pulse with long wavelength (greater than 800nm). Ultrashort pulse produces high peak power to induce nonlinear optical phenomenon such as two-photon excitation fluorescence (TPEF) and harmonic generations in the medium while maintaining relatively low average energy pre area. In plant developmental biology, confocal microscopy is widely used in plant cell imaging after the development of biological fluorescence labels in mid-1990s. However, fluorescence labeling itself affects the sample and the sample deviates from intact condition especially when labelling the entire cell. In this work, we report the dynamic images of Arabidopsis thaliana root cells. This demonstrates the multimodal nonlinear optical microscopy is an effective tool for long-term plant cell imaging.

  7. Multi-modal Color Medical Image Fusion Using Quaternion Discrete Fourier Transform

    NASA Astrophysics Data System (ADS)

    Nawaz, Qamar; Xiao, Bin; Hamid, Isma; Jiao, Du

    2016-12-01

    Multimodal image fusion is a process of combining multiple images, generated by identical or diverse imaging modalities, to get precise inside information about the same body organ. In recent years, various multimodal image fusion algorithms have been proposed to fuse medical image. However, most of them focus on fusing grayscale images. This paper proposes a novel algorithm for the fusion of multimodal color medical images. The proposed algorithm divides source images into blocks, converts each RGB block into quaternion representation and transforms them from special domain to frequency domain by applying quaternion discrete Fourier transform. The fused coefficients are obtained by calculating and comparing contrast values of corresponding coefficients in transformed blocks. The resultant fused image is reconstructed by merging all the blocks after applying inverse quaternion discrete Fourier transform on each block. Experimental evaluation demonstrates that the proposed algorithm qualitatively outperforms many existing state-of-the-art multimodal image fusion algorithms.

  8. Development of Convergence Nanoparticles for Multi-Modal Bio-Medical Imaging

    DTIC Science & Technology

    2008-09-18

    Multi-Modal Bio- Medical Imaging Key researchers: Jinwoo Cheon Affiliation: Department of Chemistry, Yonsei University Address: 134 Shinchon...01-02-2008 4. TITLE AND SUBTITLE Development of Convergence Nanoparticles for Multi-Modal Bio- Medical Imaging 5a. CONTRACT NUMBER FA48690714016

  9. Latex nanoparticles for multimodal imaging and detection in vivo

    NASA Astrophysics Data System (ADS)

    Cartier, R.; Kaufner, L.; Paulke, B. R.; Wüstneck, R.; Pietschmann, S.; Michel, R.; Bruhn, H.; Pison, U.

    2007-05-01

    The aim of the present work was to develop a multimodal imaging and detection approach to study the behaviour of nanoparticles in animal studies. Highly carboxylated 144 nm-sized latex nanoparticles were labelled with 68Ga for positron emission tomography, 111In for quantitative gamma scintigraphy or Gd3+ for magnetic resonance imaging. Following intravenous injection into rats, precise localization was achieved revealing the tracer in the blood compartment with a time-dependent accumulation in the liver. In addition, rhodamine B was also incorporated to examine specific interactions with blood cells. Flow cytometry and fluorescent microscopy show uptake of nanoparticles by leucocytes and, unexpectedly, thrombocytes, but not erythrocytes. Cellular internalization was an active and selective process. Further incorporation of polyethylene glycol into the nanoparticle corona could prevent uptake by thrombocytes but not macrophages or monocytes. Our data demonstrate the feasibility of a multimodal approach and its usefulness to analyse the fate of nanoparticles at the macroscopic and cellular level. It will facilitate the development of functionalized nanocarrier systems and extend their biomedical applications.

  10. Enhanced EDX images by fusion of multimodal SEM images using pansharpening techniques.

    PubMed

    Franchi, G; Angulo, J; Moreaud, M; Sorbier, L

    2017-08-16

    The goal of this paper is to explore the potential interest of image fusion in the context of multimodal scanning electron microscope (SEM) imaging. In particular, we aim at merging the backscattered electron images that usually have a high spatial resolution but do not provide enough discriminative information to physically classify the nature of the sample, with energy-dispersive X-ray spectroscopy (EDX) images that have discriminative information but a lower spatial resolution. The produced images are named enhanced EDX. To achieve this goal, we have compared the results obtained with classical pansharpening techniques for image fusion with an original approach tailored for multimodal SEM fusion of information. Quantitative assessment is obtained by means of two SEM images and a simulated dataset produced by a software based on PENELOPE. © 2017 The Authors Journal of Microscopy © 2017 Royal Microscopical Society.

  11. Gold Nanoconstructs for Multimodal Diagnostic Imaging and Photothermal Cancer Therapy

    NASA Astrophysics Data System (ADS)

    Coughlin, Andrew James

    Cancer accounts for nearly 1 out of every 4 deaths in the United States, and because conventional treatments are limited by morbidity and off-target toxicities, improvements in cancer management are needed. This thesis further develops nanoparticle-assisted photothermal therapy (NAPT) as a viable treatment option for cancer patients. NAPT enables localized ablation of disease because heat generation only occurs where tissue permissive near-infrared (NIR) light and absorbing nanoparticles are combined, leaving surrounding normal tissue unharmed. Two principle approaches were investigated to improve the specificity of this technique: multimodal imaging and molecular targeting. Multimodal imaging affords the ability to guide NIR laser application for site-specific NAPT and more holistic characterization of disease by combining the advantages of several diagnostic technologies. Towards the goal of image-guided NAPT, gadolinium-conjugated gold-silica nanoshells were engineered and demonstrated to enhance imaging contrast across a range of diagnostic modes, including T1-weighted magnetic resonance imaging, X-Ray, optical coherence tomography, reflective confocal microscopy, and two-photon luminescence in vitro as well as within an animal tumor model. Additionally, the nanoparticle conjugates were shown to effectively convert NIR light to heat for applications in photothermal therapy. Therefore, the broad utility of gadolinium-nanoshells for anatomic localization of tissue lesions, molecular characterization of malignancy, and mediators of ablation was established. Molecular targeting strategies may also improve NAPT by promoting nanoparticle uptake and retention within tumors and enhancing specificity when malignant and normal tissue interdigitate. Here, ephrinA1 protein ligands were conjugated to nanoshell surfaces for particle homing to overexpressed EphA2 receptors on prostate cancer cells. In vitro, successful targeting and subsequent photothermal ablation of

  12. Multimodal Medical Image Fusion by Adaptive Manifold Filter.

    PubMed

    Geng, Peng; Liu, Shuaiqi; Zhuang, Shanna

    2015-01-01

    Medical image fusion plays an important role in diagnosis and treatment of diseases such as image-guided radiotherapy and surgery. The modified local contrast information is proposed to fuse multimodal medical images. Firstly, the adaptive manifold filter is introduced into filtering source images as the low-frequency part in the modified local contrast. Secondly, the modified spatial frequency of the source images is adopted as the high-frequency part in the modified local contrast. Finally, the pixel with larger modified local contrast is selected into the fused image. The presented scheme outperforms the guided filter method in spatial domain, the dual-tree complex wavelet transform-based method, nonsubsampled contourlet transform-based method, and four classic fusion methods in terms of visual quality. Furthermore, the mutual information values by the presented method are averagely 55%, 41%, and 62% higher than the three methods and those values of edge based similarity measure by the presented method are averagely 13%, 33%, and 14% higher than the three methods for the six pairs of source images.

  13. Registration and fusion of multimodal vascular images: a phantom study

    NASA Astrophysics Data System (ADS)

    Boussion, Nicolas; de Guise, Jacques A.; Soulez, Gilles; Daronat, Michel; Cloutier, Guy

    2003-05-01

    The aim of this work was to compare the geometric accuracy of X-ray angiography, MRI, X-ray computed tomography (XCT), and ultrasound imaging (B-mode and IVUS) for measuring the lumen diameters of blood vessels. An image fusion method also was developed to improve these measurements. The images were acquired from a realistic phantom mimicking normal vessels of known internal diameters. After acquisition, the multimodal images were coregistered, by manual alignment of fiducial markers and then by automatic maximization of mutual information. The fusion method was performed by means of a fuzzy logic modeling approach followed by a combination process based on possibilistic logic. The data showed (i) the good geometric accuracy of XCT compared to the other methods for all studied diameters; and (ii) the good results of fused images compared to single modalities alone. For XCT, the error varied from 1.1% to 9.7%, depending on the vessel diameter that ranged from 0.93 to 6.24 mm. MRI-IVUS fusion allowed variability of measurements to be reduced up to 78%. To conclude, this work underlined both the usefulness of the vascular phantom as a validation tool and the utility of image fusion in the vascular context. Future work will consist of studying pathological vessel shapes, image artifacts and partial volume effect correction.

  14. [Multimodal imaging of ischemic heart diseases: A 2015 update].

    PubMed

    Di Marco, L; Rosset, M; Zhang-Yin, J; Ohana, M

    2016-05-01

    Current realities and future possibilities of imaging in the ischemic heart diseases are very broad and constantly evolving, with the improvement of existing technologies and the introduction of new features such as dual-energy CT, strain ultrasound, multimodality fusion or perfusion MRI. Regular collaboration between prescribing clinicians, cardiologists, radiologists and nuclear radiologists is therefore essential to tailor the examination to the specific clinical question. The indications for each modality will therefore depend on its diagnostic performance, cost, acquisition and post-processing times and eventual radiation exposure. This review will detail principles and applications of current cardiac imaging examinations: echocardiography, nuclear medicine, MRI, CT and coronary angiography, emphasizing their current strengths and weaknesses in the ischemic heart diseases management.

  15. Deformable image registration for multimodal lung-cancer staging

    NASA Astrophysics Data System (ADS)

    Cheirsilp, Ronnarit; Zang, Xiaonan; Bascom, Rebecca; Allen, Thomas W.; Mahraj, Rickhesvar P. M.; Higgins, William E.

    2016-03-01

    Positron emission tomography (PET) and X-ray computed tomography (CT) serve as major diagnostic imaging modalities in the lung-cancer staging process. Modern scanners provide co-registered whole-body PET/CT studies, collected while the patient breathes freely, and high-resolution chest CT scans, collected under a brief patient breath hold. Unfortunately, no method exists for registering a PET/CT study into the space of a high-resolution chest CT scan. If this could be done, vital diagnostic information offered by the PET/CT study could be brought seamlessly into the procedure plan used during live cancer-staging bronchoscopy. We propose a method for the deformable registration of whole-body PET/CT data into the space of a high-resolution chest CT study. We then demonstrate its potential for procedure planning and subsequent use in multimodal image-guided bronchoscopy.

  16. Painful heel: MR imaging findings.

    PubMed

    Narváez, J A; Narváez, J; Ortega, R; Aguilera, C; Sánchez, A; Andía, E

    2000-01-01

    Heel pain is a common and frequently disabling clinical complaint that may be caused by a broad spectrum of osseous or soft-tissue disorders. These disorders are classified on the basis of anatomic origin and predominant location of heel pain to foster a better understanding of this complaint. The disorders include plantar fascial lesions (fasciitis, rupture, fibromatosis, xanthoma), tendinous lesions (tendinitis, tenosynovitis), osseous lesions (fractures, bone bruises, osteomyelitis, tumors), bursal lesions (retrocalcaneal bursitis, retroachilleal bursitis), tarsal tunnel syndrome, and heel plantar fat pad abnormalities. With its superior soft-tissue contrast resolution and multiplanar capability, magnetic resonance (MR) imaging can help determine the cause of heel pain and help assess the extent and severity of the disease in ambiguous or clinically equivocal cases. Careful analysis of MR imaging findings and correlation of these findings with patient history and findings at physical examination can suggest a specific diagnosis in most cases. The majority of patients with heel pain can be successfully treated conservatively, but in cases requiring surgery (eg, plantar fascia rupture in competitive athletes, deeply infiltrating plantar fibromatosis, masses causing tarsal tunnel syndrome), MR imaging is especially useful in planning surgical treatment by showing the exact location and extent of the lesion.

  17. Gadolinium oxide nanoparticles as potential multimodal imaging and therapeutic agents.

    PubMed

    Kim, Tae Jeong; Chae, Kwon Seok; Chang, Yongmin; Lee, Gang Ho

    2013-01-01

    Potentials of hydrophilic and biocompatible ligand coated gadolinium oxide nanoparticles as multimodal imaging agents, drug carriers, and therapeutic agents are reviewed. First of all, they can be used as advanced T1 magnetic resonance imaging (MRI) contrast agents because they have r1 larger than those of Gd(III)-chelates due to a high density of Gd(III) per nanoparticle. They can be further functionalized by conjugating other imaging agents such as fluorescent imaging (FI), X-ray computed tomography (CT), positron emission tomography (PET), and single photon emission tomography (SPECT) agents. They can be also useful for drug carriers through morphology modifications. They themselves are also potential CT and ultrasound imaging (USI) contrast and thermal neutron capture therapeutic (NCT) agents, which are superior to commercial iodine compounds, air-filled albumin microspheres, and boron ((10)B) compounds, respectively. They, when conjugated with targeting agents such as antibodies and peptides, will provide enhanced images and be also very useful for diagnosis and therapy of diseases (so called theragnosis).

  18. A single reporter for targeted multimodal in vivo imaging

    PubMed Central

    Niers, Johanna M; Chen, John W; Lewandrowski, Grant; Kerami, Mariam; Garanger, Elisabeth; Wojtkiewicz, Greg; Waterman, Peter; Keliher, Edmund; Weissleder, Ralph; Tannous, Bakhos A.

    2012-01-01

    We have developed a multifaceted highly specific reporter for multimodal in vivo imaging and applied it for detection of brain tumors. A metabolically biotinylated, membrane-bound form of Gaussia luciferase was synthesized, termed mbGluc-biotin. We engineered glioma cells to express this reporter and showed that brain tumor formation can be temporally imaged by bioluminescence following systemic administration of coelenterazine. Brain tumors expressing this reporter had high sensitivity for detection by magnetic resonance and fluorescence tomographic imaging upon injection of streptavidin conjugated to magnetic nanoparticles or fluorophore, respectively. Moreover, single photon emission computed tomography showed enhanced imaging of these tumors upon injection with streptavidin complexed to 111In-DTPA-biotin. This work shows for the first time a single small reporter ( 40 kDa) which can be monitored with most available molecular imaging modalities and can be extended for single cell imaging using intravital microscopy, allowing real-time tracking of any cell expressing it in vivo. PMID:22397453

  19. Multimodality imaging of Alzheimer disease and other neurodegenerative dementias.

    PubMed

    Nasrallah, Ilya M; Wolk, David A

    2014-12-01

    Neurodegenerative diseases, such as Alzheimer disease, result in cognitive decline and dementia and are a leading cause of mortality in the growing elderly population. These progressive diseases typically have an insidious onset, with overlapping clinical features early in the disease course that make diagnosis challenging. The neurodegenerative diseases are associated with characteristic, although not completely understood, changes in the brain: abnormal protein deposition, synaptic dysfunction, neuronal injury, and neuronal death. Neuroimaging biomarkers-principally regional atrophy on structural MR imaging, patterns of hypometabolism on (18)F-FDG PET, and detection of cerebral amyloid plaque on amyloid PET--are able to evaluate the patterns of these abnormalities in the brain to improve early diagnosis and help predict the disease course. These techniques have unique strengths and synergies in multimodality evaluation of the patient with cognitive decline or dementia. This review discusses the key imaging biomarkers from MR imaging, (18)F-FDG PET, and amyloid PET; the imaging features of the most common neurodegenerative dementias; the role of various neuroimaging studies in differential diagnosis and prognosis; and some promising imaging techniques under development. © 2014 by the Society of Nuclear Medicine and Molecular Imaging, Inc.

  20. Resolution limits for imaging through multi-mode fiber.

    PubMed

    Mahalati, Reza Nasiri; Gu, Ruo Yu; Kahn, Joseph M

    2013-01-28

    We experimentally demonstrate endoscopic imaging through a multi-mode fiber (MMF) in which the number of resolvable image features approaches four times the number of spatial modes per polarization propagating in the fiber. In our method, a sequence of random field patterns is input to the fiber, generating a sequence of random intensity patterns at the output, which are used to sample an object. Reflected power values are returned through the fiber and linear optimization is used to reconstruct an image. The factor-of-four resolution enhancement is due to mixing of modes by the squaring inherent in field-to-intensity conversion. The incoherent point-spread function (PSF) at the center of the fiber output plane is an Airy disk equivalent to the coherent PSF of a conventional diffraction-limited imaging system having a numerical aperture twice that of the fiber. All previous methods for imaging through MMF can only resolve a number of features equal to the number of modes. Most of these methods use localized intensity patterns for sampling the object and use local image reconstruction.

  1. Multimodality Noninvasive Imaging in the Monitoring of Pediatric Heart Transplantation.

    PubMed

    Kindel, Steven J; Hsu, Hao H; Hussain, Tarique; Johnson, Jonathan N; McMahon, Colin J; Kutty, Shelby

    2017-09-01

    Orthotopic heart transplantation is a well-established and effective therapeutic option for children with end-stage heart failure. Multiple modalities, including noninvasive cardiac imaging, cardiac catheterization, angiography, and endomyocardial biopsy, are helpful to monitor these patients for graft dysfunction, rejection, and vasculopathy. Because of morbidities associated with invasive monitoring, noninvasive imaging plays a key role in the surveillance and evaluation of symptoms in pediatric transplant recipients. Echocardiography with or without stress augmentation may provide serial data on systolic and diastolic function, ventricular deformation, and tissue characteristics in children after transplantation. Although not perfectly sensitive or specific, advanced two- and three-dimensional echocardiographic detection of functional changes in cardiac grafts may allow early recognition of allograft rejection. Magnetic resonance imaging has shown promise for characterization of edema and scar and myocardial perfusion reserve, as well as potential application for the detection of microvasculopathic changes in the transplanted heart. Cardiac computed tomography is particularly well suited for the demonstration of coronary artery dimensions and anatomic residual lesions. In combination, these noninvasive imaging techniques help the transplantation cardiologist screen for graft dysfunction, detect critical graft events, and identify situations that require invasive testing of the transplanted heart. Advanced multimodality imaging techniques are likely to increasingly shape the monitoring practices for children following heart transplantation. Copyright © 2017 American Society of Echocardiography. Published by Elsevier Inc. All rights reserved.

  2. Desirable Characteristics Of A Frame Buffer For Multimodality Image Display

    NASA Astrophysics Data System (ADS)

    Horii, S. C.; Maguire, G. Q.; Noz, M. E.

    1988-06-01

    The basic goal of this paper is to present the characteristics of those frame buffers currently used to display images, versus those features which might more ideally suit frame buffers for this purpose. We use current and perceived needs and data based on our experience to identify the salient points which are useful and necessary. Over the last five years we have implemented the same image processing system on eight different frame buffers' (RAMTEK 9050 and 9400, Grinnell GMR-270, Hewlett-Packard 98710 and 98720, Nodecrest Ltd. TVN 256, Lexidata 3400, Pixar Image Computer). This paper extrapolates from these efforts on existing displays to determine what characteristics are desirable in a frame buffer used primarily for multimodality image display. Two case examples are presented: 1. A system developed for high quality computer graphics, as exemplified by the Pixar Image Computer (or in the future the AT&T PXM900 Pixel Machine). 2. A system developed for nuclear medicine and radiation therapy treatment planning as exemplified by the Nodecrest Ltd. TVN256 and TVN512 displays.

  3. IDH mutation assessment of glioma using texture features of multimodal MR images

    NASA Astrophysics Data System (ADS)

    Zhang, Xi; Tian, Qiang; Wu, Yu-Xia; Xu, Xiao-Pan; Li, Bao-Juan; Liu, Yi-Xiong; Liu, Yang; Lu, Hong-Bing

    2017-03-01

    Purpose: To 1) find effective texture features from multimodal MRI that can distinguish IDH mutant and wild status, and 2) propose a radiomic strategy for preoperatively detecting IDH mutation patients with glioma. Materials and Methods: 152 patients with glioma were retrospectively included from the Cancer Genome Atlas. Corresponding T1-weighted image before- and post-contrast, T2-weighted image and fluid-attenuation inversion recovery image from the Cancer Imaging Archive were analyzed. Specific statistical tests were applied to analyze the different kind of baseline information of LrGG patients. Finally, 168 texture features were derived from multimodal MRI per patient. Then the support vector machine-based recursive feature elimination (SVM-RFE) and classification strategy was adopted to find the optimal feature subset and build the identification models for detecting the IDH mutation. Results: Among 152 patients, 92 and 60 were confirmed to be IDH-wild and mutant, respectively. Statistical analysis showed that the patients without IDH mutation was significant older than patients with IDH mutation (p<0.01), and the distribution of some histological subtypes was significant different between IDH wild and mutant groups (p<0.01). After SVM-RFE, 15 optimal features were determined for IDH mutation detection. The accuracy, sensitivity, specificity, and AUC after SVM-RFE and parameter optimization were 82.2%, 85.0%, 78.3%, and 0.841, respectively. Conclusion: This study presented a radiomic strategy for noninvasively discriminating IDH mutation of patients with glioma. It effectively incorporated kinds of texture features from multimodal MRI, and SVM-based classification strategy. Results suggested that features selected from SVM-RFE were more potential to identifying IDH mutation. The proposed radiomics strategy could facilitate the clinical decision making in patients with glioma.

  4. Design, implementation and operation of a multimodality research imaging informatics repository

    PubMed Central

    2015-01-01

    Background Biomedical imaging research increasingly involves acquiring, managing and processing large amounts of distributed imaging data. Integrated systems that combine data, meta-data and workflows are crucial for realising the opportunities presented by advances in imaging facilities. Methods This paper describes the design, implementation and operation of a multi-modality research imaging data management system that manages imaging data obtained from biomedical imaging scanners operated at Monash Biomedical Imaging (MBI), Monash University in Melbourne, Australia. In addition to Digital Imaging and Communications in Medicine (DICOM) images, raw data and non-DICOM biomedical data can be archived and distributed by the system. Imaging data are annotated with meta-data according to a study-centric data model and, therefore, scientific users can find, download and process data easily. Results The research imaging data management system ensures long-term usability, integrity inter-operability and integration of large imaging data. Research users can securely browse and download stored images and data, and upload processed data via subject-oriented informatics frameworks including the Distributed and Reflective Informatics System (DaRIS), and the Extensible Neuroimaging Archive Toolkit (XNAT). PMID:25870760

  5. Multi-modality image registration for effective thermographic fever screening

    NASA Astrophysics Data System (ADS)

    Dwith, C. Y. N.; Ghassemi, Pejhman; Pfefer, Joshua; Casamento, Jon; Wang, Quanzeng

    2017-02-01

    Fever screening based on infrared thermographs (IRTs) is a viable mass screening approach during infectious disease pandemics, such as Ebola and Severe Acute Respiratory Syndrome (SARS), for temperature monitoring in public places like hospitals and airports. IRTs have been found to be powerful, quick and non-invasive methods for detecting elevated temperatures. Moreover, regions medially adjacent to the inner canthi (called the canthi regions in this paper) are preferred sites for fever screening. Accurate localization of the canthi regions can be achieved through multi-modality registration of infrared (IR) and white-light images. Here we propose a registration method through a coarse-fine registration strategy using different registration models based on landmarks and edge detection on eye contours. We have evaluated the registration accuracy to be within +/- 2.7 mm, which enables accurate localization of the canthi regions.

  6. Vehicle detection using multimodal imaging sensors from a moving platform

    NASA Astrophysics Data System (ADS)

    Dickson, Christopher N.; Wallace, Andrew M.; Kitchin, Matthew; Connor, Barry

    2012-10-01

    A modular vehicle detection system, using a two-stage hypothesis generation (HG) and hypothesis combination (HC) approach is presented. The HG stage consists of a set of simple algorithms which parse multi-modal data and provide a set of possible vehicle locations. These hypotheses are subsequently fused in a combination stage. This modular design allows the system to utilise additional modalities where available, and the combination of multiple information sources is shown to reduce false positive detections. The system uses Thales' high-resolution long wave infrared polarimeter and a four-band visible/near infrared multispectral system. Vehicle cues are taken from motion ow vectors, thermal intensity hot spots, and regions with a locally high degree of linear polarisation. Results using image sequences gathered from a moving vehicle are shown, and the performance of the system is assessed with Receiver Operator Characteristics.

  7. Exploiting multimode waveguides for pure fibre-based imaging.

    PubMed

    Cižmár, Tomáš; Dholakia, Kishan

    2012-01-01

    There has been an immense drive in modern microscopy towards miniaturization and fibre-based technology. This has been necessitated by the need to access hostile or difficult environments in situ and in vivo. Strategies to date have included the use of specialist fibres and miniaturized scanning systems accompanied by ingenious microfabricated lenses. Here we present a novel approach for this field by utilizing disordered light within a standard multimode optical fibre for lensless microscopy and optical mode conversion. We demonstrate the modalities of bright- and dark-field imaging and scanning fluorescence microscopy at acquisition rates that allow observation of dynamic processes such as Brownian motion of mesoscopic particles. Furthermore, we show how such control can realize a new form of mode converter and generate various types of advanced light fields such as propagation-invariant beams and optical vortices. These may be useful for future fibre-based implementations of super-resolution or light-sheet microscopy.

  8. Data structures for multimodality imaging: concepts and implementation

    NASA Astrophysics Data System (ADS)

    Mealha, Oscar E. C.; Sousa Pereira, Antonio; Santos, Maria Beatriz S.

    1992-06-01

    The integration of data coming from different imaging modalities is something to take into account, due to the importance it can have in the development of a fast and reliable diagnosis by the health staff. In the medical imaging field, computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), and single photon emission computed tomography (SPECT) are examples of devices that generate 3-D data. Digital subtraction angiography (DSA) or ultrasound (US) output 2-D data, from which its possible to reconstruct 3-D data. An important fact is that 3-D space is common to all these devices and they are all capable of producing large amounts of data. Prior to display or even data integration, matching the various 3-D spaces has to be achieved with some specific technique, according to the anatomical region under examination. The augmented octree, an extension of the linear octree, is used for data integration; its properties can help to overcome some of the constraints that occur in medical imaging. To be fully accepted by the specialist, the display and manipulation of multimodality data must be interactive and done in real-time, or at least in `nearly' real-time. Parallel architectures seem to be a solution for some computation intensive applications, and so an implementation of the linear octree encoding process was developed on a 16 Transputer machine.

  9. Multimodal image analysis of clinical influences on preterm brain development

    PubMed Central

    Ball, Gareth; Aljabar, Paul; Nongena, Phumza; Kennea, Nigel; Gonzalez‐Cinca, Nuria; Falconer, Shona; Chew, Andrew T.M.; Harper, Nicholas; Wurie, Julia; Rutherford, Mary A.; Edwards, A. David

    2017-01-01

    Objective Premature birth is associated with numerous complex abnormalities of white and gray matter and a high incidence of long‐term neurocognitive impairment. An integrated understanding of these abnormalities and their association with clinical events is lacking. The aim of this study was to identify specific patterns of abnormal cerebral development and their antenatal and postnatal antecedents. Methods In a prospective cohort of 449 infants (226 male), we performed a multivariate and data‐driven analysis combining multiple imaging modalities. Using canonical correlation analysis, we sought separable multimodal imaging markers associated with specific clinical and environmental factors and correlated to neurodevelopmental outcome at 2 years. Results We found five independent patterns of neuroanatomical variation that related to clinical factors including age, prematurity, sex, intrauterine complications, and postnatal adversity. We also confirmed the association between imaging markers of neuroanatomical abnormality and poor cognitive and motor outcomes at 2 years. Interpretation This data‐driven approach defined novel and clinically relevant imaging markers of cerebral maldevelopment, which offer new insights into the nature of preterm brain injury. Ann Neurol 2017;82:233–246 PMID:28719076

  10. Multimodal image analysis of clinical influences on preterm brain development.

    PubMed

    Ball, Gareth; Aljabar, Paul; Nongena, Phumza; Kennea, Nigel; Gonzalez-Cinca, Nuria; Falconer, Shona; Chew, Andrew T M; Harper, Nicholas; Wurie, Julia; Rutherford, Mary A; Counsell, Serena J; Edwards, A David

    2017-08-01

    Premature birth is associated with numerous complex abnormalities of white and gray matter and a high incidence of long-term neurocognitive impairment. An integrated understanding of these abnormalities and their association with clinical events is lacking. The aim of this study was to identify specific patterns of abnormal cerebral development and their antenatal and postnatal antecedents. In a prospective cohort of 449 infants (226 male), we performed a multivariate and data-driven analysis combining multiple imaging modalities. Using canonical correlation analysis, we sought separable multimodal imaging markers associated with specific clinical and environmental factors and correlated to neurodevelopmental outcome at 2 years. We found five independent patterns of neuroanatomical variation that related to clinical factors including age, prematurity, sex, intrauterine complications, and postnatal adversity. We also confirmed the association between imaging markers of neuroanatomical abnormality and poor cognitive and motor outcomes at 2 years. This data-driven approach defined novel and clinically relevant imaging markers of cerebral maldevelopment, which offer new insights into the nature of preterm brain injury. Ann Neurol 2017;82:233-246. © 2017 The Authors Annals of Neurology published by Wiley Periodicals, Inc. on behalf of American Neurological Association.

  11. Mobile, Multi-modal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia

    DTIC Science & Technology

    2015-10-01

    eyes and image choroidal vessels/capillaries using CARS intravital microscopy Subtask 3: Measure oxy-hemoglobin levels in PBI test and control eyes...AWARD NUMBER: W81XWH-14-1-0537 TITLE: Mobile, Multi-modal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia...4. TITLE AND SUBTITLE Mobile, Multimodal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia 5a. CONTRACT NUMBER W81XWH

  12. Multimodality Imaging of Alzheimer Disease and Other Neurodegenerative Dementias

    PubMed Central

    Nasrallah, Ilya M.; Wolk, David A.

    2015-01-01

    Neurodegenerative diseases, such as Alzheimer’s disease, result in cognitive decline and dementia and are a leading cause of mortality in the growing elderly population. These progressive diseases typically have insidious onset, with overlapping clinical features early in disease course that makes diagnosis challenging. Neurodegenerative diseases are associated with characteristic, although not completely understood, changes in the brain: abnormal protein deposition, synaptic dysfunction, neuronal injury and neuronal death. Neuroimaging biomarkers – principally regional atrophy on structural MRI, patterns of hypometabolism on 18F-fluorodeoxyglucose (FDG) PET, and detection of cerebral amyloid plaque on amyloid PET – are able to evaluate the patterns of these abnormalities in the brain to assist and improve early diagnosis of these conditions as well as to help predict disease course in the future. There are unique strengths of these techniques as well as synergies in multimodality evaluation of the patient with cognitive decline or dementia. This review will discuss the key imaging biomarkers from MRI, 18F-FDG PET, and amyloid PET, the imaging features of the most common neurodegenerative dementias, the role of various neuroimaging studies in differential diagnosis and prognosis, and introduce some promising imaging techniques currently under development. PMID:25413136

  13. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS).

    PubMed

    Menze, Bjoern H; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-André; Arbel, Tal; Avants, Brian B; Ayache, Nicholas; Buendia, Patricia; Collins, D Louis; Cordier, Nicolas; Corso, Jason J; Criminisi, Antonio; Das, Tilak; Delingette, Hervé; Demiralp, Çağatay; Durst, Christopher R; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M; Jena, Raj; John, Nigel M; Konukoglu, Ender; Lashkari, Danial; Mariz, José Antonió; Meier, Raphael; Pereira, Sérgio; Precup, Doina; Price, Stephen J; Raviv, Tammy Riklin; Reza, Syed M S; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A; Sousa, Nuno; Subbanna, Nagesh K; Szekely, Gabor; Taylor, Thomas J; Thomas, Owen M; Tustison, Nicholas J; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen

    2015-10-01

    In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients-manually annotated by up to four raters-and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

  14. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)

    PubMed Central

    Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-André; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Hervé; Demiralp, Çağatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, José António; Meier, Raphael; Pereira, Sérgio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen

    2016-01-01

    In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients—manually annotated by up to four raters—and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%–85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource. PMID:25494501

  15. Direct estimation of evoked hemoglobin changes by multimodality fusion imaging

    PubMed Central

    Huppert, Theodore J.; Diamond, Solomon G.; Boas, David A.

    2009-01-01

    In the last two decades, both diffuse optical tomography (DOT) and blood oxygen level dependent (BOLD)-based functional magnetic resonance imaging (fMRI) methods have been developed as noninvasive tools for imaging evoked cerebral hemodynamic changes in studies of brain activity. Although these two technologies measure functional contrast from similar physiological sources, i.e., changes in hemoglobin levels, these two modalities are based on distinct physical and biophysical principles leading to both limitations and strengths to each method. In this work, we describe a unified linear model to combine the complimentary spatial, temporal, and spectroscopic resolutions of concurrently measured optical tomography and fMRI signals. Using numerical simulations, we demonstrate that concurrent optical and BOLD measurements can be used to create cross-calibrated estimates of absolute micromolar deoxyhemoglobin changes. We apply this new analysis tool to experimental data acquired simultaneously with both DOT and BOLD imaging during a motor task, demonstrate the ability to more robustly estimate hemoglobin changes in comparison to DOT alone, and show how this approach can provide cross-calibrated estimates of hemoglobin changes. Using this multimodal method, we estimate the calibration of the 3 tesla BOLD signal to be −0.55% ± 0.40% signal change per micromolar change of deoxyhemoglobin. PMID:19021411

  16. Exploring infrared neural stimulation with multimodal nonlinear imaging (Conference Presentation)

    NASA Astrophysics Data System (ADS)

    Adams, Wilson R.; Mahadevan-Jansen, Anita

    2017-02-01

    Infrared neural stimulation (INS) provides optical control of neural excitability using near to mid-infrared (mid-IR) light, which allows for spatially selective, artifact-free excitation without the introduction of exogenous agents or genetic modification. Although neural excitability is mediated by a transient temperature increase due to water absorption of IR energy, the molecular nature of IR excitability in neural tissue remains unknown. Current research suggests that transient changes in local tissue temperature give rise to a myriad of cellular responses that have been individually attributed to IR mediated excitability. To further elucidate the underlying biophysical mechanisms, we have begun work towards employing a novel multimodal nonlinear imaging platform to probe the molecular underpinnings of INS. Our imaging system performs coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS), two-photon excitation fluorescence (TPEF), second-harmonic generation (SHG) and thermal imaging into a single platform that allows for unprecedented co-registration of thermal and biochemical information in real-time. Here, we present our work leveraging CARS and SRS in acute thalamocortical brain slice preparations. We observe the evolution of lipid and protein-specific Raman bands during INS and electrically evoked activity in real-time. Combined with two-photon fluorescence and second harmonic generation, we offer insight to cellular metabolism and membrane dynamics during INS. Thermal imaging allows for the coregistration of acquired biochemical information with temperature information. Our work previews the versatility and capabilities of coherent Raman imaging combined with multiphoton imaging to observe biophysical phenomena for neuroscience applications.

  17. Wearable Brain Imaging with Multi-Modal Physiological Recording.

    PubMed

    Strangman, Gary E; Ivkovic, Vladimir; Zhang, Quan

    2017-07-13

    The brain is a central component of cognitive and physical human performance. Measures including functional brain activation, cerebral perfusion, cerebral oxygenation, evoked electrical responses, and resting hemodynamic and electrical activity are all related to, or can predict health status or performance decrements. However, measuring brain physiology typically requires large, stationary machines that are not suitable for mobile or self-monitoring. Moreover, when individuals are ambulatory, systemic physiological fluctuations-e.g., in heart rate, blood pressure, skin perfusion and more-can interfere with non-invasive brain measurements. In efforts to address the physiological monitoring and performance assessment needs for astronauts during spaceflight, we have developed easy-to-use, wearable prototypes- NINscan, for near-infrared scanning-that can collect synchronized multi-modal physiology data, including hemodynamic deep-tissue imaging (including brain and muscles), electroencephalography, electrocardiography, electromyography, electrooculography, accelerometry, gyroscopy, pressure, respiration and temperature measurements. Given their self-contained and portable nature, these devices can be deployed in a much broader range of settings-including austere environments-thereby enabling a wider range of novel medical and research physiology applications. We review these, including high-altitude assessments, self-deployable multi-modal e.g., (polysomnographic) recordings in remote or low-resource environments, fluid shifts in variable-gravity or spaceflight analog environments, intra-cranial brain motion during high-impact sports, and long-duration monitoring for clinical symptom-capture in various clinical conditions. In addition to further enhancing sensitivity and miniaturization, advanced computational algorithms could help support real-time feedback and alerts regarding performance and health. Copyright © 2017, Journal of Applied Physiology.

  18. Auto-classification of acne lesions using multimodal imaging.

    PubMed

    Patwardhan, Sachin V; Kaczvinsky, Joseph R; Joa, James F; Canfield, Douglas

    2013-07-01

    Differentiating inflammatory and non-inflammatory acne lesions and obtaining lesion counts is pivotal part of acne evaluation. Manual lesion counting has reliably demonstrated the clinical efficacy of anti-acne products for decades. However, maintaining assessment consistency within and across acne trials is an important consideration since lesion counting can be subjective to the individual evaluators, and the technique has not been rigorously standardized. VISIA-CR is a multi-spectral and multi-modal facial imaging system. It captures fluorescence images of Horn and Porphyrin, absorption images of Hemoglobin and Melanin, and skin texture and topography characterizing broad-spectrum polarized and non-polarized images. These images are analyzed for auto-classification of inflammatory and non-inflammatory acne lesion, measurement of erythema, and post-acne pigmentation changes. In this work the accuracy of this acne lesion auto-classification technique is demonstrated by comparing the auto-detected lesions counts with those counted by expert physicians. The accuracy is further substantiated by comparing and confirming the facial location and type of every auto-identified acne lesion with those identified by the physicians. Our results indicate a strong correlation between manual and auto-classified lesion counts (correlation coefficient >0.9) for both inflammatory and non inflammatory lesions This technology has the potential to eliminate the tedium of manual lesion counting, and provide an accurate, reproducible, and clinically relevant evaluation of acne lesions. As an aid to physicians it will allow development of a standardized technique for evaluating acne in clinical research, as well as accurately choosing treatment options for their patients according to the severity of a specific lesion type in clinical practice

  19. SYMPOSIUM ON MULTIMODALITY CARDIOVASCULAR MOLECULAR IMAGING IMAGING TECHNOLOGY - PART 2

    PubMed Central

    de Kemp, Robert A.; Epstein, Frederick H.; Catana, Ciprian; Tsui, Benjamin M.W.; Ritman, Erik L.

    2013-01-01

    Rationale The ability to trace or identify specific molecules within a specific anatomic location provides insight into metabolic pathways, tissue components and tracing of solute transport mechanisms. With the increasing use of small animals for research such imaging must have sufficiently high spatial resolution to allow anatomic localization as well as sufficient specificity and sensitivity to provide an accurate description of the molecular distribution and concentration. Methods Imaging methods based on electromagnetic radiation, such as PET, SPECT, MRI and CT, are increasingly applicable due to recent advances in novel scanner hardware, image reconstruction software and availability of novel molecules which have enhanced sensitivity in these methodologies. Results Micro-PET has been advanced by development of detector arrays that provide higher resolution and positron emitting elements that allow new molecular tracers to be labeled. Micro-MRI has been improved in terms of spatial resolution and sensitivity by increased magnet field strength and development of special purpose coils and associated scan protocols. Of particular interest is the associated ability to image local mechanical function and solute transport processes which can be directly related to the molecular information. This is further strengthened by the synergistic integration of the PET with MRI. Micro-SPECT has been improved by use of coded aperture imaging approaches as well as image reconstruction algorithms which can better deal with the photon limited scan data. The limited spatial resolution can be partially overcome by integrating the SPECT with CT. Micro-CT by itself provides exquisite spatial resolution of anatomy, but recent developments of high spatial resolution photon counting and spectrally-sensitive imaging arrays, combined with x-ray optical devices, have promise for actual molecular identification by virtue of the chemical bond lengths of molecules, especially of bio

  20. Self-imaging of orbital angular momentum (OAM) modes in rectangular multimode interference waveguides.

    PubMed

    Ma, Zelin; Chen, Hui; Wu, Kaiyi; Zhang, Yanfeng; Chen, Yujie; Yu, Siyuan

    2015-02-23

    We study the propagation of orbital angular momentum (OAM) modes in rectangular multimode waveguides. Due to the multimode interference effect, an OAM mode input forms self-images at certain propagation distances. As OAM modes can be decomposed as the superposition of a pair of quarter-wave phase-shifted even and odd modes, their symmetry properties lead to two different self-imaging categories - forming the OAM-maintaining and the field-splitting self-images. We analyze these phenomena using multimode interference theory, and establish the rules governing the OAM-maintaining self-imaging, which allows the multi-mode interference waveguides to be used as OAM mode splitters and couplers.

  1. 4D XCAT phantom for multimodality imaging research

    PubMed Central

    Segars, W. P.; Sturgeon, G.; Mendonca, S.; Grimes, Jason; Tsui, B. M. W.

    2010-01-01

    Purpose: The authors develop the 4D extended cardiac-torso (XCAT) phantom for multimodality imaging research. Methods: Highly detailed whole-body anatomies for the adult male and female were defined in the XCAT using nonuniform rational B-spline (NURBS) and subdivision surfaces based on segmentation of the Visible Male and Female anatomical datasets from the National Library of Medicine as well as patient datasets. Using the flexibility of these surfaces, the Visible Human anatomies were transformed to match body measurements and organ volumes for a 50th percentile (height and weight) male and female. The desired body measurements for the models were obtained using the PEOPLESIZE program that contains anthropometric dimensions categorized from 1st to the 99th percentile for US adults. The desired organ volumes were determined from ICRP Publication 89 [ICRP, ‘‘Basic anatomical and physiological data for use in radiological protection: reference values,” ICRP Publication 89 (International Commission on Radiological Protection, New York, NY, 2002)]. The male and female anatomies serve as standard templates upon which anatomical variations may be modeled in the XCAT through user-defined parameters. Parametrized models for the cardiac and respiratory motions were also incorporated into the XCAT based on high-resolution cardiac- and respiratory-gated multislice CT data. To demonstrate the usefulness of the phantom, the authors show example simulation studies in PET, SPECT, and CT using publicly available simulation packages. Results: As demonstrated in the pilot studies, the 4D XCAT (which includes thousands of anatomical structures) can produce realistic imaging data when combined with accurate models of the imaging process. With the flexibility of the NURBS surface primitives, any number of different anatomies, cardiac or respiratory motions or patterns, and spatial resolutions can be simulated to perform imaging research. Conclusions: With the ability to produce

  2. 4D XCAT phantom for multimodality imaging research

    SciTech Connect

    Segars, W. P.; Sturgeon, G.; Mendonca, S.; Grimes, Jason; Tsui, B. M. W.

    2010-09-15

    Purpose: The authors develop the 4D extended cardiac-torso (XCAT) phantom for multimodality imaging research. Methods: Highly detailed whole-body anatomies for the adult male and female were defined in the XCAT using nonuniform rational B-spline (NURBS) and subdivision surfaces based on segmentation of the Visible Male and Female anatomical datasets from the National Library of Medicine as well as patient datasets. Using the flexibility of these surfaces, the Visible Human anatomies were transformed to match body measurements and organ volumes for a 50th percentile (height and weight) male and female. The desired body measurements for the models were obtained using the PEOPLESIZE program that contains anthropometric dimensions categorized from 1st to the 99th percentile for US adults. The desired organ volumes were determined from ICRP Publication 89 [ICRP, ''Basic anatomical and physiological data for use in radiological protection: reference values,'' ICRP Publication 89 (International Commission on Radiological Protection, New York, NY, 2002)]. The male and female anatomies serve as standard templates upon which anatomical variations may be modeled in the XCAT through user-defined parameters. Parametrized models for the cardiac and respiratory motions were also incorporated into the XCAT based on high-resolution cardiac- and respiratory-gated multislice CT data. To demonstrate the usefulness of the phantom, the authors show example simulation studies in PET, SPECT, and CT using publicly available simulation packages. Results: As demonstrated in the pilot studies, the 4D XCAT (which includes thousands of anatomical structures) can produce realistic imaging data when combined with accurate models of the imaging process. With the flexibility of the NURBS surface primitives, any number of different anatomies, cardiac or respiratory motions or patterns, and spatial resolutions can be simulated to perform imaging research. Conclusions: With the ability to produce

  3. Multimodality imaging in macular telangiectasia 2: A clue to its pathogenesis

    PubMed Central

    Wu, Lihteh

    2015-01-01

    Macular telangiectasia type 2 also known as idiopathic perifoveal telangiectasia and juxtafoveolar retinal telangiectasis type 2A is an acquired bilateral neurodegenerative macular disease that manifests itself during the fifth or sixth decades of life. It is characterized by minimal dilatation of the parafoveal capillaries with graying of the retinal area involved, a lack of lipid exudation, right-angled retinal venules, refractile deposits in the superficial retina, hyperplasia of the retinal pigment epithelium, foveal atrophy, and subretinal neovascularization (SRNV). Our understanding of the disease has paralleled advances in multimodality imaging of the fundus. Optical coherence tomography (OCT) images typically demonstrate the presence of intraretinal hyporeflective spaces that are usually not related to retinal thickening or fluorescein leakage. The typical fluorescein angiographic (FA) finding is a deep intraretinal hyperfluorescent staining in the temporal parafoveal area. With time, the staining may involve the whole parafoveal area but does not extend to the center of the fovea. Long-term prognosis for central vision is poor, because of the development of SRNV or macular atrophy. Its pathogenesis remains unclear but multimodality imaging with FA, spectral domain OCT, adaptive optics, confocal blue reflectance and short wave fundus autofluorescence implicate Müller cells and macular pigment. Currently, there is no known treatment for this condition. PMID:26139799

  4. Towards analysis of growth trajectory through multimodal longitudinal MR imaging

    NASA Astrophysics Data System (ADS)

    Sadeghi, Neda; Prastawa, Marcel; Gilmore, John H.; Lin, Weili; Gerig, Guido

    2010-03-01

    The human brain undergoes significant changes in the first few years after birth, but knowledge about this critical period of development is quite limited. Previous neuroimaging studies have been mostly focused on morphometric measures such as volume and shape, although tissue property measures related to the degree of myelination and axon density could also add valuable information to our understanding of brain maturation. Our goal is to complement brain growth analysis via morphometry with the study of longitudinal tissue property changes as reflected in patterns observed in multi-modal structural MRI and DTI. Our preliminary study includes eight healthy pediatric subjects with repeated scans at the age of two weeks, one year, and two years with T1, T2, PD, and DT MRI. Analysis is driven by the registration of multiple modalities and time points within and between subjects into a common coordinate frame, followed by image intensity normalization. Quantitative tractography with diffusion and structural image parameters serves for multi-variate tissue analysis. Different patterns of rapid changes were observed in the corpus callosum and the posterior and anterior internal capsule, structures known for distinctly different myelination growth. There are significant differences in central versus peripheral white matter. We demonstrate that the combined longitudinal analysis of structural and diffusion MRI proves superior to individual modalities and might provide a better understanding of the trajectory of early neurodevelopment.

  5. Multimodal nonlinear optical imaging of cartilage development in mouse model

    NASA Astrophysics Data System (ADS)

    He, Sicong; Xue, Wenqian; Sun, Qiqi; Li, Xuesong; Huang, Jiandong; Qu, Jianan Y.

    2017-02-01

    Kinesin-1 is a kind of motor protein responsible for intracellular transportation and has been studied in a variety of tissues. However, its roles in cartilage development are not clear. In this study, a kinesin-1 heavy chain (Kif5b) knockout mouse model is used to study the functions of kinesin-1 in the cartilage development. We developed a multimodal nonlinear optical (NLO) microscope system integrating stimulated Raman scattering (SRS), second harmonic generation (SHG) and two-photon excited fluorescence (TPEF) to investigate the morphological and biomedical characteristics of fresh tibial cartilage from normal and mutant mice at different developmental stages. The combined forward and backward SHG imaging resolved the fine structure of collagen fibrils in the extracellular matrix of cartilage. Meanwhile, the chondrocyte morphology in different zones of cartilage was visualized by label-free SRS and TPEF images. The results show that the fibrillar collagen in the superficial zone of cartilage in postnatal day 10 and 15 (P10 and P15) knockout mice was significantly less than that of control mice. Moreover, we observed distorted morphology and disorganization of columnar arrangement of chondrocytes in the growth plate cartilage of mutant mice. This study reveals the significant roles of kinesin-1 in collagen formation and chondrocyte morphogenesis.

  6. Hierarchical multimodal tomographic x-ray imaging at a superbend

    NASA Astrophysics Data System (ADS)

    Stampanoni, M.; Marone, F.; Mikuljan, G.; Jefimovs, K.; Trtik, P.; Vila-Comamala, J.; David, C.; Abela, R.

    2008-08-01

    Over the last decade, synchrotron-based X-ray tomographic microscopy has established itself as a fundamental tool for non-invasive, quantitative investigations of a broad variety of samples, with application ranging from space research and materials science to biology and medicine. Thanks to the brilliance of modern third generation sources, voxel sizes in the micrometer range are routinely achieved by the major X-ray microtomography devices around the world, while the isotropic 100 nm barrier is reached and trespassed only by few instruments. The beamline for TOmographic Microscopy and Coherent rAdiology experiments (TOMCAT) of the Swiss Light Source at the Paul Scherrer Institut, operates a multimodal endstation which offers tomographic capabilities in the micrometer range in absorption contrast - of course - as well as phase contrast imaging. Recently, the beamline has been equipped with a full field, hard X-rays microscope with a theoretical pixel size down to 30 nm and a field of view of 50 microns. The nanoscope performs well at X-ray energies between 8 and 12 keV, selected from the white beam of a 2.9 T superbend by a [Ru/C]100 fixed exit multilayer monochromator. In this work we illustrate the experimental setup dedicated to the nanoscope, in particular the ad-hoc designed X-ray optics needed to produce a homogeneous, square illumination of the sample imaging plane as well as the magnifying zone plate. Tomographic reconstructions at 60 nm voxel size will be shown and discussed.

  7. Multimodality medical image database for temporal lobe epilepsy

    NASA Astrophysics Data System (ADS)

    Siadat, Mohammad-Reza; Soltanian-Zadeh, Hamid; Fotouhi, Farshad A.; Elisevich, Kost

    2003-05-01

    This paper presents the development of a human brain multi-modality database for surgical candidacy determination in temporal lobe epilepsy. The focus of the paper is on content-based image management, navigation and retrieval. Several medical image-processing methods including our newly developed segmentation method are utilized for information extraction/correlation and indexing. The input data includes T1-, T2-Weighted and FLAIR MRI and ictal/interictal SPECT modalities with associated clinical data and EEG data analysis. The database can answer queries regarding issues such as the correlation between the attribute X of the entity Y and the outcome of a temporal lobe epilepsy surgery. The entity Y can be a brain anatomical structure such as the hippocampus. The attribute X can be either a functionality feature of the anatomical structure Y, calculated with SPECT modalities, such as signal average, or a volumetric/morphological feature of the entity Y such as volume or average curvature. The outcome of the surgery can be any surgery assessment such as non-verbal Wechsler memory quotient. A determination is made regarding surgical candidacy by analysis of both textual and image data. The current database system suggests a surgical determination for the cases with relatively small hippocampus and high signal intensity average on FLAIR images within the hippocampus. This indication matches the neurosurgeons expectations/observations. Moreover, as the database gets more populated with patient profiles and individual surgical outcomes, using data mining methods one may discover partially invisible correlations between the contents of different modalities of data and the outcome of the surgery.

  8. Integrated scanning laser ophthalmoscopy and optical coherence tomography for quantitative multimodal imaging of retinal degeneration and autofluorescence

    NASA Astrophysics Data System (ADS)

    Issaei, Ali; Szczygiel, Lukasz; Hossein-Javaheri, Nima; Young, Mei; Molday, L. L.; Molday, R. S.; Sarunic, M. V.

    2011-03-01

    Scanning Laser Ophthalmoscopy (SLO) and Coherence Tomography (OCT) are complimentary retinal imaging modalities. Integration of SLO and OCT allows for both fluorescent detection and depth- resolved structural imaging of the retinal cell layers to be performed in-vivo. System customization is required to image rodents used in medical research by vision scientists. We are investigating multimodal SLO/OCT imaging of a rodent model of Stargardt's Macular Dystrophy which is characterized by retinal degeneration and accumulation of toxic autofluorescent lipofuscin deposits. Our new findings demonstrate the ability to track fundus autofluorescence and retinal degeneration concurrently.

  9. Multimodal Imaging of Brain Connectivity Using the MIBCA Toolbox: Preliminary Application to Alzheimer's Disease

    NASA Astrophysics Data System (ADS)

    Ribeiro, André Santos; Lacerda, Luís Miguel; Silva, Nuno André da; Ferreira, Hugo Alexandre

    2015-06-01

    The Multimodal Imaging Brain Connectivity Analysis (MIBCA) toolbox is a fully automated all-in-one connectivity analysis toolbox that offers both pre-processing, connectivity, and graph theory analysis of multimodal images such as anatomical, diffusion, and functional MRI, and PET. In this work, the MIBCA functionalities were used to study Alzheimer's Disease (AD) in a multimodal MR/PET approach. Materials and Methods: Data from 12 healthy controls, and 36 patients with EMCI, LMCI and AD (12 patients for each group) were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu), including T1-weighted (T1-w), Diffusion Tensor Imaging (DTI) data, and 18F-AV-45 (florbetapir) dynamic PET data from 40-60 min post injection (4x5 min). Both MR and PET data were automatically pre-processed for all subjects using MIBCA. T1-w data was parcellated into cortical and subcortical regions-of-interest (ROIs), and the corresponding thicknesses and volumes were calculated. DTI data was used to compute structural connectivity matrices based on fibers connecting pairs of ROIs. Lastly, dynamic PET images were summed, and the relative Standard Uptake Values calculated for each ROI. Results: An overall higher uptake of 18F-AV-45, consistent with an increased deposition of beta-amyloid, was observed for the AD group. Additionally, patients showed significant cortical atrophy (thickness and volume) especially in the entorhinal cortex and temporal areas, and a significant increase in Mean Diffusivity (MD) in the hippocampus, amygdala and temporal areas. Furthermore, patients showed a reduction of fiber connectivity with the progression of the disease, especially for intra-hemispherical connections. Conclusion: This work shows the potential of the MIBCA toolbox for the study of AD, as findings were shown to be in agreement with the literature. Here, only structural changes and beta-amyloid accumulation were considered. Yet, MIBCA is further able to

  10. A new region descriptor for multi-modal medical image registration and region detection.

    PubMed

    Xiaonan Wan; Dongdong Yu; Feng Yang; Caiyun Yang; Chengcai Leng; Min Xu; Jie Tian

    2015-08-01

    Establishing accurate anatomical correspondences plays a critical role in multi-modal medical image registration and region detection. Although many features based registration methods have been proposed to detect these correspondences, they are mostly based on the point descriptor which leads to high memory cost and could not represent local region information. In this paper, we propose a new region descriptor which depicts the features in each region, instead of in each point, as a vector. First, feature attributes of each point are extracted by a Gabor filter bank combined with a gradient filter. Then, the region descriptor is defined as the covariance of feature attributes of each point inside the region, based on which a cost function is constructed for multi-modal image registration. Finally, our proposed region descriptor is applied to both multi-modal region detection and similarity metric measurement in multi-modal image registration. Experiments demonstrate the feasibility and effectiveness of our proposed region descriptor.

  11. Multimodal Task-Driven Dictionary Learning for Image Classification.

    PubMed

    Bahrampour, Soheil; Nasrabadi, Nasser M; Ray, Asok; Jenkins, William Kenneth

    2016-01-01

    Dictionary learning algorithms have been successfully used for both reconstructive and discriminative tasks, where an input signal is represented with a sparse linear combination of dictionary atoms. While these methods are mostly developed for single-modality scenarios, recent studies have demonstrated the advantages of feature-level fusion based on the joint sparse representation of the multimodal inputs. In this paper, we propose a multimodal task-driven dictionary learning algorithm under the joint sparsity constraint (prior) to enforce collaborations among multiple homogeneous/heterogeneous sources of information. In this task-driven formulation, the multimodal dictionaries are learned simultaneously with their corresponding classifiers. The resulting multimodal dictionaries can generate discriminative latent features (sparse codes) from the data that are optimized for a given task such as binary or multiclass classification. Moreover, we present an extension of the proposed formulation using a mixed joint and independent sparsity prior, which facilitates more flexible fusion of the modalities at feature level. The efficacy of the proposed algorithms for multimodal classification is illustrated on four different applications--multimodal face recognition, multi-view face recognition, multi-view action recognition, and multimodal biometric recognition. It is also shown that, compared with the counterpart reconstructive-based dictionary learning algorithms, the task-driven formulations are more computationally efficient in the sense that they can be equipped with more compact dictionaries and still achieve superior performance.

  12. Biodistribution of arctigenin-loaded nanoparticles designed for multimodal imaging.

    PubMed

    Cui, Qingxin; Hou, Yuanyuan; Wang, Yanan; Li, Xu; Liu, Yang; Ma, Xiaoyao; Wang, Zengyong; Wang, Weiya; Tao, Jin; Wang, Qian; Jiang, Min; Chen, Dongyan; Feng, Xizeng; Bai, Gang

    2017-04-07

    Tracking targets of natural products is one of the most challenging issues in fields ranging from pharmacognosy to biomedicine. It is widely recognized that the biocompatible nanoparticle (NP) could function as a "key" that opens the target "lock". We report a functionalized poly-lysine NP technique that can monitor the target protein of arctigenin (ATG) in vivo non-invasively. The NPs were synthesized, and their morphologies and surface chemical properties were characterized by transmission electron microscopy (TEM), laser particle size analysis and atomic force microscopy (AFM). In addition, we studied the localization of ATG at the level of the cell and the whole animal (zebrafish and mice). We demonstrated that fluorescent NPs could be ideal carriers in the development of a feasible method for target identification. The distributions of the target proteins were found to be consistent with the pharmacological action of ATG at the cellular and whole-organism levels. The results indicated that functionalized poly-lysine NPs could be valuable in the multimodal imaging of arctigenin.

  13. Hierarchical segmentation-assisted multimodal registration for MR brain images.

    PubMed

    Lu, Huanxiang; Beisteiner, Roland; Nolte, Lutz-Peter; Reyes, Mauricio

    2013-04-01

    Information theory-based metric such as mutual information (MI) is widely used as similarity measurement for multimodal registration. Nevertheless, this metric may lead to matching ambiguity for non-rigid registration. Moreover, maximization of MI alone does not necessarily produce an optimal solution. In this paper, we propose a segmentation-assisted similarity metric based on point-wise mutual information (PMI). This similarity metric, termed SPMI, enhances the registration accuracy by considering tissue classification probabilities as prior information, which is generated from an expectation maximization (EM) algorithm. Diffeomorphic demons is then adopted as the registration model and is optimized in a hierarchical framework (H-SPMI) based on different levels of anatomical structure as prior knowledge. The proposed method is evaluated using Brainweb synthetic data and clinical fMRI images. Both qualitative and quantitative assessment were performed as well as a sensitivity analysis to the segmentation error. Compared to the pure intensity-based approaches which only maximize mutual information, we show that the proposed algorithm provides significantly better accuracy on both synthetic and clinical data.

  14. The Role of Multimodality Cardiac Imaging for the Assessment of Sports Eligibility in Patients with Bicuspid Aortic Valve

    PubMed Central

    D’Andrea, Antonello; Corte, Alessandro Della; Padalino, Roberto; Limongelli, Giuseppe; Scarafile, Raffaella; Fratta, Fiorella; Pezzullo, Enrica; Fusco, Adelaide; Pisacane, Francesca; Coppola, Guido; Caso, Pio; Calabrò, Raffaele; Russo, Maria Giovanna

    2015-01-01

    Bicuspid aortic valve (BAV) cannot be considered an innocent finding, but it is not necessarily a life-threatening condition. Athletes with BAV should undergo a thorough staging of the valve anatomy, taking into consideration hemodynamic factors, as well as aortic diameters and looking for other associated significant cardiovascular anomalies by use of a multimodality cardiac imaging approach. Furthermore an accurate follow-up is mandatory with serial cardiological controls in those allowed to continue sports. PMID:28465922

  15. Multimodal Nonlinear Optical Microscopy and Applications to Central Nervous System Imaging

    PubMed Central

    Huff, Terry B.; Shi, Yunzhou; Fu, Yan; Wang, Haifeng; Cheng, Ji-Xin

    2009-01-01

    Multimodal nonlinear optical (NLO) imaging is poised to become a powerful tool in bioimaging given its ability to capitalize on the unique advantages possessed by different NLO imaging modalities. The integration of different imaging modalities such as two-photon-excited fluorescence, sum frequency generation, and coherent anti-Stokes Raman scattering on the same platform can facilitate simultaneous imaging of different biological structures. Parameters to be considered in constructing a multimodal NLO microscope are discussed with emphasis on achieving a compromise in these parameters for efficient signal generation with each imaging modality. As an example of biomedical applications, multimodal NLO imaging is utilized to investigate the central nervous system in healthy and diseased states. PMID:19829746

  16. TU-C-BRD-01: Image Guided SBRT I: Multi-Modality 4D Imaging

    SciTech Connect

    Cai, J; Mageras, G; Pan, T

    2014-06-15

    Motion management is one of the critical technical challenges for radiation therapy. 4D imaging has been rapidly adopted as essential tool to assess organ motion associated with respiratory breathing. A variety of 4D imaging techniques have been developed and are currently under development based on different imaging modalities such as CT, MRI, PET, and CBCT. Each modality provides specific and complementary information about organ and tumor respiratory motion. Effective use of each different technique or combined use of different techniques can introduce a comprehensive management of tumor motion. Specifically, these techniques have afforded tremendous opportunities to better define and delineate tumor volumes, more accurately perform patient positioning, and effectively apply highly conformal therapy techniques such as IMRT and SBRT. Successful implementation requires good understanding of not only each technique, including unique features, limitations, artifacts, imaging acquisition and process, but also how to systematically apply the information obtained from different imaging modalities using proper tools such as deformable image registration. Furthermore, it is important to understand the differences in the effects of breathing variation between different imaging modalities. A comprehensive motion management strategy using multi-modality 4D imaging has shown promise in improving patient care, but at the same time faces significant challenges. This session will focuses on the current status and advances in imaging respiration-induced organ motion with different imaging modalities: 4D-CT, 4D-MRI, 4D-PET, and 4D-CBCT/DTS. Learning Objectives: Understand the need and role of multimodality 4D imaging in radiation therapy. Understand the underlying physics behind each 4D imaging technique. Recognize the advantages and limitations of each 4D imaging technique.

  17. A multimodal image sensor system for identifying water stress in grapevines

    NASA Astrophysics Data System (ADS)

    Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

    2012-11-01

    Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

  18. An innovative multimodal/multispectral image registration method for medical images based on the Expectation-Maximization algorithm.

    PubMed

    Arce-Santana, Edgar; Campos-Delgado, Daniel U; Mejia-Rodriguez, Aldo; Reducindo, Isnardo

    2015-01-01

    In this paper, we present a methodology for multimodal/ multispectral image registration of medical images. This approach is formulated by using the Expectation-Maximization (EM) methodology, such that we estimate the parameters of a geometric transformation that aligns multimodal/multispectral images. In this framework, the hidden random variables are associated to the intensity relations between the studied images, which allow to compare multispectral intensity values between images of different modalities. The methodology is basically composed by an iterative two-step procedure, where at each step, a new estimation of the joint conditional multispectral intensity distribution and the geometric transformation is computed. The proposed algorithm was tested with different kinds of medical images, and the obtained results show that the proposed methodology can be used to efficiently align multimodal/multispectral medical images.

  19. Non-linear multimodal imaging for disease diagnostics and treatment monitoring

    NASA Astrophysics Data System (ADS)

    Bocklitz, Thomas; Schmitt, Michael; Lukić, Aleksandar; Heuke, Sandro; Chernavskaia, Olga; Meyer, Tobias; Popp, Jürgen

    2017-04-01

    Molecular imaging modalities, like multimodal imaging, e.g. the combination of coherent-anti-Stokes Raman scattering (CARS), second-harmonic generation (SHG) and two-photon-excited fluorescence (TPEF), feature a unique potential for disease diagnostics and treatment monitoring. In order to use the full potential of multi-modal imaging for diagnostic tasks powerful image analysis methods are necessary, which translate the physical measurements into medical meaningful information. This translation process requires standardization, correction procedures and statistical models like regression or classification models. With the help of these techniques medical relevant information can be extracted and used for the diagnostics of cancer or inflammation related diseases.

  20. Multimodality imaging of ovarian cystic lesions: Review with an imaging based algorithmic approach

    PubMed Central

    Wasnik, Ashish P; Menias, Christine O; Platt, Joel F; Lalchandani, Usha R; Bedi, Deepak G; Elsayes, Khaled M

    2013-01-01

    Ovarian cystic masses include a spectrum of benign, borderline and high grade malignant neoplasms. Imaging plays a crucial role in characterization and pretreatment planning of incidentally detected or suspected adnexal masses, as diagnosis of ovarian malignancy at an early stage is correlated with a better prognosis. Knowledge of differential diagnosis, imaging features, management trends and an algorithmic approach of such lesions is important for optimal clinical management. This article illustrates a multi-modality approach in the diagnosis of a spectrum of ovarian cystic masses and also proposes an algorithmic approach for the diagnosis of these lesions. PMID:23671748

  1. A hybrid multimodal non-rigid registration of MR images based on diffeomorphic demons.

    PubMed

    Lu, Huanxiang; Cattin, Philippe C; Reyes, Mauricio

    2010-01-01

    In this paper we present a novel hybrid approach for multimodal medical image registration based on diffeomorphic demons. Diffeomorphic demons have proven to be a robust and efficient way for intensity-based image registration. A very recent extension even allows to use mutual information (MI) as a similarity measure to registration multimodal images. However, due to the intensity correspondence uncertainty existing in some anatomical parts, it is difficult for a purely intensity-based algorithm to solve the registration problem. Therefore, we propose to combine the resulting transformations from both intensity-based and landmark-based methods for multimodal non-rigid registration based on diffeomorphic demons. Several experiments on different types of MR images were conducted, for which we show that a better anatomical correspondence between the images can be obtained using the hybrid approach than using either intensity information or landmarks alone.

  2. Multimodal backside imaging of a microcontroller using confocal laser scanning and optical-beam-induced current imaging

    NASA Astrophysics Data System (ADS)

    Finkeldey, Markus; Göring, Lena; Schellenberg, Falk; Brenner, Carsten; Gerhardt, Nils C.; Hofmann, Martin

    2017-02-01

    Microscopy imaging with a single technology is usually restricted to a single contrast mechanism. Multimodal imaging is a promising technique to improve the structural information that could be obtained about a device under test (DUT). Due to the different contrast mechanisms of laser scanning microscopy (LSM), confocal laser scanning microscopy (CLSM) and optical beam induced current microscopy (OBICM), a combination could improve the detection of structures in integrated circuits (ICs) and helps to reveal their layout. While OBIC imaging is sensitive to the changes between differently doped areas and to semiconductor-metal transitions, CLSM imaging is mostly sensitive to changes in absorption and reflection. In this work we present the implementation of OBIC imaging into a CLSM. We show first results using industry standard Atmel microcontrollers (MCUs) with a feature size of about 250nm as DUTs. Analyzing these types of microcontrollers helps to improve in the field of side-channel attacks to find hardware Trojans, possible spots for laser fault attacks and for reverse engineering. For the experimental results the DUT is placed on a custom circuit board that allows us to measure the current while imaging it in our in-house built stage scanning microscope using a near infrared (NIR) laser diode as light source. The DUT is thinned and polished, allowing backside imaging through the Si-substrate. We demonstrate the possibilities using this optical setup by evaluating OBIC, LSM and CLSM images above and below the threshold of the laser source.

  3. Concurrent multimodality image segmentation by active contours for radiotherapy treatment planning

    SciTech Connect

    El Naqa, Issam; Yang Deshan; Apte, Aditya; Khullar, Divya; Mutic, Sasa; Zheng Jie; Bradley, Jeffrey D.; Grigsby, Perry; Deasy, Joseph O.

    2007-12-15

    Multimodality imaging information is regularly used now in radiotherapy treatment planning for cancer patients. The authors are investigating methods to take advantage of all the imaging information available for joint target registration and segmentation, including multimodality images or multiple image sets from the same modality. In particular, the authors have developed variational methods based on multivalued level set deformable models for simultaneous 2D or 3D segmentation of multimodality images consisting of combinations of coregistered PET, CT, or MR data sets. The combined information is integrated to define the overall biophysical structure volume. The authors demonstrate the methods on three patient data sets, including a nonsmall cell lung cancer case with PET/CT, a cervix cancer case with PET/CT, and a prostate patient case with CT and MRI. CT, PET, and MR phantom data were also used for quantitative validation of the proposed multimodality segmentation approach. The corresponding Dice similarity coefficient (DSC) was 0.90{+-}0.02 (p<0.0001) with an estimated target volume error of 1.28{+-}1.23% volume. Preliminary results indicate that concurrent multimodality segmentation methods can provide a feasible and accurate framework for combining imaging data from different modalities and are potentially useful tools for the delineation of biophysical structure volumes in radiotherapy treatment planning.

  4. Multimodality PET/MR imaging agents targeted to activated macrophages

    PubMed Central

    Tu, Chuqiao; Ng, Thomas S. C.; Jacobs, Russell E.; Louie, Angelique Y.

    2013-01-01

    The recent emergence of multimodality imaging, particularly the combination of PET and MRI, has led to excitement over the prospect of improving detection of disease. Iron oxide nanoparticles (IONPs) have become a popular platform for the fabrication of PET/MRI probes due to their advantages of high MRI detection sensitivity, biocompatibility, and biodegradability. In this paper, we report the synthesis of dextran coated iron oxide nanoparticles labeled with the positron emitter 64Cu to generate a PET/MRI probe, and modified with small molecular maleic anhydride to increase negative surface charge. The modified nanoparticulate PET/MRI probe (MDIO-64Cu-DOTA) bears repetitive anionic charges on the surface that facilitate recognition by scavenger receptor type A (SR-A), a ligand-receptor found on activated macrophages but not on normal vessel walls. MDIO-64Cu-DOTA has an average iron oxide core size of 7-8 nm, an average hydrodynamic diameter of 62.7 nm, an r1 relaxivity of 16.8 mM−1·s−1, and an r2 relaxivity of 83.9 mM−1·s−1 (37 °C, 1.4 T). Cell studies confirmed that the probe was nontoxic and was specifically taken up by macrophages via SR-A. In comparison with the non-modified analog, the accumulation of maleylated DIO in macrophages was substantially improved. These characteristics demonstrate the promise of MDIO-64Cu-DOTA for identification of vulnerable atherosclerotic plaques (VAP) via the targeting of macrophages. PMID:24166283

  5. Manifold-based feature point matching for multi-modal image registration.

    PubMed

    Hu, Liang; Wang, Manning; Song, Zhijian

    2013-03-01

    Images captured using different modalities usually have significant variations in their intensities, which makes it difficult to reveal their internal structural similarities and achieve accurate registration. Most conventional feature-based image registration techniques are fast and efficient, but they cannot be used directly for the registration of multi-modal images because of these intensity variations. This paper introduces the theory of manifold learning to transform the original images into mono-modal modalities, which is a feature-based method that is applicable to multi-modal image registration. Subsequently, scale-invariant feature transform is used to detect highly distinctive local descriptors and matches between corresponding images, and a point-based registration is executed. The algorithm was tested with T1- and T2-weighted magnetic resonance (MR) images obtained from BrainWeb. Both qualitative and quantitative evaluations of the method were performed and the results compared with those produced previously. The experiments showed that feature point matching after manifold learning achieved more accurate results than did the similarity measure for multi-modal image registration. This study provides a new manifold-based feature point matching method for multi-modal medical image registration, especially for MR images. The proposed method performs better than do conventional intensity-based techniques in terms of its registration accuracy and is suitable for clinical procedures. Copyright © 2012 John Wiley & Sons, Ltd.

  6. Multimodal image coregistration and inducible selective cell ablation to evaluate imaging ligands.

    PubMed

    Virostko, John; Henske, Joseph; Vinet, Laurent; Lamprianou, Smaragda; Dai, Chunhua; Radhika, Aramandla; Baldwin, Ronald M; Ansari, Mohammad S; Hefti, Franz; Skovronsky, Daniel; Kung, Hank F; Herrera, Pedro L; Peterson, Todd E; Meda, Paolo; Powers, Alvin C

    2011-12-20

    We combined multimodal imaging (bioluminescence, X-ray computed tomography, and PET), tomographic reconstruction of bioluminescent sources, and two unique, complementary models to evaluate three previously synthesized PET radiotracers thought to target pancreatic beta cells. The three radiotracers {[(18)F]fluoropropyl-(+)-dihydrotetrabenazine ([(18)F]FP-DTBZ), [(18)F](+)-2-oxiranyl-3-isobutyl-9-(3-fluoropropoxy)-10-methoxy-2,3,4,6,7,11b-hexahydro-1H-pyrido[2,1-a]isoquinoline ((18)F-AV-266), and (2S,3R,11bR)-9-(3-fluoropropoxy)-2-(hydroxymethyl)-3-isobutyl-10-methoxy-2,3,4,6,7,11b-hexahydro-1H-pyrido[2,1-a]isoquinolin-2-ol ((18)F-AV-300)} bind vesicular monoamine transporter 2. Tomographic reconstruction of the bioluminescent signal in mice expressing luciferase only in pancreatic beta cells was used to delineate the pancreas and was coregistered with PET and X-ray computed tomography images. This strategy enabled unambiguous identification of the pancreas on PET images, permitting accurate quantification of the pancreatic PET signal. We show here that, after conditional, specific, and rapid mouse beta-cell ablation, beta-cell loss was detected by bioluminescence imaging but not by PET imaging, given that the pancreatic signal provided by three PET radiotracers was not altered. To determine whether these ligands bound human beta cells in vivo, we imaged mice transplanted with luciferase-expressing human islets. The human islets were imaged by bioluminescence but not with the PET ligands, indicating that these vesicular monoamine transporter 2-directed ligands did not specifically bind beta cells. These data demonstrate the utility of coregistered multimodal imaging as a platform for evaluation and validation of candidate ligands for imaging islets.

  7. Multimodal image analysis of the retina in Hunter syndrome (mucopolysaccharidosis type II): Case report.

    PubMed

    Salvucci, Isadora Darriba Macedo; Finzi, Simone; Oyamada, Maria Kiyoko; Kim, Chong Ae; Pimentel, Sérgio Luis Gianotti

    2017-08-18

    We report a case of retinal and posterior ocular findings in a 33-year-old man diagnosed with Hunter syndrome (Mucopolysaccharidosis type II) in a multimodal imaging way. Our patient was complaining of blurred night vision for the past 3 years. He had not received any systemic treatment for Hunter syndrome. Vision acuity was 20/20 in both eyes and corneas were clear. Fundus examination revealed bilateral crowded and hyperemic optic nerve heads (elevated in the ocular ultrasound) and areas of subretinal hypopigmentation. There was hyperautofluorescence at the central fovea and perifovea, and a diffuse bilateral choroidal fluorescence in angiography. Macular SD-OCT showed a thinning of the external retina at the perifovea in both eyes. Visual field testing showed a bilateral ring scotoma. The full field ERG was subnormal, with a negative response in the scotopic phase. Visual Evoked Potencial test and cranial MRI were normal. Our multimodal analysis reported here attempted to contribute to the knowledge of the natural history of GAG deposition in the eye, focusing on the retina and retinal pigment epithelium. Defining this natural history is essential for a proper comparison with Hunter patients receiving systemic treatment, thus determining if it can or cannot improve retinal function in humans with this disorder.

  8. Rapid diagnosis of liver fibrosis using multimodal multiphoton nonlinear optical microspectroscopy imaging.

    PubMed

    Lee, Jang Hyuk; Kim, Jong Chul; Tae, Giyoong; Oh, Myoung-Kyu; Ko, Do-Kyeong

    2013-07-01

    A multimodal multiphoton nonlinear optical (NLO) microspectroscopy imaging system was developed using a femtosecond laser and a photonic crystal fiber. Coherent anti-Stokes Raman scattering (CARS) microspectroscopy was combined with two-photon excitation fluorescence and second-harmonic generation microscopy in one platform and the system was applied to diagnose liver fibrosis. Normal and liver fibrosis tissues were clearly distinguished with the great difference from CARS spectra as well as multimodal multiphoton NLO images. We expect the system to be a rapid diagnosis tool for liver fibrosis at tissue level with label-free imaging of significant biochemical components.

  9. Carbon Tube Electrodes for Electrocardiography-Gated Cardiac Multimodality Imaging in Mice

    PubMed Central

    Choquet, Philippe; Goetz, Christian; Aubertin, Gaelle; Hubele, Fabrice; Sannié, Sébastien; Constantinesco, André

    2011-01-01

    This report describes a simple design of noninvasive carbon tube electrodes that facilitates electrocardiography (ECG) in mice during cardiac multimodality preclinical imaging. Both forepaws and the left hindpaw, covered by conductive gel, of mice were placed into the openings of small carbon tubes. Cardiac ECG-gated single-photon emission CT, X-ray CT, and MRI were tested (n = 60) in 20 mice. For all applications, electrodes were used in a warmed multimodality imaging cell. A heart rate of 563 ± 48 bpm was recorded from anesthetized mice regardless of the imaging technique used, with acquisition times ranging from 1 to 2 h. PMID:21333165

  10. Multimodality approach for imaging of non-traumatic acute abdominal emergencies.

    PubMed

    Gangadhar, Kiran; Kielar, Ania; Dighe, Manjiri K; O'Malley, Ryan; Wang, Carolyn; Gross, Joel A; Itani, Malak; Lalwani, Neeraj

    2016-01-01

    "Acute abdomen" includes spectrum of medical and surgical conditions ranging from a less severe to life-threatening conditions in a patient presenting with severe abdominal pain that develops over a period of hours. Accurate and rapid diagnosis of these conditions helps in reducing related complications. Clinical assessment is often difficult due to availability of over-the-counter analgesics, leading to less specific physical findings. The key clinical decision is to determine whether surgical intervention is required. Laboratory and conventional radiographic findings are often non-specific. Thus, cross-sectional imaging plays a pivotal role for helping direct management of acute abdomen. Computed tomography is the primary imaging modality used for these cases due to fast image acquisition, although US is more specific for conditions such as acute cholecystitis. Magnetic resonance imaging or ultrasound is very helpful in patients who are particularly sensitive to radiation exposure, such as pregnant women and pediatric patients. In addition, MRI is an excellent problem-solving modality in certain conditions such as assessment for choledocholithiasis in patients with right upper quadrant pain. In this review, we discuss a multimodality approach for the usual causes of non-traumatic acute abdomen including acute appendicitis, diverticulitis, cholecystitis, and small bowel obstruction. A brief review of other relatively less frequent but important causes of acute abdomen, such as perforated viscus and bowel ischemia, is also included.

  11. Finding text in color images

    NASA Astrophysics Data System (ADS)

    Zhou, Jiangying; Lopresti, Daniel P.; Tasdizen, Tolga

    1998-04-01

    In this paper, we consider the problem of locating and extracting text from WWW images. A previous algorithm based on color clustering and connected components analysis works well as long as the color of each character is relatively uniform and the typography is fairly simple. It breaks down quickly, however, when these assumptions are violated. In this paper, we describe more robust techniques for dealing with this challenging problem. We present an improved color clustering algorithm that measures similarity based on both RGB and spatial proximity. Layout analysis is also incorporated to handle more complex typography. THese changes significantly enhance the performance of our text detection procedure.

  12. A self-assembled multimodal complex for combined pre- and intraoperative imaging of the sentinel lymph node

    NASA Astrophysics Data System (ADS)

    Buckle, Tessa; van Leeuwen, Anne C.; Chin, Patrick T. K.; Janssen, Hans; Muller, Sara H.; Jonkers, Jos; van Leeuwen, Fijs W. B.

    2010-09-01

    Specific removal of the sentinel lymph node (SLN) during breast cancer surgery presents physicians with the opportunity to detect early metastatic disease. To increase the accuracy of intraoperative SLN detection, new methods with higher sensitivity and specificity are required. We have quantitatively compared conventional preoperative lymphoscintigraphy with albumin radiocolloids (99mTc-NanoColl) with optical intraoperative guidance using the near infrared dye indocyanine green (ICG) in an orthotopic mouse model for metastatic breast cancer. Furthermore, we have applied a self-assembled multimodal complex, in which ICG is non-covalently bound to the albumin radiocolloid, to attain identical dynamics of the radioactive and optical components. The SLN specificity of the multimodal complex is similar to conventional lymphoscintigraphy, while the fluorescent signal-to-noise ratio is improved by 86% compared to ICG alone. In addition, the multimodal complex permits scintigraphic validation of the fluorescent findings. The multimodal ICG-99mTc-NanoColl complex can be used both for lymphoscintigraphy by preoperative single photon emission computed tomography/computed tomography and for surgical navigation by intraoperative fluorescence imaging.

  13. Multimodality imaging assessment for Thoraflex hybrid total arch replacement.

    PubMed

    Wong, Randolph Hl; Ho, Jacky Yk; Underwood, Malcolm J

    2016-06-01

    Conventionally, aortic pathologies involving the ascending, arch, and descending thoracic aorta are treated by a staged operation. The Thoraflex device is a composite 4-branched graft with a distal endovascular stent, which allows one-stage treatment of these pathologies. We describe our multimodality hybrid approach for total arch replacement using the Thoraflex device with the adjunct of intraoperative 3-dimensional transesophageal echocardiography, Endo-EYE endoscopy, and on-table aortography in a hybrid operating room. These multimodality assessments can ascertain adequate sealing of a distal aortic tear and proper opening of the endograft, and provide on-table functional assessment of false lumen hemodynamics. Early results are promising.

  14. Multimodality evaluation of musculoskeletal sarcoidosis: Imaging findings and literature review.

    PubMed

    Aptel, S; Lecocq-Teixeira, S; Olivier, P; Regent, D; Teixeira, P Gondim; Blum, A

    2016-01-01

    Whilst the detailed X-ray features of thoracic manifestations of sarcoidosis are now clearly defined and known by most radiologists, the same does not apply to osteoarticular and muscular features of the disease, which may however raise major diagnostic problems, either because they are the presenting features of the disease (7% of cases) or because they develop during its course. The bony lesions of sarcoid dactylitis (classical Perthes-Jüngling disease) are very characteristic and well known. Many other presentations of bone and bone marrow sarcoidosis may however raise major diagnostic difficulties, particularly uni- or multifocal osteolytic and sclerotic forms of the disease. The articular manifestations of sarcoidosis are difficult to distinguish from those of the other inflammatory and degenerative arthropathies. The muscular lesions in sarcoidosis are generally clinically silent and therefore often missed. MRI has shown them to be very common in active sarcoidosis. Acute forms carry a good prognosis whereas chronic lesions are a presenting feature of multi-organ sarcoidosis. Finally, clinicians should always think about the possibility of an iatrogenic origin for musculoskeletal abnormalities seen in sarcoidosis, particularly those related to corticosteroid therapy. Copyright © 2015 Éditions françaises de radiologie. Published by Elsevier Masson SAS. All rights reserved.

  15. Content-based medical image retrieval: a survey of applications to multidimensional and multimodality data.

    PubMed

    Kumar, Ashnil; Kim, Jinman; Cai, Weidong; Fulham, Michael; Feng, Dagan

    2013-12-01

    Medical imaging is fundamental to modern healthcare, and its widespread use has resulted in the creation of image databases, as well as picture archiving and communication systems. These repositories now contain images from a diverse range of modalities, multidimensional (three-dimensional or time-varying) images, as well as co-aligned multimodality images. These image collections offer the opportunity for evidence-based diagnosis, teaching, and research; for these applications, there is a requirement for appropriate methods to search the collections for images that have characteristics similar to the case(s) of interest. Content-based image retrieval (CBIR) is an image search technique that complements the conventional text-based retrieval of images by using visual features, such as color, texture, and shape, as search criteria. Medical CBIR is an established field of study that is beginning to realize promise when applied to multidimensional and multimodality medical data. In this paper, we present a review of state-of-the-art medical CBIR approaches in five main categories: two-dimensional image retrieval, retrieval of images with three or more dimensions, the use of nonimage data to enhance the retrieval, multimodality image retrieval, and retrieval from diverse datasets. We use these categories as a framework for discussing the state of the art, focusing on the characteristics and modalities of the information used during medical image retrieval.

  16. Interactive Feature Space Explorer© for multi-modal magnetic resonance imaging.

    PubMed

    Özcan, Alpay; Türkbey, Barış; Choyke, Peter L; Akin, Oguz; Aras, Ömer; Mun, Seong K

    2015-07-01

    Wider information content of multi-modal biomedical imaging is advantageous for detection, diagnosis and prognosis of various pathologies. However, the necessity to evaluate a large number images might hinder these advantages and reduce the efficiency. Herein, a new computer aided approach based on the utilization of feature space (FS) with reduced reliance on multiple image evaluations is proposed for research and routine clinical use. The method introduces the physician experience into the discovery process of FS biomarkers for addressing biological complexity, e.g., disease heterogeneity. This, in turn, elucidates relevant biophysical information which would not be available when automated algorithms are utilized. Accordingly, the prototype platform was designed and built for interactively investigating the features and their corresponding anatomic loci in order to identify pathologic FS regions. While the platform might be potentially beneficial in decision support generally and specifically for evaluating outlier cases, it is also potentially suitable for accurate ground truth determination in FS for algorithm development. Initial assessments conducted on two different pathologies from two different institutions provided valuable biophysical perspective. Investigations of the prostate magnetic resonance imaging data resulted in locating a potential aggressiveness biomarker in prostate cancer. Preliminary findings on renal cell carcinoma imaging data demonstrated potential for characterization of disease subtypes in the FS. Copyright © 2015 Elsevier Inc. All rights reserved.

  17. [Development and applications of the extracorporeal control point module on multi-mode medical images].

    PubMed

    Chen, Zhao-Qiu; Zhao, Feng-Ling; Zhu, Jian; Li, Wan-Hu; Fu, Zheng; Hu, Xu-Dong

    2008-07-01

    This paper introduces a display module which can be used on multi-mode medical images. The module has a small size and can be easily used for point-selecting puncture diagnosis and treatment, and registration for image fusion control points.

  18. Multimodal Imaging Assisting the Early Diagnosis of Cat-Scratch Neuroretinitis.

    PubMed

    Freitas-Neto, Clovis Arcoverde; Oréfice, Fernando; Costa, Rogerio A; Oréfice, Juliana L; Dhanireddy, Swetha; Maghsoudlou, Armin; Foster, C Stephen

    2016-01-01

    To describe how a multifocal fundus imaging system assisted the early diagnosis of cat scratch neuroretinitis in a case of a 27-year-old male with unilateral visual loss, neuroretinitis, and a peripapillary angiomatous lesion. Multimodal fundus imaging analysis was an essential contributor to the clinical diagnosis of cat scratch neuroretinitis during the early stage of the disease.

  19. Multimodality Raman and photoacoustic imaging of surface-enhanced-Raman-scattering-targeted tumor cells

    NASA Astrophysics Data System (ADS)

    Shi, Wei; Paproski, Robert J.; Shao, Peng; Forbrich, Alexander; Lewis, John D.; Zemp, Roger J.

    2016-02-01

    A multimodality Raman and photoacoustic imaging system is presented. This system has ultralow background and can detect tumor cells labeled with modified surface-enhanced-Raman-scattering (SERS) nanoparticles in vivo. Photoacoustic imaging provides microvascular context and can potentially be used to guide magnetic trapping of circulating tumor cells for SERS detection in animal models.

  20. Multimodal near infrared spectral imaging as an exploratory tool for dysplastic esophageal lesion identification

    NASA Astrophysics Data System (ADS)

    Lieber, Chad A.; Urayama, Shiro; Rahim, Nazir; Tu, Raymond; Saroufeem, Ramez; Reubner, Boris; Demos, Stavros G.

    2006-03-01

    We explore nine different combinations of fluorescence, light scattering, and polarization spectral imaging approaches in the near-infrare spectral region toward the diagnosis of pathologic and normal esophageal lesions. The combinations of all the imaging techniques were evaluated for maximal sensitivity and specificity. The results suggest that this multimodal approach is capable of highly accurate detection of the presence of pathologic tissue.

  1. Multi-modal CT in Stroke Imaging: New Concepts

    PubMed Central

    Ledezma, Carlos J.; Wintermark, Max

    2009-01-01

    A multimodal CT protocol provides a comprehensive non-invasive survey of acute stroke patients with accurate demonstration of the site of arterial occlusion and its hemodynamic tissue status. It combines widespread availability with the ability to provide functional characterization of cerebral ischemia, and could potentially allow more accurate selection of candidates for acute stroke reperfusion therapy. PMID:19195537

  2. Magnetic Iron Oxide Nanoparticles for Multimodal Imaging and Therapy of Cancer

    PubMed Central

    Thomas, Reju; Park, In-Kyu; Jeong, Yong Yeon

    2013-01-01

    Superparamagnetic iron oxide nanoparticles (SPION) have emerged as an MRI contrast agent for tumor imaging due to their efficacy and safety. Their utility has been proven in clinical applications with a series of marketed SPION-based contrast agents. Extensive research has been performed to study various strategies that could improve SPION by tailoring the surface chemistry and by applying additional therapeutic functionality. Research into the dual-modal contrast uses of SPION has developed because these applications can save time and effort by reducing the number of imaging sessions. In addition to multimodal strategies, efforts have been made to develop multifunctional nanoparticles that carry both diagnostic and therapeutic cargos specifically for cancer. This review provides an overview of recent advances in multimodality imaging agents and focuses on iron oxide based nanoparticles and their theranostic applications for cancer. Furthermore, we discuss the physiochemical properties and compare different synthesis methods of SPION for the development of multimodal contrast agents. PMID:23912234

  3. Magnetic iron oxide nanoparticles for multimodal imaging and therapy of cancer.

    PubMed

    Thomas, Reju; Park, In-Kyu; Jeong, Yong Yeon

    2013-07-31

    Superparamagnetic iron oxide nanoparticles (SPION) have emerged as an MRI contrast agent for tumor imaging due to their efficacy and safety. Their utility has been proven in clinical applications with a series of marketed SPION-based contrast agents. Extensive research has been performed to study various strategies that could improve SPION by tailoring the surface chemistry and by applying additional therapeutic functionality. Research into the dual-modal contrast uses of SPION has developed because these applications can save time and effort by reducing the number of imaging sessions. In addition to multimodal strategies, efforts have been made to develop multifunctional nanoparticles that carry both diagnostic and therapeutic cargos specifically for cancer. This review provides an overview of recent advances in multimodality imaging agents and focuses on iron oxide based nanoparticles and their theranostic applications for cancer. Furthermore, we discuss the physiochemical properties and compare different synthesis methods of SPION for the development of multimodal contrast agents.

  4. Imaging findings in pulmonary vasculitis.

    PubMed

    Castañer, Eva; Alguersuari, Anna; Andreu, Marta; Gallardo, Xavier; Spinu, Cristina; Mata, Josep M

    2012-12-01

    Vasculitis is a destructive inflammatory process affecting blood vessels. Pulmonary vasculitis may develop secondary to other conditions or constitute a primary idiopathic disorder. Thoracic involvement is most common in primary idiopathic large-vessel vasculitides (Takayasu arteritis, giant cell arteritis, Behçet disease) and primary antineutrophil cytoplasmic autoantibody-associated small-vessel vasculitides (Wegener granulomatosis, microscopic polyangiitis, Churg-Strauss syndrome). Primary pulmonary vasculitides are rare, and their signs and symptoms are nonspecific, overlapping with those of infections, connective tissue diseases, and malignancies. The radiologic findings in primary pulmonary vasculitis vary widely and can include vessel wall thickening, nodular or cavitary lesions, ground-glass opacities, and consolidations, among others. Diffuse alveolar hemorrhage usually results from primary small-vessel vasculitis in the lungs. To diagnose vasculitis, medical teams must recognize characteristic combinations of clinical, radiologic, laboratory, and histopathologic features.

  5. Bayesian analysis of multimodal data and brain imaging

    NASA Astrophysics Data System (ADS)

    Assadi, Amir H.; Eghbalnia, Hamid; Backonja, Miroslav; Wakai, Ronald T.; Rutecki, Paul; Haughton, Victor

    2000-06-01

    It is often the case that information about a process can be obtained using a variety of methods. Each method is employed because of specific advantages over the competing alternatives. An example in medical neuro-imaging is the choice between fMRI and MEG modes where fMRI can provide high spatial resolution in comparison to the superior temporal resolution of MEG. The combination of data from varying modes provides the opportunity to infer results that may not be possible by means of any one mode alone. We discuss a Bayesian and learning theoretic framework for enhanced feature extraction that is particularly suited to multi-modal investigations of massive data sets from multiple experiments. In the following Bayesian approach, acquired knowledge (information) regarding various aspects of the process are all directly incorporated into the formulation. This information can come from a variety of sources. In our case, it represents statistical information obtained from other modes of data collection. The information is used to train a learning machine to estimate a probability distribution, which is used in turn by a second machine as a prior, in order to produce a more refined estimation of the distribution of events. The computational demand of the algorithm is handled by proposing a distributed parallel implementation on a cluster of workstations that can be scaled to address real-time needs if required. We provide a simulation of these methods on a set of synthetically generated MEG and EEG data. We show how spatial and temporal resolutions improve by using prior distributions. The method on fMRI signals permits one to construct the probability distribution of the non-linear hemodynamics of the human brain (real data). These computational results are in agreement with biologically based measurements of other labs, as reported to us by researchers from UK. We also provide preliminary analysis involving multi-electrode cortical recording that accompanies

  6. Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

    PubMed

    Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

    2016-08-02

    How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

  7. Multimodality image guidance system integrating X-ray fluoroscopy and ultrasound image streams with electromagnetic tracking

    NASA Astrophysics Data System (ADS)

    Gutiérrez, Luis F.; Shechter, Guy; Stanton, Douglas; Dalal, Sandeep; Elgort, Daniel; Manzke, Robert; Chan, Raymond C.; Zagorchev, Lyubomir

    2007-03-01

    This work presents an integrated system for multimodality image guidance of minimally invasive medical procedures. This software and hardware system offers real-time integration and registration of multiple image streams with localization data from navigation systems. All system components communicate over a local area Ethernet network, enabling rapid and flexible deployment configurations. As a representative configuration, we use X-ray fluoroscopy (XF) and ultrasound (US) imaging. The XF imaging system serves as the world coordinate system, with gantry geometry derived from the imaging system, and patient table position tracked with a custom-built measurement device using linear encoders. An electromagnetic (EM) tracking system is registered to the XF space using a custom imaging phantom that is also tracked by the EM system. The RMS fiducial registration error for the EM to X-ray registration was 2.19 mm, and the RMS target registration error measured with an EM-tracked catheter was 8.81 mm. The US image stream is subsequently registered to the XF coordinate system using EM tracking of the probe, following a calibration of the US image within the EM coordinate system. We present qualitative results of the system in operation, demonstrating the integration of live ultrasound imaging spatially registered to X-ray fluoroscopy with catheter localization using electromagnetic tracking.

  8. All-optically integrated multimodality imaging system: combined photoacoustic microscopy, optical coherence tomography, and fluorescence imaging

    NASA Astrophysics Data System (ADS)

    Chen, Zhongjiang; Yang, Sihua; Xing, Da

    2016-10-01

    We have developed a multimodality imaging system by optically integrating all-optical photoacoustic microscopy (AOPAM), optical coherence tomography (OCT) and fluorescence microscopy (FLM) to provide complementary information including optical absorption, optical back-scattering and fluorescence contrast of biological tissue. By sharing the same low-coherence Michelson interferometer, AOPAM and OCT could be organically optically combined to obtain the absorption and scattering information of the biological tissues. Also, owing to using the same laser source and objective lens, intrinsically registered photoacoustic and fluorescence signals are obtained to present the radiative and nonradiative transition process of absorption. Simultaneously photoacoustic angiography, tissue structure and fluorescence molecular in vivo images of mouse ear were acquired to demonstrate the capabilities of the optically integrated trimodality imaging system, which can present more information to study tumor angiogenesis, vasculature, anatomical structure and microenvironments in vivo.

  9. Intraoperative Imaging-Guided Cancer Surgery: From Current Fluorescence Molecular Imaging Methods to Future Multi-Modality Imaging Technology

    PubMed Central

    Chi, Chongwei; Du, Yang; Ye, Jinzuo; Kou, Deqiang; Qiu, Jingdan; Wang, Jiandong; Tian, Jie; Chen, Xiaoyuan

    2014-01-01

    Cancer is a major threat to human health. Diagnosis and treatment using precision medicine is expected to be an effective method for preventing the initiation and progression of cancer. Although anatomical and functional imaging techniques such as radiography, computed tomography (CT), magnetic resonance imaging (MRI) and positron emission tomography (PET) have played an important role for accurate preoperative diagnostics, for the most part these techniques cannot be applied intraoperatively. Optical molecular imaging is a promising technique that provides a high degree of sensitivity and specificity in tumor margin detection. Furthermore, existing clinical applications have proven that optical molecular imaging is a powerful intraoperative tool for guiding surgeons performing precision procedures, thus enabling radical resection and improved survival rates. However, detection depth limitation exists in optical molecular imaging methods and further breakthroughs from optical to multi-modality intraoperative imaging methods are needed to develop more extensive and comprehensive intraoperative applications. Here, we review the current intraoperative optical molecular imaging technologies, focusing on contrast agents and surgical navigation systems, and then discuss the future prospects of multi-modality imaging technology for intraoperative imaging-guided cancer surgery. PMID:25250092

  10. Multimodality imaging of intraosseous ganglia of the wrist and their differential diagnosis.

    PubMed

    Paparo, F; Fabbro, E; Piccazzo, R; Revelli, M; Ferrero, G; Muda, A; Cimmino, M A; Garlaschi, G

    2012-12-01

    Intraosseous ganglion (IOG) is the most frequently occurring bone lesion within the carpus and is often an incidental finding on radiographs obtained for other reasons. Two types of IOG have been described: an "idiopathic" form (or type I), the pathogenesis of which has not been completely clarified, and a "penetrating" form (or type II), caused by the intrusion of juxtacortical material (often a ganglion cyst of the dorsal soft tissue) into the cancellous bone compartment. The differential diagnosis for IOG is wide-ranging and complex, including lesions of posttraumatic (posttraumatic cystlike defects), degenerative (subchondral degenerative cysts), inflammatory [cystic rheumatoid arthritis, chronic tophaceous gout (CTG)], neoplastic (benign primary bone tumours and synovial proliferative lesions), ischaemic (Kienböck's disease or avascular osteonecrosis of the lunate) and metabolic (amyloidosis) origin. Multimodality imaging of IOGs is a useful diagnostic tool that provides complete morphological characterisation and differentiation from other intraosseous cystic abnormalities of the carpus. Thin-slice multidetector computed tomography (MDCT) can provide high-spatial-resolution images of the cortical and cancellous bone compartments, allowing detection of morphological findings helpful in characterising bone lesions, whereas magnetic resonance (MR) imaging can simultaneously visualise bone, articular surfaces, hyaline cartilage, fibrocartilage, capsules and ligaments, along with intra- and periarticular soft tissues.

  11. Multimodality Imaging Evaluation of an Uncommon Entity: Esophageal Heterotopic Pancreas

    PubMed Central

    Mack, Takman; Lowry, Debra; Carbone, Peter; Barbick, Brian; Kindelan, Joshua; Marks, Robert

    2014-01-01

    A 25-year-old male was referred to the Radiology Department with new onset of right upper quadrant and epigastric abdominal pain. He had no past medical or surgical history. Physical exam was unremarkable. The patient underwent computed tomography (CT), fluoroscopic upper gastrointestinal (GI) evaluation, endoscopic ultrasound (EUS), and positron emission tomography (PET) evaluation, revealing the presence of a heterogeneous esophageal mass. In light of imaging findings and clinical workup, the patient was ultimately referred for thorascopic surgery. Surgical findings and histology confirmed the diagnosis of esophageal heterotopic pancreas. PMID:24744946

  12. Establishing Keypoint Matches on Multimodal Images with Bootstrap Strategy and Global Information.

    PubMed

    Li, Yong; Jin, Hongbin; Wu, Jiatao; Liu, Jie

    2017-04-19

    This paper proposes an algorithm of building keypoint matches on multimodal images by combining a bootstrap process and global information. The correct ratio of keypoint matches built with descriptors is typically very low on multimodal images of large spectral difference. To identify correct matches, global information is utilized for evaluating keypoint matches and a bootstrap technique is employed to reduce the computational cost. A keypoint match determines a transformation T and a similarity metric between the reference and the transformed test image by T. The similarity metric encodes global information over entire images, and hence a higher similarity indicates the match can bring more image content into alignment, implying it tends to be correct. Unfortunately, exhausting triplets/quadruples of matches for affine/projective transformation is computationally intractable when the number of keypoints is large. To reduce the computational cost, a bootstrap technique is employed that starts from single matches for a translation and rotation model, and goes increasingly to quadruples of four matches for a projective model. The global information screens for "good" matches at each stage and the bootstrap strategy makes the screening process computationally feasible. Experimental results show that the proposed method can establish reliable keypoint matches on challenging multimodal images of strong multimodality.

  13. Eigenanatomy: sparse dimensionality reduction for multi-modal medical image analysis.

    PubMed

    Kandel, Benjamin M; Wang, Danny J J; Gee, James C; Avants, Brian B

    2015-02-01

    Rigorous statistical analysis of multimodal imaging datasets is challenging. Mass-univariate methods for extracting correlations between image voxels and outcome measurements are not ideal for multimodal datasets, as they do not account for interactions between the different modalities. The extremely high dimensionality of medical images necessitates dimensionality reduction, such as principal component analysis (PCA) or independent component analysis (ICA). These dimensionality reduction techniques, however, consist of contributions from every region in the brain and are therefore difficult to interpret. Recent advances in sparse dimensionality reduction have enabled construction of a set of image regions that explain the variance of the images while still maintaining anatomical interpretability. The projections of the original data on the sparse eigenvectors, however, are highly collinear and therefore difficult to incorporate into multi-modal image analysis pipelines. We propose here a method for clustering sparse eigenvectors and selecting a subset of the eigenvectors to make interpretable predictions from a multi-modal dataset. Evaluation on a publicly available dataset shows that the proposed method outperforms PCA and ICA-based regressions while still maintaining anatomical meaning. To facilitate reproducibility, the complete dataset used and all source code is publicly available. Copyright © 2014 Elsevier Inc. All rights reserved.

  14. EVolution: an edge-based variational method for non-rigid multi-modal image registration

    NASA Astrophysics Data System (ADS)

    de Senneville, B. Denis; Zachiu, C.; Ries, M.; Moonen, C.

    2016-10-01

    Image registration is part of a large variety of medical applications including diagnosis, monitoring disease progression and/or treatment effectiveness and, more recently, therapy guidance. Such applications usually involve several imaging modalities such as ultrasound, computed tomography, positron emission tomography, x-ray or magnetic resonance imaging, either separately or combined. In the current work, we propose a non-rigid multi-modal registration method (namely EVolution: an edge-based variational method for non-rigid multi-modal image registration) that aims at maximizing edge alignment between the images being registered. The proposed algorithm requires only contrasts between physiological tissues, preferably present in both image modalities, and assumes deformable/elastic tissues. Given both is shown to be well suitable for non-rigid co-registration across different image types/contrasts (T1/T2) as well as different modalities (CT/MRI). This is achieved using a variational scheme that provides a fast algorithm with a low number of control parameters. Results obtained on an annotated CT data set were comparable to the ones provided by state-of-the-art multi-modal image registration algorithms, for all tested experimental conditions (image pre-filtering, image intensity variation, noise perturbation). Moreover, we demonstrate that, compared to existing approaches, our method possesses increased robustness to transient structures (i.e. that are only present in some of the images).

  15. EVolution: an edge-based variational method for non-rigid multi-modal image registration.

    PubMed

    Denis de Senneville, B; Zachiu, C; Ries, M; Moonen, C

    2016-10-21

    Image registration is part of a large variety of medical applications including diagnosis, monitoring disease progression and/or treatment effectiveness and, more recently, therapy guidance. Such applications usually involve several imaging modalities such as ultrasound, computed tomography, positron emission tomography, x-ray or magnetic resonance imaging, either separately or combined. In the current work, we propose a non-rigid multi-modal registration method (namely EVolution: an edge-based variational method for non-rigid multi-modal image registration) that aims at maximizing edge alignment between the images being registered. The proposed algorithm requires only contrasts between physiological tissues, preferably present in both image modalities, and assumes deformable/elastic tissues. Given both is shown to be well suitable for non-rigid co-registration across different image types/contrasts (T1/T2) as well as different modalities (CT/MRI). This is achieved using a variational scheme that provides a fast algorithm with a low number of control parameters. Results obtained on an annotated CT data set were comparable to the ones provided by state-of-the-art multi-modal image registration algorithms, for all tested experimental conditions (image pre-filtering, image intensity variation, noise perturbation). Moreover, we demonstrate that, compared to existing approaches, our method possesses increased robustness to transient structures (i.e. that are only present in some of the images).

  16. Multimodal Imaging of Spike Propagation: A Technical Case Report

    PubMed Central

    Tanaka, N.; Grant, P.E.; Suzuki, N.; Madsen, J.R.; Bergin, A.M.; Hämäläinen, M.S; Stufflebeam, S.M.

    2012-01-01

    SUMMARY We report an 11-year-old boy with intractable epilepsy, who had cortical dysplasia in the right superior frontal gyrus. Spatiotemporal source analysis of MEG and EEG spikes demonstrated a similar time course of spike propagation from the superior to inferior frontal gyri, as observed on intracranial EEG. The tractography reconstructed from DTI showed a fiber connection between these areas. Our multimodal approach demonstrates spike propagation and a white matter tract guiding the propagation. PMID:21960488

  17. Multimodal imaging of spike propagation: a technical case report.

    PubMed

    Tanaka, N; Grant, P E; Suzuki, N; Madsen, J R; Bergin, A M; Hämäläinen, M S; Stufflebeam, S M

    2012-06-01

    We report an 11-year-old boy with intractable epilepsy, who had cortical dysplasia in the right superior frontal gyrus. Spatiotemporal source analysis of MEG and EEG spikes demonstrated a similar time course of spike propagation from the superior to inferior frontal gyri, as observed on intracranial EEG. The tractography reconstructed from DTI showed a fiber connection between these areas. Our multimodal approach demonstrates spike propagation and a white matter tract guiding the propagation.

  18. Multimodal non-contact photoacoustic and OCT imaging with galvanometer scanning

    NASA Astrophysics Data System (ADS)

    Berer, Thomas; Hochreiner, Armin; Leiss-Holzinger, Elisabeth; Bauer-Marschallinger, Johannes; Buchsbaum, Andreas

    2015-03-01

    In this paper we present multimodal non-contact photoacoustic and optical coherence tomography (OCT) imaging using a galvanometer scanner. Photoacoustic signals are acquired without contact on the surface of a specimen using an interferometric technique. The interferometer is realized in a fiber-optic network using a fiber laser at 1550 nm as source. In the same fiber-optic network a spectral-domain OCT system is realized, using a broadband light source at 1300 nm. Light from the fiber laser and the OCT source are multiplexed into the same fiber and the same objective is used for both imaging modalities. Fast non-contact photoacoustic and OCT imaging is demonstrated by scanning the detection spot utilizing a galvanometer scanner. Multimodal photoacoustic and OCT imaging is shown on agarose phantoms. As the same fiber network and optical components are used for non-contact photoacoustic and OCT imaging the obtained images are co-registered intrinsically.

  19. Integrated multimodal optical microscopy for structural and functional imaging of engineered and natural skin

    PubMed Central

    Zhao, Youbo; Graf, Benedikt W.; Chaney, Eric J.; Mahmassani, Ziad; Antoniadou, Eleni; DeVolder, Ross; Kong, Hyunjoon; Boppart, Marni D.; Boppart, Stephen A.

    2015-01-01

    An integrated multimodal optical microscope is demonstrated for high-resolution, structural and functional imaging of engineered and natural skin. This microscope incorporates multiple imaging modalities including optical coherence (OCM), multi-photon (MPM), and fluorescence lifetime imaging microscopy (FLIM), enabling simultaneous visualization of multiple contrast sources and mechanisms from cells and tissues. Spatially co-registered OCM/MPM/FLIM images of multi-layered skin tissues are obtained, which are formed based on complementary information provided by different modalities, i.e., scattering information from OCM, molecular information from MPM, and functional cellular metabolism states from FLIM. Cellular structures in both the dermis and epidermis, especially different morphological and physiological states of keratinocytes from different epidermal layers, are revealed by mutually-validating images. In vivo imaging of human skin is also investigated, which demonstrates the potential of multimodal microscopy for in vivo investigation during engineered skin engraftment. This integrated imaging technique and microscope show the potential for investigating cellular dynamics in developing engineered skin and following in vivo grafting, which will help refine the control and culturing conditions necessary to obtain more robust and physiologically-relevant engineered skin substitutes. Multimodal microscopy images of a microporous 3D hydrogel scaffold seeded with 3T3 fibroblasts. Representative spatially co-registered images were generated based on different methodologies including optical coherence (OCM), multiphoton (MPM), and fluorescence lifetime imaging (FLIM) microscopy. PMID:22371330

  20. Multimodality image registration quality assurance for conformal three-dimensional treatment planning.

    PubMed

    Mutic, S; Dempsey, J F; Bosch, W R; Low, D A; Drzymala, R E; Chao, K S; Goddu, S M; Cutler, P D; Purdy, J A

    2001-09-01

    We present a quality assurance methodology to determine the accuracy of multimodality image registration and fusion for the purpose of conformal three-dimensional and intensity-modulated radiation therapy treatment planning. Registration and fusion accuracy between any combination of computed tomography (CT), magnetic resonance (MR), and positron emission computed tomography (PET) imaging studies can be evaluated. A commercial anthropomorphic head phantom filled with water and containing CT, MR, and PET visible targets was modified to evaluate the accuracy of multimodality image registration and fusion software. For MR and PET imaging, the water inside the phantom was doped with CuNO(3) and 18F-fluorodeoxyglucose (18F-FDG), respectively. Targets consisting of plastic spheres and pins were distributed throughout the cranium section of the phantom. Each target sphere had a conical-shaped bore with its apex at the center of the sphere. The pins had a conical extension or indentation at the free end. The contours of the spheres, sphere centers, and pin tips were used as anatomic landmark models for image registration, which was performed using affine coordinate-transformation tools provided in a commercial multimodality image registration/fusion software package. Four sets of phantom image studies were obtained: primary CT, secondary CT with different phantom immobilization, MR, and PET study. A novel CT, MR, and PET external fiducial marking system was also tested. The registration of CT/CT, CT/MR, and CT/PET images allowed correlation of anatomic landmarks to within 2 mm, verifying the accuracy of the registration software and spatial fidelity of the four multimodality image sets. This straightforward phantom-based quality assurance of the image registration and fusion process can be used in a routine clinical setting or for providing a working image set for development of the image registration and fusion process and new software.

  1. Multimodal facial color imaging modality for objective analysis of skin lesions

    PubMed Central

    Bae, Youngwoo; Nelson, J. Stuart; Jung, Byungjo

    2009-01-01

    We introduce a multimodal facial color imaging modality that provides a conventional color image, parallel and cross-polarization color images, and a fluorescent color image. We characterize the imaging modality and describe the image analysis methods for objective evaluation of skin lesions. The parallel and cross-polarization color images are useful for the analysis of skin texture, pigmentation, and vascularity. The polarization image, which is derived from parallel and cross-polarization color images, provides morphological information of superficial skin lesions. The fluorescent color image is useful for the evaluation of skin chromophores excited by UV-A radiation. In order to demonstrate the validity of the new imaging modality in dermatology, sample images were obtained from subjects with various skin disorders and image analysis methods were applied for objective evaluation of those lesions. In conclusion, we are confident that the imaging modality and analysis methods should be useful tools to simultaneously evaluate various skin lesions in dermatology. PMID:19123654

  2. RECOVERY ACT: MULTIMODAL IMAGING FOR SOLAR CELL MICROCRACK DETECTION

    SciTech Connect

    Janice Hudgings; Lawrence Domash

    2012-02-08

    Undetected microcracks in solar cells are a principal cause of failure in service due to subsequent weather exposure, mechanical flexing or diurnal temperature cycles. Existing methods have not been able to detect cracks early enough in the production cycle to prevent inadvertent shipment to customers. This program, sponsored under the DOE Photovoltaic Supply Chain and Cross-Cutting Technologies program, studied the feasibility of quantifying surface micro-discontinuities by use of a novel technique, thermoreflectance imaging, to detect surface temperature gradients with very high spatial resolution, in combination with a suite of conventional imaging methods such as electroluminescence. The project carried out laboratory tests together with computational image analyses using sample solar cells with known defects supplied by industry sources or DOE National Labs. Quantitative comparisons between the effectiveness of the new technique and conventional methods were determined in terms of the smallest detectable crack. Also the robustness of the new technique for reliable microcrack detection was determined at various stages of processing such as before and after antireflectance treatments. An overall assessment is that the new technique compares favorably with existing methods such as lock-in thermography or ultrasonics. The project was 100% completed in Sept, 2010. A detailed report of key findings from this program was published as: Q.Zhou, X.Hu, K.Al-Hemyari, K.McCarthy, L.Domash and J.Hudgings, High spatial resolution characterization of silicon solar cells using thermoreflectance imaging, J. Appl. Phys, 110, 053108 (2011).

  3. Groupwise registration of multimodal images by an efficient joint entropy minimization scheme.

    PubMed

    Spiclin, Ziga; Likar, Bostjan; Pernus, Franjo

    2012-05-01

    Groupwise registration is concerned with bringing a group of images into the best spatial alignment. If images in the group are from different modalities, then the intensity correspondences across the images can be modeled by the joint density function (JDF) of the cooccurring image intensities. We propose a so-called treecode registration method for groupwise alignment of multimodal images that uses a hierarchical intensity-space subdivision scheme through which an efficient yet sufficiently accurate estimation of the (high-dimensional) JDF based on the Parzen kernel method is computed. To simultaneously align a group of images, a gradient-based joint entropy minimization was employed that also uses the same hierarchical intensity-space subdivision scheme. If the Hilbert kernel is used for the JDF estimation, then the treecode method requires no data-dependent bandwidth selection and is thus fully automatic. The treecode method was compared with the ensemble clustering (EC) method on four different publicly available multimodal image data sets and on a synthetic monomodal image data set. The obtained results indicate that the treecode method has similar and, for two data sets, even superior performances compared to the EC method in terms of registration error and success rate. The obtained good registration performances can be mostly attributed to the sufficiently accurate estimation of the JDF, which is computed through the hierarchical intensity-space subdivision scheme, that captures all the important features needed to detect the correct intensity correspondences across a multimodal group of images undergoing registration.

  4. Parallel Information Processing (Image Transmission Via Fiber Bundle and Multimode Fiber

    NASA Technical Reports Server (NTRS)

    Kukhtarev, Nicholai

    2003-01-01

    Growing demand for visual, user-friendly representation of information inspires search for the new methods of image transmission. Currently used in-series (sequential) methods of information processing are inherently slow and are designed mainly for transmission of one or two dimensional arrays of data. Conventional transmission of data by fibers requires many fibers with array of laser diodes and photodetectors. In practice, fiber bundles are also used for transmission of images. Image is formed on the fiber-optic bundle entrance surface and each fiber transmits the incident image to the exit surface. Since the fibers do not preserve phase, only 2D intensity distribution can be transmitted in this way. Each single mode fiber transmit only one pixel of an image. Multimode fibers may be also used, so that each mode represent different pixel element. Direct transmission of image through multimode fiber is hindered by the mode scrambling and phase randomization. To overcome these obstacles wavelength and time-division multiplexing have been used, with each pixel transmitted on a separate wavelength or time interval. Phase-conjugate techniques also was tested in, but only in the unpractical scheme when reconstructed image return back to the fiber input end. Another method of three-dimensional imaging over single mode fibers was demonstrated in, using laser light of reduced spatial coherence. Coherence encoding, needed for a transmission of images by this methods, was realized with grating interferometer or with the help of an acousto-optic deflector. We suggest simple practical holographic method of image transmission over single multimode fiber or over fiber bundle with coherent light using filtering by holographic optical elements. Originally this method was successfully tested for the single multimode fiber. In this research we have modified holographic method for transmission of laser illuminated images over commercially available fiber bundle (fiber endoscope, or

  5. Plane Wave Imaging for ultrasonic non-destructive testing: Generalization to multimodal imaging.

    PubMed

    Le Jeune, Léonard; Robert, Sébastien; Lopez Villaverde, Eduardo; Prada, Claire

    2016-01-01

    This paper describes a new ultrasonic array imaging method for Non-Destructive Testing (NDT) which is derived from the medical Plane Wave Imaging (PWI) technique. The objective is to perform fast ultrasound imaging with high image quality. The approach is to transmit plane waves at several angles and to record the back-scattered signals with all the array elements. Focusing in receive is then achieved by coherent summations of the signals in every point of a region of interest. The medical PWI is generalized to immersion setups where water acts as a coupling medium and to multimodal (direct, half-skip modes) imaging in order to detect different types of defects (inclusions, porosities, cracks). This method is compared to the Total Focusing Method (TFM) which is the reference imaging technique in NDT. First, the two post-processing algorithms are described. Then experimental results with the array probe either in contact or in immersion are presented. A good agreement between the TFM and the PWI is observed, with three to ten times less transmissions required for the PWI. Copyright © 2015 Elsevier B.V. All rights reserved.

  6. Prestack Imaging of Teleseismic Body Waves: A Comparison of Multimode Receiver Function Migration and Seismic Interferometry

    NASA Astrophysics Data System (ADS)

    Abe, S.; Sato, H.; Hirata, N.; Iwasaki, T.; Ito, T.; Kawanaka, T.

    2006-12-01

    Over the past few years, the correlation-type reciprocity theorem for one-way wave fields has been extended to derive relations between the transmission and reflection responses of an arbitrary 3-D inhomogeneous medium. Based on this generalized relation, the interferometric seismic imaging(ISI) in the presence of passive seismic sources can be simulated by cross-correlating the transmission responses recorded at dense receiver array. The ISI inherently realizes symmetric pseudo-shot-receiver sampling, and prevents irregularities of offset distribution in CMP ensembles. We have investigated the possible application of ISI to teleseismic earthquake data, which ensures the basic assumption of the correlation-type reciprocity theorem that the seismic source is located beneath the all reflectors to be reconstructed. Synthetic seismograms simulated by the elastic pseudospectral method for a simple 2-D/3-D crustal model are given to compare the seismic profile of multimode receiver function migration to seismic interferometric profiling. The numerical modeling results demonstrate the potential imaging capabilities of ISI for crustal structure with a high spatial resolution rather than the multimode receiver function profile. We applied prestack Kirchhoff imaging to the teleseismic and regional earthquake data acquired along Odawara-Yamanashi seismic survey line, located in central Japan, and utilized multimode prestack migration for receiver function and ISI for back scattered phases to investigate the subducting Philippine sea plate and crustal structure of Izu collision zone. We further discuss practical difficulties and evaluate potential for joint imaging of multimode receiver function migration and seismic interferometry.

  7. Primary cardiac lymphoma: utility of multimodality imaging in diagnosis and management.

    PubMed

    Mato, Anthony R; Morgans, Alicia K; Roullet, Michele R; Bagg, Adam; Glatstein, Eli; Litt, Harold I; Downs, Lisa H; Chong, Elise A; Olson, Erin R; Andreadis, Charalambos; Schuster, Stephen J

    2007-12-01

    Primary cardiac lymphoma (PCL) is an extremely rare disease defined as a lymphoma strictly confined to the heart or pericardium without dissemination. We present the case of an 82 yr old male with newly diagnosed PCL and two years of subsequent follow up. This report highlights the utility of a multimodality imaging approach in the diagnosis and management of PCL.

  8. A quantitative framework for the analysis of multimodal optical microscopy images

    PubMed Central

    Bower, Andrew J.; Chidester, Benjamin; Li, Joanne; Zhao, Youbo; Marjanovic, Marina; Chaney, Eric J.; Do, Minh N.

    2017-01-01

    Background Multimodal optical microscopy, a set of imaging techniques based on unique, yet complementary contrast mechanisms and spatially and temporally co-registered data acquisition, has emerged as a powerful biomedical tool. However, the analysis of the dense, high-dimensional datasets acquired by these instruments remains mostly qualitative and restricted to analysis of each modality individually. Methods Using a custom-built multimodal nonlinear optical microscope, high dimensional datasets were acquired for automated classification of functional cell states as well as identification of histopathological features in tissues slices. Supervised classification of cell death modes was performed through support vector machines (SVM) and semi-supervised classification of tissue slices was performed through the use of the expectation maximization (EM) algorithm. Results Applications of these techniques to the automated classification of cell death modes as well as to the identification of tissue components in fixed ex vivo tissue slices are presented. The analysis techniques developed provide a direct link between multimodal image contrast and biological structure and function, resulting in highly accurate classification in both settings. Conclusions Quantification of multimodal optical microscopy images through statistical modeling of the high dimensional data acquired gives a strong correlation between biological structure and function and image contrast. These methods are sensitive to the identification of diagnostic, cellular-level features important in a variety of clinical settings. PMID:28275557

  9. Multi-modal image registration based on gradient orientations of minimal uncertainty.

    PubMed

    De Nigris, Dante; Collins, D Louis; Arbel, Tal

    2012-12-01

    In this paper, we propose a new multi-scale technique for multi-modal image registration based on the alignment of selected gradient orientations of reduced uncertainty. We show how the registration robustness and accuracy can be improved by restricting the evaluation of gradient orientation alignment to locations where the uncertainty of fixed image gradient orientations is minimal, which we formally demonstrate correspond to locations of high gradient magnitude. We also embed a computationally efficient technique for estimating the gradient orientations of the transformed moving image (rather than resampling pixel intensities and recomputing image gradients). We have applied our method to different rigid multi-modal registration contexts. Our approach outperforms mutual information and other competing metrics in the context of rigid multi-modal brain registration, where we show sub-millimeter accuracy with cases obtained from the retrospective image registration evaluation project. Furthermore, our approach shows significant improvements over standard methods in the highly challenging clinical context of image guided neurosurgery, where we demonstrate misregistration of less than 2 mm with relation to expert selected landmarks for the registration of pre-operative brain magnetic resonance images to intra-operative ultrasound images.

  10. An integrated multimodality image-guided robot system for small-animal imaging research

    NASA Astrophysics Data System (ADS)

    Hsu, Wen-Lin; Hsin Wu, Tung; Hsu, Shih-Ming; Chen, Chia-Lin; Lee, Jason J. S.; Huang, Yung-Hui

    2011-10-01

    We design and construct an image-guided robot system for use in small-animal imaging research. This device allows the use of co-registered small-animal PET-MRI images to guide the movements of robotic controllers, which will accurately place a needle probe at any predetermined location inside, for example, a mouse tumor, for biological readouts without sacrificing the animal. This system is composed of three major components: an automated robot device, a CCD monitoring mechanism, and a multimodality registration implementation. Specifically, the CCD monitoring mechanism was used for correction and validation of the robot device. To demonstrate the value of the proposed system, we performed a tumor hypoxia study that involved FMISO small-animal PET imaging and the delivering of a pO 2 probe into the mouse tumor using the image-guided robot system. During our evaluation, the needle positioning error was found to be within 0.153±0.042 mm of desired placement; the phantom simulation errors were within 0.693±0.128 mm. In small-animal studies, the pO 2 probe measurements in the corresponding hypoxia areas showed good correlation with significant, low tissue oxygen tensions (less than 6 mmHg). We have confirmed the feasibility of the system and successfully applied it to small-animal investigations. The system could be easily adapted to extend to other biomedical investigations in the future.

  11. Appearance of osteolysis with melorheostosis: redefining the disease or a new disorder? A novel case report with multimodality imaging.

    PubMed

    Osher, Lawrence S; Blazer, Marie Mantini; Bumpus, Kelly

    2013-01-01

    We present a case report of melorheostosis with the novel radiographic finding of underlying cortical resorption. A number of radiographic patterns of melorheostosis have been described; however, the combination of new bone formation and resorption of the original cortex appears unique. Although the presence of underlying lysis has been postulated in published studies, direct radiographic evidence of bony resorption in melorheostosis has not been reported. These findings can be subtle and might go unnoticed using standard imaging. An in-depth review of the radiographic features is presented, including multimodality imaging with magnetic resonance imaging and computed tomography. Copyright © 2013 American College of Foot and Ankle Surgeons. Published by Elsevier Inc. All rights reserved.

  12. Log-Gabor energy based multimodal medical image fusion in NSCT domain.

    PubMed

    Yang, Yong; Tong, Song; Huang, Shuying; Lin, Pan

    2014-01-01

    Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT) based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT), the fast discrete curvelet transform (FDCT), and the dual tree complex wavelet transform (DTCWT) based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images.

  13. Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

    PubMed Central

    Yang, Yong; Tong, Song; Huang, Shuying; Lin, Pan

    2014-01-01

    Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT) based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT), the fast discrete curvelet transform (FDCT), and the dual tree complex wavelet transform (DTCWT) based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images. PMID:25214889

  14. A multimodal (MRI/ultrasound) cardiac phantom for imaging experiments

    NASA Astrophysics Data System (ADS)

    Tavakoli, Vahid; Kendrick, Michael; Shakeri, Mostafa; Alshaher, Motaz; Stoddard, Marcus F.; Amini, Amir

    2013-03-01

    A dynamic cardiac phantom can play a significant role in the evaluation and development of ultrasound and cardiac magnetic resonance (MR) motion tracking and registration methods. A four chamber multimodal cardiac phantom has been designed and built to simulate normal and pathologic hearts with different degrees of "infarction" and "scar tissues". In this set up, cardiac valves have been designed and modeled as well. The four-chamber structure can simulate the asymmetric ventricular, atrial and valve motions. Poly Vinyl Alcohol (PVA) is used as the principal material since it can simulate the shape, elasticity, and MR and ultrasound properties of the heart. The cardiac shape is simulated using a four-chamber mold made of polymer clay. An additional pathologic heart phantom containing stiff inclusions has been manufactured in order to simulate an infracted heart. The stiff inclusions are of different shapes and different degrees of elasticity and are able to simulate abnormal cardiac segments. The cardiac elasticity is adjusted based on freeze-thaw cycles of the PVA cryogel for normal and scarred regions. Ultrasound and MRI markers were inserted in the cardiac phantom as landmarks for validations. To the best of our knowledge, this is the first multimodal phantom that models a dynamic four-chamber human heart including the cardiac valve.

  15. Detailed investigation of self-imaging in large-core multimode optical fibers for application in fiber lasers and amplifiers.

    PubMed

    Zhu, X; Schülzgen, A; Li, H; Li, L; Han, L; Moloney, J V; Peyghambarian, N

    2008-10-13

    Properties of the self-imaging effect based on multimode interference (MMI) in large-core passive optical fibers are investigated and analyzed in detail, with the purpose of using multimode active fibers for high power single-transverse-mode emission. Although perfect self-imaging of the input field from a standard single-mode fiber (SMF-28) in a multimode fiber becomes practically impossible as its core diameter is larger than 50 microm, a quasi-reproduction of the input field occurs when the phase difference between the excited modes and the peak mode inside the multimode fiber is very small. Our simulation and experimental results indicate that, if the length of the multimode fiber segment can be controlled accurately, reproduction of the input field with a self-imaging quality factor larger than 0.9 can be obtained. In this case, a low-loss hybrid fiber cavity composed of a SMF-28 segment and a very-large-core active multimode fiber segment can be built. It is also found that for the hybrid fiber cavity, increasing the mode-field diameter of the single-mode fiber improves both the self-imaging quality and the tolerance on the required length accuracy of the multimode fiber segment. Moreover, in this paper key parameters for the design of MMI-based fiber devices are defined and their corresponding values are provided for multimode fibers with core diameters of 50 microm and 105 microm.

  16. Multi-Modal Curriculum Learning for Semi-Supervised Image Classification.

    PubMed

    Gong, Chen; Tao, Dacheng; Maybank, Stephen J; Liu, Wei; Kang, Guoliang; Yang, Jie

    2016-07-01

    Semi-supervised image classification aims to classify a large quantity of unlabeled images by typically harnessing scarce labeled images. Existing semi-supervised methods often suffer from inadequate classification accuracy when encountering difficult yet critical images, such as outliers, because they treat all unlabeled images equally and conduct classifications in an imperfectly ordered sequence. In this paper, we employ the curriculum learning methodology by investigating the difficulty of classifying every unlabeled image. The reliability and the discriminability of these unlabeled images are particularly investigated for evaluating their difficulty. As a result, an optimized image sequence is generated during the iterative propagations, and the unlabeled images are logically classified from simple to difficult. Furthermore, since images are usually characterized by multiple visual feature descriptors, we associate each kind of features with a teacher, and design a multi-modal curriculum learning (MMCL) strategy to integrate the information from different feature modalities. In each propagation, each teacher analyzes the difficulties of the currently unlabeled images from its own modality viewpoint. A consensus is subsequently reached among all the teachers, determining the currently simplest images (i.e., a curriculum), which are to be reliably classified by the multi-modal learner. This well-organized propagation process leveraging multiple teachers and one learner enables our MMCL to outperform five state-of-the-art methods on eight popular image data sets.

  17. Multi-modal label-free imaging based on a femtosecond fiber laser.

    PubMed

    Xie, Ruxin; Su, Jue; Rentchler, Eric C; Zhang, Ziyan; Johnson, Carey K; Shi, Honglian; Hui, Rongqing

    2014-07-01

    We demonstrate multi-mode microscopy based on a single femtosecond fiber laser. Coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and photothermal images can be obtained simultaneously with this simplified setup. Distributions of lipid and hemoglobin in sliced mouse brain samples and blood cells are imaged. The dependency of signal amplitude on the pump power and pump modulation frequency is characterized, which allows to isolate the impact from different contributions.

  18. Multi-modal label-free imaging based on a femtosecond fiber laser

    PubMed Central

    Xie, Ruxin; Su, Jue; Rentchler, Eric C.; Zhang, Ziyan; Johnson, Carey K.; Shi, Honglian; Hui, Rongqing

    2014-01-01

    We demonstrate multi-mode microscopy based on a single femtosecond fiber laser. Coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and photothermal images can be obtained simultaneously with this simplified setup. Distributions of lipid and hemoglobin in sliced mouse brain samples and blood cells are imaged. The dependency of signal amplitude on the pump power and pump modulation frequency is characterized, which allows to isolate the impact from different contributions. PMID:25071972

  19. Histological Underpinnings of Grey Matter Changes in Fibromyalgia Investigated Using Multimodal Brain Imaging.

    PubMed

    Pomares, Florence B; Funck, Thomas; Feier, Natasha A; Roy, Steven; Daigle-Martel, Alexandre; Ceko, Marta; Narayanan, Sridar; Araujo, David; Thiel, Alexander; Stikov, Nikola; Fitzcharles, Mary-Ann; Schweinhardt, Petra

    2017-02-01

    Chronic pain patients present with cortical gray matter alterations, observed with anatomical magnetic resonance (MR) imaging. Reduced regional gray matter volumes are often interpreted to reflect neurodegeneration, but studies investigating the cellular origin of gray matter changes are lacking. We used multimodal imaging to compare 26 postmenopausal women with fibromyalgia with 25 healthy controls (age range: 50-75 years) to test whether regional gray matter volume decreases in chronic pain are associated with compromised neuronal integrity. Regional gray matter decreases were largely explained by T1 relaxation times in gray matter, a surrogate measure of water content, and not to any substantial degree by GABAA receptor concentration, an indirect marker of neuronal integrity measured with [(18)F] flumazenil PET. In addition, the MR spectroscopy marker of neuronal viability, N-acetylaspartate, did not differ between patients and controls. These findings suggest that decreased gray matter volumes are not explained by compromised neuronal integrity. Alternatively, a decrease in neuronal matter could be compensated for by an upregulation of GABAA receptors. The relation between regional gray matter and T1 relaxation times suggests decreased tissue water content underlying regional gray matter decreases. In contrast, regional gray matter increases were explained by GABAA receptor concentration in addition to T1 relaxation times, indicating perhaps increased neuronal matter or GABAA receptor upregulation and inflammatory edema. By providing information on the histological origins of cerebral gray matter alterations in fibromyalgia, this study advances the understanding of the neurobiology of chronic widespread pain.

  20. Multimodality Diagnostic Imaging in Unilateral Acute Idiopathic Maculopathy

    PubMed Central

    Jung, Cecilia S.; Payne, John F.; Bergstrom, Chris S.; Cribbs, Blaine E.; Yan, Jiong; Hubbard, G. Baker; Olsen, Timothy W.; Yeh, Steven

    2014-01-01

    Objective To describe the clinical features and imaging characteristics in unilateral acute idiopathic maculopathy (UAIM). Methods This is a retrospective review of four patients diagnosed with UAIM. Clinical characteristics (age, symptoms, Snellen visual acuity (VA), and funduscopic features) and images from spectral-domain optical coherence tomography (SD-OCT), fundus autofluorescence (FAF), fluorescein (FA), and indocyanine green (ICG) angiography were analyzed. Results The median age at presentation was 31 years (range 27–52 years). The median interval between symptom onset and presentation was four weeks (range 1–20 weeks). Associated systemic findings included a viral prodrome (50%), orchitis (50%), hand-foot-mouth disease (25%), and positive Coxsackie virus titers (50%). The median presenting VA was 20/400 (range 20/70–1/400), which improved to 20/30 (range 20/20–20/60) at final follow-up. The median follow-up time was 6 weeks (range 0–8 weeks). Early in the disease course, the central macula developed irregular, circular areas of white-grey discoloration. Following recovery, the macula had a stippled retinal pigment epithelium characterized by rarefaction and hyperplasia. FA demonstrated irregular early hyperfluorescence and late subretinal hyperfluorescence. SD-OCT showed a partially reversible disruption of the outer photoreceptor layer. FAF initially revealed stippled autofluorescence that eventually became more hypoautofluorescent. ICG showed “moth-eaten” appearing choroidal vasculature, suggestive of choroidal inflammation. Conclusions The imaging characteristics highlight the structural changes during the active and resolution phases of UAIM. The visual recovery correlates with structural changes and suggests that the pathogenesis involves inflammation of the inner choroid, retinal pigment epithelium, and outer photoreceptor complex that is partially reversible. PMID:22232475

  1. Fast and Robust Registration of Multimodal Remote Sensing Images via Dense Orientated Gradient Feature

    NASA Astrophysics Data System (ADS)

    Ye, Y.

    2017-09-01

    This paper presents a fast and robust method for the registration of multimodal remote sensing data (e.g., optical, LiDAR, SAR and map). The proposed method is based on the hypothesis that structural similarity between images is preserved across different modalities. In the definition of the proposed method, we first develop a pixel-wise feature descriptor named Dense Orientated Gradient Histogram (DOGH), which can be computed effectively at every pixel and is robust to non-linear intensity differences between images. Then a fast similarity metric based on DOGH is built in frequency domain using the Fast Fourier Transform (FFT) technique. Finally, a template matching scheme is applied to detect tie points between images. Experimental results on different types of multimodal remote sensing images show that the proposed similarity metric has the superior matching performance and computational efficiency than the state-of-the-art methods. Moreover, based on the proposed similarity metric, we also design a fast and robust automatic registration system for multimodal images. This system has been evaluated using a pair of very large SAR and optical images (more than 20000 × 20000 pixels). Experimental results show that our system outperforms the two popular commercial software systems (i.e. ENVI and ERDAS) in both registration accuracy and computational efficiency.

  2. Osteoarthritis and psoriatic arthritis: findings in three-dimensional biophotonics imaging.

    PubMed

    Yuan, Zhen; Ieong, Fong H; Jiang, Huabei; Sobel, Eric S

    2014-01-01

    The goal of this study is to capture the quantitative optical features of degenerative finger joints based on x-ray aided three-dimensional (3D) diffuse optical tomography (DOT). It is anticipated that the fused imaging technique can be applied to identifying the significant differences between osteoarthritis (OA) and psoriatic arthritis (PA). For a case study, total 6 subjects were selected to study the distal interphalangeal (DIP) finger joints. 2 OA patients, 2 PA patients and 2 healthy subjects were examined clinically first. Their DIP finger joints were then scanned by the multimodality imaging method. Our findings suggested that the developed multimodality imaging approach may aid to contradistinguish OA patients from PA patients with the healthy control, which is essential for a better diagnosis and treatment of inflammatory arthritis in humans.

  3. Structural Changes in Socio-Affective Networks: Multi-Modal MRI Findings in Long-Term Meditation Practitioners.

    PubMed

    Engen, Haakon G; Bernhardt, Boris C; Skottnik, Leon; Ricard, Matthieu; Singer, Tania

    2017-08-22

    Our goal was to assess the effects of long-term mental training in socio-affective skills on structural brain networks. We studied a group of long-term meditation practitioners (LTMs) who have focused on cultivating socio-affective skills using loving-kindness and compassion meditation for an average of 40k hours, comparing these to meditation-naïve controls. To maximize homogeneity of prior practice, LTMs were included only if they had undergone extensive full-time meditation retreats in the same center. MRI-based cortical thickness analysis revealed increased thickness in the LTM cohort relative to meditation-native controls in fronto-insular cortices. To identify functional networks relevant for the generation of socio-affective states, structural imaging analysis were complemented by fMRI analysis in LTMs, showing amplitude increases during a loving-kindness meditation session relative to non-meditative rest in multiple prefrontal and insular regions bilaterally. Importantly, functional findings partially overlapped with regions of cortical thickness increases in the left ventrolateral prefrontal cortex and anterior insula, suggesting that these regions may play a central role in the generation of emotional states relevant for the meditative practice. Our multi-modal MRI approach revealed structural changes in LTMs who have cultivated loving-kindness and compassion for a significant period of their life in functional networks activated by these practices. These preliminary cross-sectional findings motivate future longitudinal work studying brain plasticity following the regular practice of skills aiming at enhancing human altruism and prosocial motivation. Copyright © 2017 Elsevier Ltd. All rights reserved.

  4. A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots.

    PubMed

    Gutiérrez, Marco A; Manso, Luis J; Pandya, Harit; Núñez, Pedro

    2017-02-11

    Object detection and classification have countless applications in human-robot interacting systems. It is a necessary skill for autonomous robots that perform tasks in household scenarios. Despite the great advances in deep learning and computer vision, social robots performing non-trivial tasks usually spend most of their time finding and modeling objects. Working in real scenarios means dealing with constant environment changes and relatively low-quality sensor data due to the distance at which objects are often found. Ambient intelligence systems equipped with different sensors can also benefit from the ability to find objects, enabling them to inform humans about their location. For these applications to succeed, systems need to detect the objects that may potentially contain other objects, working with relatively low-resolution sensor data. A passive learning architecture for sensors has been designed in order to take advantage of multimodal information, obtained using an RGB-D camera and trained semantic language models. The main contribution of the architecture lies in the improvement of the performance of the sensor under conditions of low resolution and high light variations using a combination of image labeling and word semantics. The tests performed on each of the stages of the architecture compare this solution with current research labeling techniques for the application of an autonomous social robot working in an apartment. The results obtained demonstrate that the proposed sensor architecture outperforms state-of-the-art approaches.

  5. A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots

    PubMed Central

    Gutiérrez, Marco A.; Manso, Luis J.; Pandya, Harit; Núñez, Pedro

    2017-01-01

    Object detection and classification have countless applications in human–robot interacting systems. It is a necessary skill for autonomous robots that perform tasks in household scenarios. Despite the great advances in deep learning and computer vision, social robots performing non-trivial tasks usually spend most of their time finding and modeling objects. Working in real scenarios means dealing with constant environment changes and relatively low-quality sensor data due to the distance at which objects are often found. Ambient intelligence systems equipped with different sensors can also benefit from the ability to find objects, enabling them to inform humans about their location. For these applications to succeed, systems need to detect the objects that may potentially contain other objects, working with relatively low-resolution sensor data. A passive learning architecture for sensors has been designed in order to take advantage of multimodal information, obtained using an RGB-D camera and trained semantic language models. The main contribution of the architecture lies in the improvement of the performance of the sensor under conditions of low resolution and high light variations using a combination of image labeling and word semantics. The tests performed on each of the stages of the architecture compare this solution with current research labeling techniques for the application of an autonomous social robot working in an apartment. The results obtained demonstrate that the proposed sensor architecture outperforms state-of-the-art approaches. PMID:28208671

  6. Semi-supervised multimodal relevance vector regression improves cognitive performance estimation from imaging and biological biomarkers.

    PubMed

    Cheng, Bo; Zhang, Daoqiang; Chen, Songcan; Kaufer, Daniel I; Shen, Dinggang

    2013-07-01

    Accurate estimation of cognitive scores for patients can help track the progress of neurological diseases. In this paper, we present a novel semi-supervised multimodal relevance vector regression (SM-RVR) method for predicting clinical scores of neurological diseases from multimodal imaging and biological biomarker, to help evaluate pathological stage and predict progression of diseases, e.g., Alzheimer's diseases (AD). Unlike most existing methods, we predict clinical scores from multimodal (imaging and biological) biomarkers, including MRI, FDG-PET, and CSF. Considering that the clinical scores of mild cognitive impairment (MCI) subjects are often less stable compared to those of AD and normal control (NC) subjects due to the heterogeneity of MCI, we use only the multimodal data of MCI subjects, but no corresponding clinical scores, to train a semi-supervised model for enhancing the estimation of clinical scores for AD and NC subjects. We also develop a new strategy for selecting the most informative MCI subjects. We evaluate the performance of our approach on 202 subjects with all three modalities of data (MRI, FDG-PET and CSF) from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The experimental results show that our SM-RVR method achieves a root-mean-square error (RMSE) of 1.91 and a correlation coefficient (CORR) of 0.80 for estimating the MMSE scores, and also a RMSE of 4.45 and a CORR of 0.78 for estimating the ADAS-Cog scores, demonstrating very promising performances in AD studies.

  7. [Research on non-rigid registration of multi-modal medical image based on Demons algorithm].

    PubMed

    Hao, Peibo; Chen, Zhen; Jiang, Shaofeng; Wang, Yang

    2014-02-01

    Non-rigid medical image registration is a popular subject in the research areas of the medical image and has an important clinical value. In this paper we put forward an improved algorithm of Demons, together with the conservation of gray model and local structure tensor conservation model, to construct a new energy function processing multi-modal registration problem. We then applied the L-BFGS algorithm to optimize the energy function and solve complex three-dimensional data optimization problem. And finally we used the multi-scale hierarchical refinement ideas to solve large deformation registration. The experimental results showed that the proposed algorithm for large de formation and multi-modal three-dimensional medical image registration had good effects.

  8. Single-Step Assembly of Multimodal Imaging Nanocarriers: MRI and Long-Wavelength Fluorescence Imaging.

    PubMed

    Pinkerton, Nathalie M; Gindy, Marian E; Calero-DdelC, Victoria L; Wolfson, Theodore; Pagels, Robert F; Adler, Derek; Gao, Dayuan; Li, Shike; Wang, Ruobing; Zevon, Margot; Yao, Nan; Pacheco, Carlos; Therien, Michael J; Rinaldi, Carlos; Sinko, Patrick J; Prud'homme, Robert K

    2015-06-24

    Magnetic resonance imaging (MRI)- and near-infrared (NIR)-active, multimodal composite nanocarriers (CNCs) are prepared using a simple one-step process, flash nanoprecipitation (FNP). The FNP process allows for the independent control of the hydrodynamic diameter, co-core excipient and NIR dye loading, and iron oxide-based nanocrystal (IONC) content of the CNCs. In the controlled precipitation process, 10 nm IONCs are encapsulated into poly(ethylene glycol) (PEG) stabilized CNCs to make biocompatible T2 contrast agents. By adjusting the formulation, CNC size is tuned between 80 and 360 nm. Holding the CNC size constant at an intensity weighted average diameter of 99 ± 3 nm (PDI width 28 nm), the particle relaxivity varies linearly with encapsulated IONC content ranging from 66 to 533 × 10(-3) m(-1) s(-1) for CNCs formulated with 4-16 wt% IONC. To demonstrate the use of CNCs as in vivo MRI contrast agents, CNCs are surface functionalized with liver-targeting hydroxyl groups. The CNCs enable the detection of 0.8 mm(3) non-small cell lung cancer metastases in mice livers via MRI. Incorporating the hydrophobic, NIR dye tris-(porphyrinato)zinc(II) into CNCs enables complementary visualization with long-wavelength fluorescence at 800 nm. In vivo imaging demonstrates the ability of CNCs to act both as MRI and fluorescent imaging agents.

  9. Imaging arterial cells, atherosclerosis, and restenosis by multimodal nonlinear optical microscopy

    NASA Astrophysics Data System (ADS)

    Wang, Han-Wei; Simianu, Vlad; Locker, Matthew J.; Sturek, Michael; Cheng, Ji-Xin

    2008-02-01

    By integrating sum-frequency generation (SFG), and two-photon excitation fluorescence (TPEF) on a coherent anti-Stokes Raman scattering (CARS) microscope platform, multimodal nonlinear optical (NLO) imaging of arteries and atherosclerotic lesions was demonstrated. CARS signals arising from CH II-rich membranes allowed visualization of endothelial cells and smooth muscle cells in a carotid artery. Additionally, CARS microscopy allowed vibrational imaging of elastin and collagen fibrils which are rich in CH II bonds in their cross-linking residues. The extracellular matrix organization was further confirmed by TPEF signals arising from elastin's autofluorescence and SFG signals arising from collagen fibrils' non-centrosymmetric structure. The system is capable of identifying different atherosclerotic lesion stages with sub-cellular resolution. The stages of atherosclerosis, such as macrophage infiltration, lipid-laden foam cell accumulation, extracellular lipid distribution, fibrous tissue deposition, plaque establishment, and formation of other complicated lesions could be viewed by our multimodal CARS microscope. Collagen percentages in the region adjacent to coronary artery stents were resolved. High correlation between NLO and histology imaging evidenced the validity of the NLO imaging. The capability of imaging significant components of an arterial wall and distinctive stages of atherosclerosis in a label-free manner suggests the potential application of multimodal nonlinear optical microscopy to monitor the onset and progression of arterial diseases.

  10. Multimodal optical imaging system for in vivo investigation of cerebral oxygen delivery and energy metabolism

    PubMed Central

    Yaseen, Mohammad A.; Srinivasan, Vivek J.; Gorczynska, Iwona; Fujimoto, James G.; Boas, David A.; Sakadžić, Sava

    2015-01-01

    Improving our understanding of brain function requires novel tools to observe multiple physiological parameters with high resolution in vivo. We have developed a multimodal imaging system for investigating multiple facets of cerebral blood flow and metabolism in small animals. The system was custom designed and features multiple optical imaging capabilities, including 2-photon and confocal lifetime microscopy, optical coherence tomography, laser speckle imaging, and optical intrinsic signal imaging. Here, we provide details of the system’s design and present in vivo observations of multiple metrics of cerebral oxygen delivery and energy metabolism, including oxygen partial pressure, microvascular blood flow, and NADH autofluorescence. PMID:26713212

  11. MR image features predicting hemorrhagic transformation in acute cerebral infarction: a multimodal study.

    PubMed

    Liu, Chunming; Dong, Zhengchao; Xu, Liang; Khursheed, Aiman; Dong, Longchun; Liu, Zhenxing; Yang, Jun; Liu, Jun

    2015-11-01

    The aims of this study were to observe magnetic resonance imaging (MRI) features and the frequency of hemorrhagic transformation (HT) in patients with acute cerebral infarction and to identify the risk factors of HT. We first performed multimodal MRI (anatomical, diffusion weighted, and susceptibility weighted) scans on 87 patients with acute cerebral infarction within 24 hours after symptom onset and documented the image findings. We then performed follow-up examinations 3 days to 2 weeks after the onset or whenever the conditions of the patients worsened within 3 days. We utilized univariate statistics to identify the correlations between HT and image features and used multivariate logistical regression to correct for confounding factors to determine relevant independent image features of HT. HT was observed in 17 out of total 87 patients (19.5 %). The infarct size (p = 0.021), cerebral microbleeds (CMBs) (p = 0.004), relative apparent diffusion (rADC) (p = 0.023), and venous anomalies (p = 0.000) were significantly related with HT in the univariate statistics. Multivariate analysis demonstrated that CMBs (odd ratio (OR) = 0.082; 95 % confidence interval (CI) = 0.011-0.597; p = 0.014), rADC (OR = 0.000; 95 % CI = 0.000-0.692; p = 0.041), and venous anomalies (OR = 0.066; 95 % CI = 0.011-0.403; p = 0.003) were independent risk factors for HT. The frequency of HT is 19.5 % in this study. CMBs, rADC, and venous anomalies are independent risk factors for HT of acute cerebral infarction.

  12. Finding curvilinear features in speckled images

    NASA Technical Reports Server (NTRS)

    Samadani, Ramin; Vesecky, John F.

    1990-01-01

    A method for finding curves in digital images with speckle noise is described. The solution method differs from standard linear convolutions followed by thresholds in that it explicitly allows curvature in the features. Maximum a posteriori (MAP) estimation is used, together with statistical models for the speckle noise and for the curve-generation process, to find the most probable estimate of the feature, given the image data. The estimation process is first described in general terms. Then, incorporation of the specific neighborhood system and a multiplicative noise model for speckle allows derivation of the solution, using dynamic programming, of the estimation problem. The detection of curvilinear features is considered separately. The detection results allow the determination of the minimal size of detectable feature. Finally, the estimation of linear features, followed by a detection step, is shown for computer-simulated images and for a SAR image of sea ice.

  13. Primary intracranial choriocarcinoma: MR imaging findings.

    PubMed

    Lv, X-F; Qiu, Y-W; Zhang, X-L; Han, L-J; Qiu, S-J; Xiong, W; Wen, G; Zhang, Y-Z; Zhang, J

    2010-11-01

    PICCC is the rarest, most malignant primary intracranial GCT. The purpose of this study was to describe and characterize the MR imaging findings in a series of 7 patients (6 males and 1 female; mean age, 11.9 years) with pathologically proved PICCC in our institution from 2004 to 2009. All tumors were located within the pineal (n = 6) or suprasellar (n = 1) regions. On T2-weighted MR imaging, the lesions appeared markedly heterogeneous with areas of both hypointensity and hyperintensity reflecting the histologic heterogeneity, including hemorrhage, fibrosis, cysts, or necrosis. Heterogeneous (n = 7), ringlike (n = 4), and/or intratumoral nodular (n = 3) enhancement was noted on T1-weighted images with gadolinium. These MR imaging findings, combined with patient age and serum β-HCG levels, may prove helpful in distinguishing PICCC from the more common primary brain tumors, thereby avoiding biopsy of this highly vascular tumor.

  14. Multi-modality imaging of transient osteoporosis of the hip.

    PubMed

    Gemmel, Filip; Van Der Veen, Hugo C; Van Schelven, Willem D; Collins, James M P; Vanneuville, Isabelle; Rijk, Paul C

    2012-10-01

    Transient osteoporosis of the hip (TOH), also referred to as bone marrow edema syndrome (BMES) of the femoral head and neck, is an uncommon and therefore underdiagnosed benign skeletal disorder, affecting primarily women, particularly in their last trimester of pregnancy, and middle-aged men. The disease is characterized by self-limiting hip pain and radiographically evident osteopenia, but these radiographic findings can sometimes be delayed. In the early phase, the main diagnostic dilemma lies in differentiating TOH from osteonecrosis of the femoral head (ONFH). Conventional radiographs, Tc-99m bone scans (multiphase, SPECT or SPECT/CT) and MRI scans from 10 male patients with 12 TOH episodes were retrospectively and independently reviewed by two nuclear medicine physicians and a musculoskeletal radiologist. The purpose was to identify a typical imaging pattern, and secondly, to reliably distinguish TOH from ONFH. In the early phase of TOH, conventional radiography of the hip could not sufficiently detect focal osteopenia. But in all 10 patients (mean age 45 years, range, 34-62), bone scans and MRI scans demonstrated a similar pattern of diffuse hyperaemia, bony uptake, and bone marrow edema in the femoral head and neck, extending to and ending with a sharp demarcation at the intertrochanteric region. Additionally, neither SPECT nor SPECT/CT nor MRI revealed any cold area or crescent-shaped subchondral defect in the femoral head, indicating ONFH. In some cases there was a joint effusion in varying degree. In 9 patients, an uneventful recovery was eventually observed. Scintigraphically diffuse hyperaemic and/or homogeneous osseous uptake in femoral head and neck extending to the intertrochanteric region, as well as the recently introduced term transient bone marrow edema syndrome (BMES) of the hip on MRI, are probably both expressions of the same pathophysiological mechanism, and pathognomonic for TOH. Hopefully, recognizing this highly specific imaging pattern

  15. Multimodality multidimensional image analysis of cortical and subcortical plasticity in the rat brain.

    PubMed

    Goldszal, A F; Tretiak, O J; Liu, D D; Hand, P J

    1996-01-01

    In this work, we developed and implemented a multimodality multidimensional imaging system which is capable of generating and displaying anatomical and functional images of selected structures and processes within a vertebrate's central nervous system (CNS). The functional images are generated from [14C]-2-deoxy-D-glucose (2DG) autoradiography whereas the anatomic images are derived from cytochrome oxidase (CO) histochemistry. This multi-modality imaging system has been used to study mechanisms underlying information processing in the rat brain. We have applied this technique to visualize and measure the plasticity (deformation) observed in the rat's whisker system due to neonatal lesioning of selected peripheral sensory organs. Application of this imaging system revealed detailed information about the shape, size, and directionality of selected cortical and subcortical structures. Previous 2-D imaging techniques were unable to deliver such holistic information. Another important issue addressed in this work is related to image registration problems. We developed an image registration technique which employs extrinsic fiduciary marks for alignment and is capable of registering images with subpixel accuracy. It uses the information from all available fiduciary marks to promote alignment of the sections and to avoid propagation of errors across a serial data set.

  16. Ultrasound-Triggered Phase Transition Sensitive Magnetic Fluorescent Nanodroplets as a Multimodal Imaging Contrast Agent in Rat and Mouse Model

    PubMed Central

    Chen, Yunchao; Luo, Binhua; Liu, Xuhan; Liu, Wei; Xu, Haibo; Yang, Xiangliang

    2013-01-01

    Ultrasound-triggered phase transition sensitive nanodroplets with multimodal imaging functionality were prepared via premix Shirasu porous glass (SPG) membrane emulsification method. The nanodroplets with fluorescence dye DiR and SPIO nanoparticles (DiR-SPIO-NDs) had a polymer shell and a liquid perfluoropentane (PFP) core. The as-formed DiR-SPIO-NDs have a uniform size of 385±5.0 nm with PDI of 0.169±0.011. The TEM and microscopy imaging showed that the DiR-SPIO-NDs existed as core-shell spheres, and DiR and SPIO nanoparticles dispersed in the shell or core. The MTT and hemolysis studies demonstrated that the nanodroplets were biocompatible and safe. Moreover, the proposed nanodroplets exhibited significant ultrasound-triggered phase transition property under clinical diagnostic ultrasound irradiation due to the vaporization of PFP inside. Meanwhile, the high stability and R2 relaxivity of the DiR-SPIO-NDs suggested its applicability in MRI. The in vivo T2-weighted images of MRI and fluorescence images both showed that the image contrast in liver and spleen of rats and mice model were enhanced after the intravenous injection of DiR-SPIO-NDs. Furthermore, the ultrasound imaging (US) in mice tumor as well as MRI and fluorescence imaging in liver of rats and mice showed that the DiR-SPIO-NDs had long-lasting contrast ability in vivo. These in vitro and in vivo findings suggested that DiR-SPIO-NDs could potentially be a great MRI/US/fluorescence multimodal imaging contrast agent in the diagnosis of liver tissue diseases. PMID:24391983

  17. Ultrasound-triggered phase transition sensitive magnetic fluorescent nanodroplets as a multimodal imaging contrast agent in rat and mouse model.

    PubMed

    Cheng, Xin; Li, Huan; Chen, Yunchao; Luo, Binhua; Liu, Xuhan; Liu, Wei; Xu, Haibo; Yang, Xiangliang

    2013-01-01

    Ultrasound-triggered phase transition sensitive nanodroplets with multimodal imaging functionality were prepared via premix Shirasu porous glass (SPG) membrane emulsification method. The nanodroplets with fluorescence dye DiR and SPIO nanoparticles (DiR-SPIO-NDs) had a polymer shell and a liquid perfluoropentane (PFP) core. The as-formed DiR-SPIO-NDs have a uniform size of 385 ± 5.0 nm with PDI of 0.169 ± 0.011. The TEM and microscopy imaging showed that the DiR-SPIO-NDs existed as core-shell spheres, and DiR and SPIO nanoparticles dispersed in the shell or core. The MTT and hemolysis studies demonstrated that the nanodroplets were biocompatible and safe. Moreover, the proposed nanodroplets exhibited significant ultrasound-triggered phase transition property under clinical diagnostic ultrasound irradiation due to the vaporization of PFP inside. Meanwhile, the high stability and R2 relaxivity of the DiR-SPIO-NDs suggested its applicability in MRI. The in vivo T2-weighted images of MRI and fluorescence images both showed that the image contrast in liver and spleen of rats and mice model were enhanced after the intravenous injection of DiR-SPIO-NDs. Furthermore, the ultrasound imaging (US) in mice tumor as well as MRI and fluorescence imaging in liver of rats and mice showed that the DiR-SPIO-NDs had long-lasting contrast ability in vivo. These in vitro and in vivo findings suggested that DiR-SPIO-NDs could potentially be a great MRI/US/fluorescence multimodal imaging contrast agent in the diagnosis of liver tissue diseases.

  18. Abdominal vascular syndromes: characteristic imaging findings.

    PubMed

    Cardarelli-Leite, Leandro; Velloni, Fernanda Garozzo; Salvadori, Priscila Silveira; Lemos, Marcelo Delboni; D'Ippolito, Giuseppe

    2016-01-01

    Abdominal vascular syndromes are rare diseases. Although such syndromes vary widely in terms of symptoms and etiologies, certain imaging findings are characteristic. Depending on their etiology, they can be categorized as congenital-including blue rubber bleb nevus syndrome, Klippel-Trenaunay syndrome, and hereditary hemorrhagic telangiectasia (Rendu-Osler-Weber syndrome)-or compressive-including "nutcracker" syndrome, median arcuate ligament syndrome, Cockett syndrome (also known as May-Thurner syndrome), and superior mesenteric artery syndrome. In this article, we aimed to illustrate imaging findings that are characteristic of these syndromes, through studies conducted at our institution, as well as to perform a brief review of the literature on this topic.

  19. Eliminating the scattering ambiguity in multifocal, multimodal multiphoton imaging systems

    PubMed Central

    Hoover, Erich E.; Field, Jeffrey J.; Winters, David G.; Young, Michael D.; Chandler, Eric V.; Speirs, John C.; Kim, Susy M.; Ding, Shi-you; Bartels, Randy A.; Wang, Jing W.; Squier, Jeff A.

    2013-01-01

    Four images of Drosophila Melanogaster antennal lobe structure labeled with red fluorescent protein. The images are separated axially by 7 μm in depth, and were all acquired simultaneously from a single-element detector. PMID:22461190

  20. Multi-modal imaging and cancer therapy using lanthanide oxide nanoparticles: current status and perspectives.

    PubMed

    Park, J Y; Chang, Y; Lee, G H

    2015-01-01

    Biomedical imaging is an essential tool for diagnosis and therapy of diseases such as cancers. It is likely true that medicine has developed with biomedical imaging methods. Sensitivity and resolution of biomedical imaging methods can be improved with imaging agents. Furthermore, it will be ideal if imaging agents could be also used as therapeutic agents. Therefore, one dose can be used for both diagnosis and therapy of diseases (i.e., theragnosis). This will simplify medical treatment of diseases, and will be also a benefit to patients. Mixed (Ln(1x)Ln(2y)O3, x + y = 2) or unmixed (Ln2O3) lanthanide (Ln) oxide nanoparticles (Ln = Eu, Gd, Dy, Tb, Ho, Er) are potential multi-modal imaging and cancer therapeutic agents. The lanthanides have a variety of magnetic and optical properties, useful for magnetic resonance imaging (MRI) and fluorescent imaging (FI), respectively. They also highly attenuate X-ray beam, useful for X-ray computed tomography (CT). In addition gadolinium-157 ((157)Gd) has the highest thermal neutron capture cross section among stable radionuclides, useful for gadolinium neutron capture therapy (GdNCT). Therefore, mixed or unmixed lanthanide oxide nanoparticles can be used for multi-modal imaging methods (i.e., MRI-FI, MRI-CT, CT-FI, and MRICT- FI) and cancer therapy (i.e., GdNCT). Since mixed or unmixed lanthanide oxide nanoparticles are single-phase and solid-state, they can be easily synthesized, and are compact and robust, which will be beneficial to biomedical applications. In this review physical properties of the lanthanides, synthesis, characterizations, multi-modal imagings, and cancer therapy of mixed and unmixed lanthanide oxide nanoparticles are discussed.

  1. Multimodality 3-Dimensional Image Integration for Congenital Cardiac Catheterization

    PubMed Central

    2014-01-01

    Cardiac catheterization procedures for patients with congenital and structural heart disease are becoming more complex. New imaging strategies involving integration of 3-dimensional images from rotational angiography, magnetic resonance imaging (MRI), computerized tomography (CT), and transesophageal echocardiography (TEE) are employed to facilitate these procedures. We discuss the current use of these new 3D imaging technologies and their advantages and challenges when used to guide complex diagnostic and interventional catheterization procedures in patients with congenital heart disease. PMID:25114757

  2. Discriminative feature representation for image classification via multimodal multitask deep neural networks

    NASA Astrophysics Data System (ADS)

    Mei, Shuang; Yang, Hua; Yin, Zhouping

    2017-01-01

    A good image feature representation is crucial for image classification tasks. Many traditional applications have attempted to design single-modal features for image classification; however, these may have difficulty extracting sufficient information, resulting in misjudgments for various categories. Recently, researchers have focused on designing multimodal features, which have been successfully employed in many situations. However, there are still some problems in this research area, including selecting efficient features for each modality, transforming them to the subspace feature domain, and removing the heterogeneities among different modalities. We propose an end-to-end multimodal deep neural network (MDNN) framework to automate the feature selection and transformation procedures for image classification. Furthermore, inspired by Fisher's theory of linear discriminant analysis, we improve the proposed MDNN by further proposing a multimodal multitask deep neural network (M2DNN) model. The motivation behind M2DNN is to improve the classification performance by incorporating an auxiliary discriminative constraint to the subspace representation. Experimental results on five representative datasets (NUS-WIDE, Scene-15, Texture-25, Indoor-67, and Caltech-101) demonstrate the effectiveness of the proposed MDNN and M2DNN models. In addition, experimental comparisons of the Fisher score criterion exhibit that M2DNN is more robust and has better discriminative power than other approaches.

  3. Biological Parametric Mapping: A Statistical Toolbox for Multi-Modality Brain Image Analysis

    PubMed Central

    Casanova, Ramon; Ryali, Srikanth; Baer, Aaron; Laurienti, Paul J.; Burdette, Jonathan H.; Hayasaka, Satoru; Flowers, Lynn; Wood, Frank; Maldjian, Joseph A.

    2006-01-01

    In recent years multiple brain MR imaging modalities have emerged; however, analysis methodologies have mainly remained modality specific. In addition, when comparing across imaging modalities, most researchers have been forced to rely on simple region-of-interest type analyses, which do not allow the voxel-by-voxel comparisons necessary to answer more sophisticated neuroscience questions. To overcome these limitations, we developed a toolbox for multimodal image analysis called biological parametric mapping (BPM), based on a voxel-wise use of the general linear model. The BPM toolbox incorporates information obtained from other modalities as regressors in a voxel-wise analysis, thereby permitting investigation of more sophisticated hypotheses. The BPM toolbox has been developed in MATLAB with a user friendly interface for performing analyses, including voxel-wise multimodal correlation, ANCOVA, and multiple regression. It has a high degree of integration with the SPM (statistical parametric mapping) software relying on it for visualization and statistical inference. Furthermore, statistical inference for a correlation field, rather than a widely-used T-field, has been implemented in the correlation analysis for more accurate results. An example with in-vivo data is presented demonstrating the potential of the BPM methodology as a tool for multimodal image analysis. PMID:17070709

  4. Nanoparticles for multimodal in vivo imaging in nanomedicine

    PubMed Central

    Key, Jaehong; Leary, James F

    2014-01-01

    While nanoparticles are usually designed for targeted drug delivery, they can also simultaneously provide diagnostic information by a variety of in vivo imaging methods. These diagnostic capabilities make use of specific properties of nanoparticle core materials. Near-infrared fluorescent probes provide optical detection of cells targeted by real-time nanoparticle-distribution studies within the organ compartments of live, anesthetized animals. By combining different imaging modalities, we can start with deep-body imaging by magnetic resonance imaging or computed tomography, and by using optical imaging, get down to the resolution required for real-time fluorescence-guided surgery. PMID:24511229

  5. Multi-modal registration for correlative microscopy using image analogies.

    PubMed

    Cao, Tian; Zach, Christopher; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

    2014-08-01

    Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies for the same biological specimen. In this paper, we propose an image registration method for correlative microscopy, which is challenging due to the distinct appearance of biological structures when imaged with different modalities. Our method is based on image analogies and allows to transform images of a given modality into the appearance-space of another modality. Hence, the registration between two different types of microscopy images can be transformed to a mono-modality image registration. We use a sparse representation model to obtain image analogies. The method makes use of corresponding image training patches of two different imaging modalities to learn a dictionary capturing appearance relations. We test our approach on backscattered electron (BSE) scanning electron microscopy (SEM)/confocal and transmission electron microscopy (TEM)/confocal images. We perform rigid, affine, and deformable registration via B-splines and show improvements over direct registration using both mutual information and sum of squared differences similarity measures to account for differences in image appearance. Copyright © 2013 Elsevier B.V. All rights reserved.

  6. Multi-modal Registration for Correlative Microscopy using Image Analogies

    PubMed Central

    Cao, Tian; Zach, Christopher; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

    2014-01-01

    Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies for the same biological specimen. In this paper, we propose an image registration method for correlative microscopy, which is challenging due to the distinct appearance of biological structures when imaged with different modalities. Our method is based on image analogies and allows to transform images of a given modality into the appearance-space of another modality. Hence, the registration between two different types of microscopy images can be transformed to a mono-modality image registration. We use a sparse representation model to obtain image analogies. The method makes use of corresponding image training patches of two different imaging modalities to learn a dictionary capturing appearance relations. We test our approach on backscattered electron (BSE) scanning electron microscopy (SEM)/confocal and transmission electron microscopy (TEM)/confocal images. We perform rigid, affine, and deformable registration via B-splines and show improvements over direct registration using both mutual information and sum of squared differences similarity measures to account for differences in image appearance. PMID:24387943

  7. A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration

    PubMed Central

    Chen, Jian; Tian, Jie; Lee, Noah; Zheng, Jian; Smith, R. Theodore; Laine, Andrew F.

    2011-01-01

    Detection of vascular bifurcations is a challenging task in multimodal retinal image registration. Existing algorithms based on bifurcations usually fail in correctly aligning poor quality retinal image pairs. To solve this problem, we propose a novel highly distinctive local feature descriptor named partial intensity invariant feature descriptor (PIIFD) and describe a robust automatic retinal image registration framework named Harris-PIIFD. PIIFD is invariant to image rotation, partially invariant to image intensity, affine transformation, and viewpoint/perspective change. Our Harris-PIIFD framework consists of four steps. First, corner points are used as control point candidates instead of bifurcations since corner points are sufficient and uniformly distributed across the image domain. Second, PIIFDs are extracted for all corner points, and a bilateral matching technique is applied to identify corresponding PIIFDs matches between image pairs. Third, incorrect matches are removed and inaccurate matches are refined. Finally, an adaptive transformation is used to register the image pairs. PIIFD is so distinctive that it can be correctly identified even in nonvascular areas. When tested on 168 pairs of multimodal retinal images, the Harris-PIIFD far outperforms existing algorithms in terms of robustness, accuracy, and computational efficiency. PMID:20176538

  8. Modeling decision-making in single- and multi-modal medical images

    NASA Astrophysics Data System (ADS)

    Canosa, R. L.; Baum, K. G.

    2009-02-01

    This research introduces a mode-specific model of visual saliency that can be used to highlight likely lesion locations and potential errors (false positives and false negatives) in single-mode PET and MRI images and multi-modal fused PET/MRI images. Fused-modality digital images are a relatively recent technological improvement in medical imaging; therefore, a novel component of this research is to characterize the perceptual response to these fused images. Three different fusion techniques were compared to single-mode displays in terms of observer error rates using synthetic human brain images generated from an anthropomorphic phantom. An eye-tracking experiment was performed with naÃve (non-radiologist) observers who viewed the single- and multi-modal images. The eye-tracking data allowed the errors to be classified into four categories: false positives, search errors (false negatives never fixated), recognition errors (false negatives fixated less than 350 milliseconds), and decision errors (false negatives fixated greater than 350 milliseconds). A saliency model consisting of a set of differentially weighted low-level feature maps is derived from the known error and ground truth locations extracted from a subset of the test images for each modality. The saliency model shows that lesion and error locations attract visual attention according to low-level image features such as color, luminance, and texture.

  9. Multi-Modal Nano-Probes for Radionuclide and 5-color Near Infrared Optical Lymphatic Imaging

    PubMed Central

    Kobayashi, Hisataka; Koyama, Yoshinori; Barrett, Tristan; Hama, Yukihiro; Regino, Celeste A. S.; Shin, In Soo; Jang, Beom-Su; Le, Nhat; Paik, Chang H.; Choyke, Peter L.; Urano, Yasuteru

    2008-01-01

    Current contrast agents generally have one function and can only be imaged in monochrome, therefore, the majority of imaging methods can only impart uniparametric information. A single nano-particle has the potential to be loaded with multiple payloads. Such multi-modality probes have the ability to be imaged by more than one imaging technique, which could compensate for the weakness or even combine the advantages of each individual modality. Furthermore, optical imaging using different optical probes enables us to achieve multi-color in vivo imaging, wherein multiple parameters can be read from a single image. To allow differentiation of multiple optical signals in vivo, each probe should have a close but different near infrared emission. To this end, we synthesized nano-probes with multi-modal and multi-color potential, which employed a polyamidoamine dendrimer platform linked to both radionuclides and optical probes, permitting dual-modality scintigraphic and 5-color near infrared optical lymphatic imaging using a multiple excitation spectrally-resolved fluorescence imaging technique. PMID:19079788

  10. Fast and robust multimodal image registration using a local derivative pattern.

    PubMed

    Jiang, Dongsheng; Shi, Yonghong; Chen, Xinrong; Wang, Manning; Song, Zhijian

    2017-02-01

    Deformable multimodal image registration, which can benefit radiotherapy and image guided surgery by providing complementary information, remains a challenging task in the medical image analysis field due to the difficulty of defining a proper similarity measure. This article presents a novel, robust and fast binary descriptor, the discriminative local derivative pattern (dLDP), which is able to encode images of different modalities into similar image representations. dLDP calculates a binary string for each voxel according to the pattern of intensity derivatives in its neighborhood. The descriptor similarity is evaluated using the Hamming distance, which can be efficiently computed, instead of conventional L1 or L2 norms. For the first time, we validated the effectiveness and feasibility of the local derivative pattern for multimodal deformable image registration with several multi-modal registration applications. dLDP was compared with three state-of-the-art methods in artificial image and clinical settings. In the experiments of deformable registration between different magnetic resonance imaging (MRI) modalities from BrainWeb, between computed tomography and MRI images from patient data, and between MRI and ultrasound images from BITE database, we show our method outperforms localized mutual information and entropy images in terms of both accuracy and time efficiency. We have further validated dLDP for the deformable registration of preoperative MRI and three-dimensional intraoperative ultrasound images. Our results indicate that dLDP reduces the average mean target registration error from 4.12 mm to 2.30 mm. This accuracy is statistically equivalent to the accuracy of the state-of-the-art methods in the study; however, in terms of computational complexity, our method significantly outperforms other methods and is even comparable to the sum of the absolute difference. The results reveal that dLDP can achieve superior performance regarding both accuracy and

  11. Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation

    PubMed Central

    Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

    2015-01-01

    The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6–8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multimodality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement. PMID:25562829

  12. Deep convolutional neural networks for multi-modality isointense infant brain image segmentation.

    PubMed

    Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

    2015-03-01

    The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6-8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multi-modality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement.

  13. Vein of foramen caecum: imaging findings.

    PubMed

    Tutar, Onur; Kandemirli, Sedat Giray; Yildirim, Duzgun; Memis, Emine Sebnem; Bakan, Selim

    2016-07-01

    Vein of foramen caecum has been classically described as a vein that connects nasal mucosa to the superior sagittal sinus in classic anatomy textbooks. However, its existence is controversial in literature. Herein, we demonstrated computed tomography and contrast enhanced magnetic resonance imaging findings of a tubular vascular structure extending to nasal mucosa and superior sagittal sinus.

  14. Calibration for single multi-mode fiber digital scanning microscopy imaging system

    NASA Astrophysics Data System (ADS)

    Yin, Zhe; Liu, Guodong; Liu, Bingguo; Gan, Yu; Zhuang, Zhitao; Chen, Fengdong

    2015-11-01

    Single multimode fiber (MMF) digital scanning imaging system is a development tendency of modern endoscope. We concentrate on the calibration method of the imaging system. Calibration method comprises two processes, forming scanning focused spots and calibrating the couple factors varied with positions. Adaptive parallel coordinate algorithm (APC) is adopted to form the focused spots at the multimode fiber (MMF) output. Compare with other algorithm, APC contains many merits, i.e. rapid speed, small amount calculations and no iterations. The ratio of the optics power captured by MMF to the intensity of the focused spots is called couple factor. We setup the calibration experimental system to form the scanning focused spots and calculate the couple factors for different object positions. The experimental result the couple factor is higher in the center than the edge.

  15. Multimodal imaging of vascular network and blood microcirculation by optical diagnostic techniques

    NASA Astrophysics Data System (ADS)

    Kuznetsov, Yu L.; Kalchenko, V. V.; Meglinski, I. V.

    2011-04-01

    We present a multimodal optical diagnostic approach for simultaneous non-invasive in vivo imaging of blood and lymphatic microvessels, utilising a combined use of fluorescence intravital microscopy and a method of dynamic light scattering. This approach makes it possible to renounce the use of fluorescent markers for visualisation of blood vessels and, therefore, significantly (tenfold) reduce the toxicity of the technique and minimise side effects caused by the use of contrast fluorescent markers. We demonstrate that along with the ability to obtain images of lymph and blood microvessels with a high spatial resolution, current multimodal approach allows one to observe in real time permeability of blood vessels. This technique appears to be promising in physiology studies of blood vessels, and especially in the study of peripheral cardiovascular system in vivo.

  16. Multimodal imaging of vascular network and blood microcirculation by optical diagnostic techniques

    SciTech Connect

    Kuznetsov, Yu L; Kalchenko, V V; Meglinski, I V

    2011-04-30

    We present a multimodal optical diagnostic approach for simultaneous non-invasive in vivo imaging of blood and lymphatic microvessels, utilising a combined use of fluorescence intravital microscopy and a method of dynamic light scattering. This approach makes it possible to renounce the use of fluorescent markers for visualisation of blood vessels and, therefore, significantly (tenfold) reduce the toxicity of the technique and minimise side effects caused by the use of contrast fluorescent markers. We demonstrate that along with the ability to obtain images of lymph and blood microvessels with a high spatial resolution, current multimodal approach allows one to observe in real time permeability of blood vessels. This technique appears to be promising in physiology studies of blood vessels, and especially in the study of peripheral cardiovascular system in vivo. (optical technologies in biophysics and medicine)

  17. Albumin based versatile multifunctional nanocarriers for cancer therapy: Fabrication, surface modification, multimodal therapeutics and imaging approaches.

    PubMed

    Kudarha, Ritu R; Sawant, Krutika K

    2017-12-01

    Albumin is a versatile protein used as a carrier system for cancer therapeutics. As a carrier it can provide tumor specificity, reduce drug related toxicity, maintain therapeutic concentration of the active moiety like drug, gene, peptide, protein etc. for long period of time and also reduce drug related toxicities. Apart from cancer therapy, it is also utilized in the imaging and multimodal therapy of cancer. This review highlights the important properties, structure and types of albumin based nanocarriers with regards to their use for cancer targeting. It also provides brief discussion on methods of preparation of these nanocarriers and their surface modification. Applications of albumin nanocarriers for cancer therapy, gene delivery, imaging, phototherapy and multimodal therapy have also been discussed. This review also provides brief discussion about albumin based marketed nano formulations and those under clinical trials. Copyright © 2017 Elsevier B.V. All rights reserved.

  18. Parasitic diseases in the abdomen: imaging findings.

    PubMed

    Lim, Jae Hoon

    2008-01-01

    Parasitic diseases of the liver and biliary tract include echinococcosis, schistosomiasis, toxocariasis, clonorchiasis, and opisthorchiasis, affecting millions people in some endemic areas. Amebiasis and ascariasis are believed to be the most common bowel lumen indwelling parasitic diseases, affecting billions people worldwide, but sometimes these parasites migrate inadvertently to the liver and biliary tract, resulting in liver abscess or obstructive jaundice. Imaging findings of these parasitic diseases are fairly characteristic and easy to recognize if radiologists are aware of the findings, especially in endemic areas. Because of increased immigration and frequent travelling, some patients with "exotic" parasitic diseases may be encountered in non-endemic areas, and the diagnosis may be delayed or difficult, and it is often made only after operation. This feature section was designed to provide the detailed imaging features of common parasitic diseases affecting the abdominal organs and peritoneal cavity, based on pathology-image correlation.

  19. Multi-modal Ultrasound Imaging for Breast Cancer Detection

    NASA Astrophysics Data System (ADS)

    Medina-Valdés, L.; Pérez-Liva, M.; Camacho, J.; Udías, J. M.; Herraiz, J. L.; González-Salido, N.

    This work describes preliminary results of a two-modality imaging system aimed at the early detection of breast cancer. The first technique is based on compounding conventional echographic images taken at regular angular intervals around the imaged breast. The other modality obtains tomographic images of propagation velocity using the same circular geometry. For this study, a low-cost prototype has been built. It is based on a pair of opposed 128-element, 3.2 MHz array transducers that are mechanically moved around tissue mimicking phantoms. Compounded images around 360° provide improved resolution, clutter reduction, artifact suppression and reinforce the visualization of internal structures. However, refraction at the skin interface must be corrected for an accurate image compounding process. This is achieved by estimation of the interface geometry followed by computing the internal ray paths. On the other hand, sound velocity tomographic images from time of flight projections have been also obtained. Two reconstruction methods, Filtered Back Projection (FBP) and 2D Ordered Subset Expectation Maximization (2D OSEM), were used as a first attempt towards tomographic reconstruction. These methods yield useable images in short computational times that can be considered as initial estimates in subsequent more complex methods of ultrasound image reconstruction. These images may be effective to differentiate malignant and benign masses and are very promising for breast cancer screening.

  20. Role of the Sensorimotor Cortex in Tourette Syndrome using Multimodal Imaging

    PubMed Central

    Tinaz, Sule; Belluscio, Beth A.; Malone, Patrick; van der Veen, Jan Willem; Hallett, Mark; Horovitz, Silvina G.

    2016-01-01

    Tourette syndrome (TS) is a neuropsychiatric disorder characterized by motor and vocal tics. Most patients describe uncomfortable premonitory sensations preceding the tics and a subjective experience of increased sensitivity to tactile stimuli. These reports indicate that a sensory processing disturbance is an important component of TS together with motor phenomena. Thus, we focused our investigation on the role of the sensorimotor cortex (SMC) in TS using multimodal neuroimaging techniques. We measured the gamma-aminobutyric acid (GABA)+/Creatine (Cre) ratio in the SMC using GABA 1H magnetic resonance spectroscopy. We recorded the baseline beta activity in the SMC using magnetoencephalography and correlated GABA+/Cre ratio with baseline beta band power. Finally, we examined the resting state functional connectivity (FC) pattern of the SMC using functional magnetic resonance imaging (fMRI). GABA+/Cre ratio in the SMC did not differ between patients and controls. Correlation between the baseline beta band power and GABA+/Cre ratio was abnormal in patients. The anterior insula showed increased FC with the SMC in patients. These findings suggest that altered limbic input to the SMC and abnormal GABA-mediated beta oscillations in the SMC may underpin some of the sensorimotor processing disturbances in TS and contribute to tic generation. PMID:25044024

  1. Simultaneous in vivo imaging of melanin and lipofuscin in the retina with multimodal photoacoustic ophthalmoscopy

    NASA Astrophysics Data System (ADS)

    Zhang, Xiangyang; Zhang, Hao F.; Zhou, Lixiang; Jiao, Shuliang

    2012-02-01

    We combined photoacoustic ophthalmoscopy (PAOM) with autofluorescence imaging for simultaneous in vivo imaging of dual molecular contrasts in the retina using a single light source. The dual molecular contrasts come from melanin and lipofuscin in the retinal pigment epithelium (RPE). Melanin and lipofuscin are two types of pigments and are believed to play opposite roles (protective vs. exacerbate) in the RPE in the aging process. We successfully imaged the retina of pigmented and albino rats at different ages. The experimental results showed that multimodal PAOM system can be a potentially powerful tool in the study of age-related degenerative retinal diseases.

  2. Ultrafast video imaging of cell division from zebrafish egg using multimodal microscopic system

    NASA Astrophysics Data System (ADS)

    Lee, Sung-Ho; Jang, Bumjoon; Kim, Dong Hee; Park, Chang Hyun; Bae, Gyuri; Park, Seung Woo; Park, Seung-Han

    2017-07-01

    Unlike those of other ordinary laser scanning microscopies in the past, nonlinear optical laser scanning microscopy (SHG, THG microscopy) applied ultrafast laser technology which has high peak powers with relatively inexpensive, low-average-power. It short pulse nature reduces the ionization damage in organic molecules. And it enables us to take bright label-free images. In this study, we measured cell division of zebrafish egg with ultrafast video images using multimodal nonlinear optical microscope. The result shows in-vivo cell division label-free imaging with sub-cellular resolution.

  3. Gadolinium-conjugated gold nanoshells for multimodal diagnostic imaging and photothermal cancer therapy.

    PubMed

    Coughlin, Andrew J; Ananta, Jeyarama S; Deng, Nanfu; Larina, Irina V; Decuzzi, Paolo; West, Jennifer L

    2014-02-12

    Multimodal imaging offers the potential to improve diagnosis and enhance the specificity of photothermal cancer therapy. Toward this goal, gadolinium-conjugated gold nanoshells are engineered and it is demonstrated that they enhance contrast for magnetic resonance imaging, X-ray, optical coherence tomography, reflectance confocal microscopy, and two-photon luminescence. Additionally, these particles effectively convert near-infrared light to heat, which can be used to ablate cancer cells. Ultimately, these studies demonstrate the potential of gadolinium-nanoshells for image-guided photothermal ablation.

  4. Gadolinium-Conjugated Gold Nanoshells for Multimodal Diagnostic Imaging and Photothermal Cancer Therapy

    PubMed Central

    Coughlin, Andrew J.; Ananta, Jeyarama S.; Deng, Nanfu; Larina, Irina V.; Decuzzi, Paolo

    2014-01-01

    Multimodal imaging offers the potential to improve diagnosis and enhance the specificity of photothermal cancer therapy. Toward this goal, we have engineered gadolinium-conjugated gold nanoshells and demonstrated that they enhance contrast for magnetic resonance imaging, X-Ray, optical coherence tomography, reflectance confocal microscopy, and two-photon luminescence. Additionally, these particles effectively convert near-infrared light to heat, which can be used to ablate cancer cells. Ultimately, these studies demonstrate the potential of gadolinium-nanoshells for image-guided photothermal ablation. PMID:24115690

  5. Multimodal imaging of the self-regulating developing brain

    PubMed Central

    Fjell, Anders M.; Walhovd, Kristine Beate; Brown, Timothy T.; Kuperman, Joshua M.; Chung, Yoonho; Hagler, Donald J.; Venkatraman, Vijay; Roddey, J. Cooper; Erhart, Matthew; McCabe, Connor; Akshoomoff, Natacha; Amaral, David G.; Bloss, Cinnamon S.; Libiger, Ondrej; Darst, Burcu F.; Schork, Nicholas J.; Casey, B. J.; Chang, Linda; Ernst, Thomas M.; Gruen, Jeffrey R.; Kaufmann, Walter E.; Kenet, Tal; Frazier, Jean; Murray, Sarah S.; Sowell, Elizabeth R.; van Zijl, Peter; Mostofsky, Stewart; Jernigan, Terry L.; Dale, Anders M.; Jernigan, Terry L.; McCabe, Connor; Chang, Linda; Akshoomoff, Natacha; Newman, Erik; Dale, Anders M.; Ernst, Thomas; Dale, Anders M.; Van Zijl, Peter; Kuperman, Joshua; Murray, Sarah; Bloss, Cinnamon; Schork, Nicholas J.; Appelbaum, Mark; Gamst, Anthony; Thompson, Wesley; Bartsch, Hauke; Jernigan, Terry L.; Dale, Anders M.; Akshoomoff, Natacha; Chang, Linda; Ernst, Thomas; Keating, Brian; Amaral, David; Sowell, Elizabeth; Kaufmann, Walter; Van Zijl, Peter; Mostofsky, Stewart; Casey, B.J.; Ruberry, Erika J.; Powers, Alisa; Rosen, Bruce; Kenet, Tal; Frazier, Jean; Kennedy, David; Gruen, Jeffrey

    2012-01-01

    Self-regulation refers to the ability to control behavior, cognition, and emotions, and self-regulation failure is related to a range of neuropsychiatric problems. It is poorly understood how structural maturation of the brain brings about the gradual improvement in self-regulation during childhood. In a large-scale multicenter effort, 735 children (4–21 y) underwent structural MRI for quantification of cortical thickness and surface area and diffusion tensor imaging for quantification of the quality of major fiber connections. Brain development was related to a standardized measure of cognitive control (the flanker task from the National Institutes of Health Toolbox), a critical component of self-regulation. Ability to inhibit responses and impose cognitive control increased rapidly during preteen years. Surface area of the anterior cingulate cortex accounted for a significant proportion of the variance in cognitive performance. This finding is intriguing, because characteristics of the anterior cingulum are shown to be related to impulse, attention, and executive problems in neurodevelopmental disorders, indicating a neural foundation for self-regulation abilities along a continuum from normality to pathology. The relationship was strongest in the younger children. Properties of large-fiber connections added to the picture by explaining additional variance in cognitive control. Although cognitive control was related to surface area of the anterior cingulate independently of basic processes of mental speed, the relationship between white matter quality and cognitive control could be fully accounted for by speed. The results underscore the need for integration of different aspects of brain maturation to understand the foundations of cognitive development. PMID:23150548

  6. Multimodal imaging of the self-regulating developing brain.

    PubMed

    Fjell, Anders M; Walhovd, Kristine Beate; Brown, Timothy T; Kuperman, Joshua M; Chung, Yoonho; Hagler, Donald J; Venkatraman, Vijay; Roddey, J Cooper; Erhart, Matthew; McCabe, Connor; Akshoomoff, Natacha; Amaral, David G; Bloss, Cinnamon S; Libiger, Ondrej; Darst, Burcu F; Schork, Nicholas J; Casey, B J; Chang, Linda; Ernst, Thomas M; Gruen, Jeffrey R; Kaufmann, Walter E; Kenet, Tal; Frazier, Jean; Murray, Sarah S; Sowell, Elizabeth R; van Zijl, Peter; Mostofsky, Stewart; Jernigan, Terry L; Dale, Anders M

    2012-11-27

    Self-regulation refers to the ability to control behavior, cognition, and emotions, and self-regulation failure is related to a range of neuropsychiatric problems. It is poorly understood how structural maturation of the brain brings about the gradual improvement in self-regulation during childhood. In a large-scale multicenter effort, 735 children (4-21 y) underwent structural MRI for quantification of cortical thickness and surface area and diffusion tensor imaging for quantification of the quality of major fiber connections. Brain development was related to a standardized measure of cognitive control (the flanker task from the National Institutes of Health Toolbox), a critical component of self-regulation. Ability to inhibit responses and impose cognitive control increased rapidly during preteen years. Surface area of the anterior cingulate cortex accounted for a significant proportion of the variance in cognitive performance. This finding is intriguing, because characteristics of the anterior cingulum are shown to be related to impulse, attention, and executive problems in neurodevelopmental disorders, indicating a neural foundation for self-regulation abilities along a continuum from normality to pathology. The relationship was strongest in the younger children. Properties of large-fiber connections added to the picture by explaining additional variance in cognitive control. Although cognitive control was related to surface area of the anterior cingulate independently of basic processes of mental speed, the relationship between white matter quality and cognitive control could be fully accounted for by speed. The results underscore the need for integration of different aspects of brain maturation to understand the foundations of cognitive development.

  7. Safe storage and multi-modal search for medical images.

    PubMed

    Kommeri, Jukka; Niinimäki, Marko; Müller, Henning

    2011-01-01

    Modern hospitals produce enormous amounts of data in all departments, from images, to lab results, medication use, and release letters. Since several years these data are most often produced in digital form, making them accessible for researchers to optimize the outcome of care process and analyze all available data across patients. The Geneva University Hospitals (HUG) are no exception with its daily radiology department's output of over 140'000 images in 2010, with a majority of them being tomographic slices. In this paper we introduce tools for uploading and accessing DICOM images and associated metadata in a secure Grid storage. These data are made available for authorized persons using a Grid security framework, as security is a main problem in secondary use of image data, where images are to be stored outside of the clinical image archive. Our tool combines the security and metadata access of a Grid middleware with the visual search that uses GIFT.

  8. Finding corners in images by foveated search

    NASA Astrophysics Data System (ADS)

    Arnow, Thomas L.; Bovik, Alan C.

    2006-01-01

    We develop a new approach to finding corners in images that combines foveated edge detection and curvature calculation with saccadic placement of foveal fixations. Each saccade moves the fovea to a location of high curvature combined with high edge gradient. Edges are located using a foveated Canny edge detector with spatial constant that increases with eccentricity. Next, we calculate a measure of local corner strength, based on a product of curvature and gradient. An inhibition factor based on previous visits to a region of the image prevents the system from repeatedly returning to the same locale. A long saccade is move thes fovea to previously unexplored areas of the image. Subsequent short saccades improve the accuracy of the location of the corner approximated by the long saccade. The system is tested on two natural scenes and the results compared against subjects observing the same test images through an eyetracker. Results show that the algorithm is a good locator of corners.

  9. Evaluation of Multimodal Imaging Biomarkers of Prostate Cancer

    DTIC Science & Technology

    2014-09-01

    scan duration ~ 21 min). PET imaging was performed on a Concorde Microsystems microPET Focus 220. Approximately 120 uCi of tracer was administered...acquired anatomic MRI and PET data in orthotopic tumors within the Pten/p53 mouse model, to assess tumor volume, track growth and tumor angiogenesis...In fic speciregards to PET imaging, we have further characterized the use of FMISO, FDHT and TSPO imaging to evaluate tumor hypoxia, androgen

  10. Multimodality imaging of the thyroid and parathyroid glands

    SciTech Connect

    Sandler, M.P.; Patton, J.A.

    1987-01-01

    Nuclear imaging of the thyroid and parathyroid glands has evolved from early radionuclide rectilinear thyroid scanning to the recently developed dual isotope subtraction technique for detecting parathyroid lesions. At the same time, x-ray fluorescent scanning, ultrasound, x-ray computed tomography, and magnetic resonance imaging have improved identification of these endocrine organs. The appropriate use and relative role of these imaging modalities in the investigation of patients with thyroid and parathyroid diseases is discussed.

  11. Spiking Cortical Model Based Multimodal Medical Image Fusion by Combining Entropy Information with Weber Local Descriptor

    PubMed Central

    Zhang, Xuming; Ren, Jinxia; Huang, Zhiwen; Zhu, Fei

    2016-01-01

    Multimodal medical image fusion (MIF) plays an important role in clinical diagnosis and therapy. Existing MIF methods tend to introduce artifacts, lead to loss of image details or produce low-contrast fused images. To address these problems, a novel spiking cortical model (SCM) based MIF method has been proposed in this paper. The proposed method can generate high-quality fused images using the weighting fusion strategy based on the firing times of the SCM. In the weighting fusion scheme, the weight is determined by combining the entropy information of pulse outputs of the SCM with the Weber local descriptor operating on the firing mapping images produced from the pulse outputs. The extensive experiments on multimodal medical images show that compared with the numerous state-of-the-art MIF methods, the proposed method can preserve image details very well and avoid the introduction of artifacts effectively, and thus it significantly improves the quality of fused images in terms of human vision and objective evaluation criteria such as mutual information, edge preservation index, structural similarity based metric, fusion quality index, fusion similarity metric and standard deviation. PMID:27649190

  12. In vivo imaging of nanoparticle delivery and tumor microvasculature with multimodal optical coherence tomography

    PubMed Central

    Tucker-Schwartz, Jason M.; Beavers, Kelsey R.; Sit, Wesley W.; Shah, Amy T.; Duvall, Craig L.; Skala, Melissa C.

    2014-01-01

    Current imaging techniques capable of tracking nanoparticles in vivo supply either a large field of view or cellular resolution, but not both. Here, we demonstrate a multimodality imaging platform of optical coherence tomography (OCT) techniques for high resolution, wide field of view in vivo imaging of nanoparticles. This platform includes the first in vivo images of nanoparticle pharmacokinetics acquired with photothermal OCT (PTOCT), along with overlaying images of microvascular and tissue morphology. Gold nanorods (51.8 ± 8.1 nm by 15.2 ± 3.3 nm) were intravenously injected into mice, and their accumulation into mammary tumors was non-invasively imaged in vivo in three dimensions over 24 hours using PTOCT. Spatial frequency analysis of PTOCT images indicated that gold nanorods reached peak distribution throughout the tumors by 16 hours, and remained well-dispersed up to 24 hours post-injection. In contrast, the overall accumulation of gold nanorods within the tumors peaked around 16 hours post-injection. The accumulation of gold nanorods within the tumors was validated post-mortem with multiphoton microscopy. This shows the utility of PTOCT as part of a powerful multimodality imaging platform for the development of nanomedicines and drug delivery technologies. PMID:24940536

  13. Spiking Cortical Model Based Multimodal Medical Image Fusion by Combining Entropy Information with Weber Local Descriptor.

    PubMed

    Zhang, Xuming; Ren, Jinxia; Huang, Zhiwen; Zhu, Fei

    2016-09-15

    Multimodal medical image fusion (MIF) plays an important role in clinical diagnosis and therapy. Existing MIF methods tend to introduce artifacts, lead to loss of image details or produce low-contrast fused images. To address these problems, a novel spiking cortical model (SCM) based MIF method has been proposed in this paper. The proposed method can generate high-quality fused images using the weighting fusion strategy based on the firing times of the SCM. In the weighting fusion scheme, the weight is determined by combining the entropy information of pulse outputs of the SCM with the Weber local descriptor operating on the firing mapping images produced from the pulse outputs. The extensive experiments on multimodal medical images show that compared with the numerous state-of-the-art MIF methods, the proposed method can preserve image details very well and avoid the introduction of artifacts effectively, and thus it significantly improves the quality of fused images in terms of human vision and objective evaluation criteria such as mutual information, edge preservation index, structural similarity based metric, fusion quality index, fusion similarity metric and standard deviation.

  14. A Pretargeted Approach for the Multimodal PET/NIRF Imaging of Colorectal Cancer

    PubMed Central

    Adumeau, Pierre; Carnazza, Kathryn E.; Brand, Christian; Carlin, Sean D.; Reiner, Thomas; Agnew, Brian J.; Lewis, Jason S.; Zeglis, Brian M.

    2016-01-01

    The complementary nature of positron emission tomography (PET) and near-infrared fluorescence (NIRF) imaging makes the development of strategies for the multimodal PET/NIRF imaging of cancer a very enticing prospect. Indeed, in the context of colorectal cancer, a single multimodal PET/NIRF imaging agent could be used to stage the disease, identify candidates for surgical intervention, and facilitate the image-guided resection of the disease. While antibodies have proven to be highly effective vectors for the delivery of radioisotopes and fluorophores to malignant tissues, the use of radioimmunoconjugates labeled with long-lived nuclides such as 89Zr poses two important clinical complications: high radiation doses to the patient and the need for significant lag time between imaging and surgery. In vivo pretargeting strategies that decouple the targeting vector from the radioactivity at the time of injection have the potential to circumvent these issues by facilitating the use of positron-emitting radioisotopes with far shorter half-lives. Here, we report the synthesis, characterization, and in vivo validation of a pretargeted strategy for the multimodal PET and NIRF imaging of colorectal carcinoma. This approach is based on the rapid and bioorthogonal ligation between a trans-cyclooctene- and fluorophore-bearing immunoconjugate of the huA33 antibody (huA33-Dye800-TCO) and a 64Cu-labeled tetrazine radioligand (64Cu-Tz-SarAr). In vivo imaging experiments in mice bearing A33 antigen-expressing SW1222 colorectal cancer xenografts clearly demonstrate that this approach enables the non-invasive visualization of tumors and the image-guided resection of malignant tissue, all at only a fraction of the radiation dose created by a directly labeled radioimmunoconjugate. Additional in vivo experiments in peritoneal and patient-derived xenograft models of colorectal carcinoma reinforce the efficacy of this methodology and underscore its potential as an innovative and useful

  15. A Pretargeted Approach for the Multimodal PET/NIRF Imaging of Colorectal Cancer.

    PubMed

    Adumeau, Pierre; Carnazza, Kathryn E; Brand, Christian; Carlin, Sean D; Reiner, Thomas; Agnew, Brian J; Lewis, Jason S; Zeglis, Brian M

    2016-01-01

    The complementary nature of positron emission tomography (PET) and near-infrared fluorescence (NIRF) imaging makes the development of strategies for the multimodal PET/NIRF imaging of cancer a very enticing prospect. Indeed, in the context of colorectal cancer, a single multimodal PET/NIRF imaging agent could be used to stage the disease, identify candidates for surgical intervention, and facilitate the image-guided resection of the disease. While antibodies have proven to be highly effective vectors for the delivery of radioisotopes and fluorophores to malignant tissues, the use of radioimmunoconjugates labeled with long-lived nuclides such as (89)Zr poses two important clinical complications: high radiation doses to the patient and the need for significant lag time between imaging and surgery. In vivo pretargeting strategies that decouple the targeting vector from the radioactivity at the time of injection have the potential to circumvent these issues by facilitating the use of positron-emitting radioisotopes with far shorter half-lives. Here, we report the synthesis, characterization, and in vivo validation of a pretargeted strategy for the multimodal PET and NIRF imaging of colorectal carcinoma. This approach is based on the rapid and bioorthogonal ligation between a trans-cyclooctene- and fluorophore-bearing immunoconjugate of the huA33 antibody (huA33-Dye800-TCO) and a (64)Cu-labeled tetrazine radioligand ((64)Cu-Tz-SarAr). In vivo imaging experiments in mice bearing A33 antigen-expressing SW1222 colorectal cancer xenografts clearly demonstrate that this approach enables the non-invasive visualization of tumors and the image-guided resection of malignant tissue, all at only a fraction of the radiation dose created by a directly labeled radioimmunoconjugate. Additional in vivo experiments in peritoneal and patient-derived xenograft models of colorectal carcinoma reinforce the efficacy of this methodology and underscore its potential as an innovative and useful

  16. Multimodal optical microscopy in combination with gold nanorods for cancer cell imaging.

    PubMed

    Cao, Cai-jun; Li, De-rong; Chen, Chao-xiong; Yang, Xiao-yun; Hu, Juan; Yang, Yong; Zhang, Chun-yang

    2012-12-01

    The multimodal optical imaging technique, which utilizes nonlinear and linear optical processes, plays an important role in biological and biomedical research. As second-order nonlinear phenomenon, the two-photon luminescence (TPL) results from the nonlinear excitation of fluorescent molecules, while the second harmonic generation (SHG) depends on the second order nonlinear polarization, orientation, and noncentrosymmetric properties of molecules. In contrast, the linear resonance light scattering (RLS) occurs when the molecules are excited by a light beam with a wavelength close to their absorption bands. Since SHG, TPL, and RLS involve different kinds of optical processes, they might be used in parallel to provide complementary information about the structure and function of cells and tissues. Herein, we develop for the first time a multimodal optical microscopy with the capability of simultaneous SHG, TPL, and RLS imaging. We analyze theoretically and demonstrate experimentally the near-infrared irradiation-induced SHG, TPL, and RLS from the gold nanorods with nanometer spatial resolution. With the gold nanorods as the contrast agents, we further demonstrate the simultaneous SHG, TPL, and RLS imaging of A431 human epithelial skin cancer cells. This multimodal optical microscopy might provide a reliable and complementary approach for biological and biomedical research.

  17. Multimodal optical microscopy in combination with gold nanorods for cancer cell imaging

    NASA Astrophysics Data System (ADS)

    Cao, Cai-jun; Li, De-rong; Chen, Chao-xiong; Yang, Xiao-yun; Hu, Juan; Yang, Yong; Zhang, Chun-yang

    2012-12-01

    The multimodal optical imaging technique, which utilizes nonlinear and linear optical processes, plays an important role in biological and biomedical research. As second-order nonlinear phenomenon, the two-photon luminescence (TPL) results from the nonlinear excitation of fluorescent molecules, while the second harmonic generation (SHG) depends on the second order nonlinear polarization, orientation, and noncentrosymmetric properties of molecules. In contrast, the linear resonance light scattering (RLS) occurs when the molecules are excited by a light beam with a wavelength close to their absorption bands. Since SHG, TPL, and RLS involve different kinds of optical processes, they might be used in parallel to provide complementary information about the structure and function of cells and tissues. Herein, we develop for the first time a multimodal optical microscopy with the capability of simultaneous SHG, TPL, and RLS imaging. We analyze theoretically and demonstrate experimentally the near-infrared irradiation-induced SHG, TPL, and RLS from the gold nanorods with nanometer spatial resolution. With the gold nanorods as the contrast agents, we further demonstrate the simultaneous SHG, TPL, and RLS imaging of A431 human epithelial skin cancer cells. This multimodal optical microscopy might provide a reliable and complementary approach for biological and biomedical research.

  18. Multimodal imaging probes based on Gd-DOTA conjugated quantum dot nanomicelles.

    PubMed

    Liu, Liwei; Law, Wing-Cheung; Yong, Ken-Tye; Roy, Indrajit; Ding, Hong; Erogbogbo, Folarin; Zhang, Xihe; Prasad, Paras N

    2011-05-07

    Recently, multimodal nanoparticles integrating dual- or tri-imaging modalities into a single hybrid nanosystem have attracted plenty of attention in biomedical research. Here, we report the fabrication of two types of multimodal micelle-encapsulated nanoparticles, which were systematically characterized and thoroughly evaluated in terms of their imaging potential and biocompatibility. Optical and magnetic resonance (MR) imaging probes were integrated by conjugating DOTA-gadolinium (Gd) derivative to quantum dot based nanomicelles. Two amphiphilic block copolymer micelles, amine-terminated mPEG-phospholipid and amine-modified Pluronic F127, were chosen as the capping agents because of their excellent biocompatibility and ability to prevent opsonization and prolong circulation time in vivo. Owing to their different hydrophobic-hydrophilic structure, the micellar aggregates exhibited different sizes and protection of core QDs. This work revealed the differences between these nanomicelles in terms of the stability over a wide range of pH, along with their cytotoxicity and the capacity for chelating gadolinium, thus providing a useful guideline for tailor-making multimodal nanoparticles for specific biomedical applications.

  19. Multimodal formyl peptide receptor 1 targeted inflammation imaging probe: cFLFLF-MHI-DOTA.

    PubMed

    Li, Jie; Zhang, Yi; Chordia, Mahendra D; Wu, Hua; Shao, Li; Pan, Dongfeng

    2016-02-01

    Formyl peptide receptor 1 (FPR1) targeting multimodal probe cFLFLFK-MHI-DOTA for leukocyte based inflammation imaging is described. The compound consists of three domains, (a) cFLFLF peptide for FPR1 recognition and binding for activated leukocyte, (b) heptamethine cyanine dye (MHI) for near infrared fluorescence (NIRF) detection and imaging, and (c) metal chelator DOTA ligand that could form complex with a radiometal for nuclear (PET/SPECT) imaging or with a paramagnetic metal for MRI imaging. Detailed synthesis, characterization and in vitro evaluation are reported. The availability of dual mode inflammation imaging probe would allow in vivo gross level imaging of inflammation foci as well as ex vivo microscopic level cellular imaging for role played by innate immune cells in inflamed tissue. Copyright © 2016. Published by Elsevier Ltd.

  20. Programmable aperture microscopy: A computational method for multi-modal phase contrast and light field imaging

    NASA Astrophysics Data System (ADS)

    Zuo, Chao; Sun, Jiasong; Feng, Shijie; Zhang, Minliang; Chen, Qian

    2016-05-01

    We demonstrate a simple and cost-effective programmable aperture microscope to realize multi-modal computational imaging by integrating a programmable liquid crystal display (LCD) into a conventional wide-field microscope. The LCD selectively modulates the light distribution at the rear aperture of the microscope objective, allowing numerous imaging modalities, such as bright field, dark field, differential phase contrast, quantitative phase imaging, multi-perspective imaging, and full resolution light field imaging to be achieved and switched rapidly in the same setup, without requiring specialized hardwares and any moving parts. We experimentally demonstrate the success of our method by imaging unstained cheek cells, profiling microlens array, and changing perspective views of thick biological specimens. The post-exposure refocusing of a butterfly mouthpart and RFP-labeled dicot stem cross-section is also presented to demonstrate the full resolution light field imaging capability of our system for both translucent and fluorescent specimens.

  1. Multimodality medical image registration and fusion techniques using mutual information and genetic algorithm-based approaches.

    PubMed

    Bhattacharya, Mahua; Das, Arpita

    2011-01-01

    Medical image fusion has been used to derive the useful complimentary information from multimodal images. The prior step of fusion is registration or proper alignment of test images for accurate extraction of detail information. For this purpose, the images to be fused are geometrically aligned using mutual information (MI) as similarity measuring metric followed by genetic algorithm to maximize MI. The proposed fusion strategy incorporating multi-resolution approach extracts more fine details from the test images and improves the quality of composite fused image. The proposed fusion approach is independent of any manual marking or knowledge of fiducial points and starts the procedure automatically. The performance of proposed genetic-based fusion methodology is compared with fuzzy clustering algorithm-based fusion approach, and the experimental results show that genetic-based fusion technique improves the quality of the fused image significantly over the fuzzy approaches.

  2. Multimodality imaging of osseous involvement In haematological malignancies

    PubMed Central

    Krajewski, Katherine M; Jagannathan, Jyothi P; Shinagare, Atul B; Braschi-Amirfarzan, Marta; Tirumani, Sree H; Ramaiya, Nikhil H

    2016-01-01

    The purpose of this article is to provide a comprehensive review of the imaging features of osseous involvement in haematological malignancies. Osseous involvement can be seen in various haematological malignancies including lymphomas, plasma cell neoplasms, leukaemias and myeloproliferative neoplasms. Imaging plays a crucial role in initial diagnosis, staging and in the assessment of treatment response in these patients. PMID:26781757

  3. A Task-Based Approach to Adaptive and Multimodality Imaging: Computation techniques are proposed for figures-of-merit to establish feasibility and optimize use of multiple imaging systems for disease diagnosis and treatment-monitoring.

    PubMed

    Clarkson, Eric; Kupinski, Matthew A; Barrett, Harrison H; Furenlid, Lars

    2008-03-01

    Multimodality imaging is becoming increasingly important in medical imaging. Since the motivation for combining multiple imaging modalities is generally to improve diagnostic or prognostic accuracy, the benefits of multimodality imaging cannot be assessed through the display of example images. Instead, we must use objective, task-based measures of image quality to draw valid conclusions about system performance. In this paper, we will present a general framework for utilizing objective, task-based measures of image quality in assessing multimodality and adaptive imaging systems. We introduce a classification scheme for multimodality and adaptive imaging systems and provide a mathematical description of the imaging chain along with block diagrams to provide a visual illustration. We show that the task-based methodology developed for evaluating single-modality imaging can be applied, with minor modifications, to multimodality and adaptive imaging. We discuss strategies for practical implementing of task-based methods to assess and optimize multimodality imaging systems.

  4. Pneumoconiosis: comparison of imaging and pathologic findings.

    PubMed

    Chong, Semin; Lee, Kyung Soo; Chung, Myung Jin; Han, Joungho; Kwon, O Jung; Kim, Tae Sung

    2006-01-01

    Pneumoconiosis may be classified as either fibrotic or nonfibrotic, according to the presence or absence of fibrosis. Silicosis, coal worker pneumoconiosis, asbestosis, berylliosis, and talcosis are examples of fibrotic pneumoconiosis. Siderosis, stannosis, and baritosis are nonfibrotic forms of pneumoconiosis that result from inhalation of iron oxide, tin oxide, and barium sulfate particles, respectively. In an individual who has a history of exposure to silica or coal dust, a finding of nodular or reticulonodular lesions at chest radiography or small nodules with a perilymphatic distribution at thin-section computed tomography (CT), with or without eggshell calcifications, is suggestive of silicosis or coal worker pneumoconiosis. Magnetic resonance imaging is helpful for distinguishing between progressive massive fibrosis and lung cancer. CT and histopathologic findings in asbestosis are similar to those in idiopathic pulmonary fibrosis, but the presence of asbestos bodies in histopathologic specimens is specific for the diagnosis of asbestosis. Giant cell interstitial pneumonia due to exposure to hard metals is classified as a fibrotic form of pneumoconiosis and appears on CT images as mixed ground-glass opacities and reticulation. Berylliosis simulates pulmonary sarcoidosis on CT images. CT findings in talcosis include small centrilobular and subpleural nodules or heterogeneous conglomerate masses that contain foci of high attenuation indicating talc deposition. Siderosis is nonfibrotic and is indicated by a CT finding of poorly defined centrilobular nodules or ground-glass opacities.

  5. Pneumoconiosis: Comparison of imaging and pathologic findings

    SciTech Connect

    Chong, S.; Lee, K.S.; Chung, M.J.; Han, J.H.; Kwon, O.J.; Kim, T.S.

    2006-01-15

    Pneumoconiosis may be classified as either fibrotic or nonfibrotic, according to the presence or absence of fibrosis. Silicosis, coal worker pneumoconiosis, asbestosis, berylliosis, and talcosis are examples of fibrotic pneumoconiosis. Siderosis, stannosis, and baritosis are nonfibrotic forms of pneumoconiosis that result from inhalation of iron oxide, tin oxide, and barium sulfate particles, respectively. In an individual who has a history of exposure to silica or coal dust, a finding of nodular or reticulonodular lesions at chest radiography or small nodules with a perilymphatic distribution at thin-section computed tomography (CT), with or without eggshell calcifications, is suggestive of silicosis or coal worker pneumoconiosis. Magnetic resonance imaging is helpful for distinguishing between progressive massive fibrosis and lung cancer. CT and histopathologic findings in asbestosis are similar to those in idiopathic pulmonary fibrosis, but the presence of asbestos bodies in histopathologic specimens is specific for the diagnosis of asbestosis. Giant cell interstitial pneumonia due to exposure to hard metals is classified as a fibrotic form of pneumoconiosis and appears on CT images as mixed ground-glass opacities and reticulation. Berylliosis simulates pulmonary sarcoidosis on CT images. CT findings in talcosis include small centrilobular and subpleural nodules or heterogeneous conglomerate masses that contain foci of high attenuation indicating talc deposition. Siderosis is nonfibrotic and is indicated by a CT finding of poorly defined centrilobular nodules or ground-glass opacities.

  6. Pneumoconiosis: comparison of imaging and pathologic findings

    SciTech Connect

    Semin Chong; Kyung Soo Lee; Myung Jin Chung; Joungho Han; O. Jung Kwon; d Tae Sung Kim

    2006-01-15

    Pneumoconiosis may be classified as either fibrotic or nonfibrotic, according to the presence or absence of fibrosis. Silicosis, coal worker pneumoconiosis, asbestosis, berylliosis, and talcosis are examples of fibrotic pneumoconiosis. Siderosis, stannosis, and baritosis are nonfibrotic forms of pneumoconiosis that result from inhalation of iron oxide, tin oxide, and barium sulfate particles, respectively. In an individual who has a history of exposure to silica or coal dust, a finding of nodular or reticulonodular lesions at chest radiography or small nodules with a perilymphatic distribution at thin-section computed tomography (CT), with or without eggshell calcifications, is suggestive of silicosis or coal worker pneumoconiosis. Magnetic resonance imaging is helpful for distinguishing between progressive massive fibrosis and lung cancer. CT and histopathologic findings in asbestosis are similar to those in idiopathic pulmonary fibrosis, but the presence of asbestos bodies in histopathologic specimens is specific for the diagnosis of asbestosis. Giant cell interstitial pneumonia due to exposure to hard metals is classified as a fibrotic form of pneumoconiosis and appears on CT images as mixed ground-glass opacities and reticulation. Berylliosis simulates pulmonary sarcoidosis on CT images. CT findings in talcosis include small centrilobular and subpleural nodules or heterogeneous conglomerate masses that contain foci of high attenuation indicating talc deposition. Siderosis is nonfibrotic and is indicated by a CT finding of poorly defined centrilobular nodules or ground-glass opacities.

  7. ICG-loaded microbubbles for multimodal billiary imaging in cholecystectomy

    NASA Astrophysics Data System (ADS)

    Qin, Ruogu; Melvin, Scott; Xu, Ronald X.

    2012-12-01

    A dual-mode imaging technique has been developed for intraoperative imaging of bile ducts and real-time identification of iatrogenic injuries in cholecystectomy. The technique is based on ultrasound (US) and fluorescence (FL) imaging of a dual-mode microbubble (MB) agent comprising a poly (lactic-co-glycolic acid) (PLGA) shell and a core of Indocyanine Green. During cholecystectomy, a clinical US probe is used to localize the bile duct structure after bolus injection of dual-mode MBs. As the surrounding adipose tissue is removed and the Calot's triangle is exposed, FL imaging is used to identify the MB distribution and to determine the potential bile duct injury. The contrast-enhanced bile duct imaging technique has been demonstrated in both a surgical simulation model and an ex vivo porcine tissue model under two surgical scenarios. The first scenario simulates the correct procedure where the cystic duct is clipped. The second scenario simulates the incorrect procedure where the common bile duct is clipped, leading to consequent bile duct injury. Benchtop experiments in both the phantom and the ex vivo models show that the dual-mode imaging technique is able to identify the potential bile duct injury during cholecystectomy. A phantom system has also been established for future device calibration and surgical training in image-guided cholecystectomy. Further in vivo animal validation tests are necessary before the technique can be implemented in a clinical setting.

  8. An extension of digital volume correlation for multimodality image registration

    NASA Astrophysics Data System (ADS)

    Tudisco, E.; Jailin, C.; Mendoza, A.; Tengattini, A.; Andò, E.; Hall, Stephen A.; Viggiani, Gioacchino; Hild, F.; Roux, S.

    2017-09-01

    The question of registering two images (or image volumes) acquired with different modalities, and thus exhibiting different contrast, at different positions is addressed based on an extension of global digital image (or volume) correlation. A specific comparison metric is introduced allowing the signature of the different phases to be related. A first solution consists of a Gaussian mixture to describe the joint distribution of gray levels, which not only provides a matching of both images, but also offers a natural segmentation indicator. A second ‘self-adapting’ solution does not include any postulated a priori model for the joint histogram and leads to a registration of the images based on their initial histograms. The algorithm is implemented with a pyramidal multiscale framework for the sake of robustness. The proposed multiscale technique is tested on two 3D images obtained from x-ray and neutron tomography respectively. The proposed approach brings the two images to coincidence with a sub-pixel accuracy and allows for a ‘natural’ segmentation of the different phases.

  9. Imaging plus X: multimodal models of neurodegenerative disease

    PubMed Central

    Oxtoby, Neil P.; Alexander, Daniel C.

    2017-01-01

    Purpose of review This article argues that the time is approaching for data-driven disease modelling to take centre stage in the study and management of neurodegenerative disease. The snowstorm of data now available to the clinician defies qualitative evaluation; the heterogeneity of data types complicates integration through traditional statistical methods; and the large datasets becoming available remain far from the big-data sizes necessary for fully data-driven machine-learning approaches. The recent emergence of data-driven disease progression models provides a balance between imposed knowledge of disease features and patterns learned from data. The resulting models are both predictive of disease progression in individual patients and informative in terms of revealing underlying biological patterns. Recent findings Largely inspired by observational models, data-driven disease progression models have emerged in the last few years as a feasible means for understanding the development of neurodegenerative diseases. These models have revealed insights into frontotemporal dementia, Huntington's disease, multiple sclerosis, Parkinson's disease and other conditions. For example, event-based models have revealed finer graded understanding of progression patterns; self-modelling regression and differential equation models have provided data-driven biomarker trajectories; spatiotemporal models have shown that brain shape changes, for example of the hippocampus, can occur before detectable neurodegeneration; and network models have provided some support for prion-like mechanistic hypotheses of disease propagation. The most mature results are in sporadic Alzheimer's disease, in large part because of the availability of the Alzheimer's disease neuroimaging initiative dataset. Results generally support the prevailing amyloid-led hypothetical model of Alzheimer's disease, while revealing finer detail and insight into disease progression. Summary The emerging field of disease

  10. A multimodality vascular imaging phantom of an abdominal aortic aneurysm with a visible thrombus

    SciTech Connect

    Allard, Louise; Chayer, Boris; Qin Zhao; Soulez, Gilles; Roy, David; Cloutier, Guy

    2013-06-15

    Purpose: With the continuous development of new stent grafts and implantation techniques, it has now become technically feasible to treat abdominal aortic aneurysms (AAA) with challenging anatomy using endovascular repair with standard, fenestrated, or branched stent-grafts. In vitro experimentations are very useful to improve stent-graft design and conformability or imaging guidance for stent-graft delivery or follow-up. Vascular replicas also help to better understand the limitation of endovascular approaches in challenging anatomy and possibly improve surgical planning or training by practicing high risk clinical procedures in the laboratory to improve outcomes in the operating room. Most AAA phantoms available have a very basic anatomy, which is not representative of the clinical reality. This paper presents a method of fabrication of a realistic AAA phantom with a visible thrombus, as well as some mechanical properties characterizing such phantom. Methods: A realistic AAA geometry replica of a real patient anatomy taken from a multidetector computed tomography (CT) scan was manufactured. To demonstrate the multimodality imaging capability of this new phantom with a thrombus visible in magnetic resonance (MR) angiography, CT angiography (CTA), digital subtraction angiography (DSA), and ultrasound, image acquisitions with all these modalities were performed by using standard clinical protocols. Potential use of this phantom for stent deployment was also tested. A rheometer allowed defining hyperelastic and viscoelastic properties of phantom materials. Results: MR imaging measurements of SNR and CNR values on T1 and T2-weighted sequences and MR angiography indicated reasonable agreement with published values of AAA thrombus and abdominal components in vivo. X-ray absorption also lay within normal ranges of AAA patients and was representative of findings observed on CTA, fluoroscopy, and DSA. Ultrasound propagation speeds for developed materials were also in

  11. FULLY CONVOLUTIONAL NETWORKS FOR MULTI-MODALITY ISOINTENSE INFANT BRAIN IMAGE SEGMENTATION.

    PubMed

    Nie, Dong; Wang, Li; Gao, Yaozong; Shen, Dinggang

    The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development. In the isointense phase (approximately 6-8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, resulting in extremely low tissue contrast and thus making the tissue segmentation very challenging. The existing methods for tissue segmentation in this isointense phase usually employ patch-based sparse labeling on single T1, T2 or fractional anisotropy (FA) modality or their simply-stacked combinations without fully exploring the multi-modality information. To address the challenge, in this paper, we propose to use fully convolutional networks (FCNs) for the segmentation of isointense phase brain MR images. Instead of simply stacking the three modalities, we train one network for each modality image, and then fuse their high-layer features together for final segmentation. Specifically, we conduct a convolution-pooling stream for multimodality information from T1, T2, and FA images separately, and then combine them in high-layer for finally generating the segmentation maps as the outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense phase brain images. Results showed that our proposed model significantly outperformed previous methods in terms of accuracy. In addition, our results also indicated a better way of integrating multi-modality images, which leads to performance improvement.

  12. Fluorescent Nanodiamond-Gold Hybrid Particles for Multimodal Optical and Electron Microscopy Cellular Imaging.

    PubMed

    Liu, Weina; Naydenov, Boris; Chakrabortty, Sabyasachi; Wuensch, Bettina; Hübner, Kristina; Ritz, Sandra; Cölfen, Helmut; Barth, Holger; Koynov, Kaloian; Qi, Haoyuan; Leiter, Robert; Reuter, Rolf; Wrachtrup, Jörg; Boldt, Felix; Scheuer, Jonas; Kaiser, Ute; Sison, Miguel; Lasser, Theo; Tinnefeld, Philip; Jelezko, Fedor; Walther, Paul; Wu, Yuzhou; Weil, Tanja

    2016-10-12

    There is a continuous demand for imaging probes offering excellent performance in various microscopy techniques for comprehensive investigations of cellular processes by more than one technique. Fluorescent nanodiamond-gold nanoparticles (FND-Au) constitute a new class of "all-in-one" hybrid particles providing unique features for multimodal cellular imaging including optical imaging, electron microscopy, and, and potentially even quantum sensing. Confocal and optical coherence microscopy of the FND-Au allow fast investigations inside living cells via emission, scattering, and photothermal imaging techniques because the FND emission is not quenched by AuNPs. In electron microscopy, transmission electron microscopy (TEM) and scanning transmission electron microscopy (STEM) analysis of FND-Au reveals greatly enhanced contrast due to the gold particles as well as an extraordinary flickering behavior in three-dimensional cellular environments originating from the nanodiamonds. The unique multimodal imaging characteristics of FND-Au enable detailed studies inside cells ranging from statistical distributions at the entire cellular level (micrometers) down to the tracking of individual particles in subcellular organelles (nanometers). Herein, the processes of endosomal membrane uptake and release of FNDs were elucidated for the first time by the imaging of individual FND-Au hybrid nanoparticles with single-particle resolution. Their convenient preparation, the availability of various surface groups, their flexible detection modalities, and their single-particle contrast in combination with the capability for endosomal penetration and low cytotoxicity make FND-Au unique candidates for multimodal optical-electronic imaging applications with great potential for emerging techniques, such as quantum sensing inside living cells.

  13. FULLY CONVOLUTIONAL NETWORKS FOR MULTI-MODALITY ISOINTENSE INFANT BRAIN IMAGE SEGMENTATION

    PubMed Central

    Nie, Dong; Wang, Li; Gao, Yaozong; Shen, Dinggang

    2016-01-01

    The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development. In the isointense phase (approximately 6–8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, resulting in extremely low tissue contrast and thus making the tissue segmentation very challenging. The existing methods for tissue segmentation in this isointense phase usually employ patch-based sparse labeling on single T1, T2 or fractional anisotropy (FA) modality or their simply-stacked combinations without fully exploring the multi-modality information. To address the challenge, in this paper, we propose to use fully convolutional networks (FCNs) for the segmentation of isointense phase brain MR images. Instead of simply stacking the three modalities, we train one network for each modality image, and then fuse their high-layer features together for final segmentation. Specifically, we conduct a convolution-pooling stream for multimodality information from T1, T2, and FA images separately, and then combine them in high-layer for finally generating the segmentation maps as the outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense phase brain images. Results showed that our proposed model significantly outperformed previous methods in terms of accuracy. In addition, our results also indicated a better way of integrating multi-modality images, which leads to performance improvement. PMID:27668065

  14. Multimodal Spectral Imaging of Cells Using a Transmission Diffraction Grating on a Light Microscope

    PubMed Central

    Isailovic, Dragan; Xu, Yang; Copus, Tyler; Saraswat, Suraj; Nauli, Surya M.

    2011-01-01

    A multimodal methodology for spectral imaging of cells is presented. The spectral imaging setup uses a transmission diffraction grating on a light microscope to concurrently record spectral images of cells and cellular organelles by fluorescence, darkfield, brightfield, and differential interference contrast (DIC) spectral microscopy. Initially, the setup was applied for fluorescence spectral imaging of yeast and mammalian cells labeled with multiple fluorophores. Fluorescence signals originating from fluorescently labeled biomolecules in cells were collected through triple or single filter cubes, separated by the grating, and imaged using a charge-coupled device (CCD) camera. Cellular components such as nuclei, cytoskeleton, and mitochondria were spatially separated by the fluorescence spectra of the fluorophores present in them, providing detailed multi-colored spectral images of cells. Additionally, the grating-based spectral microscope enabled measurement of scattering and absorption spectra of unlabeled cells and stained tissue sections using darkfield and brightfield or DIC spectral microscopy, respectively. The presented spectral imaging methodology provides a readily affordable approach for multimodal spectral characterization of biological cells and other specimens. PMID:21639978

  15. Multimodal non-contact photoacoustic imaging and optical coherence tomography using all optical detection

    NASA Astrophysics Data System (ADS)

    Leiss-Holzinger, Elisabeth; Bauer-Marschallinger, Johannes; Berer, Thomas

    2017-02-01

    We present a multimodal optical setup, allowing non-contact photoacoustic imaging (PAI) and optical coherence tomography (OCT). Optical coherence tomography is sensitive to changes in the specimen's refractive index, thereby offering complementary information to photoacoustic signals which are induced by light absorption. A multimodal setup, allowing OCT and photoacoustic measurements, should ideally not rely on any physical contact to a specimen and, thus, commonly used transducers for photoacoustic signal detection which require acoustic coupling to the specimen should be avoided. In this work photoacoustic signals are acquired by measuring the surface displacement of a specimen using a fiber-optic Mach-Zehnder interferometer. Photoacoustic signals are excited with a Nd:YAG pulse laser. The interferometer for non-contact photoacoustic detection and the OCT system are realized in the same fiber-optic network. Light from the PAI detection laser and the OCT source are multiplexed into a single optical fiber and the same objective is used for both imaging modalities. Light reflected from specimens is demultiplexed and guided to the respective imaging systems. To allow fast non-contact PAI and OCT imaging the detection spot is scanned across the specimens' surface using a galvanometer scanner. As the same fiber-network and optical components are used for photoacoustic and OCT imaging the obtained, images are co-registered intrinsically. Imaging is demonstrated on a tissue mimicking sample.

  16. SPECT-OPT multimodal imaging enables accurate evaluation of radiotracers for β-cell mass assessments

    PubMed Central

    Eter, Wael A.; Parween, Saba; Joosten, Lieke; Frielink, Cathelijne; Eriksson, Maria; Brom, Maarten; Ahlgren, Ulf; Gotthardt, Martin

    2016-01-01

    Single Photon Emission Computed Tomography (SPECT) has become a promising experimental approach to monitor changes in β-cell mass (BCM) during diabetes progression. SPECT imaging of pancreatic islets is most commonly cross-validated by stereological analysis of histological pancreatic sections after insulin staining. Typically, stereological methods do not accurately determine the total β-cell volume, which is inconvenient when correlating total pancreatic tracer uptake with BCM. Alternative methods are therefore warranted to cross-validate β-cell imaging using radiotracers. In this study, we introduce multimodal SPECT - optical projection tomography (OPT) imaging as an accurate approach to cross-validate radionuclide-based imaging of β-cells. Uptake of a promising radiotracer for β-cell imaging by SPECT, 111In-exendin-3, was measured by ex vivo-SPECT and cross evaluated by 3D quantitative OPT imaging as well as with histology within healthy and alloxan-treated Brown Norway rat pancreata. SPECT signal was in excellent linear correlation with OPT data as compared to histology. While histological determination of islet spatial distribution was challenging, SPECT and OPT revealed similar distribution patterns of 111In-exendin-3 and insulin positive β-cell volumes between different pancreatic lobes, both visually and quantitatively. We propose ex vivo SPECT-OPT multimodal imaging as a highly accurate strategy for validating the performance of β-cell radiotracers. PMID:27080529

  17. SPECT-OPT multimodal imaging enables accurate evaluation of radiotracers for β-cell mass assessments.

    PubMed

    Eter, Wael A; Parween, Saba; Joosten, Lieke; Frielink, Cathelijne; Eriksson, Maria; Brom, Maarten; Ahlgren, Ulf; Gotthardt, Martin

    2016-04-15

    Single Photon Emission Computed Tomography (SPECT) has become a promising experimental approach to monitor changes in β-cell mass (BCM) during diabetes progression. SPECT imaging of pancreatic islets is most commonly cross-validated by stereological analysis of histological pancreatic sections after insulin staining. Typically, stereological methods do not accurately determine the total β-cell volume, which is inconvenient when correlating total pancreatic tracer uptake with BCM. Alternative methods are therefore warranted to cross-validate β-cell imaging using radiotracers. In this study, we introduce multimodal SPECT - optical projection tomography (OPT) imaging as an accurate approach to cross-validate radionuclide-based imaging of β-cells. Uptake of a promising radiotracer for β-cell imaging by SPECT, (111)In-exendin-3, was measured by ex vivo-SPECT and cross evaluated by 3D quantitative OPT imaging as well as with histology within healthy and alloxan-treated Brown Norway rat pancreata. SPECT signal was in excellent linear correlation with OPT data as compared to histology. While histological determination of islet spatial distribution was challenging, SPECT and OPT revealed similar distribution patterns of (111)In-exendin-3 and insulin positive β-cell volumes between different pancreatic lobes, both visually and quantitatively. We propose ex vivo SPECT-OPT multimodal imaging as a highly accurate strategy for validating the performance of β-cell radiotracers.

  18. Multimodality imaging of placental masses: a pictorial review.

    PubMed

    Jha, Priyanka; Paroder, Viktoriya; Mar, Winnie; Horowtiz, Jeanne M; Poder, Liina

    2016-12-01

    Placental masses are uncommonly identified at the time of obstetric ultrasound evaluation. Understanding the pathologies presenting as placental masses is key for providing a differential diagnosis and guiding subsequent management, which may include additional imaging with magnetic resonance (MR) imaging. Potential benign entities include chorioangiomas and teratomas. Larger chorioangiomas can cause fetal cardiovascular issues from volume overload. Placental mesenchymal dysplasia has an association with fetal anomalies and detailed fetal evaluation should be performed when it is suspected. Identifying other cystic masses such as partial and complete moles is crucial to prevent erroneous pregnancy termination. This review addresses normal imaging appearance of the placenta on ultrasound and MR imaging and describes various trophoblastic and nontrophoblastic placental masses. Potential placental mass mimics including uterine contractions and thrombo-hematomas are also presented.

  19. Advanced infrared detectors for multimode active and passive imaging applications

    NASA Astrophysics Data System (ADS)

    Baker, Ian; Owton, Daniel; Trundle, Keith; Thorne, Peter; Storie, Kevin; Oakley, Philip; Copley, Jeremy

    2008-04-01

    Active systems, using a near-infrared pulse laser and a fast, gated detector, are now adopted for most long range imaging applications. This concept is often called laser-gated imaging (LGI) or burst-illumination LIDAR (BIL). The SELEX solid state detector is based on an array of HgCdTe avalanche photodiodes, and a custom-designed CMOS multiplexer to perform the fast gating and photon signal capture. This paper describes two recent developments. The first is aimed at reducing the size, weight, power and cost of steerable platforms which often have to contain a large number of electrooptic tools such as lasers, range finders, BIL, thermal imaging and visible cameras. A dual-mode infrared detector has been developed with the aim of shrinking the system to one camera. The detector can be switched to operate as a passive thermal imager, a laser-gated imager or a solar flux imager. The detector produces a sensitivity in the MW thermal band of 16-18mK and a sensitivity in the BIL mode as low as 10 photons rms, in other words close to the performance of dedicated imagers. A second development was to extend the current BIL capability to 3D. In complex scenes, with camouflage and concealment, the ability to generate 3D images provides a signal-to-clutter advantage. Also in airborne applications, especially, it is useful to have 3D information to provide agile, feedback control of the range gating in a dynamic environment. This report describes the development of the 3D detector and camera, and the results of field trials using a prototype system.

  20. Multimodal imaging biomarkers in premanifest and early Huntington's disease: 30-month IMAGE-HD data.

    PubMed

    D, Juan F Domínguez; Stout, Julie C; Poudel, Govinda; Churchyard, Andrew; Chua, Phyllis; Egan, Gary F; Georgiou-Karistianis, Nellie

    2016-06-01

    The discovery of potential disease-modifying therapies in a neurodegenerative condition like Huntington's disease depends on the availability of sensitive biomarkers that reflect decline across disease stages and that are functionally and clinically relevant. To quantify macrostructural and microstructural changes in participants with premanifest and symptomatic Huntington's disease over 30 months, and to establish their functional and clinical relevance. Multimodal magnetic resonance imaging study measuring changes in macrostructural (volume) and microstructural (diffusivity) measures in 40 patients with premanifest Huntington's disease, 36 patients with symptomatic Huntington's disease and 36 healthy control participants over three testing sessions spanning 30 months. Relative to controls, there was greater longitudinal atrophy in participants with symptomatic Huntington's disease in whole brain, grey matter, caudate and putamen, as well as increased caudate fractional anisotropy; caudate volume loss was the only measure to differ between premanifest Huntington's disease and control groups. Changes in caudate volume and fractional anisotropy correlated with each other and neurocognitive decline; caudate volume loss also correlated with clinical and disease severity. Caudate neurodegeneration, especially atrophy, may be the most suitable candidate surrogate biomarker for consideration in the development of upcoming clinical trials. © The Royal College of Psychiatrists 2016.

  1. A Multimode Optical Imaging System for Preclinical Applications In Vivo: Technology Development, Multiscale Imaging, and Chemotherapy Assessment

    PubMed Central

    Hwang, Jae Youn; Wachsmann-Hogiu, Sebastian; Ramanujan, V. Krishnan; Ljubimova, Julia; Gross, Zeev; Gray, Harry B.; Medina-Kauwe, Lali K.; Farkas, Daniel L.

    2012-01-01

    Purpose Several established optical imaging approaches have been applied, usually in isolation, to preclinical studies; however, truly useful in vivo imaging may require a simultaneous combination of imaging modalities to examine dynamic characteristics of cells and tissues. We developed a new multimode optical imaging system designed to be application-versatile, yielding high sensitivity, and specificity molecular imaging. Procedures We integrated several optical imaging technologies, including fluorescence intensity, spectral, lifetime, intravital confocal, two-photon excitation, and bioluminescence, into a single system that enables functional multiscale imaging in animal models. Results The approach offers a comprehensive imaging platform for kinetic, quantitative, and environmental analysis of highly relevant information, with micro-to-macroscopic resolution. Applied to small animals in vivo, this provides superior monitoring of processes of interest, represented here by chemo-/nanoconstruct therapy assessment. Conclusions This new system is versatile and can be optimized for various applications, of which cancer detection and targeted treatment are emphasized here. PMID:21874388

  2. Abdominal vascular syndromes: characteristic imaging findings*

    PubMed Central

    Cardarelli-Leite, Leandro; Velloni, Fernanda Garozzo; Salvadori, Priscila Silveira; Lemos, Marcelo Delboni; D'Ippolito, Giuseppe

    2016-01-01

    Abdominal vascular syndromes are rare diseases. Although such syndromes vary widely in terms of symptoms and etiologies, certain imaging findings are characteristic. Depending on their etiology, they can be categorized as congenital-including blue rubber bleb nevus syndrome, Klippel-Trenaunay syndrome, and hereditary hemorrhagic telangiectasia (Rendu-Osler-Weber syndrome)-or compressive-including "nutcracker" syndrome, median arcuate ligament syndrome, Cockett syndrome (also known as May-Thurner syndrome), and superior mesenteric artery syndrome. In this article, we aimed to illustrate imaging findings that are characteristic of these syndromes, through studies conducted at our institution, as well as to perform a brief review of the literature on this topic. PMID:27777480

  3. The ANIMAGE project: a multimodal imaging platform for small animal research

    NASA Astrophysics Data System (ADS)

    Sappey-Marinier, D.; Beuf, O.; Billotey, C.; Chereul, E.; Dupuy, J.; Jeandey, M.; Grenier, D.; Hasserodt, J.; Langlois, J. B.; Lartizien, C.; Mai, W.; Odet, C.; Samarut, J.; Vray, D.; Zimmer, L.; Janier, M.

    2004-07-01

    The advent of the molecular era has just generated a revolution in the development of new in vivo imaging techniques to examine the integrative functions of molecules, cells, organ systems and whole organisms. Molecular imaging constitutes a new tool allowing the biologist to characterize, repeatedly and non-invasively, a large number of experimental models developed in rodents. In order to monitor biological processes such as gene expression, normal development, metabolic alterations or medical treatment effects, several methodological and technological challenges have to be raised up. Developments are needed in chemistry to create new radiotracers or contrast agents, and in physic, to adapt the medical imaging techniques to the constraints of small animal investigations. ANIMAGE is a multimodal imaging platform to image the structure and function of systems using and developing different technologies such as autoradiography, ultrasounds, positron emission tomography (PET), X-ray computed tomography (CT), magnetic resonance imaging and spectroscopy (MRI/MRS). The first biological applications and results are presented.

  4. Preventing Radiobleaching of Cyanine Fluorophores Enhances Stability of Nuclear/NIRF Multimodality Imaging Agents

    PubMed Central

    Hernandez, Reinier; Heskamp, Sandra; Rijpkema, Mark; Bos, Desirée L.; Goldenberg, David M.; McBride, William J.; Morgenstern, Alfred; Bruchertseifer, Frank; Cai, Weibo; Boerman, Otto C.

    2017-01-01

    Despite the large interest in nuclear/optical multimodality imaging, the effect of radiation on the fluorescence of fluorophores remains largely unexplored. Herein, we report on the radiobleaching of cyanine fluorophores and describe conditions to provide robust radioprotection under practical (pre)clinical settings. We determined the radiosensitivity of several cyanine fluorescent compounds, including IRDye 800CW (800CW) and a dual modality imaging tetrapeptide containing DOTA as chelator and Dylight 800 as fluorophore, exposed to increasing activities of 111In, 68Ga, or 213Bi (γ, EC/β, and α emitter, respectively). An activity and type of radiation-dependent radiation-induced loss of fluorescence, radiobleaching, of 800CW was observed upon incubation with escalating activities of 111In, 68Ga, or 213Bi. 68Ga showed the largest radiolytic effect, followed by 111In and 213Bi. The addition of oxygen radical scavengers including ethanol, gentisic acid, and ascorbic acid (AA), provided a concentration dependent radioprotective effect. These results supported the hypothesis of a free radical-mediated radiobleaching mechanism. AA provided the most robust radioprotection over a wide range of concentrations and preserved fluorescence at much higher radioactivity levels. Overall, both near-infrared fluorescent compounds displayed similar sensitivity, except for 213Bi-irradiated solutions, where the dual modality construct exhibited enhanced radiolysis, presumably due to direct radiation damage from α particles. Concurrently, AA was not able to preserve fluorescence of the dual-modality molecule labeled with 213Bi. Our findings have important consequences for several research areas including ROS sensing, radiation-mediated drug release (uncaging), fluorescent dosimetry, and in the preparation of dual-modality radiopharmaceuticals. PMID:28042311

  5. Imaging findings of Gorlin-Goltz syndrome.

    PubMed

    Hajalioghli, Parisa; Ghadirpour, Ali; Ataie-Oskuie, Reza; Kontzialis, Marinos; Nezami, Nariman

    2015-01-01

    A 15-year-old girl was referred to a dentist complaining of parageusia, bad taste in the mouth, which started 9 months ago. Panoramic X-ray and non-enhanced computed tomography scan revealed multiple bilateral unilocular cysts in the mandible and maxilla, along with calcification of anterior part of the falx cerebri. She was eventually diagnosed with Gorlin-Goltz syndrome based on imaging and histopathologic finding of keratocystic odontogenic tumor.

  6. PDE based scheme for multi-modal medical image watermarking.

    PubMed

    Aherrahrou, N; Tairi, H

    2015-11-25

    This work deals with copyright protection of digital images, an issue that needs protection of intellectual property rights. It is an important issue with a large number of medical images interchanged on the Internet every day. So, it is a challenging task to ensure the integrity of received images as well as authenticity. Digital watermarking techniques have been proposed as valid solution for this problem. It is worth mentioning that the Region Of Interest (ROI)/Region Of Non Interest (RONI) selection can be seen as a significant limitation from which suffers most of ROI/RONI based watermarking schemes and that in turn affects and limit their applicability in an effective way. Generally, the ROI/RONI is defined by a radiologist or a computer-aided selection tool. And thus, this will not be efficient for an institute or health care system, where one has to process a large number of images. Therefore, developing an automatic ROI/RONI selection is a challenge task. The major aim of this work is to develop an automatic selection algorithm of embedding region based on the so called Partial Differential Equation (PDE) method. Thus avoiding ROI/RONI selection problems including: (1) computational overhead, (2) time consuming, and (3) modality dependent selection. The algorithm is evaluated in terms of imperceptibility, robustness, tamper localization and recovery using MRI, Ultrasound, CT and X-ray grey scale medical images. From experimental results that we have conducted on a database of 100 medical images of four modalities, it can be inferred that our method can achieve high imperceptibility, while showing good robustness against attacks. Furthermore, the experiment results confirm the effectiveness of the proposed algorithm in detecting and recovering the various types of tampering. The highest PSNR value reached over the 100 images is 94,746 dB, while the lowest PSNR value is 60,1272 dB, which demonstrates the higher imperceptibility nature of the proposed

  7. Calcium fluoride based multifunctional nanoparticles for multimodal imaging

    PubMed Central

    Dembski, Sofia; Haddad, Daniel; Ahrens, Bernd; Schweizer, Stefan; Christ, Bastian; Cubukova, Alevtina; Metzger, Marco; Walles, Heike; Jakob, Peter M; Sextl, Gerhard

    2017-01-01

    New multifunctional nanoparticles (NPs) that can be used as contrast agents (CA) in different imaging techniques, such as photoluminescence (PL) microscopy and magnetic resonance imaging (MRI), open new possibilities for medical imaging, e.g., in the fields of diagnostics or tissue characterization in regenerative medicine. The focus of this study is on the synthesis and characterization of CaF2:(Tb3+,Gd3+) NPs. Fabricated in a wet-chemical procedure, the spherical NPs with a diameter of 5–10 nm show a crystalline structure. Simultaneous doping of the NPs with different lanthanide ions, leading to paramagnetism and fluorescence, makes them suitable for MR and PL imaging. Owing to the Gd3+ ions on the surface, the NPs reduce the MR T 1 relaxation time constant as a function of their concentration. Thus, the NPs can be used as a MRI CA with a mean relaxivity of about r = 0.471 mL·mg−1·s−1. Repeated MRI examinations of four different batches prove the reproducibility of the NP synthesis and determine the long-term stability of the CAs. No cytotoxicity of NP concentrations between 0.5 and 1 mg·mL−1 was observed after exposure to human dermal fibroblasts over 24 h. Overall this study shows, that the CaF2:(Tb3+,Gd3+) NPs are suitable for medical imaging. PMID:28900602

  8. The sacrum: pathologic spectrum, multimodality imaging, and subspecialty approach.

    PubMed

    Diel, J; Ortiz, O; Losada, R A; Price, D B; Hayt, M W; Katz, D S

    2001-01-01

    The sacrum is a structure that is imaged by both general and subspecialty radiologists. A wide variety of disease processes can involve the sacrum either focally or as part of a systemic process. Plain radiographs, although limited in evaluation of the sacrum, should be carefully examined when abnormalities of the sacrum are suspected. Cross-sectional imaging, particularly computed tomography and magnetic resonance (MR) imaging, plays a crucial role in identification, localization, and characterization of sacral lesions. Congenital lesions of the sacrum, including sacral agenesis and meningocele, are optimally imaged with MR. The most common sacral neoplasm is metastatic disease. Primary neoplasms of the sacrum, which include giant cell tumor, chordoma, and teratoma, are infrequent. Infection of the sacrum or sacroiliac joint is most often due to contiguous spread from a suppurative focus. A wide variety of arthritic disorders such as ankylosing spondylitis and osteoarthritis can involve the sacroiliac joints as part of a localized or systemic process. Sacral fractures related to acute trauma or repetitive stress are difficult to diagnose and treat. Knowledge of these abnormalities and familiarity with the imaging of these processes will allow radiologists of all subspecialties to contribute to the diagnosis and management of sacral disorders.

  9. Perfluorocarbon Nanoparticles: Evolution of a Multimodality and Multifunctional Imaging Agent

    PubMed Central

    Winter, Patrick M.

    2014-01-01

    Perfluorocarbon nanoparticles offer a biologically inert, highly stable, and nontoxic platform that can be specifically designed to accomplish a range of molecular imaging and drug delivery functions in vivo. The particle surface can be decorated with targeting ligands to direct the agent to a variety of biomarkers that are associated with diseases such as cancer, cardiovascular disease, obesity, and thrombosis. The surface can also carry a high payload of imaging agents, ranging from paramagnetic metals for MRI, radionuclides for nuclear imaging, iodine for CT, and florescent tags for histology, allowing high sensitivity mapping of cellular receptors that may be expressed at very low levels in the body. In addition to these diagnostic imaging applications, the particles can be engineered to carry highly potent drugs and specifically deposit them into cell populations that display biosignatures of a variety of diseases. The highly flexible and robust nature of this combined molecular imaging and drug delivery vehicle has been exploited in a variety of animal models to demonstrate its potential impact on the care and treatment of patients suffering from some of the most debilitating diseases. PMID:25024867

  10. Perfluorocarbon nanoparticles: evolution of a multimodality and multifunctional imaging agent.

    PubMed

    Winter, Patrick M

    2014-01-01

    Perfluorocarbon nanoparticles offer a biologically inert, highly stable, and nontoxic platform that can be specifically designed to accomplish a range of molecular imaging and drug delivery functions in vivo. The particle surface can be decorated with targeting ligands to direct the agent to a variety of biomarkers that are associated with diseases such as cancer, cardiovascular disease, obesity, and thrombosis. The surface can also carry a high payload of imaging agents, ranging from paramagnetic metals for MRI, radionuclides for nuclear imaging, iodine for CT, and florescent tags for histology, allowing high sensitivity mapping of cellular receptors that may be expressed at very low levels in the body. In addition to these diagnostic imaging applications, the particles can be engineered to carry highly potent drugs and specifically deposit them into cell populations that display biosignatures of a variety of diseases. The highly flexible and robust nature of this combined molecular imaging and drug delivery vehicle has been exploited in a variety of animal models to demonstrate its potential impact on the care and treatment of patients suffering from some of the most debilitating diseases.

  11. Biocompatible Optically Transparent MEMS for Micromechanical Stimulation and Multimodal Imaging of Living Cells.

    PubMed

    Fior, Raffaella; Kwok, Jeanie; Malfatti, Francesca; Sbaizero, Orfeo; Lal, Ratnesh

    2015-08-01

    Cells and tissues in our body are continuously subjected to mechanical stress. Mechanical stimuli, such as tensile and contractile forces, and shear stress, elicit cellular responses, including gene and protein alterations that determine key behaviors, including proliferation, differentiation, migration, and adhesion. Several tools and techniques have been developed to study these mechanobiological phenomena, including micro-electro-mechanical systems (MEMS). MEMS provide a platform for nano-to-microscale mechanical stimulation of biological samples and quantitative analysis of their biomechanical responses. However, current devices are limited in their capability to perform single cell micromechanical stimulations as well as correlating their structural phenotype by imaging techniques simultaneously. In this study, a biocompatible and optically transparent MEMS for single cell mechanobiological studies is reported. A silicon nitride microfabricated device is designed to perform uniaxial tensile deformation of single cells and tissue. Optical transparency and open architecture of the device allows coupling of the MEMS to structural and biophysical assays, including optical microscopy techniques and atomic force microscopy (AFM). We demonstrate the design, fabrication, testing, biocompatibility and multimodal imaging with optical and AFM techniques, providing a proof-of-concept for a multimodal MEMS. The integrated multimodal system would allow simultaneous controlled mechanical stimulation of single cells and correlate cellular response.

  12. Biocompatible optically transparent MEMS for micromechanical stimulation and multimodal imaging of living cells

    PubMed Central

    Fior, Raffaella; Kwok, Jeanie; Malfatti, Francesca; Sbaizero, Orfeo; Lal, Ratnesh

    2015-01-01

    Cells and tissues in our body are continuously subjected to mechanical stress. Mechanical stimuli, such as tensile and contractile forces, and shear stress, elicit cellular responses, including gene and protein alterations that determine key behaviors, including proliferation, differentiation, migration, and adhesion. Several tools and techniques have been developed to study these mechanobiological phenomena, including micro-electro-mechanical systems (MEMS). MEMS provide a platform for nano-to-microscale mechanical stimulation of biological samples and quantitative analysis of their biomechanical responses. However, current devices are limited in their capability to perform single cell micromechanical stimulations as well as correlating their structural phenotype by imaging techniques simultaneously. In this study, a biocompatible and optically transparent MEMS for single cell mechanobiological studies is reported. A silicon nitride microfabricated device is designed to perform uniaxial tensile deformation of single cells and tissue. Optical transparency and open architecture of the device allows coupling of the MEMS to structural and biophysical assays, including optical microscopy techniques and atomic force microscopy (AFM). We demonstrate the design, fabrication, testing, biocompatibility and multimodal imaging with optical and AFM techniques, providing a proof-of-concept for a multimodal MEMS. The integrated multimodal system would allow simultaneous controlled mechanical stimulation of single cells and correlate cellular response. PMID:25549773

  13. Evaluation of registration strategies for multi-modality images of rat brain slices

    NASA Astrophysics Data System (ADS)

    Palm, Christoph; Vieten, Andrea; Salber, Dagmar; Pietrzyk, Uwe

    2009-05-01

    In neuroscience, small-animal studies frequently involve dealing with series of images from multiple modalities such as histology and autoradiography. The consistent and bias-free restacking of multi-modality image series is obligatory as a starting point for subsequent non-rigid registration procedures and for quantitative comparisons with positron emission tomography (PET) and other in vivo data. Up to now, consistency between 2D slices without cross validation using an inherent 3D modality is frequently presumed to be close to the true morphology due to the smooth appearance of the contours of anatomical structures. However, in multi-modality stacks consistency is difficult to assess. In this work, consistency is defined in terms of smoothness of neighboring slices within a single modality and between different modalities. Registration bias denotes the distortion of the registered stack in comparison to the true 3D morphology and shape. Based on these metrics, different restacking strategies of multi-modality rat brain slices are experimentally evaluated. Experiments based on MRI-simulated and real dual-tracer autoradiograms reveal a clear bias of the restacked volume despite quantitatively high consistency and qualitatively smooth brain structures. However, different registration strategies yield different inter-consistency metrics. If no genuine 3D modality is available, the use of the so-called SOP (slice-order preferred) or MOSOP (modality-and-slice-order preferred) strategy is recommended.

  14. Multimodal segmentation of optic disc and cup from stereo fundus and SD-OCT images

    NASA Astrophysics Data System (ADS)

    Miri, Mohammad Saleh; Lee, Kyungmoo; Niemeijer, Meindert; Abràmoff, Michael D.; Kwon, Young H.; Garvin, Mona K.

    2013-03-01

    Glaucoma is one of the major causes of blindness worldwide. One important structural parameter for the diagnosis and management of glaucoma is the cup-to-disc ratio (CDR), which tends to become larger as glaucoma progresses. While approaches exist for segmenting the optic disc and cup within fundus photographs, and more recently, within spectral-domain optical coherence tomography (SD-OCT) volumes, no approaches have been reported for the simultaneous segmentation of these structures within both modalities combined. In this work, a multimodal pixel-classification approach for the segmentation of the optic disc and cup within fundus photographs and SD-OCT volumes is presented. In particular, after segmentation of other important structures (such as the retinal layers and retinal blood vessels) and fundus-to-SD-OCT image registration, features are extracted from both modalities and a k-nearest-neighbor classification approach is used to classify each pixel as cup, rim, or background. The approach is evaluated on 70 multimodal image pairs from 35 subjects in a leave-10%-out fashion (by subject). A significant improvement in classification accuracy is obtained using the multimodal approach over that obtained from the corresponding unimodal approach (97.8% versus 95.2%; p < 0:05; paired t-test).

  15. Multimodal optical imager for inner ear hearing loss diagnosis (Conference Presentation)

    NASA Astrophysics Data System (ADS)

    Park, Jesung; Maguluri, Gopi N.; Zhao, Youbo; Iftimia, Nicusor V.

    2017-02-01

    Sensorineural hearing loss (SNHL), which typically originates in the cochlea, is the most common otologic problem caused by aging and noise trauma. The cochlea, a delicate and complex biological mechanosensory transducer in the inner ear, has been extensively studied with the goal of improving diagnosis of SNHL. However, the difficulty associated with accessing the cochlea and resolving the microstructures that facilitate hearing within it in a minimally-invasive way has prevented us from being able to assess the pathology underlying SNHL in humans. To address this problem we investigated the ability of a multimodal optical system that combines optical coherence tomography (OCT) and single photon autofluorescence imaging (AFI) to enable visualization and evaluation of microstructures in the cochlea. A laboratory OCT/AFI imager was built to acquire high resolution OCT and single photon fluorescence images of the cochlea. The imager's ability to resolve diagnostically-relevant details was evaluated in ears extracted from normal and noise-exposed mice. A prototype endoscopic OCT/AFI imager was developed based on a double-clad fiber approach. Our measurements show that the multimodal OCT/AFI imager can be used to evaluate structural integrity in the mouse cochlea. Therefore, we believe that this technology is promising as a potential clinical evaluation tool, and as a technique for guiding otologic surgeries such as cochlear implant surgery.

  16. Multimodal scanning laser ophthalmoscopy for image guided treatment of age-related macular degeneration

    NASA Astrophysics Data System (ADS)

    Hammer, Daniel X.; Ferguson, R. D.; Patel, Ankit H.; Iftimia, Nicusor V.; Mujat, Mircea; Husain, Deeba

    2009-02-01

    Subretinal neovascular membranes (SRNM) are a deleterious complication of laser eye injury and retinal diseases such as age-related macular degeneration (AMD), choroiditis, and myopic retinopathy. Photodynamic therapy (PDT) and anti-vascular endothelial growth factor (VEGF) drugs are approved treatment methods. PDT acts by selective dye accumulation, activation by laser light, and disruption and clotting of the new leaky vessels. However, PDT surgery is currently not image-guided, nor does it proceed in an efficient or automated manner. This may contribute to the high rate of re-treatment. We have developed a multimodal scanning laser ophthalmoscope (SLO) for automated diagnosis and image-guided treatment of SRNMs associated with AMD. The system combines line scanning laser ophthalmoscopy (LSLO), fluorescein angiography (FA), indocyanine green angiography (ICGA), PDT laser delivery, and retinal tracking in a compact, efficient platform. This paper describes the system hardware and software design, performance characterization, and automated patient imaging and treatment session procedures and algorithms. Also, we present initial imaging and tracking measurements on normal subjects and automated lesion demarcation and sizing analysis of previously acquired angiograms. Future pre-clinical testing includes line scanning angiography and PDT treatment of AMD subjects. The automated acquisition procedure, enhanced and expedited data post-processing, and innovative image visualization and interpretation tools provided by the multimodal retinal imager may eventually aid in the diagnosis, treatment, and prognosis of AMD and other retinal diseases.

  17. (90)Y Radioembolization: Multimodality Imaging Pattern Approach with Angiographic Correlation for Optimized Target Therapy Delivery.

    PubMed

    Camacho, Juan C; Moncayo, Valeria; Kokabi, Nima; Reavey, Hamilton E; Galt, James R; Yamada, Kei; Kies, Darren D; Williams, Roger S; Kim, Hyun S; Schuster, David M

    2015-01-01

    Primary and metastatic liver cancers are responsible for considerable morbidity and mortality, and many patients are not curable at presentation. Therefore, new therapies such as radioembolization with yttrium 90 ((90)Y)-labeled microspheres are an alternative method to treat patients with unresectable primary or secondary liver tumors. Patient selection, treatment technique, and early recognition of potential complications are the keys for successful patient outcomes. The activity of administered (90)Y microspheres depends on multiple variables, including the tumor burden, the volume of the liver lobe to be treated, the type of (90)Y microspheres, and the hepatopulmonary shunt fraction. Preprocedural planning relies on the results of cross-sectional imaging to determine the extent of disease, tumoral and nontumoral liver volumes, patency of the portal vein, and the degree of extrahepatic disease. A multidisciplinary approach that combines expertise in cross-sectional imaging, nuclear medicine, and flow dynamics is critical to adequately target malignant tissue. Preprocedural multimodality imaging, particularly combined single photon emission computed tomography (SPECT) and computed tomography (CT) imaging (SPECT/CT), may be used to identify nontarget imaging patterns that, if recognized, can potentially be corrected with either branch vessel embolization or catheter repositioning. Postprocedural multimodality imaging is also useful to confirm the appropriate delivery of (90)Y microspheres, enabling early identification of potential complications and the adequacy of microsphere distribution, thereby optimizing planning for subsequent therapies.

  18. Rat brain imaging using full field optical coherence microscopy with short multimode fiber probe

    NASA Astrophysics Data System (ADS)

    Sato, Manabu; Saito, Daisuke; Kurotani, Reiko; Abe, Hiroyuki; Kawauchi, Satoko; Sato, Shunichi; Nishidate, Izumi

    2017-02-01

    We demonstrated FF OCM(full field optical coherence microscopy) using an ultrathin forward-imaging SMMF (short multimode fiber) probe of 50 μm core diameter, 125 μm diameter, and 7.4 mm length, which is a typical graded-index multimode fiber for optical communications. The axial resolution was measured to be 2.20 μm, which is close to the calculated axial resolution of 2.06 μm. The lateral resolution was evaluated to be 4.38 μm using a test pattern. Assuming that the FWHM of the contrast is the DOF (depth of focus), the DOF of the signal is obtained at 36 μm and that of the OCM is 66 μm. The contrast of the OCT images was 6.1 times higher than that of the signal images due to the coherence gate. After an euthanasia the rat brain was resected and cut at 2.6mm tail from Bregma. Contacting SMMF to the primary somatosensory cortex and the agranular insular cortex of ex vivo brain, OCM images of the brain were measured 100 times with 2μm step. 3D OCM images of the brain were measured, and internal structure information was obtained. The feasibility of an SMMF as an ultrathin forward-imaging probe in full-field OCM has been demonstrated.

  19. Core-Shell Nanostars for Multimodal Therapy and Imaging

    PubMed Central

    Li, Mengyuan; Li, Lele; Zhan, Changyou; Kohane, Daniel S.

    2016-01-01

    The coupling of diagnostic capability and effective therapy in a single multifunctional nanomedicine is desirable but remains challenging. Here, we developed multifunctional nanoparticles consisting of a gold nanostar (AuNS) core with a shell of metal-drug coordination polymer (CP). The AuNS core enabled plasmonic photothermal effect and two-photon photoluminescence (TPL), while the CP shell of gadolinium and gemcitabine monophosphate allowed chemotherapy and MRI imaging. The AuNS@CP nanoparticles exhibited a strong T1 contrast signal and could monitor the localization of nanoparticles in vivo through noninvasive MR imaging, while intravital TPL imaging could be used to study nanoparticle behavior in tumors at the microscopic level. The combination of photothermal therapy and chemotherapy inhibited tumor growth in vivo. PMID:27877236

  20. Differences in Multi-Modal Ultrasound Imaging between Triple Negative and Non-Triple Negative Breast Cancer.

    PubMed

    Li, Ziyao; Tian, Jiawei; Wang, Xiaowei; Wang, Ying; Wang, Zhenzhen; Zhang, Lei; Jing, Hui; Wu, Tong

    2016-04-01

    The objective of this study was to identify multi-modal ultrasound imaging parameters that could potentially help to differentiate between triple negative breast cancer (TNBC) and non-TNBC. Conventional ultrasonography, ultrasound strain elastography and 3-D ultrasound (3-D-US) findings from 50 TNBC and 179 non-TNBC patients were retrospectively reviewed. Immunohistochemical examination was used as the reference gold standard for cancer subtyping. Different ultrasound modalities were initially analyzed to define TNBC-related features. Subsequently, logistic regression analysis was applied to TNBC-related features to establish models for predicting TNBC. TNBCs often presented as micro-lobulated, markedly hypo-echoic masses with an abrupt interface (p = 0.015, 0.0015 and 0.004, compared with non-TNBCs, respectively) on conventional ultrasound, and showed a diminished retraction pattern phenomenon in the coronal plane (p = 0.035) on 3-D-US. Our findings suggest that B-mode ultrasound and 3-D-US in multi-modality ultrasonography could be a useful non-invasive technique for differentiating TNBCs from non-TNBCs.

  1. Depth-resolved multimodal imaging: Wavelength modulated spatially offset Raman spectroscopy with optical coherence tomography.

    PubMed

    Chen, Mingzhou; Mas, Josep; Forbes, Lindsey H; Andrews, Melissa R; Dholakia, Kishan

    2017-07-13

    A major challenge in biophotonics is multimodal imaging to obtain both morphological and molecular information at depth. We demonstrate a hybrid approach integrating optical coherence tomography (OCT) with wavelength modulated spatially offset Raman spectroscopy (WM-SORS). With depth colocalization obtained from the OCT, we can penetrate 1.2-mm deep into strong scattering media (lard) to acquire up to a 14-fold enhancement of a Raman signal from a hidden target (polystyrene) with a spatial offset. Our approach is capable of detecting both Raman and OCT signals for pharmaceutical particles embedded in turbid media and revealing the white matter at depth within a 0.6-mm thick brain tissue layer. This depth resolved label-free multimodal approach is a powerful route to analyze complex biomedical samples. © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

  2. Multimodal brain imaging with magnetoencephalography: A method for measuring blood pressure and cardiorespiratory oscillations.

    PubMed

    Myllylä, Teemu; Zacharias, Norman; Korhonen, Vesa; Zienkiewicz, Aleksandra; Hinrichs, Hermann; Kiviniemi, Vesa; Walter, Martin

    2017-12-01

    Studies with magnetoencephalography (MEG) are still quite rarely combined simultaneously with methods that can provide a metabolic dimension to MEG investigations. In addition, continuous blood pressure measurements which comply with MEG compatibility requirements are lacking. For instance, by combining methods reflecting neurovascular status one could obtain more information on low frequency fluctuations that have recently gained increasing interest as a mediator of functional connectivity within brain networks. This paper presents a multimodal brain imaging setup, capable to non-invasively and continuously measure cerebral hemodynamic, cardiorespiratory and blood pressure oscillations simultaneously with MEG. In the setup, all methods apart from MEG rely on the use of fibre optics. In particular, we present a method for measuring of blood pressure and cardiorespiratory oscillations continuously with MEG. The potential of this type of multimodal setup for brain research is demonstrated by our preliminary studies on human, showing effects of mild hypercapnia, gathered simultaneously with the presented modalities.

  3. Multimodality Imaging in Coronary Artery Disease: Focus on Computed Tomography

    PubMed Central

    Lee, Ji Hyun; Han, Donghee; Danad, Ibrahim; Hartaigh, Bríain ó; Lin, Fay Y.

    2016-01-01

    Coronary artery disease (CAD) is the leading cause of mortality worldwide, and various cardiovascular imaging modalities have been introduced for the purpose of diagnosing and determining the severity of CAD. More recently, advances in computed tomography (CT) technology have contributed to the widespread clinical application of cardiac CT for accurate and noninvasive evaluation of CAD. In this review, we focus on imaging assessment of CAD based upon CT, which includes coronary artery calcium screening, coronary CT angiography, myocardial CT perfusion, and fractional flow reserve CT. Further, we provide a discussion regarding the potential implications, benefits and limitations, as well as the possible future directions according to each modality. PMID:27081438

  4. Ankle impingement: a review of multimodality imaging approach.

    PubMed

    Russo, A; Zappia, M; Reginelli, A; Carfora, M; D'Agosto, G F; La Porta, M; Genovese, E A; Fonio, P

    2013-08-01

    Ankle impingement is defined as entrapment of an anatomic structure that leads to pain and decreased range of motion of the ankle and can be classified as either soft tissue or osseous (Bassett et al. in J Bone Joint Surg Am 72:55-59, 1990). The impingement syndromes of the ankle are a group of painful disorders that limit full range of movement. Symptoms are due to compression of soft-tissues or osseous structures during particular movements (Ogilvie-Harris et al. in Arthroscopy 13:564-574, 1997). Osseous impingement can result from spur formation along the anterior margin of the distal tibia and talus or as a result of a prominent posterolateral talar process, the os trigonum. Soft-tissue impingement usually results from scarring and fibrosis associated with synovial, capsular, or ligamentous injury. Soft-tissue impingement most often occurs in the anterolateral gutter, the medial ankle, or in the region of the syndesmosis (Van den Bekerom and Raven in Knee Surg Sports Traumatol Arthrosc 15:465-471, 2007). The main impingement syndromes are anterolateral, anterior, anteromedial, posterior, and posteromedial impingement. These conditions arise from initial ankle injuries, which, in the subacute or chronic situation, lead to development of abnormal osseous and soft-tissue thickening within the ankle joint. The relative contributions of the osseous and soft-tissue abnormalities are variable, but whatever component is dominant there is physical impingement and painful limitation of ankle movement. Conventional radiography is usually the first imaging technique performer and allows assessment of any potential bone abnormality, particularly in anterior and posterior impingement. Computed tomography (CT) and isotope bone scanning have been largely superseded by magnetic resonance (MR) imaging. MR imaging can demonstrate osseous and soft-tissue edema in anterior or posterior impingement. MR imaging is the most useful imaging modality in evaluating suspected soft

  5. High resolution in vitro bioluminescence imaging using a multimodal optical system

    NASA Astrophysics Data System (ADS)

    Altabella, L.; Gigliotti, C. R.; Perani, L.; Crippa, M. P.; Boschi, F.; Spinelli, A. E.

    2016-01-01

    Bioluminescence in vitro studies are usually performed with dedicated microscopes. In this work, we developed a novel image recovery algorithm and a multimodal system prototype to perform bioluminescence microscopy. We performed a feasibility study using GEANT4 Monte Carlo (MC) simulation of bioluminescent cells acquired at low SNR frames and processed using a Super Resolution Regularization Algorithm (SRRA). The method was also tested using in vitro cell acquisition. The results obtained with MC simulations showed an improvement in the spatial resolution from 90 μ m to 10 μ m and from 110 μ m to 13 μ m for in vitro imaging of mesothelioma cells.

  6. Multimodal in vivo imaging of oral cancer using fluorescence lifetime, photoacoustic and ultrasound techniques

    PubMed Central

    Fatakdawala, Hussain; Poti, Shannon; Zhou, Feifei; Sun, Yang; Bec, Julien; Liu, Jing; Yankelevich, Diego R.; Tinling, Steven P.; Gandour-Edwards, Regina F.; Farwell, D. Gregory; Marcu, Laura

    2013-01-01

    This work reports a multimodal system for label-free tissue diagnosis combining fluorescence lifetime imaging (FLIm), ultrasound backscatter microscopy (UBM), and photoacoustic imaging (PAI). This system provides complementary biochemical, structural and functional features allowing for enhanced in vivo detection of oral carcinoma. Results from a hamster oral carcinoma model (normal, precancer and carcinoma) are presented demonstrating the ability of FLIm to delineate biochemical composition at the tissue surface, UBM and related radiofrequency parameters to identify disruptions in the tissue microarchitecture and PAI to map optical absorption associated with specific tissue morphology and physiology. PMID:24049693

  7. Atherosclerotic plaque targeting mechanism of long-circulating nanoparticles established by multimodal imaging.

    PubMed

    Lobatto, Mark E; Calcagno, Claudia; Millon, Antoine; Senders, Max L; Fay, Francois; Robson, Philip M; Ramachandran, Sarayu; Binderup, Tina; Paridaans, Maarten P M; Sensarn, Steven; Rogalla, Stephan; Gordon, Ronald E; Cardoso, Luis; Storm, Gert; Metselaar, Josbert M; Contag, Christopher H; Stroes, Erik S G; Fayad, Zahi A; Mulder, Willem J M

    2015-02-24

    Atherosclerosis is a major cause of global morbidity and mortality that could benefit from novel targeted therapeutics. Recent studies have shown efficient and local drug delivery with nanoparticles, although the nanoparticle targeting mechanism for atherosclerosis has not yet been fully elucidated. Here we used in vivo and ex vivo multimodal imaging to examine permeability of the vessel wall and atherosclerotic plaque accumulation of fluorescently labeled liposomal nanoparticles in a rabbit model. We found a strong correlation between permeability as established by in vivo dynamic contrast enhanced magnetic resonance imaging and nanoparticle plaque accumulation with subsequent nanoparticle distribution throughout the vessel wall. These key observations will enable the development of nanotherapeutic strategies for atherosclerosis.

  8. MULTIMODAL IMAGING OF ACUTE EXUDATIVE POLYMORPHOUS VITELLIFORM MACULOPATHY WITH OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY AND ADAPTIVE OPTICS SCANNING LASER OPHTHALMOSCOPY.

    PubMed

    Skondra, Dimitra; Nesper, Peter L; Fawzi, Amani A

    2017-05-16

    To report a case of acute exudative polymorphous vitelliform maculopathy including the findings of optical coherence tomography angiography and adaptive optics scanning laser ophthalmoscopy. Findings on clinical examination, color fundus photography, spectral-domain optical coherence tomography, infrared reflectance, autofluorescence, optical coherence tomography angiography, and adaptive optics scanning laser ophthalmoscopy. A 54-year-old white man with no significant medical history and history of smoking presented with bilateral multiple serous and vitelliform detachments consistent with acute exudative polymorphous vitelliform maculopathy. Extensive infectious, inflammatory, and malignancy workup was negative. Spectral-domain optical coherence tomography showed thickened, hyperreflective ellipsoid zone, subretinal fluid, and focal as well as diffuse subretinal hyperreflective material corresponding to the vitelliform lesions. Optical coherence tomography angiography showed normal retinal and choroidal vasculature, whereas adaptive optics scanning laser ophthalmoscopy showed circular focal "target" lesions at the level of the photoreceptors in the area of foveal detachment. Multimodal imaging is valuable in evaluating patients with acute exudative polymorphous vitelliform maculopathy.

  9. Coregistration of multimodal imaging is associated with favourable two-year seizure outcome after paediatric epilepsy surgery.

    PubMed

    Perry, Michael Scott; Bailey, Laurie; Freedman, Daniel; Donahue, David; Malik, Saleem; Head, Hayden; Keator, Cynthia; Hernandez, Angel

    2017-03-01

    confidence in presurgical localization. These findings support the use of multimodal coregistered imaging as part of the presurgical assessment in patients evaluated for surgical treatment of intractable epilepsy.

  10. IMAGING WITH MULTIMODAL ADAPTIVE-OPTICS OPTICAL COHERENCE TOMOGRAPHY IN MULTIPLE EVANESCENT WHITE DOT SYNDROME: THE STRUCTURE AND FUNCTIONAL RELATIONSHIP.

    PubMed

    Labriola, Leanne T; Legarreta, Andrew D; Legarreta, John E; Nadler, Zach; Gallagher, Denise; Hammer, Daniel X; Ferguson, R Daniel; Iftimia, Nicusor; Wollstein, Gadi; Schuman, Joel S

    2016-01-01

    To elucidate the location of pathological changes in multiple evanescent white dot syndrome (MEWDS) with the use of multimodal adaptive optics (AO) imaging. A 5-year observational case study of a 24-year-old female with recurrent MEWDS. Full examination included history, Snellen chart visual acuity, pupil assessment, intraocular pressures, slit lamp evaluation, dilated fundoscopic exam, imaging with Fourier-domain optical coherence tomography (FD-OCT), blue-light fundus autofluorescence (FAF), fundus photography, fluorescein angiography, and adaptive-optics optical coherence tomography. Three distinct acute episodes of MEWDS occurred during the period of follow-up. Fourier-domain optical coherence tomography and adaptive-optics imaging showed disturbance in the photoreceptor outer segments (PR OS) in the posterior pole with each flare. The degree of disturbance at the photoreceptor level corresponded to size and extent of the visual field changes. All findings were transient with delineation of the photoreceptor recovery from the outer edges of the lesion inward. Hyperautofluorescence was seen during acute flares. Increase in choroidal thickness did occur with each active flare but resolved. Although changes in the choroid and RPE can be observed in MEWDS, Fourier-domain optical coherence tomography, and multimodal adaptive optics imaging localized the visually significant changes seen in this disease at the level of the photoreceptors. These transient retinal changes specifically occur at the level of the inner segment ellipsoid and OS/RPE line. En face optical coherence tomography imaging provides a detailed, yet noninvasive method for following the convalescence of MEWDS and provides insight into the structural and functional relationship of this transient inflammatory retinal disease.

  11. IMAGING WITH MULTIMODAL ADAPTIVE-OPTICS OPTICAL COHERENCE TOMOGRAPHY IN MULTIPLE EVANESCENT WHITE DOT SYNDROME: THE STRUCTURE AND FUNCTIONAL RELATIONSHIP

    PubMed Central

    Legarreta, Andrew D.; Legarreta, John E.; Nadler, Zach; Gallagher, Denise; Hammer, Daniel X.; Ferguson, R. Daniel; Iftimia, Nicusor; Wollstein, Gadi; Schuman, Joel S.

    2016-01-01

    Purpose: To elucidate the location of pathological changes in multiple evanescent white dot syndrome (MEWDS) with the use of multimodal adaptive optics (AO) imaging. Methods: A 5-year observational case study of a 24-year-old female with recurrent MEWDS. Full examination included history, Snellen chart visual acuity, pupil assessment, intraocular pressures, slit lamp evaluation, dilated fundoscopic exam, imaging with Fourier-domain optical coherence tomography (FD-OCT), blue-light fundus autofluorescence (FAF), fundus photography, fluorescein angiography, and adaptive-optics optical coherence tomography. Results: Three distinct acute episodes of MEWDS occurred during the period of follow-up. Fourier-domain optical coherence tomography and adaptive-optics imaging showed disturbance in the photoreceptor outer segments (PR OS) in the posterior pole with each flare. The degree of disturbance at the photoreceptor level corresponded to size and extent of the visual field changes. All findings were transient with delineation of the photoreceptor recovery from the outer edges of the lesion inward. Hyperautofluorescence was seen during acute flares. Increase in choroidal thickness did occur with each active flare but resolved. Conclusion: Although changes in the choroid and RPE can be observed in MEWDS, Fourier-domain optical coherence tomography, and multimodal adaptive optics imaging localized the visually significant changes seen in this disease at the level of the photoreceptors. These transient retinal changes specifically occur at the level of the inner segment ellipsoid and OS/RPE line. En face optical coherence tomography imaging provides a detailed, yet noninvasive method for following the convalescence of MEWDS and provides insight into the structural and functional relationship of this transient inflammatory retinal disease. PMID:26735319

  12. Registration of multimodal brain images: some experimental results

    NASA Astrophysics Data System (ADS)

    Chen, Hua-mei; Varshney, Pramod K.

    2002-03-01

    Joint histogram of two images is required to uniquely determine the mutual information between the two images. It has been pointed out that, under certain conditions, existing joint histogram estimation algorithms like partial volume interpolation (PVI) and linear interpolation may result in different types of artifact patterns in the MI based registration function by introducing spurious maxima. As a result, the artifacts may hamper the global optimization process and limit registration accuracy. In this paper we present an extensive study of interpolation-induced artifacts using simulated brain images and show that similar artifact patterns also exist when other intensity interpolation algorithms like cubic convolution interpolation and cubic B-spline interpolation are used. A new joint histogram estimation scheme named generalized partial volume estimation (GPVE) is proposed to eliminate the artifacts. A kernel function is involved in the proposed scheme and when the 1st order B-spline is chosen as the kernel function, it is equivalent to the PVI. A clinical brain image database furnished by Vanderbilt University is used to compare the accuracy of our algorithm with that of PVI. Our experimental results show that the use of higher order kernels can effectively remove the artifacts and, in cases when MI based registration result suffers from the artifacts, registration accuracy can be improved significantly.

  13. Multimodality Imaging in Cardiac Sarcoidosis: Is There a Winner?

    PubMed Central

    Perez, Irving E.; Garcia, Mario J.; Taub, Cynthia C.

    2016-01-01

    Sarcoidosis is a multisystem granulomatous disease of unknown cause that can affect the heart. Cardiac sarcoidosis may be present in as many as 25% of patients with systemic sarcoidosis, and it is frequently underdiagnosed. The early and accurate diagnosis of myocardial involvement is challenging. Advanced imaging techniques play important roles in the diagnosis and management of patients with cardiac sarcoidosis. PMID:25784137

  14. Multi-Modality fiducial marker for validation of registration of medical images with histology

    NASA Astrophysics Data System (ADS)

    Shojaii, Rushin; Martel, Anne L.

    2010-03-01

    A multi-modality fiducial marker is presented in this work, which can be used for validating the correlation of histology images with medical images. This marker can also be used for landmark-based image registration. Seven different fiducial markers including a catheter, spaghetti, black spaghetti, cuttlefish ink, and liquid iron are implanted in a mouse specimen and then investigated based on visibility, localization, size, and stability. The black spaghetti and the mixture of cuttlefish ink and flour are shown to be the most suitable markers. Based on the size of the markers, black spaghetti is more suitable for big specimens and the mixture of the cuttlefish ink, flour, and water injected in a catheter is more suitable for small specimens such as mouse tumours. These markers are visible on medical images and also detectable on histology and optical images of the tissue blocks. The main component in these agents which enhances the contrast is iron.

  15. Multi-modal molecular diffuse optical tomography system for small animal imaging

    PubMed Central

    Guggenheim, James A.; Basevi, Hector R. A.; Frampton, Jon; Styles, Iain B.; Dehghani, Hamid

    2013-01-01

    A multi-modal optical imaging system for quantitative 3D bioluminescence and functional diffuse imaging is presented, which has no moving parts and uses mirrors to provide multi-view tomographic data for image reconstruction. It is demonstrated that through the use of trans-illuminated spectral near infrared measurements and spectrally constrained tomographic reconstruction, recovered concentrations of absorbing agents can be used as prior knowledge for bioluminescence imaging within the visible spectrum. Additionally, the first use of a recently developed multi-view optical surface capture technique is shown and its application to model-based image reconstruction and free-space light modelling is demonstrated. The benefits of model-based tomographic image recovery as compared to 2D planar imaging are highlighted in a number of scenarios where the internal luminescence source is not visible or is confounding in 2D images. The results presented show that the luminescence tomographic imaging method produces 3D reconstructions of individual light sources within a mouse-sized solid phantom that are accurately localised to within 1.5mm for a range of target locations and depths indicating sensitivity and accurate imaging throughout the phantom volume. Additionally the total reconstructed luminescence source intensity is consistent to within 15% which is a dramatic improvement upon standard bioluminescence imaging. Finally, results from a heterogeneous phantom with an absorbing anomaly are presented demonstrating the use and benefits of a multi-view, spectrally constrained coupled imaging system that provides accurate 3D luminescence images. PMID:24954977

  16. Multimodality Imaging of the Effects of a Novel Dentifrice on Oral Biofilm

    PubMed Central

    Ajdaharian, Janet; Dadkhah, Mohammad; Sabokpey, Sara; Biren-Fetz, John; Chung, Na Eun; Wink, Cherie; Wilder-Smith, Petra

    2014-01-01

    Objective Oral biofilm formation and progression on the surface of the tooth can lead to advanced oral disease such as gingivitis. The purpose of this randomized, controlled, double-blinded study was to evaluate the effects of a novel dental gel on oral plaque biofilm using multimodal imaging techniques. Materials and Methods Twenty-five subjects with moderate gingival inflammation (Löe and Silness Gingival Index ≥ 2) and pocket depths <4 were randomly assigned to brush twice daily for 21 days with the test or the control dental gel. In vivo multimodality in situ imaging was performed over a 3-week period using in vivo Optical Coherence Tomography (OCT) and Non-Linear Optical microscopy (NLOM). Plaque levels, gingival inflammation and gingival bleeding were also charted on days 0, 7, 14, and 21 using standard clinical indices. Results After 3 weeks, OCT and NLOM images showed a macroscopic break-up of the plaque layer and smaller, fragmented residual deposits in the test group with no apparent changes in the pellicle. Biofilm was also reduced in the control group, but to a lesser degree with regard to thickness, continuity and surface area. Paralleling these imaging results, clinical indices were significantly improved in both groups (P <0.05) and significantly lower in the test group (P <0.05). Conclusion Both dental gels reduced oral biofilm with the test gel showing greater efficacy (P <0.05) as determined by clinical and imaging parameters. PMID:24916419

  17. A Pipeline for 3D Multimodality Image Integration and Computer-assisted Planning in Epilepsy Surgery.

    PubMed

    Nowell, Mark; Rodionov, Roman; Zombori, Gergely; Sparks, Rachel; Rizzi, Michele; Ourselin, Sebastien; Miserocchi, Anna; McEvoy, Andrew; Duncan, John

    2016-05-20

    Epilepsy surgery is challenging and the use of 3D multimodality image integration (3DMMI) to aid presurgical planning is well-established. Multimodality image integration can be technically demanding, and is underutilised in clinical practice. We have developed a single software platform for image integration, 3D visualization and surgical planning. Here, our pipeline is described in step-by-step fashion, starting with image acquisition, proceeding through image co-registration, manual segmentation, brain and vessel extraction, 3D visualization and manual planning of stereoEEG (SEEG) implantations. With dissemination of the software this pipeline can be reproduced in other centres, allowing other groups to benefit from 3DMMI. We also describe the use of an automated, multi-trajectory planner to generate stereoEEG implantation plans. Preliminary studies suggest this is a rapid, safe and efficacious adjunct for planning SEEG implantations. Finally, a simple solution for the export of plans and models to commercial neuronavigation systems for implementation of plans in the operating theater is described. This software is a valuable tool that can support clinical decision making throughout the epilepsy surgery pathway.

  18. A Pipeline for 3D Multimodality Image Integration and Computer-assisted Planning in Epilepsy Surgery

    PubMed Central

    Nowell, Mark; Rodionov, Roman; Zombori, Gergely; Sparks, Rachel; Rizzi, Michele; Ourselin, Sebastien; Miserocchi, Anna; McEvoy, Andrew; Duncan, John

    2016-01-01

    Epilepsy surgery is challenging and the use of 3D multimodality image integration (3DMMI) to aid presurgical planning is well-established. Multimodality image integration can be technically demanding, and is underutilised in clinical practice. We have developed a single software platform for image integration, 3D visualization and surgical planning. Here, our pipeline is described in step-by-step fashion, starting with image acquisition, proceeding through image co-registration, manual segmentation, brain and vessel extraction, 3D visualization and manual planning of stereoEEG (SEEG) implantations. With dissemination of the software this pipeline can be reproduced in other centres, allowing other groups to benefit from 3DMMI. We also describe the use of an automated, multi-trajectory planner to generate stereoEEG implantation plans. Preliminary studies suggest this is a rapid, safe and efficacious adjunct for planning SEEG implantations. Finally, a simple solution for the export of plans and models to commercial neuronavigation systems for implementation of plans in the operating theater is described. This software is a valuable tool that can support clinical decision making throughout the epilepsy surgery pathway. PMID:27286266

  19. Multimodal imaging of a humanized orthotopic model of hepatocellular carcinoma in immunodeficient mice

    PubMed Central

    Wu, Tao; Heuillard, Emilie; Lindner, Véronique; Bou About, Ghina; Ignat, Mihaela; Dillenseger, Jean-Philippe; Anton, Nicolas; Dalimier, Eugénie; Gossé, Francine; Fouré, Gael; Blindauer, Franck; Giraudeau, Céline; El-Saghire, Hussein; Bouhadjar, Mourad; Calligaro, Cynthia; Sorg, Tania; Choquet, Philippe; Vandamme, Thierry; Ferrand, Christophe; Marescaux, Jacques; Baumert, Thomas F.; Diana, Michele; Pessaux, Patrick; Robinet, Eric

    2016-01-01

    The development of multimodal strategies for the treatment of hepatocellular carcinoma requires tractable animal models allowing for advanced in vivo imaging. Here, we characterize an orthotopic hepatocellular carcinoma model based on the injection of luciferase-expressing human hepatoma Huh-7 (Huh-7-Luc) cells in immunodeficient mice. Luciferase allows for an easy repeated monitoring of tumor growth by in vivo bioluminescence. The intrahepatic injection was more efficient than intrasplenic or intraportal injection in terms of survival, rate of orthotopic engraftment, and easiness. A positive correlation between luciferase activity and tumor size, evaluated by Magnetic Resonance Imaging, allowed to define the endpoint value for animal experimentation with this model. Response to standard of care, sorafenib or doxorubicin, were similar to those previously reported in the literature, with however a strong toxicity of doxorubicin. Tumor vascularization was visible by histology seven days after Huh-7-Luc transplantation and robustly developed at day 14 and day 21. The model was used to explore different imaging modalities, including microtomography, probe-based confocal laser endomicroscopy, full-field optical coherence tomography, and ultrasound imaging. Tumor engraftment was similar after echo-guided intrahepatic injection as after laparotomy. Collectively, this orthotopic hepatocellular carcinoma model enables the in vivo evaluation of chemotherapeutic and surgical approaches using multimodal imaging. PMID:27739457

  20. Visual tracking for multi-modality computer-assisted image guidance

    NASA Astrophysics Data System (ADS)

    Basafa, Ehsan; Foroughi, Pezhman; Hossbach, Martin; Bhanushali, Jasmine; Stolka, Philipp

    2017-03-01

    With optical cameras, many interventional navigation tasks previously relying on EM, optical, or mechanical guidance can be performed robustly, quickly, and conveniently. We developed a family of novel guidance systems based on wide-spectrum cameras and vision algorithms for real-time tracking of interventional instruments and multi-modality markers. These navigation systems support the localization of anatomical targets, support placement of imaging probe and instruments, and provide fusion imaging. The unique architecture - low-cost, miniature, in-hand stereo vision cameras fitted directly to imaging probes - allows for an intuitive workflow that fits a wide variety of specialties such as anesthesiology, interventional radiology, interventional oncology, emergency medicine, urology, and others, many of which see increasing pressure to utilize medical imaging and especially ultrasound, but have yet to develop the requisite skills for reliable success. We developed a modular system, consisting of hardware (the Optical Head containing the mini cameras) and software (components for visual instrument tracking with or without specialized visual features, fully automated marker segmentation from a variety of 3D imaging modalities, visual observation of meshes of widely separated markers, instant automatic registration, and target tracking and guidance on real-time multi-modality fusion views). From these components, we implemented a family of distinct clinical and pre-clinical systems (for combinations of ultrasound, CT, CBCT, and MRI), most of which have international regulatory clearance for clinical use. We present technical and clinical results on phantoms, ex- and in-vivo animals, and patients.

  1. Quasi-simultaneous multimodal imaging of cutaneous tissue oxygenation and perfusion

    NASA Astrophysics Data System (ADS)

    Ren, Wenqi; Gan, Qi; Wu, Qiang; Zhang, Shiwu; Xu, Ronald

    2015-12-01

    Simultaneous and quantitative assessment of multiple tissue parameters may facilitate more effective diagnosis and therapy in many clinical applications, such as wound healing. However, existing wound assessment methods are typically subjective and qualitative, with the need for sequential data acquisition and coregistration between modalities, and lack of reliable standards for performance evaluation or calibration. To overcome these limitations, we developed a multimodal imaging system for quasi-simultaneous assessment of cutaneous tissue oxygenation and perfusion in a quantitative and noninvasive fashion. The system integrated multispectral and laser speckle imaging technologies into one experimental setup. Tissue oxygenation and perfusion were reconstructed by advanced algorithms. The accuracy and reliability of the imaging system were quantitatively validated in calibration experiments and a tissue-simulating phantom test. The experimental results were compared with a commercial oxygenation and perfusion monitor. Dynamic detection of cutaneous tissue oxygenation and perfusion was also demonstrated in vivo by a postocclusion reactive hyperemia procedure in a human subject and a wound healing process in a wounded mouse model. Our in vivo experiments not only validated the performance of the multimodal imaging system for cutaneous tissue oxygenation and perfusion imaging but also demonstrated its technical potential for wound healing assessment in clinical practice.

  2. Quasi-simultaneous multimodal imaging of cutaneous tissue oxygenation and perfusion.

    PubMed

    Ren, Wenqi; Gan, Qi; Wu, Qiang; Zhang, Shiwu; Xu, Ronald

    2015-12-01

    Simultaneous and quantitative assessment of multiple tissue parameters may facilitate more effective diagnosis and therapy in many clinical applications, such as wound healing. However, existing wound assessment methods are typically subjective and qualitative, with the need for sequential data acquisition and coregistration between modalities, and lack of reliable standards for performance evaluation or calibration. To overcome these limitations, we developed a multimodal imaging system for quasi-simultaneous assessment of cutaneous tissue oxygenation and perfusion in a quantitative and noninvasive fashion. The system integrated multispectral and laser speckle imaging technologies into one experimental setup. Tissue oxygenation and perfusion were reconstructed by advanced algorithms. The accuracy and reliability of the imaging system were quantitatively validated in calibration experiments and a tissue-simulating phantom test. The experimental results were compared with a commercial oxygenation and perfusion monitor. Dynamic detection of cutaneous tissue oxygenation and perfusion was also demonstrated in vivo by a postocclusion reactive hyperemia procedure in a human subject and a wound healing process in a wounded mouse model. Our in vivo experiments not only validated the performance of the multimodal imaging system for cutaneous tissue oxygenation and perfusion imaging but also demonstrated its technical potential for wound healing assessment in clinical practice.

  3. A Multimodal Imaging Approach for Longitudinal Evaluation of Bladder Tumor Development in an Orthotopic Murine Model

    PubMed Central

    Meyer, Sandra; Burggraaf, Maroeska J.; Jose, Jithin; Molthoff, Carla F. M.

    2016-01-01

    Bladder cancer is the fourth most common malignancy amongst men in Western industrialized countries with an initial response rate of 70% for the non-muscle invasive type, and improving therapy efficacy is highly needed. For this, an appropriate, reliable animal model is essential to gain insight into mechanisms of tumor growth for use in response monitoring of (new) agents. Several animal models have been described in previous studies, but so far success has been hampered due to the absence of imaging methods to follow tumor growth non-invasively over time. Recent developments of multimodal imaging methods for use in animal research have substantially strengthened these options of in vivo visualization of tumor growth. In the present study, a multimodal imaging approach was addressed to investigate bladder tumor proliferation longitudinally. The complementary abilities of Bioluminescence, High Resolution Ultrasound and Photo-acoustic Imaging permit a better understanding of bladder tumor development. Hybrid imaging modalities allow the integration of individual strengths to enable sensitive and improved quantification and understanding of tumor biology, and ultimately, can aid in the discovery and development of new therapeutics. PMID:27533303

  4. Gold–silica quantum rattles for multimodal imaging and therapy

    PubMed Central

    Hembury, Mathew; Chiappini, Ciro; Bertazzo, Sergio; Kalber, Tammy L.; Drisko, Glenna L.; Ogunlade, Olumide; Walker-Samuel, Simon; Krishna, Katla Sai; Jumeaux, Coline; Beard, Paul; Kumar, Challa S. S. R.; Porter, Alexandra E.; Lythgoe, Mark F.; Boissière, Cédric; Sanchez, Clément; Stevens, Molly M.

    2015-01-01

    Gold quantum dots exhibit distinctive optical and magnetic behaviors compared with larger gold nanoparticles. However, their unfavorable interaction with living systems and lack of stability in aqueous solvents has so far prevented their adoption in biology and medicine. Here, a simple synthetic pathway integrates gold quantum dots within a mesoporous silica shell, alongside larger gold nanoparticles within the shell’s central cavity. This “quantum rattle” structure is stable in aqueous solutions, does not elicit cell toxicity, preserves the attractive near-infrared photonics and paramagnetism of gold quantum dots, and enhances the drug-carrier performance of the silica shell. In vivo, the quantum rattles reduced tumor burden in a single course of photothermal therapy while coupling three complementary imaging modalities: near-infrared fluorescence, photoacoustic, and magnetic resonance imaging. The incorporation of gold within the quantum rattles significantly enhanced the drug-carrier performance of the silica shell. This innovative material design based on the mutually beneficial interaction of gold and silica introduces the use of gold quantum dots for imaging and therapeutic applications. PMID:25653336

  5. Gold-silica quantum rattles for multimodal imaging and therapy.

    PubMed

    Hembury, Mathew; Chiappini, Ciro; Bertazzo, Sergio; Kalber, Tammy L; Drisko, Glenna L; Ogunlade, Olumide; Walker-Samuel, Simon; Krishna, Katla Sai; Jumeaux, Coline; Beard, Paul; Kumar, Challa S S R; Porter, Alexandra E; Lythgoe, Mark F; Boissière, Cédric; Sanchez, Clément; Stevens, Molly M

    2015-02-17

    Gold quantum dots exhibit distinctive optical and magnetic behaviors compared with larger gold nanoparticles. However, their unfavorable interaction with living systems and lack of stability in aqueous solvents has so far prevented their adoption in biology and medicine. Here, a simple synthetic pathway integrates gold quantum dots within a mesoporous silica shell, alongside larger gold nanoparticles within the shell's central cavity. This "quantum rattle" structure is stable in aqueous solutions, does not elicit cell toxicity, preserves the attractive near-infrared photonics and paramagnetism of gold quantum dots, and enhances the drug-carrier performance of the silica shell. In vivo, the quantum rattles reduced tumor burden in a single course of photothermal therapy while coupling three complementary imaging modalities: near-infrared fluorescence, photoacoustic, and magnetic resonance imaging. The incorporation of gold within the quantum rattles significantly enhanced the drug-carrier performance of the silica shell. This innovative material design based on the mutually beneficial interaction of gold and silica introduces the use of gold quantum dots for imaging and therapeutic applications.

  6. Gold–silica quantum rattles for multimodal imaging and therapy

    SciTech Connect

    Hembury, Mathew; Chiappini, Ciro; Bertazzo, Sergio; Kalber, Tammy L.; Drisko, Glenna L.; Ogunlade, Olumide; Walker-Samuel, Simon; Krishna, Katla Sai; Jumeaux, Coline; Beard, Paul; Kumar, Challa S. S. R.; Porter, Alexandra E.; Lythgoe, Mark F.; Boissière, Cédric; Sanchez, Clément; Stevens, Molly M.

    2015-02-04

    Gold quantum dots exhibit distinctive optical and magnetic behaviors compared with larger gold nanoparticles. However, their unfavorable interaction with living systems and lack of stability in aqueous solvents has so far prevented their adoption in biology and medicine. In this paper, a simple synthetic pathway integrates gold quantum dots within a mesoporous silica shell, alongside larger gold nanoparticles within the shell’s central cavity. This “quantum rattle” structure is stable in aqueous solutions, does not elicit cell toxicity, preserves the attractive near-infrared photonics and paramagnetism of gold quantum dots, and enhances the drug-carrier performance of the silica shell. In vivo, the quantum rattles reduced tumor burden in a single course of photothermal therapy while coupling three complementary imaging modalities: near-infrared fluorescence, photoacoustic, and magnetic resonance imaging. The incorporation of gold within the quantum rattles significantly enhanced the drug-carrier performance of the silica shell. Finally, this innovative material design based on the mutually beneficial interaction of gold and silica introduces the use of gold quantum dots for imaging and therapeutic applications.

  7. Gold–silica quantum rattles for multimodal imaging and therapy

    DOE PAGES

    Hembury, Mathew; Chiappini, Ciro; Bertazzo, Sergio; ...

    2015-02-04

    Gold quantum dots exhibit distinctive optical and magnetic behaviors compared with larger gold nanoparticles. However, their unfavorable interaction with living systems and lack of stability in aqueous solvents has so far prevented their adoption in biology and medicine. In this paper, a simple synthetic pathway integrates gold quantum dots within a mesoporous silica shell, alongside larger gold nanoparticles within the shell’s central cavity. This “quantum rattle” structure is stable in aqueous solutions, does not elicit cell toxicity, preserves the attractive near-infrared photonics and paramagnetism of gold quantum dots, and enhances the drug-carrier performance of the silica shell. In vivo, themore » quantum rattles reduced tumor burden in a single course of photothermal therapy while coupling three complementary imaging modalities: near-infrared fluorescence, photoacoustic, and magnetic resonance imaging. The incorporation of gold within the quantum rattles significantly enhanced the drug-carrier performance of the silica shell. Finally, this innovative material design based on the mutually beneficial interaction of gold and silica introduces the use of gold quantum dots for imaging and therapeutic applications.« less

  8. Associations between white matter microstructure and amyloid burden in preclinical Alzheimer's disease: A multimodal imaging investigation.

    PubMed

    Racine, Annie M; Adluru, Nagesh; Alexander, Andrew L; Christian, Bradley T; Okonkwo, Ozioma C; Oh, Jennifer; Cleary, Caitlin A; Birdsill, Alex; Hillmer, Ansel T; Murali, Dhanabalan; Barnhart, Todd E; Gallagher, Catherine L; Carlsson, Cynthia M; Rowley, Howard A; Dowling, N Maritza; Asthana, Sanjay; Sager, Mark A; Bendlin, Barbara B; Johnson, Sterling C

    2014-01-01

    Some cognitively healthy individuals develop brain amyloid accumulation, suggestive of incipient Alzheimer's disease (AD), but the effect of amyloid on other potentially informative imaging modalities, such as Diffusion Tensor Imaging (DTI), in characterizing brain changes in preclinical AD requires further exploration. In this study, a sample (N = 139, mean age 60.6, range 46 to 71) from the Wisconsin Registry for Alzheimer's Prevention (WRAP), a cohort enriched for AD risk factors, was recruited for a multimodal imaging investigation that included DTI and [C-11]Pittsburgh Compound B (PiB) positron emission tomography (PET). Participants were grouped as amyloid positive (Aβ+), amyloid indeterminate (Aβi), or amyloid negative (Aβ-) based on the amount and pattern of amyloid deposition. Regional voxel-wise analyses of four DTI metrics, fractional anisotropy (FA), mean diffusivity (MD), axial diffusivity (Da), and radial diffusivity (Dr), were performed based on amyloid grouping. Three regions of interest (ROIs), the cingulum adjacent to the corpus callosum, hippocampal cingulum, and lateral fornix, were selected based on their involvement in the early stages of AD. Voxel-wise analysis revealed higher FA among Aβ+ compared to Aβ- in all three ROIs and in Aβi compared to Aβ- in the cingulum adjacent to the corpus callosum. Follow-up exploratory whole-brain analyses were consistent with the ROI findings, revealing multiple regions where higher FA was associated with greater amyloid. Lower fronto-lateral gray matter MD was associated with higher amyloid burden. Further investigation showed a negative correlation between MD and PiB signal, suggesting that Aβ accumulation impairs diffusion. Interestingly, these findings in a largely presymptomatic sample are in contradistinction to relationships reported in the literature in symptomatic disease stages of Mild Cognitive Impairment and AD, which usually show higher MD and lower FA. Together with analyses showing

  9. Associations between white matter microstructure and amyloid burden in preclinical Alzheimer's disease: A multimodal imaging investigation

    PubMed Central

    Racine, Annie M.; Adluru, Nagesh; Alexander, Andrew L.; Christian, Bradley T.; Okonkwo, Ozioma C.; Oh, Jennifer; Cleary, Caitlin A.; Birdsill, Alex; Hillmer, Ansel T.; Murali, Dhanabalan; Barnhart, Todd E.; Gallagher, Catherine L.; Carlsson, Cynthia M.; Rowley, Howard A.; Dowling, N. Maritza; Asthana, Sanjay; Sager, Mark A.; Bendlin, Barbara B.; Johnson, Sterling C.

    2014-01-01

    Some cognitively healthy individuals develop brain amyloid accumulation, suggestive of incipient Alzheimer's disease (AD), but the effect of amyloid on other potentially informative imaging modalities, such as Diffusion Tensor Imaging (DTI), in characterizing brain changes in preclinical AD requires further exploration. In this study, a sample (N = 139, mean age 60.6, range 46 to 71) from the Wisconsin Registry for Alzheimer's Prevention (WRAP), a cohort enriched for AD risk factors, was recruited for a multimodal imaging investigation that included DTI and [C-11]Pittsburgh Compound B (PiB) positron emission tomography (PET). Participants were grouped as amyloid positive (Aβ+), amyloid indeterminate (Aβi), or amyloid negative (Aβ−) based on the amount and pattern of amyloid deposition. Regional voxel-wise analyses of four DTI metrics, fractional anisotropy (FA), mean diffusivity (MD), axial diffusivity (Da), and radial diffusivity (Dr), were performed based on amyloid grouping. Three regions of interest (ROIs), the cingulum adjacent to the corpus callosum, hippocampal cingulum, and lateral fornix, were selected based on their involvement in the early stages of AD. Voxel-wise analysis revealed higher FA among Aβ+ compared to Aβ− in all three ROIs and in Aβi compared to Aβ− in the cingulum adjacent to the corpus callosum. Follow-up exploratory whole-brain analyses were consistent with the ROI findings, revealing multiple regions where higher FA was associated with greater amyloid. Lower fronto-lateral gray matter MD was associated with higher amyloid burden. Further investigation showed a negative correlation between MD and PiB signal, suggesting that Aβ accumulation impairs diffusion. Interestingly, these findings in a largely presymptomatic sample are in contradistinction to relationships reported in the literature in symptomatic disease stages of Mild Cognitive Impairment and AD, which usually show higher MD and lower FA. Together with analyses

  10. Improving supervised classification accuracy using non-rigid multimodal image registration: detecting prostate cancer

    NASA Astrophysics Data System (ADS)

    Chappelow, Jonathan; Viswanath, Satish; Monaco, James; Rosen, Mark; Tomaszewski, John; Feldman, Michael; Madabhushi, Anant

    2008-03-01

    Computer-aided diagnosis (CAD) systems for the detection of cancer in medical images require precise labeling of training data. For magnetic resonance (MR) imaging (MRI) of the prostate, training labels define the spatial extent of prostate cancer (CaP); the most common source for these labels is expert segmentations. When ancillary data such as whole mount histology (WMH) sections, which provide the gold standard for cancer ground truth, are available, the manual labeling of CaP can be improved by referencing WMH. However, manual segmentation is error prone, time consuming and not reproducible. Therefore, we present the use of multimodal image registration to automatically and accurately transcribe CaP from histology onto MRI following alignment of the two modalities, in order to improve the quality of training data and hence classifier performance. We quantitatively demonstrate the superiority of this registration-based methodology by comparing its results to the manual CaP annotation of expert radiologists. Five supervised CAD classifiers were trained using the labels for CaP extent on MRI obtained by the expert and 4 different registration techniques. Two of the registration methods were affi;ne schemes; one based on maximization of mutual information (MI) and the other method that we previously developed, Combined Feature Ensemble Mutual Information (COFEMI), which incorporates high-order statistical features for robust multimodal registration. Two non-rigid schemes were obtained by succeeding the two affine registration methods with an elastic deformation step using thin-plate splines (TPS). In the absence of definitive ground truth for CaP extent on MRI, classifier accuracy was evaluated against 7 ground truth surrogates obtained by different combinations of the expert and registration segmentations. For 26 multimodal MRI-WMH image pairs, all four registration methods produced a higher area under the receiver operating characteristic curve compared to that

  11. Visible-light optical coherence tomography-based multimodal retinal imaging for improvement of fluorescent intensity quantification

    PubMed Central

    Nafar, Zahra; Jiang, Minshan; Wen, Rong; Jiao, Shuliang

    2016-01-01

    We developed a spectral-domain visible-light optical coherence tomography (VIS-OCT) based multimodal imaging technique which can accomplish simultaneous OCT and fluorescence imaging with a single broadband light source. Phantom experiments showed that by using the simultaneously acquired OCT images as a reference, the effect of light attenuation on the intensity of the fluorescent images by materials in front of the fluorescent target can be compensated. This capability of the multimodal imaging technique is of high importance for achieving quantification of the true intensities of autofluorescence (AF) imaging of the retina. We applied the technique in retinal imaging including AF imaging of the retinal pigment epithelium and fluorescein angiography (FA). We successfully demonstrated the effect of compensation on AF and FA images with the simultaneously acquired VIS-OCT images. PMID:27699094

  12. Imaging horse tendons using multimodal 2-photon microscopy.

    PubMed

    Sivaguru, Mayandi; Eichorst, John Paul; Durgam, Sushmitha; Fried, Glenn A; Stewart, Allison A; Stewart, Matthew C

    2014-03-15

    Injuries and damage to tendons plague both human and equine athletes. At the site of injuries, various cells congregate to repair and re-structure the collagen. Treatments for collagen injury range from simple procedures such as icing and pharmaceutical treatments to more complex surgeries and the implantation of stem cells. Regardless of the treatment, the level of mechanical stimulation incurred by the recovering tendon is crucial. However, for a given tendon injury, it is not known precisely how much of a load should be applied for an effective recovery. Both too much and too little loading of the tendon could be detrimental during recovery. A mapping of the complex local environment imparted to any cell present at the site of a tendon injury may however, convey fundamental insights related to their decision making as a function of applied load. Therefore, fundamentally knowing how cells translate mechanical cues from their external environment into signals regulating their functions during repair is crucial to more effectively treat these types of injuries. In this paper, we studied systems of tendons with a variety of 2-photon-based imaging techniques to examine the local mechanical environment of cells in both normal and injured tendons. These tendons were chemically treated to instigate various extents of injury and in some cases, were injected with stem cells. The results related by each imaging technique distinguish with high contrast and resolution multiple morphologies of the cells' nuclei and the alignment of the collagen during injury. The incorporation of 2-photon FLIM into this study probed new features in the local environment of the nuclei that were not apparent with steady-state imaging. Overall, this paper focuses on horse tendon injury pattern and analysis with different 2-photon confocal modalities useful for wide variety of application in damaged tissues. Copyright © 2013 Elsevier Inc. All rights reserved.

  13. A graph-based approach for the retrieval of multi-modality medical images.

    PubMed

    Kumar, Ashnil; Kim, Jinman; Wen, Lingfeng; Fulham, Michael; Feng, Dagan

    2014-02-01

    In this paper, we address the retrieval of multi-modality medical volumes, which consist of two different imaging modalities, acquired sequentially, from the same scanner. One such example, positron emission tomography and computed tomography (PET-CT), provides physicians with complementary functional and anatomical features as well as spatial relationships and has led to improved cancer diagnosis, localisation, and staging. The challenge of multi-modality volume retrieval for cancer patients lies in representing the complementary geometric and topologic attributes between tumours and organs. These attributes and relationships, which are used for tumour staging and classification, can be formulated as a graph. It has been demonstrated that graph-based methods have high accuracy for retrieval by spatial similarity. However, naïvely representing all relationships on a complete graph obscures the structure of the tumour-anatomy relationships. We propose a new graph structure derived from complete graphs that structurally constrains the edges connected to tumour vertices based upon the spatial proximity of tumours and organs. This enables retrieval on the basis of tumour localisation. We also present a similarity matching algorithm that accounts for different feature sets for graph elements from different imaging modalities. Our method emphasises the relationships between a tumour and related organs, while still modelling patient-specific anatomical variations. Constraining tumours to related anatomical structures improves the discrimination potential of graphs, making it easier to retrieve similar images based on tumour location. We evaluated our retrieval methodology on a dataset of clinical PET-CT volumes. Our results showed that our method enabled the retrieval of multi-modality images using spatial features. Our graph-based retrieval algorithm achieved a higher precision than several other retrieval techniques: gray-level histograms as well as state

  14. Imaging findings of Kaposiform Hemangioendothelioma in children.

    PubMed

    Ryu, Young Jin; Choi, Young Hun; Cheon, Jung-Eun; Kim, Woo Sun; Kim, In-One; Park, Ji Eun; Kim, Yu Jin

    2017-01-01

    Kaposiform hemangioendothelioma (KHE) is a rare, aggressive vascular tumor that typically occurs during infancy or early childhood. Though several case reports have discussed the imaging findings of KHE, larger comprehensive studies are lacking. The purpose of this study was to evaluate the imaging findings of KHE in children. A total of twelve cases of pathologically proven KHE were collected by searching our institution's pathology database for children diagnosed between January 2004 and April 2016 (6 male, 6 female; median age: 3 months; age range 7days - 18 years). CT (n=7) and MRI (n=9) findings were retrospectively evaluated. The location, morphology, enhancement, and growth pattern were analyzed. KHEs involved various locations: superficial or deep soft tissue of the extremities (n=4); abdomen (n=3; 2 cases, pancreas; 1 case, small bowel), neck and mediastinum (n=1); chest wall, diaphragm, and pericardium (n=1); abdominal wall (n=1); and head (IAC, CP angle) (n=2). Eight of 10 cases (80%) with CT/MR findings were locally invasive and involved two or more adjacent organs. Three cases presented as well-defined solid masses, and seven were associated with infiltrative lesions of the surrounding areas with (n=4) or without definite solid regions (n=3). In nine patients with MRI, all KHEs were heterogeneous and hyperintense to muscles on T2-weighted images (T2WI), while four KHEs consisted of some regions that were nearly isointense to muscle. Eight of the 10 cases with imaging exhibited heterogeneous intense enhancement, while only one demonstrated mild enhancement. Signal voids (n=2), engorged vessels (n=1), calcification (n=3), hemorrhage (n=1), or bone changes (n=4) were infrequently observed. Four patients (33%) had Kasabach-Merritt phenomenon, and recurrence was observed in two cases. KHEs occurred in various locations, affected mostly infants, and generally exhibited intense heterogeneous enhancement. In more than half of the included cases, KHEs were

  15. Electricity and Magnetism: Insights into the brain from multimodal imaging.

    PubMed

    Cohen, M S

    2009-11-01

    The windows into brain function given us by the instruments of neuroimaging each are murky and their view is limited. Simultaneous collection of data from multiple modalities offers the potential to overcome the weaknesses of any tool alone. We argue that the combination of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) offers observations - and hypothesis testing - not possible using either single instrument. Because of their safety profiles and their non-invasive natures, EEG fMRI are among the best available devices for the study of human brain. These methods are complementary. EEG is fast, operating in a time domain comparable to single unit activity, but its localizing power is poor and the field of view is limited. While fMRI has the highest spatial resolution of any noninvasive imaging method and can reveal multiple centers of brain activity implicated in cognitive tasks, it is very slow compared to mental activity and is a poor choice for studying rapidly evolving processes. Here, we address theoretical models of the coupling between EEG and fMRI signals based on cellular physiology and energetics and argue that both tools observe principally synaptic activity. We discuss the technical problems of mutual interference then present several models of brain rhythms for which the joint EEG and fMRI observations provide significant evidence.

  16. Polarization sensitive spectroscopic optical coherence tomography for multimodal imaging

    NASA Astrophysics Data System (ADS)

    Strąkowski, Marcin R.; Kraszewski, Maciej; Strąkowska, Paulina; Trojanowski, Michał

    2015-03-01

    Optical coherence tomography (OCT) is a non-invasive method for 3D and cross-sectional imaging of biological and non-biological objects. The OCT measurements are provided in non-contact and absolutely safe way for the tested sample. Nowadays, the OCT is widely applied in medical diagnosis especially in ophthalmology, as well as dermatology, oncology and many more. Despite of great progress in OCT measurements there are still a vast number of issues like tissue recognition or imaging contrast enhancement that have not been solved yet. Here we are going to present the polarization sensitive spectroscopic OCT system (PS-SOCT). The PS-SOCT combines the polarization sensitive analysis with time-frequency analysis. Unlike standard polarization sensitive OCT the PS-SOCT delivers spectral information about measured quantities e.g. tested object birefringence changes over the light spectra. This solution overcomes the limits of polarization sensitive analysis applied in standard PS-OCT. Based on spectral data obtained from PS-SOCT the exact value of birefringence can be calculated even for the objects that provide higher order of retardation. In this contribution the benefits of using the combination of time-frequency and polarization sensitive analysis are being expressed. Moreover, the PS-SOCT system features, as well as OCT measurement examples are presented.

  17. Observation of Geometric Parametric Instability Induced by the Periodic Spatial Self-Imaging of Multimode Waves

    NASA Astrophysics Data System (ADS)

    Krupa, Katarzyna; Tonello, Alessandro; Barthélémy, Alain; Couderc, Vincent; Shalaby, Badr Mohamed; Bendahmane, Abdelkrim; Millot, Guy; Wabnitz, Stefan

    2016-05-01

    Spatiotemporal mode coupling in highly multimode physical systems permits new routes for exploring complex instabilities and forming coherent wave structures. We present here the first experimental demonstration of multiple geometric parametric instability sidebands, generated in the frequency domain through resonant space-time coupling, owing to the natural periodic spatial self-imaging of a multimode quasi-continuous-wave beam in a standard graded-index multimode fiber. The input beam was launched in the fiber by means of an amplified microchip laser emitting sub-ns pulses at 1064 nm. The experimentally observed frequency spacing among sidebands agrees well with analytical predictions and numerical simulations. The first-order peaks are located at the considerably large detuning of 123.5 THz from the pump. These results open the remarkable possibility to convert a near-infrared laser directly into a broad spectral range spanning visible and infrared wavelengths, by means of a single resonant parametric nonlinear effect occurring in the normal dispersion regime. As further evidence of our strong space-time coupling regime, we observed the striking effect that all of the different sideband peaks were carried by a well-defined and stable bell-shaped spatial profile.

  18. Predicting brain-age from multimodal imaging data captures cognitive impairment.

    PubMed

    Liem, Franziskus; Varoquaux, Gaël; Kynast, Jana; Beyer, Frauke; Kharabian Masouleh, Shahrzad; Huntenburg, Julia M; Lampe, Leonie; Rahim, Mehdi; Abraham, Alexandre; Craddock, R Cameron; Riedel-Heller, Steffi; Luck, Tobias; Loeffler, Markus; Schroeter, Matthias L; Witte, Anja Veronica; Villringer, Arno; Margulies, Daniel S

    2017-03-01

    The disparity between the chronological age of an individual and their brain-age measured based on biological information has the potential to offer clinically relevant biomarkers of neurological syndromes that emerge late in the lifespan. While prior brain-age prediction studies have relied exclusively on either structural or functional brain data, here we investigate how multimodal brain-imaging data improves age prediction. Using cortical anatomy and whole-brain functional connectivity on a large adult lifespan sample (N=2354, age 19-82), we found that multimodal data improves brain-based age prediction, resulting in a mean absolute prediction error of 4.29 years. Furthermore, we found that the discrepancy between predicted age and chronological age captures cognitive impairment. Importantly, the brain-age measure was robust to confounding effects: head motion did not drive brain-based age prediction and our models generalized reasonably to an independent dataset acquired at a different site (N=475). Generalization performance was increased by training models on a larger and more heterogeneous dataset. The robustness of multimodal brain-age prediction to confounds, generalizability across sites, and sensitivity to clinically-relevant impairments, suggests promising future application to the early prediction of neurocognitive disorders.

  19. Investigating the photosensitizer-potential of targeted gallium corrole using multimode optical imaging

    NASA Astrophysics Data System (ADS)

    Hwang, Jae Youn; Lubow, Jay; Chu, David; Gross, Zeev; Gray, Harry B.; Farkas, Daniel L.; Medina-Kauwe, Lali K.

    2011-02-01

    We recently developed a novel therapeutic particle, HerGa, for breast cancer treatment and detection. HerGa consists of a tumor-targeted cell penetration protein noncovalently assembled with a gallium-metallated corrole. The corrole is structurally similar to porphyrin, emits intense fluorescence, and has proven highly effective for breast tumor treatment preclinically, without light exposure. Here, we tested HerGa as a photosensitizer for photodynamic therapy and investigated its mechanism of action using multimode optical imaging. Using confocal fluorescence imaging, we observed that HerGa disrupts the mitochondrial membrane potential in situ, and this disruption is substantially augmented by light exposure. In addition, spectral and fluorescence lifetime imaging were utilized to both validate the mitochondrial membrane potential disruption and investigate HerGa internalization, allowing us to optimize the timing for light dosimetry. We observed, using advanced multimode optical imaging, that light at a specific wavelength promotes HerGa cytotoxicity, which is likely to cause disruption of mitochondrial function. Thus, we can identify for the first time the capacity of HerGa as a photosensitizer for photodynamic therapy and reveal its mechanism of action, opening possibilities for therapeutic intervention in human breast cancer management.

  20. Shape-Controlled Synthesis of Isotopic Yttrium-90-Labeled Rare Earth Fluoride Nanocrystals for Multimodal Imaging.

    PubMed

    Paik, Taejong; Chacko, Ann-Marie; Mikitsh, John L; Friedberg, Joseph S; Pryma, Daniel A; Murray, Christopher B

    2015-09-22

    Isotopically labeled nanomaterials have recently attracted much attention in biomedical research, environmental health studies, and clinical medicine because radioactive probes allow the elucidation of in vitro and in vivo cellular transport mechanisms, as well as the unambiguous distribution and localization of nanomaterials in vivo. In addition, nanocrystal-based inorganic materials have a unique capability of customizing size, shape, and composition; with the potential to be designed as multimodal imaging probes. Size and shape of nanocrystals can directly influence interactions with biological systems, hence it is important to develop synthetic methods to design radiolabeled nanocrystals with precise control of size and shape. Here, we report size- and shape-controlled synthesis of rare earth fluoride nanocrystals doped with the β-emitting radioisotope yttrium-90 ((90)Y). Size and shape of nanocrystals are tailored via tight control of reaction parameters and the type of rare earth hosts (e.g., Gd or Y) employed. Radiolabeled nanocrystals are synthesized in high radiochemical yield and purity as well as excellent radiolabel stability in the face of surface modification with different polymeric ligands. We demonstrate the Cerenkov radioluminescence imaging and magnetic resonance imaging capabilities of (90)Y-doped GdF3 nanoplates, which offer unique opportunities as a promising platform for multimodal imaging and targeted therapy.

  1. Large Margin Multi-Modal Multi-Task Feature Extraction for Image Classification.

    PubMed

    Yong Luo; Yonggang Wen; Dacheng Tao; Jie Gui; Chao Xu

    2016-01-01

    The features used in many image analysis-based applications are frequently of very high dimension. Feature extraction offers several advantages in high-dimensional cases, and many recent studies have used multi-task feature extraction approaches, which often outperform single-task feature extraction approaches. However, most of these methods are limited in that they only consider data represented by a single type of feature, even though features usually represent images from multiple modalities. We, therefore, propose a novel large margin multi-modal multi-task feature extraction (LM3FE) framework for handling multi-modal features for image classification. In particular, LM3FE simultaneously learns the feature extraction matrix for each modality and the modality combination coefficients. In this way, LM3FE not only handles correlated and noisy features, but also utilizes the complementarity of different modalities to further help reduce feature redundancy in each modality. The large margin principle employed also helps to extract strongly predictive features, so that they are more suitable for prediction (e.g., classification). An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging real-world image data sets demonstrate the effectiveness and superiority of the proposed method.

  2. A practical salient region feature based 3D multi-modality registration method for medical images

    NASA Astrophysics Data System (ADS)

    Hahn, Dieter A.; Wolz, Gabriele; Sun, Yiyong; Hornegger, Joachim; Sauer, Frank; Kuwert, Torsten; Xu, Chenyang

    2006-03-01

    We present a novel representation of 3D salient region features and its integration into a hybrid rigid-body registration framework. We adopt scale, translation and rotation invariance properties of those intrinsic 3D features to estimate a transform between underlying mono- or multi-modal 3D medical images. Our method combines advantageous aspects of both feature- and intensity-based approaches and consists of three steps: an automatic extraction of a set of 3D salient region features on each image, a robust estimation of correspondences and their sub-pixel accurate refinement with outliers elimination. We propose a region-growing based approach for the extraction of 3D salient region features, a solution to the problem of feature clustering and a reduction of the correspondence search space complexity. Results of the developed algorithm are presented for both mono- and multi-modal intra-patient 3D image pairs (CT, PET and SPECT) that have been acquired for change detection, tumor localization, and time based intra-person studies. The accuracy of the method is clinically evaluated by a medical expert with an approach that measures the distance between a set of selected corresponding points consisting of both anatomical and functional structures or lesion sites. This demonstrates the robustness of the proposed method to image overlap, missing information and artefacts. We conclude by discussing potential medical applications and possibilities for integration into a non-rigid registration framework.

  3. Transferring biomarker into molecular probe: Melanin nanoparticle as a naturally active platform for multimodality imaging

    DOE PAGES

    Fan, Quli; Cheng, Kai; Hu, Xiang; ...

    2014-10-07

    Developing multifunctional and easily prepared nanoplatforms with integrated different modalities is highly challenging for molecular imaging. Here, we report the successful transfer of an important molecular target, melanin, into a novel multimodality imaging nanoplatform. Melanin is abundantly expressed in melanotic melanomas and thus has been actively studied as a target for melanoma imaging. In our work, the multifunctional biopolymer nanoplatform based on ultrasmall (<10 nm) water-soluble melanin nanoparticle (MNP) was developed and showed unique photoacoustic property and natural binding ability with metal ions (for example, 64Cu2+, Fe3+). Therefore, MNP can serve not only as a photoacoustic contrast agent, but alsomore » as a nanoplatform for positron emission tomography (PET) and magnetic resonance imaging (MRI). Traditional passive nanoplatforms require complicated and time-consuming processes for prebuilding reporting moieties or chemical modifications using active groups to integrate different contrast properties into one entity. In comparison, utilizing functional biomarker melanin can greatly simplify the building process. We further conjugated αvβ3 integrins, cyclic c(RGDfC) peptide, to MNPs to allow for U87MG tumor accumulation due to its targeting property combined with the enhanced permeability and retention (EPR) effect. As a result, the multimodal properties of MNPs demonstrate the high potential of endogenous materials with multifunctions as nanoplatforms for molecular theranostics and clinical translation.« less

  4. Relaxometric property of organosilica nanoparticles internally functionalized with iron oxide and fluorescent dye for multimodal imaging.

    PubMed

    Nakamura, Michihiro; Hayashi, Koichiro; Kubo, Hitoshi; Kanadani, Takafumi; Harada, Masafumi; Yogo, Toshinobu

    2017-04-15

    Multimodal imaging using novel multifunctional nanoparticles provides a new approach for the biomedical field. Thiol-organosilica nanoparticles containing iron oxide magnetic nanoparticles (MNPs) as the core and rhodamine B in the thiol-organosilica layer (thiol OS-MNP/Rho) were synthesized in a one-pot process. The thiol OS-MNP/Rho showed enhanced magnetic resonance imaging (MRI) contrast and high fluorescence intensity. The relaxometry of thiol OS-MNP/Rho revealed a novel coating effect of the organosilica layer to the MNPs. The organosilica layer shortened the T2 relaxation time but not the T1 relaxation time of the MNPs. We injected thiol-OS-MNP/Rho into normal mice intravenously. Injected mice revealed an alteration of the liver contrast in the MRI and a fluorescent pattern based on the liver histological structure at the level between macroscopic and microscopic fluorescent imaging (mesoscopic FI). In addition, the labeled macrophages were observed at the single cell level histologically. We demonstrated a new approach to evaluate the liver at the macroscopic, microscopic level as well as the mesoscopic level using multimodal imaging.

  5. Multi-modal automatic montaging of adaptive optics retinal images.

    PubMed

    Chen, Min; Cooper, Robert F; Han, Grace K; Gee, James; Brainard, David H; Morgan, Jessica I W

    2016-12-01

    We present a fully automated adaptive optics (AO) retinal image montaging algorithm using classic scale invariant feature transform with random sample consensus for outlier removal. Our approach is capable of using information from multiple AO modalities (confocal, split detection, and dark field) and can accurately detect discontinuities in the montage. The algorithm output is compared to manual montaging by evaluating the similarity of the overlapping regions after montaging, and calculating the detection rate of discontinuities in the montage. Our results show that the proposed algorithm has high alignment accuracy and a discontinuity detection rate that is comparable (and often superior) to manual montaging. In addition, we analyze and show the benefits of using multiple modalities in the montaging process. We provide the algorithm presented in this paper as open-source and freely available to download.

  6. Multi-modal automatic montaging of adaptive optics retinal images

    PubMed Central

    Chen, Min; Cooper, Robert F.; Han, Grace K.; Gee, James; Brainard, David H.; Morgan, Jessica I. W.

    2016-01-01

    We present a fully automated adaptive optics (AO) retinal image montaging algorithm using classic scale invariant feature transform with random sample consensus for outlier removal. Our approach is capable of using information from multiple AO modalities (confocal, split detection, and dark field) and can accurately detect discontinuities in the montage. The algorithm output is compared to manual montaging by evaluating the similarity of the overlapping regions after montaging, and calculating the detection rate of discontinuities in the montage. Our results show that the proposed algorithm has high alignment accuracy and a discontinuity detection rate that is comparable (and often superior) to manual montaging. In addition, we analyze and show the benefits of using multiple modalities in the montaging process. We provide the algorithm presented in this paper as open-source and freely available to download. PMID:28018714

  7. Multimodal Ultrawide-Field Imaging Features in Waardenburg Syndrome.

    PubMed

    Choudhry, Netan; Rao, Rajesh C

    2015-06-01

    A 45-year-old woman was referred for bilateral irregular fundus pigmentation. Dilated fundus examination revealed irregular hypopigmentation posterior to the equator in both eyes, confirmed by fundus autofluorescence. A thickened choroid was seen on enhanced-depth imaging spectral-domain optical coherence tomography (EDI SD-OCT). Systemic evaluation revealed sensorineural deafness, telecanthus, and a white forelock. Further investigation revealed a first-degree relative with Waardenburg syndrome. Waardenburg syndrome is characterized by a group of features including telecanthus, a broad nasal root, synophrys of the eyebrows, piedbaldism, heterochromia irides, and deafness. Choroidal hypopigmentation is a unique feature that can be visualized with ultrawide-field fundus autofluorescence. The choroid may also be thickened and its thickness measured with EDI SD-OCT.

  8. Autoimmune pancreatitis: Multimodality non-invasive imaging diagnosis

    PubMed Central

    Crosara, Stefano; D'Onofrio, Mirko; De Robertis, Riccardo; Demozzi, Emanuele; Canestrini, Stefano; Zamboni, Giulia; Pozzi Mucelli, Roberto

    2014-01-01

    Autoimmune pancreatitis (AIP) is characterized by obstructive jaundice, a dramatic clinical response to steroids and pathologically by a lymphoplasmacytic infiltrate, with or without a pancreatic mass. Type 1 AIP is the pancreatic manifestation of an IgG4-related systemic disease and is characterized by elevated IgG4 serum levels, infiltration of IgG4-positive plasma cells and extrapancreatic lesions. Type 2 AIP usually has none or very few IgG4-positive plasma cells, no serum IgG4 elevation and appears to be a pancreas-specific disorder without extrapancreatic involvement. AIP is diagnosed in approximately 2%-6% of patients that undergo pancreatic resection for suspected pancreatic cancer. There are three patterns of autoimmune pancreatitis: diffuse disease is the most common type, with a diffuse, “sausage-like” pancreatic enlargement with sharp margins and loss of the lobular contours; focal disease is less common and manifests as a focal mass, often within the pancreatic head, mimicking a pancreatic malignancy. Multifocal involvement can also occur. In this paper we describe the features of AIP at ultrasonography, computed tomography, magnetic resonance and positron emission tomography/computed tomography imaging, focusing on diagnosis and differential diagnosis with pancreatic ductal adenocarcinoma. It is of utmost importance to make an early correct differential diagnosis between these two diseases in order to identify the optimal therapeutic strategy and to avoid unnecessary laparotomy or pancreatic resection in AIP patients. Non-invasive imaging plays also an important role in therapy monitoring, in follow-up and in early identification of disease recurrence. PMID:25493001

  9. Investigating photoexcitation-induced mitochondrial damage by chemotherapeutic corroles using multimode optical imaging

    NASA Astrophysics Data System (ADS)

    Hwang, Jae Youn; Lubow, David J.; Sims, Jessica D.; Gray, Harry B.; Mahammed, Atif; Gross, Zeev; Medina-Kauwe, Lali K.; Farkas, Daniel L.

    2012-01-01

    We recently reported that a targeted, brightly fluorescent gallium corrole (HerGa) is highly effective for breast tumor detection and treatment. Unlike structurally similar porphryins, HerGa exhibits tumor-targeted toxicity without the need for photoexcitation. We have now examined whether photoexcitation further modulates HerGa toxicity, using multimode optical imaging of live cells, including two-photon excited fluorescence, differential interference contrast (DIC), spectral, and lifetime imaging. Using two-photon excited fluorescence imaging, we observed that light at specific wavelengths augments the HerGa-mediated mitochondrial membrane potential disruption of breast cancer cells in situ. In addition, DIC, spectral, and fluorescence lifetime imaging enabled us to both validate cell damage by HerGa photoexcitation and investigate HerGa internalization, thus allowing optimization of light dose and timing. Our demonstration of HerGa phototoxicity opens the way for development of new methods of cancer intervention using tumor-targeted corroles.

  10. Long circulating reduced graphene oxide-iron oxide nanoparticles for efficient tumor targeting and multimodality imaging.

    PubMed

    Xu, Cheng; Shi, Sixiang; Feng, Liangzhu; Chen, Feng; Graves, Stephen A; Ehlerding, Emily B; Goel, Shreya; Sun, Haiyan; England, Christopher G; Nickles, Robert J; Liu, Zhuang; Wang, Taihong; Cai, Weibo

    2016-07-07

    Polyethylene glycol (PEG) surface modification is one of the most widely used approaches to improve the solubility of inorganic nanoparticles, prevent their aggregation and prolong their in vivo blood circulation half-life. Herein, we developed double-PEGylated biocompatible reduced graphene oxide nanosheets anchored with iron oxide nanoparticles (RGO-IONP-(1st)PEG-(2nd)PEG). The nanoconjugates exhibited a prolonged blood circulation half-life (∼27.7 h) and remarkable tumor accumulation (>11 %ID g(-1)) via an enhanced permeability and retention (EPR) effect. Due to the strong near-infrared absorbance and superparamagnetism of RGO-IONP-(1st)PEG-(2nd)PEG, multimodality imaging combining positron emission tomography (PET) imaging with magnetic resonance imaging (MRI) and photoacoustic (PA) imaging was successfully achieved. The promising results suggest the great potential of these nanoconjugates for multi-dimensional and more accurate tumor diagnosis and therapy in the future.

  11. Delivery of picosecond lasers in multimode fibers for coherent anti-Stokes Raman scattering imaging.

    PubMed

    Wang, Zhiyong; Yang, Yaliang; Luo, Pengfei; Gao, Liang; Wong, Kelvin K; Wong, Stephen T C

    2010-06-07

    We investigated the possibility of using standard commercial multimode fibers (MMF), Corning SMF28 fibers, to deliver picosecond excitation lasers for coherent anti-Stokes Raman scattering (CARS) imaging. We theoretically and/or experimentally analyzed issues associated with the fiber delivery, such as dispersion length, walk-off length, nonlinear length, average threshold power for self-phase modulations, and four-wave mixing (FWM). These analyses can also be applied to other types of fibers. We found that FWM signals are generated in MMF, but they can be filtered out using a long-pass filter for CARS imaging. Finally, we demonstrated that MMF can be used for delivery of picosecond excitation lasers in the CARS imaging system without any degradation of image quality.

  12. Long circulating reduced graphene oxide-iron oxide nanoparticles for efficient tumor targeting and multimodality imaging

    NASA Astrophysics Data System (ADS)

    Xu, Cheng; Shi, Sixiang; Feng, Liangzhu; Chen, Feng; Graves, Stephen A.; Ehlerding, Emily B.; Goel, Shreya; Sun, Haiyan; England, Christopher G.; Nickles, Robert J.; Liu, Zhuang; Wang, Taihong; Cai, Weibo

    2016-06-01

    Polyethylene glycol (PEG) surface modification is one of the most widely used approaches to improve the solubility of inorganic nanoparticles, prevent their aggregation and prolong their in vivo blood circulation half-life. Herein, we developed double-PEGylated biocompatible reduced graphene oxide nanosheets anchored with iron oxide nanoparticles (RGO-IONP-1stPEG-2ndPEG). The nanoconjugates exhibited a prolonged blood circulation half-life (~27.7 h) and remarkable tumor accumulation (>11 %ID g-1) via an enhanced permeability and retention (EPR) effect. Due to the strong near-infrared absorbance and superparamagnetism of RGO-IONP-1stPEG-2ndPEG, multimodality imaging combining positron emission tomography (PET) imaging with magnetic resonance imaging (MRI) and photoacoustic (PA) imaging was successfully achieved. The promising results suggest the great potential of these nanoconjugates for multi-dimensional and more accurate tumor diagnosis and therapy in the future.

  13. Gallbladder metastasis: spectrum of imaging findings.

    PubMed

    Barretta, Maria Luisa; Catalano, Orlando; Setola, Sergio Venanzio; Granata, Vincenza; Marone, Ugo; D'Errico Gallipoli, Adolfo

    2011-12-01

    The objective of this study is to report the diagnostic features of hematogenous gallbladder metastasis using various imaging modalities. We carried out a single-center retrospective analysis of 13 patients with gallbladder metastasis. The primary malignancy was cutaneous melanoma (11 cases), hepatocellular carcinoma (1 case), and non-Hodgkin lymphoma (1 case). All patients underwent sonography (US), with color-power-Doppler assessment in 11 cases. Contrast-enhanced US (CEUS) was performed in 8 patients, MDCT in 8, and MR imaging in 1. Four subjects studied by whole-body PET. The gallbladder lesions were first detected with US in 9 cases and with MDCT in 3 cases. The remaining patient was investigated because of hepatic fluorodeoxyglucose uptake at PET; CEUS failed to detect any liver metastasis in this subject but identified a gallbladder lesion. Typical findings included multiplicity of gallbladder vegetations, broad base, limited mural thickening, presence of contrast enhancement, absence of gallstones and gallbladder bed infiltration, presence of combined lesions within other organs. Only two patients presented an isolated location in the gallbladder and were successfully treated with surgery. Gallbladder metastasis is a rare but possible occurrence. Knowledge of the typical imaging features and careful evaluation of the gallbladder may avoid an incorrect or false negative diagnosis.

  14. Image Findings in Brain Developmental Venous Anomalies

    PubMed Central

    Lee, Mong

    2012-01-01

    Objective Developmental venous anomalies (DVAs) are benign anatomic variations; therefore, they are usually discovered incidentally. The aim of this article was to describe radiological findings of DVAs. Methods A retrospective search for DVAs of the brain was performed in 1899 patients who had undergone magnetic resonance imaging (MRI) with contrast enhancement between January 1, 2005 and April 25, 2011. We also reviewed the results of computed tomography (CT), magnetic resonance angiography (MRA), CT angiography, and transfemoral cerebral angiography (TFCA) studies performed in patients with DVAs. Results Thirty-two DVAs were identified in 31 of the 1899 patients (1.63%). These 31 patients underwent five enhanced CTs, three MRAs, two CT angiographies, and two TFCAs. Thirty of the 32 DVAs were supratentorial (ST) and two were infratentorial (IT). All enhanced MRI studies exhibited excellent resolution of DVAs. All DVAs had only one draining vein. The venous drainage system was an IT vein in three DVAs and an ST vein in 29 DVAs. Two out of five enhanced CTs presented good visualization of the draining vein. None of the MRAs, including the source image, revealed the presence of DVAs. The two CT angiographies exhibited good resolution of DVAs. One of the two TFCAs yielded an excellent illustration of the DVA. Conclusion CT angiography and MRI with contrast enhancement yielded detailed findings of DVAs. In contrast, MRA did not identify the DVAs. Enhanced CT presented only the draining vein of DVAs. PMID:23210028

  15. Geometrical accuracy and fusion of multimodal vascular images: a phantom study.

    PubMed

    Boussion, Nicolas; Soulez, Gilles; De Guise, Jacques A; Daronat, Michel; Qin, Zhao; Cloutier, Guy

    2004-06-01

    The aim of this work was to compare the geometrical accuracy of x-ray angiography, magnetic resonance imaging (MRI), x-ray computed tomography (XCT), and ultrasound imaging (B-mode and IVUS, or intravascular ultrasound) for measuring the lumen diameters of blood vessels. An image fusion method was also developed to improve these measurements. The images were acquired from a phantom that mimic vessels of known diameters. After acquisition, the multimodal images were coregistered by manual alignment of fiducial markers, and then by maximization of mutual information. The fusion method was performed by means of a fuzzy logic modeling approach followed by a combination process based on a possibilistic theory. The results showed (i) the better geometrical accuracy of XCT and IVUS compared to the other modalities, and (ii) the better accuracy and smaller variability of fused images compared to single modalities, with respect to most diameters investigated. For XCT, the error varied from 0.4% to 5.4%, depending on the vessel diameter that ranged from 0.93 to 6.24 mm. For IVUS, the error ranged from -0.3% to 1.7% but the smallest vessel (0.93 mm) could not be investigated because of the probe size. Compared to others fusion schemes, the XCT-MRI fused images provided the best results for both accuracy (from -1.6% to 0.2% for the three largest vessels) and robustness (mean relative error of 1.9%). To conclude, this work underlined both the usefulness of the multimodality vascular phantom as a validation tool and the utility of image fusion in the vascular context.

  16. Multimodal imaging of ocular surface of dry eye subjects

    NASA Astrophysics Data System (ADS)

    Zhang, Aizhong; Salahura, Gheorghe; Kottaiyan, Ranjini; Yoon, Geunyoung; Aquavella, James V.; Zavislan, James M.

    2016-03-01

    To study the relationship between the corneal lipid layer and the ocular surface temperature (OST), we conducted a clinical trial for 20 subjects. Subjects were clinically screened prior to the trial. Of the 20 subjects, 15 have Meibomian gland dysfunction (MGD), and 5 have aqueous-deficient dry eye (ADDE). A custom, circularly polarized illumination video tearscope measured the lipid layer thickness of the ocular tear film. A long-wave infrared video camera recorded the dynamic thermal properties of the ocular team film. The results of these two methods were analyzed and compared. Using principal component analysis (PCA) of the lipid layer distribution, we find that the 20 subjects could be categorized into five statistically significant groups, independent of their original clinical classification: thin (6 subjects), medium (5 subjects), medium and homogenous (3 subjects), thick (4 subjects), and very thick (2 subjects) lipids, respectively. We also conducted PCA of the OST data, and recategorized the subjects into two thermal groups by k-means clustering: one includes all ADDE subjects and some MGD subjects; the other includes the remaining MGD subjects. By comparing these two methods, we find that dry eye subjects with thin (<= 40 nm) lipids have significantly lower OST, and a larger OST drop range, potentially due to more evaporation. However, as long as the lipid layer is not thin (> 40 nm), there is no strong correlation between the lipid layer thickness and heterogeneity and the OST patterns.

  17. Multimodality Imaging with Silica-Based Targeted Nanoparticle Platforms

    SciTech Connect

    Jason S. Lewis

    2012-04-09

    Objectives: To synthesize and characterize a C-Dot silica-based nanoparticle containing 'clickable' groups for the subsequent attachment of targeting moieties (e.g., peptides) and multiple contrast agents (e.g., radionuclides with high specific activity) [1,2]. These new constructs will be tested in suitable tumor models in vitro and in vivo to ensure maintenance of target-specificity and high specific activity. Methods: Cy5 dye molecules are cross-linked to a silica precursor which is reacted to form a dye-rich core particle. This core is then encapsulated in a layer of pure silica to create the core-shell C-Dot (Figure 1) [2]. A 'click' chemistry approach has been used to functionalize the silica shell with radionuclides conferring high contrast and specific activity (e.g. 64Cu and 89Zr) and peptides for tumor targeting (e.g. cRGD and octreotate) [3]. Based on the selective Diels-Alder reaction between tetrazine and norbornene, the reaction is bioorthogonal, highyielding, rapid, and water-compatible. This radiolabeling approach has already been employed successfully with both short peptides (e.g. octreotate) and antibodies (e.g. trastuzumab) as model systems for the ultimate labeling of the nanoparticles [1]. Results: PEGylated C-Dots with a Cy5 core and labeled with tetrazine have been synthesized (d = 55 nm, zeta potential = -3 mV) reliably and reproducibly and have been shown to be stable under physiological conditions for up to 1 month. Characterization of the nanoparticles revealed that the immobilized Cy5 dye within the C-Dots exhibited fluorescence intensities over twice that of the fluorophore alone. The nanoparticles were successfully radiolabeled with Cu-64. Efforts toward the conjugation of targeting peptides (e.g. cRGD) are underway. In vitro stability, specificity, and uptake studies as well as in vivo imaging and biodistribution investigations will be presented. Conclusions: C-Dot silica-based nanoparticles offer a robust, versatile, and multi

  18. CRAFT: Multimodality confocal skin imaging for early cancer diagnosis.

    PubMed

    Peng, Tong; Xie, Hao; Ding, Yichen; Wang, Weichao; Li, Zhiming; Jin, Dayong; Tang, Yuanhe; Ren, Qiushi; Xi, Peng

    2012-05-01

    Although histological analysis serves as a gold standard to cancer diagnosis, its application on skin cancer detection is largely prohibited due to its invasive nature. To obtain both the structural and pathological information in situ, a Confocal Reflectance/Auto-Fluorescence Tomography (CRAFT) system was established to examine the skin sites in vivo with both reflectance and autofluorescence modes simultaneously. Nude mice skin with cancerous sites and normal skin sites were imaged and compared with the system. The cellular density and reflective intensity in cancerous sites reflects the structural change of the tissue. With the decay coefficient analysis, the corresponding NAD(P)H decay index for cancerous sites is 1.65-fold that of normal sites, leading to a 97.8% of sensitivity and specificity for early cancer diagnosis. The results are verified by the followed histological analysis. Therefore, CRAFT may provide a novel method for the in vivo, non-invasive diagnosis of early cancer. Copyright © 2012 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

  19. Voxelwise multivariate analysis of multimodality magnetic resonance imaging

    PubMed Central

    Naylor, Melissa G.; Cardenas, Valerie A.; Tosun, Duygu; Schuff, Norbert; Weiner, Michael; Schwartzman, Armin

    2015-01-01

    Most brain magnetic resonance imaging (MRI) studies concentrate on a single MRI contrast or modality, frequently structural MRI. By performing an integrated analysis of several modalities, such as structural, perfusion-weighted, and diffusion-weighted MRI, new insights may be attained to better understand the underlying processes of brain diseases. We compare two voxelwise approaches: (1) fitting multiple univariate models, one for each outcome and then adjusting for multiple comparisons among the outcomes and (2) fitting a multivariate model. In both cases, adjustment for multiple comparisons is performed over all voxels jointly to account for the search over the brain. The multivariate model is able to account for the multiple comparisons over outcomes without assuming independence because the covariance structure between modalities is estimated. Simulations show that the multivariate approach is more powerful when the outcomes are correlated and, even when the outcomes are independent, the multivariate approach is just as powerful or more powerful when at least two outcomes are dependent on predictors in the model. However, multiple univariate regressions with Bonferroni correction remains a desirable alternative in some circumstances. To illustrate the power of each approach, we analyze a case control study of Alzheimer's disease, in which data from three MRI modalities are available. PMID:23408378

  20. Voxelwise multivariate analysis of multimodality magnetic resonance imaging.

    PubMed

    Naylor, Melissa G; Cardenas, Valerie A; Tosun, Duygu; Schuff, Norbert; Weiner, Michael; Schwartzman, Armin

    2014-03-01

    Most brain magnetic resonance imaging (MRI) studies concentrate on a single MRI contrast or modality, frequently structural MRI. By performing an integrated analysis of several modalities, such as structural, perfusion-weighted, and diffusion-weighted MRI, new insights may be attained to better understand the underlying processes of brain diseases. We compare two voxelwise approaches: (1) fitting multiple univariate models, one for each outcome and then adjusting for multiple comparisons among the outcomes and (2) fitting a multivariate model. In both cases, adjustment for multiple comparisons is performed over all voxels jointly to account for the search over the brain. The multivariate model is able to account for the multiple comparisons over outcomes without assuming independence because the covariance structure between modalities is estimated. Simulations show that the multivariate approach is more powerful when the outcomes are correlated and, even when the outcomes are independent, the multivariate approach is just as powerful or more powerful when at least two outcomes are dependent on predictors in the model. However, multiple univariate regressions with Bonferroni correction remain a desirable alternative in some circumstances. To illustrate the power of each approach, we analyze a case control study of Alzheimer's disease, in which data from three MRI modalities are available.

  1. Multi-Modal Optical Imaging of the Cerebellum in Animals.

    PubMed

    Allegra Mascaro, Anna Letizia; Sacconi, Leonardo; Silvestri, Ludovico; Knott, Graham; Pavone, Francesco S

    2015-10-17

    Thanks to their flexibility, optical techniques could be the key to explore anatomy, plasticity, and functionality of the cerebellum. As an example, an in vivo analysis of the dynamic remodeling of cerebellar axons by nonlinear microscopy can provide fundamental insights of the mechanism that promotes neuronal regeneration. Several studies showed that damaged climbing fibers are capable of regrowing also in adult animals. The investigation of the time-lapse dynamics of degeneration and regeneration of these axons within their complex environment can be performed by time-lapse two-photon fluorescence (TPF) imaging in vivo. Here, we show that single axonal branches can be dissected by laser axotomy, thus avoiding collateral damage to the adjacent dendrite and the formation of a persistent glial scar. Despite the very small denervated area, the injured axons consistently reshaped the connectivity with surrounding neurons and sprouted new branches through the intact surroundings. Correlative light and electron microscopy revealed that the sprouted branch contains large numbers of vesicles, with varicosities in the close vicinity of Purkinje dendrites. By using an RNA interference approach, we found that downregulating GAP-43 causes a significant increase in the turnover of presynaptic boutons and hampers the generation of reactive sprouts. Further, we report how nonlinear microscopy in combination with novel voltage sensitive dyes or transgenic mice allow optical registrations of action potential across a population of neurons opening promising prospective in understanding brain functionality. Finally, we describe novel implementations of light-sheet microscopy to resolve neuronal anatomy in whole cerebellum with cellular resolution. The understanding gained from these complementary optical methods may provide a deeper comprehension of the cerebellum.

  2. Multimodality imaging of a huge subaortic left ventricular aneurysm in a child.

    PubMed

    Morais, Humberto; Pedro, Albino; Reis, Maria João; Costa, João Carlos

    2017-08-22

    A subannular left ventricular aneurysm is very rare, and is mostly considered to be a congenital anomaly. A subannular left ventricular aneurysm is classified based on the type of its own orifice-submitral or subaortic. Subaortic left ventricular aneurysm occurs less frequently compared with a submitral type of subannular aneurysm. We hereby describe a rare case of a huge bilobed subaortic aneurysm, in which the orifice was located just below the left coronary cusp diagnosed with multimodality imaging in a child. © 2017, Wiley Periodicals, Inc.

  3. Continuous multi-modality brain imaging reveals modified neurovascular seizure response after intervention

    PubMed Central

    Ringuette, Dene; Jeffrey, Melanie A.; Dufour, Suzie; Carlen, Peter L.; Levi, Ofer

    2017-01-01

    We developed a multi-modal brain imaging system to investigate the relationship between blood flow, blood oxygenation/volume, intracellular calcium and electrographic activity during acute seizure-like events (SLEs), both before and after pharmacological intervention. Rising blood volume was highly specific to SLE-onset whereas blood flow was more correlated with all eletrographic activity. Intracellular calcium spiked between SLEs and at SLE-onset with oscillation during SLEs. Modified neurovascular and ionic SLE responses were observed after intervention and the interval between SLEs became shorter and more inconsistent. Comparison of artery and vein pulsatile flow suggest proximal interference and greater vascular leakage prior to intervention. PMID:28270990

  4. Multi-modal spectroscopic imaging with synchrotron light to study mechanisms of brain disease

    NASA Astrophysics Data System (ADS)

    Summers, Kelly L.; Fimognari, Nicholas; Hollings, Ashley; Kiernan, Mitchell; Lam, Virginie; Tidy, Rebecca J.; Takechi, Ryu; George, Graham N.; Pickering, Ingrid J.; Mamo, John C.; Harris, Hugh H.; Hackett, Mark J.

    2017-04-01

    The international health care costs associated with Alzheimer's disease (AD) and dementia have been predicted to reach $2 trillion USD by 2030. As such, there is urgent need to develop new treatments and diagnostic methods to stem an international health crisis. A major limitation to therapy and diagnostic development is the lack of complete understanding about the disease mechanisms. Spectroscopic methods at synchrotron light sources, such as FTIR, XRF, and XAS, offer a "multi-modal imaging platform" to reveal a wealth of important biochemical information in situ within ex vivo tissue sections, to increase our understanding of disease mechanisms.

  5. Multi-Modal Imaging with a Toolbox of Influenza A Reporter Viruses.

    PubMed

    Tran, Vy; Poole, Daniel S; Jeffery, Justin J; Sheahan, Timothy P; Creech, Donald; Yevtodiyenko, Aleksey; Peat, Andrew J; Francis, Kevin P; You, Shihyun; Mehle, Andrew

    2015-10-13

    Reporter viruses are useful probes for studying multiple stages of the viral life cycle. Here we describe an expanded toolbox of fluorescent and bioluminescent influenza A reporter viruses. The enhanced utility of these tools enabled kinetic studies of viral attachment, infection, and co-infection. Multi-modal bioluminescence and positron emission tomography-computed tomography (PET/CT) imaging of infected animals revealed that antiviral treatment reduced viral load, dissemination, and inflammation. These new technologies and applications will dramatically accelerate in vitro and in vivo influenza virus studies.

  6. Multimodality Cardiac Imaging in a Patient with Kawasaki Disease and Giant Aneurysms

    PubMed Central

    Srinivasan, Ranjini; Weller, Rachel; Einstein, Andrew J.

    2016-01-01

    Kawasaki disease is a well-known cause of acquired cardiac disease in the pediatric and adult population, most prevalent in Japan but also seen commonly in the United States. In the era of intravenous immunoglobulin (IVIG) treatment, the morbidity associated with this disease has decreased, but it remains a serious illness. Here we present the case of an adolescent, initially diagnosed with Kawasaki disease as an infant, that progressed to giant aneurysm formation and calcification of the coronary arteries. We review his case and the literature, focusing on the integral role of multimodality imaging in managing Kawasaki disease. PMID:27872783

  7. Pseudovitelliform maculopathy associated with deferoxamine toxicity: multimodal imaging and electrophysiology of a rare entity

    PubMed Central

    Bui, Kelly M.; Sadda, SriniVas R.; Salehi-Had, Hani

    2017-01-01

    Summary Deferoxamine is a commonly used chelating agent for secondary hemochromatosis. We report a rare retinal manifestation of deferoxamine toxicity in a 68-year-old man and provide supporting multimodal imaging and electrophysiology. The patient had iron overload related to transfusion-dependent myelodysplastic syndrome and developed a pseudovitelliform macular lesion related to deferoxamine toxicity. We also describe for the first time the worsening of this maculopathy on deferasirox, an alternative chelating agent. Macular pseudovitelliform lesion is a unique manifestation of deferoxamine toxicity that can be mistaken for pattern dystrophy. It is important to recognize this manifestation, because discontinuation of the offending agent may halt or reverse the toxicity. PMID:28924413

  8. Self-imaging and high-beam-quality operation in multi-mode planar waveguide optical amplifiers.

    PubMed

    Baker, Howard; Lee, Jason; Hall, Denis

    2002-03-25

    Self-imaging in a multi-mode active waveguide is examined as a method to preserve beam quality when amplifying a fundamental gaussian beam. Misalignment tolerance, gain saturation and thermal lensing effects are evaluated for the use of self-imaging in high average power, diodepumped, planar waveguide lasers.

  9. A Multimodal Imaging Protocol, (123)I/(99)Tc-Sestamibi, SPECT, and SPECT/CT, in Primary Hyperparathyroidism Adds Limited Benefit for Preoperative Localization.

    PubMed

    Lee, Grace S; McKenzie, Travis J; Mullan, Brian P; Farley, David R; Thompson, Geoffrey B; Richards, Melanie L

    2016-03-01

    Focused parathyroidectomy in primary hyperparathyroidism (1°HPT) is possible with accurate preoperative localization and intraoperative PTH monitoring (IOPTH). The added benefit of multimodal imaging techniques for operative success is unknown. Patients with 1°HPT, who underwent parathyroidectomy in 2012-2014 at a single institution, were retrospectively reviewed. Only the patients who underwent the standardized multimodal imaging workup consisting of (123)I/(99)Tc-sestamibi subtraction scintigraphy, SPECT, and SPECT/CT were assessed. Of 360 patients who were identified, a curative operation was performed in 96%, using pre-operative imaging and IOPTH. Imaging analysis showed that (123)I/(99)Tc-sestamibi had a sensitivity of 86% (95% CI 82-90%), positive predictive value (PPV) 93%, and accuracy 81%, based on correct lateralization. SPECT had a sensitivity of 77% (95% CI 72-82%), PPV 92% and accuracy 72%. SPECT/CT had a sensitivity of 75% (95% CI 70-80%), PPV of 94%, and accuracy 71%. There were 3 of 45 (7%) patients with negative sestamibi imaging that had an accurate SPECT and SPECT/CT. Of 312 patients (87%) with positive uptake on sestamibi (93% true positive, 7% false positive), concordant findings were present in 86% SPECT and 84% SPECT/CT. In cases where imaging modalities were discordant, but at least one method was true-positive, (123)I/(99)Tc-sestamibi was significantly better than both SPECT and SPECT/CT (p < 0.001). The inclusion of SPECT and SPECT/CT in 1°HPT imaging protocol increases patient cost up to 2.4-fold. (123)I/(99)Tc-sestamibi subtraction imaging is highly sensitive for preoperative localization in 1°HPT. SPECT and SPECT/CT are commonly concordant with (123)I/(99)Tc-sestamibi and rarely increase the sensitivity. Routine inclusion of multimodality imaging technique adds minimal clinical benefit but increases cost to patient in high-volume setting.

  10. Multimodal fluorescence mediated tomography and SPECT/CT for small animals imaging

    PubMed Central

    Solomon, Metasebya; Nothdruft, Ralph E.; Akers, Walter; Edwards, W. Barry; Liang, Kexian; Xu, Baogang; Suddlow, Gail P.; Deghani, Hamid; Tai, Yuan-Chuan; Eggebrecht, Adam T.; Achilefu, Samuel; Culver, Joseph P.

    2014-01-01

    Spatial and temporal co-registration of nuclear and optical images would enable the fusion of the information from theses complementary molecular imaging modalities. A critical challenge in integration is fitting optical hardware into the nuclear imaging platforms. Flexible fiber-based fluorescence mediated tomography (FMT) systems provide a viable solution because the various imaging bore sizes of small animal nuclear imaging systems can potentially accommodate the FMT fiber imaging arrays. Further, FMT imaging facilitates co-registering the nuclear and optical contrasts in time. Herein, we combine a fiber based FMT system with a preclinical NanoSPECT/CT platform. Feasibility of in vivo imaging is demonstrated by tracking the accumulation of a monomolecular multimodal imaging agent (MOMIA) in a sentinel lymph node (SLN) of a rat. Methods The fiber-based, video-rate FMT imaging system is composed of 12 alternating sources (785nm and 830nm LDs) and 13 detectors. To maintain high temporal sampling, the system simultaneously acquires ratio-metric data at each detector. The data is reconstructed using the normalized Born approach with a three-dimensional finite element model derived from an anatomical CT image of a rat for accurate light propagation modeling. Nuclear and optical contrasts are integrated by using a MOMIA. Data collection begins immediately after injection of the MOMIA intradermally into the forepaw with the FMT data acquired simultaneously with both the SPECT and CT. Results Fluorescence and radioactivity from the MOMIA were co-localized in a spatially coincident region. Intravital imaging with surgical exposure of the lymph node validated the localization of the optical contrast. The optical and nuclear contrasts where integrated by incorporating SPECT as a prior in the DOT reconstruction. Conclusion The feasibility of integrating a fiber-based, video-rate FMT system with a commercial preclinical NanoSPECT/CT platform was established. The co

  11. Magnetic resonance imaging findings of musculoskeletal brucellosis.

    PubMed

    Bozgeyik, Zulkif; Aglamis, Serpil; Bozdag, Pinar Gundogan; Denk, Affan

    2014-01-01

    The aim of this retrospective study was to determine the magnetic resonance imaging (MRI) findings of patients with musculoskeletal brucellosis. Sixty-eight among 304 patients with musculoskeletal brucellosis, aged 12-82 years (average, 50.2 years), were included in the study. Patients were diagnosed based on clinical findings, Brucella agglutination tests, and MRI findings. MRI was performed to all of the patients with sacroiliitis, spondylitis-spondylodiscitis, and peripheral arthritis. Brucella serum agglutination test was >1/160 in all cases and blood cultures were positive in twelve cases. The most commonly affected site was the spine (57.3%), wherein lumbar vertebrae were found to be most commonly affected. The second most common affected site was sacroiliac joint (26.4%), whereas peripheral joints were affected in 11 cases (16.1%). Brucellosis may affect various sites in musculoskeletal system. The spine was the most frequently affected site in our study. Sacroiliac joints and the other peripheral joints were less commonly involved sites. Brucellosis should be included in the differential diagnosis of a patient with arthralgia or symptoms of musculoskeletal system disorders especially in endemic areas. Copyright © 2014 Elsevier Inc. All rights reserved.

  12. Optimization of multimodal imaging of mesenchymal stem cells using the human sodium iodide symporter for PET and Cerenkov luminescence imaging.

    PubMed

    Wolfs, Esther; Holvoet, Bryan; Gijsbers, Rik; Casteels, Cindy; Roberts, Scott J; Struys, Tom; Maris, Michael; Ibrahimi, Abdelilah; Debyser, Zeger; Van Laere, Koen; Verfaillie, Catherine M; Deroose, Christophe M

    2014-01-01

    The use of stably integrated reporter gene imaging provides a manner to monitor the in vivo fate of engrafted cells over time in a non-invasive manner. Here, we optimized multimodal imaging (small-animal PET, Cerenkov luminescence imaging (CLI) and bioluminescence imaging (BLI)) of mesenchymal stem cells (MSCs), by means of the human sodium iodide symporter (hNIS) and firefly luciferase (Fluc) as reporters. First, two multicistronic lentiviral vectors (LV) were generated for multimodal imaging: BLI, 124I PET/SPECT and CLI. Expression of the imaging reporter genes was validated in vitro using 99mTcO4- radioligand uptake experiments and BLI. Uptake kinetics, specificity and tracer elution were determined as well as the effect of the transduction process on the cell's differentiation capacity. MSCs expressing the LV were injected intravenously or subcutaneously and imaged using small-animal PET, CLI and BLI. The expression of both imaging reporter genes was functional and specific. An elution of 99mTcO4- from the cells was observed, with 31% retention after 3 h. After labeling cells with 124I in vitro, a significantly higher CLI signal was noted in hNIS expressing murine MSCs. Furthermore, it was possible to visualize cells injected intravenously using BLI or subcutaneously in mice, using 124I small-animal PET, CLI and BLI. This study identifies hNIS as a suitable reporter gene for molecular imaging with PET and CLI, as confirmed with BLI through the expression of Fluc. It supports the potential for a wider application of hNIS reporter gene imaging and future clinical applications.

  13. VoxelStats: A MATLAB Package for Multi-Modal Voxel-Wise Brain Image Analysis

    PubMed Central

    Mathotaarachchi, Sulantha; Wang, Seqian; Shin, Monica; Pascoal, Tharick A.; Benedet, Andrea L.; Kang, Min Su; Beaudry, Thomas; Fonov, Vladimir S.; Gauthier, Serge; Labbe, Aurélie; Rosa-Neto, Pedro

    2016-01-01

    In healthy individuals, behavioral outcomes are highly associated with the variability on brain regional structure or neurochemical phenotypes. Similarly, in the context of neurodegenerative conditions, neuroimaging reveals that cognitive decline is linked to the magnitude of atrophy, neurochemical declines, or concentrations of abnormal protein aggregates across brain regions. However, modeling the effects of multiple regional abnormalities as determinants of cognitive decline at the voxel level remains largely unexplored by multimodal imaging research, given the high computational cost of estimating regression models for every single voxel from various imaging modalities. VoxelStats is a voxel-wise computational framework to overcome these computational limitations and to perform statistical operations on multiple scalar variables and imaging modalities at the voxel level. VoxelStats package has been developed in Matlab® and supports imaging formats such as Nifti-1, ANALYZE, and MINC v2. Prebuilt functions in VoxelStats enable the user to perform voxel-wise general and generalized linear models and mixed effect models with multiple volumetric covariates. Importantly, VoxelStats can recognize scalar values or image volumes as response variables and can accommodate volumetric statistical covariates as well as their interaction effects with other variables. Furthermore, this package includes built-in functionality to perform voxel-wise receiver operating characteristic analysis and paired and unpaired group contrast analysis. Validation of VoxelStats was conducted by comparing the linear regression functionality with existing toolboxes such as glim_image and RMINC. The validation results were identical to existing methods and the additional functionality was demonstrated by generating feature case assessments (t-statistics, odds ratio, and true positive rate maps). In summary, VoxelStats expands the current methods for multimodal imaging analysis by allowing the

  14. VoxelStats: A MATLAB Package for Multi-Modal Voxel-Wise Brain Image Analysis.

    PubMed

    Mathotaarachchi, Sulantha; Wang, Seqian; Shin, Monica; Pascoal, Tharick A; Benedet, Andrea L; Kang, Min Su; Beaudry, Thomas; Fonov, Vladimir S; Gauthier, Serge; Labbe, Aurélie; Rosa-Neto, Pedro

    2016-01-01

    In healthy individuals, behavioral outcomes are highly associated with the variability on brain regional structure or neurochemical phenotypes. Similarly, in the context of neurodegenerative conditions, neuroimaging reveals that cognitive decline is linked to the magnitude of atrophy, neurochemical declines, or concentrations of abnormal protein aggregates across brain regions. However, modeling the effects of multiple regional abnormalities as determinants of cognitive decline at the voxel level remains largely unexplored by multimodal imaging research, given the high computational cost of estimating regression models for every single voxel from various imaging modalities. VoxelStats is a voxel-wise computational framework to overcome these computational limitations and to perform statistical operations on multiple scalar variables and imaging modalities at the voxel level. VoxelStats package has been developed in Matlab(®) and supports imaging formats such as Nifti-1, ANALYZE, and MINC v2. Prebuilt functions in VoxelStats enable the user to perform voxel-wise general and generalized linear models and mixed effect models with multiple volumetric covariates. Importantly, VoxelStats can recognize scalar values or image volumes as response variables and can accommodate volumetric statistical covariates as well as their interaction effects with other variables. Furthermore, this package includes built-in functionality to perform voxel-wise receiver operating characteristic analysis and paired and unpaired group contrast analysis. Validation of VoxelStats was conducted by comparing the linear regression functionality with existing toolboxes such as glim_image and RMINC. The validation results were identical to existing methods and the additional functionality was demonstrated by generating feature case assessments (t-statistics, odds ratio, and true positive rate maps). In summary, VoxelStats expands the current methods for multimodal imaging analysis by allowing the

  15. In vivo monitoring of structural and mechanical changes of tissue scaffolds by multi-modality imaging

    PubMed Central

    Park, Dae Woo; Ye, Sang-Ho; Jiang, Hong Bin; Dutta, Debaditya; Nonaka, Kazuhiro; Wagner, William R.; Kim, Kang

    2014-01-01

    Degradable tissue scaffolds are implanted to serve a mechanical role while healing processes occur and putatively assume the physiological load as the scaffold degrades. Mechanical failure during this period can be unpredictable as monitoring of structural degradation and mechanical strength changes at the implant site is not readily achieved in vivo, and non-invasively. To address this need, a multi-modality approach using ultrasound shear wave imaging (USWI) and photoacoustic imaging (PAI) for both mechanical and structural assessment in vivo was demonstrated with degradable poly(ester urethane)urea (PEUU) and polydioxanone (PDO) scaffolds. The fibrous scaffolds were fabricated with wet electrospinning, dyed with indocyanine green (ICG) for optical contrast in PAI, and implanted in the abdominal wall of 36 rats. The scaffolds were monitored monthly using USWI and PAI and were extracted at 0, 4, 8 and 12 wk for mechanical and histological assessment. The change in shear modulus of the constructs in vivo obtained by USWI correlated with the change in average Young's modulus of the constructs ex vivo obtained by compression measurements. The PEUU and PDO scaffolds exhibited distinctly different degradation rates and average PAI signal intensity. The distribution of PAI signal intensity also corresponded well to the remaining scaffolds as seen in explant histology. This evidence using a small animal abdominal wall repair model demonstrates that multi-modality imaging of USWI and PAI may allow tissue engineers to noninvasively evaluate concurrent mechanical stiffness and structural changes of tissue constructs in vivo for a variety of applications. PMID:24951048

  16. Laser Microdissection and Atmospheric Pressure Chemical Ionization Mass Spectrometry Coupled for Multimodal Imaging

    SciTech Connect

    Lorenz, Matthias; Ovchinnikova, Olga S; Kertesz, Vilmos; Van Berkel, Gary J

    2013-01-01

    This paper describes the coupling of ambient laser ablation surface sampling, accomplished using a laser capture microdissection system, with atmospheric pressure chemical ionization mass spectrometry for high spatial resolution multimodal imaging. A commercial laser capture microdissection system was placed in close proximity to a modified ion source of a mass spectrometer designed to allow for sampling of laser ablated material via a transfer tube directly into the ionization region. Rhodamine 6G dye of red sharpie ink in a laser etched pattern as well as cholesterol and phosphatidylcholine in a cerebellum mouse brain thin tissue section were identified and imaged from full scan mass spectra. A minimal spot diameter of 8 m was achieved using the 10X microscope cutting objective with a lateral oversampling pixel resolution of about 3.7 m. Distinguishing between features approximately 13 m apart in a cerebellum mouse brain thin tissue section was demonstrated in a multimodal fashion including co-registered optical and mass spectral chemical images.

  17. STRUCTURAL AND FUNCTIONAL CHARACTERIZATION OF BENIGN FLECK RETINA USING MULTIMODAL IMAGING.

    PubMed

    Neriyanuri, Srividya; Rao, Chetan; Raman, Rajiv

    2017-01-01

    To report structural and functional features in a case series of benign fleck retina using multimodal imaging. Four cases with benign fleck retina underwent complete ophthalmic examination that included detailed history, visual acuity, and refractive error testing, FM-100 hue test, dilated fundus evaluation, full field electroretinogram, fundus photography with autofluorescence, fundus fluorescein angiography, and swept-source optical coherence tomography. Age group of the cases ranged from 19 years to 35 years (3 males and 1 female). Parental consanguinity was reported in two cases. All of them were visually asymptomatic with best-corrected visual acuity of 20/20 (moderate astigmatism) in both the eyes. Low color discrimination was seen in two cases. Fundus photography showed pisciform flecks which were compactly placed on posterior pole and were discrete, diverging towards periphery. Lesions were seen as smaller dots within 1500 microns from fovea and were hyperfluorescent on autofluorescence. Palisading retinal pigment epithelium defects were seen in posterior pole on fundus fluorescein angiography imaging; irregular hyper fluorescence was also noted. One case had reduced cone responses on full field electroretinogram; the other three cases had normal electroretinogram. On optical coherence tomography, level of lesions varied from retinal pigment epithelium, inner segment to outer segment extending till external limiting membrane. Functional and structural deficits in benign fleck retina were picked up using multimodal imaging.

  18. Imaging plus X: multimodal models of neurodegenerative disease.

    PubMed

    Oxtoby, Neil P; Alexander, Daniel C

    2017-08-01

    mechanism to integrate different kinds of information, for example from imaging, serum and cerebrospinal fluid markers and cognitive tests, to obtain new insights into progressive diseases. Such insights include fine-grained longitudinal patterns of neurodegeneration, from early stages, and the heterogeneity of these trajectories over the population. More pragmatically, such models enable finer precision in patient staging and stratification, prediction of progression rates and earlier and better identification of at-risk individuals. We argue that this will make disease progression modelling invaluable for recruitment and end-points in future clinical trials, potentially ameliorating the high failure rate in trials of, e.g., Alzheimer's disease therapies. We review the state of the art in these techniques and discuss the future steps required to translate the ideas to front-line application.

  19. Multimodality imaging of bilateral pheochromocytoma. A case report.

    PubMed

    Paladino, Nunzia Cinzia; Lowery, Aoife; Guérin, Carole; Taïeb, David; Sebag, Frédéric

    2015-06-22

    . La TEP alla 18 FDG, grazie all’uso della metodica qualitativa e quantitativa nell’analisi della lesione, è stata molto utile nello svelarne la natura. Veniva pertanto eseguita una surrenalectomia sinistra per via laparoscopica. L’esame istologico per entrambe le lesioni era in favore di feocromocitoma, Pass score 0. Nella fase post-operatoria la paziente veniva trattata con idrocortisone a dosi decrescenti fino ad un dosaggio giornaliero di 30 mg in associazione a 50 mg di fludrocortisone. Questo caso clinico dimostra ancora una volta la possibilità di falsi negativi da parte di tecniche di imaging funzionale specifiche. In questa esperienza, la TEP alla 18 FDG è stata molto utile. La RMN ha senza dubbio mostrato un valore incontestabile. In questa paziente non è stata trovata nessuna mutazione germinale a carico dei geni RET, VHL, SDHx.

  20. Multicomponent, peptide-targeted glycol chitosan nanoparticles containing ferrimagnetic iron oxide nanocubes for bladder cancer multimodal imaging.

    PubMed

    Key, Jaehong; Dhawan, Deepika; Cooper, Christy L; Knapp, Deborah W; Kim, Kwangmeyung; Kwon, Ick Chan; Choi, Kuiwon; Park, Kinam; Decuzzi, Paolo; Leary, James F

    While current imaging modalities, such as magnetic resonance imaging (MRI), computed tomography, and positron emission tomography, play an important role in detecting tumors in the body, no single-modality imaging possesses all the functions needed for a complete diagnostic imaging, such as spatial resolution, signal sensitivity, and tissue penetration depth. For this reason, multimodal imaging strategies have become promising tools for advanced biomedical research and cancer diagnostics and therapeutics. In designing multimodal nanoparticles, the physicochemical properties of the nanoparticles should be engineered so that they successfully accumulate at the tumor site and minimize nonspecific uptake by other organs. Finely altering the nano-scale properties can dramatically change the biodistribution and tumor accumulation of nanoparticles in the body. In this study, we engineered multimodal nanoparticles for both MRI, by using ferrimagnetic nanocubes (NCs), and near infrared fluorescence imaging, by using cyanine 5.5 fluorescence molecules. We changed the physicochemical properties of glycol chitosan nanoparticles by conjugating bladder cancer-targeting peptides and loading many ferrimagnetic iron oxide NCs per glycol chitosan nanoparticle to improve MRI contrast. The 22 nm ferrimagnetic NCs were stabilized in physiological conditions by encapsulating them within modified chitosan nanoparticles. The multimodal nanoparticles were compared with in vivo MRI and near infrared fluorescent systems. We demonstrated significant and important changes in the biodistribution and tumor accumulation of nanoparticles with different physicochemical properties. Finally, we demonstrated that multimodal nanoparticles specifically visualize small tumors and show minimal accumulation in other organs. This work reveals the importance of finely modulating physicochemical properties in designing multimodal nanoparticles for bladder cancer imaging.

  1. Multicomponent, peptide-targeted glycol chitosan nanoparticles containing ferrimagnetic iron oxide nanocubes for bladder cancer multimodal imaging

    PubMed Central

    Key, Jaehong; Dhawan, Deepika; Cooper, Christy L; Knapp, Deborah W; Kim, Kwangmeyung; Kwon, Ick Chan; Choi, Kuiwon; Park, Kinam; Decuzzi, Paolo; Leary, James F

    2016-01-01

    While current imaging modalities, such as magnetic resonance imaging (MRI), computed tomography, and positron emission tomography, play an important role in detecting tumors in the body, no single-modality imaging possesses all the functions needed for a complete diagnostic imaging, such as spatial resolution, signal sensitivity, and tissue penetration depth. For this reason, multimodal imaging strategies have become promising tools for advanced biomedical research and cancer diagnostics and therapeutics. In designing multimodal nanoparticles, the physicochemical properties of the nanoparticles should be engineered so that they successfully accumulate at the tumor site and minimize nonspecific uptake by other organs. Finely altering the nano-scale properties can dramatically change the biodistribution and tumor accumulation of nanoparticles in the body. In this study, we engineered multimodal nanoparticles for both MRI, by using ferrimagnetic nanocubes (NCs), and near infrared fluorescence imaging, by using cyanine 5.5 fluorescence molecules. We changed the physicochemical properties of glycol chitosan nanoparticles by conjugating bladder cancer-targeting peptides and loading many ferrimagnetic iron oxide NCs per glycol chitosan nanoparticle to improve MRI contrast. The 22 nm ferrimagnetic NCs were stabilized in physiological conditions by encapsulating them within modified chitosan nanoparticles. The multimodal nanoparticles were compared with in vivo MRI and near infrared fluorescent systems. We demonstrated significant and important changes in the biodistribution and tumor accumulation of nanoparticles with different physicochemical properties. Finally, we demonstrated that multimodal nanoparticles specifically visualize small tumors and show minimal accumulation in other organs. This work reveals the importance of finely modulating physicochemical properties in designing multimodal nanoparticles for bladder cancer imaging. PMID:27621615

  2. Cardiovascular manifestations of Williams syndrome: imaging findings.

    PubMed

    Gray, J Cranston; Krazinski, Aleksander W; Schoepf, U Joseph; Meinel, Felix G; Pietris, Nicholas P; Suranyi, Pal; Hlavacek, Anthony M

    2013-01-01

    Williams syndrome is a relatively common (1 in 10,000 live births) genetic disorder caused by a deletion involving chromosome 7 that results in a variety of clinically significant abnormalities, including developmental delay, behavioral changes, hypercalcemia, and a distinct "elfin" facial appearance. Congenital cardiovascular disease that presents in childhood is responsible for most of the morbidity and mortality associated with this disorder. The purpose of this pictorial essay is to review imaging findings of some of the more common cardiovascular manifestations of Williams syndrome and to highlight some of the unique anatomic variations that can be seen in these patients. Copyright © 2013 Society of Cardiovascular Computed Tomography. Published by Elsevier Inc. All rights reserved.

  3. Use of anomolous thermal imaging effects for multi-mode systems control during crystal growth

    NASA Technical Reports Server (NTRS)

    Wargo, Michael J.

    1989-01-01

    Real time image processing techniques, combined with multitasking computational capabilities are used to establish thermal imaging as a multimode sensor for systems control during crystal growth. Whereas certain regions of the high temperature scene are presently unusable for quantitative determination of temperature, the anomalous information thus obtained is found to serve as a potentially low noise source of other important systems control output. Using this approach, the light emission/reflection characteristics of the crystal, meniscus and melt system are used to infer the crystal diameter and a linear regression algorithm is employed to determine the local diameter trend. This data is utilized as input for closed loop control of crystal shape. No performance penalty in thermal imaging speed is paid for this added functionality. Approach to secondary (diameter) sensor design and systems control structure is discussed. Preliminary experimental results are presented.

  4. Development of multimodal imaging system combined with laser microbeam for nanoscale manipulation and characterization

    NASA Astrophysics Data System (ADS)

    Ingle, Ninad

    Optical microscopy has fascinated biologists for probing and observing cellular structure while performing scientific research. While numerous wide-field and scanning microscopic techniques are being developed for probing cellular structure and function with high spatial and temporal resolution, mapping of complete biochemical, material and structural properties of the cell in three dimensions requires integration of multiple microscopic imaging techniques. In this thesis, conventional phase contrast microscopy and epifluorescence microscopy techniques were combined with other imaging methods such as digital holography microscopy (DHM) also known as quantitative phase microscopy, atomic force microscopy (AFM), near-field scanning optical microscopy (NSOM), total internal reflection fluorescence microscopy (TIRFM) and multiphoton microscopy (MPM). Introductory chapter will describe the importance of each technique and how the shortcoming of one technique is overcome by inclusion of other. Characterization of laser microbeam induced nanoscale manipulation was achieved using this multimodal imaging system.

  5. Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

    NASA Astrophysics Data System (ADS)

    Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth; Huang, Xiaojing; Wagner, Ulrich; Rau, Christoph; Yusuf, Mohammed; Robinson, Ian; Kalbfleisch, Sebastian; Li, Li; Bouet, Nathalie; Zhou, Juan; Conley, Ray; Chu, Yong S.

    2016-02-01

    We developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray’s superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioning it.

  6. Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

    DOE PAGES

    Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth R.; ...

    2016-02-05

    Here, we developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray's superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioningmore » it.« less

  7. Clinical application of multimodality imaging in radiotherapy treatment planning for rectal cancer.

    PubMed

    Wang, Yan Yang; Zhe, Hong

    2013-12-11

    Radiotherapy plays an important role in the treatment of rectal cancer. Three-dimensional conformal radiotherapy and intensity-modulated radiotherapy are mainstay techniques of radiotherapy for rectal cancer. However, the success of these techniques is heavily reliant on accurate target delineation and treatment planning. Computed tomography simulation is a cornerstone of rectal cancer radiotherapy, but there are limitations, such as poor soft-tissue contrast between pelvic structures and partial volume effects. Magnetic resonance imaging and positron emission tomography (PET) can overcome these limitations and provide additional information for rectal cancer treatment planning. PET can also reduce the interobserver variation in the definition of rectal tumor volume. However, there is a long way to go before these image modalities are routinely used in the clinical setting. This review summarizes the most promising studies on clinical applications of multimodality imaging in target delineation and treatment planning for rectal cancer radiotherapy.

  8. Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

    SciTech Connect

    Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth R.; Huang, Xiaojing; Wagner, Ulrich; Rau, Christoph; Yusuf, Mohammed; Robinson, Ian K.; Kalbfleisch, Sebastian; Li, Li; Bouet, Nathalie; Zhou, Juan; Conley, Ray; Chu, Yong S.

    2016-02-05

    Here, we developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray's superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioning it.

  9. Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

    PubMed Central

    Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth; Huang, Xiaojing; Wagner, Ulrich; Rau, Christoph; Yusuf, Mohammed; Robinson, Ian; Kalbfleisch, Sebastian; Li, Li; Bouet, Nathalie; Zhou, Juan; Conley, Ray; Chu, Yong S.

    2016-01-01

    We developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray’s superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioning it. PMID:26846188

  10. Multimodal two-photon imaging using a second harmonic generation-specific dye

    PubMed Central

    Nuriya, Mutsuo; Fukushima, Shun; Momotake, Atsuya; Shinotsuka, Takanori; Yasui, Masato; Arai, Tatsuo

    2016-01-01

    Second harmonic generation (SHG) imaging can be used to visualize unique biological phenomena, but currently available dyes limit its application owing to the strong fluorescent signals that they generate together with SHG. Here we report the first non-fluorescent and membrane potential-sensitive SHG-active organic dye Ap3. Ap3 is photostable and generates SH signals at the plasma membrane with virtually no fluorescent signals, in sharp contrast to the previously used fluorescent dye FM4-64. When tested in neurons, Ap3-SHG shows linear membrane potential sensitivity and fast responses to action potentials, and also shows significantly reduced photodamage compared with FM4-64. The SHG-specific nature of Ap3 allows simultaneous and completely independent imaging of SHG signals and fluorescent signals from various reporter molecules, including markers of cellular organelles and intracellular calcium. Therefore, this SHG-specific dye enables true multimodal two-photon imaging in biological samples. PMID:27156702

  11. Accumulating advantages, reducing limitations: multimodal nonlinear imaging in biomedical sciences - the synergy of multiple contrast mechanisms.

    PubMed

    Meyer, Tobias; Schmitt, Michael; Dietzek, Benjamin; Popp, Jürgen

    2013-12-01

    Multimodal nonlinear microscopy has matured during the past decades to one of the key imaging modalities in life science and biomedicine due to its unique capabilities of label-free visualization of tissue structure and chemical composition, high depth penetration, intrinsic 3D sectioning, diffraction limited resolution and low phototoxicity. This review briefly summarizes first recent advances in the field regarding the methodology, e.g., contrast mechanisms and signal characteristics used for contrast generation as well as novel image processing approaches. The second part deals with technologic developments emphasizing improvements in penetration depth, imaging speed, spatial resolution and nonlinear labeling strategies. The third part focuses on recent applications in life science fundamental research and biomedical diagnostics as well as future clinical applications.

  12. A framework based on hidden Markov trees for multimodal PET/CT image co-segmentation.

    PubMed

    Hanzouli-Ben Salah, Houda; Lapuyade-Lahorgue, Jerome; Bert, Julien; Benoit, Didier; Lambin, Philippe; Van Baardwijk, Angela; Monfrini, Emmanuel; Pieczynski, Wojciech; Visvikis, Dimitris; Hatt, Mathieu

    2017-08-24

    The purpose of this study was to investigate the use of a probabilistic quad-tree graph (hidden Markov tree, HMT) to provide fast computation, robustness and an interpretational framework for multimodality image processing and to evaluate this framework for single gross tumor target (GTV) delineation from both positron emission tomography (PET) and computed tomography (CT) images. We exploited joint statistical dependencies between hidden states to handle the data stack using multi-observation, multi-resolution of HMT and Bayesian inference. This framework was applied to segmentation of lung tumors in PET/CT datasets taking into consideration simultaneously the CT and the PET image information. PET and CT images were considered using either the original voxels intensities, or after wavelet/contourlet enhancement. The Dice similarity coefficient (DSC), sensitivity (SE), positive predictive value (PPV) were used to assess the performance of the proposed approach on one simulated and 15 clinical PET/CT datasets of non-small cell lung cancer (NSCLC) cases. The surrogate of truth was a statistical consensus (obtained with the Simultaneous Truth and Performance Level Estimation algorithm) of three manual delineations performed by experts on fused PET/CT images. The proposed framework was applied to PET-only, CT-only and PET/CT datasets, and were compared to standard and improved fuzzy c-means (FCM) multimodal implementations. A high agreement with the consensus of manual delineations was observed when using both PET and CT images. Contourlet-based HMT led to the best results with a DSC of 0.92 ± 0.11 compared to 0.89 ± 0.13 and 0.90 ± 0.12 for Intensity-based HMT and Wavelet-based HMT, respectively. Considering PET or CT only in the HMT led to much lower accuracy. Standard and improved FCM led to comparatively lower accuracy than HMT, even when considering multimodal implementations. We evaluated the accuracy of the proposed HMT-based framework for PET/CT image

  13. Oxidation-Responsive, EuII/III-Based, Multimodal Contrast Agent for Magnetic Resonance and Photoacoustic Imaging

    PubMed Central

    2017-01-01

    We report, for the first time, a multimodal, oxidation-responsive contrast agent for magnetic resonance imaging and photoacoustic imaging that uses the differences in the properties between Eu in the +2 and +3 oxidation states. The enhancement of contrast in T1-weighted magnetic resonance and photoacoustic imaging was observed in the +2 but not in the +3 oxidation state, and the complex is a known chemical exchange saturation transfer agent for magnetic resonance imaging in the +3 oxidation state. PMID:28393130

  14. Abdominal sarcoidosis: cross-sectional imaging findings

    PubMed Central

    Gezer, Naciye Sinem; Başara, Işıl; Altay, Canan; Harman, Mustafa; Rocher, Laurence; Karabulut, Nevzat; Seçil, Mustafa

    2015-01-01

    Sarcoidosis is a multisystem inflammatory disease of unknown etiology. The lungs and the lymphoid system are the most commonly involved organs. Extrapulmonary involvement is reported in 30% of patients, and the abdomen is the most common extrapulmonary site with a frequency of 50%–70%. Although intra-abdominal sarcoidosis is usually asymptomatic, its presence may affect the prognosis and treatment options. The lesions are less characteristic and may mimick neoplastic or infectious diseases such as lymphoma, diffuse metastasis, and granulomatous inflammation. The liver and spleen are the most common abdominal sites of involvement. Sarcoidosis of the gastrointestinal system, pancreas, and kidneys are extremely rare. Adenopathy which is most commonly found in the porta hepatis, exudative ascites, and multiple granulomatous nodules studding the peritoneum are the reported manifestations of abdominal sarcoidosis. Since abdominal sarcoidosis is less common and long-standing, unrecognized disease can result in significant morbidity and mortality. Imaging contributes to diagnosis and management of intra-abdominal sarcoidosis. In this report we reviewed the cross-sectional imaging findings of hepatobiliary, gastrointestinal, and genitourinary sarcoidosis. PMID:25512071

  15. Hopc: a Novel Similarity Metric Based on Geometric Structural Properties for Multi-Modal Remote Sensing Image Matching

    NASA Astrophysics Data System (ADS)

    Ye, Yuanxin; Shen, Li

    2016-06-01

    Automatic matching of multi-modal remote sensing images (e.g., optical, LiDAR, SAR and maps) remains a challenging task in remote sensing image analysis due to significant non-linear radiometric differences between these images. This paper addresses this problem and proposes a novel similarity metric for multi-modal matching using geometric structural properties of images. We first extend the phase congruency model with illumination and contrast invariance, and then use the extended model to build a dense descriptor called the Histogram of Orientated Phase Congruency (HOPC) that captures geometric structure or shape features of images. Finally, HOPC is integrated as the similarity metric to detect tie-points between images by designing a fast template matching scheme. This novel metric aims to represent geometric structural similarities between multi-modal remote sensing datasets and is robust against significant non-linear radiometric changes. HOPC has been evaluated with a variety of multi-modal images including optical, LiDAR, SAR and map data. Experimental results show its superiority to the recent state-of-the-art similarity metrics (e.g., NCC, MI, etc.), and demonstrate its improved matching performance.

  16. In vivo multimodal magnetic particle imaging (MPI) with tailored magneto/optical contrast agents

    PubMed Central

    Arami, Hamed; Khandhar, Amit; Tomitaka, Asahi; Yu, Elaine; Goodwill, Patrick; Conolly, Steven; Krishnan, Kannan M.

    2015-01-01

    Magnetic Particle Imaging (MPI) is a novel non-invasive biomedical imaging modality that uses safe magnetite nanoparticles as tracers. Controlled synthesis of iron oxide nanoparticles (NPs) with tuned size-dependent magnetic relaxation properties is critical for the development of MPI. Additional functionalization of these NPs for other imaging modalities (e.g. MRI and fluorescent imaging) would accelerate screening of the MPI tracers based on their in vitro and in vivo performance in pre-clinical trials. Here, we conjugated two different types of poly-ethylene-glycols (NH2-PEG-NH2 and NH2-PEG FMOC) to monodisperse carboxylated 19.7nm NPs by amide bonding. Further, we labeled these NPs with Cy5.5 near infra-red fluorescent (NIRF) molecules. Bi-functional PEG (NH2-PEG-NH2) resulted in larger hydrodynamic size (~98nm vs. ~43nm) of the tracers, due to interparticle crosslinking. Formation of such clusters impacted the multimodal imaging performance and pharmacokinetics of these tracers. We found that MPI signal intensity of the tracers in blood depends on their plasmatic clearance pharmacokinetics. Whole body mice MPI/MRI/NIRF, used to study the biodistribution of the injected NPs, showed primary distribution in liver and spleen. Biodistribution of tracers and their clearance pathway was further confirmed by MPI and NIRF signals from the excised organs where the Cy5.5 labeling enabled detailed anatomical mapping of the tracers.in tissue sections. These multimodal MPI tracers, combining the strengths of each imaging modality (e.g. resolution, tracer sensitivity and clinical use feasibility) pave the way for various in vitro and in vivo MPI applications. PMID:25818431

  17. Comparative imaging study in ultrasound, MRI, CT, and DSA using a multimodality renal artery phantom

    SciTech Connect

    King, Deirdre M.; Fagan, Andrew J.; Moran, Carmel M.; Browne, Jacinta E.

    2011-02-15

    Purpose: A range of anatomically realistic multimodality renal artery phantoms consisting of vessels with varying degrees of stenosis was developed and evaluated using four imaging techniques currently used to detect renal artery stenosis (RAS). The spatial resolution required to visualize vascular geometry and the velocity detection performance required to adequately characterize blood flow in patients suffering from RAS are currently ill-defined, with the result that no one imaging modality has emerged as a gold standard technique for screening for this disease. Methods: The phantoms, which contained a range of stenosis values (0%, 30%, 50%, 70%, and 85%), were designed for use with ultrasound, magnetic resonance imaging, x-ray computed tomography, and x-ray digital subtraction angiography. The construction materials used were optimized with respect to their ultrasonic speed of sound and attenuation coefficient, MR relaxometry (T{sub 1},T{sub 2}) properties, and Hounsfield number/x-ray attenuation coefficient, with a design capable of tolerating high-pressure pulsatile flow. Fiducial targets, incorporated into the phantoms to allow for registration of images among modalities, were chosen to minimize geometric distortions. Results: High quality distortion-free images of the phantoms with good contrast between vessel lumen, fiducial markers, and background tissue to visualize all stenoses were obtained with each modality. Quantitative assessments of the grade of stenosis revealed significant discrepancies between modalities, with each underestimating the stenosis severity for the higher-stenosed phantoms (70% and 85%) by up to 14%, with the greatest discrepancy attributable to DSA. Conclusions: The design and construction of a range of anatomically realistic renal artery phantoms containing varying degrees of stenosis is described. Images obtained using the main four diagnostic techniques used to detect RAS were free from artifacts and exhibited adequate contrast

  18. In vivo multimodal magnetic particle imaging (MPI) with tailored magneto/optical contrast agents.

    PubMed

    Arami, Hamed; Khandhar, Amit P; Tomitaka, Asahi; Yu, Elaine; Goodwill, Patrick W; Conolly, Steven M; Krishnan, Kannan M

    2015-06-01

    Magnetic Particle Imaging (MPI) is a novel non-invasive biomedical imaging modality that uses safe magnetite nanoparticles as tracers. Controlled synthesis of iron oxide nanoparticles (NPs) with tuned size-dependent magnetic relaxation properties is critical for the development of MPI. Additional functionalization of these NPs for other imaging modalities (e.g. MRI and fluorescent imaging) would accelerate screening of the MPI tracers based on their in vitro and in vivo performance in pre-clinical trials. Here, we conjugated two different types of poly-ethylene-glycols (NH2-PEG-NH2 and NH2-PEG-FMOC) to monodisperse carboxylated 19.7 nm NPs by amide bonding. Further, we labeled these NPs with Cy5.5 near infra-red fluorescent (NIRF) molecules. Bi-functional PEG (NH2-PEG-NH2) resulted in larger hydrodynamic size (∼98 nm vs. ∼43 nm) of the tracers, due to inter-particle crosslinking. Formation of such clusters impacted the multimodal imaging performance and pharmacokinetics of these tracers. We found that MPI signal intensity of the tracers in blood depends on their plasmatic clearance pharmacokinetics. Whole body mice MPI/MRI/NIRF, used to study the biodistribution of the injected NPs, showed primary distribution in liver and spleen. Biodistribution of tracers and their clearance pathway was further confirmed by MPI and NIRF signals from the excised organs where the Cy5.5 labeling enabled detailed anatomical mapping of the tracers.in tissue sections. These multimodal MPI tracers, combining the strengths of each imaging modality (e.g. resolution, tracer sensitivity and clinical use feasibility) pave the way for various in vitro and in vivo MPI applications. Copyright © 2015 Elsevier Ltd. All rights reserved.

  19. Refinement by integration: aggregated effects of multimodal imaging markers on adult ADHD.

    PubMed

    Wolfers, Thomas; Arenas, Alberto Llera; Onnink, A Marten H; Dammers, Janneke; Hoogman, Martine; Zwiers, Marcel P; Buitelaar, Jan K; Franke, Barbara; Marquand, Andre F; Beckmann, Christian F

    2017-08-22

    Attention-deficit/hyperactivity disorder (ADHD) is biologically heterogeneous, with different biological predispositions - mediated through developmental processes - converging upon a common clinical phenotype. Brain imaging studies have variably shown altered brain structure, activity and connectivity in children and adults with ADHD. Recent methodological developments allow for the integration of information across imaging modalities, potentially yielding a more coherent view regarding the biology underlying the disorder. We analyzed a sample of adults with persistent ADHD and healthy controls using an advanced multimodal linked independent component analysis approach. Diffusion and structural MRI data were fused to form imaging markers reflecting independent components that explain variation across modalities. We included these markers as predictors into logistic regression models on adult ADHD and put those into context with predictions of estimated intelligence, age and sex. We included 87 adults with ADHD and 93 controls in our analysis. Participants' courses associated with all imaging markers explained 27.86% of the variance in adult ADHD. No single imaging modality dominated this result. Instead, it was explained by aggregation of relatively small effects across several modalities and markers. One of the top markers for adult ADHD was multimodal and linked to morphological and microstructural effects within anterior temporal brain regions; another was linked to cortical thickness. Several markers were also influenced by estimated intelligence, age and/or sex. Although complex analytical approaches, such as the one applied here, provide insight into otherwise hidden mechanisms, they also increase the complexity of interpretations. No dominant imaging modality or marker characterizes structural brain phenotypes in adults with ADHD, but we can refine our characterization of the disorder by the integration of small effects across modalities.

  20. A novel automated method for doing registration and 3D reconstruction from multi-modal RGB/IR image sequences

    NASA Astrophysics Data System (ADS)

    Kirby, Richard; Whitaker, Ross

    2016-09-01

    In recent years, the use of multi-modal camera rigs consisting of an RGB sensor and an infrared (IR) sensor have become increasingly popular for use in surveillance and robotics applications. The advantages of using multi-modal camera rigs include improved foreground/background segmentation, wider range of lighting conditions under which the system works, and richer information (e.g. visible light and heat signature) for target identification. However, the traditional computer vision method of mapping pairs of images using pixel intensities or image features is often not possible with an RGB/IR image pair. We introduce a novel method to overcome the lack of common features in RGB/IR image pairs by using a variational methods optimization algorithm to map the optical flow fields computed from different wavelength images. This results in the alignment of the flow fields, which in turn produce correspondences similar to those found in a stereo RGB/RGB camera rig using pixel intensities or image features. In addition to aligning the different wavelength images, these correspondences are used to generate dense disparity and depth maps. We obtain accuracies similar to other multi-modal image alignment methodologies as long as the scene contains sufficient depth variations, although a direct comparison is not possible because of the lack of standard image sets from moving multi-modal camera rigs. We test our method on synthetic optical flow fields and on real image sequences that we created with a multi-modal binocular stereo RGB/IR camera rig. We determine our method's accuracy by comparing against a ground truth.

  1. A nucleolin-targeted multimodal nanoparticle imaging probe for tracking cancer cells using an aptamer.

    PubMed

    Hwang, Do Won; Ko, Hae Young; Lee, Jung Hwan; Kang, Hyungu; Ryu, Sung Ho; Song, In Chan; Lee, Dong Soo; Kim, Soonhag

    2010-01-01

    The recent advances in molecular imaging techniques, using cancer-targeting nanoparticle probes, provide noninvasive tracking information on cancer cells in living subjects. Here, we report a multimodal cancer-targeted imaging system capable of concurrent fluorescence imaging, radionuclide imaging, and MRI in vivo. A cobalt-ferrite nanoparticle surrounded by fluorescent rhodamine (designated MF) within a silica shell matrix was synthesized with the AS1411 aptamer (MF-AS1411) that targets nucleolin (a cellular membrane protein highly expressed in cancer) using N-(3-dimethylaminopropyl)-N-ethylcarbodiimide (EDC). This purified MF-AS1411 particle was bound with 2-(p-isothio-cyanatobenzyl)-1,4,7-triazacyclonane-1,4,7-triacetic acid (p-SCN-bn-NOTA) chelating agent and further labeled with (67)Ga-citrate (MFR-AS1411). The shape and size distribution of MFR-AS1411 were characterized by transmission electron microscope (TEM). The cellular distribution of the nucleolin protein using the MFR-AS1411 nanoparticle was detected by fluorescence confocal microscopy. Phantom MR images were obtained as the concentration of MFR-AS1411 increased, using a 1.5-T MRI scanner. In vivo (67)Ga radionuclide imaging and MRI were performed using a gamma-camera and a 1.5-T MR imager, respectively. TEM imaging revealed MF and MFR-AS1411 to be spheric and well dispersed. The purified MFR-AS1411 nanoparticle showed specific fluorescence signals in nucleolin-expressing C6 cells, compared with MFR-AS1411 mutant (MFR-AS1411mt)-treated C6 cells. The rhodamine fluorescence intensity and (67)Ga activity of MFR-AS1411 were enhanced in a dose-dependent manner as the concentration of MFR-AS1411 was increased. The (67)Ga radionuclide was detected in both thighs of the mice injected with MFR-AS1411, whereas the MFR-AS1411 mutant (MFR-AS1411mt) administration revealed rapid clearance via the bloodstream, demonstrating that MFR-AS1411 specifically targeted cancer cells. Bioluminescence images in the C6 cells

  2. Design and characterization of a handheld multimodal imaging device for the assessment of oral epithelial lesions

    NASA Astrophysics Data System (ADS)

    Higgins, Laura M.; Pierce, Mark C.

    2014-08-01

    A compact handpiece combining high resolution fluorescence (HRF) imaging with optical coherence tomography (OCT) was developed to provide real-time assessment of oral lesions. This multimodal imaging device simultaneously captures coregistered en face images with subcellular detail alongside cross-sectional images of tissue microstructure. The HRF imaging acquires a 712×594 μm2 field-of-view at the sample with a spatial resolution of 3.5 μm. The OCT images were acquired to a depth of 1.5 mm with axial and lateral resolutions of 9.3 and 8.0 μm, respectively. HRF and OCT images are simultaneously displayed at 25 fps. The handheld device was used to image a healthy volunteer, demonstrating the potential for in vivo assessment of the epithelial surface for dysplastic and neoplastic changes at the cellular level, while simultaneously evaluating submucosal involvement. We anticipate potential applications in real-time assessment of oral lesions for improved surveillance and surgical guidance.

  3. A novel multimodal optical imaging system for early detection of oral cancer.

    PubMed

    Malik, Bilal H; Jabbour, Joey M; Cheng, Shuna; Cuenca, Rodrigo; Cheng, Yi-Shing Lisa; Wright, John M; Jo, Javier A; Maitland, Kristen C

    2016-03-01

    Several imaging techniques have been advocated as clinical adjuncts to improve identification of suspicious oral lesions. However, these have not yet shown superior sensitivity or specificity over conventional oral examination techniques. We developed a multimodal, multi-scale optical imaging system that combines macroscopic biochemical imaging of fluorescence lifetime imaging with subcellular morphologic imaging of reflectance confocal microscopy for early detection of oral cancer. We tested our system on excised human oral tissues. In total, 4 tissue specimens were imaged. These specimens were diagnosed as either clinically normal, oral lichen planus, gingival hyperplasia, or superficially invasive squamous cell carcinoma. The optical and fluorescence lifetime properties of each specimen were recorded. Both quantitative and qualitative differences among normal, benign, and squamous cell carcinoma lesions can be resolved with fluorescence lifetime imaging reflectance confocal microscopy. The results demonstrate that an integrated approach based on these two methods can potentially enable rapid screening and evaluation of large areas of oral epithelial tissue. Early results from ongoing studies of imaging human oral cavity illustrate the synergistic combination of the 2 modalities. An adjunct device based on such optical characterization of oral mucosa can potentially be used to detect oral carcinogenesis in early stages. Copyright © 2016 Elsevier Inc. All rights reserved.

  4. A novel multimodal optical imaging system for early detection of oral cancer

    PubMed Central

    Malik, Bilal H.; Jabbour, Joey M.; Cheng, Shuna; Cuenca, Rodrigo; Cheng, Yi-Shing Lisa; Wright, John M.; Jo, Javier A.; Maitland, Kristen C.

    2015-01-01

    Objectives Several imaging techniques have been advocated as clinical adjuncts to improve identification of suspicious oral lesions. However, these have not yet shown superior sensitivity or specificity over conventional oral examination techniques. We developed a multimodal, multi-scale optical imaging system that combines macroscopic biochemical imaging of fluorescence lifetime imaging (FLIM) with subcellular morphologic imaging of reflectance confocal microscopy (RCM) for early detection of oral cancer. We tested our system on excised human oral tissues. Study Design A total of four tissue specimen were imaged. These specimens were diagnosed as one each: clinically normal, oral lichen planus, gingival hyperplasia, and superficially-invasive squamous cell carcinoma (SCC). The optical and fluorescence lifetime properties of each specimen were recorded. Results Both quantitative and qualitative differences between normal, benign and SCC lesions can be resolved with FLIM-RCM imaging. The results demonstrate that an integrated approach based on these two methods can potentially enable rapid screening and evaluation of large areas of oral epithelial tissue. Conclusions Early results from ongoing studies of imaging human oral cavity illustrate the synergistic combination of the two modalities. An adjunct device based on such optical characterization of oral mucosa can potentially be used to detect oral carcinogenesis in early stages. PMID:26725720

  5. Design and characterization of a handheld multimodal imaging device for the assessment of oral epithelial lesions

    PubMed Central

    Higgins, Laura M.; Pierce, Mark C.

    2014-01-01

    Abstract. A compact handpiece combining high resolution fluorescence (HRF) imaging with optical coherence tomography (OCT) was developed to provide real-time assessment of oral lesions. This multimodal imaging device simultaneously captures coregistered en face images with subcellular detail alongside cross-sectional images of tissue microstructure. The HRF imaging acquires a 712×594  μm2 field-of-view at the sample with a spatial resolution of 3.5  μm. The OCT images were acquired to a depth of 1.5 mm with axial and lateral resolutions of 9.3 and 8.0  μm, respectively. HRF and OCT images are simultaneously displayed at 25 fps. The handheld device was used to image a healthy volunteer, demonstrating the potential for in vivo assessment of the epithelial surface for dysplastic and neoplastic changes at the cellular level, while simultaneously evaluating submucosal involvement. We anticipate potential applications in real-time assessment of oral lesions for improved surveillance and surgical guidance. PMID:25104410

  6. Multi-modal hard x-ray imaging with a laboratory source using selective reflection from a mirror.

    PubMed

    Pelliccia, Daniele; Paganin, David M

    2014-04-01

    Multi-modal hard x-ray imaging sensitive to absorption, refraction, phase and scattering contrast is demonstrated using a simple setup implemented with a laboratory source. The method is based on selective reflection at the edge of a mirror, aligned to partially reflect a pencil x-ray beam after its interaction with a sample. Quantitative scattering contrast from a test sample is experimentally demonstrated using this method. Multi-modal imaging of a house fly (Musca domestica) is shown as proof of principle of the technique for biological samples.

  7. Multi-modal hard x-ray imaging with a laboratory source using selective reflection from a mirror

    PubMed Central

    Pelliccia, Daniele; Paganin, David M.

    2014-01-01

    Multi-modal hard x-ray imaging sensitive to absorption, refraction, phase and scattering contrast is demonstrated using a simple setup implemented with a laboratory source. The method is based on selective reflection at the edge of a mirror, aligned to partially reflect a pencil x-ray beam after its interaction with a sample. Quantitative scattering contrast from a test sample is experimentally demonstrated using this method. Multi-modal imaging of a house fly (Musca domestica) is shown as proof of principle of the technique for biological samples. PMID:24761297

  8. Identifying disease sensitive and quantitative trait-relevant biomarkers from multidimensional heterogeneous imaging genetics data via sparse multimodal multitask learning.

    PubMed

    Wang, Hua; Nie, Feiping; Huang, Heng; Risacher, Shannon L; Saykin, Andrew J; Shen, Li

    2012-06-15

    Recent advances in brain imaging and high-throughput genotyping techniques enable new approaches to study the influence of genetic and anatomical variations on