[Usefulness of computed tomography with three-dimensional reconstructions in visualization of cervical spine malformation of a child with Sprengel's deformity].

PubMed

Wawrzynek, Wojciech; Siemianowicz, Anna; Koczy, Bogdan; Kasprowska, Sabina; Besler, Krzysztof

2005-01-01

The Sprengel's deformity is a congenital anomaly of the shoulder girdle with an elevation of the scapula and limitation of movement of the shoulder. Sprengel's deformity is frequently associated with cervical spine malformations such as: spinal synostosis, spina bifida and an abnormal omovertebral fibrous, cartilaginous or osseus connection. The diagnosis of Sprengel's deformity is based on a clinical examination and radiological procedures. In every case of Sprengel's deformity plain radiography and computed tomography should be performed. Three-dimensional (3D) reconstructions allow to visualize precise topography and spatial proportions of examined bone structures. 3D reconstruction also enables an optional rotation of visualized bone structures in order to clarify the anatomical abnormalities and to plan surgical treatment.

Nerves of Steel: a Low-Cost Method for 3D Printing the Cranial Nerves.

PubMed

Javan, Ramin; Davidson, Duncan; Javan, Afshin

2017-10-01

Steady-state free precession (SSFP) magnetic resonance imaging (MRI) can demonstrate details down to the cranial nerve (CN) level. High-resolution three-dimensional (3D) visualization can now quickly be performed at the workstation. However, we are still limited by visualization on flat screens. The emerging technologies in rapid prototyping or 3D printing overcome this limitation. It comprises a variety of automated manufacturing techniques, which use virtual 3D data sets to fabricate solid forms in a layer-by-layer technique. The complex neuroanatomy of the CNs may be better understood and depicted by the use of highly customizable advanced 3D printed models. In this technical note, after manually perfecting the segmentation of each CN and brain stem on each SSFP-MRI image, initial 3D reconstruction was performed. The bony skull base was also reconstructed from computed tomography (CT) data. Autodesk 3D Studio Max, available through freeware student/educator license, was used to three-dimensionally trace the 3D reconstructed CNs in order to create smooth graphically designed CNs and to assure proper fitting of the CNs into their respective neural foramina and fissures. This model was then 3D printed with polyamide through a commercial online service. Two different methods are discussed for the key segmentation and 3D reconstruction steps, by either using professional commercial software, i.e., Materialise Mimics, or utilizing a combination of the widely available software Adobe Photoshop, as well as a freeware software, OsiriX Lite.

3D second harmonic generation imaging tomography by multi-view excitation

PubMed Central

Campbell, Kirby R.; Wen, Bruce; Shelton, Emily M.; Swader, Robert; Cox, Benjamin L.; Eliceiri, Kevin; Campagnola, Paul J.

2018-01-01

Biological tissues have complex 3D collagen fiber architecture that cannot be fully visualized by conventional second harmonic generation (SHG) microscopy due to electric dipole considerations. We have developed a multi-view SHG imaging platform that successfully visualizes all orientations of collagen fibers. This is achieved by rotating tissues relative to the excitation laser plane of incidence, where the complete fibrillar structure is then visualized following registration and reconstruction. We evaluated high frequency and Gaussian weighted fusion reconstruction algorithms, and found the former approach performs better in terms of the resulting resolution. The new approach is a first step toward SHG tomography. PMID:29541654

3D reconstruction techniques made easy: know-how and pictures.

PubMed

Luccichenti, Giacomo; Cademartiri, Filippo; Pezzella, Francesca Romana; Runza, Giuseppe; Belgrano, Manuel; Midiri, Massimo; Sabatini, Umberto; Bastianello, Stefano; Krestin, Gabriel P

2005-10-01

Three-dimensional reconstructions represent a visual-based tool for illustrating the basis of three-dimensional post-processing such as interpolation, ray-casting, segmentation, percentage classification, gradient calculation, shading and illumination. The knowledge of the optimal scanning and reconstruction parameters facilitates the use of three-dimensional reconstruction techniques in clinical practise. The aim of this article is to explain the principles of multidimensional image processing in a pictorial way and the advantages and limitations of the different possibilities of 3D visualisation.

Volumetric imaging of supersonic boundary layers using filtered Rayleigh scattering background suppression

NASA Technical Reports Server (NTRS)

Forkey, Joseph N.; Lempert, Walter R.; Bogdonoff, Seymour M.; Miles, Richard B.; Russell, G.

1995-01-01

We demonstrate the use of Filtererd Rayleigh Scattering and a 3D reconstruction technique to interrogate the highly three dimensional flow field inside of a supersonic inlet model. A 3 inch by 3 inch by 2.5 inch volume is reconstructed yielding 3D visualizations of the crossing shock waves and of the boundary layer. In this paper we discuss the details of the techniques used, and present the reconstructured 3D images.

Precise photorealistic visualization for restoration of historic buildings based on tacheometry data

NASA Astrophysics Data System (ADS)

Ragia, Lemonia; Sarri, Froso; Mania, Katerina

2018-03-01

This paper puts forward a 3D reconstruction methodology applied to the restoration of historic buildings taking advantage of the speed, range and accuracy of a total geodetic station. The measurements representing geo-referenced points produced an interactive and photorealistic geometric mesh of a monument named `Neoria.' `Neoria' is a Venetian building located by the old harbor at Chania, Crete, Greece. The integration of tacheometry acquisition and computer graphics puts forward a novel integrated software framework for the accurate 3D reconstruction of a historical building. The main technical challenge of this work was the production of a precise 3D mesh based on a sufficient number of tacheometry measurements acquired fast and at low cost, employing a combination of surface reconstruction and processing methods. A fully interactive application based on game engine technologies was developed. The user can visualize and walk through the monument and the area around it as well as photorealistically view it at different times of day and night. Advanced interactive functionalities are offered to the user in relation to identifying restoration areas and visualizing the outcome of such works. The user could visualize the coordinates of the points measured, calculate distances and navigate through the complete 3D mesh of the monument. The geographical data are stored in a database connected with the application. Features referencing and associating the database with the monument are developed. The goal was to utilize a small number of acquired data points and present a fully interactive visualization of a geo-referenced 3D model.

Precise photorealistic visualization for restoration of historic buildings based on tacheometry data

NASA Astrophysics Data System (ADS)

Ragia, Lemonia; Sarri, Froso; Mania, Katerina

2018-04-01

This paper puts forward a 3D reconstruction methodology applied to the restoration of historic buildings taking advantage of the speed, range and accuracy of a total geodetic station. The measurements representing geo-referenced points produced an interactive and photorealistic geometric mesh of a monument named `Neoria.' `Neoria' is a Venetian building located by the old harbor at Chania, Crete, Greece. The integration of tacheometry acquisition and computer graphics puts forward a novel integrated software framework for the accurate 3D reconstruction of a historical building. The main technical challenge of this work was the production of a precise 3D mesh based on a sufficient number of tacheometry measurements acquired fast and at low cost, employing a combination of surface reconstruction and processing methods. A fully interactive application based on game engine technologies was developed. The user can visualize and walk through the monument and the area around it as well as photorealistically view it at different times of day and night. Advanced interactive functionalities are offered to the user in relation to identifying restoration areas and visualizing the outcome of such works. The user could visualize the coordinates of the points measured, calculate distances and navigate through the complete 3D mesh of the monument. The geographical data are stored in a database connected with the application. Features referencing and associating the database with the monument are developed. The goal was to utilize a small number of acquired data points and present a fully interactive visualization of a geo-referenced 3D model.

Micro-CT images reconstruction and 3D visualization for small animal studying

NASA Astrophysics Data System (ADS)

Gong, Hui; Liu, Qian; Zhong, Aijun; Ju, Shan; Fang, Quan; Fang, Zheng

2005-01-01

A small-animal x-ray micro computed tomography (micro-CT) system has been constructed to screen laboratory small animals and organs. The micro-CT system consists of dual fiber-optic taper-coupled CCD detectors with a field-of-view of 25x50 mm2, a microfocus x-ray source, a rotational subject holder. For accurate localization of rotation center, coincidence between the axis of rotation and centre of image was studied by calibration with a polymethylmethacrylate cylinder. Feldkamp"s filtered back-projection cone-beam algorithm is adopted for three-dimensional reconstruction on account of the effective corn-beam angle is 5.67° of the micro-CT system. 200x1024x1024 matrix data of micro-CT is obtained with the magnification of 1.77 and pixel size of 31x31μm2. In our reconstruction software, output image size of micro-CT slices data, magnification factor and rotation sample degree can be modified in the condition of different computational efficiency and reconstruction region. The reconstructed image matrix data is processed and visualization by Visualization Toolkit (VTK). Data parallelism of VTK is performed in surface rendering of reconstructed data in order to improve computing speed. Computing time of processing a 512x512x512 matrix datasets is about 1/20 compared with serial program when 30 CPU is used. The voxel size is 54x54x108 μm3. The reconstruction and 3-D visualization images of laboratory rat ear are presented.

Towards disparity joint upsampling for robust stereoscopic endoscopic scene reconstruction in robotic prostatectomy

NASA Astrophysics Data System (ADS)

Luo, Xiongbiao; McLeod, A. Jonathan; Jayarathne, Uditha L.; Pautler, Stephen E.; Schlacta, Christopher M.; Peters, Terry M.

2016-03-01

Three-dimensional (3-D) scene reconstruction from stereoscopic binocular laparoscopic videos is an effective way to expand the limited surgical field and augment the structure visualization of the organ being operated in minimally invasive surgery. However, currently available reconstruction approaches are limited by image noise, occlusions, textureless and blurred structures. In particular, an endoscope inside the body only has the limited light source resulting in illumination non-uniformities in the visualized field. These limitations unavoidably deteriorate the stereo image quality and hence lead to low-resolution and inaccurate disparity maps, resulting in blurred edge structures in 3-D scene reconstruction. This paper proposes an improved stereo correspondence framework that integrates cost-volume filtering with joint upsampling for robust disparity estimation. Joint bilateral upsampling, joint geodesic upsampling, and tree filtering upsampling were compared to enhance the disparity accuracy. The experimental results demonstrate that joint upsampling provides an effective way to boost the disparity estimation and hence to improve the surgical endoscopic scene 3-D reconstruction. Moreover, the bilateral upsampling generally outperforms the other two upsampling methods in disparity estimation.

One-stop shop for 3-dimensional anatomy of hepatic vasculature and bile duct with special reference to biliary image reconstruction.

PubMed

Enkhbold, Ch; Shimada, M; Utsunomiya, T; Ishibashi, H; Yamada, S; Kanamoto, M; Arakawa, Y; Ikemoto, Z; Morine, E; Imura, S

2013-01-01

Three-dimensional CT has become an essential tool for successful hepatic surgery. Up to now, efforts have been made to simultaneously visualize hepatic vasculature and bile ducts. Herein, we introduce a new one-stop shop approach to hepatic 3D-anatomy, using a standard enhanced MDCT alone. A 3D-reconstruction of hepatic vasculature was made using data from contrast enhanced MDCT and SYNAPSE VINCENT software. We identified bile ducts from axial 2D image, and then reconstructed the 3D image. Both hepatic vasculature and bile duct images were integrated into a single image and it was compared with the 3D image, utilized with MRCP or DIC-CT. The first branches of both the right and left hepatic ducts were hand-traced and visualized for all 100 cases. The second branches of these ducts were visualized in 69 cases, and only the right second branch was recognized in 52 cases. Anomalous variations of bile ducts, such as posterior branch joining into common hepatic duct, were recognized in 12 cases. These biliary tract variations were all confirmed by MRCP or DIC-CT. Our new one-stop shop approach using the 3D imaging technique might contribute to successful hepatectomy as well as reduce medical costs and radiation exposure by omission of MRCP and DIC-CT.

Biplane reconstruction and visualization of virtual endoscopic and fluoroscopic views for interventional device navigation

NASA Astrophysics Data System (ADS)

Wagner, Martin G.; Strother, Charles M.; Schafer, Sebastian; Mistretta, Charles A.

2016-03-01

Biplane fluoroscopic imaging is an important tool for minimally invasive procedures for the treatment of cerebrovascular diseases. However, finding a good working angle for the C-arms of the angiography system as well as navigating based on the 2D projection images can be a difficult task. The purpose of this work is to propose a novel 4D reconstruction algorithm for interventional devices from biplane fluoroscopy images and to propose new techniques for a better visualization of the results. The proposed reconstruction methods binarizes the fluoroscopic images using a dedicated noise reduction algorithm for curvilinear structures and a global thresholding approach. A topology preserving thinning algorithm is then applied and a path search algorithm minimizing the curvature of the device is used to extract the 2D device centerlines. Finally, the 3D device path is reconstructed using epipolar geometry. The point correspondences are determined by a monotonic mapping function that minimizes the reconstruction error. The three dimensional reconstruction of the device path allows the rendering of virtual fluoroscopy images from arbitrary angles as well as 3D visualizations like virtual endoscopic views or glass pipe renderings, where the vessel wall is rendered with a semi-transparent material. This work also proposes a combination of different visualization techniques in order to increase the usability and spatial orientation for the user. A combination of synchronized endoscopic and glass pipe views is proposed, where the virtual endoscopic camera position is determined based on the device tip location as well as the previous camera position using a Kalman filter in order to create a smooth path. Additionally, vessel centerlines are displayed and the path to the target is highlighted. Finally, the virtual endoscopic camera position is also visualized in the glass pipe view to further improve the spatial orientation. The proposed techniques could considerably improve the workflow of minimally invasive procedures for the treatment of cerebrovascular diseases.

Automated UAV-based video exploitation using service oriented architecture framework

NASA Astrophysics Data System (ADS)

Se, Stephen; Nadeau, Christian; Wood, Scott

2011-05-01

Airborne surveillance and reconnaissance are essential for successful military missions. Such capabilities are critical for troop protection, situational awareness, mission planning, damage assessment, and others. Unmanned Aerial Vehicles (UAVs) gather huge amounts of video data but it is extremely labour-intensive for operators to analyze hours and hours of received data. At MDA, we have developed a suite of tools that can process the UAV video data automatically, including mosaicking, change detection and 3D reconstruction, which have been integrated within a standard GIS framework. In addition, the mosaicking and 3D reconstruction tools have also been integrated in a Service Oriented Architecture (SOA) framework. The Visualization and Exploitation Workstation (VIEW) integrates 2D and 3D visualization, processing, and analysis capabilities developed for UAV video exploitation. Visualization capabilities are supported through a thick-client Graphical User Interface (GUI), which allows visualization of 2D imagery, video, and 3D models. The GUI interacts with the VIEW server, which provides video mosaicking and 3D reconstruction exploitation services through the SOA framework. The SOA framework allows multiple users to perform video exploitation by running a GUI client on the operator's computer and invoking the video exploitation functionalities residing on the server. This allows the exploitation services to be upgraded easily and allows the intensive video processing to run on powerful workstations. MDA provides UAV services to the Canadian and Australian forces in Afghanistan with the Heron, a Medium Altitude Long Endurance (MALE) UAV system. On-going flight operations service provides important intelligence, surveillance, and reconnaissance information to commanders and front-line soldiers.

Virtual finger boosts three-dimensional imaging and microsurgery as well as terabyte volume image visualization and analysis.

PubMed

Peng, Hanchuan; Tang, Jianyong; Xiao, Hang; Bria, Alessandro; Zhou, Jianlong; Butler, Victoria; Zhou, Zhi; Gonzalez-Bellido, Paloma T; Oh, Seung W; Chen, Jichao; Mitra, Ananya; Tsien, Richard W; Zeng, Hongkui; Ascoli, Giorgio A; Iannello, Giulio; Hawrylycz, Michael; Myers, Eugene; Long, Fuhui

2014-07-11

Three-dimensional (3D) bioimaging, visualization and data analysis are in strong need of powerful 3D exploration techniques. We develop virtual finger (VF) to generate 3D curves, points and regions-of-interest in the 3D space of a volumetric image with a single finger operation, such as a computer mouse stroke, or click or zoom from the 2D-projection plane of an image as visualized with a computer. VF provides efficient methods for acquisition, visualization and analysis of 3D images for roundworm, fruitfly, dragonfly, mouse, rat and human. Specifically, VF enables instant 3D optical zoom-in imaging, 3D free-form optical microsurgery, and 3D visualization and annotation of terabytes of whole-brain image volumes. VF also leads to orders of magnitude better efficiency of automated 3D reconstruction of neurons and similar biostructures over our previous systems. We use VF to generate from images of 1,107 Drosophila GAL4 lines a projectome of a Drosophila brain.

Analysis and 3D reconstruction of heterogeneity in malignant brain tumors: an interdisciplinary case study using a novel computational visualization approach.

PubMed

Mojsilovic, Aleksandra; Rogowitz, Bernice; Gomes, Jose; Deisboeck, Thomas S

2002-06-01

To explore how a multidisciplinary approach, combining modern visualization and image processing techniques with innovative experimental studies, can augment the understanding of tumor development. We analyzed histologic sections of a microscopic brain tumor and reconstructed these slices into a 3D representation. We processed these slices to: (1) identify tumor boundaries, (2) isolate proliferating tumor cells, and (3) segment the tumor into regions based on the density of proliferating cells. We then reconstructed the 3D shape of the tumor using a constrained deformable surface approach. This novel method allows the analyst to (1) see specific properties of histologic slices in the 3D environment with animation, (2) switch 2D "views" dynamically, and (3) see relationships between the 3D structure and structure on a plane. Using this method to analyze a specific "case," we were also able to shed light on the limitations of a widely held assumption about the shape of expanding microscopic solid tumors as well as find more indications that such tumors behave as adaptive biosystems. Implications of these case study results, as well as future applications of the method for tumor biology research, are discussed.

A graphic user interface for efficient 3D photo-reconstruction based on free software

NASA Astrophysics Data System (ADS)

Castillo, Carlos; James, Michael; Gómez, Jose A.

2015-04-01

Recently, different studies have stressed the applicability of 3D photo-reconstruction based on Structure from Motion algorithms in a wide range of geoscience applications. For the purpose of image photo-reconstruction, a number of commercial and freely available software packages have been developed (e.g. Agisoft Photoscan, VisualSFM). The workflow involves typically different stages such as image matching, sparse and dense photo-reconstruction, point cloud filtering and georeferencing. For approaches using open and free software, each of these stages usually require different applications. In this communication, we present an easy-to-use graphic user interface (GUI) developed in Matlab® code as a tool for efficient 3D photo-reconstruction making use of powerful existing software: VisualSFM (Wu, 2015) for photo-reconstruction and CloudCompare (Girardeau-Montaut, 2015) for point cloud processing. The GUI performs as a manager of configurations and algorithms, taking advantage of the command line modes of existing software, which allows an intuitive and automated processing workflow for the geoscience user. The GUI includes several additional features: a) a routine for significantly reducing the duration of the image matching operation, normally the most time consuming stage; b) graphical outputs for understanding the overall performance of the algorithm (e.g. camera connectivity, point cloud density); c) a number of useful options typically performed before and after the photo-reconstruction stage (e.g. removal of blurry images, image renaming, vegetation filtering); d) a manager of batch processing for the automated reconstruction of different image datasets. In this study we explore the advantages of this new tool by testing its performance using imagery collected in several soil erosion applications. References Girardeau-Montaut, D. 2015. CloudCompare documentation accessed at http://cloudcompare.org/ Wu, C. 2015. VisualSFM documentation access at http://ccwu.me/vsfm/doc.html#.

An Interdisciplinary Method for the Visualization of Novel High-Resolution Precision Photography and Micro-XCT Data Sets of NASA's Apollo Lunar Samples and Antarctic Meteorite Samples to Create Combined Research-Grade 3D Virtual Samples for the Benefit of Astromaterials Collections Conservation, Curation, Scientific Research and Education

NASA Technical Reports Server (NTRS)

Blumenfeld, E. H.; Evans, C. A.; Oshel, E. R.; Liddle, D. A.; Beaulieu, K.; Zeigler, R. A.; Hanna, R. D.; Ketcham, R. A.

2016-01-01

New technologies make possible the advancement of documentation and visualization practices that can enhance conservation and curation protocols for NASA's Astromaterials Collections. With increasing demands for accessibility to updated comprehensive data, and with new sample return missions on the horizon, it is of primary importance to develop new standards for contemporary documentation and visualization methodologies. Our interdisciplinary team has expertise in the fields of heritage conservation practices, professional photography, photogrammetry, imaging science, application engineering, data curation, geoscience, and astromaterials curation. Our objective is to create virtual 3D reconstructions of Apollo Lunar and Antarctic Meteorite samples that are a fusion of two state-of-the-art data sets: the interior view of the sample by collecting Micro-XCT data and the exterior view of the sample by collecting high-resolution precision photography data. These new data provide researchers an information-rich visualization of both compositional and textural information prior to any physical sub-sampling. Since January 2013 we have developed a process that resulted in the successful creation of the first image-based 3D reconstruction of an Apollo Lunar Sample correlated to a 3D reconstruction of the same sample's Micro- XCT data, illustrating that this technique is both operationally possible and functionally beneficial. In May of 2016 we began a 3-year research period during which we aim to produce Virtual Astromaterials Samples for 60 high-priority Apollo Lunar and Antarctic Meteorite samples and serve them on NASA's Astromaterials Acquisition and Curation website. Our research demonstrates that research-grade Virtual Astromaterials Samples are beneficial in preserving for posterity a precise 3D reconstruction of the sample prior to sub-sampling, which greatly improves documentation practices, provides unique and novel visualization of the sample's interior and exterior features, offers scientists a preliminary research tool for targeted sub-sample requests, and additionally is a visually engaging interactive tool for bringing astromaterials science to the public.

An Interdisciplinary Method for the Visualization of Novel High-Resolution Precision Photography and Micro-XCT Data Sets of NASA's Apollo Lunar Samples and Antarctic Meteorite Samples to Create Combined Research-Grade 3D Virtual Samples for the Benefit of Astromaterials Collections Conservation, Curation, Scientific Research and Education

NASA Astrophysics Data System (ADS)

Blumenfeld, E. H.; Evans, C. A.; Zeigler, R. A.; Righter, K.; Beaulieu, K. R.; Oshel, E. R.; Liddle, D. A.; Hanna, R.; Ketcham, R. A.; Todd, N. S.

2016-12-01

New technologies make possible the advancement of documentation and visualization practices that can enhance conservation and curation protocols for NASA's Astromaterials Collections. With increasing demands for accessibility to updated comprehensive data, and with new sample return missions on the horizon, it is of primary importance to develop new standards for contemporary documentation and visualization methodologies. Our interdisciplinary team has expertise in the fields of heritage conservation practices, professional photography, photogrammetry, imaging science, application engineering, data curation, geoscience, and astromaterials curation. Our objective is to create virtual 3D reconstructions of Apollo Lunar and Antarctic Meteorite samples that are a fusion of two state-of-the-art data sets: the interior view of the sample by collecting Micro-XCT data and the exterior view of the sample by collecting high-resolution precision photography data. These new data provide researchers an information-rich visualization of both compositional and textural information prior to any physical sub-sampling. Since January 2013 we have developed a process that resulted in the successful creation of the first image-based 3D reconstruction of an Apollo Lunar Sample correlated to a 3D reconstruction of the same sample's Micro-XCT data, illustrating that this technique is both operationally possible and functionally beneficial. In May of 2016 we began a 3-year research period during which we aim to produce Virtual Astromaterials Samples for 60 high-priority Apollo Lunar and Antarctic Meteorite samples and serve them on NASA's Astromaterials Acquisition and Curation website. Our research demonstrates that research-grade Virtual Astromaterials Samples are beneficial in preserving for posterity a precise 3D reconstruction of the sample prior to sub-sampling, which greatly improves documentation practices, provides unique and novel visualization of the sample's interior and exterior features, offers scientists a preliminary research tool for targeted sub-sample requests, and additionally is a visually engaging interactive tool for bringing astromaterials science to the public.

Retrieving spin textures on curved magnetic thin films with full-field soft X-ray microscopies

DOE PAGES

Streubel, Robert; Kronast, Florian; Fischer, Peter; ...

2015-07-03

X-ray tomography is a well-established technique to characterize 3D structures in material sciences and biology; its magnetic analogue—magnetic X-ray tomography—is yet to be developed. We demonstrate the visualization and reconstruction of magnetic domain structures in a 3D curved magnetic thin films with tubular shape by means of full-field soft X-ray microscopies. In the 3D arrangement of the magnetization is retrieved from a set of 2D projections by analysing the evolution of the magnetic contrast with varying projection angle. By using reconstruction algorithms to analyse the angular evolution of 2D projections provides quantitative information about domain patterns and magnetic coupling phenomenamore » between windings of azimuthally and radially magnetized tubular objects. In conclusion, the present approach represents a first milestone towards visualizing magnetization textures of 3D curved thin films with virtually arbitrary shape.« less

Retrieving spin textures on curved magnetic thin films with full-field soft X-ray microscopies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Streubel, Robert; Kronast, Florian; Fischer, Peter

X-ray tomography is a well-established technique to characterize 3D structures in material sciences and biology; its magnetic analogue—magnetic X-ray tomography—is yet to be developed. We demonstrate the visualization and reconstruction of magnetic domain structures in a 3D curved magnetic thin films with tubular shape by means of full-field soft X-ray microscopies. In the 3D arrangement of the magnetization is retrieved from a set of 2D projections by analysing the evolution of the magnetic contrast with varying projection angle. By using reconstruction algorithms to analyse the angular evolution of 2D projections provides quantitative information about domain patterns and magnetic coupling phenomenamore » between windings of azimuthally and radially magnetized tubular objects. In conclusion, the present approach represents a first milestone towards visualizing magnetization textures of 3D curved thin films with virtually arbitrary shape.« less

Structured illumination microscopy for dual-modality 3D sub-diffraction resolution fluorescence and refractive-index reconstruction

PubMed Central

Chowdhury, Shwetadwip; Eldridge, Will J.; Wax, Adam; Izatt, Joseph A.

2017-01-01

Though structured illumination (SI) microscopy is a popular imaging technique conventionally associated with fluorescent super-resolution, recent works have suggested its applicability towards sub-diffraction resolution coherent imaging with quantitative endogenous biological contrast. Here, we demonstrate that SI can efficiently integrate together the principles of fluorescent super-resolution and coherent synthetic aperture to achieve 3D dual-modality sub-diffraction resolution, fluorescence and refractive-index (RI) visualizations of biological samples. We experimentally demonstrate this framework by introducing a SI microscope capable of 3D sub-diffraction resolution fluorescence and RI imaging, and verify its biological visualization capabilities by experimentally reconstructing 3D RI/fluorescence visualizations of fluorescent calibration microspheres as well as alveolar basal epithelial adenocarcinoma (A549) and human colorectal adenocarcinmoa (HT-29) cells, fluorescently stained for F-actin. This demonstration may suggest SI as an especially promising imaging technique to enable future biological studies that explore synergistically operating biophysical/biochemical and molecular mechanisms at sub-diffraction resolutions. PMID:29296504

[Research on Three-dimensional Medical Image Reconstruction and Interaction Based on HTML5 and Visualization Toolkit].

PubMed

Gao, Peng; Liu, Peng; Su, Hongsen; Qiao, Liang

2015-04-01

Integrating visualization toolkit and the capability of interaction, bidirectional communication and graphics rendering which provided by HTML5, we explored and experimented on the feasibility of remote medical image reconstruction and interaction in pure Web. We prompted server-centric method which did not need to download the big medical data to local connections and avoided considering network transmission pressure and the three-dimensional (3D) rendering capability of client hardware. The method integrated remote medical image reconstruction and interaction into Web seamlessly, which was applicable to lower-end computers and mobile devices. Finally, we tested this method in the Internet and achieved real-time effects. This Web-based 3D reconstruction and interaction method, which crosses over internet terminals and performance limited devices, may be useful for remote medical assistant.

Augmented reality three-dimensional object visualization and recognition with axially distributed sensing.

PubMed

Markman, Adam; Shen, Xin; Hua, Hong; Javidi, Bahram

2016-01-15

An augmented reality (AR) smartglass display combines real-world scenes with digital information enabling the rapid growth of AR-based applications. We present an augmented reality-based approach for three-dimensional (3D) optical visualization and object recognition using axially distributed sensing (ADS). For object recognition, the 3D scene is reconstructed, and feature extraction is performed by calculating the histogram of oriented gradients (HOG) of a sliding window. A support vector machine (SVM) is then used for classification. Once an object has been identified, the 3D reconstructed scene with the detected object is optically displayed in the smartglasses allowing the user to see the object, remove partial occlusions of the object, and provide critical information about the object such as 3D coordinates, which are not possible with conventional AR devices. To the best of our knowledge, this is the first report on combining axially distributed sensing with 3D object visualization and recognition for applications to augmented reality. The proposed approach can have benefits for many applications, including medical, military, transportation, and manufacturing.

3D frequency-domain ultrasound waveform tomography breast imaging

NASA Astrophysics Data System (ADS)

Sandhu, Gursharan Yash; West, Erik; Li, Cuiping; Roy, Olivier; Duric, Neb

2017-03-01

Frequency-domain ultrasound waveform tomography is a promising method for the visualization and characterization of breast disease. It has previously been shown to accurately reconstruct the sound speed distributions of breasts of varying densities. The reconstructed images show detailed morphological and quantitative information that can help differentiate different types of breast disease including benign and malignant lesions. The attenuation properties of an ex vivo phantom have also been assessed. However, the reconstruction algorithms assumed a 2D geometry while the actual data acquisition process was not. Although clinically useful sound speed images can be reconstructed assuming this mismatched geometry, artifacts from the reconstruction process exist within the reconstructed images. This is especially true for registration across different modalities and when the 2D assumption is violated. For example, this happens when a patient's breast is rapidly sloping. It is also true for attenuation imaging where energy lost or gained out of the plane gets transformed into artifacts within the image space. In this paper, we will briefly review ultrasound waveform tomography techniques, give motivation for pursuing the 3D method, discuss the 3D reconstruction algorithm, present the results of 3D forward modeling, show the mismatch that is induced by the violation of 3D modeling via numerical simulations, and present a 3D inversion of a numerical phantom.

Applying microCT and 3D visualization to Jurassic silicified conifer seed cones: A virtual advantage over thin-sectioning.

PubMed

Gee, Carole T

2013-11-01

As an alternative to conventional thin-sectioning, which destroys fossil material, high-resolution X-ray computed tomography (also called microtomography or microCT) integrated with scientific visualization, three-dimensional (3D) image segmentation, size analysis, and computer animation is explored as a nondestructive method of imaging the internal anatomy of 150-million-year-old conifer seed cones from the Late Jurassic Morrison Formation, USA, and of recent and other fossil cones. • MicroCT was carried out on cones using a General Electric phoenix v|tome|x s 240D, and resulting projections were processed with visualization software to produce image stacks of serial single sections for two-dimensional (2D) visualization, 3D segmented reconstructions with targeted structures in color, and computer animations. • If preserved in differing densities, microCT produced images of internal fossil tissues that showed important characters such as seed phyllotaxy or number of seeds per cone scale. Color segmentation of deeply embedded seeds highlighted the arrangement of seeds in spirals. MicroCT of recent cones was even more effective. • This is the first paper on microCT integrated with 3D segmentation and computer animation applied to silicified seed cones, which resulted in excellent 2D serial sections and segmented 3D reconstructions, revealing features requisite to cone identification and understanding of strobilus construction.

An object-oriented simulator for 3D digital breast tomosynthesis imaging system.

PubMed

Seyyedi, Saeed; Cengiz, Kubra; Kamasak, Mustafa; Yildirim, Isa

2013-01-01

Digital breast tomosynthesis (DBT) is an innovative imaging modality that provides 3D reconstructed images of breast to detect the breast cancer. Projections obtained with an X-ray source moving in a limited angle interval are used to reconstruct 3D image of breast. Several reconstruction algorithms are available for DBT imaging. Filtered back projection algorithm has traditionally been used to reconstruct images from projections. Iterative reconstruction algorithms such as algebraic reconstruction technique (ART) were later developed. Recently, compressed sensing based methods have been proposed in tomosynthesis imaging problem. We have developed an object-oriented simulator for 3D digital breast tomosynthesis (DBT) imaging system using C++ programming language. The simulator is capable of implementing different iterative and compressed sensing based reconstruction methods on 3D digital tomosynthesis data sets and phantom models. A user friendly graphical user interface (GUI) helps users to select and run the desired methods on the designed phantom models or real data sets. The simulator has been tested on a phantom study that simulates breast tomosynthesis imaging problem. Results obtained with various methods including algebraic reconstruction technique (ART) and total variation regularized reconstruction techniques (ART+TV) are presented. Reconstruction results of the methods are compared both visually and quantitatively by evaluating performances of the methods using mean structural similarity (MSSIM) values.

An Object-Oriented Simulator for 3D Digital Breast Tomosynthesis Imaging System

PubMed Central

Cengiz, Kubra

2013-01-01

Digital breast tomosynthesis (DBT) is an innovative imaging modality that provides 3D reconstructed images of breast to detect the breast cancer. Projections obtained with an X-ray source moving in a limited angle interval are used to reconstruct 3D image of breast. Several reconstruction algorithms are available for DBT imaging. Filtered back projection algorithm has traditionally been used to reconstruct images from projections. Iterative reconstruction algorithms such as algebraic reconstruction technique (ART) were later developed. Recently, compressed sensing based methods have been proposed in tomosynthesis imaging problem. We have developed an object-oriented simulator for 3D digital breast tomosynthesis (DBT) imaging system using C++ programming language. The simulator is capable of implementing different iterative and compressed sensing based reconstruction methods on 3D digital tomosynthesis data sets and phantom models. A user friendly graphical user interface (GUI) helps users to select and run the desired methods on the designed phantom models or real data sets. The simulator has been tested on a phantom study that simulates breast tomosynthesis imaging problem. Results obtained with various methods including algebraic reconstruction technique (ART) and total variation regularized reconstruction techniques (ART+TV) are presented. Reconstruction results of the methods are compared both visually and quantitatively by evaluating performances of the methods using mean structural similarity (MSSIM) values. PMID:24371468

3D surface reconstruction and visualization of the Drosophila wing imaginal disc at cellular resolution

NASA Astrophysics Data System (ADS)

Bai, Linge; Widmann, Thomas; Jülicher, Frank; Dahmann, Christian; Breen, David

2013-01-01

Quantifying and visualizing the shape of developing biological tissues provide information about the morphogenetic processes in multicellular organisms. The size and shape of biological tissues depend on the number, size, shape, and arrangement of the constituting cells. To better understand the mechanisms that guide tissues into their final shape, it is important to investigate the cellular arrangement within tissues. Here we present a data processing pipeline to generate 3D volumetric surface models of epithelial tissues, as well as geometric descriptions of the tissues' apical cell cross-sections. The data processing pipeline includes image acquisition, editing, processing and analysis, 2D cell mesh generation, 3D contourbased surface reconstruction, cell mesh projection, followed by geometric calculations and color-based visualization of morphological parameters. In their first utilization we have applied these procedures to construct a 3D volumetric surface model at cellular resolution of the wing imaginal disc of Drosophila melanogaster. The ultimate goal of the reported effort is to produce tools for the creation of detailed 3D geometric models of the individual cells in epithelial tissues. To date, 3D volumetric surface models of the whole wing imaginal disc have been created, and the apicolateral cell boundaries have been identified, allowing for the calculation and visualization of cell parameters, e.g. apical cross-sectional area of cells. The calculation and visualization of morphological parameters show position-dependent patterns of cell shape in the wing imaginal disc. Our procedures should offer a general data processing pipeline for the construction of 3D volumetric surface models of a wide variety of epithelial tissues.

Minimizing camera-eye optical aberrations during the 3D reconstruction of retinal structures

NASA Astrophysics Data System (ADS)

Aldana-Iuit, Javier; Martinez-Perez, M. Elena; Espinosa-Romero, Arturo; Diaz-Uribe, Rufino

2010-05-01

3D reconstruction of blood vessels is a powerful visualization tool for physicians, since it allows them to refer to qualitative representation of their subject of study. In this paper we propose a 3D reconstruction method of retinal vessels from fundus images. The reconstruction method propose herein uses images of the same retinal structure in epipolar geometry. Images are preprocessed by RISA system for segmenting blood vessels and obtaining feature points for correspondences. The correspondence points process is solved using correlation. The LMedS analysis and Graph Transformation Matching algorithm are used for outliers suppression. Camera projection matrices are computed with the normalized eight point algorithm. Finally, we retrieve 3D position of the retinal tree points by linear triangulation. In order to increase the power of visualization, 3D tree skeletons are represented by surfaces via generalized cylinders whose radius correspond to morphological measurements obtained by RISA. In this paper the complete calibration process including the fundus camera and the optical properties of the eye, the so called camera-eye system is proposed. On one hand, the internal parameters of the fundus camera are obtained by classical algorithms using a reference pattern. On the other hand, we minimize the undesirable efects of the aberrations induced by the eyeball optical system assuming that contact enlarging lens corrects astigmatism, spherical and coma aberrations are reduced changing the aperture size and eye refractive errors are suppressed adjusting camera focus during image acquisition. Evaluation of two self-calibration proposals and results of 3D blood vessel surface reconstruction are presented.

A Fast 3-Dimensional Magnetic Resonance Imaging Reconstruction for Surgical Planning of Uterine Myomectomy

PubMed Central

2017-01-01

Background Uterine myoma is the most common benign gynecologic tumor in reproductive-aged women. During myomectomy for women who want to preserve fertility, it is advisable to detect and remove all myomas to decrease the risk of additional surgery. However, finding myomas during surgery is often challenging, especially for deep-seated myomas. Therefore, three-dimensional (3D) preoperative localization of myomas can be helpful for the surgical planning for myomectomy. However, the previously reported manual 3D segmenting method takes too much time and effort for clinical use. The objective of this study was to propose a new method of rapid 3D visualization of uterine myoma using a uterine template. Methods Magnetic resonance images were listed according to the slide spacing on each plane of the multiplanar reconstruction, and images that were determined to be myomas were selected by simply scrolling the mouse down. By using the selected images, a 3D grid with a slide spacing interval was constructed and filled on its plane and finally registered to a uterine template. Results The location of multiple myomas in the uterus was visualized in 3D and this proposed method is over 95% faster than the existing manual-segmentation method. Not only the size and location of the myomas, but also the shortest distance between the uterine surface and the myomas, can be calculated. This technique also enables the surgeon to know the number of total, removed, and remaining myomas on the 3D image. Conclusion This proposed 3D reconstruction method with a uterine template enables faster 3D visualization of myomas. PMID:29215821

Three- and four-dimensional reconstruction of intra-cardiac anatomy from two-dimensional magnetic resonance images.

PubMed

Miquel, M E; Hill, D L G; Baker, E J; Qureshi, S A; Simon, R D B; Keevil, S F; Razavi, R S

2003-06-01

The present study was designed to evaluate the feasibility and clinical usefulness of three-dimensional (3D) reconstruction of intra-cardiac anatomy from a series of two-dimensional (2D) MR images using commercially available software. Sixteen patients (eight with structurally normal hearts but due to have catheter radio-frequency ablation of atrial tachyarrhythmias and eight with atrial septal defects (ASD) due for trans-catheter closure) and two volunteers were imaged at 1T. For each patient, a series of ECG-triggered images (5 mm thick slices, 2-3 mm apart) were acquired during breath holding. Depending on image quality, T1- or T2-weighted spin-echo images or gradient-echo cine images were used. The 3D reconstruction was performed off-line: the blood pools within cardiac chambers and great vessels were semi-automatically segmented, their outer surface was extracted using a marching cube algorithm and rendered. Intra- and inter-observer variability, effect of breath-hold position and differences between pulse sequences were assessed by imaging a volunteer. The 3D reconstructions were assessed by three cardiologists and compared with the 2D MR images and with 2D and 3D trans-esophagal and intra-cardiac echocardiography obtained during interventions. In every case, an anatomically detailed 3D volume was obtained. In the two patients where a 3 mm interval between slices was used, the resolution was not as good but it was still possible to visualize all the major anatomical structures. Spin-echo images lead to reconstructions more detailed than those obtained from gradient-echo images. However, gradient-echo images are easier to segment due to their greater contrast. Furthermore, because images were acquired at least at ten points in the cardiac cycles for every slice it was possible to reconstruct a cine loop and, for example, to visualize the evolution of the size and margins of the ASD during the cardiac cycle. 3D reconstruction proved to be an effective way to assess the relationship between the different parts of the cardiac anatomy. The technique was useful in planning interventions in these patients.

Three-dimensional scanner based on fringe projection

NASA Astrophysics Data System (ADS)

Nouri, Taoufik

1995-07-01

This article presents a way of scanning 3D objects using noninvasive and contact loss techniques. The principle is to project parallel fringes on an object and then to record the object at two viewing angles. With an appropriate treatment one can reconstruct the 3D object even when it has no symmetry planes. The 3D surface data are available immediately in digital form for computer visualization and for analysis software tools. The optical setup for recording the object, the data extraction and treatment, and the reconstruction of the object are reported and commented on. Application is proposed for reconstructive/cosmetic surgery, CAD, animation, and research.

3D skin surface reconstruction from a single image by merging global curvature and local texture using the guided filtering for 3D haptic palpation.

PubMed

Lee, K; Kim, M; Kim, K

2018-05-11

Skin surface evaluation has been studied using various imaging techniques. However, all these studies had limited impact because they were performed using visual exam only. To improve on this scenario with haptic feedback, we propose 3D reconstruction of the skin surface using a single image. Unlike extant 3D skin surface reconstruction algorithms, we utilize the local texture and global curvature regions, combining the results for reconstruction. The first entails the reconstruction of global curvature, achieved by bilateral filtering that removes noise on the surface while maintaining the edge (ie, furrow) to obtain the overall curvature. The second entails the reconstruction of local texture, representing the fine wrinkles of the skin, using an advanced form of bilateral filtering. The final image is then composed by merging the two reconstructed images. We tested the curvature reconstruction part by comparing the resulting curvatures with measured values from real phantom objects while local texture reconstruction was verified by measuring skin surface roughness. Then, we showed the reconstructed result of our proposed algorithm via the reconstruction of various real skin surfaces. The experimental results demonstrate that our approach is a promising technology to reconstruct an accurate skin surface with a single skin image. We proposed 3D skin surface reconstruction using only a single camera. We highlighted the utility of global curvature, which has not been considered important in the past. Thus, we proposed a new method for 3D reconstruction that can be used for 3D haptic palpation, dividing the concepts of local and global regions. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

3-D reconstruction of neurons from multichannel confocal laser scanning image series.

PubMed

Wouterlood, Floris G

2014-04-10

A confocal laser scanning microscope (CLSM) collects information from a thin, focal plane and ignores out-of-focus information. Scanning of a specimen, with stepwise axial (Z-) movement of the stage in between each scan, produces Z-series of confocal images of a tissue volume, which then can be used to 3-D reconstruct structures of interest. The operator first configures separate channels (e.g., laser, filters, and detector settings) for each applied fluorochrome and then acquires Z-series of confocal images: one series per channel. Channel signal separation is extremely important. Measures to avoid bleaching are vital. Post-acquisition deconvolution of the image series is often performed to increase resolution before 3-D reconstruction takes place. In the 3-D reconstruction programs described in this unit, reconstructions can be inspected in real time from any viewing angle. By altering viewing angles and by switching channels off and on, the spatial relationships of 3-D-reconstructed structures with respect to structures visualized in other channels can be studied. Since each brand of CLSM, computer program, and 3-D reconstruction package has its own proprietary set of procedures, a general approach is provided in this protocol wherever possible. Copyright © 2014 John Wiley & Sons, Inc.

A fast 4D cone beam CT reconstruction method based on the OSC-TV algorithm.

PubMed

Mascolo-Fortin, Julia; Matenine, Dmitri; Archambault, Louis; Després, Philippe

2018-01-01

Four-dimensional cone beam computed tomography allows for temporally resolved imaging with useful applications in radiotherapy, but raises particular challenges in terms of image quality and computation time. The purpose of this work is to develop a fast and accurate 4D algorithm by adapting a GPU-accelerated ordered subsets convex algorithm (OSC), combined with the total variation minimization regularization technique (TV). Different initialization schemes were studied to adapt the OSC-TV algorithm to 4D reconstruction: each respiratory phase was initialized either with a 3D reconstruction or a blank image. Reconstruction algorithms were tested on a dynamic numerical phantom and on a clinical dataset. 4D iterations were implemented for a cluster of 8 GPUs. All developed methods allowed for an adequate visualization of the respiratory movement and compared favorably to the McKinnon-Bates and adaptive steepest descent projection onto convex sets algorithms, while the 4D reconstructions initialized from a prior 3D reconstruction led to better overall image quality. The most suitable adaptation of OSC-TV to 4D CBCT was found to be a combination of a prior FDK reconstruction and a 4D OSC-TV reconstruction with a reconstruction time of 4.5 minutes. This relatively short reconstruction time could facilitate a clinical use.

Improved Visualization of Intracranial Vessels with Intraoperative Coregistration of Rotational Digital Subtraction Angiography and Intraoperative 3D Ultrasound

PubMed Central

Podlesek, Dino; Meyer, Tobias; Morgenstern, Ute; Schackert, Gabriele; Kirsch, Matthias

2015-01-01

Introduction Ultrasound can visualize and update the vessel status in real time during cerebral vascular surgery. We studied the depiction of parent vessels and aneurysms with a high-resolution 3D intraoperative ultrasound imaging system during aneurysm clipping using rotational digital subtraction angiography as a reference. Methods We analyzed 3D intraoperative ultrasound in 39 patients with cerebral aneurysms to visualize the aneurysm intraoperatively and the nearby vascular tree before and after clipping. Simultaneous coregistration of preoperative subtraction angiography data with 3D intraoperative ultrasound was performed to verify the anatomical assignment. Results Intraoperative ultrasound detected 35 of 43 aneurysms (81%) in 39 patients. Thirty-nine intraoperative ultrasound measurements were matched with rotational digital subtraction angiography and were successfully reconstructed during the procedure. In 7 patients, the aneurysm was partially visualized by 3D-ioUS or was not in field of view. Post-clipping intraoperative ultrasound was obtained in 26 and successfully reconstructed in 18 patients (69%) despite clip related artefacts. The overlap between 3D-ioUS aneurysm volume and preoperative rDSA aneurysm volume resulted in a mean accuracy of 0.71 (Dice coefficient). Conclusions Intraoperative coregistration of 3D intraoperative ultrasound data with preoperative rotational digital subtraction angiography is possible with high accuracy. It allows the immediate visualization of vessels beyond the microscopic field, as well as parallel assessment of blood velocity, aneurysm and vascular tree configuration. Although spatial resolution is lower than for standard angiography, the method provides an excellent vascular overview, advantageous interpretation of 3D-ioUS and immediate intraoperative feedback of the vascular status. A prerequisite for understanding vascular intraoperative ultrasound is image quality and a successful match with preoperative rotational digital subtraction angiography. PMID:25803318

Improved visualization of intracranial vessels with intraoperative coregistration of rotational digital subtraction angiography and intraoperative 3D ultrasound.

PubMed

Podlesek, Dino; Meyer, Tobias; Morgenstern, Ute; Schackert, Gabriele; Kirsch, Matthias

2015-01-01

Ultrasound can visualize and update the vessel status in real time during cerebral vascular surgery. We studied the depiction of parent vessels and aneurysms with a high-resolution 3D intraoperative ultrasound imaging system during aneurysm clipping using rotational digital subtraction angiography as a reference. We analyzed 3D intraoperative ultrasound in 39 patients with cerebral aneurysms to visualize the aneurysm intraoperatively and the nearby vascular tree before and after clipping. Simultaneous coregistration of preoperative subtraction angiography data with 3D intraoperative ultrasound was performed to verify the anatomical assignment. Intraoperative ultrasound detected 35 of 43 aneurysms (81%) in 39 patients. Thirty-nine intraoperative ultrasound measurements were matched with rotational digital subtraction angiography and were successfully reconstructed during the procedure. In 7 patients, the aneurysm was partially visualized by 3D-ioUS or was not in field of view. Post-clipping intraoperative ultrasound was obtained in 26 and successfully reconstructed in 18 patients (69%) despite clip related artefacts. The overlap between 3D-ioUS aneurysm volume and preoperative rDSA aneurysm volume resulted in a mean accuracy of 0.71 (Dice coefficient). Intraoperative coregistration of 3D intraoperative ultrasound data with preoperative rotational digital subtraction angiography is possible with high accuracy. It allows the immediate visualization of vessels beyond the microscopic field, as well as parallel assessment of blood velocity, aneurysm and vascular tree configuration. Although spatial resolution is lower than for standard angiography, the method provides an excellent vascular overview, advantageous interpretation of 3D-ioUS and immediate intraoperative feedback of the vascular status. A prerequisite for understanding vascular intraoperative ultrasound is image quality and a successful match with preoperative rotational digital subtraction angiography.

3D documenatation of the petalaindera: digital heritage preservation methods using 3D laser scanner and photogrammetry

NASA Astrophysics Data System (ADS)

Sharif, Harlina Md; Hazumi, Hazman; Hafizuddin Meli, Rafiq

2018-01-01

3D imaging technologies have undergone massive revolution in recent years. Despite this rapid development, documentation of 3D cultural assets in Malaysia is still very much reliant upon conventional techniques such as measured drawings and manual photogrammetry. There is very little progress towards exploring new methods or advanced technologies to convert 3D cultural assets into 3D visual representation and visualization models that are easily accessible for information sharing. In recent years, however, the advent of computer vision (CV) algorithms make it possible to reconstruct 3D geometry of objects by using image sequences from digital cameras, which are then processed by web services and freeware applications. This paper presents a completed stage of an exploratory study that investigates the potentials of using CV automated image-based open-source software and web services to reconstruct and replicate cultural assets. By selecting an intricate wooden boat, Petalaindera, this study attempts to evaluate the efficiency of CV systems and compare it with the application of 3D laser scanning, which is known for its accuracy, efficiency and high cost. The final aim of this study is to compare the visual accuracy of 3D models generated by CV system, and 3D models produced by 3D scanning and manual photogrammetry for an intricate subject such as the Petalaindera. The final objective is to explore cost-effective methods that could provide fundamental guidelines on the best practice approach for digital heritage in Malaysia.

Three-dimensional imaging from a unidirectional hologram: wide-viewing-zone projection type.

PubMed

Okoshi, T; Oshima, K

1976-04-01

In ordinary holography reconstructing a virtual image, the hologram must be wider than either the visual field or the viewing zone. In this paper, an economical method of recording a wide-viewing-zone wide-visual-field 3-D holographic image is proposed. In this method, many mirrors are used to collect object waves onto a small hologram. In the reconstruction, a real image from the hologram is projected onto a horizontally direction-selective stereoscreen through the same mirrors. In the experiment, satisfactory 3-D images have been observed from a wide viewing zone. The optimum design and information reduction techniques are also discussed.

Three-dimensional visualization system as an aid for facial surgical planning

NASA Astrophysics Data System (ADS)

Barre, Sebastien; Fernandez-Maloigne, Christine; Paume, Patricia; Subrenat, Gilles

2001-05-01

We present an aid for facial deformities treatment. We designed a system for surgical planning and prediction of human facial aspect after maxillo-facial surgery. We study the 3D reconstruction process of the tissues involved in the simulation, starting from CT acquisitions. 3D iso-surfaces meshes of soft tissues and bone structures are built. A sparse set of still photographs is used to reconstruct a 360 degree(s) texture of the facial surface and increase its visual realism. Reconstructed objects are inserted into an object-oriented, portable and scriptable visualization software allowing the practitioner to manipulate and visualize them interactively. Several LODs (Level-Of- Details) techniques are used to ensure usability. Bone structures are separated and moved by means of cut planes matching orthognatic surgery procedures. We simulate soft tissue deformations by creating a physically-based springs model between both tissues. The new static state of the facial model is computed by minimizing the energy of the springs system to achieve equilibrium. This process is optimized by transferring informations like participation hints at vertex-level between a warped generic model and the facial mesh.

Applying microCT and 3D visualization to Jurassic silicified conifer seed cones: A virtual advantage over thin-sectioning1

PubMed Central

Gee, Carole T.

2013-01-01

• Premise of the study: As an alternative to conventional thin-sectioning, which destroys fossil material, high-resolution X-ray computed tomography (also called microtomography or microCT) integrated with scientific visualization, three-dimensional (3D) image segmentation, size analysis, and computer animation is explored as a nondestructive method of imaging the internal anatomy of 150-million-year-old conifer seed cones from the Late Jurassic Morrison Formation, USA, and of recent and other fossil cones. • Methods: MicroCT was carried out on cones using a General Electric phoenix v|tome|x s 240D, and resulting projections were processed with visualization software to produce image stacks of serial single sections for two-dimensional (2D) visualization, 3D segmented reconstructions with targeted structures in color, and computer animations. • Results: If preserved in differing densities, microCT produced images of internal fossil tissues that showed important characters such as seed phyllotaxy or number of seeds per cone scale. Color segmentation of deeply embedded seeds highlighted the arrangement of seeds in spirals. MicroCT of recent cones was even more effective. • Conclusions: This is the first paper on microCT integrated with 3D segmentation and computer animation applied to silicified seed cones, which resulted in excellent 2D serial sections and segmented 3D reconstructions, revealing features requisite to cone identification and understanding of strobilus construction. PMID:25202495

Enhanced visualization of the retinal vasculature using depth information in OCT.

PubMed

de Moura, Joaquim; Novo, Jorge; Charlón, Pablo; Barreira, Noelia; Ortega, Marcos

2017-12-01

Retinal vessel tree extraction is a crucial step for analyzing the microcirculation, a frequently needed process in the study of relevant diseases. To date, this has normally been done by using 2D image capture paradigms, offering a restricted visualization of the real layout of the retinal vasculature. In this work, we propose a new approach that automatically segments and reconstructs the 3D retinal vessel tree by combining near-infrared reflectance retinography information with Optical Coherence Tomography (OCT) sections. Our proposal identifies the vessels, estimates their calibers, and obtains the depth at all the positions of the entire vessel tree, thereby enabling the reconstruction of the 3D layout of the complete arteriovenous tree for subsequent analysis. The method was tested using 991 OCT images combined with their corresponding near-infrared reflectance retinography. The different stages of the methodology were validated using the opinion of an expert as a reference. The tests offered accurate results, showing coherent reconstructions of the 3D vasculature that can be analyzed in the diagnosis of relevant diseases affecting the retinal microcirculation, such as hypertension or diabetes, among others.

3D reconstruction of internal structure of animal body using near-infrared light

NASA Astrophysics Data System (ADS)

Tran, Trung Nghia; Yamamoto, Kohei; Namita, Takeshi; Kato, Yuji; Shimizu, Koichi

2014-03-01

To realize three-dimensional (3D) optical imaging of the internal structure of animal body, we have developed a new technique to reconstruct CT images from two-dimensional (2D) transillumination images. In transillumination imaging, the image is blurred due to the strong scattering in the tissue. We had developed a scattering suppression technique using the point spread function (PSF) for a fluorescent light source in the body. In this study, we have newly proposed a technique to apply this PSF for a light source to the image of unknown light-absorbing structure. The effectiveness of the proposed technique was examined in the experiments with a model phantom and a mouse. In the phantom experiment, the absorbers were placed in the tissue-equivalent medium to simulate the light-absorbing organs in mouse body. Near-infrared light was illuminated from one side of the phantom and the image was recorded with CMOS camera from another side. Using the proposed techniques, the scattering effect was efficiently suppressed and the absorbing structure can be visualized in the 2D transillumination image. Using the 2D images obtained in many different orientations, we could reconstruct the 3D image. In the mouse experiment, an anesthetized mouse was held in an acrylic cylindrical holder. We can visualize the internal organs such as kidneys through mouse's abdomen using the proposed technique. The 3D image of the kidneys and a part of the liver were reconstructed. Through these experimental studies, the feasibility of practical 3D imaging of the internal light-absorbing structure of a small animal was verified.

3D-Reconstructions and Virtual 4D-Visualization to Study Metamorphic Brain Development in the Sphinx Moth Manduca Sexta

PubMed Central

Huetteroth, Wolf; el Jundi, Basil; el Jundi, Sirri; Schachtner, Joachim

2009-01-01

During metamorphosis, the transition from the larva to the adult, the insect brain undergoes considerable remodeling: new neurons are integrated while larval neurons are remodeled or eliminated. One well acknowledged model to study metamorphic brain development is the sphinx moth Manduca sexta. To further understand mechanisms involved in the metamorphic transition of the brain we generated a 3D standard brain based on selected brain areas of adult females and 3D reconstructed the same areas during defined stages of pupal development. Selected brain areas include for example mushroom bodies, central complex, antennal- and optic lobes. With this approach we eventually want to quantify developmental changes in neuropilar architecture, but also quantify changes in the neuronal complement and monitor the development of selected neuronal populations. Furthermore, we used a modeling software (Cinema 4D) to create a virtual 4D brain, morphing through its developmental stages. Thus the didactical advantages of 3D visualization are expanded to better comprehend complex processes of neuropil formation and remodeling during development. To obtain datasets of the M. sexta brain areas, we stained whole brains with an antiserum against the synaptic vesicle protein synapsin. Such labeled brains were then scanned with a confocal laser scanning microscope and selected neuropils were reconstructed with the 3D software AMIRA 4.1. PMID:20339481

3D-Reconstructions and Virtual 4D-Visualization to Study Metamorphic Brain Development in the Sphinx Moth Manduca Sexta.

PubMed

Huetteroth, Wolf; El Jundi, Basil; El Jundi, Sirri; Schachtner, Joachim

2010-01-01

DURING METAMORPHOSIS, THE TRANSITION FROM THE LARVA TO THE ADULT, THE INSECT BRAIN UNDERGOES CONSIDERABLE REMODELING: new neurons are integrated while larval neurons are remodeled or eliminated. One well acknowledged model to study metamorphic brain development is the sphinx moth Manduca sexta. To further understand mechanisms involved in the metamorphic transition of the brain we generated a 3D standard brain based on selected brain areas of adult females and 3D reconstructed the same areas during defined stages of pupal development. Selected brain areas include for example mushroom bodies, central complex, antennal- and optic lobes. With this approach we eventually want to quantify developmental changes in neuropilar architecture, but also quantify changes in the neuronal complement and monitor the development of selected neuronal populations. Furthermore, we used a modeling software (Cinema 4D) to create a virtual 4D brain, morphing through its developmental stages. Thus the didactical advantages of 3D visualization are expanded to better comprehend complex processes of neuropil formation and remodeling during development. To obtain datasets of the M. sexta brain areas, we stained whole brains with an antiserum against the synaptic vesicle protein synapsin. Such labeled brains were then scanned with a confocal laser scanning microscope and selected neuropils were reconstructed with the 3D software AMIRA 4.1.

[Three-dimensional morphological modeling and visualization of wheat root system].

PubMed

Tan, Feng; Tang, Liang; Hu, Jun-Cheng; Jiang, Hai-Yan; Cao, Wei-Xing; Zhu, Yan

2011-01-01

Crop three-dimensional (3D) morphological modeling and visualization is an important part of digital plant study. This paper aimed to develop a 3D morphological model of wheat root system based on the parameters of wheat root morphological features, and to realize the visualization of wheat root growth. According to the framework of visualization technology for wheat root growth, a 3D visualization model of wheat root axis, including root axis growth model, branch geometric model, and root axis curve model, was developed firstly. Then, by integrating root topology, the corresponding pixel was determined, and the whole wheat root system was three-dimensionally re-constructed by using the morphological feature parameters in the root morphological model. Finally, based on the platform of OpenGL, and by integrating the technologies of texture mapping, lighting rendering, and collision detection, the 3D visualization of wheat root growth was realized. The 3D output of wheat root system from the model was vivid, which could realize the 3D root system visualization of different wheat cultivars under different water regimes and nitrogen application rates. This study could lay a technical foundation for further development of an integral visualization system of wheat plant.

Three-dimensional reconstruction from serial sections in PC-Windows platform by using 3D_Viewer.

PubMed

Xu, Yi-Hua; Lahvis, Garet; Edwards, Harlene; Pitot, Henry C

2004-11-01

Three-dimensional (3D) reconstruction from serial sections allows identification of objects of interest in 3D and clarifies the relationship among these objects. 3D_Viewer, developed in our laboratory for this purpose, has four major functions: image alignment, movie frame production, movie viewing, and shift-overlay image generation. Color images captured from serial sections were aligned; then the contours of objects of interest were highlighted in a semi-automatic manner. These 2D images were then automatically stacked at different viewing angles, and their composite images on a projected plane were recorded by an image transform-shift-overlay technique. These composition images are used in the object-rotation movie show. The design considerations of the program and the procedures used for 3D reconstruction from serial sections are described. This program, with a digital image-capture system, a semi-automatic contours highlight method, and an automatic image transform-shift-overlay technique, greatly speeds up the reconstruction process. Since images generated by 3D_Viewer are in a general graphic format, data sharing with others is easy. 3D_Viewer is written in MS Visual Basic 6, obtainable from our laboratory on request.

A Java tool for dynamic web-based 3D visualization of anatomy and overlapping gene or protein expression patterns.

PubMed

Gerth, Victor E; Vize, Peter D

2005-04-01

The Gene Expression Viewer is a web-launched three-dimensional visualization tool, tailored to compare surface reconstructions of multi-channel image volumes generated by confocal microscopy or micro-CT.

Multi-Mission Simulation and Visualization for Real-Time Telemetry Display, Playback and EDL Event Reconstruction

NASA Technical Reports Server (NTRS)

Pomerantz, M. I.; Lim, C.; Myint, S.; Woodward, G.; Balaram, J.; Kuo, C.

2012-01-01

he Jet Propulsion Laboratory's Entry, Descent and Landing (EDL) Reconstruction Task has developed a software system that provides mission operations personnel and analysts with a real time telemetry-based live display, playback and post-EDL reconstruction capability that leverages the existing high-fidelity, physics-based simulation framework and modern game engine-derived 3D visualization system developed in the JPL Dynamics and Real Time Simulation (DARTS) Lab. Developed as a multi-mission solution, the EDL Telemetry Visualization (ETV) system has been used for a variety of projects including NASA's Mars Science Laboratory (MSL), NASA'S Low Density Supersonic Decelerator (LDSD) and JPL's MoonRise Lunar sample return proposal.

Occupancy mapping and surface reconstruction using local Gaussian processes with Kinect sensors.

PubMed

Kim, Soohwan; Kim, Jonghyuk

2013-10-01

Although RGB-D sensors have been successfully applied to visual SLAM and surface reconstruction, most of the applications aim at visualization. In this paper, we propose a noble method of building continuous occupancy maps and reconstructing surfaces in a single framework for both navigation and visualization. Particularly, we apply a Bayesian nonparametric approach, Gaussian process classification, to occupancy mapping. However, it suffers from high-computational complexity of O(n(3))+O(n(2)m), where n and m are the numbers of training and test data, respectively, limiting its use for large-scale mapping with huge training data, which is common with high-resolution RGB-D sensors. Therefore, we partition both training and test data with a coarse-to-fine clustering method and apply Gaussian processes to each local clusters. In addition, we consider Gaussian processes as implicit functions, and thus extract iso-surfaces from the scalar fields, continuous occupancy maps, using marching cubes. By doing that, we are able to build two types of map representations within a single framework of Gaussian processes. Experimental results with 2-D simulated data show that the accuracy of our approximated method is comparable to previous work, while the computational time is dramatically reduced. We also demonstrate our method with 3-D real data to show its feasibility in large-scale environments.

MRI segmentation by active contours model, 3D reconstruction, and visualization

NASA Astrophysics Data System (ADS)

Lopez-Hernandez, Juan M.; Velasquez-Aguilar, J. Guadalupe

2005-02-01

The advances in 3D data modelling methods are becoming increasingly popular in the areas of biology, chemistry and medical applications. The Nuclear Magnetic Resonance Imaging (NMRI) technique has progressed at a spectacular rate over the past few years, its uses have been spread over many applications throughout the body in both anatomical and functional investigations. In this paper we present the application of Zernike polynomials for 3D mesh model of the head using the contour acquired of cross-sectional slices by active contour model extraction and we propose the visualization with OpenGL 3D Graphics of the 2D-3D (slice-surface) information for the diagnostic aid in medical applications.

Three-dimensional model of the skull and the cranial bones reconstructed from CT scans designed for rapid prototyping process.

PubMed

Skrzat, Janusz; Spulber, Alexandru; Walocha, Jerzy

This paper presents the effects of building mesh models of the human skull and the cranial bones from a series of CT-scans. With the aid of computer so ware, 3D reconstructions of the whole skull and segmented cranial bones were performed and visualized by surface rendering techniques. The article briefly discusses clinical and educational applications of 3D cranial models created using stereolitographic reproduction.

PET Image Reconstruction Incorporating 3D Mean-Median Sinogram Filtering

NASA Astrophysics Data System (ADS)

Mokri, S. S.; Saripan, M. I.; Rahni, A. A. Abd; Nordin, A. J.; Hashim, S.; Marhaban, M. H.

2016-02-01

Positron Emission Tomography (PET) projection data or sinogram contained poor statistics and randomness that produced noisy PET images. In order to improve the PET image, we proposed an implementation of pre-reconstruction sinogram filtering based on 3D mean-median filter. The proposed filter is designed based on three aims; to minimise angular blurring artifacts, to smooth flat region and to preserve the edges in the reconstructed PET image. The performance of the pre-reconstruction sinogram filter prior to three established reconstruction methods namely filtered-backprojection (FBP), Maximum likelihood expectation maximization-Ordered Subset (OSEM) and OSEM with median root prior (OSEM-MRP) is investigated using simulated NCAT phantom PET sinogram as generated by the PET Analytical Simulator (ASIM). The improvement on the quality of the reconstructed images with and without sinogram filtering is assessed according to visual as well as quantitative evaluation based on global signal to noise ratio (SNR), local SNR, contrast to noise ratio (CNR) and edge preservation capability. Further analysis on the achieved improvement is also carried out specific to iterative OSEM and OSEM-MRP reconstruction methods with and without pre-reconstruction filtering in terms of contrast recovery curve (CRC) versus noise trade off, normalised mean square error versus iteration, local CNR versus iteration and lesion detectability. Overall, satisfactory results are obtained from both visual and quantitative evaluations.

Dynamic three-dimensional display of common congenital cardiac defects from reconstruction of two-dimensional echocardiographic images.

PubMed

Hsieh, K S; Lin, C C; Liu, W S; Chen, F L

1996-01-01

Two-dimensional echocardiography had long been a standard diagnostic modality for congenital heart disease. Further attempts of three-dimensional reconstruction using two-dimensional echocardiographic images to visualize stereotypic structure of cardiac lesions have been successful only recently. So far only very few studies have been done to display three-dimensional anatomy of the heart through two-dimensional image acquisition because such complex procedures were involved. This study introduced a recently developed image acquisition and processing system for dynamic three-dimensional visualization of various congenital cardiac lesions. From December 1994 to April 1995, 35 cases were selected in the Echo Laboratory here from about 3000 Echo examinations completed. Each image was acquired on-line with specially designed high resolution image grazmber with EKG and respiratory gating technique. Off-line image processing using a window-architectured interactive software package includes construction of 2-D ehcocardiographic pixel to 3-D "voxel" with conversion of orthogonal to rotatory axial system, interpolation, extraction of region of interest, segmentation, shading and, finally, 3D rendering. Three-dimensional anatomy of various congenital cardiac defects was shown, including four cases with ventricular septal defects, two cases with atrial septal defects, and two cases with aortic stenosis. Dynamic reconstruction of a "beating heart" is recorded as vedio tape with video interface. The potential application of 3D display of the reconstruction from 2D echocardiographic images for the diagnosis of various congenital heart defects has been shown. The 3D display was able to improve the diagnostic ability of echocardiography, and clear-cut display of the various congenital cardiac defects and vavular stenosis could be demonstrated. Reinforcement of current techniques will expand future application of 3D display of conventional 2D images.

A method for brain 3D surface reconstruction from MR images

NASA Astrophysics Data System (ADS)

Zhao, De-xin

2014-09-01

Due to the encephalic tissues are highly irregular, three-dimensional (3D) modeling of brain always leads to complicated computing. In this paper, we explore an efficient method for brain surface reconstruction from magnetic resonance (MR) images of head, which is helpful to surgery planning and tumor localization. A heuristic algorithm is proposed for surface triangle mesh generation with preserved features, and the diagonal length is regarded as the heuristic information to optimize the shape of triangle. The experimental results show that our approach not only reduces the computational complexity, but also completes 3D visualization with good quality.

Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization.

PubMed

Lee, Sing Chun; Fuerst, Bernhard; Fotouhi, Javad; Fischer, Marius; Osgood, Greg; Navab, Nassir

2016-06-01

This work proposes a novel algorithm to register cone-beam computed tomography (CBCT) volumes and 3D optical (RGBD) camera views. The co-registered real-time RGBD camera and CBCT imaging enable a novel augmented reality solution for orthopedic surgeries, which allows arbitrary views using digitally reconstructed radiographs overlaid on the reconstructed patient's surface without the need to move the C-arm. An RGBD camera is rigidly mounted on the C-arm near the detector. We introduce a calibration method based on the simultaneous reconstruction of the surface and the CBCT scan of an object. The transformation between the two coordinate spaces is recovered using Fast Point Feature Histogram descriptors and the Iterative Closest Point algorithm. Several experiments are performed to assess the repeatability and the accuracy of this method. Target registration error is measured on multiple visual and radio-opaque landmarks to evaluate the accuracy of the registration. Mixed reality visualizations from arbitrary angles are also presented for simulated orthopedic surgeries. To the best of our knowledge, this is the first calibration method which uses only tomographic and RGBD reconstructions. This means that the method does not impose a particular shape of the phantom. We demonstrate a marker-less calibration of CBCT volumes and 3D depth cameras, achieving reasonable registration accuracy. This design requires a one-time factory calibration, is self-contained, and could be integrated into existing mobile C-arms to provide real-time augmented reality views from arbitrary angles.

Contour interpolated radial basis functions with spline boundary correction for fast 3D reconstruction of the human articular cartilage from MR images

DOE Office of Scientific and Technical Information (OSTI.GOV)

Javaid, Zarrar; Unsworth, Charles P., E-mail: c.unsworth@auckland.ac.nz; Boocock, Mark G.

2016-03-15

Purpose: The aim of this work is to demonstrate a new image processing technique that can provide a “near real-time” 3D reconstruction of the articular cartilage of the human knee from MR images which is user friendly. This would serve as a point-of-care 3D visualization tool which would benefit a consultant radiologist in the visualization of the human articular cartilage. Methods: The authors introduce a novel fusion of an adaptation of the contour method known as “contour interpolation (CI)” with radial basis functions (RBFs) which they describe as “CI-RBFs.” The authors also present a spline boundary correction which further enhancesmore » volume estimation of the method. A subject cohort consisting of 17 right nonpathological knees (ten female and seven male) is assessed to validate the quality of the proposed method. The authors demonstrate how the CI-RBF method dramatically reduces the number of data points required for fitting an implicit surface to the entire cartilage, thus, significantly improving the speed of reconstruction over the comparable RBF reconstruction method of Carr. The authors compare the CI-RBF method volume estimation to a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Results: The authors demonstrate how the CI-RBF method significantly reduces the number of data points (p-value < 0.0001) required for fitting an implicit surface to the cartilage, by 48%, 31%, and 44% for the patellar, tibial, and femoral cartilages, respectively. Thus, significantly improving the speed of reconstruction (p-value < 0.0001) by 39%, 40%, and 44% for the patellar, tibial, and femoral cartilages over the comparable RBF model of Carr providing a near real-time reconstruction of 6.49, 8.88, and 9.43 min for the patellar, tibial, and femoral cartilages, respectively. In addition, it is demonstrated how the CI-RBF method matches the volume estimation of a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Furthermore, the performance of the segmentation method used for the extraction of the femoral, tibial, and patellar cartilages is assessed with a Dice similarity coefficient, sensitivity, and specificity measure providing high agreement to manual segmentation. Conclusions: The CI-RBF method provides a fast, accurate, and robust 3D model reconstruction that matches Carr’s RBF method, 3D DOCTOR, and a manual benchmark method in accuracy and significantly improves upon Carr’s RBF method in data requirement and computational speed. In addition, the visualization tool has been designed to quickly segment MR images requiring only four mouse clicks per MR image slice.« less

Visualization and 3D Reconstruction of Flame Cells of Taenia solium (Cestoda)

PubMed Central

Valverde-Islas, Laura E.; Arrangoiz, Esteban; Vega, Elio; Robert, Lilia; Villanueva, Rafael; Reynoso-Ducoing, Olivia; Willms, Kaethe; Zepeda-Rodríguez, Armando; Fortoul, Teresa I.; Ambrosio, Javier R.

2011-01-01

Background Flame cells are the terminal cells of protonephridial systems, which are part of the excretory systems of invertebrates. Although the knowledge of their biological role is incomplete, there is a consensus that these cells perform excretion/secretion activities. It has been suggested that the flame cells participate in the maintenance of the osmotic environment that the cestodes require to live inside their hosts. In live Platyhelminthes, by light microscopy, the cells appear beating their flames rapidly and, at the ultrastructural, the cells have a large body enclosing a tuft of cilia. Few studies have been performed to define the localization of the cytoskeletal proteins of these cells, and it is unclear how these proteins are involved in cell function. Methodology/Principal Findings Parasites of two different developmental stages of T. solium were used: cysticerci recovered from naturally infected pigs and intestinal adults obtained from immunosuppressed and experimentally infected golden hamsters. Hamsters were fed viable cysticerci to recover adult parasites after one month of infection. In the present studies focusing on flame cells of cysticerci tissues was performed. Using several methods such as video, confocal and electron microscopy, in addition to computational analysis for reconstruction and modeling, we have provided a 3D visual rendition of the cytoskeletal architecture of Taenia solium flame cells. Conclusions/Significance We consider that visual representations of cells open a new way for understanding the role of these cells in the excretory systems of Platyhelminths. After reconstruction, the observation of high resolution 3D images allowed for virtual observation of the interior composition of cells. A combination of microscopic images, computational reconstructions and 3D modeling of cells appears to be useful for inferring the cellular dynamics of the flame cell cytoskeleton. PMID:21412407

Quantitative 3D high resolution transmission ultrasound tomography: creating clinically relevant images (Conference Presentation)

NASA Astrophysics Data System (ADS)

Wiskin, James; Klock, John; Iuanow, Elaine; Borup, Dave T.; Terry, Robin; Malik, Bilal H.; Lenox, Mark

2017-03-01

There has been a great deal of research into ultrasound tomography for breast imaging over the past 35 years. Few successful attempts have been made to reconstruct high-resolution images using transmission ultrasound. To this end, advances have been made in 2D and 3D algorithms that utilize either time of arrival or full wave data to reconstruct images with high spatial and contrast resolution suitable for clinical interpretation. The highest resolution and quantitative accuracy result from inverse scattering applied to full wave data in 3D. However, this has been prohibitively computationally expensive, meaning that full inverse scattering ultrasound tomography has not been considered clinically viable. Here we show the results of applying a nonlinear inverse scattering algorithm to 3D data in a clinically useful time frame. This method yields Quantitative Transmission (QT) ultrasound images with high spatial and contrast resolution. We reconstruct sound speeds for various 2D and 3D phantoms and verify these values with independent measurements. The data are fully 3D as is the reconstruction algorithm, with no 2D approximations. We show that 2D reconstruction algorithms can introduce artifacts into the QT breast image which are avoided by using a full 3D algorithm and data. We show high resolution gross and microscopic anatomic correlations comparing cadaveric breast QT images with MRI to establish imaging capability and accuracy. Finally, we show reconstructions of data from volunteers, as well as an objective visual grading analysis to confirm clinical imaging capability and accuracy.

Navigation for fluoroscopy-guided cryo-balloon ablation procedures of atrial fibrillation

NASA Astrophysics Data System (ADS)

Bourier, Felix; Brost, Alexander; Kleinoeder, Andreas; Kurzendorfer, Tanja; Koch, Martin; Kiraly, Attila; Schneider, Hans-Juergen; Hornegger, Joachim; Strobel, Norbert; Kurzidim, Klaus

2012-02-01

Atrial fibrillation (AFib), the most common arrhythmia, has been identified as a major cause of stroke. The current standard in interventional treatment of AFib is the pulmonary vein isolation (PVI). PVI is guided by fluoroscopy or non-fluoroscopic electro-anatomic mapping systems (EAMS). Either classic point-to-point radio-frequency (RF)- catheter ablation or so-called single-shot-devices like cryo-balloons are used to achieve electrically isolation of the pulmonary veins and the left atrium (LA). Fluoroscopy-based systems render overlay images from pre-operative 3-D data sets which are then merged with fluoroscopic imaging, thereby adding detailed 3-D information to conventional fluoroscopy. EAMS provide tracking and visualization of RF catheters by means of electro-magnetic tracking. Unfortunately, current navigation systems, fluoroscopy-based or EAMS, do not provide tools to localize and visualize single shot devices like cryo-balloon catheters in 3-D. We present a prototype software for fluoroscopy-guided ablation procedures that is capable of superimposing 3-D datasets as well as reconstructing cyro-balloon catheters in 3-D. The 3-D cyro-balloon reconstruction was evaluated on 9 clinical data sets, yielded a reprojected 2-D error of 1.72 mm +/- 1.02 mm.

Detailed Primitive-Based 3d Modeling of Architectural Elements

NASA Astrophysics Data System (ADS)

Remondino, F.; Lo Buglio, D.; Nony, N.; De Luca, L.

2012-07-01

The article describes a pipeline, based on image-data, for the 3D reconstruction of building façades or architectural elements and the successive modeling using geometric primitives. The approach overcome some existing problems in modeling architectural elements and deliver efficient-in-size reality-based textured 3D models useful for metric applications. For the 3D reconstruction, an opensource pipeline developed within the TAPENADE project is employed. In the successive modeling steps, the user manually selects an area containing an architectural element (capital, column, bas-relief, window tympanum, etc.) and then the procedure fits geometric primitives and computes disparity and displacement maps in order to tie visual and geometric information together in a light but detailed 3D model. Examples are reported and commented.

A Case-Based Study with Radiologists Performing Diagnosis Tasks in Virtual Reality.

PubMed

Venson, José Eduardo; Albiero Berni, Jean Carlo; Edmilson da Silva Maia, Carlos; Marques da Silva, Ana Maria; Cordeiro d'Ornellas, Marcos; Maciel, Anderson

2017-01-01

In radiology diagnosis, medical images are most often visualized slice by slice. At the same time, the visualization based on 3D volumetric rendering of the data is considered useful and has increased its field of application. In this work, we present a case-based study with 16 medical specialists to assess the diagnostic effectiveness of a Virtual Reality interface in fracture identification over 3D volumetric reconstructions. We developed a VR volume viewer compatible with both the Oculus Rift and handheld-based head mounted displays (HMDs). We then performed user experiments to validate the approach in a diagnosis environment. In addition, we assessed the subjects' perception of the 3D reconstruction quality, ease of interaction and ergonomics, and also the users opinion on how VR applications can be useful in healthcare. Among other results, we have found a high level of effectiveness of the VR interface in identifying superficial fractures on head CTs.

3D reconstruction of a carotid bifurcation from 2D transversal ultrasound images.

PubMed

Yeom, Eunseop; Nam, Kweon-Ho; Jin, Changzhu; Paeng, Dong-Guk; Lee, Sang-Joon

2014-12-01

Visualizing and analyzing the morphological structure of carotid bifurcations are important for understanding the etiology of carotid atherosclerosis, which is a major cause of stroke and transient ischemic attack. For delineation of vasculatures in the carotid artery, ultrasound examinations have been widely employed because of a noninvasive procedure without ionizing radiation. However, conventional 2D ultrasound imaging has technical limitations in observing the complicated 3D shapes and asymmetric vasodilation of bifurcations. This study aims to propose image-processing techniques for better 3D reconstruction of a carotid bifurcation in a rat by using 2D cross-sectional ultrasound images. A high-resolution ultrasound imaging system with a probe centered at 40MHz was employed to obtain 2D transversal images. The lumen boundaries in each transverse ultrasound image were detected by using three different techniques; an ellipse-fitting, a correlation mapping to visualize the decorrelation of blood flow, and the ellipse-fitting on the correlation map. When the results are compared, the third technique provides relatively good boundary extraction. The incomplete boundaries of arterial lumen caused by acoustic artifacts are somewhat resolved by adopting the correlation mapping and the distortion in the boundary detection near the bifurcation apex was largely reduced by using the ellipse-fitting technique. The 3D lumen geometry of a carotid artery was obtained by volumetric rendering of several 2D slices. For the 3D vasodilatation of the carotid bifurcation, lumen geometries at the contraction and expansion states were simultaneously depicted at various view angles. The present 3D reconstruction methods would be useful for efficient extraction and construction of the 3D lumen geometries of carotid bifurcations from 2D ultrasound images. Copyright © 2014 Elsevier B.V. All rights reserved.

Image processing and 3D visualization in the interpretation of patterned injury of the skin

NASA Astrophysics Data System (ADS)

Oliver, William R.; Altschuler, Bruce R.

1995-09-01

The use of image processing is becoming increasingly important in the evaluation of violent crime. While much work has been done in the use of these techniques for forensic purposes outside of forensic pathology, its use in the pathologic examination of wounding has been limited. We are investigating the use of image processing in the analysis of patterned injuries and tissue damage. Our interests are currently concentrated on 1) the use of image processing techniques to aid the investigator in observing and evaluating patterned injuries in photographs, 2) measurement of the 3D shape characteristics of surface lesions, and 3) correlation of patterned injuries with deep tissue injury as a problem in 3D visualization. We are beginning investigations in data-acquisition problems for performing 3D scene reconstructions from the pathology perspective of correlating tissue injury to scene features and trace evidence localization. Our primary tool for correlation of surface injuries with deep tissue injuries has been the comparison of processed surface injury photographs with 3D reconstructions from antemortem CT and MRI data. We have developed a prototype robot for the acquisition of 3D wound and scene data.

Visualizing the 3D Architecture of Multiple Erythrocytes Infected with Plasmodium at Nanoscale by Focused Ion Beam-Scanning Electron Microscopy

PubMed Central

Soares Medeiros, Lia Carolina; De Souza, Wanderley; Jiao, Chengge; Barrabin, Hector; Miranda, Kildare

2012-01-01

Different methods for three-dimensional visualization of biological structures have been developed and extensively applied by different research groups. In the field of electron microscopy, a new technique that has emerged is the use of a focused ion beam and scanning electron microscopy for 3D reconstruction at nanoscale resolution. The higher extent of volume that can be reconstructed with this instrument represent one of the main benefits of this technique, which can provide statistically relevant 3D morphometrical data. As the life cycle of Plasmodium species is a process that involves several structurally complex developmental stages that are responsible for a series of modifications in the erythrocyte surface and cytoplasm, a high number of features within the parasites and the host cells has to be sampled for the correct interpretation of their 3D organization. Here, we used FIB-SEM to visualize the 3D architecture of multiple erythrocytes infected with Plasmodium chabaudi and analyzed their morphometrical parameters in a 3D space. We analyzed and quantified alterations on the host cells, such as the variety of shapes and sizes of their membrane profiles and parasite internal structures such as a polymorphic organization of hemoglobin-filled tubules. The results show the complex 3D organization of Plasmodium and infected erythrocyte, and demonstrate the contribution of FIB-SEM for the obtainment of statistical data for an accurate interpretation of complex biological structures. PMID:22432024

Virtual reality on the web: the potentials of different methodologies and visualization techniques for scientific research and medical education.

PubMed

Kling-Petersen, T; Pascher, R; Rydmark, M

1999-01-01

Academic and medical imaging are increasingly using computer based 3D reconstruction and/or visualization. Three-dimensional interactive models play a major role in areas such as preclinical medical education, clinical visualization and medical research. While 3D is comparably easy to do on a high end workstations, distribution and use of interactive 3D graphics necessitate the use of personal computers and the web. Several new techniques have been demonstrated providing interactive 3D via a web browser thereby allowing a limited version of VR to be experienced by a larger majority of students, medical practitioners and researchers. These techniques include QuickTimeVR2 (QTVR), VRML2, QuickDraw3D, OpenGL and Java3D. In order to test the usability of the different techniques, Mednet have initiated a number of projects designed to evaluate the potentials of 3D techniques for scientific reporting, clinical visualization and medical education. These include datasets created by manual tracing followed by triangulation, smoothing and 3D visualization, MRI or high-resolution laserscanning. Preliminary results indicate that both VRML and QTVR fulfills most of the requirements of web based, interactive 3D visualization, whereas QuickDraw3D is too limited. Presently, the JAVA 3D has not yet reached a level where in depth testing is possible. The use of high-resolution laserscanning is an important addition to 3D digitization.

Improving Visibility of Stereo-Radiographic Spine Reconstruction with Geometric Inferences.

PubMed

Kumar, Sampath; Nayak, K Prabhakar; Hareesha, K S

2016-04-01

Complex deformities of the spine, like scoliosis, are evaluated more precisely using stereo-radiographic 3D reconstruction techniques. Primarily, it uses six stereo-corresponding points available on the vertebral body for the 3D reconstruction of each vertebra. The wireframe structure obtained in this process has poor visualization, hence difficult to diagnose. In this paper, a novel method is proposed to improve the visibility of this wireframe structure using a deformation of a generic spine model in accordance with the 3D-reconstructed corresponding points. Then, the geometric inferences like vertebral orientations are automatically extracted from the radiographs to improve the visibility of the 3D model. Biplanar radiographs are acquired from five scoliotic subjects on a specifically designed calibration bench. The stereo-corresponding point reconstruction method is used to build six-point wireframe vertebral structures and thus the entire spine model. Using the 3D spine midline and automatically extracted vertebral orientation features, a more realistic 3D spine model is generated. To validate the method, the 3D spine model is back-projected on biplanar radiographs and the error difference is computed. Though, this difference is within the error limits available in the literature, the proposed work is simple and economical. The proposed method does not require more corresponding points and image features to improve the visibility of the model. Hence, it reduces the computational complexity. Expensive 3D digitizer and vertebral CT scan models are also excluded from this study. Thus, the visibility of stereo-corresponding point reconstruction is improved to obtain a low-cost spine model for a better diagnosis of spinal deformities.

Graphic and movie illustrations of human prenatal development and their application to embryological education based on the human embryo specimens in the Kyoto collection.

PubMed

Yamada, Shigehito; Uwabe, Chigako; Nakatsu-Komatsu, Tomoko; Minekura, Yutaka; Iwakura, Masaji; Motoki, Tamaki; Nishimiya, Kazuhiko; Iiyama, Masaaki; Kakusho, Koh; Minoh, Michihiko; Mizuta, Shinobu; Matsuda, Tetsuya; Matsuda, Yoshimasa; Haishi, Tomoyuki; Kose, Katsumi; Fujii, Shingo; Shiota, Kohei

2006-02-01

Morphogenesis in the developing embryo takes place in three dimensions, and in addition, the dimension of time is another important factor in development. Therefore, the presentation of sequential morphological changes occurring in the embryo (4D visualization) is essential for understanding the complex morphogenetic events and the underlying mechanisms. Until recently, 3D visualization of embryonic structures was possible only by reconstruction from serial histological sections, which was tedious and time-consuming. During the past two decades, 3D imaging techniques have made significant advances thanks to the progress in imaging and computer technologies, computer graphics, and other related techniques. Such novel tools have enabled precise visualization of the 3D topology of embryonic structures and to demonstrate spatiotemporal 4D sequences of organogenesis. Here, we describe a project in which staged human embryos are imaged by the magnetic resonance (MR) microscope, and 3D images of embryos and their organs at each developmental stage were reconstructed based on the MR data, with the aid of computer graphics techniques. On the basis of the 3D models of staged human embryos, we constructed a data set of 3D images of human embryos and made movies to illustrate the sequential process of human morphogenesis. Furthermore, a computer-based self-learning program of human embryology is being developed for educational purposes, using the photographs, histological sections, MR images, and 3D models of staged human embryos. Copyright 2005 Wiley-Liss, Inc.

A Method for 3D-Reconstruction of a Muscle Thick Filament Using the Tilt Series Images of a Single Filament Electron Tomogram

PubMed Central

Márquez, G.; Pinto, A.; Alamo, L.; Baumann, B.; Ye, F.; Winkler, H.; Taylor, K.; Padrón, R.

2014-01-01

Summary Myosin interacting-heads (MIH) motifs are visualized in 3D-reconstructions of thick filaments from striated muscle. These reconstructions are calculated by averaging methods using images from electron micrographs of grids prepared using numerous filament preparations. Here we propose an alternative method to calculate the 3D-reconstruction of a single thick filament using only a tilt series images recorded by electron tomography. Relaxed thick filaments, prepared from tarantula leg muscle homogenates, were negatively stained. Single-axis tilt series of single isolated thick filaments were obtained with the electron microscope at a low electron dose, and recorded on a CCD camera by electron tomography. An IHRSR 3D-recontruction was calculated from the tilt series images of a single thick filament. The reconstruction was enhanced by including in the search stage dual tilt image segments while only single tilt along the filament axis is usually used, as well as applying a band pass filter just before the back projection. The reconstruction from a single filament has a 40 Å resolution and clearly shows the presence of MIH motifs. In contrast, the electron tomogram 3D-reconstruction of the same thick filament –calculated without any image averaging and/or imposition of helical symmetry- only reveals MIH motifs infrequently. This is –to our knowledge- the first application of the IHRSR method to calculate a 3D reconstruction from tilt series images. This single filament IHRSR reconstruction method (SF-IHRSR) should provide a new tool to assess structural differences between well-ordered thick (or thin) filaments in a grid by recording separately their electron tomograms. PMID:24727133

A method for 3D-reconstruction of a muscle thick filament using the tilt series images of a single filament electron tomogram.

PubMed

Márquez, G; Pinto, A; Alamo, L; Baumann, B; Ye, F; Winkler, H; Taylor, K; Padrón, R

2014-05-01

Myosin interacting-heads (MIH) motifs are visualized in 3D-reconstructions of thick filaments from striated muscle. These reconstructions are calculated by averaging methods using images from electron micrographs of grids prepared using numerous filament preparations. Here we propose an alternative method to calculate the 3D-reconstruction of a single thick filament using only a tilt series images recorded by electron tomography. Relaxed thick filaments, prepared from tarantula leg muscle homogenates, were negatively stained. Single-axis tilt series of single isolated thick filaments were obtained with the electron microscope at a low electron dose, and recorded on a CCD camera by electron tomography. An IHRSR 3D-recontruction was calculated from the tilt series images of a single thick filament. The reconstruction was enhanced by including in the search stage dual tilt image segments while only single tilt along the filament axis is usually used, as well as applying a band pass filter just before the back projection. The reconstruction from a single filament has a 40 Å resolution and clearly shows the presence of MIH motifs. In contrast, the electron tomogram 3D-reconstruction of the same thick filament - calculated without any image averaging and/or imposition of helical symmetry - only reveals MIH motifs infrequently. This is - to our knowledge - the first application of the IHRSR method to calculate a 3D reconstruction from tilt series images. This single filament IHRSR reconstruction method (SF-IHRSR) should provide a new tool to assess structural differences between well-ordered thick (or thin) filaments in a grid by recording separately their electron tomograms. Copyright © 2014 Elsevier Inc. All rights reserved.

Non-iterative volumetric particle reconstruction near moving bodies

NASA Astrophysics Data System (ADS)

Mendelson, Leah; Techet, Alexandra

2017-11-01

When multi-camera 3D PIV experiments are performed around a moving body, the body often obscures visibility of regions of interest in the flow field in a subset of cameras. We evaluate the performance of non-iterative particle reconstruction algorithms used for synthetic aperture PIV (SAPIV) in these partially-occluded regions. We show that when partial occlusions are present, the quality and availability of 3D tracer particle information depends on the number of cameras and reconstruction procedure used. Based on these findings, we introduce an improved non-iterative reconstruction routine for SAPIV around bodies. The reconstruction procedure combines binary masks, already required for reconstruction of the body's 3D visual hull, and a minimum line-of-sight algorithm. This approach accounts for partial occlusions without performing separate processing for each possible subset of cameras. We combine this reconstruction procedure with three-dimensional imaging on both sides of the free surface to reveal multi-fin wake interactions generated by a jumping archer fish. Sufficient particle reconstruction in near-body regions is crucial to resolving the wake structures of upstream fins (i.e., dorsal and anal fins) before and during interactions with the caudal tail.

Deformable known component model-based reconstruction for coronary CT angiography

NASA Astrophysics Data System (ADS)

Zhang, X.; Tilley, S.; Xu, S.; Mathews, A.; McVeigh, E. R.; Stayman, J. W.

2017-03-01

Purpose: Atherosclerosis detection remains challenging in coronary CT angiography for patients with cardiac implants. Pacing electrodes of a pacemaker or lead components of a defibrillator can create substantial blooming and streak artifacts in the heart region, severely hindering the visualization of a plaque of interest. We present a novel reconstruction method that incorporates a deformable model for metal leads to eliminate metal artifacts and improve anatomy visualization even near the boundary of the component. Methods: The proposed reconstruction method, referred as STF-dKCR, includes a novel parameterization of the component that integrates deformation, a 3D-2D preregistration process that estimates component shape and position, and a polyenergetic forward model for x-ray propagation through the component where the spectral properties are jointly estimated. The methodology was tested on physical data of a cardiac phantom acquired on a CBCT testbench. The phantom included a simulated vessel, a metal wire emulating a pacing lead, and a small Teflon sphere attached to the vessel wall, mimicking a calcified plaque. The proposed method was also compared to the traditional FBP reconstruction and an interpolation-based metal correction method (FBP-MAR). Results: Metal artifacts presented in standard FBP reconstruction were significantly reduced in both FBP-MAR and STF- dKCR, yet only the STF-dKCR approach significantly improved the visibility of the small Teflon target (within 2 mm of the metal wire). The attenuation of the Teflon bead improved to 0.0481 mm-1 with STF-dKCR from 0.0166 mm-1 with FBP and from 0.0301 mm-1 with FBP-MAR - much closer to the expected 0.0414 mm-1. Conclusion: The proposed method has the potential to improve plaque visualization in coronary CT angiography in the presence of wire-shaped metal components.

Preoperative Visualization of Cranial Nerves in Skull Base Tumor Surgery Using Diffusion Tensor Imaging Technology.

PubMed

Ma, Jun; Su, Shaobo; Yue, Shuyuan; Zhao, Yan; Li, Yonggang; Chen, Xiaochen; Ma, Hui

2016-01-01

To visualize cranial nerves (CNs) using diffusion tensor imaging (DTI) with special parameters. This study also involved the evaluation of preoperative estimates and intraoperative confirmation of the relationship between nerves and tumor by verifying the accuracy of visualization. 3T magnetic resonance imaging scans including 3D-FSPGR, FIESTA, and DTI were used to collect information from 18 patients with skull base tumor. DTI data were integrated into the 3D slicer for fiber tracking and overlapped anatomic images to determine course of nerves. 3D reconstruction of tumors was achieved to perform neighboring, encasing, and invading relationship between lesion and nerves. Optic pathway including the optic chiasm could be traced in cases of tuberculum sellae meningioma and hypophysoma (pituitary tumor). The oculomotor nerve, from the interpeduncular fossa out of the brain stem to supraorbital fissure, was clearly visible in parasellar meningioma cases. Meanwhile, cisternal parts of trigeminal nerve and abducens nerve, facial nerve were also imaged well in vestibular schwannomas and petroclival meningioma cases. The 3D-spatial relationship between CNs and skull base tumor estimated preoperatively by tumor modeling and tractography corresponded to the results determined during surgery. Supported by DTI and 3D slicer, preoperative 3D reconstruction of most CNs related to skull base tumor is feasible in pathological circumstances. We consider DTI Technology to be a useful tool for predicting the course and location of most CNs, and syntopy between them and skull base tumor.

Three-dimensional curvilinear device reconstruction from two fluoroscopic views

NASA Astrophysics Data System (ADS)

Delmas, Charlotte; Berger, Marie-Odile; Kerrien, Erwan; Riddell, Cyril; Trousset, Yves; Anxionnat, René; Bracard, Serge

2015-03-01

In interventional radiology, navigating devices under the sole guidance of fluoroscopic images inside a complex architecture of tortuous and narrow vessels like the cerebral vascular tree is a difficult task. Visualizing the device in 3D could facilitate this navigation. For curvilinear devices such as guide-wires and catheters, a 3D reconstruction may be achieved using two simultaneous fluoroscopic views, as available on a biplane acquisition system. The purpose of this paper is to present a new automatic three-dimensional curve reconstruction method that has the potential to reconstruct complex 3D curves and does not require a perfect segmentation of the endovascular device. Using epipolar geometry, our algorithm translates the point correspondence problem into a segment correspondence problem. Candidate 3D curves can be formed and evaluated independently after identifying all possible combinations of compatible 3D segments. Correspondence is then inherently solved by looking in 3D space for the most coherent curve in terms of continuity and curvature. This problem can be cast into a graph problem where the most coherent curve corresponds to the shortest path of a weighted graph. We present quantitative results of curve reconstructions performed from numerically simulated projections of tortuous 3D curves extracted from cerebral vascular trees affected with brain arteriovenous malformations as well as fluoroscopic image pairs of a guide-wire from both phantom and clinical sets. Our method was able to select the correct 3D segments in 97.5% of simulated cases thus demonstrating its ability to handle complex 3D curves and can deal with imperfect 2D segmentation.

[3D visualization and analysis of vocal fold dynamics].

PubMed

Bohr, C; Döllinger, M; Kniesburges, S; Traxdorf, M

2016-04-01

Visual investigation methods of the larynx mainly allow for the two-dimensional presentation of the three-dimensional structures of the vocal fold dynamics. The vertical component of the vocal fold dynamics is often neglected, yielding a loss of information. The latest studies show that the vertical dynamic components are in the range of the medio-lateral dynamics and play a significant role within the phonation process. This work presents a method for future 3D reconstruction and visualization of endoscopically recorded vocal fold dynamics. The setup contains a high-speed camera (HSC) and a laser projection system (LPS). The LPS projects a regular grid on the vocal fold surfaces and in combination with the HSC allows a three-dimensional reconstruction of the vocal fold surface. Hence, quantitative information on displacements and velocities can be provided. The applicability of the method is presented for one ex-vivo human larynx, one ex-vivo porcine larynx and one synthetic silicone larynx. The setup introduced allows the reconstruction of the entire visible vocal fold surfaces for each oscillation status. This enables a detailed analysis of the three dimensional dynamics (i. e. displacements, velocities, accelerations) of the vocal folds. The next goal is the miniaturization of the LPS to allow clinical in-vivo analysis in humans. We anticipate new insight on dependencies between 3D dynamic behavior and the quality of the acoustic outcome for healthy and disordered phonation.

Ultrasound-directed robotic system for thermal ablation of liver tumors: a preliminary report

NASA Astrophysics Data System (ADS)

Zheng, Jian; Tian, Jie; Dai, Yakang; Zhang, Xing; Dong, Di; Xu, Min

2010-03-01

Thermal ablation has been proved safe and effective as the treatment for liver tumors that are not suitable for resection. Currently, manually performed thermal ablation is greatly dependent on the surgeon's acupuncture manipulation against hand tremor. Besides that, inaccurate or inappropriate placement of the applicator will also directly decrease the final treatment effect. In order to reduce the influence of hand tremor, and provide an accurate and appropriate guidance for a better treatment, we develop an ultrasound-directed robotic system for thermal ablation of liver tumors. In this paper, we will give a brief preliminary report of our system. Especially, three innovative techniques are proposed to solve the critical problems in our system: accurate ultrasound calibration when met with artifacts, realtime reconstruction with visualization using Graphic Processing Unit (GPU) acceleration and 2D-3D ultrasound image registration. To reduce the error of point extraction with artifacts, we propose a novel point extraction method by minimizing an error function which is defined based on the geometric property of our N-fiducial phantom. Then realtime reconstruction with visualization using GPU acceleration is provided for fast 3D ultrasound volume acquisition with dynamic display of reconstruction progress. After that, coarse 2D-3D ultrasound image registration is performed based on landmark points correspondences, followed by accurate 2D-3D ultrasound image registration based on Euclidean distance transform (EDT). The effectiveness of our proposed techniques is demonstrated in phantom experiments.

Image-Based Virtual Tours and 3d Modeling of Past and Current Ages for the Enhancement of Archaeological Parks: the Visualversilia 3d Project

NASA Astrophysics Data System (ADS)

Castagnetti, C.; Giannini, M.; Rivola, R.

2017-05-01

The research project VisualVersilia 3D aims at offering a new way to promote the territory and its heritage by matching the traditional reading of the document and the potential use of modern communication technologies for the cultural tourism. Recently, the research on the use of new technologies applied to cultural heritage have turned their attention mainly to technologies to reconstruct and narrate the complexity of the territory and its heritage, including 3D scanning, 3D printing and augmented reality. Some museums and archaeological sites already exploit the potential of digital tools to preserve and spread their heritage but interactive services involving tourists in an immersive and more modern experience are still rare. The innovation of the project consists in the development of a methodology for documenting current and past historical ages and integrating their 3D visualizations with rendering capable of returning an immersive virtual reality for a successful enhancement of the heritage. The project implements the methodology in the archaeological complex of Massaciuccoli, one of the best preserved roman site of the Versilia Area (Tuscany, Italy). The activities of the project briefly consist in developing: 1. the virtual tour of the site in its current configuration on the basis of spherical images then enhanced by texts, graphics and audio guides in order to enable both an immersive and remote tourist experience; 2. 3D reconstruction of the evidences and buildings in their current condition for documentation and conservation purposes on the basis of a complete metric survey carried out through laser scanning; 3. 3D virtual reconstructions through the main historical periods on the basis of historical investigation and the analysis of data acquired.

Compression and accelerated rendering of volume data using DWT

NASA Astrophysics Data System (ADS)

Kamath, Preyas; Akleman, Ergun; Chan, Andrew K.

1998-09-01

2D images cannot convey information on object depth and location relative to the surfaces. The medical community is increasingly using 3D visualization techniques to view data from CT scans, MRI etc. 3D images provide more information on depth and location in the spatial domain to help surgeons making better diagnoses of the problem. 3D images can be constructed from 2D images using 3D scalar algorithms. With recent advances in communication techniques, it is possible for doctors to diagnose and plan treatment of a patient who lives at a remote location. It is made possible by transmitting relevant data of the patient via telephone lines. If this information is to be reconstructed in 3D, then 2D images must be transmitted. However 2D dataset storage occupies a lot of memory. In addition, visualization algorithms are slow. We describe in this paper a scheme which reduces the data transfer time by only transmitting information that the doctor wants. Compression is achieved by reducing the amount of data transfer. This is possible by using the 3D wavelet transform applied to 3D datasets. Since the wavelet transform is localized in frequency and spatial domain, we transmit detail only in the region where the doctor needs it. Since only ROM (Region of Interest) is reconstructed in detail, we need to render only ROI in detail, thus we can reduce the rendering time.

VERS: a virtual environment for reconstructive surgery planning

NASA Astrophysics Data System (ADS)

Montgomery, Kevin N.

1997-05-01

The virtual environment for reconstructive surgery (VERS) project at the NASA Ames Biocomputation Center is applying virtual reality technology to aid surgeons in planning surgeries. We are working with a craniofacial surgeon at Stanford to assemble and visualize the bone structure of patients requiring reconstructive surgery either through developmental abnormalities or trauma. This project is an extension of our previous work in 3D reconstruction, mesh generation, and immersive visualization. The current VR system, consisting of an SGI Onyx RE2, FakeSpace BOOM and ImmersiveWorkbench, Virtual Technologies CyberGlove and Ascension Technologies tracker, is currently in development and has already been used to visualize defects preoperatively. In the near future it will be used to more fully plan the surgery and compute the projected result to soft tissue structure. This paper presents the work in progress and details the production of a high-performance, collaborative, and networked virtual environment.

Conditions that influence the accuracy of anthropometric parameter estimation for human body segments using shape-from-silhouette

NASA Astrophysics Data System (ADS)

Mundermann, Lars; Mundermann, Annegret; Chaudhari, Ajit M.; Andriacchi, Thomas P.

2005-01-01

Anthropometric parameters are fundamental for a wide variety of applications in biomechanics, anthropology, medicine and sports. Recent technological advancements provide methods for constructing 3D surfaces directly. Of these new technologies, visual hull construction may be the most cost-effective yet sufficiently accurate method. However, the conditions influencing the accuracy of anthropometric measurements based on visual hull reconstruction are unknown. The purpose of this study was to evaluate the conditions that influence the accuracy of 3D shape-from-silhouette reconstruction of body segments dependent on number of cameras, camera resolution and object contours. The results demonstrate that the visual hulls lacked accuracy in concave regions and narrow spaces, but setups with a high number of cameras reconstructed a human form with an average accuracy of 1.0 mm. In general, setups with less than 8 cameras yielded largely inaccurate visual hull constructions, while setups with 16 and more cameras provided good volume estimations. Body segment volumes were obtained with an average error of 10% at a 640x480 resolution using 8 cameras. Changes in resolution did not significantly affect the average error. However, substantial decreases in error were observed with increasing number of cameras (33.3% using 4 cameras; 10.5% using 8 cameras; 4.1% using 16 cameras; 1.2% using 64 cameras).

Virtual animation of victim-specific 3D models obtained from CT scans for forensic reconstructions: Living and dead subjects.

PubMed

Villa, C; Olsen, K B; Hansen, S H

2017-09-01

Post-mortem CT scanning (PMCT) has been introduced at several forensic medical institutions many years ago and has proved to be a useful tool. 3D models of bones, skin, internal organs and bullet paths can rapidly be generated using post-processing software. These 3D models reflect the individual physiognomics and can be used to create whole-body 3D virtual animations. In such way, virtual reconstructions of the probable ante-mortem postures of victims can be constructed and contribute to understand the sequence of events. This procedure is demonstrated in two victims of gunshot injuries. Case #1 was a man showing three perforating gunshot wounds, who died due to the injuries of the incident. Whole-body PMCT was performed and 3D reconstructions of bones, relevant internal organs and bullet paths were generated. Using 3ds Max software and a human anatomy 3D model, a virtual animated body was built and probable ante-mortem postures visualized. Case #2 was a man presenting three perforating gunshot wounds, who survived the incident: one in the left arm and two in the thorax. Only CT scans of the thorax, abdomen and the injured arm were provided by the hospital. Therefore, a whole-body 3D model reflecting the anatomical proportions of the patient was made combining the actual bones of the victim with those obtained from the human anatomy 3D model. The resulted 3D model was used for the animation process. Several probable postures were also visualized in this case. It has be shown that in Case #1 the lesions and the bullet path were not consistent with an upright standing position; instead, the victim was slightly bent forward, i.e. he was sitting or running when he was shot. In Case #2, one of the bullets could have passed through the arm and continued into the thorax. In conclusion, specialized 3D modelling and animation techniques allow for the reconstruction of ante-mortem postures based on both PMCT and clinical CT. Copyright © 2017 Elsevier B.V. All rights reserved.

SF3M 2.0: improvement of 3D photo-reconstruction interface based on freely available software

NASA Astrophysics Data System (ADS)

Castillo, Carlos; James, Michael R.; Pérez, Rafael; Gómez, Jose A.

2016-04-01

During recent years, a number of tools based on Structure-from-Motion algorithms have been released for full image-based 3D reconstruction either freely (e.g. Bundler, PMVS2, VisualSFM, MicMac) or commercially (e.g. Agisoft PhotoScan). The SF3M interface was developed in Matlab® to use link software developments (VisualSFM, CloudCompare) and new applications to create a semi-automated workflow including reconstruction, georeferencing and point-cloud filtering, and has been tested for gully erosion assessment with terrestrial images (Castillo et al., 2015). The main aim of this work to provide an improved freely-available and easy-to-use alternative for 3D reconstruction intended for public agencies, non-profit organisations, researchers and other stakeholders interested in 3D modelling. In this communication we present SF3M 2.0, a new version of the graphical user interface. In this case, the SfM module is based on MicMac, an open-software tool (Pierrot-Deseilligny and Cléry, 2011) which provides advanced features such as camera calibration and constrained bundle adjustment using ground control points. SF3M 2.0 will be tested in two scenarios: a) using the same ground-based image set tested in Castillo et al. (2015) to compare the performance of both versions and b) using aerial images taken from a helium balloon to assess a gully network in a 40-hectares catchment. In this study we explore the advantages of SF3M 2.0, explain its operation and evaluate its accuracy and performance. This tool will be also available for free download. References Castillo, C., James, M.R., Redel-Macías, M. D., Pérez, R., and Gómez, J.A.: SF3M software: 3-D photo-reconstruction for non-expert users and its application to a gully network, SOIL, 1, 583-594. Pierrot-Deseilligny, M and Cléry, I. APERO, an Open Source Bundle Adjusment Software for Automatic Calibration and Orientation of a Set of Images. Proceedings of the ISPRS Commission V Symposium, Image Engineering and Vision Metrology, Trento, Italy, 2-4 March 2011.

Reconstruction of measurable three-dimensional point cloud model based on large-scene archaeological excavation sites

NASA Astrophysics Data System (ADS)

Zhang, Chun-Sen; Zhang, Meng-Meng; Zhang, Wei-Xing

2017-01-01

This paper outlines a low-cost, user-friendly photogrammetric technique with nonmetric cameras to obtain excavation site digital sequence images, based on photogrammetry and computer vision. Digital camera calibration, automatic aerial triangulation, image feature extraction, image sequence matching, and dense digital differential rectification are used, combined with a certain number of global control points of the excavation site, to reconstruct the high precision of measured three-dimensional (3-D) models. Using the acrobatic figurines in the Qin Shi Huang mausoleum excavation as an example, our method solves the problems of little base-to-height ratio, high inclination, unstable altitudes, and significant ground elevation changes affecting image matching. Compared to 3-D laser scanning, the 3-D color point cloud obtained by this method can maintain the same visual result and has advantages of low project cost, simple data processing, and high accuracy. Structure-from-motion (SfM) is often used to reconstruct 3-D models of large scenes and has lower accuracy if it is a reconstructed 3-D model of a small scene at close range. Results indicate that this method quickly achieves 3-D reconstruction of large archaeological sites and produces heritage site distribution of orthophotos providing a scientific basis for accurate location of cultural relics, archaeological excavations, investigation, and site protection planning. This proposed method has a comprehensive application value.

Online C-arm calibration using a marked guide wire for 3D reconstruction of pulmonary arteries

NASA Astrophysics Data System (ADS)

Vachon, Étienne; Miró, Joaquim; Duong, Luc

2017-03-01

3D reconstruction of vessels from 2D X-ray angiography is highly relevant to improve the visualization and the assessment of vascular structures such as pulmonary arteries by interventional cardiologists. However, to ensure a robust and accurate reconstruction, C-arm gantry parameters must be properly calibrated to provide clinically acceptable results. Calibration procedures often rely on calibration objects and complex protocol which is not adapted to an intervention context. In this study, a novel calibration algorithm for C-arm gantry is presented using the instrumentation such as catheters and guide wire. This ensures the availability of a minimum set of correspondences and implies minimal changes to the clinical workflow. The method was evaluated on simulated data and on retrospective patient datasets. Experimental results on simulated datasets demonstrate a calibration that allows a 3D reconstruction of the guide wire up to a geometric transformation. Experiments with patients datasets show a significant decrease of the retro projection error to 0.17 mm 2D RMS. Consequently, such procedure might contribute to identify any calibration drift during the intervention.

Application of Digital Diagnosis and Treatment Technique in Benign Mandibular Diseases.

PubMed

Ju, Rui; Zeng, Wei; Lian, Xiaotian; Chen, Gang; Yin, Huaqiang; Tang, Wei

2018-05-01

To explore the feasibility of preoperative planning for treatment of benign mandibular lesions (BML) using digital technologies such as three-dimensional (3D) reconstruction, measurement, visualization as well as image contrast and design of neural positioning protection template (NPPT) in combination with 3D printing technology in the BML diagnosis and treatment. The 3D models of BML and inferior alveolar nerves (IAN) of 10 BML patients were reconstructed based on their digital imaging and communications in medicine (DICOM) data using MIMICS16.0 software. The models were used to visualize lesions and nerve contrast measurement and guide design of personalized NPPT and osteotomy after operation modality was determined in order to achieve accurate, minimally invasive operation with shortened intraoperative time. Intraoperative NPPT application could accurately locate lesions and their scope and assist osteotomy. The measurement results were consistent with those of preoperative reconstruction and measurement. The BML were curetted completely without damage IAN. The 10 BML patients had no numbness and other discomforts in the lower lip and mandibular teeth after operation. The digital diagnosis and treatment technology is an effective method for functional treatment of BML patients and its application could achieve personalized, minimally invasive and precise treatment and save intraoperation time.

'tomo_display' and 'vol_tools': IDL VM Packages for Tomography Data Reconstruction, Processing, and Visualization

NASA Astrophysics Data System (ADS)

Rivers, M. L.; Gualda, G. A.

2009-05-01

One of the challenges in tomography is the availability of suitable software for image processing and analysis in 3D. We present here 'tomo_display' and 'vol_tools', two packages created in IDL that enable reconstruction, processing, and visualization of tomographic data. They complement in many ways the capabilities offered by Blob3D (Ketcham 2005 - Geosphere, 1: 32-41, DOI: 10.1130/GES00001.1) and, in combination, allow users without programming knowledge to perform all steps necessary to obtain qualitative and quantitative information using tomographic data. The package 'tomo_display' was created and is maintained by Mark Rivers. It allows the user to: (1) preprocess and reconstruct parallel beam tomographic data, including removal of anomalous pixels, ring artifact reduction, and automated determination of the rotation center, (2) visualization of both raw and reconstructed data, either as individual frames, or as a series of sequential frames. The package 'vol_tools' consists of a series of small programs created and maintained by Guilherme Gualda to perform specific tasks not included in other packages. Existing modules include simple tools for cropping volumes, generating histograms of intensity, sample volume measurement (useful for porous samples like pumice), and computation of volume differences (for differential absorption tomography). The module 'vol_animate' can be used to generate 3D animations using rendered isosurfaces around objects. Both packages use the same NetCDF format '.volume' files created using code written by Mark Rivers. Currently, only 16-bit integer volumes are created and read by the packages, but floating point and 8-bit data can easily be stored in the NetCDF format as well. A simple GUI to convert sequences of tiffs into '.volume' files is available within 'vol_tools'. Both 'tomo_display' and 'vol_tools' include options to (1) generate onscreen output that allows for dynamic visualization in 3D, (2) save sequences of tiffs to disk, and (3) generate MPEG movies for inclusion in presentations, publications, websites, etc. Both are freely available as run-time ('.sav') versions that can be run using the free IDL Virtual Machine TM, available from ITT Visual Information Solutions: http://www.ittvis.com/ProductServices/IDL/VirtualMachine.aspx The run-time versions of 'tomo_display' and 'vol_tools' can be downloaded from: http://cars.uchicago.edu/software/idl/tomography.html http://sites.google.com/site/voltools/

A framework for breast cancer visualization using augmented reality x-ray vision technique in mobile technology

NASA Astrophysics Data System (ADS)

Rahman, Hameedur; Arshad, Haslina; Mahmud, Rozi; Mahayuddin, Zainal Rasyid

2017-10-01

Breast Cancer patients who require breast biopsy has increased over the past years. Augmented Reality guided core biopsy of breast has become the method of choice for researchers. However, this cancer visualization has limitations to the extent of superimposing the 3D imaging data only. In this paper, we are introducing an Augmented Reality visualization framework that enables breast cancer biopsy image guidance by using X-Ray vision technique on a mobile display. This framework consists of 4 phases where it initially acquires the image from CT/MRI and process the medical images into 3D slices, secondly it will purify these 3D grayscale slices into 3D breast tumor model using 3D modeling reconstruction technique. Further, in visualization processing this virtual 3D breast tumor model has been enhanced using X-ray vision technique to see through the skin of the phantom and the final composition of it is displayed on handheld device to optimize the accuracy of the visualization in six degree of freedom. The framework is perceived as an improved visualization experience because the Augmented Reality x-ray vision allowed direct understanding of the breast tumor beyond the visible surface and direct guidance towards accurate biopsy targets.

Contrast-enhanced time-resolved MRA for follow-up of intracranial aneurysms treated with the pipeline embolization device.

PubMed

Boddu, S R; Tong, F C; Dehkharghani, S; Dion, J E; Saindane, A M

2014-01-01

Endovascular reconstruction and flow diversion by using the Pipeline Embolization Device is an effective treatment for complex cerebral aneurysms. Accurate noninvasive alternatives to DSA for follow-up after Pipeline Embolization Device treatment are desirable. This study evaluated the accuracy of contrast-enhanced time-resolved MRA for this purpose, hypothesizing that contrast-enhanced time-resolved MRA will be comparable with DSA and superior to 3D-TOF MRA. During a 24-month period, 37 Pipeline Embolization Device-treated intracranial aneurysms in 26 patients underwent initial follow-up by using 3D-TOF MRA, contrast-enhanced time-resolved MRA, and DSA. MRA was performed on a 1.5T unit by using 3D-TOF and time-resolved imaging of contrast kinetics. All patients underwent DSA a median of 0 days (range, 0-68) after MRA. Studies were evaluated for aneurysm occlusion, quality of visualization of the reconstructed artery, and measurable luminal diameter of the Pipeline Embolization Device, with DSA used as the reference standard. The sensitivity, specificity, and positive and negative predictive values of contrast-enhanced time-resolved MRA relative to DSA for posttreatment aneurysm occlusion were 96%, 85%, 92%, and 92%. Contrast-enhanced time-resolved MRA demonstrated superior quality of visualization (P = .0001) and a higher measurable luminal diameter (P = .0001) of the reconstructed artery compared with 3D-TOF MRA but no significant difference compared with DSA. Contrast-enhanced time-resolved MRA underestimated the luminal diameter of the reconstructed artery by 0.965 ± 0.497 mm (27% ± 13%) relative to DSA. Contrast-enhanced time-resolved MRA is a reliable noninvasive method for monitoring intracranial aneurysms following flow diversion and vessel reconstruction by using the Pipeline Embolization Device. © 2014 by American Journal of Neuroradiology.

Recent development on computer aided tissue engineering--a review.

PubMed

Sun, Wei; Lal, Pallavi

2002-02-01

The utilization of computer-aided technologies in tissue engineering has evolved in the development of a new field of computer-aided tissue engineering (CATE). This article reviews recent development and application of enabling computer technology, imaging technology, computer-aided design and computer-aided manufacturing (CAD and CAM), and rapid prototyping (RP) technology in tissue engineering, particularly, in computer-aided tissue anatomical modeling, three-dimensional (3-D) anatomy visualization and 3-D reconstruction, CAD-based anatomical modeling, computer-aided tissue classification, computer-aided tissue implantation and prototype modeling assisted surgical planning and reconstruction.

3D reconstruction of cystoscopy videos for comprehensive bladder records

PubMed Central

Lurie, Kristen L.; Angst, Roland; Zlatev, Dimitar V.; Liao, Joseph C.; Ellerbee Bowden, Audrey K.

2017-01-01

White light endoscopy is widely used for diagnostic imaging of the interior of organs and body cavities, but the inability to correlate individual 2D images with 3D organ morphology limits its utility for quantitative or longitudinal studies of disease physiology or cancer surveillance. As a result, most endoscopy videos, which carry enormous data potential, are used only for real-time guidance and are discarded after collection. We present a computational method to reconstruct and visualize a 3D model of organs from an endoscopic video that captures the shape and surface appearance of the organ. A key aspect of our strategy is the use of advanced computer vision techniques and unmodified, clinical-grade endoscopy hardware with few constraints on the image acquisition protocol, which presents a low barrier to clinical translation. We validate the accuracy and robustness of our reconstruction and co-registration method using cystoscopy videos from tissue-mimicking bladder phantoms and show clinical utility during cystoscopy in the operating room for bladder cancer evaluation. As our method can powerfully augment the visual medical record of the appearance of internal organs, it is broadly applicable to endoscopy and represents a significant advance in cancer surveillance opportunities for big-data cancer research. PMID:28736658

A resource from 3D electron microscopy of hippocampal neuropil for user training and tool development

PubMed Central

Harris, Kristen M.; Spacek, Josef; Bell, Maria Elizabeth; Parker, Patrick H.; Lindsey, Laurence F.; Baden, Alexander D.; Vogelstein, Joshua T.; Burns, Randal

2015-01-01

Resurgent interest in synaptic circuitry and plasticity has emphasized the importance of 3D reconstruction from serial section electron microscopy (3DEM). Three volumes of hippocampal CA1 neuropil from adult rat were imaged at X-Y resolution of ~2 nm on serial sections of ~50–60 nm thickness. These are the first densely reconstructed hippocampal volumes. All axons, dendrites, glia, and synapses were reconstructed in a cube (~10 μm3) surrounding a large dendritic spine, a cylinder (~43 μm3) surrounding an oblique dendritic segment (3.4 μm long), and a parallelepiped (~178 μm3) surrounding an apical dendritic segment (4.9 μm long). The data provide standards for identifying ultrastructural objects in 3DEM, realistic reconstructions for modeling biophysical properties of synaptic transmission, and a test bed for enhancing reconstruction tools. Representative synapses are quantified from varying section planes, and microtubules, polyribosomes, smooth endoplasmic reticulum, and endosomes are identified and reconstructed in a subset of dendrites. The original images, traces, and Reconstruct software and files are freely available and visualized at the Open Connectome Project (Data Citation 1). PMID:26347348

High-accuracy 3D measurement system based on multi-view and structured light

NASA Astrophysics Data System (ADS)

Li, Mingyue; Weng, Dongdong; Li, Yufeng; Zhang, Longbin; Zhou, Haiyun

2013-12-01

3D surface reconstruction is one of the most important topics in Spatial Augmented Reality (SAR). Using structured light is a simple and rapid method to reconstruct the objects. In order to improve the precision of 3D reconstruction, we present a high-accuracy multi-view 3D measurement system based on Gray-code and Phase-shift. We use a camera and a light projector that casts structured light patterns on the objects. In this system, we use only one camera to take photos on the left and right sides of the object respectively. In addition, we use VisualSFM to process the relationships between each perspective, so the camera calibration can be omitted and the positions to place the camera are no longer limited. We also set appropriate exposure time to make the scenes covered by gray-code patterns more recognizable. All of the points above make the reconstruction more precise. We took experiments on different kinds of objects, and a large number of experimental results verify the feasibility and high accuracy of the system.

GPU-accelerated Kernel Regression Reconstruction for Freehand 3D Ultrasound Imaging.

PubMed

Wen, Tiexiang; Li, Ling; Zhu, Qingsong; Qin, Wenjian; Gu, Jia; Yang, Feng; Xie, Yaoqin

2017-07-01

Volume reconstruction method plays an important role in improving reconstructed volumetric image quality for freehand three-dimensional (3D) ultrasound imaging. By utilizing the capability of programmable graphics processing unit (GPU), we can achieve a real-time incremental volume reconstruction at a speed of 25-50 frames per second (fps). After incremental reconstruction and visualization, hole-filling is performed on GPU to fill remaining empty voxels. However, traditional pixel nearest neighbor-based hole-filling fails to reconstruct volume with high image quality. On the contrary, the kernel regression provides an accurate volume reconstruction method for 3D ultrasound imaging but with the cost of heavy computational complexity. In this paper, a GPU-based fast kernel regression method is proposed for high-quality volume after the incremental reconstruction of freehand ultrasound. The experimental results show that improved image quality for speckle reduction and details preservation can be obtained with the parameter setting of kernel window size of [Formula: see text] and kernel bandwidth of 1.0. The computational performance of the proposed GPU-based method can be over 200 times faster than that on central processing unit (CPU), and the volume with size of 50 million voxels in our experiment can be reconstructed within 10 seconds.

2-D And 3-D Reconstructions Of The Olfactory System Of The Rat

NASA Astrophysics Data System (ADS)

Reisner, Alex H.; Bell, G. A.; Bucholtz, C. A.; Rosenfeld, Dov; Tsui, K. K.

1989-04-01

The olfactory system of the rat is a useful model for the study of mammalian sensory systems. However, the anatomy of the nasal epithelium, where the cells responsible for detecting odors are located, is extremely complex. Therefore, we have focused our attention on the development of two- and three-dimensional automated imaging methods. The presentation of pure odorants to the experimental animal together with the injection of [14M-deoxyglucose has been combined with autoradiography of frozen sectioned material. Several approaches have been used to obtain optimal alignments of the digitized images of the sections so as to be able to generate appropriate 2-D and 3-D reconstructions. Such reconstructions allow visualization of the ethmo-turbinal bones (turbinates) and the associated soft tissue and appear to be useful in analyzing and highlighting differential metabolic activity.

Virtual Reconstruction of Lost Architectures: from the Tls Survey to AR Visualization

NASA Astrophysics Data System (ADS)

Quattrini, R.; Pierdicca, R.; Frontoni, E.; Barcaglioni, R.

2016-06-01

The exploitation of high quality 3D models for dissemination of archaeological heritage is currently an investigated topic, although Mobile Augmented Reality platforms for historical architecture are not available, allowing to develop low-cost pipelines for effective contents. The paper presents a virtual anastylosis, starting from historical sources and from 3D model based on TLS survey. Several efforts and outputs in augmented or immersive environments, exploiting this reconstruction, are discussed. The work demonstrates the feasibility of a 3D reconstruction approach for complex architectural shapes starting from point clouds and its AR/VR exploitation, allowing the superimposition with archaeological evidences. Major contributions consist in the presentation and the discussion of a pipeline starting from the virtual model, to its simplification showing several outcomes, comparing also the supported data qualities and advantages/disadvantages due to MAR and VR limitations.

Identification of superficial defects in reconstructed 3D objects using phase-shifting fringe projection

NASA Astrophysics Data System (ADS)

Madrigal, Carlos A.; Restrepo, Alejandro; Branch, John W.

2016-09-01

3D reconstruction of small objects is used in applications of surface analysis, forensic analysis and tissue reconstruction in medicine. In this paper, we propose a strategy for the 3D reconstruction of small objects and the identification of some superficial defects. We applied a technique of projection of structured light patterns, specifically sinusoidal fringes and an algorithm of phase unwrapping. A CMOS camera was used to capture images and a DLP digital light projector for synchronous projection of the sinusoidal pattern onto the objects. We implemented a technique based on a 2D flat pattern as calibration process, so the intrinsic and extrinsic parameters of the camera and the DLP were defined. Experimental tests were performed in samples of artificial teeth, coal particles, welding defects and surfaces tested with Vickers indentation. Areas less than 5cm were studied. The objects were reconstructed in 3D with densities of about one million points per sample. In addition, the steps of 3D description, identification of primitive, training and classification were implemented to recognize defects, such as: holes, cracks, roughness textures and bumps. We found that pattern recognition strategies are useful, when quality supervision of surfaces has enough quantities of points to evaluate the defective region, because the identification of defects in small objects is a demanding activity of the visual inspection.

SU-E-T-154: Establishment and Implement of 3D Image Guided Brachytherapy Planning System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jiang, S; Zhao, S; Chen, Y

2014-06-01

Purpose: Cannot observe the dose intuitionally is a limitation of the existing 2D pre-implantation dose planning. Meanwhile, a navigation module is essential to improve the accuracy and efficiency of the implantation. Hence a 3D Image Guided Brachytherapy Planning System conducting dose planning and intra-operative navigation based on 3D multi-organs reconstruction is developed. Methods: Multi-organs including the tumor are reconstructed in one sweep of all the segmented images using the multiorgans reconstruction method. The reconstructed organs group establishs a three-dimensional visualized operative environment. The 3D dose maps of the three-dimentional conformal localized dose planning are calculated with Monte Carlo method whilemore » the corresponding isodose lines and isodose surfaces are displayed in a stereo view. The real-time intra-operative navigation is based on an electromagnetic tracking system (ETS) and the fusion between MRI and ultrasound images. Applying Least Square Method, the coordinate registration between 3D models and patient is realized by the ETS which is calibrated by a laser tracker. The system is validated by working on eight patients with prostate cancer. The navigation has passed the precision measurement in the laboratory. Results: The traditional marching cubes (MC) method reconstructs one organ at one time and assembles them together. Compared to MC, presented multi-organs reconstruction method has superiorities in reserving the integrality and connectivity of reconstructed organs. The 3D conformal localized dose planning, realizing the 'exfoliation display' of different isodose surfaces, helps make sure the dose distribution has encompassed the nidus and avoid the injury of healthy tissues. During the navigation, surgeons could observe the coordinate of instruments real-timely employing the ETS. After the calibration, accuracy error of the needle position is less than 2.5mm according to the experiments. Conclusion: The speed and quality of 3D reconstruction, the efficiency in dose planning and accuracy in navigation all can be improved simultaneously.« less

Advanced texture filtering: a versatile framework for reconstructing multi-dimensional image data on heterogeneous architectures

NASA Astrophysics Data System (ADS)

Zellmann, Stefan; Percan, Yvonne; Lang, Ulrich

2015-01-01

Reconstruction of 2-d image primitives or of 3-d volumetric primitives is one of the most common operations performed by the rendering components of modern visualization systems. Because this operation is often aided by GPUs, reconstruction is typically restricted to first-order interpolation. With the advent of in situ visualization, the assumption that rendering algorithms are in general executed on GPUs is however no longer adequate. We thus propose a framework that provides versatile texture filtering capabilities: up to third-order reconstruction using various types of cubic filtering and interpolation primitives; cache-optimized algorithms that integrate seamlessly with GPGPU rendering or with software rendering that was optimized for cache-friendly "Structure of Array" (SoA) access patterns; a memory management layer (MML) that gracefully hides the complexities of extra data copies necessary for memory access optimizations such as swizzling, for rendering on GPGPUs, or for reconstruction schemes that rely on pre-filtered data arrays. We prove the effectiveness of our software architecture by integrating it into and validating it using the open source direct volume rendering (DVR) software DeskVOX.

A Novel Use of Three-dimensional High-frequency Ultrasonography for Early Pregnancy Characterization in the Mouse.

PubMed

Peavey, Mary C; Reynolds, Corey L; Szwarc, Maria M; Gibbons, William E; Valdes, Cecilia T; DeMayo, Francesco J; Lydon, John P

2017-10-24

High-frequency ultrasonography (HFUS) is a common method to non-invasively monitor the real-time development of the human fetus in utero. The mouse is routinely used as an in vivo model to study embryo implantation and pregnancy progression. Unfortunately, such murine studies require pregnancy interruption to enable follow-up phenotypic analysis. To address this issue, we used three-dimensional (3-D) reconstruction of HFUS imaging data for early detection and characterization of murine embryo implantation sites and their individual developmental progression in utero. Combining HFUS imaging with 3-D reconstruction and modeling, we were able to accurately quantify embryo implantation site number as well as monitor developmental progression in pregnant C57BL6J/129S mice from 5.5 days post coitus (d.p.c.) through to 9.5 d.p.c. with the use of a transducer. Measurements included: number, location, and volume of implantation sites as well as inter-implantation site spacing; embryo viability was assessed by cardiac activity monitoring. In the immediate post-implantation period (5.5 to 8.5 d.p.c.), 3-D reconstruction of the gravid uterus in both mesh and solid overlay format enabled visual representation of the developing pregnancies within each uterine horn. As genetically engineered mice continue to be used to characterize female reproductive phenotypes derived from uterine dysfunction, this method offers a new approach to detect, quantify, and characterize early implantation events in vivo. This novel use of 3-D HFUS imaging demonstrates the ability to successfully detect, visualize, and characterize embryo-implantation sites during early murine pregnancy in a non-invasive manner. The technology offers a significant improvement over current methods, which rely on the interruption of pregnancies for gross tissue and histopathologic characterization. Here we use a video and text format to describe how to successfully perform ultrasounds of early murine pregnancy to generate reliable and reproducible data with reconstruction of the uterine form in mesh and solid 3-D images.

3D Surface Reconstruction and Volume Calculation of Rills

NASA Astrophysics Data System (ADS)

Brings, Christine; Gronz, Oliver; Becker, Kerstin; Wirtz, Stefan; Seeger, Manuel; Ries, Johannes B.

2015-04-01

We use the low-cost, user-friendly photogrammetric Structure from Motion (SfM) technique, which is implemented in the Software VisualSfM, for 3D surface reconstruction and volume calculation of an 18 meter long rill in Luxembourg. The images were taken with a Canon HD video camera 1) before a natural rainfall event, 2) after a natural rainfall event and before a rill experiment and 3) after a rill experiment. Recording with a video camera results compared to a photo camera not only a huge time advantage, the method also guarantees more than adequately overlapping sharp images. For each model, approximately 8 minutes of video were taken. As SfM needs single images, we automatically selected the sharpest image from 15 frame intervals. The sharpness was estimated using a derivative-based metric. Then, VisualSfM detects feature points in each image, searches matching feature points in all image pairs, recovers the camera positions and finally by triangulation of camera positions and feature points the software reconstructs a point cloud of the rill surface. From the point cloud, 3D surface models (meshes) are created and via difference calculations of the pre and post models a visualization of the changes (erosion and accumulation areas) and quantification of erosion volumes are possible. The calculated volumes are presented in spatial units of the models and so real values must be converted via references. The outputs are three models at three different points in time. The results show that especially using images taken from suboptimal videos (bad lighting conditions, low contrast of the surface, too much in-motion unsharpness), the sharpness algorithm leads to much more matching features. Hence the point densities of the 3D models are increased and thereby clarify the calculations.

Fast High Resolution Volume Carving for 3D Plant Shoot Reconstruction

PubMed Central

Scharr, Hanno; Briese, Christoph; Embgenbroich, Patrick; Fischbach, Andreas; Fiorani, Fabio; Müller-Linow, Mark

2017-01-01

Volume carving is a well established method for visual hull reconstruction and has been successfully applied in plant phenotyping, especially for 3d reconstruction of small plants and seeds. When imaging larger plants at still relatively high spatial resolution (≤1 mm), well known implementations become slow or have prohibitively large memory needs. Here we present and evaluate a computationally efficient algorithm for volume carving, allowing e.g., 3D reconstruction of plant shoots. It combines a well-known multi-grid representation called “Octree” with an efficient image region integration scheme called “Integral image.” Speedup with respect to less efficient octree implementations is about 2 orders of magnitude, due to the introduced refinement strategy “Mark and refine.” Speedup is about a factor 1.6 compared to a highly optimized GPU implementation using equidistant voxel grids, even without using any parallelization. We demonstrate the application of this method for trait derivation of banana and maize plants. PMID:29033961

Forensic Facial Reconstruction: The Final Frontier.

PubMed

Gupta, Sonia; Gupta, Vineeta; Vij, Hitesh; Vij, Ruchieka; Tyagi, Nutan

2015-09-01

Forensic facial reconstruction can be used to identify unknown human remains when other techniques fail. Through this article, we attempt to review the different methods of facial reconstruction reported in literature. There are several techniques of doing facial reconstruction, which vary from two dimensional drawings to three dimensional clay models. With the advancement in 3D technology, a rapid, efficient and cost effective computerized 3D forensic facial reconstruction method has been developed which has brought down the degree of error previously encountered. There are several methods of manual facial reconstruction but the combination Manchester method has been reported to be the best and most accurate method for the positive recognition of an individual. Recognition allows the involved government agencies to make a list of suspected victims'. This list can then be narrowed down and a positive identification may be given by the more conventional method of forensic medicine. Facial reconstruction allows visual identification by the individual's family and associates to become easy and more definite.

Real time 3D visualization of intraoperative organ deformations using structured dictionary.

PubMed

Wang, Dan; Tewfik, Ahmed H

2012-04-01

Restricted visualization of the surgical field is one of the most critical challenges for minimally invasive surgery (MIS). Current intraoperative visualization systems are promising. However, they can hardly meet the requirements of high resolution and real time 3D visualization of the surgical scene to support the recognition of anatomic structures for safe MIS procedures. In this paper, we present a new approach for real time 3D visualization of organ deformations based on optical imaging patches with limited field-of-view and a single preoperative scan of magnetic resonance imaging (MRI) or computed tomography (CT). The idea for reconstruction is motivated by our empirical observation that the spherical harmonic coefficients corresponding to distorted surfaces of a given organ lie in lower dimensional subspaces in a structured dictionary that can be learned from a set of representative training surfaces. We provide both theoretical and practical designs for achieving these goals. Specifically, we discuss details about the selection of limited optical views and the registration of partial optical images with a single preoperative MRI/CT scan. The design proposed in this paper is evaluated with both finite element modeling data and ex vivo experiments. The ex vivo test is conducted on fresh porcine kidneys using 3D MRI scans with 1.2 mm resolution and a portable laser scanner with an accuracy of 0.13 mm. Results show that the proposed method achieves a sub-3 mm spatial resolution in terms of Hausdorff distance when using only one preoperative MRI scan and the optical patch from the single-sided view of the kidney. The reconstruction frame rate is between 10 frames/s and 39 frames/s depending on the complexity of the test model.

SU-E-J-128: 3D Surface Reconstruction of a Patient Using Epipolar Geometry

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kotoku, J; Nakabayashi, S; Kumagai, S

Purpose: To obtain a 3D surface data of a patient in a non-invasive way can substantially reduce the effort for the registration of patient in radiation therapy. To achieve this goal, we introduced the multiple view stereo technique, which is known to be used in a 'photo tourism' on the internet. Methods: 70 Images were taken with a digital single-lens reflex camera from different angles and positions. The camera positions and angles were inferred later in the reconstruction step. A sparse 3D reconstruction model was locating by SIFT features, which is robust for rotation and shift variance, in each image.more » We then found a set of correspondences between pairs of images by computing the fundamental matrix using the eight-point algorithm with RANSAC. After the pair matching, we optimized the parameter including camera positions to minimize the reprojection error by use of bundle adjustment technique (non-linear optimization). As a final step, we performed dense reconstruction and associate a color with each point using the library of PMVS. Results: Surface data were reconstructed well by visual inspection. The human skin is reconstructed well, althogh the reconstruction was time-consuming for direct use in daily clinical practice. Conclusion: 3D reconstruction using multi view stereo geometry is a promising tool for reducing the effort of patient setup. This work was supported by JSPS KAKENHI(25861128)« less

An Interactive Virtual 3D Tool for Scientific Exploration of Planetary Surfaces

NASA Astrophysics Data System (ADS)

Traxler, Christoph; Hesina, Gerd; Gupta, Sanjeev; Paar, Gerhard

2014-05-01

In this paper we present an interactive 3D visualization tool for scientific analysis and planning of planetary missions. At the moment scientists have to look at individual camera images separately. There is no tool to combine them in three dimensions and look at them seamlessly as a geologist would do (by walking backwards and forwards resulting in different scales). For this reason a virtual 3D reconstruction of the terrain that can be interactively explored is necessary. Such a reconstruction has to consider multiple scales ranging from orbital image data to close-up surface image data from rover cameras. The 3D viewer allows seamless zooming between these various scales, giving scientists the possibility to relate small surface features (e.g. rock outcrops) to larger geological contexts. For a reliable geologic assessment a realistic surface rendering is important. Therefore the material properties of the rock surfaces will be considered for real-time rendering. This is achieved by an appropriate Bidirectional Reflectance Distribution Function (BRDF) estimated from the image data. The BRDF is implemented to run on the Graphical Processing Unit (GPU) to enable realistic real-time rendering, which allows a naturalistic perception for scientific analysis. Another important aspect for realism is the consideration of natural lighting conditions, which means skylight to illuminate the reconstructed scene. In our case we provide skylights from Mars and Earth, which allows switching between these two modes of illumination. This gives geologists the opportunity to perceive rock outcrops from Mars as they would appear on Earth facilitating scientific assessment. Besides viewing the virtual reconstruction on multiple scales, scientists can also perform various measurements, i.e. geo-coordinates of a selected point or distance between two surface points. Rover or other models can be placed into the scene and snapped onto certain location of the terrain. These are important features to support the planning of rover paths. In addition annotations can be placed directly into the 3D scene, which also serve as landmarks to aid navigation. The presented visualization and planning tool is a valuable asset for scientific analysis of planetary mission data. It complements traditional methods by giving access to an interactive virtual 3D reconstruction, which is realistically rendered. Representative examples and further information about the interactive 3D visualization tool can be found on the FP7-SPACE Project PRoViDE web page http://www.provide-space.eu/interactive-virtual-3d-tool/. The research leading to these results has received funding from the European Union's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 312377 'PRoViDE'.

Dense soft tissue 3D reconstruction refined with super-pixel segmentation for robotic abdominal surgery.

PubMed

Penza, Veronica; Ortiz, Jesús; Mattos, Leonardo S; Forgione, Antonello; De Momi, Elena

2016-02-01

Single-incision laparoscopic surgery decreases postoperative infections, but introduces limitations in the surgeon's maneuverability and in the surgical field of view. This work aims at enhancing intra-operative surgical visualization by exploiting the 3D information about the surgical site. An interactive guidance system is proposed wherein the pose of preoperative tissue models is updated online. A critical process involves the intra-operative acquisition of tissue surfaces. It can be achieved using stereoscopic imaging and 3D reconstruction techniques. This work contributes to this process by proposing new methods for improved dense 3D reconstruction of soft tissues, which allows a more accurate deformation identification and facilitates the registration process. Two methods for soft tissue 3D reconstruction are proposed: Method 1 follows the traditional approach of the block matching algorithm. Method 2 performs a nonparametric modified census transform to be more robust to illumination variation. The simple linear iterative clustering (SLIC) super-pixel algorithm is exploited for disparity refinement by filling holes in the disparity images. The methods were validated using two video datasets from the Hamlyn Centre, achieving an accuracy of 2.95 and 1.66 mm, respectively. A comparison with ground-truth data demonstrated the disparity refinement procedure: (1) increases the number of reconstructed points by up to 43 % and (2) does not affect the accuracy of the 3D reconstructions significantly. Both methods give results that compare favorably with the state-of-the-art methods. The computational time constraints their applicability in real time, but can be greatly improved by using a GPU implementation.

D Reconstruction of Cultural Tourism Attractions from Indoor to Outdoor Based on Portable Four-Camera Stereo Vision System

NASA Astrophysics Data System (ADS)

Shao, Z.; Li, C.; Zhong, S.; Liu, B.; Jiang, H.; Wen, X.

2015-05-01

Building the fine 3D model from outdoor to indoor is becoming a necessity for protecting the cultural tourism resources. However, the existing 3D modelling technologies mainly focus on outdoor areas. Actually, a 3D model should contain detailed descriptions of both its appearance and its internal structure, including architectural components. In this paper, a portable four-camera stereo photographic measurement system is developed, which can provide a professional solution for fast 3D data acquisition, processing, integration, reconstruction and visualization. Given a specific scene or object, it can directly collect physical geometric information such as positions, sizes and shapes of an object or a scene, as well as physical property information such as the materials and textures. On the basis of the information, 3D model can be automatically constructed. The system has been applied to the indooroutdoor seamless modelling of distinctive architecture existing in two typical cultural tourism zones, that is, Tibetan and Qiang ethnic minority villages in Sichuan Jiuzhaigou Scenic Area and Tujia ethnic minority villages in Hubei Shennongjia Nature Reserve, providing a new method and platform for protection of minority cultural characteristics, 3D reconstruction and cultural tourism.

Real-time quasi-3D tomographic reconstruction

NASA Astrophysics Data System (ADS)

Buurlage, Jan-Willem; Kohr, Holger; Palenstijn, Willem Jan; Joost Batenburg, K.

2018-06-01

Developments in acquisition technology and a growing need for time-resolved experiments pose great computational challenges in tomography. In addition, access to reconstructions in real time is a highly demanded feature but has so far been out of reach. We show that by exploiting the mathematical properties of filtered backprojection-type methods, having access to real-time reconstructions of arbitrarily oriented slices becomes feasible. Furthermore, we present , software for visualization and on-demand reconstruction of slices. A user of can interactively shift and rotate slices in a GUI, while the software updates the slice in real time. For certain use cases, the possibility to study arbitrarily oriented slices in real time directly from the measured data provides sufficient visual and quantitative insight. Two such applications are discussed in this article.

Preliminary development of augmented reality systems for spinal surgery

NASA Astrophysics Data System (ADS)

Nguyen, Nhu Q.; Ramjist, Joel M.; Jivraj, Jamil; Jakubovic, Raphael; Deorajh, Ryan; Yang, Victor X. D.

2017-02-01

Surgical navigation has been more actively deployed in open spinal surgeries due to the need for improved precision during procedures. This is increasingly difficult in minimally invasive surgeries due to the lack of visual cues caused by smaller exposure sites, and increases a surgeon's dependence on their knowledge of anatomical landmarks as well as the CT or MRI images. The use of augmented reality (AR) systems and registration technologies in spinal surgeries could allow for improvements to techniques by overlaying a 3D reconstruction of patient anatomy in the surgeon's field of view, creating a mixed reality visualization. The AR system will be capable of projecting the 3D reconstruction onto a field and preliminary object tracking on a phantom. Dimensional accuracy of the mixed media will also be quantified to account for distortions in tracking.

Using a local low rank plus sparse reconstruction to accelerate dynamic hyperpolarized 13C imaging using the bSSFP sequence

NASA Astrophysics Data System (ADS)

Milshteyn, Eugene; von Morze, Cornelius; Reed, Galen D.; Shang, Hong; Shin, Peter J.; Larson, Peder E. Z.; Vigneron, Daniel B.

2018-05-01

Acceleration of dynamic 2D (T2 Mapping) and 3D hyperpolarized 13C MRI acquisitions using the balanced steady-state free precession sequence was achieved with a specialized reconstruction method, based on the combination of low rank plus sparse and local low rank reconstructions. Methods were validated using both retrospectively and prospectively undersampled in vivo data from normal rats and tumor-bearing mice. Four-fold acceleration of 1-2 mm isotropic 3D dynamic acquisitions with 2-5 s temporal resolution and two-fold acceleration of 0.25-1 mm2 2D dynamic acquisitions was achieved. This enabled visualization of the biodistribution of [2-13C]pyruvate, [1-13C]lactate, [13C, 15N2]urea, and HP001 within heart, kidneys, vasculature, and tumor, as well as calculation of high resolution T2 maps.

Automated UAV-based mapping for airborne reconnaissance and video exploitation

NASA Astrophysics Data System (ADS)

Se, Stephen; Firoozfam, Pezhman; Goldstein, Norman; Wu, Linda; Dutkiewicz, Melanie; Pace, Paul; Naud, J. L. Pierre

2009-05-01

Airborne surveillance and reconnaissance are essential for successful military missions. Such capabilities are critical for force protection, situational awareness, mission planning, damage assessment and others. UAVs gather huge amount of video data but it is extremely labour-intensive for operators to analyse hours and hours of received data. At MDA, we have developed a suite of tools towards automated video exploitation including calibration, visualization, change detection and 3D reconstruction. The on-going work is to improve the robustness of these tools and automate the process as much as possible. Our calibration tool extracts and matches tie-points in the video frames incrementally to recover the camera calibration and poses, which are then refined by bundle adjustment. Our visualization tool stabilizes the video, expands its field-of-view and creates a geo-referenced mosaic from the video frames. It is important to identify anomalies in a scene, which may include detecting any improvised explosive devices (IED). However, it is tedious and difficult to compare video clips to look for differences manually. Our change detection tool allows the user to load two video clips taken from two passes at different times and flags any changes between them. 3D models are useful for situational awareness, as it is easier to understand the scene by visualizing it in 3D. Our 3D reconstruction tool creates calibrated photo-realistic 3D models from video clips taken from different viewpoints, using both semi-automated and automated approaches. The resulting 3D models also allow distance measurements and line-of- sight analysis.

3DSEM++: Adaptive and intelligent 3D SEM surface reconstruction.

PubMed

Tafti, Ahmad P; Holz, Jessica D; Baghaie, Ahmadreza; Owen, Heather A; He, Max M; Yu, Zeyun

2016-08-01

Structural analysis of microscopic objects is a longstanding topic in several scientific disciplines, such as biological, mechanical, and materials sciences. The scanning electron microscope (SEM), as a promising imaging equipment has been around for decades to determine the surface properties (e.g., compositions or geometries) of specimens by achieving increased magnification, contrast, and resolution greater than one nanometer. Whereas SEM micrographs still remain two-dimensional (2D), many research and educational questions truly require knowledge and facts about their three-dimensional (3D) structures. 3D surface reconstruction from SEM images leads to remarkable understanding of microscopic surfaces, allowing informative and qualitative visualization of the samples being investigated. In this contribution, we integrate several computational technologies including machine learning, contrario methodology, and epipolar geometry to design and develop a novel and efficient method called 3DSEM++ for multi-view 3D SEM surface reconstruction in an adaptive and intelligent fashion. The experiments which have been performed on real and synthetic data assert the approach is able to reach a significant precision to both SEM extrinsic calibration and its 3D surface modeling. Copyright © 2016 Elsevier Ltd. All rights reserved.

A Comparison of Four-Image Reconstruction Algorithms for 3-D PET Imaging of MDAPET Camera Using Phantom Data

NASA Astrophysics Data System (ADS)

Baghaei, H.; Wong, Wai-Hoi; Uribe, J.; Li, Hongdi; Wang, Yu; Liu, Yaqiang; Xing, Tao; Ramirez, R.; Xie, Shuping; Kim, Soonseok

2004-10-01

We compared two fully three-dimensional (3-D) image reconstruction algorithms and two 3-D rebinning algorithms followed by reconstruction with a two-dimensional (2-D) filtered-backprojection algorithm for 3-D positron emission tomography (PET) imaging. The two 3-D image reconstruction algorithms were ordered-subsets expectation-maximization (3D-OSEM) and 3-D reprojection (3DRP) algorithms. The two rebinning algorithms were Fourier rebinning (FORE) and single slice rebinning (SSRB). The 3-D projection data used for this work were acquired with a high-resolution PET scanner (MDAPET) with an intrinsic transaxial resolution of 2.8 mm. The scanner has 14 detector rings covering an axial field-of-view of 38.5 mm. We scanned three phantoms: 1) a uniform cylindrical phantom with inner diameter of 21.5 cm; 2) a uniform 11.5-cm cylindrical phantom with four embedded small hot lesions with diameters of 3, 4, 5, and 6 mm; and 3) the 3-D Hoffman brain phantom with three embedded small hot lesion phantoms with diameters of 3, 5, and 8.6 mm in a warm background. Lesions were placed at different radial and axial distances. We evaluated the different reconstruction methods for MDAPET camera by comparing the noise level of images, contrast recovery, and hot lesion detection, and visually compared images. We found that overall the 3D-OSEM algorithm, especially when images post filtered with the Metz filter, produced the best results in terms of contrast-noise tradeoff, and detection of hot spots, and reproduction of brain phantom structures. Even though the MDAPET camera has a relatively small maximum axial acceptance (/spl plusmn/5 deg), images produced with the 3DRP algorithm had slightly better contrast recovery and reproduced the structures of the brain phantom slightly better than the faster 2-D rebinning methods.

Resliced image space construction for coronary artery collagen fibers.

PubMed

Luo, Tong; Chen, Huan; Kassab, Ghassan S

2017-01-01

Collagen fibers play an important role in the biomechanics of the blood vessel wall. The objective of this study was to determine the 3D microstructure of collagen fibers in the media and adventitia of coronary arteries. We present a novel optimal angle consistence algorithm to reform image slices in the visualization and analysis of 3D collagen images. 3D geometry was reconstructed from resliced image space where the 3D skeleton was extracted as the primary feature for accurate reconstruction of geometrical parameters. Collagen fibers (range 80-200) were reconstructed from the porcine coronary artery wall for the measurement of various morphological parameters. Collagen waviness and diameters were 1.37 ± 0.19 and 2.61 ± 0.89 μm, respectively. The biaxial distributions of orientation had two different peaks at 110.7 ± 25.2° and 18.4 ± 19.3°. Results for width, waviness, and orientation were found to be in good agreement with manual measurements. In addition to accurately measuring 2D features more efficiently than the manual approach, the present method produced 3D features that could not be measured in the 2D manual approach. These additional parameters included the tilt angle (5.10 ± 2.95°) and cross-sectional area (CSA; 5.98 ± 3.79 μm2) of collagen fibers. These 3D collagen reconstructions provide accurate and reliable microstructure for biomechanical modeling of vessel wall mechanics.

Human Lumbar Ligamentum Flavum Anatomy for Epidural Anesthesia: Reviewing a 3D MR-Based Interactive Model and Postmortem Samples.

PubMed

Reina, Miguel A; Lirk, Philipp; Puigdellívol-Sánchez, Anna; Mavar, Marija; Prats-Galino, Alberto

2016-03-01

The ligamentum flavum (LF) forms the anatomic basis for the loss-of-resistance technique essential to the performance of epidural anesthesia. However, the LF presents considerable interindividual variability, including the possibility of midline gaps, which may influence the performance of epidural anesthesia. We devise a method to reconstruct the anatomy of the digitally LF based on magnetic resonance images to clarify the exact limits and edges of LF and its different thickness, depending on the area examined, while avoiding destructive methods, as well as the dissection processes. Anatomic cadaveric cross sections enabled us to visually check the definition of the edges along the entire LF and compare them using 3D image reconstruction methods. Reconstruction was performed in images obtained from 7 patients. Images from 1 patient were used as a basis for the 3D spinal anatomy tool. In parallel, axial cuts, 2 to 3 cm thick, were performed in lumbar spines of 4 frozen cadavers. This technique allowed us to identify the entire ligament and its exact limits, while avoiding alterations resulting from cutting processes or from preparation methods. The LF extended between the laminas of adjacent vertebrae at all vertebral levels of the patients examined, but midline gaps are regularly encountered. These anatomical variants were reproduced in a 3D portable document format. The major anatomical features of the LF were reproduced in the 3D model. Details of its structure and variations of thickness in successive sagittal and axial slides could be visualized. Gaps within LF previously studied in cadavers have been identified in our interactive 3D model, which may help to understand their nature, as well as possible implications for epidural techniques.

Clinical validation of coronal and sagittal spinal curve measurements based on three-dimensional vertebra vector parameters.

PubMed

Somoskeöy, Szabolcs; Tunyogi-Csapó, Miklós; Bogyó, Csaba; Illés, Tamás

2012-10-01

For many decades, visualization and evaluation of three-dimensional (3D) spinal deformities have only been possible by two-dimensional (2D) radiodiagnostic methods, and as a result, characterization and classification were based on 2D terminologies. Recent developments in medical digital imaging and 3D visualization techniques including surface 3D reconstructions opened a chance for a long-sought change in this field. Supported by a 3D Terminology on Spinal Deformities of the Scoliosis Research Society, an approach for 3D measurements and a new 3D classification of scoliosis yielded several compelling concepts on 3D visualization and new proposals for 3D classification in recent years. More recently, a new proposal for visualization and complete 3D evaluation of the spine by 3D vertebra vectors has been introduced by our workgroup, a concept, based on EOS 2D/3D, a groundbreaking new ultralow radiation dose integrated orthopedic imaging device with sterEOS 3D spine reconstruction software. Comparison of accuracy, correlation of measurement values, intraobserver and interrater reliability of methods by conventional manual 2D and vertebra vector-based 3D measurements in a routine clinical setting. Retrospective, nonrandomized study of diagnostic X-ray images created as part of a routine clinical protocol of eligible patients examined at our clinic during a 30-month period between July 2007 and December 2009. In total, 201 individuals (170 females, 31 males; mean age, 19.88 years) including 10 healthy athletes with normal spine and patients with adolescent idiopathic scoliosis (175 cases), adult degenerative scoliosis (11 cases), and Scheuermann hyperkyphosis (5 cases). Overall range of coronal curves was between 2.4 and 117.5°. Analysis of accuracy and reliability of measurements was carried out on a group of all patients and in subgroups based on coronal plane deviation: 0 to 10° (Group 1; n=36), 10 to 25° (Group 2; n=25), 25 to 50° (Group 3; n=69), 50 to 75° (Group 4; n=49), and above 75° (Group 5; n=22). All study subjects were examined by EOS 2D imaging, resulting in anteroposterior (AP) and lateral (LAT) full spine, orthogonal digital X-ray images, in standing position. Conventional coronal and sagittal curvature measurements including sagittal L5 vertebra wedges were determined by 3 experienced examiners, using traditional Cobb methods on EOS 2D AP and LAT images. Vertebra vector-based measurements were performed as published earlier, based on computer-assisted calculations of corresponding spinal curvature. Vertebra vectors were generated by dedicated software from sterEOS 3D spine models reconstructed from EOS 2D images by the same three examiners. Manual measurements were performed by each examiner, thrice for sterEOS 3D reconstructions and twice for vertebra vector-based measurements. Means comparison t test, Pearson bivariate correlation analysis, reliability analysis by intraclass correlation coefficients for intraobserver reproducibility and interrater reliability were performed using SPSS v16.0 software. In comparison with manual 2D methods, only small and nonsignificant differences were detectable in vertebra vector-based curvature data for coronal curves and thoracic kyphosis, whereas the found difference in L1-L5 lordosis values was shown to be strongly related to the magnitude of corresponding L5 wedge. Intraobserver reliability was excellent for both methods, and interrater reproducibility was consistently higher for vertebra vector-based methods that was also found to be unaffected by the magnitude of coronal curves or sagittal plane deviations. Vertebra vector-based angulation measurements could fully substitute conventional manual 2D measurements, with similar accuracy and higher intraobserver reliability and interrater reproducibility. Vertebra vectors represent a truly 3D solution for clear and comprehensible 3D visualization of spinal deformities while preserving crucial parametric information for vertebral size, 3D position, orientation, and rotation. The concept of vertebra vectors may serve as a starting point to a valid and clinically useful alternative for a new 3D classification of scoliosis. Copyright © 2012 Elsevier Inc. All rights reserved.

VIPAR, a quantitative approach to 3D histopathology applied to lymphatic malformations

PubMed Central

Hägerling, René; Drees, Dominik; Scherzinger, Aaron; Dierkes, Cathrin; Martin-Almedina, Silvia; Butz, Stefan; Gordon, Kristiana; Schäfers, Michael; Hinrichs, Klaus; Vestweber, Dietmar; Goerge, Tobias; Mansour, Sahar; Mortimer, Peter S.

2017-01-01

BACKGROUND. Lack of investigatory and diagnostic tools has been a major contributing factor to the failure to mechanistically understand lymphedema and other lymphatic disorders in order to develop effective drug and surgical therapies. One difficulty has been understanding the true changes in lymph vessel pathology from standard 2D tissue sections. METHODS. VIPAR (volume information-based histopathological analysis by 3D reconstruction and data extraction), a light-sheet microscopy–based approach for the analysis of tissue biopsies, is based on digital reconstruction and visualization of microscopic image stacks. VIPAR allows semiautomated segmentation of the vasculature and subsequent nonbiased extraction of characteristic vessel shape and connectivity parameters. We applied VIPAR to analyze biopsies from healthy lymphedematous and lymphangiomatous skin. RESULTS. Digital 3D reconstruction provided a directly visually interpretable, comprehensive representation of the lymphatic and blood vessels in the analyzed tissue volumes. The most conspicuous features were disrupted lymphatic vessels in lymphedematous skin and a hyperplasia (4.36-fold lymphatic vessel volume increase) in the lymphangiomatous skin. Both abnormalities were detected by the connectivity analysis based on extracted vessel shape and structure data. The quantitative evaluation of extracted data revealed a significant reduction of lymphatic segment length (51.3% and 54.2%) and straightness (89.2% and 83.7%) for lymphedematous and lymphangiomatous skin, respectively. Blood vessel length was significantly increased in the lymphangiomatous sample (239.3%). CONCLUSION. VIPAR is a volume-based tissue reconstruction data extraction and analysis approach that successfully distinguished healthy from lymphedematous and lymphangiomatous skin. Its application is not limited to the vascular systems or skin. FUNDING. Max Planck Society, DFG (SFB 656), and Cells-in-Motion Cluster of Excellence EXC 1003. PMID:28814672

VIPAR, a quantitative approach to 3D histopathology applied to lymphatic malformations.

PubMed

Hägerling, René; Drees, Dominik; Scherzinger, Aaron; Dierkes, Cathrin; Martin-Almedina, Silvia; Butz, Stefan; Gordon, Kristiana; Schäfers, Michael; Hinrichs, Klaus; Ostergaard, Pia; Vestweber, Dietmar; Goerge, Tobias; Mansour, Sahar; Jiang, Xiaoyi; Mortimer, Peter S; Kiefer, Friedemann

2017-08-17

Lack of investigatory and diagnostic tools has been a major contributing factor to the failure to mechanistically understand lymphedema and other lymphatic disorders in order to develop effective drug and surgical therapies. One difficulty has been understanding the true changes in lymph vessel pathology from standard 2D tissue sections. VIPAR (volume information-based histopathological analysis by 3D reconstruction and data extraction), a light-sheet microscopy-based approach for the analysis of tissue biopsies, is based on digital reconstruction and visualization of microscopic image stacks. VIPAR allows semiautomated segmentation of the vasculature and subsequent nonbiased extraction of characteristic vessel shape and connectivity parameters. We applied VIPAR to analyze biopsies from healthy lymphedematous and lymphangiomatous skin. Digital 3D reconstruction provided a directly visually interpretable, comprehensive representation of the lymphatic and blood vessels in the analyzed tissue volumes. The most conspicuous features were disrupted lymphatic vessels in lymphedematous skin and a hyperplasia (4.36-fold lymphatic vessel volume increase) in the lymphangiomatous skin. Both abnormalities were detected by the connectivity analysis based on extracted vessel shape and structure data. The quantitative evaluation of extracted data revealed a significant reduction of lymphatic segment length (51.3% and 54.2%) and straightness (89.2% and 83.7%) for lymphedematous and lymphangiomatous skin, respectively. Blood vessel length was significantly increased in the lymphangiomatous sample (239.3%). VIPAR is a volume-based tissue reconstruction data extraction and analysis approach that successfully distinguished healthy from lymphedematous and lymphangiomatous skin. Its application is not limited to the vascular systems or skin. Max Planck Society, DFG (SFB 656), and Cells-in-Motion Cluster of Excellence EXC 1003.

An Interactive Training Game Using 3D Sound for Visually Impaired People

ERIC Educational Resources Information Center

Lee, Hsiao Ping; Huang, Yen-Hsuan; Sheu, Tzu-Fang

2013-01-01

The number of visually impaired people is increasing year by year. Although attention has been given to the needs of people with disabilities, most of the discussion has focused on social welfare, while talk about assistive technology for people with disabilities is rare. The blind need training courses for reconstruction and rehabilitation.…

3D Visualization for Phoenix Mars Lander Science Operations

NASA Technical Reports Server (NTRS)

Edwards, Laurence; Keely, Leslie; Lees, David; Stoker, Carol

2012-01-01

Planetary surface exploration missions present considerable operational challenges in the form of substantial communication delays, limited communication windows, and limited communication bandwidth. A 3D visualization software was developed and delivered to the 2008 Phoenix Mars Lander (PML) mission. The components of the system include an interactive 3D visualization environment called Mercator, terrain reconstruction software called the Ames Stereo Pipeline, and a server providing distributed access to terrain models. The software was successfully utilized during the mission for science analysis, site understanding, and science operations activity planning. A terrain server was implemented that provided distribution of terrain models from a central repository to clients running the Mercator software. The Ames Stereo Pipeline generates accurate, high-resolution, texture-mapped, 3D terrain models from stereo image pairs. These terrain models can then be visualized within the Mercator environment. The central cross-cutting goal for these tools is to provide an easy-to-use, high-quality, full-featured visualization environment that enhances the mission science team s ability to develop low-risk productive science activity plans. In addition, for the Mercator and Viz visualization environments, extensibility and adaptability to different missions and application areas are key design goals.

Study of the structure of 3-D composites based on carbon nanotubes in bovine serum albumin matrix by X-ray microtomography

NASA Astrophysics Data System (ADS)

Ignatov, D.; Zhurbina, N.; Gerasimenko, A.

2017-01-01

3-D composites are widely used in tissue engineering. A comprehensive analysis by X-ray microtomography was conducted to study the structure of the 3-D composites. Comprehensive analysis of the structure of the 3-D composites consisted of scanning, image reconstruction of shadow projections, two-dimensional and three-dimensional visualization of the reconstructed images and quantitative analysis of the samples. Experimental samples of composites were formed by laser vaporization of the aqueous dispersion BSA and single-walled (SWCNTs) and multi-layer (MWCNTs) carbon nanotubes. The samples have a homogeneous structure over the entire volume, the percentage of porosity of 3-D composites based on SWCNTs and MWCNTs - 16.44%, 28.31%, respectively. An average pore diameter of 3-D composites based on SWCNTs and MWCNTs - 45 μm 93 μm. 3-D composites based on carbon nanotubes in bovine serum albumin matrix can be used in tissue engineering of bone and cartilage, providing cell proliferation and blood vessel sprouting.

Topology reconstruction for B-Rep modeling from 3D mesh in reverse engineering applications

NASA Astrophysics Data System (ADS)

Bénière, Roseline; Subsol, Gérard; Gesquière, Gilles; Le Breton, François; Puech, William

2012-03-01

Nowadays, most of the manufactured objects are designed using CAD (Computer-Aided Design) software. Nevertheless, for visualization, data exchange or manufacturing applications, the geometric model has to be discretized into a 3D mesh composed of a finite number of vertices and edges. But, in some cases, the initial model may be lost or unavailable. In other cases, the 3D discrete representation may be modified, for example after a numerical simulation, and does not correspond anymore to the initial model. A reverse engineering method is then required to reconstruct a 3D continuous representation from the discrete one. In previous work, we have presented a new approach for 3D geometric primitive extraction. In this paper, to complete our automatic and comprehensive reverse engineering process, we propose a method to construct the topology of the retrieved object. To reconstruct a B-Rep model, a new formalism is now introduced to define the adjacency relations. Then a new process is used to construct the boundaries of the object. The whole process is tested on 3D industrial meshes and bring a solution to recover B-Rep models.

Indoor Photogrammetry Aided with Uwb Navigation

NASA Astrophysics Data System (ADS)

Masiero, A.; Fissore, F.; Guarnieri, A.; Vettore, A.

2018-05-01

The subject of photogrammetric surveying with mobile devices, in particular smartphones, is becoming of significant interest in the research community. Nowadays, the process of providing 3D point clouds with photogrammetric procedures is well known. However, external information is still typically needed in order to move from the point cloud obtained from images to a 3D metric reconstruction. This paper investigates the integration of information provided by an UWB positioning system with visual based reconstruction to produce a metric reconstruction. Furthermore, the orientation (with respect to North-East directions) of the obtained model is assessed thanks to the use of inertial sensors included in the considered UWB devices. Results of this integration are shown on two case studies in indoor environments.

Digital Reconstruction of 3D Polydisperse Dry Foam

NASA Astrophysics Data System (ADS)

Chieco, A.; Feitosa, K.; Roth, A. E.; Korda, P. T.; Durian, D. J.

2012-02-01

Dry foam is a disordered packing of bubbles that distort into familiar polyhedral shapes. We have implemented a method that uses optical axial tomography to reconstruct the internal structure of a dry foam in three dimensions. The technique consists of taking a series of photographs of the dry foam against a uniformly illuminated background at successive angles. By summing the projections we create images of the foam cross section. Image analysis of the cross sections allows us to locate Plateau borders and vertices. The vertices are then connected according to Plateau's rules to reconstruct the internal structure of the foam. Using this technique we are able to visualize a large number of bubbles of real 3D foams and obtain statistics of faces and edges.

Demonstration of three gorges archaeological relics based on 3D-visualization technology

NASA Astrophysics Data System (ADS)

Xu, Wenli

2015-12-01

This paper mainly focuses on the digital demonstration of three gorges archeological relics to exhibit the achievements of the protective measures. A novel and effective method based on 3D-visualization technology, which includes large-scaled landscape reconstruction, virtual studio, and virtual panoramic roaming, etc, is proposed to create a digitized interactive demonstration system. The method contains three stages: pre-processing, 3D modeling and integration. Firstly, abundant archaeological information is classified according to its history and geographical information. Secondly, build up a 3D-model library with the technology of digital images processing and 3D modeling. Thirdly, use virtual reality technology to display the archaeological scenes and cultural relics vividly and realistically. The present work promotes the application of virtual reality to digital projects and enriches the content of digital archaeology.

3D interactive surgical visualization system using mobile spatial information acquisition and autostereoscopic display.

PubMed

Fan, Zhencheng; Weng, Yitong; Chen, Guowen; Liao, Hongen

2017-07-01

Three-dimensional (3D) visualization of preoperative and intraoperative medical information becomes more and more important in minimally invasive surgery. We develop a 3D interactive surgical visualization system using mobile spatial information acquisition and autostereoscopic display for surgeons to observe surgical target intuitively. The spatial information of regions of interest (ROIs) is captured by the mobile device and transferred to a server for further image processing. Triangular patches of intraoperative data with texture are calculated with a dimension-reduced triangulation algorithm and a projection-weighted mapping algorithm. A point cloud selection-based warm-start iterative closest point (ICP) algorithm is also developed for fusion of the reconstructed 3D intraoperative image and the preoperative image. The fusion images are rendered for 3D autostereoscopic display using integral videography (IV) technology. Moreover, 3D visualization of medical image corresponding to observer's viewing direction is updated automatically using mutual information registration method. Experimental results show that the spatial position error between the IV-based 3D autostereoscopic fusion image and the actual object was 0.38±0.92mm (n=5). The system can be utilized in telemedicine, operating education, surgical planning, navigation, etc. to acquire spatial information conveniently and display surgical information intuitively. Copyright © 2017 Elsevier Inc. All rights reserved.

Digital 3D reconstructions using histological serial sections of lung tissue including the alveolar capillary network.

PubMed

Grothausmann, Roman; Knudsen, Lars; Ochs, Matthias; Mühlfeld, Christian

2017-02-01

Grothausmann R, Knudsen L, Ochs M, Mühlfeld C. Digital 3D reconstructions using histological serial sections of lung tissue including the alveolar capillary network. Am J Physiol Lung Cell Mol Physiol 312: L243-L257, 2017. First published December 2, 2016; doi:10.1152/ajplung.00326.2016-The alveolar capillary network (ACN) provides an enormously large surface area that is necessary for pulmonary gas exchange. Changes of the ACN during normal or pathological development or in pulmonary diseases are of great functional impact and warrant further analysis. Due to the complexity of the three-dimensional (3D) architecture of the ACN, 2D approaches are limited in providing a comprehensive impression of the characteristics of the normal ACN or the nature of its alterations. Stereological methods offer a quantitative way to assess the ACN in 3D in terms of capillary volume, surface area, or number but lack a 3D visualization to interpret the data. Hence, the necessity to visualize the ACN in 3D and to correlate this with data from the same set of data arises. Such an approach requires a large sample volume combined with a high resolution. Here, we present a technically simple and cost-efficient approach to create 3D representations of lung tissue ranging from bronchioles over alveolar ducts and alveoli up to the ACN from more than 1 mm sample extent to a resolution of less than 1 μm. The method is based on automated image acquisition of serially sectioned epoxy resin-embedded lung tissue fixed by vascular perfusion and subsequent automated digital reconstruction and analysis of the 3D data. This efficient method may help to better understand mechanisms of vascular development and pathology of the lung. Copyright © 2017 the American Physiological Society.

In vivo three-dimensional confocal laser scanning microscopy of the epithelial nerve structure in the human cornea.

PubMed

Stachs, Oliver; Zhivov, Andrey; Kraak, Robert; Stave, Joachim; Guthoff, Rudolf

2007-04-01

Evaluation of a new method for in vivo visualization of the distribution and morphology of human anterior corneal nerves. The anterior cornea was examined to a depth of 100 microm in four human volunteers with a confocal laser scanning microscope (CLSM) using a Rostock Cornea Module (developed in house) attached to a Heidelberg Retina Tomograph II (Heidelberg Engineering, Germany). Optical sections were digitally reconstructed in 3D using AMIRA (TGS Inc., USA). The scanned volumes had a greatest size of 300 x 300 x 40 microm and voxel size of 0.78 x 0.78 x 0.95 microm. The spatial arrangement of the epithelium, nerves and keratocytes was visualized by in vivo 3D-CLSM. The 3D-reconstruction of the volunteers' corneas in combination with the oblique sections gave a picture of the nerves in the central human cornea. Thin nerves run in the subepithelial plexus aligned parallel to Bowman's layer and are partially interconnected. The diameter of these fibres varied between 1.0 and 5 microm. Thick fibres rose out of the deeper stroma. The diameter of the main nerve trunks was 12+/-2 microm. Branches penetrating the anterior epithelial cell layer could not be visualized. 3D-CLSM allows analysis of the spatial arrangement of the anterior corneal nerves and visualization of the epithelium and keratocytes in the living human cornea. The developed method provides a basis for further studies of alterations of the cellular arrangement and epithelial innervation in corneal disease. This may help to clarify alterations of nerve fibre patterns under various clinical and experimental conditions.

Quantitative 3D electromagnetic field determination of 1D nanostructures from single projection

DOE PAGES

Phatak, C.; Knoop, L. de; Houdellier, F.; ...

2016-05-01

One-dimensional (1D) nanostructures have been regarded as the most promising building blocks for nanoelectronics and nanocomposite material systems as well as for alternative energy applications. Although they result in confinement of a material, their properties and interactions with other nanostructures are still very much three-dimensional (3D) in nature. In this work, we present a novel method for quantitative determination of the 3D electromagnetic fields in and around 1D nanostructures using a single electron wave phase image, thereby eliminating the cumbersome acquisition of tomographic data. Using symmetry arguments, we have reconstructed the 3D magnetic field of a nickel nanowire as wellmore » as the 3D electric field around a carbon nanotube field emitter, from one single projection. The accuracy of quantitative values determined here is shown to be a better fit to the physics at play than the value obtained by conventional analysis. Moreover the 3D reconstructions can then directly be visualized and used in the design of functional 3D architectures built using 1D nanostructures.« less

Quantitative 3D electromagnetic field determination of 1D nanostructures from single projection

DOE Office of Scientific and Technical Information (OSTI.GOV)

Phatak, C.; Knoop, L. de; Houdellier, F.

One-dimensional (1D) nanostructures have been regarded as the most promising building blocks for nanoelectronics and nanocomposite material systems as well as for alternative energy applications. Although they result in confinement of a material, their properties and interactions with other nanostructures are still very much three-dimensional (3D) in nature. In this work, we present a novel method for quantitative determination of the 3D electromagnetic fields in and around 1D nanostructures using a single electron wave phase image, thereby eliminating the cumbersome acquisition of tomographic data. Using symmetry arguments, we have reconstructed the 3D magnetic field of a nickel nanowire as wellmore » as the 3D electric field around a carbon nanotube field emitter, from one single projection. The accuracy of quantitative values determined here is shown to be a better fit to the physics at play than the value obtained by conventional analysis. Moreover the 3D reconstructions can then directly be visualized and used in the design of functional 3D architectures built using 1D nanostructures.« less

D Virtual Reconstruction of the Middle Stoa in the Athens Ancient Agora

NASA Astrophysics Data System (ADS)

Kontogianni, G.; Georgopoulos, A.; Saraga, N.; Alexandraki, E.; Tsogka, K.

2013-02-01

Reconstruction is an action that re-builds a ruin or a non-existing structure trying to reproduce its form and shape at a given moment of its past. Reconstruction of Cultural Heritage monuments used to be common practice during the 19th and 20th centuries. However, contemporary ways of thinking and approaching the issue of reviving the past have introduced a lot of scepticism as far as reconstructions are concerned. An attractive alternative is virtual reconstruction, which does not involve any intervention to the existing relics, while it offers all advantages to the curator. In this paper the virtual reconstruction of a non-existing building of the Athenian Agora is described, presented and visualized. All data collected were evaluated and used appropriately for the final product. It is evident that, on one hand, the data collected do not all belong to the target period and, on the other, not all the data necessary to built up the model are available today. Therefore, one needs to carefully select the data corresponding to the period of study and complete them with suitable hypotheses. It is imperative that both tasks must be done in collaboration of the archaeologists and architects responsible for the monument. In this context a hierarchy of the data was developed, based on their reliability as far as their "correctness" is concerned. The data were categorized for their reliability after careful evaluation. The accuracy of the data depends on the source; hence the data which originate from a drawing or from one study of the 3D reconstructed monument are considered more accurate than data which come from a source referring to architectural elements of other monuments or written reports of travelers. Sometimes the data appear in more than one source, in this case they must be checked for their reliability. In cases of remaining artifacts that could be found in the museum and belonged to the building a different approach was followed. They were used to produce 3D models and these were later attached to the final 3D model. From the final virtual reconstruction a short video has also been produced for the better visualization of the result.

Cryo-electron microscopy and cryo-electron tomography of nanoparticles.

PubMed

Stewart, Phoebe L

2017-03-01

Cryo-transmission electron microscopy (cryo-TEM or cryo-EM) and cryo-electron tomography (cryo-ET) offer robust and powerful ways to visualize nanoparticles. These techniques involve imaging of the sample in a frozen-hydrated state, allowing visualization of nanoparticles essentially as they exist in solution. Cryo-TEM grid preparation can be performed with the sample in aqueous solvents or in various organic and ionic solvents. Two-dimensional (2D) cryo-TEM provides a direct way to visualize the polydispersity within a nanoparticle preparation. Fourier transforms of cryo-TEM images can confirm the structural periodicity within a sample. While measurement of specimen parameters can be performed with 2D TEM images, determination of a three-dimensional (3D) structure often facilitates more spatially accurate quantization. 3D structures can be determined in one of two ways. If the nanoparticle has a homogeneous structure, then 2D projection images of different particles can be averaged using a computational process referred to as single particle reconstruction. Alternatively, if the nanoparticle has a heterogeneous structure, then a structure can be generated by cryo-ET. This involves collecting a tilt-series of 2D projection images for a defined region of the grid, which can be used to generate a 3D tomogram. Occasionally it is advantageous to calculate both a single particle reconstruction, to reveal the regular portions of a nanoparticle structure, and a cryo-electron tomogram, to reveal the irregular features. A sampling of 2D cryo-TEM images and 3D structures are presented for protein based, DNA based, lipid based, and polymer based nanoparticles. WIREs Nanomed Nanobiotechnol 2017, 9:e1417. doi: 10.1002/wnan.1417 For further resources related to this article, please visit the WIREs website. © 2016 Wiley Periodicals, Inc.

Real Time Data Acquisition and Online Signal Processing for Magnetoencephalography

NASA Astrophysics Data System (ADS)

Rongen, H.; Hadamschek, V.; Schiek, M.

2006-06-01

To establish improved therapies for patients suffering from severe neurological and psychiatric diseases, a demand controlled and desynchronizing brain-pacemaker has been developed with techniques from statistical physics and nonlinear dynamics. To optimize the novel therapeutic approach, brain activity is investigated with a Magnetoencephalography (MEG) system prior to surgery. For this, a real time data acquisition system for a 148 channel MEG and online signal processing for artifact rejection, filtering, cross trial phase resetting analysis and three-dimensional (3-D) reconstruction of the cerebral current sources was developed. The developed PCI bus hardware is based on a FPGA and DSP design, using the benefits from both architectures. The reconstruction and visualization of the 3-D volume data is done by the PC which hosts the real time DAQ and pre-processing board. The framework of the MEG-online system is introduced and the architecture of the real time DAQ board and online reconstruction is described. In addition we show first results with the MEG-Online system for the investigation of dynamic brain activities in relation to external visual stimulation, based on test data sets.

A 3D-printed anatomical pancreas and kidney phantom for optimizing SPECT/CT reconstruction settings in beta cell imaging using 111In-exendin.

PubMed

Woliner-van der Weg, Wietske; Deden, Laura N; Meeuwis, Antoi P W; Koenrades, Maaike; Peeters, Laura H C; Kuipers, Henny; Laanstra, Geert Jan; Gotthardt, Martin; Slump, Cornelis H; Visser, Eric P

2016-12-01

Quantitative single photon emission computed tomography (SPECT) is challenging, especially for pancreatic beta cell imaging with 111 In-exendin due to high uptake in the kidneys versus much lower uptake in the nearby pancreas. Therefore, we designed a three-dimensionally (3D) printed phantom representing the pancreas and kidneys to mimic the human situation in beta cell imaging. The phantom was used to assess the effect of different reconstruction settings on the quantification of the pancreas uptake for two different, commercially available software packages. 3D-printed, hollow pancreas and kidney compartments were inserted into the National Electrical Manufacturers Association (NEMA) NU2 image quality phantom casing. These organs and the background compartment were filled with activities simulating relatively high and low pancreatic 111 In-exendin uptake for, respectively, healthy humans and type 1 diabetes patients. Images were reconstructed using Siemens Flash 3D and Hermes Hybrid Recon, with varying numbers of iterations and subsets and corrections. Images were visually assessed on homogeneity and artefacts, and quantitatively by the pancreas-to-kidney activity concentration ratio. Phantom images were similar to clinical images and showed comparable artefacts. All corrections were required to clearly visualize the pancreas. Increased numbers of subsets and iterations improved the quantitative performance but decreased homogeneity both in the pancreas and the background. Based on the phantom analyses, the Hybrid Recon reconstruction with 6 iterations and 16 subsets was found to be most suitable for clinical use. This work strongly contributed to quantification of pancreatic 111 In-exendin uptake. It showed how clinical images of 111 In-exendin can be interpreted and enabled selection of the most appropriate protocol for clinical use.

Supernova Remnant in 3-D

NASA Image and Video Library

2009-01-06

For the first time, a multiwavelength three-dimensional reconstruction of a supernova remnant has been created. This visualization of Cassiopeia A, or Cas A, the result of an explosion approximately 330 years ago, uses data from several NASA telescopes.

Immersive Visualization of the Solid Earth

NASA Astrophysics Data System (ADS)

Kreylos, O.; Kellogg, L. H.

2017-12-01

Immersive visualization using virtual reality (VR) display technology offers unique benefits for the visual analysis of complex three-dimensional data such as tomographic images of the mantle and higher-dimensional data such as computational geodynamics models of mantle convection or even planetary dynamos. Unlike "traditional" visualization, which has to project 3D scalar data or vectors onto a 2D screen for display, VR can display 3D data in a pseudo-holographic (head-tracked stereoscopic) form, and does therefore not suffer the distortions of relative positions, sizes, distances, and angles that are inherent in 2D projection and interfere with interpretation. As a result, researchers can apply their spatial reasoning skills to 3D data in the same way they can to real objects or environments, as well as to complex objects like vector fields. 3D Visualizer is an application to visualize 3D volumetric data, such as results from mantle convection simulations or seismic tomography reconstructions, using VR display technology and a strong focus on interactive exploration. Unlike other visualization software, 3D Visualizer does not present static visualizations, such as a set of cross-sections at pre-selected positions and orientations, but instead lets users ask questions of their data, for example by dragging a cross-section through the data's domain with their hands and seeing data mapped onto that cross-section in real time, or by touching a point inside the data domain, and immediately seeing an isosurface connecting all points having the same data value as the touched point. Combined with tools allowing 3D measurements of positions, distances, and angles, and with annotation tools that allow free-hand sketching directly in 3D data space, the outcome of using 3D Visualizer is not primarily a set of pictures, but derived data to be used for subsequent analysis. 3D Visualizer works best in virtual reality, either in high-end facility-scale environments such as CAVEs, or using commodity low-cost virtual reality headsets such as HTC's Vive. The recent emergence of high-quality commodity VR means that researchers can buy a complete VR system off the shelf, install it and the 3D Visualizer software themselves, and start using it for data analysis immediately.

C-plane Reconstructions from Sheaf Acquisition for Ultrasound Electrode Vibration Elastography.

PubMed

Ingle, Atul; Varghese, Tomy

2014-09-03

This paper presents a novel algorithm for reconstructing and visualizing ablated volumes using radiofrequency ultrasound echo data acquired with the electrode vibration elastography approach. The ablation needle is vibrated using an actuator to generate shear wave pulses that are tracked in the ultrasound image plane at different locations away from the needle. This data is used for reconstructing shear wave velocity maps for each imaging plane. A C-plane reconstruction algorithm is proposed which estimates shear wave velocity values on a collection of transverse planes that are perpendicular to the imaging planes. The algorithm utilizes shear wave velocity maps from different imaging planes that share a common axis of intersection. These C-planes can be used to generate a 3D visualization of the ablated region. Experimental validation of this approach was carried out using data from a tissue mimicking phantom. The shear wave velocity estimates were within 20% of those obtained from a clinical scanner, and a contrast of over 4 dB was obtained between the stiff and soft regions of the phantom.

Intuitive Terrain Reconstruction Using Height Observation-Based Ground Segmentation and 3D Object Boundary Estimation

PubMed Central

Song, Wei; Cho, Kyungeun; Um, Kyhyun; Won, Chee Sun; Sim, Sungdae

2012-01-01

Mobile robot operators must make rapid decisions based on information about the robot’s surrounding environment. This means that terrain modeling and photorealistic visualization are required for the remote operation of mobile robots. We have produced a voxel map and textured mesh from the 2D and 3D datasets collected by a robot’s array of sensors, but some upper parts of objects are beyond the sensors’ measurements and these parts are missing in the terrain reconstruction result. This result is an incomplete terrain model. To solve this problem, we present a new ground segmentation method to detect non-ground data in the reconstructed voxel map. Our method uses height histograms to estimate the ground height range, and a Gibbs-Markov random field model to refine the segmentation results. To reconstruct a complete terrain model of the 3D environment, we develop a 3D boundary estimation method for non-ground objects. We apply a boundary detection technique to the 2D image, before estimating and refining the actual height values of the non-ground vertices in the reconstructed textured mesh. Our proposed methods were tested in an outdoor environment in which trees and buildings were not completely sensed. Our results show that the time required for ground segmentation is faster than that for data sensing, which is necessary for a real-time approach. In addition, those parts of objects that were not sensed are accurately recovered to retrieve their real-world appearances. PMID:23235454

Intuitive terrain reconstruction using height observation-based ground segmentation and 3D object boundary estimation.

PubMed

Song, Wei; Cho, Kyungeun; Um, Kyhyun; Won, Chee Sun; Sim, Sungdae

2012-12-12

Mobile robot operators must make rapid decisions based on information about the robot's surrounding environment. This means that terrain modeling and photorealistic visualization are required for the remote operation of mobile robots. We have produced a voxel map and textured mesh from the 2D and 3D datasets collected by a robot's array of sensors, but some upper parts of objects are beyond the sensors' measurements and these parts are missing in the terrain reconstruction result. This result is an incomplete terrain model. To solve this problem, we present a new ground segmentation method to detect non-ground data in the reconstructed voxel map. Our method uses height histograms to estimate the ground height range, and a Gibbs-Markov random field model to refine the segmentation results. To reconstruct a complete terrain model of the 3D environment, we develop a 3D boundary estimation method for non-ground objects. We apply a boundary detection technique to the 2D image, before estimating and refining the actual height values of the non-ground vertices in the reconstructed textured mesh. Our proposed methods were tested in an outdoor environment in which trees and buildings were not completely sensed. Our results show that the time required for ground segmentation is faster than that for data sensing, which is necessary for a real-time approach. In addition, those parts of objects that were not sensed are accurately recovered to retrieve their real-world appearances.

Surface topography characterization using 3D stereoscopic reconstruction of SEM images

NASA Astrophysics Data System (ADS)

Vedantha Krishna, Amogh; Flys, Olena; Reddy, Vijeth V.; Rosén, B. G.

2018-06-01

A major drawback of the optical microscope is its limitation to resolve finer details. Many microscopes have been developed to overcome the limitations set by the diffraction of visible light. The scanning electron microscope (SEM) is one such alternative: it uses electrons for imaging, which have much smaller wavelength than photons. As a result high magnification with superior image resolution can be achieved. However, SEM generates 2D images which provide limited data for surface measurements and analysis. Often many research areas require the knowledge of 3D structures as they contribute to a comprehensive understanding of microstructure by allowing effective measurements and qualitative visualization of the samples under study. For this reason, stereo photogrammetry technique is employed to convert SEM images into 3D measurable data. This paper aims to utilize a stereoscopic reconstruction technique as a reliable method for characterization of surface topography. Reconstructed results from SEM images are compared with coherence scanning interferometer (CSI) results obtained by measuring a roughness reference standard sample. This paper presents a method to select the most robust/consistent surface texture parameters that are insensitive to the uncertainties involved in the reconstruction technique itself. Results from the two-stereoscopic reconstruction algorithms are also documented in this paper.

Novel fusion for hybrid optical/microcomputed tomography imaging based on natural light surface reconstruction and iterated closest point

NASA Astrophysics Data System (ADS)

Ning, Nannan; Tian, Jie; Liu, Xia; Deng, Kexin; Wu, Ping; Wang, Bo; Wang, Kun; Ma, Xibo

2014-02-01

In mathematics, optical molecular imaging including bioluminescence tomography (BLT), fluorescence tomography (FMT) and Cerenkov luminescence tomography (CLT) are concerned with a similar inverse source problem. They all involve the reconstruction of the 3D location of a single/multiple internal luminescent/fluorescent sources based on 3D surface flux distribution. To achieve that, an accurate fusion between 2D luminescent/fluorescent images and 3D structural images that may be acquired form micro-CT, MRI or beam scanning is extremely critical. However, the absence of a universal method that can effectively convert 2D optical information into 3D makes the accurate fusion challengeable. In this study, to improve the fusion accuracy, a new fusion method for dual-modality tomography (luminescence/fluorescence and micro-CT) based on natural light surface reconstruction (NLSR) and iterated closest point (ICP) was presented. It consisted of Octree structure, exact visual hull from marching cubes and ICP. Different from conventional limited projection methods, it is 360° free-space registration, and utilizes more luminescence/fluorescence distribution information from unlimited multi-orientation 2D optical images. A mouse mimicking phantom (one XPM-2 Phantom Light Source, XENOGEN Corporation) and an in-vivo BALB/C mouse with implanted one luminescent light source were used to evaluate the performance of the new fusion method. Compared with conventional fusion methods, the average error of preset markers was improved by 0.3 and 0.2 pixels from the new method, respectively. After running the same 3D internal light source reconstruction algorithm of the BALB/C mouse, the distance error between the actual and reconstructed internal source was decreased by 0.19 mm.

Hard X-ray submicrometer tomography of human brain tissue at Diamond Light Source

NASA Astrophysics Data System (ADS)

Khimchenko, A.; Bikis, C.; Schulz, G.; Zdora, M.-C.; Zanette, I.; Vila-Comamala, J.; Schweighauser, G.; Hench, J.; Hieber, S. E.; Deyhle, H.; Thalmann, P.; Müller, B.

2017-06-01

There is a lack of the necessary methodology for three-dimensional (3D) investigation of soft tissues with cellular resolution without staining or tissue transformation. Synchrotron radiation based hard X-ray in-line phase contrast tomography using single-distance phase reconstruction (SDPR) provides high spatial resolution and density contrast for the visualization of individual cells using a standard specimen preparation and data reconstruction. In this study, we demonstrate the 3D characterization of a formalin-fixed paraffin-embedded (FFPE) human cerebellum specimen by SDPR at the Diamond-Manchester Imaging Branchline I13-2 (Diamond Light Source, UK) at pixel sizes down to 0.45 μm. The approach enables visualization of cerebellar layers (Stratum moleculare and Stratum granulosum), the 3D characterization of individual cells (Purkinje, stellate and granule cells) and can even resolve some subcellular structures (nucleus and nucleolus of Purkinje cells). The tomographic results are qualitatively compared to hematoxylin and eosin (H&E) stained histological sections. We demonstrate the potential benefits of hard X-ray microtomography for the investigations of biological tissues in comparison to conventional histology.

Virtual reality and 3D animation in forensic visualization.

PubMed

Ma, Minhua; Zheng, Huiru; Lallie, Harjinder

2010-09-01

Computer-generated three-dimensional (3D) animation is an ideal media to accurately visualize crime or accident scenes to the viewers and in the courtrooms. Based upon factual data, forensic animations can reproduce the scene and demonstrate the activity at various points in time. The use of computer animation techniques to reconstruct crime scenes is beginning to replace the traditional illustrations, photographs, and verbal descriptions, and is becoming popular in today's forensics. This article integrates work in the areas of 3D graphics, computer vision, motion tracking, natural language processing, and forensic computing, to investigate the state-of-the-art in forensic visualization. It identifies and reviews areas where new applications of 3D digital technologies and artificial intelligence could be used to enhance particular phases of forensic visualization to create 3D models and animations automatically and quickly. Having discussed the relationships between major crime types and level-of-detail in corresponding forensic animations, we recognized that high level-of-detail animation involving human characters, which is appropriate for many major crime types but has had limited use in courtrooms, could be useful for crime investigation. © 2010 American Academy of Forensic Sciences.

Three-Dimensional Image Fusion of 18F-Fluorodeoxyglucose-Positron Emission Tomography/Computed Tomography and Contrast-Enhanced Computed Tomography for Computer-Assisted Planning of Maxillectomy of Recurrent Maxillary Squamous Cell Carcinoma and Defect Reconstruction.

PubMed

Yu, Yao; Zhang, Wen-Bo; Liu, Xiao-Jing; Guo, Chuan-Bin; Yu, Guang-Yan; Peng, Xin

2017-06-01

The purpose of this study was to describe new technology assisted by 3-dimensional (3D) image fusion of 18 F-fluorodeoxyglucose (FDG)-positron emission tomography (PET)/computed tomography (CT) and contrast-enhanced CT (CECT) for computer planning of a maxillectomy of recurrent maxillary squamous cell carcinoma and defect reconstruction. Treatment of recurrent maxillary squamous cell carcinoma usually includes tumor resection and free flap reconstruction. FDG-PET/CT provided images of regions of abnormal glucose uptake and thus showed metabolic tumor volume to guide tumor resection. CECT data were used to create 3D reconstructed images of vessels to show the vascular diameters and locations, so that the most suitable vein and artery could be selected during anastomosis of the free flap. The data from preoperative maxillofacial CECT scans and FDG-PET/CT imaging were imported into the navigation system (iPlan 3.0; Brainlab, Feldkirchen, Germany). Three-dimensional image fusion between FDG-PET/CT and CECT was accomplished using Brainlab software according to the position of the 2 skulls simulated in the CECT image and PET/CT image, respectively. After verification of the image fusion accuracy, the 3D reconstruction images of the metabolic tumor, vessels, and other critical structures could be visualized within the same coordinate system. These sagittal, coronal, axial, and 3D reconstruction images were used to determine the virtual osteotomy sites and reconstruction plan, which was provided to the surgeon and used for surgical navigation. The average shift of the 3D image fusion between FDG-PET/CT and CECT was less than 1 mm. This technique, by clearly showing the metabolic tumor volume and the most suitable vessels for anastomosis, facilitated resection and reconstruction of recurrent maxillary squamous cell carcinoma. We used 3D image fusion of FDG-PET/CT and CECT to successfully accomplish resection and reconstruction of recurrent maxillary squamous cell carcinoma. This method has the potential to improve the clinical outcomes of these challenging procedures. Copyright © 2017 American Association of Oral and Maxillofacial Surgeons. Published by Elsevier Inc. All rights reserved.

A Hierarchical Building Segmentation in Digital Surface Models for 3D Reconstruction

PubMed Central

Yan, Yiming; Gao, Fengjiao; Deng, Shupei; Su, Nan

2017-01-01

In this study, a hierarchical method for segmenting buildings in a digital surface model (DSM), which is used in a novel framework for 3D reconstruction, is proposed. Most 3D reconstructions of buildings are model-based. However, the limitations of these methods are overreliance on completeness of the offline-constructed models of buildings, and the completeness is not easily guaranteed since in modern cities buildings can be of a variety of types. Therefore, a model-free framework using high precision DSM and texture-images buildings was introduced. There are two key problems with this framework. The first one is how to accurately extract the buildings from the DSM. Most segmentation methods are limited by either the terrain factors or the difficult choice of parameter-settings. A level-set method are employed to roughly find the building regions in the DSM, and then a recently proposed ‘occlusions of random textures model’ are used to enhance the local segmentation of the buildings. The second problem is how to generate the facades of buildings. Synergizing with the corresponding texture-images, we propose a roof-contour guided interpolation of building facades. The 3D reconstruction results achieved by airborne-like images and satellites are compared. Experiments show that the segmentation method has good performance, and 3D reconstruction is easily performed by our framework, and better visualization results can be obtained by airborne-like images, which can be further replaced by UAV images. PMID:28125018

A Hierarchical Building Segmentation in Digital Surface Models for 3D Reconstruction.

PubMed

Yan, Yiming; Gao, Fengjiao; Deng, Shupei; Su, Nan

2017-01-24

In this study, a hierarchical method for segmenting buildings in a digital surface model (DSM), which is used in a novel framework for 3D reconstruction, is proposed. Most 3D reconstructions of buildings are model-based. However, the limitations of these methods are overreliance on completeness of the offline-constructed models of buildings, and the completeness is not easily guaranteed since in modern cities buildings can be of a variety of types. Therefore, a model-free framework using high precision DSM and texture-images buildings was introduced. There are two key problems with this framework. The first one is how to accurately extract the buildings from the DSM. Most segmentation methods are limited by either the terrain factors or the difficult choice of parameter-settings. A level-set method are employed to roughly find the building regions in the DSM, and then a recently proposed 'occlusions of random textures model' are used to enhance the local segmentation of the buildings. The second problem is how to generate the facades of buildings. Synergizing with the corresponding texture-images, we propose a roof-contour guided interpolation of building facades. The 3D reconstruction results achieved by airborne-like images and satellites are compared. Experiments show that the segmentation method has good performance, and 3D reconstruction is easily performed by our framework, and better visualization results can be obtained by airborne-like images, which can be further replaced by UAV images.

Tradeoff between noise reduction and inartificial visualization in a model-based iterative reconstruction algorithm on coronary computed tomography angiography.

PubMed

Hirata, Kenichiro; Utsunomiya, Daisuke; Kidoh, Masafumi; Funama, Yoshinori; Oda, Seitaro; Yuki, Hideaki; Nagayama, Yasunori; Iyama, Yuji; Nakaura, Takeshi; Sakabe, Daisuke; Tsujita, Kenichi; Yamashita, Yasuyuki

2018-05-01

We aimed to evaluate the image quality performance of coronary CT angiography (CTA) under the different settings of forward-projected model-based iterative reconstruction solutions (FIRST).Thirty patients undergoing coronary CTA were included. Each image was reconstructed using filtered back projection (FBP), adaptive iterative dose reduction 3D (AIDR-3D), and 2 model-based iterative reconstructions including FIRST-body and FIRST-cardiac sharp (CS). CT number and noise were measured in the coronary vessels and plaque. Subjective image-quality scores were obtained for noise and structure visibility.In the objective image analysis, FIRST-body produced the significantly highest contrast-to-noise ratio. Regarding subjective image quality, FIRST-CS had the highest score for structure visibility, although the image noise score was inferior to that of FIRST-body.In conclusion, FIRST provides significant improvements in objective and subjective image quality compared with FBP and AIDR-3D. FIRST-body effectively reduces image noise, but the structure visibility with FIRST-CS was superior to FIRST-body.

Interrogation of patient data delivered to the operating theatre during hepato-pancreatic surgery using high-performance computing.

PubMed

John, Nigel W; McCloy, Rory F; Herrman, Simone

2004-01-01

The Op3D visualization system allows, for the first time, a surgeon in the operating theatre to interrogate patient-specific medical data sets rendered in three dimensions using high-performance computing. The hypothesis of this research is that the success rate of hepato-pancreatic surgical resections can be improved by replacing the light box with an interactive 3D representation of the medical data in the operating theatre. A laptop serves as the client computer and an easy-to-use interface has been developed for the surgeon to interact with and interrogate the patient data. To date, 16 patients have had 3D reconstructions of their DICOM data sets, including preoperative interrogation and planning of surgery. Interrogation of the 3D images live in theatre and comparison with the surgeons' operative findings (including intraoperative ultrasound) led to the operation being abandoned in 25% of cases, adoption of an alternative surgical approach in 25% of cases, and helpful image guidance for successful resection in 50% of cases. The clinical value of the latest generation of scanners and digital imaging techniques cannot be realized unless appropriate dissemination of the images takes place. This project has succeeded in translating the image technology into a user-friendly form and delivers 3D reconstructions of patient-specific data to the "sharp end"-the surgeon undertaking the tumor resection in theatre, in a manner that allows interaction and interpretation. More time interrogating the 3D data sets preoperatively would help reduce the incidence of abandoned operations-this is part of the surgeons' learning curve. We have developed one of the first practical applications to benefit from remote visualization, and certainly the first medical visualization application of this kind.

In situ flash x-ray high-speed computed tomography for the quantitative analysis of highly dynamic processes

NASA Astrophysics Data System (ADS)

Moser, Stefan; Nau, Siegfried; Salk, Manfred; Thoma, Klaus

2014-02-01

The in situ investigation of dynamic events, ranging from car crash to ballistics, often is key to the understanding of dynamic material behavior. In many cases the important processes and interactions happen on the scale of milli- to microseconds at speeds of 1000 m s-1 or more. Often, 3D information is necessary to fully capture and analyze all relevant effects. High-speed 3D-visualization techniques are thus required for the in situ analysis. 3D-capable optical high-speed methods often are impaired by luminous effects and dust, while flash x-ray based methods usually deliver only 2D data. In this paper, a novel 3D-capable flash x-ray based method, in situ flash x-ray high-speed computed tomography is presented. The method is capable of producing 3D reconstructions of high-speed processes based on an undersampled dataset consisting of only a few (typically 3 to 6) x-ray projections. The major challenges are identified, discussed and the chosen solution outlined. The application is illustrated with an exemplary application of a 1000 m s-1 high-speed impact event on the scale of microseconds. A quantitative analysis of the in situ measurement of the material fragments with a 3D reconstruction with 1 mm voxel size is presented and the results are discussed. The results show that the HSCT method allows gaining valuable visual and quantitative mechanical information for the understanding and interpretation of high-speed events.

[Principles of the EOS™ X-ray machine and its use in daily orthopedic practice].

PubMed

Illés, Tamás; Somoskeöy, Szabolcs

2012-02-26

The EOS™ X-ray machine, based on a Nobel prize-winning invention in Physics in the field of particle detection, is capable of simultaneously capturing biplanar X-ray images by slot scanning of the whole body in an upright, physiological load-bearing position, using ultra low radiation doses. The simultaneous capture of spatially calibrated anterioposterior and lateral images allows the performance of a three-dimensional (3D) surface reconstruction of the skeletal system by a special software. Parts of the skeletal system in X-ray images and 3D-reconstructed models appear in true 1:1 scale for size and volume, thus spinal and vertebral parameters, lower limb axis lengths and angles, as well as any relevant clinical parameters in orthopedic practice could be very precisely measured and calculated. Visualization of 3D reconstructed models in various views by the sterEOS 3D software enables the presentation of top view images, through which one can analyze the rotational conditions of lower limbs, joints and spine deformities in horizontal plane and this provides revolutionary novel possibilities in orthopedic surgery, especially in spine surgery.

Development of an inexpensive optical method for studies of dental erosion process in vitro

NASA Astrophysics Data System (ADS)

Nasution, A. M. T.; Noerjanto, B.; Triwanto, L.

2008-09-01

Teeth have important roles in digestion of food, supporting the facial-structure, as well as in articulation of speech. Abnormality in teeth structure can be initiated by an erosion process due to diet or beverages consumption that lead to destruction which affect their functionality. Research to study the erosion processes that lead to teeth's abnormality is important in order to be used as a care and prevention purpose. Accurate measurement methods would be necessary as a research tool, in order to be capable for quantifying dental destruction's degree. In this work an inexpensive optical method as tool to study dental erosion process is developed. It is based on extraction the parameters from the 3D dental visual information. The 3D visual image is obtained from reconstruction of multiple lateral projection of 2D images that captured from many angles. Using a simple motor stepper and a pocket digital camera, sequence of multi-projection 2D images of premolar tooth is obtained. This images are then reconstructed to produce a 3D image, which is useful for quantifying related dental erosion parameters. The quantification process is obtained from the shrinkage of dental volume as well as surface properties due to erosion process. Results of quantification is correlated to the ones of dissolved calcium atom which released from the tooth using atomic absorption spectrometry. This proposed method would be useful as visualization tool in many engineering, dentistry, and medical research. It would be useful also for the educational purposes.

Automated 3D architecture reconstruction from photogrammetric structure-and-motion: A case study of the One Pilla pagoda, Hanoi, Vienam

NASA Astrophysics Data System (ADS)

To, T.; Nguyen, D.; Tran, G.

2015-04-01

Heritage system of Vietnam has decline because of poor-conventional condition. For sustainable development, it is required a firmly control, space planning organization, and reasonable investment. Moreover, in the field of Cultural Heritage, the use of automated photogrammetric systems, based on Structure from Motion techniques (SfM), is widely used. With the potential of high-resolution, low-cost, large field of view, easiness, rapidity and completeness, the derivation of 3D metric information from Structure-and- Motion images is receiving great attention. In addition, heritage objects in form of 3D physical models are recorded not only for documentation issues, but also for historical interpretation, restoration, cultural and educational purposes. The study suggests the archaeological documentation of the "One Pilla" pagoda placed in Hanoi capital, Vietnam. The data acquired through digital camera Cannon EOS 550D, CMOS APS-C sensor 22.3 x 14.9 mm. Camera calibration and orientation were carried out by VisualSFM, CMPMVS (Multi-View Reconstruction) and SURE (Photogrammetric Surface Reconstruction from Imagery) software. The final result represents a scaled 3D model of the One Pilla Pagoda and displayed different views in MeshLab software.

3D visualization of the scoliotic spine: longitudinal studies, data acquisition, and radiation dosage constraints

NASA Astrophysics Data System (ADS)

Kalvin, Alan D.; Adler, Roy L.; Margulies, Joseph Y.; Tresser, Charles P.; Wu, Chai W.

1999-05-01

Decision making in the treatment of scoliosis is typically based on longitudinal studies that involve the imaging and visualization the progressive degeneration of a patient's spine over a period of years. Some patients will need surgery if their spinal deformation exceeds a certain degree of severity. Currently, surgeons rely on 2D measurements, obtained from x-rays, to quantify spinal deformation. Clearly working only with 2D measurements seriously limits the surgeon's ability to infer 3D spinal pathology. Standard CT scanning is not a practical solution for obtaining 3D spinal measurements of scoliotic patients. Because it would expose the patient to a prohibitively high dose of radiation. We have developed 2 new CT-based methods of 3D spinal visualization that produce 3D models of the spine by integrating a very small number of axial CT slices with data obtained from CT scout data. In the first method the scout data are converted to sinogram data, and then processed by a tomographic image reconstruction algorithm. In the second method, the vertebral boundaries are detected in the scout data, and these edges are then used as linear constraints to determine 2D convex hulls of the vertebrae.

Spectral data compression using weighted principal component analysis with consideration of human visual system and light sources

NASA Astrophysics Data System (ADS)

Cao, Qian; Wan, Xiaoxia; Li, Junfeng; Liu, Qiang; Liang, Jingxing; Li, Chan

2016-10-01

This paper proposed two weight functions based on principal component analysis (PCA) to reserve more colorimetric information in spectral data compression process. One weight function consisted of the CIE XYZ color-matching functions representing the characteristic of the human visual system, while another was made up of the CIE XYZ color-matching functions of human visual system and relative spectral power distribution of the CIE standard illuminant D65. The improvement obtained from the proposed two methods were tested to compress and reconstruct the reflectance spectra of 1600 glossy Munsell color chips and 1950 Natural Color System color chips as well as six multispectral images. The performance was evaluated by the mean values of color difference under the CIE 1931 standard colorimetric observer and the CIE standard illuminant D65 and A. The mean values of root mean square errors between the original and reconstructed spectra were also calculated. The experimental results show that the proposed two methods significantly outperform the standard PCA and another two weighted PCA in the aspects of colorimetric reconstruction accuracy with very slight degradation in spectral reconstruction accuracy. In addition, weight functions with the CIE standard illuminant D65 can improve the colorimetric reconstruction accuracy compared to weight functions without the CIE standard illuminant D65.

Three-dimensional reconstruction of the topographical cerebral surface anatomy for presurgical planning with free OsiriX Software.

PubMed

Harput, Mehmet V; Gonzalez-Lopez, Pablo; Türe, Uğur

2014-09-01

During surgery for intrinsic brain lesions, it is important to distinguish the pathological gyrus from the surrounding normal sulci and gyri. This task is usually tedious because of the pia-arachnoid membranes with their arterial and venous complexes that obscure the underlying anatomy. Moreover, most tumors grow in the white matter without initially distorting the cortical anatomy, making their direct visualization more difficult. To create and evaluate a simple and free surgical planning tool to simulate the anatomy of the surgical field with and without vessels. We used free computer software (OsiriX Medical Imaging Software) that allowed us to create 3-dimensional reconstructions of the cerebral surface with and without cortical vessels. These reconstructions made use of magnetic resonance images from 51 patients with neocortical supratentorial lesions operated on over a period of 21 months (June 2011 to February 2013). The 3-dimensional (3-D) anatomic images were compared with the true surgical view to evaluate their accuracy. In all patients, the landmarks determined by 3-D reconstruction were cross-checked during surgery with high-resolution ultrasonography; in select cases, they were also checked with indocyanine green videoangiography. The reconstructed neurovascular structures were confirmed intraoperatively in all patients. We found this technique to be extremely useful in achieving pure lesionectomy, as it defines tumor's borders precisely. A 3-D reconstruction of the cortical surface can be easily created with free OsiriX software. This technique helps the surgeon perfect the mentally created 3-D picture of the tumor location to carry out cleaner, safer surgeries.

Using a local low rank plus sparse reconstruction to accelerate dynamic hyperpolarized 13C imaging using the bSSFP sequence.

PubMed

Milshteyn, Eugene; von Morze, Cornelius; Reed, Galen D; Shang, Hong; Shin, Peter J; Larson, Peder E Z; Vigneron, Daniel B

2018-05-01

Acceleration of dynamic 2D (T 2 Mapping) and 3D hyperpolarized 13 C MRI acquisitions using the balanced steady-state free precession sequence was achieved with a specialized reconstruction method, based on the combination of low rank plus sparse and local low rank reconstructions. Methods were validated using both retrospectively and prospectively undersampled in vivo data from normal rats and tumor-bearing mice. Four-fold acceleration of 1-2 mm isotropic 3D dynamic acquisitions with 2-5 s temporal resolution and two-fold acceleration of 0.25-1 mm 2 2D dynamic acquisitions was achieved. This enabled visualization of the biodistribution of [2- 13 C]pyruvate, [1- 13 C]lactate, [ 13 C,  15 N 2 ]urea, and HP001 within heart, kidneys, vasculature, and tumor, as well as calculation of high resolution T 2 maps. Copyright © 2018 Elsevier Inc. All rights reserved.

ANGIOCARE: an automated system for fast three-dimensional coronary reconstruction by integrating angiographic and intracoronary ultrasound data.

PubMed

Bourantas, Christos V; Kalatzis, Fanis G; Papafaklis, Michail I; Fotiadis, Dimitrios I; Tweddel, Ann C; Kourtis, Iraklis C; Katsouras, Christos S; Michalis, Lampros K

2008-08-01

The development of an automated, user-friendly system (ANGIOCARE), for rapid three-dimensional (3D) coronary reconstruction, integrating angiographic and, intracoronary ultrasound (ICUS) data. Biplane angiographic and ICUS sequence images are imported into the system where a prevalidated method is used for coronary reconstruction. This incorporates extraction of the catheter path from two end-diastolic X-ray images and detection of regions of interest (lumen, outer vessel wall) in the ICUS sequence by an automated border detection algorithm. The detected borders are placed perpendicular to the catheter path and established algorithms used to estimate their absolute orientation. The resulting 3D object is imported into an advanced visualization module with which the operator can interact, examine plaque distribution (depicted as a color coded map) and assess plaque burden by virtual endoscopy. Data from 19 patients (27 vessels) undergoing biplane angiography and ICUS were examined. The reconstructed vessels were 21.3-80.2 mm long. The mean difference was 0.9 +/- 2.9% between the plaque volumes measured using linear 3D ICUS analysis and the volumes, estimated by taking into account the curvature of the vessel. The time required to reconstruct a luminal narrowing of 25 mm was approximately 10 min. The ANGIOCARE system provides rapid coronary reconstruction allowing the operator accurately to estimate the length of the lesion and determine plaque distribution and volume. (c) 2008 Wiley-Liss, Inc.

A high-level 3D visualization API for Java and ImageJ.

PubMed

Schmid, Benjamin; Schindelin, Johannes; Cardona, Albert; Longair, Mark; Heisenberg, Martin

2010-05-21

Current imaging methods such as Magnetic Resonance Imaging (MRI), Confocal microscopy, Electron Microscopy (EM) or Selective Plane Illumination Microscopy (SPIM) yield three-dimensional (3D) data sets in need of appropriate computational methods for their analysis. The reconstruction, segmentation and registration are best approached from the 3D representation of the data set. Here we present a platform-independent framework based on Java and Java 3D for accelerated rendering of biological images. Our framework is seamlessly integrated into ImageJ, a free image processing package with a vast collection of community-developed biological image analysis tools. Our framework enriches the ImageJ software libraries with methods that greatly reduce the complexity of developing image analysis tools in an interactive 3D visualization environment. In particular, we provide high-level access to volume rendering, volume editing, surface extraction, and image annotation. The ability to rely on a library that removes the low-level details enables concentrating software development efforts on the algorithm implementation parts. Our framework enables biomedical image software development to be built with 3D visualization capabilities with very little effort. We offer the source code and convenient binary packages along with extensive documentation at http://3dviewer.neurofly.de.

Format preferences of district attorneys for post-mortem medical imaging reports: understandability, cost effectiveness, and suitability for the courtroom: a questionnaire based study.

PubMed

Ampanozi, Garyfalia; Zimmermann, David; Hatch, Gary M; Ruder, Thomas D; Ross, Steffen; Flach, Patricia M; Thali, Michael J; Ebert, Lars C

2012-05-01

The objective of this study was to explore the perception of the legal authorities regarding different report types and visualization techniques for post-mortem radiological findings. A standardized digital questionnaire was developed and the district attorneys in the catchment area of the affiliated Forensic Institute were requested to evaluate four different types of forensic imaging reports based on four cases examples. Each case was described in four different report types (short written report only, gray-scale CT image with figure caption, color-coded CT image with figure caption, 3D-reconstruction with figure caption). The survey participants were asked to evaluate those types of reports regarding understandability, cost effectiveness and overall appropriateness for the courtroom. 3D reconstructions and color-coded CT images accompanied by written report were preferred regarding understandability and cost/effectiveness. 3D reconstructions of the forensic findings reviewed as most adequate for court. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Do's and don'ts of cryo-electron microscopy: a primer on sample preparation and high quality data collection for macromolecular 3D reconstruction.

PubMed

Cabra, Vanessa; Samsó, Montserrat

2015-01-09

Cryo-electron microscopy (cryoEM) entails flash-freezing a thin layer of sample on a support, and then visualizing the sample in its frozen hydrated state by transmission electron microscopy (TEM). This can be achieved with very low quantity of protein and in the buffer of choice, without the use of any stain, which is very useful to determine structure-function correlations of macromolecules. When combined with single-particle image processing, the technique has found widespread usefulness for 3D structural determination of purified macromolecules. The protocol presented here explains how to perform cryoEM and examines the causes of most commonly encountered problems for rational troubleshooting; following all these steps should lead to acquisition of high quality cryoEM images. The technique requires access to the electron microscope instrument and to a vitrification device. Knowledge of the 3D reconstruction concepts and software is also needed for computerized image processing. Importantly, high quality results depend on finding the right purification conditions leading to a uniform population of structurally intact macromolecules. The ability of cryoEM to visualize macromolecules combined with the versatility of single particle image processing has proven very successful for structural determination of large proteins and macromolecular machines in their near-native state, identification of their multiple components by 3D difference mapping, and creation of pseudo-atomic structures by docking of x-ray structures. The relentless development of cryoEM instrumentation and image processing techniques for the last 30 years has resulted in the possibility to generate de novo 3D reconstructions at atomic resolution level.

3D Reconstruction in the Presence of Glass and Mirrors by Acoustic and Visual Fusion.

PubMed

Zhang, Yu; Ye, Mao; Manocha, Dinesh; Yang, Ruigang

2017-07-06

We present a practical and inexpensive method to reconstruct 3D scenes that include transparent and mirror objects. Our work is motivated by the need for automatically generating 3D models of interior scenes, which commonly include glass. These large structures are often invisible to cameras. Existing 3D reconstruction methods for transparent objects are usually not applicable in such a room-sized reconstruction setting. Our simple hardware setup augments a regular depth camera with a single ultrasonic sensor, which is able to measure the distance to any object, including transparent surfaces. The key technical challenge is the sparse sampling rate from the acoustic sensor, which only takes one point measurement per frame. To address this challenge, we take advantage of the fact that the large scale glass structures in indoor environments are usually either piece-wise planar or simple parametric surfaces. Based on these assumptions, we have developed a novel sensor fusion algorithm that first segments the (hybrid) depth map into different categories such as opaque/transparent/infinity (e.g., too far to measure) and then updates the depth map based on the segmentation outcome. We validated our algorithms with a number of challenging cases, including multiple panes of glass, mirrors, and even a curved glass cabinet.

A new approach of building 3D visualization framework for multimodal medical images display and computed assisted diagnosis

NASA Astrophysics Data System (ADS)

Li, Zhenwei; Sun, Jianyong; Zhang, Jianguo

2012-02-01

As more and more CT/MR studies are scanning with larger volume of data sets, more and more radiologists and clinician would like using PACS WS to display and manipulate these larger data sets of images with 3D rendering features. In this paper, we proposed a design method and implantation strategy to develop 3D image display component not only with normal 3D display functions but also with multi-modal medical image fusion as well as compute-assisted diagnosis of coronary heart diseases. The 3D component has been integrated into the PACS display workstation of Shanghai Huadong Hospital, and the clinical practice showed that it is easy for radiologists and physicians to use these 3D functions such as multi-modalities' (e.g. CT, MRI, PET, SPECT) visualization, registration and fusion, and the lesion quantitative measurements. The users were satisfying with the rendering speeds and quality of 3D reconstruction. The advantages of the component include low requirements for computer hardware, easy integration, reliable performance and comfortable application experience. With this system, the radiologists and the clinicians can manipulate with 3D images easily, and use the advanced visualization tools to facilitate their work with a PACS display workstation at any time.

A Novel 2D Image Compression Algorithm Based on Two Levels DWT and DCT Transforms with Enhanced Minimize-Matrix-Size Algorithm for High Resolution Structured Light 3D Surface Reconstruction

NASA Astrophysics Data System (ADS)

Siddeq, M. M.; Rodrigues, M. A.

2015-09-01

Image compression techniques are widely used on 2D image 2D video 3D images and 3D video. There are many types of compression techniques and among the most popular are JPEG and JPEG2000. In this research, we introduce a new compression method based on applying a two level discrete cosine transform (DCT) and a two level discrete wavelet transform (DWT) in connection with novel compression steps for high-resolution images. The proposed image compression algorithm consists of four steps. (1) Transform an image by a two level DWT followed by a DCT to produce two matrices: DC- and AC-Matrix, or low and high frequency matrix, respectively, (2) apply a second level DCT on the DC-Matrix to generate two arrays, namely nonzero-array and zero-array, (3) apply the Minimize-Matrix-Size algorithm to the AC-Matrix and to the other high-frequencies generated by the second level DWT, (4) apply arithmetic coding to the output of previous steps. A novel decompression algorithm, Fast-Match-Search algorithm (FMS), is used to reconstruct all high-frequency matrices. The FMS-algorithm computes all compressed data probabilities by using a table of data, and then using a binary search algorithm for finding decompressed data inside the table. Thereafter, all decoded DC-values with the decoded AC-coefficients are combined in one matrix followed by inverse two levels DCT with two levels DWT. The technique is tested by compression and reconstruction of 3D surface patches. Additionally, this technique is compared with JPEG and JPEG2000 algorithm through 2D and 3D root-mean-square-error following reconstruction. The results demonstrate that the proposed compression method has better visual properties than JPEG and JPEG2000 and is able to more accurately reconstruct surface patches in 3D.

Building Virtual Mars

NASA Astrophysics Data System (ADS)

Abercrombie, S. P.; Menzies, A.; Goddard, C.

2017-12-01

Virtual and augmented reality enable scientists to visualize environments that are very difficult, or even impossible to visit, such as the surface of Mars. A useful immersive visualization begins with a high quality reconstruction of the environment under study. This presentation will discuss a photogrammetry pipeline developed at the Jet Propulsion Laboratory to reconstruct 3D models of the surface of Mars using stereo images sent back to Earth by the Curiosity Mars rover. The resulting models are used to support a virtual reality tool (OnSight) that allows scientists and engineers to visualize the surface of Mars as if they were standing on the red planet. Images of Mars present challenges to existing scene reconstruction solutions. Surface images of Mars are sparse with minimal overlap, and are often taken from extremely different viewpoints. In addition, the specialized cameras used by Mars rovers are significantly different than consumer cameras, and GPS localization data is not available on Mars. This presentation will discuss scene reconstruction with an emphasis on coping with limited input data, and on creating models suitable for rendering in virtual reality at high frame rate.

Evaluation of a breast software model for 2D and 3D X-ray imaging studies of the breast.

PubMed

Baneva, Yanka; Bliznakova, Kristina; Cockmartin, Lesley; Marinov, Stoyko; Buliev, Ivan; Mettivier, Giovanni; Bosmans, Hilde; Russo, Paolo; Marshall, Nicholas; Bliznakov, Zhivko

2017-09-01

In X-ray imaging, test objects reproducing breast anatomy characteristics are realized to optimize issues such as image processing or reconstruction, lesion detection performance, image quality and radiation induced detriment. Recently, a physical phantom with a structured background has been introduced for both 2D mammography and breast tomosynthesis. A software version of this phantom and a few related versions are now available and a comparison between these 3D software phantoms and the physical phantom will be presented. The software breast phantom simulates a semi-cylindrical container filled with spherical beads of different diameters. Four computational breast phantoms were generated with a dedicated software application and for two of these, physical phantoms are also available and they are used for the side by side comparison. Planar projections in mammography and tomosynthesis were simulated under identical incident air kerma conditions. Tomosynthesis slices were reconstructed with an in-house developed reconstruction software. In addition to a visual comparison, parameters like fractal dimension, power law exponent β and second order statistics (skewness, kurtosis) of planar projections and tomosynthesis reconstructed images were compared. Visually, an excellent agreement between simulated and real planar and tomosynthesis images is observed. The comparison shows also an overall very good agreement between parameters evaluated from simulated and experimental images. The computational breast phantoms showed a close match with their physical versions. The detailed mathematical analysis of the images confirms the agreement between real and simulated 2D mammography and tomosynthesis images. The software phantom is ready for optimization purpose and extrapolation of the phantom to other breast imaging techniques. Copyright © 2017 Associazione Italiana di Fisica Medica. Published by Elsevier Ltd. All rights reserved.

Photogrammetric point cloud compression for tactical networks

NASA Astrophysics Data System (ADS)

Madison, Andrew C.; Massaro, Richard D.; Wayant, Clayton D.; Anderson, John E.; Smith, Clint B.

2017-05-01

We report progress toward the development of a compression schema suitable for use in the Army's Common Operating Environment (COE) tactical network. The COE facilitates the dissemination of information across all Warfighter echelons through the establishment of data standards and networking methods that coordinate the readout and control of a multitude of sensors in a common operating environment. When integrated with a robust geospatial mapping functionality, the COE enables force tracking, remote surveillance, and heightened situational awareness to Soldiers at the tactical level. Our work establishes a point cloud compression algorithm through image-based deconstruction and photogrammetric reconstruction of three-dimensional (3D) data that is suitable for dissimination within the COE. An open source visualization toolkit was used to deconstruct 3D point cloud models based on ground mobile light detection and ranging (LiDAR) into a series of images and associated metadata that can be easily transmitted on a tactical network. Stereo photogrammetric reconstruction is then conducted on the received image stream to reveal the transmitted 3D model. The reported method boasts nominal compression ratios typically on the order of 250 while retaining tactical information and accurate georegistration. Our work advances the scope of persistent intelligence, surveillance, and reconnaissance through the development of 3D visualization and data compression techniques relevant to the tactical operations environment.

Analyzing Structure and Function of Vascularization in Engineered Bone Tissue by Video-Rate Intravital Microscopy and 3D Image Processing.

PubMed

Pang, Yonggang; Tsigkou, Olga; Spencer, Joel A; Lin, Charles P; Neville, Craig; Grottkau, Brian

2015-10-01

Vascularization is a key challenge in tissue engineering. Three-dimensional structure and microcirculation are two fundamental parameters for evaluating vascularization. Microscopic techniques with cellular level resolution, fast continuous observation, and robust 3D postimage processing are essential for evaluation, but have not been applied previously because of technical difficulties. In this study, we report novel video-rate confocal microscopy and 3D postimage processing techniques to accomplish this goal. In an immune-deficient mouse model, vascularized bone tissue was successfully engineered using human bone marrow mesenchymal stem cells (hMSCs) and human umbilical vein endothelial cells (HUVECs) in a poly (D,L-lactide-co-glycolide) (PLGA) scaffold. Video-rate (30 FPS) intravital confocal microscopy was applied in vitro and in vivo to visualize the vascular structure in the engineered bone and the microcirculation of the blood cells. Postimage processing was applied to perform 3D image reconstruction, by analyzing microvascular networks and calculating blood cell viscosity. The 3D volume reconstructed images show that the hMSCs served as pericytes stabilizing the microvascular network formed by HUVECs. Using orthogonal imaging reconstruction and transparency adjustment, both the vessel structure and blood cells within the vessel lumen were visualized. Network length, network intersections, and intersection densities were successfully computed using our custom-developed software. Viscosity analysis of the blood cells provided functional evaluation of the microcirculation. These results show that by 8 weeks, the blood vessels in peripheral areas function quite similarly to the host vessels. However, the viscosity drops about fourfold where it is only 0.8 mm away from the host. In summary, we developed novel techniques combining intravital microscopy and 3D image processing to analyze the vascularization in engineered bone. These techniques have broad applicability for evaluating vascularization in other engineered tissues as well.

Seeing More by Showing Less: Orientation-Dependent Transparency Rendering for Fiber Tractography Visualization

PubMed Central

Tax, Chantal M. W.; Chamberland, Maxime; van Stralen, Marijn; Viergever, Max A.; Whittingstall, Kevin; Fortin, David; Descoteaux, Maxime; Leemans, Alexander

2015-01-01

Fiber tractography plays an important role in exploring the architectural organization of fiber trajectories, both in fundamental neuroscience and in clinical applications. With the advent of diffusion MRI (dMRI) approaches that can also model “crossing fibers”, the complexity of the fiber network as reconstructed with tractography has increased tremendously. Many pathways interdigitate and overlap, which hampers an unequivocal 3D visualization of the network and impedes an efficient study of its organization. We propose a novel fiber tractography visualization approach that interactively and selectively adapts the transparency rendering of fiber trajectories as a function of their orientation to enhance the visibility of the spatial context. More specifically, pathways that are oriented (locally or globally) along a user-specified opacity axis can be made more transparent or opaque. This substantially improves the 3D visualization of the fiber network and the exploration of tissue configurations that would otherwise be largely covered by other pathways. We present examples of fiber bundle extraction and neurosurgical planning cases where the added benefit of our new visualization scheme is demonstrated over conventional fiber visualization approaches. PMID:26444010

Seeing More by Showing Less: Orientation-Dependent Transparency Rendering for Fiber Tractography Visualization.

PubMed

Tax, Chantal M W; Chamberland, Maxime; van Stralen, Marijn; Viergever, Max A; Whittingstall, Kevin; Fortin, David; Descoteaux, Maxime; Leemans, Alexander

2015-01-01

Fiber tractography plays an important role in exploring the architectural organization of fiber trajectories, both in fundamental neuroscience and in clinical applications. With the advent of diffusion MRI (dMRI) approaches that can also model "crossing fibers", the complexity of the fiber network as reconstructed with tractography has increased tremendously. Many pathways interdigitate and overlap, which hampers an unequivocal 3D visualization of the network and impedes an efficient study of its organization. We propose a novel fiber tractography visualization approach that interactively and selectively adapts the transparency rendering of fiber trajectories as a function of their orientation to enhance the visibility of the spatial context. More specifically, pathways that are oriented (locally or globally) along a user-specified opacity axis can be made more transparent or opaque. This substantially improves the 3D visualization of the fiber network and the exploration of tissue configurations that would otherwise be largely covered by other pathways. We present examples of fiber bundle extraction and neurosurgical planning cases where the added benefit of our new visualization scheme is demonstrated over conventional fiber visualization approaches.

3D reconstructions of quail-chick chimeras provide a new fate map of the avian scapula.

PubMed

Shearman, Rebecca M; Tulenko, Frank J; Burke, Ann C

2011-07-01

Limbed vertebrates have functionally integrated postcranial axial and appendicular systems derived from two distinct populations of embryonic mesoderm. The axial skeletal elements arise from the paraxial somites, the appendicular skeleton and sternum arise from the somatic lateral plate mesoderm, and all of the muscles for both systems arise from the somites. Recent studies in amniotes demonstrate that the scapula has a mixed mesodermal origin. Here we determine the relative contribution of somitic and lateral plate mesoderm to the avian scapula from quail-chick chimeras. We generate 3D reconstructions of the grafted tissue in the host revealing a very different distribution of somitic cells in the scapula than previously reported. This novel 3D visualization of the cryptic border between somitic and lateral plate populations reveals the dynamics of musculoskeletal morphogenesis and demonstrates the importance of 3D visualization of chimera data. Reconstructions of chimeras make clear three significant contrasts with existing models of scapular development. First, the majority of the avian scapula is lateral plate derived and the somitic contribution to the scapular blade is significantly smaller than in previous models. Second, the segmentation of the somitic component of the blade is partially lost; and third, there are striking differences in growth rates between different tissues derived from the same somites that contribute to the structures of the cervical thoracic transition, including the scapula. These data call for the reassessment of theories on the development, homology, and evolution of the vertebrate scapula. Copyright © 2011 Elsevier Inc. All rights reserved.

3D bubble reconstruction using multiple cameras and space carving method

NASA Astrophysics Data System (ADS)

Fu, Yucheng; Liu, Yang

2018-07-01

An accurate measurement of bubble shape and size has a significant value in understanding the behavior of bubbles that exist in many engineering applications. Past studies usually use one or two cameras to estimate bubble volume, surface area, among other parameters. The 3D bubble shape and rotation angle are generally not available in these studies. To overcome this challenge and obtain more detailed information of individual bubbles, a 3D imaging system consisting of four high-speed cameras is developed in this paper, and the space carving method is used to reconstruct the 3D bubble shape based on the recorded high-speed images from different view angles. The proposed method can reconstruct the bubble surface with minimal assumptions. A benchmarking test is performed in a 3 cm  ×  1 cm rectangular channel with stagnant water. The results show that the newly proposed method can measure the bubble volume with an error of less than 2% compared with the syringe reading. The conventional two-camera system has an error around 10%. The one-camera system has an error greater than 25%. The visualization of a 3D bubble rising demonstrates the wall influence on bubble rotation angle and aspect ratio. This also explains the large error that exists in the single camera measurement.

Art care: A multi-modality coronary 3D reconstruction and hemodynamic status assessment software.

PubMed

Siogkas, Panagiotis K; Stefanou, Kostas A; Athanasiou, Lambros S; Papafaklis, Michail I; Michalis, Lampros K; Fotiadis, Dimitrios I

2018-01-01

Due to the incremental increase of clinical interest in the development of software that allows the 3-dimensional (3D) reconstruction and the functional assessment of the coronary vasculature, several software packages have been developed and are available today. Taking this into consideration, we have developed an innovative suite of software modules that perform 3D reconstruction of coronary arterial segments using different coronary imaging modalities such as IntraVascular UltraSound (IVUS) and invasive coronary angiography images (ICA), Optical Coherence Tomography (OCT) and ICA images, or plain ICA images and can safely and accurately assess the hemodynamic status of the artery of interest. The user can perform automated or manual segmentation of the IVUS or OCT images, visualize in 3D the reconstructed vessel and export it to formats, which are compatible with other Computer Aided Design (CAD) software systems. We employ finite elements to provide the capability to assess the hemodynamic functionality of the reconstructed vessels by calculating the virtual functional assessment index (vFAI), an index that corresponds and has been shown to correlate well to the actual fractional flow reserve (FFR) value. All the modules of the proposed system have been thoroughly validated. In brief, the 3D-QCA module, compared to a successful commercial software of the same genre, presented very good correlation using several validation metrics, with a Pearson's correlation coefficient (R) for the calculated volumes, vFAI, length and minimum lumen diameter of 0.99, 0.99, 0.99 and 0.88, respectively. Moreover, the automatic lumen detection modules for IVUS and OCT presented very high accuracy compared to the annotations by medical experts with the Pearson's correlation coefficient reaching the values of 0.94 and 0.99, respectively. In this study, we have presented a user-friendly software for the 3D reconstruction of coronary arterial segments and the accurate hemodynamic assessment of the severity of existing stenosis.

Virtual 3D bladder reconstruction for augmented medical records from white light cystoscopy (Conference Presentation)

NASA Astrophysics Data System (ADS)

Lurie, Kristen L.; Zlatev, Dimitar V.; Angst, Roland; Liao, Joseph C.; Ellerbee, Audrey K.

2016-02-01

Bladder cancer has a high recurrence rate that necessitates lifelong surveillance to detect mucosal lesions. Examination with white light cystoscopy (WLC), the standard of care, is inherently subjective and data storage limited to clinical notes, diagrams, and still images. A visual history of the bladder wall can enhance clinical and surgical management. To address this clinical need, we developed a tool to transform in vivo WLC videos into virtual 3-dimensional (3D) bladder models using advanced computer vision techniques. WLC videos from rigid cystoscopies (1280 x 720 pixels) were recorded at 30 Hz followed by immediate camera calibration to control for image distortions. Video data were fed into an automated structure-from-motion algorithm that generated a 3D point cloud followed by a 3D mesh to approximate the bladder surface. The highest quality cystoscopic images were projected onto the approximated bladder surface to generate a virtual 3D bladder reconstruction. In intraoperative WLC videos from 36 patients undergoing transurethral resection of suspected bladder tumors, optimal reconstruction was achieved from frames depicting well-focused vasculature, when the bladder was maintained at constant volume with minimal debris, and when regions of the bladder wall were imaged multiple times. A significant innovation of this work is the ability to perform the reconstruction using video from a clinical procedure collected with standard equipment, thereby facilitating rapid clinical translation, application to other forms of endoscopy and new opportunities for longitudinal studies of cancer recurrence.

MRI vs. CT for orthodontic applications: comparison of two MRI protocols and three CT (multislice, cone-beam, industrial) technologies.

PubMed

Detterbeck, Andreas; Hofmeister, Michael; Hofmann, Elisabeth; Haddad, Daniel; Weber, Daniel; Hölzing, Astrid; Zabler, Simon; Schmid, Matthias; Hiller, Karl-Heinz; Jakob, Peter; Engel, Jens; Hiller, Jochen; Hirschfelder, Ursula

2016-07-01

To examine the relative usefulness and suitability of magnetic resonance imaging (MRI) in daily clinical practice as compared to various technologies of computed tomography (CT) in addressing questions of orthodontic interest. Three blinded raters evaluated 2D slices and 3D reconstructions created from scans of two pig heads. Five imaging modalities were used, including three CT technologies-multislice (MSCT), cone-beam CT (CBCT), and industrial (µCT)-and two MRI protocols with different scan durations. Defined orthodontic parameters were rated one by one on the 2D slices and the 3D reconstructions, followed by final overall ratings for each modality. A mixed linear model was used for statistical analysis. Based on the 2D slices, the parameter of visualizing tooth-germ topography did not yield any significantly different ratings for MRI versus any of the CT scans. While some ratings for the other parameters did involve significant differences, how these should be interpreted depends greatly on the relevance of each parameter. Based on the 3D reconstructions, the only significant difference between technologies was noted for the parameter of visualizing root-surface morphology. Based on the final overall ratings, the imaging performance of the standard MRI protocol was noninferior to the performance of the three CT technologies. On comparing the imaging performance of MRI and CT scans, it becomes clear that MRI has a huge potential for applications in daily clinical practice. Given its additional benefits of a good contrast ratio and complete absence of ionizing radiation, further studies are needed to explore this clinical potential in greater detail.

Piecewise-Planar StereoScan: Sequential Structure and Motion using Plane Primitives.

PubMed

Raposo, Carolina; Antunes, Michel; P Barreto, Joao

2017-08-09

The article describes a pipeline that receives as input a sequence of stereo images, and outputs the camera motion and a Piecewise-Planar Reconstruction (PPR) of the scene. The pipeline, named Piecewise-Planar StereoScan (PPSS), works as follows: the planes in the scene are detected for each stereo view using semi-dense depth estimation; the relative pose is computed by a new closed-form minimal algorithm that only uses point correspondences whenever plane detections do not fully constrain the motion; the camera motion and the PPR are jointly refined by alternating between discrete optimization and continuous bundle adjustment; and, finally, the detected 3D planes are segmented in images using a new framework that handles low texture and visibility issues. PPSS is extensively validated in indoor and outdoor datasets, and benchmarked against two popular point-based SfM pipelines. The experiments confirm that plane-based visual odometry is resilient to situations of small image overlap, poor texture, specularity, and perceptual aliasing where the fast LIBVISO2 pipeline fails. The comparison against VisualSfM+CMVS/PMVS shows that, for a similar computational complexity, PPSS is more accurate and provides much more compelling and visually pleasant 3D models. These results strongly suggest that plane primitives are an advantageous alternative to point correspondences for applications of SfM and 3D reconstruction in man-made environments.

Isolation, electron microscopic imaging, and 3-D visualization of native cardiac thin myofilaments.

PubMed

Spiess, M; Steinmetz, M O; Mandinova, A; Wolpensinger, B; Aebi, U; Atar, D

1999-06-15

An increasing number of cardiac diseases are currently pinpointed to reside at the level of the thin myofilaments (e.g., cardiomyopathies, reperfusion injury). Hence the aim of our study was to develop a new method for the isolation of mammalian thin myofilaments suitable for subsequent high-resolution electron microscopic imaging. Native cardiac thin myofilaments were extracted from glycerinated porcine myocardial tissue in the presence of protease inhibitors. Separation of thick and thin myofilaments was achieved by addition of ATP and several centrifugation steps. Negative staining and subsequent conventional and scanning transmission electron microscopy (STEM) of thin myofilaments permitted visualization of molecular details; unlike conventional preparations of thin myofilaments, our method reveals the F-actin moiety and allows direct recognition of thin myofilament-associated porcine cardiac troponin complexes. They appear as "bulges" at regular intervals of approximately 36 nm along the actin filaments. Protein analysis using SDS-polyacrylamide gel electrophoresis revealed that only approximately 20% troponin I was lost during the isolation procedure. In a further step, 3-D helical reconstructions were calculated using STEM dark-field images. These 3-D reconstructions will allow further characterization of molecular details, and they will be useful for directly visualizing molecular alterations related to diseased cardiac thin myofilaments (e.g., reperfusion injury, alterations of Ca2+-mediated tropomyosin switch). Copyright 1999 Academic Press.

First 3D reconstruction of the rhizocephalan root system using MicroCT

NASA Astrophysics Data System (ADS)

Noever, Christoph; Keiler, Jonas; Glenner, Henrik

2016-07-01

Parasitic barnacles (Cirripedia: Rhizocephala) are highly specialized parasites of crustaceans. Instead of an alimentary tract for feeding they utilize a system of roots, which infiltrates the body of their hosts to absorb nutrients. Using X-ray micro computer tomography (MicroCT) and computer-aided 3D-reconstruction, we document the spatial organization of this root system, the interna, inside the intact host and also demonstrate its use for morphological examinations of the parasites reproductive part, the externa. This is the first 3D visualization of the unique root system of the Rhizocephala in situ, showing how it is related to the inner organs of the host. We investigated the interna from different parasitic barnacles of the family Peltogastridae, which are parasitic on anomuran crustaceans. Rhizocephalan parasites of pagurid hermit crabs and lithodid crabs were analysed in this study.

Rapid reconstruction of 3D neuronal morphology from light microscopy images with augmented rayburst sampling.

PubMed

Ming, Xing; Li, Anan; Wu, Jingpeng; Yan, Cheng; Ding, Wenxiang; Gong, Hui; Zeng, Shaoqun; Liu, Qian

2013-01-01

Digital reconstruction of three-dimensional (3D) neuronal morphology from light microscopy images provides a powerful technique for analysis of neural circuits. It is time-consuming to manually perform this process. Thus, efficient computer-assisted approaches are preferable. In this paper, we present an innovative method for the tracing and reconstruction of 3D neuronal morphology from light microscopy images. The method uses a prediction and refinement strategy that is based on exploration of local neuron structural features. We extended the rayburst sampling algorithm to a marching fashion, which starts from a single or a few seed points and marches recursively forward along neurite branches to trace and reconstruct the whole tree-like structure. A local radius-related but size-independent hemispherical sampling was used to predict the neurite centerline and detect branches. Iterative rayburst sampling was performed in the orthogonal plane, to refine the centerline location and to estimate the local radius. We implemented the method in a cooperative 3D interactive visualization-assisted system named flNeuronTool. The source code in C++ and the binaries are freely available at http://sourceforge.net/projects/flneurontool/. We validated and evaluated the proposed method using synthetic data and real datasets from the Digital Reconstruction of Axonal and Dendritic Morphology (DIADEM) challenge. Then, flNeuronTool was applied to mouse brain images acquired with the Micro-Optical Sectioning Tomography (MOST) system, to reconstruct single neurons and local neural circuits. The results showed that the system achieves a reasonable balance between fast speed and acceptable accuracy, which is promising for interactive applications in neuronal image analysis.

3D visualization techniques for the STEREO-mission

NASA Astrophysics Data System (ADS)

Wiegelmann, T.; Podlipnik, B.; Inhester, B.; Feng, L.; Ruan, P.

The forthcoming STEREO-mission will observe the Sun from two different viewpoints We expect about 2GB data per day which ask for suitable data presentation techniques A key feature of STEREO is that it will provide for the first time a 3D-view of the Sun and the solar corona In our normal environment we see objects three dimensional because the light from real 3D objects needs different travel times to our left and right eye As a consequence we see slightly different images with our eyes which gives us information about the depth of objects and a corresponding 3D impression Techniques for the 3D-visualization of scientific and other data on paper TV computer screen cinema etc are well known e g two colour anaglyph technique shutter glasses polarization filters and head-mounted displays We discuss advantages and disadvantages of these techniques and how they can be applied to STEREO-data The 3D-visualization techniques are not limited to visual images but can be also used to show the reconstructed coronal magnetic field and energy and helicity distribution In the advent of STEREO we test the method with data from SOHO which provides us different viewpoints by the solar rotation This restricts the analysis to structures which remain stationary for several days Real STEREO-data will not be affected by these limitations however

Depicting surgical anatomy of the porta hepatis in living donor liver transplantation.

PubMed

Kelly, Paul; Fung, Albert; Qu, Joy; Greig, Paul; Tait, Gordon; Jenkinson, Jodie; McGilvray, Ian; Agur, Anne

2017-01-01

Visualizing the complex anatomy of vascular and biliary structures of the liver on a case-by-case basis has been challenging. A living donor liver transplant (LDLT) right hepatectomy case, with focus on the porta hepatis, was used to demonstrate an innovative method to visualize anatomy with the purpose of refining preoperative planning and teaching of complex surgical procedures. The production of an animation-enhanced video consisted of many stages including the integration of pre-surgical planning; case-specific footage and 3D models of the liver and associated vasculature, reconstructed from contrast-enhanced CTs. Reconstructions of the biliary system were modeled from intraoperative cholangiograms. The distribution of the donor portal veins, hepatic arteries and bile ducts was defined from the porta hepatis intrahepatically to the point of surgical division. Each step of the surgery was enhanced with 3D animation to provide sequential and seamless visualization from pre-surgical planning to outcome. Use of visualization techniques such as transparency and overlays allows viewers not only to see the operative field, but also the origin and course of segmental branches and their spatial relationships. This novel educational approach enables integrating case-based operative footage with advanced editing techniques for visualizing not only the surgical procedure, but also complex anatomy such as vascular and biliary structures. The surgical team has found this approach to be beneficial for preoperative planning and clinical teaching, especially for complex cases. Each animation-enhanced video case is posted to the open-access Toronto Video Atlas of Surgery (TVASurg), an education resource with a global clinical and patient user base. The novel educational system described in this paper enables integrating operative footage with 3D animation and cinematic editing techniques for seamless sequential organization from pre-surgical planning to outcome.

Depicting surgical anatomy of the porta hepatis in living donor liver transplantation

PubMed Central

Fung, Albert; Qu, Joy; Greig, Paul; Tait, Gordon; Jenkinson, Jodie; McGilvray, Ian; Agur, Anne

2017-01-01

Visualizing the complex anatomy of vascular and biliary structures of the liver on a case-by-case basis has been challenging. A living donor liver transplant (LDLT) right hepatectomy case, with focus on the porta hepatis, was used to demonstrate an innovative method to visualize anatomy with the purpose of refining preoperative planning and teaching of complex surgical procedures. The production of an animation-enhanced video consisted of many stages including the integration of pre-surgical planning; case-specific footage and 3D models of the liver and associated vasculature, reconstructed from contrast-enhanced CTs. Reconstructions of the biliary system were modeled from intraoperative cholangiograms. The distribution of the donor portal veins, hepatic arteries and bile ducts was defined from the porta hepatis intrahepatically to the point of surgical division. Each step of the surgery was enhanced with 3D animation to provide sequential and seamless visualization from pre-surgical planning to outcome. Use of visualization techniques such as transparency and overlays allows viewers not only to see the operative field, but also the origin and course of segmental branches and their spatial relationships. This novel educational approach enables integrating case-based operative footage with advanced editing techniques for visualizing not only the surgical procedure, but also complex anatomy such as vascular and biliary structures. The surgical team has found this approach to be beneficial for preoperative planning and clinical teaching, especially for complex cases. Each animation-enhanced video case is posted to the open-access Toronto Video Atlas of Surgery (TVASurg), an education resource with a global clinical and patient user base. The novel educational system described in this paper enables integrating operative footage with 3D animation and cinematic editing techniques for seamless sequential organization from pre-surgical planning to outcome. PMID:29078606

Reconstruction and 3D visualisation based on objective real 3D based documentation.

PubMed

Bolliger, Michael J; Buck, Ursula; Thali, Michael J; Bolliger, Stephan A

2012-09-01

Reconstructions based directly upon forensic evidence alone are called primary information. Historically this consists of documentation of findings by verbal protocols, photographs and other visual means. Currently modern imaging techniques such as 3D surface scanning and radiological methods (computer tomography, magnetic resonance imaging) are also applied. Secondary interpretation is based on facts and the examiner's experience. Usually such reconstructive expertises are given in written form, and are often enhanced by sketches. However, narrative interpretations can, especially in complex courses of action, be difficult to present and can be misunderstood. In this report we demonstrate the use of graphic reconstruction of secondary interpretation with supporting pictorial evidence, applying digital visualisation (using 'Poser') or scientific animation (using '3D Studio Max', 'Maya') and present methods of clearly distinguishing between factual documentation and examiners' interpretation based on three cases. The first case involved a pedestrian who was initially struck by a car on a motorway and was then run over by a second car. The second case involved a suicidal gunshot to the head with a rifle, in which the trigger was pushed with a rod. The third case dealt with a collision between two motorcycles. Pictorial reconstruction of the secondary interpretation of these cases has several advantages. The images enable an immediate overview, give rise to enhanced clarity, and compel the examiner to look at all details if he or she is to create a complete image.

Volume-of-Change Cone-Beam CT for Image-Guided Surgery

PubMed Central

Lee, Junghoon; Stayman, J. Webster; Otake, Yoshito; Schafer, Sebastian; Zbijewski, Wojciech; Khanna, A. Jay; Prince, Jerry L.; Siewerdsen, Jeffrey H.

2012-01-01

C-arm cone-beam CT (CBCT) can provide intraoperative 3D imaging capability for surgical guidance, but workflow and radiation dose are the significant barriers to broad utilization. One main reason is that each 3D image acquisition requires a complete scan with a full radiation dose to present a completely new 3D image every time. In this paper, we propose to utilize patient-specific CT or CBCT as prior knowledge to accurately reconstruct the aspects of the region that have changed by the surgical procedure from only a sparse set of x-rays. The proposed methods consist of a 3D-2D registration between the prior volume and a sparse set of intraoperative x-rays, creating digitally reconstructed radiographs (DRR) from the registered prior volume, computing difference images by subtracting DRRs from the intraoperative x-rays, a penalized likelihood reconstruction of the volume of change (VOC) from the difference images, and finally a fusion of VOC reconstruction with the prior volume to visualize the entire surgical field. When the surgical changes are local and relatively small, the VOC reconstruction involves only a small volume size and a small number of projections, allowing less computation and lower radiation dose than is needed to reconstruct the entire surgical field. We applied this approach to sacroplasty phantom data obtained from a CBCT test bench and vertebroplasty data with a fresh cadaver acquired from a C-arm CBCT system with a flat-panel detector (FPD). The VOCs were reconstructed from varying number of images (10–66 images) and compared to the CBCT ground truth using four different metrics (mean squared error, correlation coefficient, structural similarity index, and perceptual difference model). The results show promising reconstruction quality with structural similarity to the ground truth close to 1 even when only 15–20 images were used, allowing dose reduction by the factor of 10–20. PMID:22801026

Volume-of-change cone-beam CT for image-guided surgery

NASA Astrophysics Data System (ADS)

Lee, Junghoon; Webster Stayman, J.; Otake, Yoshito; Schafer, Sebastian; Zbijewski, Wojciech; Khanna, A. Jay; Prince, Jerry L.; Siewerdsen, Jeffrey H.

2012-08-01

C-arm cone-beam CT (CBCT) can provide intraoperative 3D imaging capability for surgical guidance, but workflow and radiation dose are the significant barriers to broad utilization. One main reason is that each 3D image acquisition requires a complete scan with a full radiation dose to present a completely new 3D image every time. In this paper, we propose to utilize patient-specific CT or CBCT as prior knowledge to accurately reconstruct the aspects of the region that have changed by the surgical procedure from only a sparse set of x-rays. The proposed methods consist of a 3D-2D registration between the prior volume and a sparse set of intraoperative x-rays, creating digitally reconstructed radiographs (DRRs) from the registered prior volume, computing difference images by subtracting DRRs from the intraoperative x-rays, a penalized likelihood reconstruction of the volume of change (VOC) from the difference images, and finally a fusion of VOC reconstruction with the prior volume to visualize the entire surgical field. When the surgical changes are local and relatively small, the VOC reconstruction involves only a small volume size and a small number of projections, allowing less computation and lower radiation dose than is needed to reconstruct the entire surgical field. We applied this approach to sacroplasty phantom data obtained from a CBCT test bench and vertebroplasty data with a fresh cadaver acquired from a C-arm CBCT system with a flat-panel detector. The VOCs were reconstructed from a varying number of images (10-66 images) and compared to the CBCT ground truth using four different metrics (mean squared error, correlation coefficient, structural similarity index and perceptual difference model). The results show promising reconstruction quality with structural similarity to the ground truth close to 1 even when only 15-20 images were used, allowing dose reduction by the factor of 10-20.

Imaging and characterizing cells using tomography

PubMed Central

Do, Myan; Isaacson, Samuel A.; McDermott, Gerry; Le Gros, Mark A.; Larabell, Carolyn A.

2015-01-01

We can learn much about cell function by imaging and quantifying sub-cellular structures, especially if this is done non-destructively without altering said structures. Soft x-ray tomography (SXT) is a high-resolution imaging technique for visualizing cells and their interior structure in 3D. A tomogram of the cell, reconstructed from a series of 2D projection images, can be easily segmented and analyzed. SXT has a very high specimen throughput compared to other high-resolution structure imaging modalities; for example, tomographic data for reconstructing an entire eukaryotic cell is acquired in a matter of minutes. SXT visualizes cells without the need for chemical fixation, dehydration, or staining of the specimen. As a result, the SXT reconstructions are close representations of cells in their native state. SXT is applicable to most cell types. The deep penetration of soft x-rays allows cells, even mammalian cells, to be imaged without being sectioned. Image contrast in SXT is generated by the differential attenuation soft x-ray illumination as it passes through the specimen. Accordingly, each voxel in the tomographic reconstruction has a measured linear absorption coefficient (LAC) value. LAC values are quantitative and give rise to each sub-cellular component having a characteristic LAC profile, allowing organelles to be identified and segmented from the milieu of other cell contents. In this chapter, we describe the fundamentals of SXT imaging and how this technique can answer real world questions in the study of the nucleus. We also describe the development of correlative methods for the localization of specific molecules in a SXT reconstruction. The combination of fluorescence and SXT data acquired from the same specimen produces composite 3D images, rich with detailed information on the inner workings of cells. PMID:25602704

Merging Surface Reconstructions of Terrestrial and Airborne LIDAR Range Data

DTIC Science & Technology

2009-05-19

Mangan and R. Whitaker. Partitioning 3D surface meshes using watershed segmentation . IEEE Trans. on Visualization and Computer Graphics, 5(4), pp...Jain, and A. Zakhor. Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images. International...acquired set of overlapping range images into a single mesh [2,9,10]. However, due to the volume of data involved in large scale urban modeling, data

[Optimizing histological image data for 3-D reconstruction using an image equalizer].

PubMed

Roth, A; Melzer, K; Annacker, K; Lipinski, H G; Wiemann, M; Bingmann, D

2002-01-01

Bone cells form a wired network within the extracellular bone matrix. To analyse this complex 3D structure, we employed a confocal fluorescence imaging procedure to visualize live bone cells within their native surrounding. By means of newly developed image processing software, the "Image-Equalizer", we aimed to enhanced the contrast and eliminize artefacts in such a way that cell bodies as well as fine interconnecting processes were visible.

Combined High-Speed 3D Scalar and Velocity Reconstruction of Hairpin Vortex

NASA Astrophysics Data System (ADS)

Sabatino, Daniel; Rossmann, Tobias; Zhu, Xuanyu; Thorsen, Mary

2017-11-01

The combination of 3D scanning stereoscopic particle image velocimetry (PIV) and 3D Planar Laser Induced Fluorescence (PLIF) is used to create high-speed three-dimensional reconstructions of the scalar and velocity fields of a developing hairpin vortex. The complete description of the regenerating hairpin vortex is needed as transitional boundary layers and turbulent spots are both comprised of and influenced by these vortices. A new high-speed, high power, laser-based imaging system is used which enables both high-speed 3D scanning stereo PIV and PLIF measurements. The experimental system uses a 250 Hz scanning mirror, two high-speed cameras with a 10 kHz frame rate, and a 40 kHz pulsed laser. Individual stereoscopic PIV images and scalar PLIF images are then reconstructed into time-resolved volumetric velocity and scalar data. The results from the volumetric velocity and scalar fields are compared to previous low-speed tomographic PIV data and scalar visualizations to determine the accuracy and fidelity of the high-speed diagnostics. Comparisons between the velocity and scalar field during hairpin development and regeneration are also discussed. Supported by the National Science Foundation under Grant CBET-1531475, Lafayette College,and the McCutcheon Foundation.

Creating computer aided 3D model of spleen and kidney based on Visible Human Project.

PubMed

Aldur, Muhammet M

2005-01-01

To investigate the efficacy of computer aided 3-dimensional (3D) reconstruction technique on visualization and modeling of gross anatomical structures with an affordable methodology applied on the spleen and kidney. From The Visible Human Project Dataset cryosection images, developed by the National Library of Medicine, the spleen and kidney sections were preferred to be used due to their highly distinct contours. The software used for the reconstruction were SurfDriver 3.5.3 for Mac and Cinema 4D XL version 7.1 for Mac OS X. This study was carried out in May 2004 at the Department of Anatomy, Hacettepe University, Ankara, Turkey. As a result of this study, it is determined that these 2 programs could be effectively used both for 3D modeling of the mentioned organs and volumetric analyses on these models. It is also seen that it is possible to hold the physical models of these gross anatomical digital ones with stereolithography technique by means of the data exchange file format provided by the program and present such images as anaglyph. SurfDriver 3.5.3 for Mac OS and Cinema 4 DXL version 7.1 for Mac OS X can be used effectively for reconstruction of gross anatomical structures from serial parallel sections with distinct contours such as spleen and kidney and the animation of models. These software constitute a highly effective way of getting volumetric calculations, spatial relations and morphometrical measurements of reconstructed structures.

Evaluation of three-dimensional computed tomography processing for deep inferior epigastric perforator flap breast reconstruction.

PubMed

Teoh, Raymond; Johnson, Raleigh F; Nishino, Thomas K; Ethridge, Richard T

2007-01-01

The deep inferior epigastric perforator flap procedure has become a popular alternative for women who require breast reconstruction. One of the difficulties with this procedure is identifying perforator arteries large enough to ensure that the harvested tissue is well vascularized. Current techniques involve imaging the perforator arteries with computed tomography (CT) to produce a grid mapping the locations of the perforator arteries relative to the umbilicus. To compare the time it takes to produce a map of the perforators using either two-dimensional (2D) or three-dimensional (3D) CT, and to see whether there is a benefit in using a 3D model. Patient CT abdomen and pelvis scans were acquired from a GE 64-slice scanner. CT image processing was performed with the GE 3D Advantage Workstation v4.2 software. Maps of the perforators were generated both as 2D and 3D representations. Perforators within a region 5 cm rostral and 7 cm caudal to the umbilicus were measured and the times to perform these measurements using both 2D and 3D images were recorded by a stopwatch. Although the 3D method took longer than the 2D method (mean [+/- SD] time 1:51+/-0:35 min versus 1:08+/-0:16 min per perforator artery, respectively), producing a 3D image provides much more information than the 2D images alone. Additionally, an actual-sized 3D image can be printed out, removing the need to make measurements and producing a grid. Although it took less time to create a grid of the perforators using 2D axial CT scans, the 3D reconstruction of the abdomen allows the plastic surgeons to better visualize the patient's anatomy and has definite clinical utility.

Post-processing methods of rendering and visualizing 3-D reconstructed tomographic images

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wong, S.T.C.

The purpose of this presentation is to discuss the computer processing techniques of tomographic images, after they have been generated by imaging scanners, for volume visualization. Volume visualization is concerned with the representation, manipulation, and rendering of volumetric data. Since the first digital images were produced from computed tomography (CT) scanners in the mid 1970s, applications of visualization in medicine have expanded dramatically. Today, three-dimensional (3D) medical visualization has expanded from using CT data, the first inherently digital source of 3D medical data, to using data from various medical imaging modalities, including magnetic resonance scanners, positron emission scanners, digital ultrasound,more » electronic and confocal microscopy, and other medical imaging modalities. We have advanced from rendering anatomy to aid diagnosis and visualize complex anatomic structures to planning and assisting surgery and radiation treatment. New, more accurate and cost-effective procedures for clinical services and biomedical research have become possible by integrating computer graphics technology with medical images. This trend is particularly noticeable in current market-driven health care environment. For example, interventional imaging, image-guided surgery, and stereotactic and visualization techniques are now stemming into surgical practice. In this presentation, we discuss only computer-display-based approaches of volumetric medical visualization. That is, we assume that the display device available is two-dimensional (2D) in nature and all analysis of multidimensional image data is to be carried out via the 2D screen of the device. There are technologies such as holography and virtual reality that do provide a {open_quotes}true 3D screen{close_quotes}. To confine the scope, this presentation will not discuss such approaches.« less

An interactive, stereoscopic virtual environment for medical imaging visualization, simulation and training

NASA Astrophysics Data System (ADS)

Krueger, Evan; Messier, Erik; Linte, Cristian A.; Diaz, Gabriel

2017-03-01

Recent advances in medical image acquisition allow for the reconstruction of anatomies with 3D, 4D, and 5D renderings. Nevertheless, standard anatomical and medical data visualization still relies heavily on the use of traditional 2D didactic tools (i.e., textbooks and slides), which restrict the presentation of image data to a 2D slice format. While these approaches have their merits beyond being cost effective and easy to disseminate, anatomy is inherently three-dimensional. By using 2D visualizations to illustrate more complex morphologies, important interactions between structures can be missed. In practice, such as in the planning and execution of surgical interventions, professionals require intricate knowledge of anatomical complexities, which can be more clearly communicated and understood through intuitive interaction with 3D volumetric datasets, such as those extracted from high-resolution CT or MRI scans. Open source, high quality, 3D medical imaging datasets are freely available, and with the emerging popularity of 3D display technologies, affordable and consistent 3D anatomical visualizations can be created. In this study we describe the design, implementation, and evaluation of one such interactive, stereoscopic visualization paradigm for human anatomy extracted from 3D medical images. A stereoscopic display was created by projecting the scene onto the lab floor using sequential frame stereo projection and viewed through active shutter glasses. By incorporating a PhaseSpace motion tracking system, a single viewer can navigate an augmented reality environment and directly manipulate virtual objects in 3D. While this paradigm is sufficiently versatile to enable a wide variety of applications in need of 3D visualization, we designed our study to work as an interactive game, which allows users to explore the anatomy of various organs and systems. In this study we describe the design, implementation, and evaluation of an interactive and stereoscopic visualization platform for exploring and understanding human anatomy. This system can present medical imaging data in three dimensions and allows for direct physical interaction and manipulation by the viewer. This should provide numerous benefits over traditional, 2D display and interaction modalities, and in our analysis, we aim to quantify and qualify users' visual and motor interactions with the virtual environment when employing this interactive display as a 3D didactic tool.

Optical sectioning and 3D reconstructions as an alternative to scanning electron microscopy for analysis of cell shape.

PubMed

Landis, Jacob B; Ventura, Kayla L; Soltis, Douglas E; Soltis, Pamela S; Oppenheimer, David G

2015-04-01

Visualizing flower epidermal cells is often desirable for investigating the interaction between flowers and their pollinators, in addition to the broader range of ecological interactions in which flowers are involved. We developed a protocol for visualizing petal epidermal cells without the limitations of the commonly used method of scanning electron microscopy (SEM). Flower material was collected and fixed in glutaraldehyde, followed by dehydration in an ethanol series. Flowers were dissected to collect petals, and subjected to a Histo-Clear series to remove the cuticle. Material was then stained with aniline blue, mounted on microscope slides, and imaged using a compound fluorescence microscope to obtain optical sections that were reconstructed into a 3D image. This optical sectioning method yielded high-quality images of the petal epidermal cells with virtually no damage to cells. Flowers were processed in larger batches than are possible using common SEM methods. Also, flower size was not a limiting factor as often observed in SEM studies. Flowers up to 5 cm in length were processed and mounted for visualization. This method requires no special equipment for sample preparation prior to imaging and should be seen as an alternative method to SEM.

SU-E-J-167: Improvement of Time-Ordered Four Dimensional Cone-Beam CT; Image Mosaicing with Real and Virtual Projections

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nakano, M; Kida, S; Masutani, Y

2014-06-01

Purpose: In the previous study, we developed time-ordered fourdimensional (4D) cone-beam CT (CBCT) technique to visualize nonperiodic organ motion, such as peristaltic motion of gastrointestinal organs and adjacent area, using half-scan reconstruction method. One important obstacle was that truncation of projection was caused by asymmetric location of flat-panel detector (FPD) in order to cover whole abdomen or pelvis in one rotation. In this study, we propose image mosaicing to extend projection data to make possible to reconstruct full field-of-view (FOV) image using half-scan reconstruction. Methods: The projections of prostate cancer patients were acquired using the X-ray Volume Imaging system (XVI,more » version 4.5) on Synergy linear accelerator system (Elekta, UK). The XVI system has three options of FOV, S, M and L, and M FOV was chosen for pelvic CBCT acquisition, with a FPD panel 11.5 cm offset. The method to produce extended projections consists of three main steps: First, normal three-dimensional (3D) reconstruction which contains whole pelvis was implemented using real projections. Second, virtual projections were produced by reprojection process of the reconstructed 3D image. Third, real and virtual projections in each angle were combined into one extended mosaic projection. Then, 4D CBCT images were reconstructed using our inhouse reconstruction software based on Feldkamp, Davis and Kress algorithm. The angular range of each reconstruction phase in the 4D reconstruction was 180 degrees, and the range moved as time progressed. Results: Projection data were successfully extended without discontinuous boundary between real and virtual projections. Using mosaic projections, 4D CBCT image sets were reconstructed without artifacts caused by the truncation, and thus, whole pelvis was clearly visible. Conclusion: The present method provides extended projections which contain whole pelvis. The presented reconstruction method also enables time-ordered 4D CBCT reconstruction of organs with non-periodic motion with full FOV without projection-truncation artifacts. This work was partly supported by the JSPS Core-to-Core Program(No. 23003). This work was partly supported by JSPS KAKENHI 24234567.« less

Three-dimensional noninvasive monitoring iodine-131 uptake in the thyroid using a modified Cerenkov luminescence tomography approach.

PubMed

Hu, Zhenhua; Ma, Xiaowei; Qu, Xiaochao; Yang, Weidong; Liang, Jimin; Wang, Jing; Tian, Jie

2012-01-01

Cerenkov luminescence tomography (CLT) provides the three-dimensional (3D) radiopharmaceutical biodistribution in small living animals, which is vital to biomedical imaging. However, existing single-spectral and multispectral methods are not very efficient and effective at reconstructing the distribution of the radionuclide tracer. In this paper, we present a semi-quantitative Cerenkov radiation spectral characteristic-based source reconstruction method named the hybrid spectral CLT, to efficiently reconstruct the radionuclide tracer with both encouraging reconstruction results and less acquisition and image reconstruction time. We constructed the implantation mouse model implanted with a 400 µCi Na(131)I radioactive source and the physiological mouse model received an intravenous tail injection of 400 µCi radiopharmaceutical Iodine-131 (I-131) to validate the performance of the hybrid spectral CLT and compared the reconstruction results, acquisition, and image reconstruction time with that of single-spectral and multispectral CLT. Furthermore, we performed 3D noninvasive monitoring of I-131 uptake in the thyroid and quantified I-131 uptake in vivo using hybrid spectral CLT. Results showed that the reconstruction based on the hybrid spectral CLT was more accurate in localization and quantification than using single-spectral CLT, and was more efficient in the in vivo experiment compared with multispectral CLT. Additionally, 3D visualization of longitudinal observations suggested that the reconstructed energy of I-131 uptake in the thyroid increased with acquisition time and there was a robust correlation between the reconstructed energy versus the gamma ray counts of I-131 (r(2) = 0.8240). The ex vivo biodistribution experiment further confirmed the I-131 uptake in the thyroid for hybrid spectral CLT. Results indicated that hybrid spectral CLT could be potentially used for thyroid imaging to evaluate its function and monitor its treatment for thyroid cancer.

[Development of a software for 3D virtual phantom design].

PubMed

Zou, Lian; Xie, Zhao; Wu, Qi

2014-02-01

In this paper, we present a 3D virtual phantom design software, which was developed based on object-oriented programming methodology and dedicated to medical physics research. This software was named Magical Phan tom (MPhantom), which is composed of 3D visual builder module and virtual CT scanner. The users can conveniently construct any complex 3D phantom, and then export the phantom as DICOM 3.0 CT images. MPhantom is a user-friendly and powerful software for 3D phantom configuration, and has passed the real scene's application test. MPhantom will accelerate the Monte Carlo simulation for dose calculation in radiation therapy and X ray imaging reconstruction algorithm research.

The SF3M approach to 3-D photo-reconstruction for non-expert users: application to a gully network

NASA Astrophysics Data System (ADS)

Castillo, C.; James, M. R.; Redel-Macías, M. D.; Pérez, R.; Gómez, J. A.

2015-04-01

3-D photo-reconstruction (PR) techniques have been successfully used to produce high resolution elevation models for different applications and over different spatial scales. However, innovative approaches are required to overcome some limitations that this technique may present in challenging scenarios. Here, we evaluate SF3M, a new graphical user interface for implementing a complete PR workflow based on freely available software (including external calls to VisualSFM and CloudCompare), in combination with a low-cost survey design for the reconstruction of a several-hundred-meters-long gully network. SF3M provided a semi-automated workflow for 3-D reconstruction requiring ~ 49 h (of which only 17% required operator assistance) for obtaining a final gully network model of > 17 million points over a gully plan area of 4230 m2. We show that a walking itinerary along the gully perimeter using two light-weight automatic cameras (1 s time-lapse mode) and a 6 m-long pole is an efficient method for 3-D monitoring of gullies, at a low cost (about EUR 1000 budget for the field equipment) and time requirements (~ 90 min for image collection). A mean error of 6.9 cm at the ground control points was found, mainly due to model deformations derived from the linear geometry of the gully and residual errors in camera calibration. The straightforward image collection and processing approach can be of great benefit for non-expert users working on gully erosion assessment.

Three-dimensional reconstruction of the peripancreatic vascular system based on computed tomographic angiography images and its clinical application in the surgical management of pancreatic tumors.

PubMed

Fang, Chi-hua; Kong, Deshuai; Wang, Xiaojun; Wang, Huaizhi; Xiang, Nan; Fan, Yingfang; Yang, Jian; Zhong, Shi Zheng

2014-04-01

This study aimed to investigate the clinical significance of 3-dimensional (3D) reconstruction of peripancreatic vessels for patients with suspected pancreatic cancer (PC). A total of 89 patients with PC were included; 60 patients randomly underwent computed tomographic angiography. Based on the findings of 3D reconstruction of peripancreatic vessels, the appropriate method for individualized tumor resection was determined. These patients were compared with 29 conventionally treated patients with PC. The rate of visualization was 100% for great vessels around the pancreas. The detection rates for anterior superior pancreaticoduodenal artery, posterior superior pancreaticoduodenal artery, anterior inferior pancreaticoduodenal artery, posterior inferior pancreaticoduodenal artery, dorsal pancreatic artery, superior marginal arterial branch of the pancreatic head, anterior superior pancreaticoduodenal vein, posterior superior pancreaticoduodenal vein, anterior inferior pancreaticoduodenal vein, and posterior inferior pancreaticoduodenal vein were 86.6%, 85.0%, 76.6%, 71.6%, 91.6%, 53.3%, 61.6%, 55.0%, 43.3%, and 51.6%, respectively. Forty-three patients who had undergone 3D reconstruction underwent surgery. Of the 29 conventionally treated patients, 19 underwent surgery. The operative time, blood loss, length of hospital stay, and complication incidence of the 43 patients were superior to that of the 19 patients. A peripancreatic vascular reconstruction can reveal the vascular anatomy, variations of peripancreatic vascular, and tumor-induced vascular changes; the application of the simulation surgery platform could reduce surgical trauma and decrease operative time.

Development and evaluation of a new 3-D digitization and computer graphic system to study the anatomic tissue and restoration surfaces.

PubMed

Dastane, A; Vaidyanathan, T K; Vaidyanathan, J; Mehra, R; Hesby, R

1996-01-01

It is necessary to visualize and reconstruct tissue anatomic surfaces accurately for a variety of oral rehabilitation applications such as surface wear characterization and automated fabrication of dental restorations, accuracy of reproduction of impression and die materials, etc. In this investigation, a 3-D digitization and computer-graphic system was developed for surface characterization. The hardware consists of a profiler assembly for digitization in an MTS biomechanical test system with an artificial mouth, an IBM PS/2 computer model 70 for data processing and a Hewlett-Packard laser printer for hardcopy outputs. The software used includes a commercially available Surfer 3-D graphics package, a public domain data-fitting alignment software and an inhouse Pascal program for intercommunication plus some other limited tasks. Surfaces were digitized before and after rotation by angular displacement, the digital data were interpolated by Surfer to provide a data grid and the surfaces were computer graphically reconstructed: Misaligned surfaces were aligned by the data-fitting alignment software under different choices of parameters. The effect of different interpolation parameters (e.g. grid size, method of interpolation) and extent of rotation on the alignment accuracy was determined. The results indicate that improved alignment accuracy results from optimization of interpolation parameters and minimization of the initial misorientation between the digitized surfaces. The method provides important advantages for surface reconstruction and visualization, such as overlay of sequentially generated surfaces and accurate alignment of pairs of surfaces with small misalignment.

Hemodynamics model of fluid–solid interaction in internal carotid artery aneurysms

PubMed Central

Fu-Yu, Wang; Lei, Liu; Xiao-Jun, Zhang; Hai-Yue, Ju

2010-01-01

The objective of this study is to present a relatively simple method to reconstruct cerebral aneurysms as 3D numerical grids. The method accurately duplicates the geometry to provide computer simulations of the blood flow. Initial images were obtained by using CT angiography and 3D digital subtraction angiography in DICOM format. The image was processed by using MIMICS software, and the 3D fluid model (blood flow) and 3D solid model (wall) were generated. The subsequent output was exported to the ANSYS workbench software to generate the volumetric mesh for further hemodynamic study. The fluid model was defined and simulated in CFX software while the solid model was calculated in ANSYS software. The force data calculated firstly in the CFX software were transferred to the ANSYS software, and after receiving the force data, total mesh displacement data were calculated in the ANSYS software. Then, the mesh displacement data were transferred back to the CFX software. The data exchange was processed in workbench software. The results of simulation could be visualized in CFX-post. Two examples of grid reconstruction and blood flow simulation for patients with internal carotid artery aneurysms were presented. The wall shear stress, wall total pressure, and von Mises stress could be visualized. This method seems to be relatively simple and suitable for direct use by neurosurgeons or neuroradiologists, and maybe a practical tool for planning treatment and follow-up of patients after neurosurgical or endovascular interventions with 3D angiography. PMID:20812022

Hemodynamics model of fluid-solid interaction in internal carotid artery aneurysms.

PubMed

Bai-Nan, Xu; Fu-Yu, Wang; Lei, Liu; Xiao-Jun, Zhang; Hai-Yue, Ju

2011-01-01

The objective of this study is to present a relatively simple method to reconstruct cerebral aneurysms as 3D numerical grids. The method accurately duplicates the geometry to provide computer simulations of the blood flow. Initial images were obtained by using CT angiography and 3D digital subtraction angiography in DICOM format. The image was processed by using MIMICS software, and the 3D fluid model (blood flow) and 3D solid model (wall) were generated. The subsequent output was exported to the ANSYS workbench software to generate the volumetric mesh for further hemodynamic study. The fluid model was defined and simulated in CFX software while the solid model was calculated in ANSYS software. The force data calculated firstly in the CFX software were transferred to the ANSYS software, and after receiving the force data, total mesh displacement data were calculated in the ANSYS software. Then, the mesh displacement data were transferred back to the CFX software. The data exchange was processed in workbench software. The results of simulation could be visualized in CFX-post. Two examples of grid reconstruction and blood flow simulation for patients with internal carotid artery aneurysms were presented. The wall shear stress, wall total pressure, and von Mises stress could be visualized. This method seems to be relatively simple and suitable for direct use by neurosurgeons or neuroradiologists, and maybe a practical tool for planning treatment and follow-up of patients after neurosurgical or endovascular interventions with 3D angiography.

Microtomographic images of rat's lumbar vertebra microstructure using 30 keV synchrotron X-rays: an analysis in terms of 3D visualization

NASA Astrophysics Data System (ADS)

Rao, D. V.; Takeda, T.; Kawakami, T.; Uesugi, K.; Tsuchiya, Y.; Wu, J.; Lwin, T. T.; Itai, Y.; Zeniya, T.; Yuasa, T.; Akatsuka, T.

2004-05-01

Microtomographic images of rat's lumbar vertebra of different age groups varying from 8, 56 and 78 weeks were obtained at 30 keV using synchrotron X-rays with a spatial resolution of 12 μm. The images are analyzed in terms of 3D visualization and micro-architecture. Density histogram of rat's lumbar vertebra is compared with test phantoms. Rat's lumbar volume and phantom volume are studied at different concentrations of hydroxyapatite with slice number. With the use of 2D slices, 3D images are reconstructed, in order to know the evolution and a state of decline of bone microstructure with aging. Cross-sectional μ-CT images shows that the bone of young rat has a fine trabecular microstructure while that of the old rat has large meshed structure.

Augmented reality based real-time subcutaneous vein imaging system

PubMed Central

Ai, Danni; Yang, Jian; Fan, Jingfan; Zhao, Yitian; Song, Xianzheng; Shen, Jianbing; Shao, Ling; Wang, Yongtian

2016-01-01

A novel 3D reconstruction and fast imaging system for subcutaneous veins by augmented reality is presented. The study was performed to reduce the failure rate and time required in intravenous injection by providing augmented vein structures that back-project superimposed veins on the skin surface of the hand. Images of the subcutaneous vein are captured by two industrial cameras with extra reflective near-infrared lights. The veins are then segmented by a multiple-feature clustering method. Vein structures captured by the two cameras are matched and reconstructed based on the epipolar constraint and homographic property. The skin surface is reconstructed by active structured light with spatial encoding values and fusion displayed with the reconstructed vein. The vein and skin surface are both reconstructed in the 3D space. Results show that the structures can be precisely back-projected to the back of the hand for further augmented display and visualization. The overall system performance is evaluated in terms of vein segmentation, accuracy of vein matching, feature points distance error, duration times, accuracy of skin reconstruction, and augmented display. All experiments are validated with sets of real vein data. The imaging and augmented system produces good imaging and augmented reality results with high speed. PMID:27446690

Augmented reality based real-time subcutaneous vein imaging system.

PubMed

Ai, Danni; Yang, Jian; Fan, Jingfan; Zhao, Yitian; Song, Xianzheng; Shen, Jianbing; Shao, Ling; Wang, Yongtian

2016-07-01

A novel 3D reconstruction and fast imaging system for subcutaneous veins by augmented reality is presented. The study was performed to reduce the failure rate and time required in intravenous injection by providing augmented vein structures that back-project superimposed veins on the skin surface of the hand. Images of the subcutaneous vein are captured by two industrial cameras with extra reflective near-infrared lights. The veins are then segmented by a multiple-feature clustering method. Vein structures captured by the two cameras are matched and reconstructed based on the epipolar constraint and homographic property. The skin surface is reconstructed by active structured light with spatial encoding values and fusion displayed with the reconstructed vein. The vein and skin surface are both reconstructed in the 3D space. Results show that the structures can be precisely back-projected to the back of the hand for further augmented display and visualization. The overall system performance is evaluated in terms of vein segmentation, accuracy of vein matching, feature points distance error, duration times, accuracy of skin reconstruction, and augmented display. All experiments are validated with sets of real vein data. The imaging and augmented system produces good imaging and augmented reality results with high speed.

A medical application integrating remote 3D visualization tools to access picture archiving and communication system on mobile devices.

PubMed

He, Longjun; Ming, Xing; Liu, Qian

2014-04-01

With computing capability and display size growing, the mobile device has been used as a tool to help clinicians view patient information and medical images anywhere and anytime. However, for direct interactive 3D visualization, which plays an important role in radiological diagnosis, the mobile device cannot provide a satisfactory quality of experience for radiologists. This paper developed a medical system that can get medical images from the picture archiving and communication system on the mobile device over the wireless network. In the proposed application, the mobile device got patient information and medical images through a proxy server connecting to the PACS server. Meanwhile, the proxy server integrated a range of 3D visualization techniques, including maximum intensity projection, multi-planar reconstruction and direct volume rendering, to providing shape, brightness, depth and location information generated from the original sectional images for radiologists. Furthermore, an algorithm that changes remote render parameters automatically to adapt to the network status was employed to improve the quality of experience. Finally, performance issues regarding the remote 3D visualization of the medical images over the wireless network of the proposed application were also discussed. The results demonstrated that this proposed medical application could provide a smooth interactive experience in the WLAN and 3G networks.

a Multi-Data Source and Multi-Sensor Approach for the 3d Reconstruction and Visualization of a Complex Archaelogical Site: the Case Study of Tolmo de Minateda

NASA Astrophysics Data System (ADS)

Torres-Martínez, J. A.; Seddaiu, M.; Rodríguez-Gonzálvez, P.; Hernández-López, D.; González-Aguilera, D.

2015-02-01

The complexity of archaeological sites hinders to get an integral modelling using the actual Geomatic techniques (i.e. aerial, closerange photogrammetry and terrestrial laser scanner) individually, so a multi-sensor approach is proposed as the best solution to provide a 3D reconstruction and visualization of these complex sites. Sensor registration represents a riveting milestone when automation is required and when aerial and terrestrial dataset must be integrated. To this end, several problems must be solved: coordinate system definition, geo-referencing, co-registration of point clouds, geometric and radiometric homogeneity, etc. Last but not least, safeguarding of tangible archaeological heritage and its associated intangible expressions entails a multi-source data approach in which heterogeneous material (historical documents, drawings, archaeological techniques, habit of living, etc.) should be collected and combined with the resulting hybrid 3D of "Tolmo de Minateda" located models. The proposed multi-data source and multi-sensor approach is applied to the study case of "Tolmo de Minateda" archaeological site. A total extension of 9 ha is reconstructed, with an adapted level of detail, by an ultralight aerial platform (paratrike), an unmanned aerial vehicle, a terrestrial laser scanner and terrestrial photogrammetry. In addition, the own defensive nature of the site (i.e. with the presence of three different defensive walls) together with the considerable stratification of the archaeological site (i.e. with different archaeological surfaces and constructive typologies) require that tangible and intangible archaeological heritage expressions can be integrated with the hybrid 3D models obtained, to analyse, understand and exploit the archaeological site by different experts and heritage stakeholders.

Stages as models of scene geometry.

PubMed

Nedović, Vladimir; Smeulders, Arnold W M; Redert, André; Geusebroek, Jan-Mark

2010-09-01

Reconstruction of 3D scene geometry is an important element for scene understanding, autonomous vehicle and robot navigation, image retrieval, and 3D television. We propose accounting for the inherent structure of the visual world when trying to solve the scene reconstruction problem. Consequently, we identify geometric scene categorization as the first step toward robust and efficient depth estimation from single images. We introduce 15 typical 3D scene geometries called stages, each with a unique depth profile, which roughly correspond to a large majority of broadcast video frames. Stage information serves as a first approximation of global depth, narrowing down the search space in depth estimation and object localization. We propose different sets of low-level features for depth estimation, and perform stage classification on two diverse data sets of television broadcasts. Classification results demonstrate that stages can often be efficiently learned from low-dimensional image representations.

Volume estimation of tonsil phantoms using an oral camera with 3D imaging

PubMed Central

Das, Anshuman J.; Valdez, Tulio A.; Vargas, Jose Arbouin; Saksupapchon, Punyapat; Rachapudi, Pushyami; Ge, Zhifei; Estrada, Julio C.; Raskar, Ramesh

2016-01-01

Three-dimensional (3D) visualization of oral cavity and oropharyngeal anatomy may play an important role in the evaluation for obstructive sleep apnea (OSA). Although computed tomography (CT) and magnetic resonance (MRI) imaging are capable of providing 3D anatomical descriptions, this type of technology is not readily available in a clinic setting. Current imaging of the oropharynx is performed using a light source and tongue depressors. For better assessment of the inferior pole of the tonsils and tongue base flexible laryngoscopes are required which only provide a two dimensional (2D) rendering. As a result, clinical diagnosis is generally subjective in tonsillar hypertrophy where current physical examination has limitations. In this report, we designed a hand held portable oral camera with 3D imaging capability to reconstruct the anatomy of the oropharynx in tonsillar hypertrophy where the tonsils get enlarged and can lead to increased airway resistance. We were able to precisely reconstruct the 3D shape of the tonsils and from that estimate airway obstruction percentage and volume of the tonsils in 3D printed realistic models. Our results correlate well with Brodsky’s classification of tonsillar hypertrophy as well as intraoperative volume estimations. PMID:27446667

Computer vision for RGB-D sensors: Kinect and its applications.

PubMed

Shao, Ling; Han, Jungong; Xu, Dong; Shotton, Jamie

2013-10-01

Kinect sensor, high-resolution depth and visual (RGB) sensing has become available for widespread use as an off-the-shelf technology. This special issue is specifically dedicated to new algorithms and/or new applications based on the Kinect (or similar RGB-D) sensors. In total, we received over ninety submissions from more than twenty countries all around the world. The submissions cover a wide range of areas including object and scene classification, 3-D pose estimation, visual tracking, data fusion, human action/activity recognition, 3-D reconstruction, mobile robotics, and so on. After two rounds of review by at least two (mostly three) expert reviewers for each paper, the Guest Editors have selected twelve high-quality papers to be included in this highly popular special issue. The papers that comprise this issue are briefly summarized.

Chromosome3D: reconstructing three-dimensional chromosomal structures from Hi-C interaction frequency data using distance geometry simulated annealing.

PubMed

Adhikari, Badri; Trieu, Tuan; Cheng, Jianlin

2016-11-07

Reconstructing three-dimensional structures of chromosomes is useful for visualizing their shapes in a cell and interpreting their function. In this work, we reconstruct chromosomal structures from Hi-C data by translating contact counts in Hi-C data into Euclidean distances between chromosomal regions and then satisfying these distances using a structure reconstruction method rigorously tested in the field of protein structure determination. We first evaluate the robustness of the overall reconstruction algorithm on noisy simulated data at various levels of noise by comparing with some of the state-of-the-art reconstruction methods. Then, using simulated data, we validate that Spearman's rank correlation coefficient between pairwise distances in the reconstructed chromosomal structures and the experimental chromosomal contact counts can be used to find optimum conversion rules for transforming interaction frequencies to wish distances. This strategy is then applied to real Hi-C data at chromosome level for optimal transformation of interaction frequencies to wish distances and for ranking and selecting structures. The chromosomal structures reconstructed from a real-world human Hi-C dataset by our method were validated by the known two-compartment feature of the human chromosome organization. We also show that our method is robust with respect to the change of the granularity of Hi-C data, and consistently produces similar structures at different chromosomal resolutions. Chromosome3D is a robust method of reconstructing chromosome three-dimensional models using distance restraints obtained from Hi-C interaction frequency data. It is available as a web application and as an open source tool at http://sysbio.rnet.missouri.edu/chromosome3d/ .

Photogrammetric 3D reconstruction using mobile imaging

NASA Astrophysics Data System (ADS)

Fritsch, Dieter; Syll, Miguel

2015-03-01

In our paper we demonstrate the development of an Android Application (AndroidSfM) for photogrammetric 3D reconstruction that works on smartphones and tablets likewise. The photos are taken with mobile devices, and can thereafter directly be calibrated using standard calibration algorithms of photogrammetry and computer vision, on that device. Due to still limited computing resources on mobile devices, a client-server handshake using Dropbox transfers the photos to the sever to run AndroidSfM for the pose estimation of all photos by Structure-from-Motion and, thereafter, uses the oriented bunch of photos for dense point cloud estimation by dense image matching algorithms. The result is transferred back to the mobile device for visualization and ad-hoc on-screen measurements.

Breast percent density estimation from 3D reconstructed digital breast tomosynthesis images

NASA Astrophysics Data System (ADS)

Bakic, Predrag R.; Kontos, Despina; Carton, Ann-Katherine; Maidment, Andrew D. A.

2008-03-01

Breast density is an independent factor of breast cancer risk. In mammograms breast density is quantitatively measured as percent density (PD), the percentage of dense (non-fatty) tissue. To date, clinical estimates of PD have varied significantly, in part due to the projective nature of mammography. Digital breast tomosynthesis (DBT) is a 3D imaging modality in which cross-sectional images are reconstructed from a small number of projections acquired at different x-ray tube angles. Preliminary studies suggest that DBT is superior to mammography in tissue visualization, since superimposed anatomical structures present in mammograms are filtered out. We hypothesize that DBT could also provide a more accurate breast density estimation. In this paper, we propose to estimate PD from reconstructed DBT images using a semi-automated thresholding technique. Preprocessing is performed to exclude the image background and the area of the pectoral muscle. Threshold values are selected manually from a small number of reconstructed slices; a combination of these thresholds is applied to each slice throughout the entire reconstructed DBT volume. The proposed method was validated using images of women with recently detected abnormalities or with biopsy-proven cancers; only contralateral breasts were analyzed. The Pearson correlation and kappa coefficients between the breast density estimates from DBT and the corresponding digital mammogram indicate moderate agreement between the two modalities, comparable with our previous results from 2D DBT projections. Percent density appears to be a robust measure for breast density assessment in both 2D and 3D x-ray breast imaging modalities using thresholding.

Scalable and Interactive Segmentation and Visualization of Neural Processes in EM Datasets

PubMed Central

Jeong, Won-Ki; Beyer, Johanna; Hadwiger, Markus; Vazquez, Amelio; Pfister, Hanspeter; Whitaker, Ross T.

2011-01-01

Recent advances in scanning technology provide high resolution EM (Electron Microscopy) datasets that allow neuroscientists to reconstruct complex neural connections in a nervous system. However, due to the enormous size and complexity of the resulting data, segmentation and visualization of neural processes in EM data is usually a difficult and very time-consuming task. In this paper, we present NeuroTrace, a novel EM volume segmentation and visualization system that consists of two parts: a semi-automatic multiphase level set segmentation with 3D tracking for reconstruction of neural processes, and a specialized volume rendering approach for visualization of EM volumes. It employs view-dependent on-demand filtering and evaluation of a local histogram edge metric, as well as on-the-fly interpolation and ray-casting of implicit surfaces for segmented neural structures. Both methods are implemented on the GPU for interactive performance. NeuroTrace is designed to be scalable to large datasets and data-parallel hardware architectures. A comparison of NeuroTrace with a commonly used manual EM segmentation tool shows that our interactive workflow is faster and easier to use for the reconstruction of complex neural processes. PMID:19834227

[Visualization of Anterolateral Ligament of the Knee Using 3D Reconstructed Variable Refocus Flip Angle-Turbo Spin Echo T2 Weighted Image].

PubMed

Yokosawa, Kenta; Sasaki, Kana; Muramatsu, Koichi; Ono, Tomoya; Izawa, Hiroyuki; Hachiya, Yudo

2016-05-01

Anterolateral ligament (ALL) is one of the lateral structures in the knee that contributes to the internal rotational stability of tibia. ALL has been referred to in some recent reports to re-emphasize its importance. We visualized the ALL on 3D-MRI in 32 knees of 27 healthy volunteers (23 male knees, 4 female knees; mean age: 37 years). 3D-MRIs were performed using 1.5-T scanner [T(2) weighted image (WI), SPACE: Sampling Perfection with Application optimized Contrast using different flip angle Evolutions] in the knee extended positions. The visualization rate of the ALL, the mean angle to the lateral collateral ligament (LCL), and the width and the thickness of the ALL at the joint level were investigated. The visualization rate was 100%. The mean angle to the LCL was 10.6 degrees. The mean width and the mean thickness of the ALL were 6.4 mm and 1.0 mm, respectively. The ALL is a very thin ligament with a somewhat oblique course between the lateral femoral epicondyle and the mid-third area of lateral tibial condyle. Therefore, the slice thickness and the slice angle can easily affect the ALL visualization. 3D-MRI enables acquiring thin-slice imaging data over a relatively short time, and arbitrary sections aligned with the course of the ALL can later be selected.

3D Visualization of Sheath Folds in Roman Marble from Ephesus, Turkey

NASA Astrophysics Data System (ADS)

Wex, Sebastian; Passchier, Cornelis W.; de Kemp, Eric A.; Ilhan, Sinan

2013-04-01

Excavation of a palatial 2nd century AD house (Terrace House Two) in the ancient city of Ephesus, Turkey in the 1970s produced 10.313 pieces of colored, folded marble which belonged to 54 marble plates of 1.6 cm thickness that originally covered the walls of the banquet hall of the house. The marble plates were completely reassembled and restored by a team of workers over the last 6 years. The plates were recognized as having been sawn from two separate large blocks of "Cipollino verde", a green mylonitized marble from Karystos on the Island of Euboea, Greece. After restoration, it became clear that all slabs had been placed on the wall in approximately the sequence in which they had been cut off by a Roman stone saw. As a result, the marble plates give a full 3D insight in the folded internal structure of 1m3 block of mylonite. The restoration of the slabs was recognized as a first, unique opportunity for detailed reconstruction of the 3D geometry of m-scale folds in mylonitized marble. Photographs were taken of each slab and used to reconstruct their exact arrangement within the originally quarried blocks. Outlines of layers were digitized and a full 3D reconstruction of the internal structure of the block was created using ArcMap and GOCAD. Fold structures in the block include curtain folds and multilayered sheath folds. Several different layers showing these structures were digitized on the photographs of the slab surfaces and virtually mounted back together within the model of the marble block. Due to the serial sectioning into slabs, with cm-scale spacing, the visualization of the 3D geometry of sheath folds was accomplished with a resolution better than 4 cm. Final assembled 3D images reveal how sheath folds emerge from continuous layers and show their overall consistency as well as a constant hinge line orientation of the fold structures. Observations suggest that a single deformation phase was responsible for the evolution of "Cipollino verde" structures. Furthermore the XY plane of all analyzed sheath folds was orientated perpendicular to the layering of the marble, indicating a compressional component during shear deformation. This study sheds light on the general evolution and possible interpretation of sheath folds, currently still subject of debate, and on the structural evolution of "Cipollino verde", which is still used in modern architectural design. Furthermore, the detailed analysis of the slabs helps in the interpretation and reconstruction of Roman stone saws. For future applications this work could serve as an excellent 3D test set for geologic reconstruction methodologies and interpolation algorithms. The results presented could only be obtained by close cooperation of workers in geology and archaeology.

A technique system for the measurement, reconstruction and character extraction of rice plant architecture

PubMed Central

Li, Xumeng; Wang, Xiaohui; Wei, Hailin; Zhu, Xinguang; Peng, Yulin; Li, Ming; Li, Tao; Huang, Huang

2017-01-01

This study developed a technique system for the measurement, reconstruction, and trait extraction of rice canopy architectures, which have challenged functional–structural plant modeling for decades and have become the foundation of the design of ideo-plant architectures. The system uses the location-separation-measurement method (LSMM) for the collection of data on the canopy architecture and the analytic geometry method for the reconstruction and visualization of the three-dimensional (3D) digital architecture of the rice plant. It also uses the virtual clipping method for extracting the key traits of the canopy architecture such as the leaf area, inclination, and azimuth distribution in spatial coordinates. To establish the technique system, we developed (i) simple tools to measure the spatial position of the stem axis and azimuth of the leaf midrib and to capture images of tillers and leaves; (ii) computer software programs for extracting data on stem diameter, leaf nodes, and leaf midrib curves from the tiller images and data on leaf length, width, and shape from the leaf images; (iii) a database of digital architectures that stores the measured data and facilitates the reconstruction of the 3D visual architecture and the extraction of architectural traits; and (iv) computation algorithms for virtual clipping to stratify the rice canopy, to extend the stratified surface from the horizontal plane to a general curved surface (including a cylindrical surface), and to implement in silico. Each component of the technique system was quantitatively validated and visually compared to images, and the sensitivity of the virtual clipping algorithms was analyzed. This technique is inexpensive and accurate and provides high throughput for the measurement, reconstruction, and trait extraction of rice canopy architectures. The technique provides a more practical method of data collection to serve functional–structural plant models of rice and for the optimization of rice canopy types. Moreover, the technique can be easily adapted for other cereal crops such as wheat, which has numerous stems and leaves sheltering each other. PMID:28558045

360-degree 3D transvaginal ultrasound system for high-dose-rate interstitial gynaecological brachytherapy needle guidance

NASA Astrophysics Data System (ADS)

Rodgers, Jessica R.; Surry, Kathleen; D'Souza, David; Leung, Eric; Fenster, Aaron

2017-03-01

Treatment for gynaecological cancers often includes brachytherapy; in particular, in high-dose-rate (HDR) interstitial brachytherapy, hollow needles are inserted into the tumour and surrounding area through a template in order to deliver the radiation dose. Currently, there is no standard modality for visualizing needles intra-operatively, despite the need for precise needle placement in order to deliver the optimal dose and avoid nearby organs, including the bladder and rectum. While three-dimensional (3D) transrectal ultrasound (TRUS) imaging has been proposed for 3D intra-operative needle guidance, anterior needles tend to be obscured by shadowing created by the template's vaginal cylinder. We have developed a 360-degree 3D transvaginal ultrasound (TVUS) system that uses a conventional two-dimensional side-fire TRUS probe rotated inside a hollow vaginal cylinder made from a sonolucent plastic (TPX). The system was validated using grid and sphere phantoms in order to test the geometric accuracy of the distance and volumetric measurements in the reconstructed image. To test the potential for visualizing needles, an agar phantom mimicking the geometry of the female pelvis was used. Needles were inserted into the phantom and then imaged using the 3D TVUS system. The needle trajectories and tip positions in the 3D TVUS scan were compared to their expected values and the needle tracks visualized in magnetic resonance images. Based on this initial study, 360-degree 3D TVUS imaging through a sonolucent vaginal cylinder is a feasible technique for intra-operatively visualizing needles during HDR interstitial gynaecological brachytherapy.

NOTE: The feasibility of an infrared system for real-time visualization and mapping of ultrasound fields

NASA Astrophysics Data System (ADS)

Shaw, Adam; Nunn, John

2010-06-01

In treatment planning for ultrasound therapy, it is desirable to know the 3D structure of the ultrasound field. However, mapping an ultrasound field in 3D is very slow, with even a single planar raster scan taking typically several hours. Additionally, hydrophones that are used for field mapping are expensive and can be damaged in some therapy fields. So there is value in rapid methods which enable visualization and mapping of the ultrasound field in about 1 min. In this note we explore the feasibility of mapping the intensity distribution by measuring the temperature distribution produced in a thin sheet of absorbing material. A 0.2 mm thick acetate sheet forms a window in the wall of a water tank containing the transducer. The window is oriented at 45° to the beam axis, and the distance from the transducer to the window can be varied. The temperature distribution is measured with an infrared camera; thermal images of the inclined plane could be viewed in real time or images could be captured for later analysis and 3D field reconstruction. We conclude that infrared thermography can be used to gain qualitative information about ultrasound fields. Thermal images are easily visualized with good spatial and thermal resolutions (0.044 mm and 0.05 °C in our system). The focus and field structure such as side lobes can be identified in real time from the direct video output. 3D maps and image planes at arbitrary orientations to the beam axis can be obtained and reconstructed within a few minutes. In this note we are primarily interested in the technique for characterization of high intensity focused ultrasound (HIFU) fields, but other applications such as physiotherapy fields are also possible.

The feasibility of an infrared system for real-time visualization and mapping of ultrasound fields.

PubMed

Shaw, Adam; Nunn, John

2010-06-07

In treatment planning for ultrasound therapy, it is desirable to know the 3D structure of the ultrasound field. However, mapping an ultrasound field in 3D is very slow, with even a single planar raster scan taking typically several hours. Additionally, hydrophones that are used for field mapping are expensive and can be damaged in some therapy fields. So there is value in rapid methods which enable visualization and mapping of the ultrasound field in about 1 min. In this note we explore the feasibility of mapping the intensity distribution by measuring the temperature distribution produced in a thin sheet of absorbing material. A 0.2 mm thick acetate sheet forms a window in the wall of a water tank containing the transducer. The window is oriented at 45 degrees to the beam axis, and the distance from the transducer to the window can be varied. The temperature distribution is measured with an infrared camera; thermal images of the inclined plane could be viewed in real time or images could be captured for later analysis and 3D field reconstruction. We conclude that infrared thermography can be used to gain qualitative information about ultrasound fields. Thermal images are easily visualized with good spatial and thermal resolutions (0.044 mm and 0.05 degrees C in our system). The focus and field structure such as side lobes can be identified in real time from the direct video output. 3D maps and image planes at arbitrary orientations to the beam axis can be obtained and reconstructed within a few minutes. In this note we are primarily interested in the technique for characterization of high intensity focused ultrasound (HIFU) fields, but other applications such as physiotherapy fields are also possible.

Enhanced truncated-correlation photothermal coherence tomography with application to deep subsurface defect imaging and 3-dimensional reconstructions

NASA Astrophysics Data System (ADS)

Tavakolian, Pantea; Sivagurunathan, Koneswaran; Mandelis, Andreas

2017-07-01

Photothermal diffusion-wave imaging is a promising technique for non-destructive evaluation and medical applications. Several diffusion-wave techniques have been developed to produce depth-resolved planar images of solids and to overcome imaging depth and image blurring limitations imposed by the physics of parabolic diffusion waves. Truncated-Correlation Photothermal Coherence Tomography (TC-PCT) is the most successful class of these methodologies to-date providing 3-D subsurface visualization with maximum depth penetration and high axial and lateral resolution. To extend the depth range and axial and lateral resolution, an in-depth analysis of TC-PCT, a novel imaging system with improved instrumentation, and an optimized reconstruction algorithm over the original TC-PCT technique is developed. Thermal waves produced by a laser chirped pulsed heat source in a finite thickness solid and the image reconstruction algorithm are investigated from the theoretical point of view. 3-D visualization of subsurface defects utilizing the new TC-PCT system is reported. The results demonstrate that this method is able to detect subsurface defects at the depth range of ˜4 mm in a steel sample, which exhibits dynamic range improvement by a factor of 2.6 compared to the original TC-PCT. This depth does not represent the upper limit of the enhanced TC-PCT. Lateral resolution in the steel sample was measured to be ˜31 μm.

False ankylosis of the temporomandibular joint in a cat. Correction by partial zygomatic arch resection.

PubMed

Larguier, L; Jamet, N

2015-01-01

To describe the use of two-dimensional computer-assisted tomography (CT) with three-dimensional (3D) reconstruction in the diagnosis and planning of surgical treatment of a case of false ankylosis of the temporomandibular joint. A young European Shorthaired cat was presented with the complaint of inability to eat and open its jaws. A CT scan with 3D reconstruction allowed visualization of the lesion which was causing extra-articular ankylosis of the temporomandibular joint. Surgery was performed to resect an osseous lesion of the zygomatic arch, thus freeing the temporomandibular joint. Postoperative physical therapy was initiated immediately following surgery, and then carried out by the owner with a one year follow-up. Clinical examination of the cat was performed during regular office visits (at 1 month and 3 months following surgery), which allowed objective assessment of postoperative recuperation. At the end of a year, the owners reported that the cat had maintained sufficient jaw opening without any signs consistent with chronic pain. Computed tomography scan with 3D reconstruction allowed planning of the surgical correction of extra-articular ankylosis of the temporomandibular joint, and in this case condylectomy was avoided, since temporomandibular joint range-of-motion was maintained.

3D Reconstruction of Space Objects from Multi-Views by a Visible Sensor

PubMed Central

Zhang, Haopeng; Wei, Quanmao; Jiang, Zhiguo

2017-01-01

In this paper, a novel 3D reconstruction framework is proposed to recover the 3D structural model of a space object from its multi-view images captured by a visible sensor. Given an image sequence, this framework first estimates the relative camera poses and recovers the depths of the surface points by the structure from motion (SFM) method, then the patch-based multi-view stereo (PMVS) algorithm is utilized to generate a dense 3D point cloud. To resolve the wrong matches arising from the symmetric structure and repeated textures of space objects, a new strategy is introduced, in which images are added to SFM in imaging order. Meanwhile, a refining process exploiting the structural prior knowledge that most sub-components of artificial space objects are composed of basic geometric shapes is proposed and applied to the recovered point cloud. The proposed reconstruction framework is tested on both simulated image datasets and real image datasets. Experimental results illustrate that the recovered point cloud models of space objects are accurate and have a complete coverage of the surface. Moreover, outliers and points with severe noise are effectively filtered out by the refinement, resulting in an distinct improvement of the structure and visualization of the recovered points. PMID:28737675

Three-dimensional analysis of the early development of the dentition

PubMed Central

Peterkova, R; Hovorakova, M; Peterka, M; Lesot, H

2014-01-01

Tooth development has attracted the attention of researchers since the 19th century. It became obvious even then that morphogenesis could not fully be appreciated from two-dimensional histological sections. Therefore, methods of three-dimensional (3D) reconstructions were employed to visualize the surface morphology of developing structures and to help appreciate the complexity of early tooth morphogenesis. The present review surveys the data provided by computer-aided 3D analyses to update classical knowledge of early odontogenesis in the laboratory mouse and in humans. 3D reconstructions have demonstrated that odontogenesis in the early stages is a complex process which also includes the development of rudimentary odontogenic structures with different fates. Their developmental, evolutionary, and pathological aspects are discussed. The combination of in situ hybridization and 3D reconstruction have demonstrated the temporo-spatial dynamics of the signalling centres that reflect transient existence of rudimentary tooth primordia at loci where teeth were present in ancestors. The rudiments can rescue their suppressed development and revitalize, and then their subsequent autonomous development can give rise to oral pathologies. This shows that tooth-forming potential in mammals can be greater than that observed from their functional dentitions. From this perspective, the mouse rudimentary tooth primordia represent a natural model to test possibilities of tooth regeneration. PMID:24495023

Espina: A Tool for the Automated Segmentation and Counting of Synapses in Large Stacks of Electron Microscopy Images

PubMed Central

Morales, Juan; Alonso-Nanclares, Lidia; Rodríguez, José-Rodrigo; DeFelipe, Javier; Rodríguez, Ángel; Merchán-Pérez, Ángel

2011-01-01

The synapses in the cerebral cortex can be classified into two main types, Gray's type I and type II, which correspond to asymmetric (mostly glutamatergic excitatory) and symmetric (inhibitory GABAergic) synapses, respectively. Hence, the quantification and identification of their different types and the proportions in which they are found, is extraordinarily important in terms of brain function. The ideal approach to calculate the number of synapses per unit volume is to analyze 3D samples reconstructed from serial sections. However, obtaining serial sections by transmission electron microscopy is an extremely time consuming and technically demanding task. Using focused ion beam/scanning electron microscope microscopy, we recently showed that virtually all synapses can be accurately identified as asymmetric or symmetric synapses when they are visualized, reconstructed, and quantified from large 3D tissue samples obtained in an automated manner. Nevertheless, the analysis, segmentation, and quantification of synapses is still a labor intensive procedure. Thus, novel solutions are currently necessary to deal with the large volume of data that is being generated by automated 3D electron microscopy. Accordingly, we have developed ESPINA, a software tool that performs the automated segmentation and counting of synapses in a reconstructed 3D volume of the cerebral cortex, and that greatly facilitates and accelerates these processes. PMID:21633491

Calibration and evaluation of a magnetically tracked ICE probe for guidance of left atrial ablation therapy

NASA Astrophysics Data System (ADS)

Linte, Cristian A.; Rettmann, Maryam E.; Dilger, Ben; Gunawan, Mia S.; Arunachalam, Shivaram P.; Holmes, David R., III; Packer, Douglas L.; Robb, Richard A.

2012-02-01

The novel prototype system for advanced visualization for image-guided left atrial ablation therapy developed in our laboratory permits ready integration of multiple imaging modalities, surgical instrument tracking, interventional devices and electro-physiologic data. This technology allows subject-specific procedure planning and guidance using 3D dynamic, patient-specific models of the patient's heart, augmented with real-time intracardiac echocardiography (ICE). In order for the 2D ICE images to provide intuitive visualization for accurate catheter to surgical target navigation, the transducer must be tracked, so that the acquired images can be appropriately presented with respect to the patient-specific anatomy. Here we present the implementation of a previously developed ultrasound calibration technique for a magnetically tracked ICE transducer, along with a series of evaluation methods to ensure accurate imaging and faithful representation of the imaged structures. Using an engineering-designed phantom, target localization accuracy is assessed by comparing known target locations with their transformed locations inferred from the tracked US images. In addition, the 3D volume reconstruction accuracy is also estimated by comparing a truth volume to that reconstructed from sequential 2D US images. Clinically emulating validation studies are conducted using a patient-specific left atrial phantom. Target localization error of clinically-relevant surgical targets represented by nylon fiducials implanted within the endocardial wall of the phantom was assessed. Our studies have demonstrated 2.4 +/- 0.8 mm target localization error in the engineering-designed evaluation phantoms, 94.8 +/- 4.6 % volume reconstruction accuracy, and 3.1 +/- 1.2 mm target localization error in the left atrial-mimicking phantom. These results are consistent with those disseminated in the literature and also with the accuracy constraints imposed by the employed technology and the clinical application.

Rapid fusion of 2D X-ray fluoroscopy with 3D multislice CT for image-guided electrophysiology procedures

NASA Astrophysics Data System (ADS)

Zagorchev, Lyubomir; Manzke, Robert; Cury, Ricardo; Reddy, Vivek Y.; Chan, Raymond C.

2007-03-01

Interventional cardiac electrophysiology (EP) procedures are typically performed under X-ray fluoroscopy for visualizing catheters and EP devices relative to other highly-attenuating structures such as the thoracic spine and ribs. These projections do not however contain information about soft-tissue anatomy and there is a recognized need for fusion of conventional fluoroscopy with pre-operatively acquired cardiac multislice computed tomography (MSCT) volumes. Rapid 2D-3D integration in this application would allow for real-time visualization of all catheters present within the thorax in relation to the cardiovascular anatomy visible in MSCT. We present a method for rapid fusion of 2D X-ray fluoroscopy with 3DMSCT that can facilitate EP mapping and interventional procedures by reducing the need for intra-operative contrast injections to visualize heart chambers and specialized systems to track catheters within the cardiovascular anatomy. We use hardware-accelerated ray-casting to compute digitally reconstructed radiographs (DRRs) from the MSCT volume and iteratively optimize the rigid-body pose of the volumetric data to maximize the similarity between the MSCT-derived DRR and the intra-operative X-ray projection data.

D Reconstruction from Uav-Based Hyperspectral Images

NASA Astrophysics Data System (ADS)

Liu, L.; Xu, L.; Peng, J.

2018-04-01

Reconstructing the 3D profile from a set of UAV-based images can obtain hyperspectral information, as well as the 3D coordinate of any point on the profile. Our images are captured from the Cubert UHD185 (UHD) hyperspectral camera, which is a new type of high-speed onboard imaging spectrometer. And it can get both hyperspectral image and panchromatic image simultaneously. The panchromatic image have a higher spatial resolution than hyperspectral image, but each hyperspectral image provides considerable information on the spatial spectral distribution of the object. Thus there is an opportunity to derive a high quality 3D point cloud from panchromatic image and considerable spectral information from hyperspectral image. The purpose of this paper is to introduce our processing chain that derives a database which can provide hyperspectral information and 3D position of each point. First, We adopt a free and open-source software, Visual SFM which is based on structure from motion (SFM) algorithm, to recover 3D point cloud from panchromatic image. And then get spectral information of each point from hyperspectral image by a self-developed program written in MATLAB. The production can be used to support further research and applications.

Three-dimensional reconstruction of rat knee joint using episcopic fluorescence image capture.

PubMed

Takaishi, R; Aoyama, T; Zhang, X; Higuchi, S; Yamada, S; Takakuwa, T

2014-10-01

Development of the knee joint was morphologically investigated, and the process of cavitation was analyzed by using episcopic fluorescence image capture (EFIC) to create spatial and temporal three-dimensional (3D) reconstructions. Knee joints of Wister rat embryos between embryonic day (E)14 and E20 were investigated. Samples were sectioned and visualized using an EFIC. Then, two-dimensional image stacks were reconstructed using OsiriX software, and 3D reconstructions were generated using Amira software. Cavitations of the knee joint were constructed from five divided portions. Cavity formation initiated at multiple sites at E17; among them, the femoropatellar cavity (FPC) was the first. Cavitations of the medial side preceded those of the lateral side. Each cavity connected at E20 when cavitations around the anterior cruciate ligament (ACL) and posterior cruciate ligament (PCL) were completed. Cavity formation initiated from six portions. In each portion, development proceeded asymmetrically. These results concerning anatomical development of the knee joint using EFIC contribute to a better understanding of the structural feature of the knee joint. Copyright © 2014 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

3D Surface Reconstruction of Rills in a Spanish Olive Grove

NASA Astrophysics Data System (ADS)

Brings, Christine; Gronz, Oliver; Seeger, Manuel; Wirtz, Stefan; Taguas, Encarnación; Ries, Johannes B.

2016-04-01

The low-cost, user-friendly photogrammetric Structure from Motion (SfM) technique is used for 3D surface reconstruction and difference calculation of an 18 meter long rill in South Spain (Andalusia, Puente Genil). The images were taken with a Canon HD video camera before and after a rill experiment in an olive grove. Recording with a video camera has compared to a photo camera a huge time advantage and the method also guarantees more than adequately overlapping sharp images. For each model, approximately 20 minutes of video were taken. As SfM needs single images, the sharpest image was automatically selected from 8 frame intervals. The sharpness was estimated using a derivative-based metric. Then, VisualSfM detects feature points in each image, searches matching feature points in all image pairs and recovers the camera and feature positions. Finally, by triangulation of camera positions and feature points the software reconstructs a point cloud of the rill surface. From the point cloud, 3D surface models (meshes) are created and via difference calculations of the pre and post model a visualization of the changes (erosion and accumulation areas) and quantification of erosion volumes are possible. The calculated volumes are presented in spatial units of the models and so real values must be converted via references. The results show that rills in olive groves have a high dynamic due to the lack of vegetation cover under the trees, so that the rill can incise until the bedrock. Another reason for the high activity is the intensive employment of machinery.

Immersive Visual Data Analysis For Geoscience Using Commodity VR Hardware

NASA Astrophysics Data System (ADS)

Kreylos, O.; Kellogg, L. H.

2017-12-01

Immersive visualization using virtual reality (VR) display technology offers tremendous benefits for the visual analysis of complex three-dimensional data like those commonly obtained from geophysical and geological observations and models. Unlike "traditional" visualization, which has to project 3D data onto a 2D screen for display, VR can side-step this projection and display 3D data directly, in a pseudo-holographic (head-tracked stereoscopic) form, and does therefore not suffer the distortions of relative positions, sizes, distances, and angles that are inherent in 2D projection. As a result, researchers can apply their spatial reasoning skills to virtual data in the same way they can to real objects or environments. The UC Davis W.M. Keck Center for Active Visualization in the Earth Sciences (KeckCAVES, http://keckcaves.org) has been developing VR methods for data analysis since 2005, but the high cost of VR displays has been preventing large-scale deployment and adoption of KeckCAVES technology. The recent emergence of high-quality commodity VR, spearheaded by the Oculus Rift and HTC Vive, has fundamentally changed the field. With KeckCAVES' foundational VR operating system, Vrui, now running natively on the HTC Vive, all KeckCAVES visualization software, including 3D Visualizer, LiDAR Viewer, Crusta, Nanotech Construction Kit, and ProtoShop, are now available to small labs, single researchers, and even home users. LiDAR Viewer and Crusta have been used for rapid response to geologic events including earthquakes and landslides, to visualize the impacts of sealevel rise, to investigate reconstructed paleooceanographic masses, and for exploration of the surface of Mars. The Nanotech Construction Kit is being used to explore the phases of carbon in Earth's deep interior, while ProtoShop can be used to construct and investigate protein structures.

Computed reconstruction of spatial ammonoid-shell orientation captured from digitized grinding and landmark data

NASA Astrophysics Data System (ADS)

Lukeneder, Susanne; Lukeneder, Alexander; Weber, Gerhard W.

2014-03-01

The internal orientation of fossil mass occurrences can be exploited as useful source of information about their primary depositional conditions. A series of studies, using different kinds of fossils, especially those with elongated shape (e.g., elongated gastropods), deal with their orientation and the subsequent reconstruction of the depositional conditions (e.g., paleocurrents and transport mechanisms). However, disk-shaped fossils like planispiral cephalopods or gastropods were used, up to now, with caution for interpreting paleocurrents. Moreover, most studies just deal with the topmost surface of such mass occurrences, due to the easier accessibility. Within this study, a new method for three-dimensional reconstruction of the internal structure of a fossil mass occurrence and the subsequent calculation of its spatial shell orientation is established. A 234 million-years-old (Carnian, Triassic) monospecific mass occurrence of the ammonoid Kasimlarceltites krystyni from the Taurus Mountains in Turkey, embedded in limestone, is used for this pilot study. Therefore, a 150×45×140 mm3 block of the ammonoid bearing limestone bed has been grinded to 70 slices, with a distance of 2 mm between each slice. By using a semi-automatic region growing algorithm of the 3D-visualization software Amira, ammonoids of a part of this mass occurrence were segmented and a 3D-model reconstructed. Landmarks, trigonometric and vector-based calculations were used to compute the diameters and the spatial orientation of each ammonoid. The spatial shell orientation was characterized by dip and dip-direction and aperture direction of the longitudinal axis, as well as by dip and azimuth of an imaginary sagittal-plane through each ammonoid. The exact spatial shell orientation was determined for a sample of 675 ammonoids, and their statistical orientation analyzed (i.e., NW/SE). The study combines classical orientation analysis with modern 3D-visualization techniques, and establishes a novel spatial orientation analyzing method, which can be adapted to any kind of abundant solid matter.

Combined in-depth, 3D, en face imaging of the optic disc, optic disc pits and optic disc pit maculopathy using swept-source megahertz OCT at 1050 nm.

PubMed

Maertz, Josef; Kolb, Jan Philip; Klein, Thomas; Mohler, Kathrin J; Eibl, Matthias; Wieser, Wolfgang; Huber, Robert; Priglinger, Siegfried; Wolf, Armin

2018-02-01

To demonstrate papillary imaging of eyes with optic disc pits (ODP) or optic disc pit associated maculopathy (ODP-M) with ultrahigh-speed swept-source optical coherence tomography (SS-OCT) at 1.68 million A-scans/s. To generate 3D-renderings of the papillary area with 3D volume-reconstructions of the ODP and highly resolved en face images from a single densely-sampled megahertz-OCT (MHz-OCT) dataset for investigation of ODP-characteristics. A 1.68 MHz-prototype SS-MHz-OCT system at 1050 nm based on a Fourier-domain mode-locked laser was employed to acquire high-definition, 3D datasets with a dense sampling of 1600 × 1600 A-scans over a 45° field of view. Six eyes with ODPs, and two further eyes with glaucomatous alteration or without ocular pathology are presented. 3D-rendering of the deep papillary structures, virtual 3D-reconstructions of the ODPs and depth resolved isotropic en face images were generated using semiautomatic segmentation. 3D-rendering and en face imaging of the optic disc, ODPs and ODP associated pathologies showed a broad spectrum regarding ODP characteristics. Between individuals the shape of the ODP and the appending pathologies varied considerably. MHz-OCT en face imaging generates distinct top-view images of ODPs and ODP-M. MHz-OCT generates high resolution images of retinal pathologies associated with ODP-M and allows visualizing ODPs with depths of up to 2.7 mm. Different patterns of ODPs can be visualized in patients for the first time using 3D-reconstructions and co-registered high-definition en face images extracted from a single densely sampled 1050 nm megahertz-OCT (MHz-OCT) dataset. As the immediate vicinity to the SAS and the site of intrapapillary proliferation is located at the bottom of the ODP it is crucial to image the complete structure and the whole depth of ODPs. Especially in very deep pits, where non-swept-source OCT fails to reach the bottom, conventional swept-source devices and the MHz-OCT alike are feasible and beneficial methods to examine deep details of optic disc pathologies, while the MHz-OCT bears the advantage of an essentially swifter imaging process.

Epithelial innervation of human cornea: a three-dimensional study using confocal laser scanning fluorescence microscopy.

PubMed

Guthoff, Rudolf F; Wienss, Holger; Hahnel, Christian; Wree, Andreas

2005-07-01

Evaluation of a new method to visualize distribution and morphology of human corneal nerves (Adelta- and C-fibers) by means of fluorescence staining, confocal laser scanning microscopy, and 3-dimensional (3D) reconstruction. Trephinates of corneas with a diagnosis of Fuchs corneal dystrophy were sliced into layers of 200 microm thickness using a Draeger microkeratome (Storz, Germany). The anterior lamella was stained with the Life/Dead-Kit (Molecular Probes Inc.), examined by the confocal laser scanning microscope "Odyssey XL," step size between 0.5 and 1 microm, and optical sections were digitally 3D-reconstructed. Immediate staining of explanted corneas by the Life/Dead-Kit gave a complete picture of the nerves in the central human cornea. Thin nerves running parallel to the Bowman layer in the subepithelial plexus perforate the Bowman layer orthogonally through tube-like structures. Passing the Bowman layer, Adelta- and C-fibers can be clearly distinguished by fiber diameter, and, while running in the basal epithelial plexus, by their spatial arrangement. Adelta-fibers run straight and parallel to the Bowman layer underneath the basal cell layer. C-fibers, after a short run parallel to the Bowman layer, send off multiple branches penetrating epithelial cell layers orthogonally, ending blindly in invaginations of the superficial cells. In contrast to C-fibers, Adelta-fibers show characteristic bulbous formations when kinking into the basal epithelial plexus. Ex-vivo fluorescence staining of the cornea and 3D reconstructions of confocal scans provide a fast and easily reproducible tool to visualize nerves of the anterior living cornea at high resolution. This may help to clarify gross variations of nerve fiber patterns under various clinical and experimental conditions.

Image-Based Modeling Techniques for Architectural Heritage 3d Digitalization: Limits and Potentialities

NASA Astrophysics Data System (ADS)

Santagati, C.; Inzerillo, L.; Di Paola, F.

2013-07-01

3D reconstruction from images has undergone a revolution in the last few years. Computer vision techniques use photographs from data set collection to rapidly build detailed 3D models. The simultaneous applications of different algorithms (MVS), the different techniques of image matching, feature extracting and mesh optimization are inside an active field of research in computer vision. The results are promising: the obtained models are beginning to challenge the precision of laser-based reconstructions. Among all the possibilities we can mainly distinguish desktop and web-based packages. Those last ones offer the opportunity to exploit the power of cloud computing in order to carry out a semi-automatic data processing, thus allowing the user to fulfill other tasks on its computer; whereas desktop systems employ too much processing time and hard heavy approaches. Computer vision researchers have explored many applications to verify the visual accuracy of 3D model but the approaches to verify metric accuracy are few and no one is on Autodesk 123D Catch applied on Architectural Heritage Documentation. Our approach to this challenging problem is to compare the 3Dmodels by Autodesk 123D Catch and 3D models by terrestrial LIDAR considering different object size, from the detail (capitals, moldings, bases) to large scale buildings for practitioner purpose.

Telearch - Integrated visual simulation environment for collaborative virtual archaeology.

NASA Astrophysics Data System (ADS)

Kurillo, Gregorij; Forte, Maurizio

Archaeologists collect vast amounts of digital data around the world; however, they lack tools for integration and collaborative interaction to support reconstruction and interpretation process. TeleArch software is aimed to integrate different data sources and provide real-time interaction tools for remote collaboration of geographically distributed scholars inside a shared virtual environment. The framework also includes audio, 2D and 3D video streaming technology to facilitate remote presence of users. In this paper, we present several experimental case studies to demonstrate the integration and interaction with 3D models and geographical information system (GIS) data in this collaborative environment.

Light ray field capture using focal plane sweeping and its optical reconstruction using 3D displays.

PubMed

Park, Jae-Hyeung; Lee, Sung-Keun; Jo, Na-Young; Kim, Hee-Jae; Kim, Yong-Soo; Lim, Hong-Gi

2014-10-20

We propose a method to capture light ray field of three-dimensional scene using focal plane sweeping. Multiple images are captured using a usual camera at different focal distances, spanning the three-dimensional scene. The captured images are then back-projected to four-dimensional spatio-angular space to obtain the light ray field. The obtained light ray field can be visualized either using digital processing or optical reconstruction using various three-dimensional display techniques including integral imaging, layered display, and holography.

Three-dimensional Noninvasive Monitoring Iodine-131 Uptake in the Thyroid Using a Modified Cerenkov Luminescence Tomography Approach

PubMed Central

Qu, Xiaochao; Yang, Weidong; Liang, Jimin; Wang, Jing; Tian, Jie

2012-01-01

Background Cerenkov luminescence tomography (CLT) provides the three-dimensional (3D) radiopharmaceutical biodistribution in small living animals, which is vital to biomedical imaging. However, existing single-spectral and multispectral methods are not very efficient and effective at reconstructing the distribution of the radionuclide tracer. In this paper, we present a semi-quantitative Cerenkov radiation spectral characteristic-based source reconstruction method named the hybrid spectral CLT, to efficiently reconstruct the radionuclide tracer with both encouraging reconstruction results and less acquisition and image reconstruction time. Methodology/Principal Findings We constructed the implantation mouse model implanted with a 400 µCi Na131I radioactive source and the physiological mouse model received an intravenous tail injection of 400 µCi radiopharmaceutical Iodine-131 (I-131) to validate the performance of the hybrid spectral CLT and compared the reconstruction results, acquisition, and image reconstruction time with that of single-spectral and multispectral CLT. Furthermore, we performed 3D noninvasive monitoring of I-131 uptake in the thyroid and quantified I-131 uptake in vivo using hybrid spectral CLT. Results showed that the reconstruction based on the hybrid spectral CLT was more accurate in localization and quantification than using single-spectral CLT, and was more efficient in the in vivo experiment compared with multispectral CLT. Additionally, 3D visualization of longitudinal observations suggested that the reconstructed energy of I-131 uptake in the thyroid increased with acquisition time and there was a robust correlation between the reconstructed energy versus the gamma ray counts of I-131 (). The ex vivo biodistribution experiment further confirmed the I-131 uptake in the thyroid for hybrid spectral CLT. Conclusions/Significance Results indicated that hybrid spectral CLT could be potentially used for thyroid imaging to evaluate its function and monitor its treatment for thyroid cancer. PMID:22629431

The research of autonomous obstacle avoidance of mobile robot based on multi-sensor integration

NASA Astrophysics Data System (ADS)

Zhao, Ming; Han, Baoling

2016-11-01

The object of this study is the bionic quadruped mobile robot. The study has proposed a system design plan for mobile robot obstacle avoidance with the binocular stereo visual sensor and the self-control 3D Lidar integrated with modified ant colony optimization path planning to realize the reconstruction of the environmental map. Because the working condition of a mobile robot is complex, the result of the 3D reconstruction with a single binocular sensor is undesirable when feature points are few and the light condition is poor. Therefore, this system integrates the stereo vision sensor blumblebee2 and the Lidar sensor together to detect the cloud information of 3D points of environmental obstacles. This paper proposes the sensor information fusion technology to rebuild the environment map. Firstly, according to the Lidar data and visual data on obstacle detection respectively, and then consider two methods respectively to detect the distribution of obstacles. Finally fusing the data to get the more complete, more accurate distribution of obstacles in the scene. Then the thesis introduces ant colony algorithm. It has analyzed advantages and disadvantages of the ant colony optimization and its formation cause deeply, and then improved the system with the help of the ant colony optimization to increase the rate of convergence and precision of the algorithm in robot path planning. Such improvements and integrations overcome the shortcomings of the ant colony optimization like involving into the local optimal solution easily, slow search speed and poor search results. This experiment deals with images and programs the motor drive under the compiling environment of Matlab and Visual Studio and establishes the visual 2.5D grid map. Finally it plans a global path for the mobile robot according to the ant colony algorithm. The feasibility and effectiveness of the system are confirmed by ROS and simulation platform of Linux.

The interactive presentation of 3D information obtained from reconstructed datasets and 3D placement of single histological sections with the 3D portable document format.

PubMed

de Boer, Bouke A; Soufan, Alexandre T; Hagoort, Jaco; Mohun, Timothy J; van den Hoff, Maurice J B; Hasman, Arie; Voorbraak, Frans P J M; Moorman, Antoon F M; Ruijter, Jan M

2011-01-01

Interpretation of the results of anatomical and embryological studies relies heavily on proper visualization of complex morphogenetic processes and patterns of gene expression in a three-dimensional (3D) context. However, reconstruction of complete 3D datasets is time consuming and often researchers study only a few sections. To help in understanding the resulting 2D data we developed a program (TRACTS) that places such arbitrary histological sections into a high-resolution 3D model of the developing heart. The program places sections correctly, robustly and as precisely as the best of the fits achieved by five morphology experts. Dissemination of 3D data is severely hampered by the 2D medium of print publication. Many insights gained from studying the 3D object are very hard to convey using 2D images and are consequently lost or cannot be verified independently. It is possible to embed 3D objects into a pdf document, which is a format widely used for the distribution of scientific papers. Using the freeware program Adobe Reader to interact with these 3D objects is reasonably straightforward; creating such objects is not. We have developed a protocol that describes, step by step, how 3D objects can be embedded into a pdf document. Both the use of TRACTS and the inclusion of 3D objects in pdf documents can help in the interpretation of 2D and 3D data, and will thus optimize communication on morphological issues in developmental biology.

A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage

PubMed Central

Faure, Emmanuel; Savy, Thierry; Rizzi, Barbara; Melani, Camilo; Stašová, Olga; Fabrèges, Dimitri; Špir, Róbert; Hammons, Mark; Čúnderlík, Róbert; Recher, Gaëlle; Lombardot, Benoît; Duloquin, Louise; Colin, Ingrid; Kollár, Jozef; Desnoulez, Sophie; Affaticati, Pierre; Maury, Benoît; Boyreau, Adeline; Nief, Jean-Yves; Calvat, Pascal; Vernier, Philippe; Frain, Monique; Lutfalla, Georges; Kergosien, Yannick; Suret, Pierre; Remešíková, Mariana; Doursat, René; Sarti, Alessandro; Mikula, Karol; Peyriéras, Nadine; Bourgine, Paul

2016-01-01

The quantitative and systematic analysis of embryonic cell dynamics from in vivo 3D+time image data sets is a major challenge at the forefront of developmental biology. Despite recent breakthroughs in the microscopy imaging of living systems, producing an accurate cell lineage tree for any developing organism remains a difficult task. We present here the BioEmergences workflow integrating all reconstruction steps from image acquisition and processing to the interactive visualization of reconstructed data. Original mathematical methods and algorithms underlie image filtering, nucleus centre detection, nucleus and membrane segmentation, and cell tracking. They are demonstrated on zebrafish, ascidian and sea urchin embryos with stained nuclei and membranes. Subsequent validation and annotations are carried out using Mov-IT, a custom-made graphical interface. Compared with eight other software tools, our workflow achieved the best lineage score. Delivered in standalone or web service mode, BioEmergences and Mov-IT offer a unique set of tools for in silico experimental embryology. PMID:26912388

Accelerated Optical Projection Tomography Applied to In Vivo Imaging of Zebrafish

PubMed Central

Correia, Teresa; Yin, Jun; Ramel, Marie-Christine; Andrews, Natalie; Katan, Matilda; Bugeon, Laurence; Dallman, Margaret J.; McGinty, James; Frankel, Paul; French, Paul M. W.; Arridge, Simon

2015-01-01

Optical projection tomography (OPT) provides a non-invasive 3-D imaging modality that can be applied to longitudinal studies of live disease models, including in zebrafish. Current limitations include the requirement of a minimum number of angular projections for reconstruction of reasonable OPT images using filtered back projection (FBP), which is typically several hundred, leading to acquisition times of several minutes. It is highly desirable to decrease the number of required angular projections to decrease both the total acquisition time and the light dose to the sample. This is particularly important to enable longitudinal studies, which involve measurements of the same fish at different time points. In this work, we demonstrate that the use of an iterative algorithm to reconstruct sparsely sampled OPT data sets can provide useful 3-D images with 50 or fewer projections, thereby significantly decreasing the minimum acquisition time and light dose while maintaining image quality. A transgenic zebrafish embryo with fluorescent labelling of the vasculature was imaged to acquire densely sampled (800 projections) and under-sampled data sets of transmitted and fluorescence projection images. The under-sampled OPT data sets were reconstructed using an iterative total variation-based image reconstruction algorithm and compared against FBP reconstructions of the densely sampled data sets. To illustrate the potential for quantitative analysis following rapid OPT data acquisition, a Hessian-based method was applied to automatically segment the reconstructed images to select the vasculature network. Results showed that 3-D images of the zebrafish embryo and its vasculature of sufficient visual quality for quantitative analysis can be reconstructed using the iterative algorithm from only 32 projections—achieving up to 28 times improvement in imaging speed and leading to total acquisition times of a few seconds. PMID:26308086

3-D Flow Visualization with a Light-field Camera

NASA Astrophysics Data System (ADS)

Thurow, B.

2012-12-01

Light-field cameras have received attention recently due to their ability to acquire photographs that can be computationally refocused after they have been acquired. In this work, we describe the development of a light-field camera system for 3D visualization of turbulent flows. The camera developed in our lab, also known as a plenoptic camera, uses an array of microlenses mounted next to an image sensor to resolve both the position and angle of light rays incident upon the camera. For flow visualization, the flow field is seeded with small particles that follow the fluid's motion and are imaged using the camera and a pulsed light source. The tomographic MART algorithm is then applied to the light-field data in order to reconstruct a 3D volume of the instantaneous particle field. 3D, 3C velocity vectors are then determined from a pair of 3D particle fields using conventional cross-correlation algorithms. As an illustration of the concept, 3D/3C velocity measurements of a turbulent boundary layer produced on the wall of a conventional wind tunnel are presented. Future experiments are planned to use the camera to study the influence of wall permeability on the 3-D structure of the turbulent boundary layer.Schematic illustrating the concept of a plenoptic camera where each pixel represents both the position and angle of light rays entering the camera. This information can be used to computationally refocus an image after it has been acquired. Instantaneous 3D velocity field of a turbulent boundary layer determined using light-field data captured by a plenoptic camera.

Gestalt-like constraints produce veridical (Euclidean) percepts of 3D indoor scenes

PubMed Central

Kwon, TaeKyu; Li, Yunfeng; Sawada, Tadamasa; Pizlo, Zygmunt

2015-01-01

This study, which was influenced a lot by Gestalt ideas, extends our prior work on the role of a priori constraints in the veridical perception of 3D shapes to the perception of 3D scenes. Our experiments tested how human subjects perceive the layout of a naturally-illuminated indoor scene that contains common symmetrical 3D objects standing on a horizontal floor. In one task, the subject was asked to draw a top view of a scene that was viewed either monocularly or binocularly. The top views the subjects reconstructed were configured accurately except for their overall size. These size errors varied from trial to trial, and were shown most-likely to result from the presence of a response bias. There was little, if any, evidence of systematic distortions of the subjects’ perceived visual space, the kind of distortions that have been reported in numerous experiments run under very unnatural conditions. This shown, we proceeded to use Foley’s (Vision Research 12 (1972) 323–332) isosceles right triangle experiment to test the intrinsic geometry of visual space directly. This was done with natural viewing, with the impoverished viewing conditions Foley had used, as well as with a number of intermediate viewing conditions. Our subjects produced very accurate triangles when the viewing conditions were natural, but their performance deteriorated systematically as the viewing conditions were progressively impoverished. Their perception of visual space became more compressed as their natural visual environment was degraded. Once this was shown, we developed a computational model that emulated the most salient features of our psychophysical results. We concluded that human observers see 3D scenes veridically when they view natural 3D objects within natural 3D environments. PMID:26525845

A three-dimensional radiation image display on a real space image created via photogrammetry

NASA Astrophysics Data System (ADS)

Sato, Y.; Ozawa, S.; Tanifuji, Y.; Torii, T.

2018-03-01

The Fukushima Daiichi Nuclear Power Station (FDNPS), operated by Tokyo Electric Power Company Holdings, Inc., went into meltdown after the occurrence of a large tsunami caused by the Great East Japan Earthquake of March 11, 2011. The radiation distribution measurements inside the FDNPS buildings are indispensable to execute decommissioning tasks in the reactor buildings. We have developed a three-dimensional (3D) image reconstruction method for radioactive substances using a compact Compton camera. Moreover, we succeeded in visually recognizing the position of radioactive substances in real space by the integration of 3D radiation images and the 3D photo-model created using photogrammetry.

MR image denoising method for brain surface 3D modeling

NASA Astrophysics Data System (ADS)

Zhao, De-xin; Liu, Peng-jie; Zhang, De-gan

2014-11-01

Three-dimensional (3D) modeling of medical images is a critical part of surgical simulation. In this paper, we focus on the magnetic resonance (MR) images denoising for brain modeling reconstruction, and exploit a practical solution. We attempt to remove the noise existing in the MR imaging signal and preserve the image characteristics. A wavelet-based adaptive curve shrinkage function is presented in spherical coordinates system. The comparative experiments show that the denoising method can preserve better image details and enhance the coefficients of contours. Using these denoised images, the brain 3D visualization is given through surface triangle mesh model, which demonstrates the effectiveness of the proposed method.

Multiplanar visualization in 3D transthoracic echocardiography for precise delineation of mitral valve pathology.

PubMed

Kuppahally, Suman S; Paloma, Allan; Craig Miller, D; Schnittger, Ingela; Liang, David

2008-01-01

A novel multiplanar reformatting (MPR) technique in three-dimensional transthoracic echocardiography (3D TTE) was used to precisely localize the prolapsed lateral segment of posterior mitral valve leaflet in a patient symptomatic with mitral valve prolapse (MVP) and moderate mitral regurgitation (MR) before undergoing mitral valve repair surgery. Transesophageal echocardiography was avoided based on the findings of this new technique by 3D TTE. It was noninvasive, quick, reproducible and reliable. Also, it did not need the time-consuming reconstruction of multiple cardiac images. Mitral valve repair surgery was subsequently performed based on the MPR findings and corroborated the findings from the MPR examination.

Shearing Low-frictional 3D Granular Materials

NASA Astrophysics Data System (ADS)

Chen, David; Zheng, Hu; Behringer, Robert

Shear jamming occurs in frictional particles over a range of packing fractions, from random loose to random dense. Simulations show shear jamming for frictionless spheres, but over a vanishing range as the system size grows. We use packings of submerged and diffractive index-matched hydrogel particles to determine the shear-induced microscopic response of 3D, low-frictional granular systems near jamming, bridging the gap between frictionless and low friction packings. We visualize the particles by a laser scanning technique, and we track particle motion along with their interparticle contact forces from its 3D-reconstructions. NSF-DMF-1206351, NASA NNX15AD38G, William M. Keck Foundation, and DARPA.

3D reconstruction and spatial auralization of the "Painted Dolmen" of Antelas

NASA Astrophysics Data System (ADS)

Dias, Paulo; Campos, Guilherme; Santos, Vítor; Casaleiro, Ricardo; Seco, Ricardo; Sousa Santos, Beatriz

2008-02-01

This paper presents preliminary results on the development of a 3D audiovisual model of the Anta Pintada (painted dolmen) of Antelas, a Neolithic chamber tomb located in Oliveira de Frades and listed as Portuguese national monument. The final aim of the project is to create a highly accurate Virtual Reality (VR) model of this unique archaeological site, capable of providing not only visual but also acoustic immersion based on its actual geometry and physical properties. The project started in May 2006 with in situ data acquisition. The 3D geometry of the chamber was captured using a Laser Range Finder. In order to combine the different scans into a complete 3D visual model, reconstruction software based on the Iterative Closest Point (ICP) algorithm was developed using the Visualization Toolkit (VTK). This software computes the boundaries of the room on a 3D uniform grid and populates its interior with "free-space nodes", through an iterative algorithm operating like a torchlight illuminating a dark room. The envelope of the resulting set of "free-space nodes" is used to generate a 3D iso-surface approximating the interior shape of the chamber. Each polygon of this surface is then assigned the acoustic absorption coefficient of the corresponding boundary material. A 3D audiovisual model operating in real-time was developed for a VR Environment comprising head-mounted display (HMD) I-glasses SVGAPro, an orientation sensor (tracker) InterTrax 2 with 3 Degrees Of Freedom (3DOF) and stereo headphones. The auralisation software is based on a geometric model. This constitutes a first approach, since geometric acoustics have well-known limitations in rooms with irregular surfaces. The immediate advantage lies in their inherent computational efficiency, which allows real-time operation. The program computes the early reflections forming the initial part of the chamber's impulse response (IR), which carry the most significant cues for source localisation. These early reflections are processed through Head Related Transfer Functions (HRTF) updated in real-time according to the orientation of the user's head, so that sound waves appear to come from the correct location in space, in agreement with the visual scene. The late-reverberation tail of the IR is generated by an algorithm designed to match the reverberation time of the chamber, calculated from the actual acoustic absorption coefficients of its surfaces. The sound output to the headphones is obtained by convolving the IR with anechoic recordings of the virtual audio source.

"torino 1911" Project: a Contribution of a Slam-Based Survey to Extensive 3d Heritage Modeling

NASA Astrophysics Data System (ADS)

Chiabrando, F.; Della Coletta, C.; Sammartano, G.; Spanò, A.; Spreafico, A.

2018-05-01

In the framework of the digital documentation of complex environments the advanced Geomatics researches offers integrated solution and multi-sensor strategies for the 3D accurate reconstruction of stratified structures and articulated volumes in the heritage domain. The use of handheld devices for rapid mapping, both image- and range-based, can help the production of suitable easy-to use and easy-navigable 3D model for documentation projects. These types of reality-based modelling could support, with their tailored integrated geometric and radiometric aspects, valorisation and communication projects including virtual reconstructions, interactive navigation settings, immersive reality for dissemination purposes and evoking past places and atmospheres. The aim of this research is localized within the "Torino 1911" project, led by the University of San Diego (California) in cooperation with the PoliTo. The entire project is conceived for multi-scale reconstruction of the real and no longer existing structures in the whole park space of more than 400,000 m2, for a virtual and immersive visualization of the Turin 1911 International "Fabulous Exposition" event, settled in the Valentino Park. Particularly, in the presented research, a 3D metric documentation workflow is proposed and validated in order to integrate the potentialities of LiDAR mapping by handheld SLAM-based device, the ZEB REVO Real Time instrument by GeoSLAM (2017 release), instead of TLS consolidated systems. Starting from these kind of models, the crucial aspects of the trajectories performances in the 3D reconstruction and the radiometric content from imaging approaches are considered, specifically by means of compared use of common DSLR cameras and portable sensors.

A 3D reconstruction of pancreas development in the human embryos during embryonic period (Carnegie stages 15-23).

PubMed

Radi, M; Gaubert, J; Cristol-Gaubert, R; Baecker, V; Travo, P; Prudhomme, M; Godlewski, G; Prat-Pradal, D

2010-01-01

The goal in this paper was to rebuild a three dimensional (3D) reconstruction of the dorsal and ventral pancreatic buds, in the human embryos, at Carnegie stages 15-23. The early development of the pancreas is studied by tissue observation and reconstruction by a computer-assisted method, using a light micrograph images from consecutive serial sagittal sections (diameter 7 microm) of ten human embryos ranging from Carnegie stages 15-23, CRL 7-27 mm, fixed, dehydrated and embedded in paraffin, were stained alternately with haematoxylin-eosin or Heindenhain'Azan. The images were digitalized by Canon Camera 350 EOS D. The serial views were aligned automatically by software, manual alignment was performed, the data were analysed following segmentation and threshold. The two buds were clearly identified at stage 15. In stage 16, both pancreatic buds were in final position, and begin to merge in stage 17. From stage 18 to the stage 23, surrounding connective tissue differentiated. In the stage 23, the morphology of the pancreas was definitive. The superior portion of the anterior face of the pancreas's head was arising from the dorsal bud. The rest of the head including the uncinate process emanated from the ventral bud. The 3D computer-assisted reconstruction of the human pancreas visualized the relationships between the two pancreatic buds. This explains the disposition and the modality of the components fusion. This embryologic development permits a better understanding of congenital abnormalities.

Computational Approaches to Vestibular Research

NASA Technical Reports Server (NTRS)

Ross, Muriel D.; Wade, Charles E. (Technical Monitor)

1994-01-01

The Biocomputation Center at NASA Ames Research Center is dedicated to a union between computational, experimental and theoretical approaches to the study of neuroscience and of life sciences in general. The current emphasis is on computer reconstruction and visualization of vestibular macular architecture in three-dimensions (3-D), and on mathematical modeling and computer simulation of neural activity in the functioning system. Our methods are being used to interpret the influence of spaceflight on mammalian vestibular maculas in a model system, that of the adult Sprague-Dawley rat. More than twenty 3-D reconstructions of type I and type II hair cells and their afferents have been completed by digitization of contours traced from serial sections photographed in a transmission electron microscope. This labor-intensive method has now been replace d by a semiautomated method developed in the Biocomputation Center in which conventional photography is eliminated. All viewing, storage and manipulation of original data is done using Silicon Graphics workstations. Recent improvements to the software include a new mesh generation method for connecting contours. This method will permit the investigator to describe any surface, regardless of complexity, including highly branched structures such as are routinely found in neurons. This same mesh can be used for 3-D, finite volume simulation of synapse activation and voltage spread on neuronal surfaces visualized via the reconstruction process. These simulations help the investigator interpret the relationship between neuroarchitecture and physiology, and are of assistance in determining which experiments will best test theoretical interpretations. Data are also used to develop abstract, 3-D models that dynamically display neuronal activity ongoing in the system. Finally, the same data can be used to visualize the neural tissue in a virtual environment. Our exhibit will depict capabilities of our computational approaches and some of our findings from their application. For example, our research has demonstrated that maculas of adult mammals retain the property of synaptic plasticity. Ribbon synapses increase numerically and undergo changes in type and distribution (p<0.0001) in type II hair cells after exposure to microgravity for as few as nine days. The finding of macular synaptic plasticity is pertinent to the clinic, and may help explain some. balance disorders in humans. The software used in our investigations will be demonstrated for those interested in applying it in their own research.

Stereoscopic vascular models of the head and neck: A computed tomography angiography visualization.

PubMed

Cui, Dongmei; Lynch, James C; Smith, Andrew D; Wilson, Timothy D; Lehman, Michael N

2016-01-01

Computer-assisted 3D models are used in some medical and allied health science schools; however, they are often limited to online use and 2D flat screen-based imaging. Few schools take advantage of 3D stereoscopic learning tools in anatomy education and clinically relevant anatomical variations when teaching anatomy. A new approach to teaching anatomy includes use of computed tomography angiography (CTA) images of the head and neck to create clinically relevant 3D stereoscopic virtual models. These high resolution images of the arteries can be used in unique and innovative ways to create 3D virtual models of the vasculature as a tool for teaching anatomy. Blood vessel 3D models are presented stereoscopically in a virtual reality environment, can be rotated 360° in all axes, and magnified according to need. In addition, flexible views of internal structures are possible. Images are displayed in a stereoscopic mode, and students view images in a small theater-like classroom while wearing polarized 3D glasses. Reconstructed 3D models enable students to visualize vascular structures with clinically relevant anatomical variations in the head and neck and appreciate spatial relationships among the blood vessels, the skull and the skin. © 2015 American Association of Anatomists.

2D AND 3D KINEMATICS DURING LATERAL STEP-DOWN TESTING IN INDIVIDUALS WITH ANTERIOR CRUCIATE LIGAMENT RECONSTRUCTION.

PubMed

Mostaed, Maria F; Werner, David M; Barrios, Joaquin A

2018-02-01

The lateral step-down test is an established clinical evaluation tool to assess quality of movement in patients with knee disorders. However, this test has not been investigated in individuals after anterior cruciate ligament reconstruction (ACLR) in association with quantitative 3D motion analysis. The purpose of this study was to determine the strength of association between visually-assessed quality of movement during the lateral step-down test and 3D lower limb kinematics in patients with history of ACLR. A second purpose was to compare kinematics between subgroups based on the presence or absence of faulty alignments during the task. The final purpose was to compare visually-assessed quality of movement scores between box heights during lateral step-down testing. Twenty subjects at least one year status post-ACLR (18 females, age of 24.5 ± 4.6 years and body mass index of 23.4 ± 2.3 kg/m 2 ) performed the lateral step-down test unilaterally on the surgical limb atop four and six inch boxes. A board-certified orthopedic physical therapist scored overall quality of movement during the lateral step-down test using established criteria during 2D video playback. Lower limb kinematics were simultaneously collected using 3D motion capture. An alpha level of 0.05 was used for all statistical treatments. Overall 2D quality of movement score significantly correlated (r =0.47-0.57) with 3D hip adduction and hip internal rotation across box heights. Across box heights, the presence of faulty pelvic alignment differentiated a subgroup exhibiting less peak knee flexion, and the presence of faulty knee alignment differentiated a subgroup exhibiting greater peak hip adduction. The six inch box elicited worse quality of movement compared to the four inch box. These results suggest that visually-assessed quality of movement is associated with several kinematic variables after ACLR. 2D movement deviations at the pelvis appear to consistently relate to less knee flexion, and 2D deviations at the knee appear to suggest greater hip adduction. Generally, poorer quality of movement was observed for the six inch box height. Clinically, these data suggest that interventions targeting hip abductor and knee extensor strength and neuromuscular control may be useful in the presence of poor quality of movement during lateral step-down testing. 2b.

3D reconstruction of synapses with deep learning based on EM Images

NASA Astrophysics Data System (ADS)

Xiao, Chi; Rao, Qiang; Zhang, Dandan; Chen, Xi; Han, Hua; Xie, Qiwei

2017-03-01

Recently, due to the rapid development of electron microscope (EM) with its high resolution, stacks delivered by EM can be used to analyze a variety of components that are critical to understand brain function. Since synaptic study is essential in neurobiology and can be analyzed by EM stacks, the automated routines for reconstruction of synapses based on EM Images can become a very useful tool for analyzing large volumes of brain tissue and providing the ability to understand the mechanism of brain. In this article, we propose a novel automated method to realize 3D reconstruction of synapses for Automated Tapecollecting Ultra Microtome Scanning Electron Microscopy (ATUM-SEM) with deep learning. Being different from other reconstruction algorithms, which employ classifier to segment synaptic clefts directly. We utilize deep learning method and segmentation algorithm to obtain synaptic clefts as well as promote the accuracy of reconstruction. The proposed method contains five parts: (1) using modified Moving Least Square (MLS) deformation algorithm and Scale Invariant Feature Transform (SIFT) features to register adjacent sections, (2) adopting Faster Region Convolutional Neural Networks (Faster R-CNN) algorithm to detect synapses, (3) utilizing screening method which takes context cues of synapses into consideration to reduce the false positive rate, (4) combining a practical morphology algorithm with a suitable fitting function to segment synaptic clefts and optimize the shape of them, (5) applying the plugin in FIJI to show the final 3D visualization of synapses. Experimental results on ATUM-SEM images demonstrate the effectiveness of our proposed method.

Accurate three-dimensional virtual reconstruction of surgical field using calibrated trajectories of an image-guided medical robot

PubMed Central

Gong, Yuanzheng; Hu, Danying; Hannaford, Blake; Seibel, Eric J.

2014-01-01

Abstract. Brain tumor margin removal is challenging because diseased tissue is often visually indistinguishable from healthy tissue. Leaving residual tumor leads to decreased survival, and removing normal tissue causes life-long neurological deficits. Thus, a surgical robotics system with a high degree of dexterity, accurate navigation, and highly precise resection is an ideal candidate for image-guided removal of fluorescently labeled brain tumor cells. To image, we developed a scanning fiber endoscope (SFE) which acquires concurrent reflectance and fluorescence wide-field images at a high resolution. This miniature flexible endoscope was affixed to the arm of a RAVEN II surgical robot providing programmable motion with feedback control using stereo-pair surveillance cameras. To verify the accuracy of the three-dimensional (3-D) reconstructed surgical field, a multimodal physical-sized model of debulked brain tumor was used to obtain the 3-D locations of residual tumor for robotic path planning to remove fluorescent cells. Such reconstruction is repeated intraoperatively during margin clean-up so the algorithm efficiency and accuracy are important to the robotically assisted surgery. Experimental results indicate that the time for creating this 3-D surface can be reduced to one-third by using known trajectories of a robot arm, and the error from the reconstructed phantom is within 0.67 mm in average compared to the model design. PMID:26158071

Visualizing Volcanic Clouds in the Atmosphere and Their Impact on Air Traffic.

PubMed

Gunther, Tobias; Schulze, Maik; Friederici, Anke; Theisel, Holger

2016-01-01

Volcanic eruptions are not only hazardous in the direct vicinity of a volcano, but they also affect the climate and air travel for great distances. This article sheds light on the Grímsvötn, Puyehue-Cordón Caulle, and Nabro eruptions in 2011. The authors study the agreement of the complementary satellite data, reconstruct sulfate aerosol and volcanic ash clouds, visualize endangered flight routes, minimize occlusion in particle trajectory visualizations, and focus on the main pathways of Nabro's sulfate aerosol into the stratosphere. The results here were developed for the 2014 IEEE Scientific Visualization Contest, which centers around the fusion of multiple satellite data modalities to reconstruct and assess the movement of volcanic ash and sulfate aerosol emissions. Using data from three volcanic eruptions that occurred in the span of approximately three weeks, the authors study the agreement of the complementary satellite data, reconstruct sulfate aerosol and volcanic ash clouds, visualize endangered flight routes, minimize occlusion in particle trajectory visualizations, and focus on the main pathways of sulfate aerosol into the stratosphere. This video provides animations of the reconstructed ash clouds. https://youtu.be/D9DvJ5AvZAs.

Muon tomography imaging algorithms for nuclear threat detection inside large volume containers with the Muon Portal detector

NASA Astrophysics Data System (ADS)

Riggi, S.; Antonuccio-Delogu, V.; Bandieramonte, M.; Becciani, U.; Costa, A.; La Rocca, P.; Massimino, P.; Petta, C.; Pistagna, C.; Riggi, F.; Sciacca, E.; Vitello, F.

2013-11-01

Muon tomographic visualization techniques try to reconstruct a 3D image as close as possible to the real localization of the objects being probed. Statistical algorithms under test for the reconstruction of muon tomographic images in the Muon Portal Project are discussed here. Autocorrelation analysis and clustering algorithms have been employed within the context of methods based on the Point Of Closest Approach (POCA) reconstruction tool. An iterative method based on the log-likelihood approach was also implemented. Relative merits of all such methods are discussed, with reference to full GEANT4 simulations of different scenarios, incorporating medium and high-Z objects inside a container.

Can the Diagnostics of Triangular Fibrocartilage Complex Lesions Be Improved by MRI-Based Soft-Tissue Reconstruction? An Imaging-Based Workup and Case Presentation.

PubMed

Hammer, Niels; Hirschfeld, Ulrich; Strunz, Hendrik; Werner, Michael; Wolfskämpf, Thomas; Löffler, Sabine

2017-01-01

Introduction . The triangular fibrocartilage complex (TFCC) provides both mobility and stability of the radiocarpal joint. TFCC lesions are difficult to diagnose due to the complex anatomy. The standard treatment for TFCC lesions is arthroscopy, posing surgery-related risks onto the patients. This feasibility study aimed at developing a workup for soft-tissue reconstruction using clinical imaging, to verify these results in retrospective patient data. Methods . Microcomputed tomography ( μ -CT), 3 T magnetic resonance imaging (MRI), and plastination were used to visualize the TFCC in cadaveric specimens applying segmentation-based 3D reconstruction. This approach further trialed the MRI dataset of a patient with minor radiological TFCC alterations but persistent pain. Results . TFCC reconstruction was impossible using μ -CT only but feasible using MRI, resulting in an appreciation of its substructures, as seen in the plastinates. Applying this approach allowed for visualizing a Palmer 2C lesion in a patient, confirming ex postum the arthroscopy findings, being markedly different from MRI (Palmer 1B). Discussion . This preliminary study showed that image-based TFCC reconstruction may help to identify pathologies invisible in standard MRI. The combined approach of μ -CT, MRI, and plastination allowed for a three-dimensional appreciation of the TFCC. Image quality and time expenditure limit the approach's usefulness as a diagnostic tool.

Can the Diagnostics of Triangular Fibrocartilage Complex Lesions Be Improved by MRI-Based Soft-Tissue Reconstruction? An Imaging-Based Workup and Case Presentation

PubMed Central

Hirschfeld, Ulrich; Strunz, Hendrik; Werner, Michael; Wolfskämpf, Thomas; Löffler, Sabine

2017-01-01

Introduction. The triangular fibrocartilage complex (TFCC) provides both mobility and stability of the radiocarpal joint. TFCC lesions are difficult to diagnose due to the complex anatomy. The standard treatment for TFCC lesions is arthroscopy, posing surgery-related risks onto the patients. This feasibility study aimed at developing a workup for soft-tissue reconstruction using clinical imaging, to verify these results in retrospective patient data. Methods. Microcomputed tomography (μ-CT), 3 T magnetic resonance imaging (MRI), and plastination were used to visualize the TFCC in cadaveric specimens applying segmentation-based 3D reconstruction. This approach further trialed the MRI dataset of a patient with minor radiological TFCC alterations but persistent pain. Results. TFCC reconstruction was impossible using μ-CT only but feasible using MRI, resulting in an appreciation of its substructures, as seen in the plastinates. Applying this approach allowed for visualizing a Palmer 2C lesion in a patient, confirming ex postum the arthroscopy findings, being markedly different from MRI (Palmer 1B). Discussion. This preliminary study showed that image-based TFCC reconstruction may help to identify pathologies invisible in standard MRI. The combined approach of μ-CT, MRI, and plastination allowed for a three-dimensional appreciation of the TFCC. Image quality and time expenditure limit the approach's usefulness as a diagnostic tool. PMID:28246600

Rhodobase, a meta-analytical tool for reconstructing gene regulatory networks in a model photosynthetic bacterium.

PubMed

Moskvin, Oleg V; Bolotin, Dmitry; Wang, Andrew; Ivanov, Pavel S; Gomelsky, Mark

2011-02-01

We present Rhodobase, a web-based meta-analytical tool for analysis of transcriptional regulation in a model anoxygenic photosynthetic bacterium, Rhodobacter sphaeroides. The gene association meta-analysis is based on the pooled data from 100 of R. sphaeroides whole-genome DNA microarrays. Gene-centric regulatory networks were visualized using the StarNet approach (Jupiter, D.C., VanBuren, V., 2008. A visual data mining tool that facilitates reconstruction of transcription regulatory networks. PLoS ONE 3, e1717) with several modifications. We developed a means to identify and visualize operons and superoperons. We designed a framework for the cross-genome search for transcription factor binding sites that takes into account high GC-content and oligonucleotide usage profile characteristic of the R. sphaeroides genome. To facilitate reconstruction of directional relationships between co-regulated genes, we screened upstream sequences (-400 to +20bp from start codons) of all genes for putative binding sites of bacterial transcription factors using a self-optimizing search method developed here. To test performance of the meta-analysis tools and transcription factor site predictions, we reconstructed selected nodes of the R. sphaeroides transcription factor-centric regulatory matrix. The test revealed regulatory relationships that correlate well with the experimentally derived data. The database of transcriptional profile correlations, the network visualization engine and the optimized search engine for transcription factor binding sites analysis are available at http://rhodobase.org. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Three-Dimensional Printing: Basic Principles and Applications in Medicine and Radiology.

PubMed

Kim, Guk Bae; Lee, Sangwook; Kim, Haekang; Yang, Dong Hyun; Kim, Young-Hak; Kyung, Yoon Soo; Kim, Choung-Soo; Choi, Se Hoon; Kim, Bum Joon; Ha, Hojin; Kwon, Sun U; Kim, Namkug

2016-01-01

The advent of three-dimensional printing (3DP) technology has enabled the creation of a tangible and complex 3D object that goes beyond a simple 3D-shaded visualization on a flat monitor. Since the early 2000s, 3DP machines have been used only in hard tissue applications. Recently developed multi-materials for 3DP have been used extensively for a variety of medical applications, such as personalized surgical planning and guidance, customized implants, biomedical research, and preclinical education. In this review article, we discuss the 3D reconstruction process, touching on medical imaging, and various 3DP systems applicable to medicine. In addition, the 3DP medical applications using multi-materials are introduced, as well as our recent results.

Three-dimensional magnetic resonance imaging based on time-of-flight magnetic resonance angiography for superficial cerebral arteriovenous malformation--technical note.

PubMed

Murata, Takahiro; Horiuchi, Tetsuyoshi; Rahmah, Nunung Nur; Sakai, Keiichi; Hongo, Kazuhiro

2011-01-01

Direct surgery remains important for the treatment of superficial cerebral arteriovenous malformation (AVM). Surgical planning on the basis of careful analysis from various neuroimaging modalities can aid in resection of superficial AVM with favorable outcome. Three-dimensional (3D) magnetic resonance (MR) imaging reconstructed from time-of-flight (TOF) MR angiography was developed as an adjunctive tool for surgical planning of superficial AVM. 3-T TOF MR imaging without contrast medium was performed preoperatively in patients with superficial AVM. The images were imported into OsiriX imaging software and the 3D reconstructed MR image was produced using the volume rendering method. This 3D MR image could clearly visualize the surface angioarchitecture of the AVM with the surrounding brain on a single image, and clarified feeding arteries including draining veins and the relationship with sulci or fissures surrounding the nidus. 3D MR image of the whole AVM angioarchitecture was also displayed by skeletonization of the surrounding brain. Preoperative 3D MR image corresponded to the intraoperative view. Feeders on the brain surface were easily confirmed and obliterated during surgery, with the aid of the 3D MR images. 3D MR imaging for surgical planning of superficial AVM is simple and noninvasive to perform, enhances intraoperative orientation, and is helpful for successful resection.

3D Segmentation with an application of level set-method using MRI volumes for image guided surgery.

PubMed

Bosnjak, A; Montilla, G; Villegas, R; Jara, I

2007-01-01

This paper proposes an innovation in the application for image guided surgery using a comparative study of three different method of segmentation. This segmentation method is faster than the manual segmentation of images, with the advantage that it allows to use the same patient as anatomical reference, which has more precision than a generic atlas. This new methodology for 3D information extraction is based on a processing chain structured of the following modules: 1) 3D Filtering: the purpose is to preserve the contours of the structures and to smooth the homogeneous areas; several filters were tested and finally an anisotropic diffusion filter was used. 2) 3D Segmentation. This module compares three different methods: Region growing Algorithm, Cubic spline hand assisted, and Level Set Method. It then proposes a Level Set-based on the front propagation method that allows the making of the reconstruction of the internal walls of the anatomical structures of the brain. 3) 3D visualization. The new contribution of this work consists on the visualization of the segmented model and its use in the pre-surgery planning.

Visualization of 3D elbow kinematics using reconstructed bony surfaces

NASA Astrophysics Data System (ADS)

Lalone, Emily A.; McDonald, Colin P.; Ferreira, Louis M.; Peters, Terry M.; King, Graham J. W.; Johnson, James A.

2010-02-01

An approach for direct visualization of continuous three-dimensional elbow kinematics using reconstructed surfaces has been developed. Simulation of valgus motion was achieved in five cadaveric specimens using an upper arm simulator. Direct visualization of the motion of the ulna and humerus at the ulnohumeral joint was obtained using a contact based registration technique. Employing fiducial markers, the rendered humerus and ulna were positioned according to the simulated motion. The specific aim of this study was to investigate the effect of radial head arthroplasty on restoring elbow joint stability after radial head excision. The position of the ulna and humerus was visualized for the intact elbow and following radial head excision and replacement. Visualization of the registered humerus/ulna indicated an increase in valgus angulation of the ulna with respect to the humerus after radial head excision. This increase in valgus angulation was restored to that of an elbow with a native radial head following radial head arthroplasty. These findings were consistent with previous studies investigating elbow joint stability following radial head excision and arthroplasty. The current technique was able to visualize a change in ulnar position in a single DoF. Using this approach, the coupled motion of ulna undergoing motion in all 6 degrees-of-freedom can also be visualized.

The reconstruction algorithm used for [68Ga]PSMA-HBED-CC PET/CT reconstruction significantly influences the number of detected lymph node metastases and coeliac ganglia.

PubMed

Krohn, Thomas; Birmes, Anita; Winz, Oliver H; Drude, Natascha I; Mottaghy, Felix M; Behrendt, Florian F; Verburg, Frederik A

2017-04-01

To investigate whether the numbers of lymph node metastases and coeliac ganglia delineated on [ 68 Ga]PSMA-HBED-CC PET/CT scans differ among datasets generated using different reconstruction algorithms. Data were constructed using the BLOB-OS-TF, BLOB-OS and 3D-RAMLA algorithms. All reconstructions were assessed by two nuclear medicine physicians for the number of pelvic/paraaortal lymph node metastases as well the number of coeliac ganglia. Standardized uptake values (SUV) were also calculated in different regions. At least one [ 68 Ga]PSMA-HBED-CC PET/CT-positive pelvic or paraaortal lymph node metastasis was found in 49 and 35 patients using the BLOB-OS-TF algorithm, in 42 and 33 patients using the BLOB-OS algorithm, and in 41 and 31 patients using the 3D-RAMLA algorithm, respectively, and a positive ganglion was found in 92, 59 and 24 of 100 patients using the three algorithms, respectively. Quantitatively, the SUVmean and SUVmax were significantly higher with the BLOB-OS algorithm than with either the BLOB-OS-TF or the 3D-RAMLA algorithm in all measured regions (p < 0.001 for all comparisons). The differences between the SUVs with the BLOB-OS-TF- and 3D-RAMLA algorithms were not significant in the aorta (SUVmean, p = 0.93; SUVmax, p = 0.97) but were significant in all other regions (p < 0.001 in all cases). The SUVmean ganglion/gluteus ratio was significantly higher with the BLOB-OS-TF algorithm than with either the BLOB-OS or the 3D-RAMLA algorithm and was significantly higher with the BLOB-OS than with the 3D-RAMLA algorithm (p < 0.001 in all cases). The results of [ 68 Ga]PSMA-HBED-CC PET/CT are affected by the reconstruction algorithm used. The highest number of lesions and physiological structures will be visualized using a modern algorithm employing time-of-flight information.

Uncalibrated stereo rectification and disparity range stabilization: a comparison of different feature detectors

NASA Astrophysics Data System (ADS)

Luo, Xiongbiao; Jayarathne, Uditha L.; McLeod, A. Jonathan; Pautler, Stephen E.; Schlacta, Christopher M.; Peters, Terry M.

2016-03-01

This paper studies uncalibrated stereo rectification and stable disparity range determination for surgical scene three-dimensional (3-D) reconstruction. Stereoscopic endoscope calibration sometimes is not available and also increases the complexity of the operating-room environment. Stereo from uncalibrated endoscopic cameras is an alternative to reconstruct the surgical field visualized by binocular endoscopes within the body. Uncalibrated rectification is usually performed on the basis of a number of matched feature points (semi-dense correspondence) between the left and the right images of stereo pairs. After uncalibrated rectification, the corresponding feature points can be used to determine the proper disparity range that helps to improve the reconstruction accuracy and reduce the computational time of disparity map estimation. Therefore, the corresponding or matching accuracy and robustness of feature point descriptors is important to surgical field 3-D reconstruction. This work compares four feature detectors: (1) scale invariant feature transform (SIFT), (2) speeded up robust features (SURF), (3) affine scale invariant feature transform (ASIFT), and (4) gauge speeded up robust features (GSURF) with applications to uncalibrated rectification and stable disparity range determination. We performed our experiments on surgical endoscopic video images that were collected during robotic prostatectomy. The experimental results demonstrate that ASIFT outperforms other feature detectors in the uncalibrated stereo rectification and also provides a stable stable disparity range for surgical scene reconstruction.

Joint Simultaneous Reconstruction of Regularized Building Superstructures from Low-Density LIDAR Data Using Icp

NASA Astrophysics Data System (ADS)

Wichmann, Andreas; Kada, Martin

2016-06-01

There are many applications for 3D city models, e.g., in visualizations, analysis, and simulations; each one requiring a certain level of detail to be effective. The overall trend goes towards including various kinds of anthropogenic and natural objects therein with ever increasing geometric and semantic details. A few years back, the featured 3D building models had only coarse roof geometry. But nowadays, they are expected to include detailed roof superstructures like dormers and chimneys. Several methods have been proposed for the automatic reconstruction of 3D building models from airborne based point clouds. However, they are usually unable to reliably recognize and reconstruct small roof superstructures as these objects are often represented by only few point measurements, especially in low-density point clouds. In this paper, we propose a recognition and reconstruction approach that overcomes this problem by identifying and simultaneously reconstructing regularized superstructures of similar shape. For this purpose, candidate areas for superstructures are detected by taking into account virtual sub-surface points that are assumed to lie on the main roof faces below the measured points. The areas with similar superstructures are detected, extracted, grouped together, and registered to one another with the Iterative Closest Point (ICP) algorithm. As an outcome, the joint point density of each detected group is increased, which helps to recognize the shape of the superstructure more reliably and in more detail. Finally, all instances of each group of superstructures are modeled at once and transformed back to their original position. Because superstructures are reconstructed in groups, symmetries, alignments, and regularities can be enforced in a straight-forward way. The validity of the approach is presented on a number of example buildings from the Vaihingen test data set.

a Line-Based 3d Roof Model Reconstruction Algorithm: Tin-Merging and Reshaping (tmr)

NASA Astrophysics Data System (ADS)

Rau, J.-Y.

2012-07-01

Three-dimensional building model is one of the major components of a cyber-city and is vital for the realization of 3D GIS applications. In the last decade, the airborne laser scanning (ALS) data is widely used for 3D building model reconstruction and object extraction. Instead, based on 3D roof structural lines, this paper presents a novel algorithm for automatic roof models reconstruction. A line-based roof model reconstruction algorithm, called TIN-Merging and Reshaping (TMR), is proposed. The roof structural line, such as edges, eaves and ridges, can be measured manually from aerial stereo-pair, derived by feature line matching or inferred from ALS data. The originality of the TMR algorithm for 3D roof modelling is to perform geometric analysis and topology reconstruction among those unstructured lines and then reshapes the roof-type using elevation information from the 3D structural lines. For topology reconstruction, a line constrained Delaunay Triangulation algorithm is adopted where the input structural lines act as constraint and their vertex act as input points. Thus, the constructed TINs will not across the structural lines. Later at the stage of Merging, the shared edge between two TINs will be check if the original structural line exists. If not, those two TINs will be merged into a polygon. Iterative checking and merging of any two neighboured TINs/Polygons will result in roof polygons on the horizontal plane. Finally, at the Reshaping stage any two structural lines with fixed height will be used to adjust a planar function for the whole roof polygon. In case ALS data exist, the Reshaping stage can be simplified by adjusting the point cloud within the roof polygon. The proposed scheme reduces the complexity of 3D roof modelling and makes the modelling process easier. Five test datasets provided by ISPRS WG III/4 located at downtown Toronto, Canada and Vaihingen, Germany are used for experiment. The test sites cover high rise buildings and residential area with diverse roof type. For performance evaluation, the adopted roof structural lines are manually measured from the provided stereo-pair. Experimental results indicate a nearly 100% success rate for topology reconstruction was achieved provided that the 3D structural lines can be enclosed as polygons. On the other hand, the success rate at the Reshaping stage is dependent on the complexity of the rooftop structure. Thus, a visual inspection and semi-automatic adjustment of roof-type is suggested and implemented to complete the roof modelling. The results demonstrate that the proposed scheme is robust and reliable with a high degree of completeness, correctness, and quality, even when a group of connected buildings with multiple layers and mixed roof types is processed.

SF3M software: 3-D photo-reconstruction for non-expert users and its application to a gully network

NASA Astrophysics Data System (ADS)

Castillo, C.; James, M. R.; Redel-Macías, M. D.; Pérez, R.; Gómez, J. A.

2015-08-01

Three-dimensional photo-reconstruction (PR) techniques have been successfully used to produce high-resolution surface models for different applications and over different spatial scales. However, innovative approaches are required to overcome some limitations that this technique may present for field image acquisition in challenging scene geometries. Here, we evaluate SF3M, a new graphical user interface for implementing a complete PR workflow based on freely available software (including external calls to VisualSFM and CloudCompare), in combination with a low-cost survey design for the reconstruction of a several-hundred-metres-long gully network. SF3M provided a semi-automated workflow for 3-D reconstruction requiring ~ 49 h (of which only 17 % required operator assistance) for obtaining a final gully network model of > 17 million points over a gully plan area of 4230 m2. We show that a walking itinerary along the gully perimeter using two lightweight automatic cameras (1 s time-lapse mode) and a 6 m long pole is an efficient method for 3-D monitoring of gullies, at a low cost (~ EUR 1000 budget for the field equipment) and the time requirements (~ 90 min for image collection). A mean error of 6.9 cm at the ground control points was found, mainly due to model deformations derived from the linear geometry of the gully and residual errors in camera calibration. The straightforward image collection and processing approach can be of great benefit for non-expert users working on gully erosion assessment.

3D cardiac wall thickening assessment for acute myocardial infarction

NASA Astrophysics Data System (ADS)

Khalid, A.; Chan, B. T.; Lim, E.; Liew, Y. M.

2017-06-01

Acute myocardial infarction (AMI) is the most severe form of coronary artery disease leading to localized myocardial injury and therefore irregularities in the cardiac wall contractility. Studies have found very limited differences in global indices (such as ejection fraction, myocardial mass and volume) between healthy subjects and AMI patients, and therefore suggested regional assessment. Regional index, specifically cardiac wall thickness (WT) and thickening is closely related to cardiac function and could reveal regional abnormality due to AMI. In this study, we developed a 3D wall thickening assessment method to identify regional wall contractility dysfunction due to localized myocardial injury from infarction. Wall thickness and thickening were assessed from 3D personalized cardiac models reconstructed from cine MRI images by fitting inscribed sphere between endocardial and epicardial wall. The thickening analysis was performed in 5 patients and 3 healthy subjects and the results were compared against the gold standard 2D late-gadolinium-enhanced (LGE) images for infarct localization. The notable finding of this study is the highly accurate estimation and visual representation of the infarct size and location in 3D. This study provides clinicians with an intuitive way to visually and qualitatively assess regional cardiac wall dysfunction due to infarction in AMI patients.

Toward 2D and 3D imaging of magnetic nanoparticles using EPR measurements.

PubMed

Coene, A; Crevecoeur, G; Leliaert, J; Dupré, L

2015-09-01

Magnetic nanoparticles (MNPs) are an important asset in many biomedical applications. An effective working of these applications requires an accurate knowledge of the spatial MNP distribution. A promising, noninvasive, and sensitive technique to visualize MNP distributions in vivo is electron paramagnetic resonance (EPR). Currently only 1D MNP distributions can be reconstructed. In this paper, the authors propose extending 1D EPR toward 2D and 3D using computer simulations to allow accurate imaging of MNP distributions. To find the MNP distribution belonging to EPR measurements, an inverse problem needs to be solved. The solution of this inverse problem highly depends on the stability of the inverse problem. The authors adapt 1D EPR imaging to realize the imaging of multidimensional MNP distributions. Furthermore, the authors introduce partial volume excitation in which only parts of the volume are imaged to increase stability of the inverse solution and to speed up the measurements. The authors simulate EPR measurements of different 2D and 3D MNP distributions and solve the inverse problem. The stability is evaluated by calculating the condition measure and by comparing the actual MNP distribution to the reconstructed MNP distribution. Based on these simulations, the authors define requirements for the EPR system to cope with the added dimensions. Moreover, the authors investigate how EPR measurements should be conducted to improve the stability of the associated inverse problem and to increase reconstruction quality. The approach used in 1D EPR can only be employed for the reconstruction of small volumes in 2D and 3D EPRs due to numerical instability of the inverse solution. The authors performed EPR measurements of increasing cylindrical volumes and evaluated the condition measure. This showed that a reduction of the inherent symmetry in the EPR methodology is necessary. By reducing the symmetry of the EPR setup, quantitative images of larger volumes can be obtained. The authors found that, by selectively exciting parts of the volume, the authors could increase the reconstruction quality even further while reducing the amount of measurements. Additionally, the inverse solution of this activation method degrades slower for increasing volumes. Finally, the methodology was applied to noisy EPR measurements: using the reduced EPR setup's symmetry and the partial activation method, an increase in reconstruction quality of ≈ 80% can be seen with a speedup of the measurements with 10%. Applying the aforementioned requirements to the EPR setup and stabilizing the EPR measurements showed a tremendous increase in noise robustness, thereby making EPR a valuable method for quantitative imaging of multidimensional MNP distributions.

Left ventricular endocardial surface detection based on real-time 3D echocardiographic data

NASA Technical Reports Server (NTRS)

Corsi, C.; Borsari, M.; Consegnati, F.; Sarti, A.; Lamberti, C.; Travaglini, A.; Shiota, T.; Thomas, J. D.

2001-01-01

OBJECTIVE: A new computerized semi-automatic method for left ventricular (LV) chamber segmentation is presented. METHODS: The LV is imaged by real-time three-dimensional echocardiography (RT3DE). The surface detection model, based on level set techniques, is applied to RT3DE data for image analysis. The modified level set partial differential equation we use is solved by applying numerical methods for conservation laws. The initial conditions are manually established on some slices of the entire volume. The solution obtained for each slice is a contour line corresponding with the boundary between LV cavity and LV endocardium. RESULTS: The mathematical model has been applied to sequences of frames of human hearts (volume range: 34-109 ml) imaged by 2D and reconstructed off-line and RT3DE data. Volume estimation obtained by this new semi-automatic method shows an excellent correlation with those obtained by manual tracing (r = 0.992). Dynamic change of LV volume during the cardiac cycle is also obtained. CONCLUSION: The volume estimation method is accurate; edge based segmentation, image completion and volume reconstruction can be accomplished. The visualization technique also allows to navigate into the reconstructed volume and to display any section of the volume.

Reconstructing 3D coastal cliffs from airborne oblique photographs without ground control points

NASA Astrophysics Data System (ADS)

Dewez, T. J. B.

2014-05-01

Coastal cliff collapse hazard assessment requires measuring cliff face topography at regular intervals. Terrestrial laser scanner techniques have proven useful so far but are expensive to use either through purchasing the equipment or through survey subcontracting. In addition, terrestrial laser surveys take time which is sometimes incompatible with the time during with the beach is accessible at low-tide. By comparison, structure from motion techniques (SFM) are much less costly to implement, and if airborne, acquisition of several kilometers of coastline can be done in a matter of minutes. In this paper, the potential of GPS-tagged oblique airborne photographs and SFM techniques is examined to reconstruct chalk cliff dense 3D point clouds without Ground Control Points (GCP). The focus is put on comparing the relative 3D point of views reconstructed by Visual SFM with their synchronous Solmeta Geotagger Pro2 GPS locations using robust estimators. With a set of 568 oblique photos, shot from the open door of an airplane with a triplet of synchronized Nikon D7000, GPS and SFM-determined view point coordinates converge to X: ±31.5 m; Y: ±39.7 m; Z: ±13.0 m (LE66). Uncertainty in GPS position affects the model scale, angular attitude of the reference frame (the shoreline ends up tilted by 2°) and absolute positioning. Ground Control Points cannot be avoided to orient such models.

3D modeling of building indoor spaces and closed doors from imagery and point clouds.

PubMed

Díaz-Vilariño, Lucía; Khoshelham, Kourosh; Martínez-Sánchez, Joaquín; Arias, Pedro

2015-02-03

3D models of indoor environments are increasingly gaining importance due to the wide range of applications to which they can be subjected: from redesign and visualization to monitoring and simulation. These models usually exist only for newly constructed buildings; therefore, the development of automatic approaches for reconstructing 3D indoors from imagery and/or point clouds can make the process easier, faster and cheaper. Among the constructive elements defining a building interior, doors are very common elements and their detection can be very useful either for knowing the environment structure, to perform an efficient navigation or to plan appropriate evacuation routes. The fact that doors are topologically connected to walls by being coplanar, together with the unavoidable presence of clutter and occlusions indoors, increases the inherent complexity of the automation of the recognition process. In this work, we present a pipeline of techniques used for the reconstruction and interpretation of building interiors based on point clouds and images. The methodology analyses the visibility problem of indoor environments and goes in depth with door candidate detection. The presented approach is tested in real data sets showing its potential with a high door detection rate and applicability for robust and efficient envelope reconstruction.

Applying a 2D based CAD scheme for detecting micro-calcification clusters using digital breast tomosynthesis images: an assessment

NASA Astrophysics Data System (ADS)

Park, Sang Cheol; Zheng, Bin; Wang, Xiao-Hui; Gur, David

2008-03-01

Digital breast tomosynthesis (DBT) has emerged as a promising imaging modality for screening mammography. However, visually detecting micro-calcification clusters depicted on DBT images is a difficult task. Computer-aided detection (CAD) schemes for detecting micro-calcification clusters depicted on mammograms can achieve high performance and the use of CAD results can assist radiologists in detecting subtle micro-calcification clusters. In this study, we compared the performance of an available 2D based CAD scheme with one that includes a new grouping and scoring method when applied to both projection and reconstructed DBT images. We selected a dataset involving 96 DBT examinations acquired on 45 women. Each DBT image set included 11 low dose projection images and a varying number of reconstructed image slices ranging from 18 to 87. In this dataset 20 true-positive micro-calcification clusters were visually detected on the projection images and 40 were visually detected on the reconstructed images, respectively. We first applied the CAD scheme that was previously developed in our laboratory to the DBT dataset. We then tested a new grouping method that defines an independent cluster by grouping the same cluster detected on different projection or reconstructed images. We then compared four scoring methods to assess the CAD performance. The maximum sensitivity level observed for the different grouping and scoring methods were 70% and 88% for the projection and reconstructed images with a maximum false-positive rate of 4.0 and 15.9 per examination, respectively. This preliminary study demonstrates that (1) among the maximum, the minimum or the average CAD generated scores, using the maximum score of the grouped cluster regions achieved the highest performance level, (2) the histogram based scoring method is reasonably effective in reducing false-positive detections on the projection images but the overall CAD sensitivity is lower due to lower signal-to-noise ratio, and (3) CAD achieved higher sensitivity and higher false-positive rate (per examination) on the reconstructed images. We concluded that without changing the detection threshold or performing pre-filtering to possibly increase detection sensitivity, current CAD schemes developed and optimized for 2D mammograms perform relatively poorly and need to be re-optimized using DBT datasets and new grouping and scoring methods need to be incorporated into the schemes if these are to be used on the DBT examinations.

3-D components of a biological neural network visualized in computer generated imagery. I - Macular receptive field organization

NASA Technical Reports Server (NTRS)

Ross, Muriel D.; Cutler, Lynn; Meyer, Glenn; Lam, Tony; Vaziri, Parshaw

1990-01-01

Computer-assisted, 3-dimensional reconstructions of macular receptive fields and of their linkages into a neural network have revealed new information about macular functional organization. Both type I and type II hair cells are included in the receptive fields. The fields are rounded, oblong, or elongated, but gradations between categories are common. Cell polarizations are divergent. Morphologically, each calyx of oblong and elongated fields appears to be an information processing site. Intrinsic modulation of information processing is extensive and varies with the kind of field. Each reconstructed field differs in detail from every other, suggesting that an element of randomness is introduced developmentally and contributes to endorgan adaptability.

Using optically scanned 3D data in the restoration of Michelangelo's David

NASA Astrophysics Data System (ADS)

Scopigno, Roberto; Cignoni, Paolo; Callieri, Marco; Ganovelli, Fabio; Impoco, G.; Pingi, P.; Ponchio, F.

2003-10-01

Modern 3D scanning technologies allow to reconstruct 3D digital representations of Cultural Heritage artifacts in a semi-automatic way, characterized by very high accuracy and wealth of details. The availability of an accurate digital representation opens several possibilities of utilization to experts (restorers, archivists, museum curators), or to ordinary people (students, museum visitors). 3D scanned data are commonly used for the production of animations, interactive visualizations, or virtual reality applications. A much more exciting opportunity is to use these data in the restoration of Cultural Heritage artworks. The integration between 3D graphic and restoration represents an open research field where many new supporting tools are required; the David restoration project has given several starting points and guidelines to the definition and development of innovative solutions. Digital 3D models can be used in two different but not subsidiary modes: as an instrument for the execution of specific investigations and as a supporting media for the archival and integration of all the restoration-related information, gathered with the different studies and analysis performed on the artwork. In this paper we present some recent work done in the framework of the Michelangelo's David restoration project. A 3D model of the David was reconstructed by the Digital Michelangelo Project, using laser-based 3D scanning technology. We have developed some tools to make those data accessible and useful in the restoration. Preliminary results are reported here together with some directions for further research.

High brightness, low coherence, digital holographic microscopy for 3D visualization of an in-vitro sandwiched biological sample.

PubMed

Abdelsalam, D G; Yasui, Takeshi

2017-05-01

We achieve practically a bright-field digital holographic microscopy (DHM) configuration free from coherent noise for three-dimensional (3D) visualization of an in-vitro sandwiched sarcomere sample. Visualization of such sandwiched samples by conventional atomic force microscope (AFM) is impossible, while visualization using DHM with long coherent lengths is challenging. The proposed configuration is comprised of an ultrashort pulse laser source and a Mach-Zehnder interferometer in transmission. Periodically poled lithium niobate (PPLN) crystal was used to convert the fundamental beam by second harmonic generation (SHG) to the generated beam fit to the CCD camera used. The experimental results show that the contrast of the reconstructed phase image is improved to a higher degree compared to a He-Ne laser based result. We attribute this improvement to two things: the feature of the femtosecond pulse light, which acts as a chopper for coherent noise suppression, and the fact that the variance of a coherent mode can be reduced by a factor of 9 due to low loss through a nonlinear medium.

3D visualization of two-phase flow in the micro-tube by a simple but effective method

NASA Astrophysics Data System (ADS)

Fu, X.; Zhang, P.; Hu, H.; Huang, C. J.; Huang, Y.; Wang, R. Z.

2009-08-01

The present study provides a simple but effective method for 3D visualization of the two-phase flow in the micro-tube. An isosceles right-angle prism combined with a mirror located 45° bevel to the prism is employed to synchronously obtain the front and side views of the flow patterns with a single camera, where the locations of the prism and the micro-tube for clear imaging should satisfy a fixed relationship which is specified in the present study. The optical design is proven successfully by the tough visualization work at the cryogenic temperature range. The image deformation due to the refraction and geometrical configuration of the test section is quantitatively investigated. It is calculated that the image is enlarged by about 20% in inner diameter compared to the real object, which is validated by the experimental results. Meanwhile, the image deformation by adding a rectangular optical correction box outside the circular tube is comparatively investigated. It is calculated that the image is reduced by about 20% in inner diameter with a rectangular optical correction box compared to the real object. The 3D re-construction process based on the two views is conducted through three steps, which shows that the 3D visualization method can easily be applied for two-phase flow research in micro-scale channels and improves the measurement accuracy of some important parameters of the two-phase flow such as void fraction, spatial distribution of bubbles, etc.

Nanoscale Analysis of a Hierarchical Hybrid Solar Cell in 3D.

PubMed

Divitini, Giorgio; Stenzel, Ole; Ghadirzadeh, Ali; Guarnera, Simone; Russo, Valeria; Casari, Carlo S; Bassi, Andrea Li; Petrozza, Annamaria; Di Fonzo, Fabio; Schmidt, Volker; Ducati, Caterina

2014-05-01

A quantitative method for the characterization of nanoscale 3D morphology is applied to the investigation of a hybrid solar cell based on a novel hierarchical nanostructured photoanode. A cross section of the solar cell device is prepared by focused ion beam milling in a micropillar geometry, which allows a detailed 3D reconstruction of the titania photoanode by electron tomography. It is found that the hierarchical titania nanostructure facilitates polymer infiltration, thus favoring intermixing of the two semiconducting phases, essential for charge separation. The 3D nanoparticle network is analyzed with tools from stochastic geometry to extract information related to the charge transport in the hierarchical solar cell. In particular, the experimental dataset allows direct visualization of the percolation pathways that contribute to the photocurrent.

Nanoscale Analysis of a Hierarchical Hybrid Solar Cell in 3D

PubMed Central

Divitini, Giorgio; Stenzel, Ole; Ghadirzadeh, Ali; Guarnera, Simone; Russo, Valeria; Casari, Carlo S; Bassi, Andrea Li; Petrozza, Annamaria; Di Fonzo, Fabio; Schmidt, Volker; Ducati, Caterina

2014-01-01

A quantitative method for the characterization of nanoscale 3D morphology is applied to the investigation of a hybrid solar cell based on a novel hierarchical nanostructured photoanode. A cross section of the solar cell device is prepared by focused ion beam milling in a micropillar geometry, which allows a detailed 3D reconstruction of the titania photoanode by electron tomography. It is found that the hierarchical titania nanostructure facilitates polymer infiltration, thus favoring intermixing of the two semiconducting phases, essential for charge separation. The 3D nanoparticle network is analyzed with tools from stochastic geometry to extract information related to the charge transport in the hierarchical solar cell. In particular, the experimental dataset allows direct visualization of the percolation pathways that contribute to the photocurrent. PMID:25834481

Preliminary study of visual effect of multiplex hologram

NASA Astrophysics Data System (ADS)

Fu, Huaiping; Xiong, Bingheng; Yang, Hong; Zhang, Xueguo

2004-06-01

The process of any movement of real object can be recorded and displayed by a multiplex holographic stereogram. An embossing multiplex holographic stereogram and a multiplex rainbow holographic stereogram have been made by us, the multiplex rainbow holographic stereogram reconstructs the dynamic 2D line drawing of speech organs, the embossing multiplex holographic stereogram reconstructs the process of an old man drinking water. In this paper, we studied the visual result of an embossing multiplex holographic stereogram made with 80 films of 2-D pictures. Forty-eight persons of aged from 13 to 67 were asked to see the hologram and then to answer some questions about the feeling of viewing. The results indicate that this kind of holograms could be accepted by human visual sense organ without any problem. This paper also discusses visual effect of the multiplex holography stereograms base on visual perceptual psychology. It is open out that the planar multiplex holograms can be recorded and present the movement of real animal and object. Not only have the human visual perceptual constancy for shape, just as that size, color, etc... but also have visual perceptual constancy for binocular parallax.

MO-DE-207A-08: Four-Dimensional Cone-Beam CT Iterative Reconstruction with Time-Ordered Chain Graph Model for Non-Periodic Organ Motion and Deformation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nakano, M; Haga, A; Hanaoka, S

2016-06-15

Purpose: The purpose of this study is to propose a new concept of four-dimensional (4D) cone-beam CT (CBCT) reconstruction for non-periodic organ motion using the Time-ordered Chain Graph Model (TCGM), and to compare the reconstructed results with the previously proposed methods, the total variation-based compressed sensing (TVCS) and prior-image constrained compressed sensing (PICCS). Methods: CBCT reconstruction method introduced in this study consisted of maximum a posteriori (MAP) iterative reconstruction combined with a regularization term derived from a concept of TCGM, which includes a constraint coming from the images of neighbouring time-phases. The time-ordered image series were concurrently reconstructed in themore » MAP iterative reconstruction framework. Angular range of projections for each time-phase was 90 degrees for TCGM and PICCS, and 200 degrees for TVCS. Two kinds of projection data, an elliptic-cylindrical digital phantom data and two clinical patients’ data, were used for reconstruction. The digital phantom contained an air sphere moving 3 cm along longitudinal axis, and temporal resolution of each method was evaluated by measuring the penumbral width of reconstructed moving air sphere. The clinical feasibility of non-periodic time-ordered 4D CBCT reconstruction was also examined using projection data of prostate cancer patients. Results: The results of reconstructed digital phantom shows that the penumbral widths of TCGM yielded the narrowest result; PICCS and TCGM were 10.6% and 17.4% narrower than that of TVCS, respectively. This suggests that the TCGM has the better temporal resolution than the others. Patients’ CBCT projection data were also reconstructed and all three reconstructed results showed motion of rectal gas and stool. The result of TCGM provided visually clearer and less blurring images. Conclusion: The present study demonstrates that the new concept for 4D CBCT reconstruction, TCGM, combined with MAP iterative reconstruction framework enables time-ordered image reconstruction with narrower time-window.« less

Value of 3D printing for the comprehension of surgical anatomy.

PubMed

Marconi, Stefania; Pugliese, Luigi; Botti, Marta; Peri, Andrea; Cavazzi, Emma; Latteri, Saverio; Auricchio, Ferdinando; Pietrabissa, Andrea

2017-10-01

In a preliminary experience, we claimed the potential value of 3D printing technology for pre-operative counseling and surgical planning. However, no objective analysis has ever assessed its additional benefit in transferring anatomical information from radiology to final users. We decided to validate the pre-operative use of 3D-printed anatomical models in patients with solid organs' diseases as a new tool to deliver morphological information. Fifteen patients scheduled for laparoscopic splenectomy, nephrectomy, or pancreatectomy were selected and, for each, a full-size 3D virtual anatomical object was reconstructed from a contrast-enhanced MDCT (Multiple Detector Computed Tomography) and then prototyped using a 3D printer. After having carefully evaluated-in a random sequence-conventional contrast MDCT scans, virtual 3D reconstructions on a flat monitor, and 3D-printed models of the same anatomy for each selected case, thirty subjects with different expertise in radiological imaging (10 medical students, 10 surgeons and 10 radiologists) were administered a multiple-item questionnaire. Crucial issues for the anatomical understanding and the pre-operative planning of the scheduled procedure were addressed. The visual and tactile inspection of 3D models allowed the best anatomical understanding, with faster and clearer comprehension of the surgical anatomy. As expected, less experienced medical students perceived the highest benefit (53.9% ± 4.14 of correct answers with 3D-printed models, compared to 53.4 % ± 4.6 with virtual models and 45.5% ± 4.6 with MDCT), followed by surgeons and radiologists. The average time spent by participants in 3D model assessing was shorter (60.67 ± 25.5 s) than the one of the corresponding virtual 3D reconstruction (70.8 ± 28.18 s) or conventional MDCT scan (127.04 ± 35.91 s). 3D-printed models help to transfer complex anatomical information to clinicians, resulting useful in the pre-operative planning, for intra-operative navigation and for surgical training purposes.

Preoperative simulation for the planning of microsurgical clipping of intracranial aneurysms.

PubMed

Marinho, Paulo; Vermandel, Maximilien; Bourgeois, Philippe; Lejeune, Jean-Paul; Mordon, Serge; Thines, Laurent

2014-12-01

The safety and success of intracranial aneurysm (IA) surgery could be improved through the dedicated application of simulation covering the procedure from the 3-dimensional (3D) description of the surgical scene to the visual representation of the clip application. We aimed in this study to validate the technical feasibility and clinical relevance of such a protocol. All patients preoperatively underwent 3D magnetic resonance imaging and 3D computed tomography angiography to build 3D reconstructions of the brain, cerebral arteries, and surrounding cranial bone. These 3D models were segmented and merged using Osirix, a DICOM image processing application. This provided the surgical scene that was subsequently imported into Blender, a modeling platform for 3D animation. Digitized clips and appliers could then be manipulated in the virtual operative environment, allowing the visual simulation of clipping. This simulation protocol was assessed in a series of 10 IAs by 2 neurosurgeons. The protocol was feasible in all patients. The visual similarity between the surgical scene and the operative view was excellent in 100% of the cases, and the identification of the vascular structures was accurate in 90% of the cases. The neurosurgeons found the simulation helpful for planning the surgical approach (ie, the bone flap, cisternal opening, and arterial tree exposure) in 100% of the cases. The correct number of final clip(s) needed was predicted from the simulation in 90% of the cases. The preoperatively expected characteristics of the optimal clip(s) (ie, their number, shape, size, and orientation) were validated during surgery in 80% of the cases. This study confirmed that visual simulation of IA clipping based on the processing of high-resolution 3D imaging can be effective. This is a new and important step toward the development of a more sophisticated integrated simulation platform dedicated to cerebrovascular surgery.

MO-DE-207A-11: Sparse-View CT Reconstruction Via a Novel Non-Local Means Method

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, Z; Qi, H; Wu, S

2016-06-15

Purpose: Sparse-view computed tomography (CT) reconstruction is an effective strategy to reduce the radiation dose delivered to patients. Due to its insufficiency of measurements, traditional non-local means (NLM) based reconstruction methods often lead to over-smoothness in image edges. To address this problem, an adaptive NLM reconstruction method based on rotational invariance (RIANLM) is proposed. Methods: The method consists of four steps: 1) Initializing parameters; 2) Algebraic reconstruction technique (ART) reconstruction using raw projection data; 3) Positivity constraint of the image reconstructed by ART; 4) Update reconstructed image by using RIANLM filtering. In RIANLM, a novel similarity metric that is rotationalmore » invariance is proposed and used to calculate the distance between two patches. In this way, any patch with similar structure but different orientation to the reference patch would win a relatively large weight to avoid over-smoothed image. Moreover, the parameter h in RIANLM which controls the decay of the weights is adaptive to avoid over-smoothness, while it in NLM is not adaptive during the whole reconstruction process. The proposed method is named as ART-RIANLM and validated on Shepp-Logan phantom and clinical projection data. Results: In our experiments, the searching neighborhood size is set to 15 by 15 and the similarity window is set to 3 by 3. For the simulated case with a resolution of 256 by 256 Shepp-Logan phantom, the ART-RIANLM produces higher SNR (35.38dB<24.00dB) and lower MAE (0.0006<0.0023) reconstructed image than ART-NLM. The visual inspection demonstrated that the proposed method could suppress artifacts or noises more effectively and preserve image edges better. Similar results were found for clinical data case. Conclusion: A novel ART-RIANLM method for sparse-view CT reconstruction is presented with superior image. Compared to the conventional ART-NLM method, the SNR and MAE from ART-RIANLM increases 47% and decreases 74%, respectively.« less

Haptic augmented skin surface generation toward telepalpation from a mobile skin image.

PubMed

Kim, K

2018-05-01

Very little is known about the methods of integrating palpation techniques to existing mobile teleskin imaging that delivers low quality tactile information (roughness) for telepalpation. However, no study has been reported yet regarding telehaptic palpation using mobile phone images for teledermatology or teleconsultations of skincare. This study is therefore aimed at introducing a new algorithm accurately reconstructing a haptic augmented skin surface for telehaptic palpation using a low-cost clip-on microscope simply attached to a mobile phone. Multiple algorithms such as gradient-based image enhancement, roughness-adaptive tactile mask generation, roughness-enhanced 3D tactile map building, and visual and haptic rendering with a three-degrees-of-freedom (DOF) haptic device were developed and integrated as one system. Evaluation experiments have been conducted to test the performance of 3D roughness reconstruction with/without the tactile mask. The results confirm that reconstructed haptic roughness with the tactile mask is superior to the reconstructed haptic roughness without the tactile mask. Additional experiments demonstrate that the proposed algorithm is robust against varying lighting conditions and blurring. In last, a user study has been designed to see the effect of the haptic modality to the existing visual only interface and the results attest that the haptic skin palpation can significantly improve the skin exam performance. Mobile image-based telehaptic palpation technology was proposed, and an initial version was developed. The developed technology was tested with several skin images and the experimental results showed the superiority of the proposed scheme in terms of the performance of haptic augmentation of real skin images. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

2D and 3D visualization methods of endoscopic panoramic bladder images

NASA Astrophysics Data System (ADS)

Behrens, Alexander; Heisterklaus, Iris; Müller, Yannick; Stehle, Thomas; Gross, Sebastian; Aach, Til

2011-03-01

While several mosaicking algorithms have been developed to compose endoscopic images of the internal urinary bladder wall into panoramic images, the quantitative evaluation of these output images in terms of geometrical distortions have often not been discussed. However, the visualization of the distortion level is highly desired for an objective image-based medical diagnosis. Thus, we present in this paper a method to create quality maps from the characteristics of transformation parameters, which were applied to the endoscopic images during the registration process of the mosaicking algorithm. For a global first view impression, the quality maps are laid over the panoramic image and highlight image regions in pseudo-colors according to their local distortions. This illustration supports then surgeons to identify geometrically distorted structures easily in the panoramic image, which allow more objective medical interpretations of tumor tissue in shape and size. Aside from introducing quality maps in 2-D, we also discuss a visualization method to map panoramic images onto a 3-D spherical bladder model. Reference points are manually selected by the surgeon in the panoramic image and the 3-D model. Then the panoramic image is mapped by the Hammer-Aitoff equal-area projection onto the 3-D surface using texture mapping. Finally the textured bladder model can be freely moved in a virtual environment for inspection. Using a two-hemisphere bladder representation, references between panoramic image regions and their corresponding space coordinates within the bladder model are reconstructed. This additional spatial 3-D information thus assists the surgeon in navigation, documentation, as well as surgical planning.

2D and 3D MALDI-imaging: conceptual strategies for visualization and data mining.

PubMed

Thiele, Herbert; Heldmann, Stefan; Trede, Dennis; Strehlow, Jan; Wirtz, Stefan; Dreher, Wolfgang; Berger, Judith; Oetjen, Janina; Kobarg, Jan Hendrik; Fischer, Bernd; Maass, Peter

2014-01-01

3D imaging has a significant impact on many challenges in life sciences, because biology is a 3-dimensional phenomenon. Current 3D imaging-technologies (various types MRI, PET, SPECT) are labeled, i.e. they trace the localization of a specific compound in the body. In contrast, 3D MALDI mass spectrometry-imaging (MALDI-MSI) is a label-free method imaging the spatial distribution of molecular compounds. It complements 3D imaging labeled methods, immunohistochemistry, and genetics-based methods. However, 3D MALDI-MSI cannot tap its full potential due to the lack of statistical methods for analysis and interpretation of large and complex 3D datasets. To overcome this, we established a complete and robust 3D MALDI-MSI pipeline combined with efficient computational data analysis methods for 3D edge preserving image denoising, 3D spatial segmentation as well as finding colocalized m/z values, which will be reviewed here in detail. Furthermore, we explain, why the integration and correlation of the MALDI imaging data with other imaging modalities allows to enhance the interpretation of the molecular data and provides visualization of molecular patterns that may otherwise not be apparent. Therefore, a 3D data acquisition workflow is described generating a set of 3 different dimensional images representing the same anatomies. First, an in-vitro MRI measurement is performed which results in a three-dimensional image modality representing the 3D structure of the measured object. After sectioning the 3D object into N consecutive slices, all N slices are scanned using an optical digital scanner, enabling for performing the MS measurements. Scanning the individual sections results into low-resolution images, which define the base coordinate system for the whole pipeline. The scanned images conclude the information from the spatial (MRI) and the mass spectrometric (MALDI-MSI) dimension and are used for the spatial three-dimensional reconstruction of the object performed by image registration techniques. Different strategies for automatic serial image registration applied to MS datasets are outlined in detail. The third image modality is histology driven, i.e. a digital scan of the histological stained slices in high-resolution. After fusion of reconstructed scan images and MRI the slice-related coordinates of the mass spectra can be propagated into 3D-space. After image registration of scan images and histological stained images, the anatomical information from histology is fused with the mass spectra from MALDI-MSI. As a result of the described pipeline we have a set of 3 dimensional images representing the same anatomies, i.e. the reconstructed slice scans, the spectral images as well as corresponding clustering results, and the acquired MRI. Great emphasis is put on the fact that the co-registered MRI providing anatomical details improves the interpretation of 3D MALDI images. The ability to relate mass spectrometry derived molecular information with in vivo and in vitro imaging has potentially important implications. This article is part of a Special Issue entitled: Computational Proteomics in the Post-Identification Era. Guest Editors: Martin Eisenacher and Christian Stephan. Copyright © 2013. Published by Elsevier B.V.

A non-disruptive technology for robust 3D tool tracking for ultrasound-guided interventions.

PubMed

Mung, Jay; Vignon, Francois; Jain, Ameet

2011-01-01

In the past decade ultrasound (US) has become the preferred modality for a number of interventional procedures, offering excellent soft tissue visualization. The main limitation however is limited visualization of surgical tools. A new method is proposed for robust 3D tracking and US image enhancement of surgical tools under US guidance. Small US sensors are mounted on existing surgical tools. As the imager emits acoustic energy, the electrical signal from the sensor is analyzed to reconstruct its 3D coordinates. These coordinates can then be used for 3D surgical navigation, similar to current day tracking systems. A system with real-time 3D tool tracking and image enhancement was implemented on a commercial ultrasound scanner and 3D probe. Extensive water tank experiments with a tracked 0.2mm sensor show robust performance in a wide range of imaging conditions and tool position/orientations. The 3D tracking accuracy was 0.36 +/- 0.16mm throughout the imaging volume of 55 degrees x 27 degrees x 150mm. Additionally, the tool was successfully tracked inside a beating heart phantom. This paper proposes an image enhancement and tool tracking technology with sub-mm accuracy for US-guided interventions. The technology is non-disruptive, both in terms of existing clinical workflow and commercial considerations, showing promise for large scale clinical impact.

Reconstructing the Alcatraz escape

NASA Astrophysics Data System (ADS)

Baart, F.; Hoes, O.; Hut, R.; Donchyts, G.; van Leeuwen, E.

2014-12-01

In the night of June 12, 1962 three inmates used a raft made of raincoatsto escaped the ultimate maximum security prison island Alcatraz in SanFrancisco, United States. History is unclear about what happened tothe escapees. At what time did they step into the water, did theysurvive, if so, where did they reach land? The fate of the escapees has been the subject of much debate: did theymake landfall on Angel Island, or did the current sweep them out ofthe bay and into the cold pacific ocean? In this presentation, we try to shed light on this historic case using avisualization of a high-resolution hydrodynamic simulation of the San Francisco Bay, combined with historical tidal records. By reconstructing the hydrodynamic conditions and using a particle based simulation of the escapees we show possible scenarios. The interactive model is visualized using both a 3D photorealistic and web based visualization. The "Escape from Alcatraz" scenario demonstrates the capabilities of the 3Di platform. This platform is normally used for overland flooding (1D/2D). The model engine uses a quad tree structure, resulting in an order of magnitude speedup. The subgrid approach takes detailed bathymetry information into account. The inter-model variability is tested by comparing the results with the DFlow Flexible Mesh (DFlowFM) San Francisco Bay model. Interactivity is implemented by converting the models from static programs to interactive libraries, adhering to the Basic ModelInterface (BMI). Interactive models are more suitable for answeringexploratory research questions such as this reconstruction effort. Although these hydrodynamic simulations only provide circumstantialevidence for solving the mystery of what happened during the foggy darknight of June 12, 1962, it can be used as a guidance and provides aninteresting testcase to apply interactive modelling.

Inlining 3d Reconstruction, Multi-Source Texture Mapping and Semantic Analysis Using Oblique Aerial Imagery

NASA Astrophysics Data System (ADS)

Frommholz, D.; Linkiewicz, M.; Poznanska, A. M.

2016-06-01

This paper proposes an in-line method for the simplified reconstruction of city buildings from nadir and oblique aerial images that at the same time are being used for multi-source texture mapping with minimal resampling. Further, the resulting unrectified texture atlases are analyzed for façade elements like windows to be reintegrated into the original 3D models. Tests on real-world data of Heligoland/ Germany comprising more than 800 buildings exposed a median positional deviation of 0.31 m at the façades compared to the cadastral map, a correctness of 67% for the detected windows and good visual quality when being rendered with GPU-based perspective correction. As part of the process building reconstruction takes the oriented input images and transforms them into dense point clouds by semi-global matching (SGM). The point sets undergo local RANSAC-based regression and topology analysis to detect adjacent planar surfaces and determine their semantics. Based on this information the roof, wall and ground surfaces found get intersected and limited in their extension to form a closed 3D building hull. For texture mapping the hull polygons are projected into each possible input bitmap to find suitable color sources regarding the coverage and resolution. Occlusions are detected by ray-casting a full-scale digital surface model (DSM) of the scene and stored in pixel-precise visibility maps. These maps are used to derive overlap statistics and radiometric adjustment coefficients to be applied when the visible image parts for each building polygon are being copied into a compact texture atlas without resampling whenever possible. The atlas bitmap is passed to a commercial object-based image analysis (OBIA) tool running a custom rule set to identify windows on the contained façade patches. Following multi-resolution segmentation and classification based on brightness and contrast differences potential window objects are evaluated against geometric constraints and conditionally grown, fused and filtered morphologically. The output polygons are vectorized and reintegrated into the previously reconstructed buildings by sparsely ray-tracing their vertices. Finally the enhanced 3D models get stored as textured geometry for visualization and semantically annotated "LOD-2.5" CityGML objects for GIS applications.

Morphological features of the macerated cranial bones registered by the 3D vision system for potential use in forensic anthropology.

PubMed

Skrzat, Janusz; Sioma, Andrzej; Kozerska, Magdalena

2013-01-01

In this paper we present potential usage of the 3D vision system for registering features of the macerated cranial bones. Applied 3D vision system collects height profiles of the object surface and from that data builds a three-dimensional image of the surface. This method appeared to be accurate enough to capture anatomical details of the macerated bones. With the aid of the 3D vision system we generated images of the surface of the human calvaria which was used for testing the system. Performed reconstruction visualized the imprints of the dural vascular system, cranial sutures, and the three-layer structure of the cranial bones observed in the cross-section. We figure out that the 3D vision system may deliver data which can enhance estimation of sex from the osteological material.

3D imaging of cleared human skin biopsies using light-sheet microscopy: A new way to visualize in-depth skin structure.

PubMed

Abadie, S; Jardet, C; Colombelli, J; Chaput, B; David, A; Grolleau, J-L; Bedos, P; Lobjois, V; Descargues, P; Rouquette, J

2018-05-01

Human skin is composed of the superimposition of tissue layers of various thicknesses and components. Histological staining of skin sections is the benchmark approach to analyse the organization and integrity of human skin biopsies; however, this approach does not allow 3D tissue visualization. Alternatively, confocal or two-photon microscopy is an effective approach to perform fluorescent-based 3D imaging. However, owing to light scattering, these methods display limited light penetration in depth. The objectives of this study were therefore to combine optical clearing and light-sheet fluorescence microscopy (LSFM) to perform in-depth optical sectioning of 5 mm-thick human skin biopsies and generate 3D images of entire human skin biopsies. A benzyl alcohol and benzyl benzoate solution was used to successfully optically clear entire formalin fixed human skin biopsies, making them transparent. In-depth optical sectioning was performed with LSFM on the basis of tissue-autofluorescence observations. 3D image analysis of optical sections generated with LSFM was performed by using the Amira ® software. This new approach allowed us to observe in situ the different layers and compartments of human skin, such as the stratum corneum, the dermis and epidermal appendages. With this approach, we easily performed 3D reconstruction to visualise an entire human skin biopsy. Finally, we demonstrated that this method is useful to visualise and quantify histological anomalies, such as epidermal hyperplasia. The combination of optical clearing and LSFM has new applications in dermatology and dermatological research by allowing 3D visualization and analysis of whole human skin biopsies. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A Digital 3D-Reconstruction of the Younger Dryas Baltic Ice Lake

NASA Astrophysics Data System (ADS)

Jakobsson, M.; Alm, G.; Bjorck, S.; Lindeberg, G.; Svensson, N.

2005-12-01

A digital 3D-reconstruction of the final stage of the ice dammed Baltic Ice Lake (BIL), dated to the very end of the Younger Dryas cold period (ca. 11 600 cal. yr BP) has been compiled using a combined bathymetric-topographic Digital Terrain Model (DTM), Scandinavian ice sheet limits, Baltic Sea Holocene bottom sediment thickness information, and a paleoshoreline database maintained at the Lund University. The combined bathymetric-topographic Digital Terrain Model (DTM) model used to reconstruct the ice dammed lake was compiled specifically for this study from publicly available data sets. The final DTM is in the form of a digital grid on Lamberts Equal Area projection with a resolution of 500 x 500 m, which permits a much more detailed reconstruction of the BIL than previously made. The lake was constructed through a series of experiments where mathematical algorithms were applied to fit the paleolake's surface through the shoreline database. The accumulated Holocene bottom sediments in the Baltic Sea were subsequently subtracted from the present bathymetry in our reconstruction. This allows us to estimate the Baltic Ice Lake's paleobathymetry, area, volume, and hypsometry, which will comprise key input data to lake/climate modeling exercises following this study. The Scandinavian ice sheet margin eventually retreated north of Mount Billingen, which was the high point in terrain of Southern central Sweden bordering to lower terrain further to the North. As a consequence, the BIL was catastrophically drained through this area, resulting in a 25 m drop of the lake level. With our digital BIL model we estimate that approximately 7, 800 km3 of water drained during this event and that the ice dammed lake area was reduced with ca 18 percent. The digital BIL reconstruction is analyzed using 3D-visualization techniques that provide new detailed information on the paleogeography in the area, both before and after the lake drainage, with implications for interpretations of geological records concerning the post-glacial environmental development of southern Scandinavia.

Local motion-compensated method for high-quality 3D coronary artery reconstruction

PubMed Central

Liu, Bo; Bai, Xiangzhi; Zhou, Fugen

2016-01-01

The 3D reconstruction of coronary artery from X-ray angiograms rotationally acquired on C-arm has great clinical value. While cardiac-gated reconstruction has shown promising results, it suffers from the problem of residual motion. This work proposed a new local motion-compensated reconstruction method to handle this issue. An initial image was firstly reconstructed using a regularized iterative reconstruction method. Then a 3D/2D registration method was proposed to estimate the residual vessel motion. Finally, the residual motion was compensated in the final reconstruction using the extended iterative reconstruction method. Through quantitative evaluation, it was found that high-quality 3D reconstruction could be obtained and the result was comparable to state-of-the-art method. PMID:28018741

Non-isotropic noise correlation in PET data reconstructed by FBP but not by OSEM demonstrated using auto-correlation function.

PubMed

Razifar, Pasha; Lubberink, Mark; Schneider, Harald; Långström, Bengt; Bengtsson, Ewert; Bergström, Mats

2005-05-13

BACKGROUND: Positron emission tomography (PET) is a powerful imaging technique with the potential of obtaining functional or biochemical information by measuring distribution and kinetics of radiolabelled molecules in a biological system, both in vitro and in vivo. PET images can be used directly or after kinetic modelling to extract quantitative values of a desired physiological, biochemical or pharmacological entity. Because such images are generally noisy, it is essential to understand how noise affects the derived quantitative values. A pre-requisite for this understanding is that the properties of noise such as variance (magnitude) and texture (correlation) are known. METHODS: In this paper we explored the pattern of noise correlation in experimentally generated PET images, with emphasis on the angular dependence of correlation, using the autocorrelation function (ACF). Experimental PET data were acquired in 2D and 3D acquisition mode and reconstructed by analytical filtered back projection (FBP) and iterative ordered subsets expectation maximisation (OSEM) methods. The 3D data was rebinned to a 2D dataset using FOurier REbinning (FORE) followed by 2D reconstruction using either FBP or OSEM. In synthetic images we compared the ACF results with those from covariance matrix. The results were illustrated as 1D profiles and also visualized as 2D ACF images. RESULTS: We found that the autocorrelation images from PET data obtained after FBP were not fully rotationally symmetric or isotropic if the object deviated from a uniform cylindrical radioactivity distribution. In contrast, similar autocorrelation images obtained after OSEM reconstruction were isotropic even when the phantom was not circular. Simulations indicated that the noise autocorrelation is non-isotropic in images created by FBP when the level of noise in projections is angularly variable. Comparison between 1D cross profiles on autocorrelation images obtained by FBP reconstruction and covariance matrices produced almost identical results in a simulation study. CONCLUSION: With asymmetric radioactivity distribution in PET, reconstruction using FBP, in contrast to OSEM, generates images in which the noise correlation is non-isotropic when the noise magnitude is angular dependent, such as in objects with asymmetric radioactivity distribution. In this respect, iterative reconstruction is superior since it creates isotropic noise correlations in the images.

D Reconstruction and Visualization of Cultural Heritage: Analyzing Our Legacy Through Time

NASA Astrophysics Data System (ADS)

Rodríguez-Gonzálvez, P.; Muñoz-Nieto, A. L.; del Pozo, S.; Sanchez-Aparicio, L. J.; Gonzalez-Aguilera, D.; Micoli, L.; Gonizzi Barsanti, S.; Guidi, G.; Mills, J.; Fieber, K.; Haynes, I.; Hejmanowska, B.

2017-02-01

Temporal analyses and multi-temporal 3D reconstruction are fundamental for the preservation and maintenance of all forms of Cultural Heritage (CH) and are the basis for decisions related to interventions and promotion. Introducing the fourth dimension of time into three-dimensional geometric modelling of real data allows the creation of a multi-temporal representation of a site. In this way, scholars from various disciplines (surveyors, geologists, archaeologists, architects, philologists, etc.) are provided with a new set of tools and working methods to support the study of the evolution of heritage sites, both to develop hypotheses about the past and to model likely future developments. The capacity to "see" the dynamic evolution of CH assets across different spatial scales (e.g. building, site, city or territory) compressed in diachronic model, affords the possibility to better understand the present status of CH according to its history. However, there are numerous challenges in order to carry out 4D modelling and the requisite multi-data source integration. It is necessary to identify the specifications, needs and requirements of the CH community to understand the required levels of 4D model information. In this way, it is possible to determine the optimum material and technologies to be utilised at different CH scales, as well as the data management and visualization requirements. This manuscript aims to provide a comprehensive approach for CH time-varying representations, analysis and visualization across different working scales and environments: rural landscape, urban landscape and architectural scales. Within this aim, the different available metric data sources are systemized and evaluated in terms of their suitability.

Visualization of scoliotic spine using ultrasound-accessible skeletal landmarks

NASA Astrophysics Data System (ADS)

Church, Ben; Lasso, Andras; Schlenger, Christopher; Borschneck, Daniel P.; Mousavi, Parvin; Fichtinger, Gabor; Ungi, Tamas

2017-03-01

PURPOSE: Ultrasound imaging is an attractive alternative to X-ray for scoliosis diagnosis and monitoring due to its safety and inexpensiveness. The transverse processes as skeletal landmarks are accessible by means of ultrasound and are sufficient for quantifying scoliosis, but do not provide an informative visualization of the spine. METHODS: We created a method for visualization of the scoliotic spine using a 3D transform field, resulting from thin-spline interpolation of a landmark-based registration between the transverse processes that we localized in both the patient's ultrasound and an average healthy spine model. Additional anchor points were computationally generated to control the thin-spline interpolation, in order to gain a transform field that accurately represents the deformation of the patient's spine. The transform field is applied to the average spine model, resulting in a 3D surface model depicting the patient's spine. We applied ground truth CT from pediatric scoliosis patients in which we reconstructed the bone surface and localized the transverse processes. We warped the average spine model and analyzed the match between the patient's bone surface and the warped spine. RESULTS: Visual inspection revealed accurate rendering of the scoliotic spine. Notable misalignments occurred mainly in the anterior-posterior direction, and at the first and last vertebrae, which is immaterial for scoliosis quantification. The average Hausdorff distance computed for 4 patients was 2.6 mm. CONCLUSIONS: We achieved qualitatively accurate and intuitive visualization to depict the 3D deformation of the patient's spine when compared to ground truth CT.

Procedural 3d Modelling for Traditional Settlements. The Case Study of Central Zagori

NASA Astrophysics Data System (ADS)

Kitsakis, D.; Tsiliakou, E.; Labropoulos, T.; Dimopoulou, E.

2017-02-01

Over the last decades 3D modelling has been a fast growing field in Geographic Information Science, extensively applied in various domains including reconstruction and visualization of cultural heritage, especially monuments and traditional settlements. Technological advances in computer graphics, allow for modelling of complex 3D objects achieving high precision and accuracy. Procedural modelling is an effective tool and a relatively novel method, based on algorithmic modelling concept. It is utilized for the generation of accurate 3D models and composite facade textures from sets of rules which are called Computer Generated Architecture grammars (CGA grammars), defining the objects' detailed geometry, rather than altering or editing the model manually. In this paper, procedural modelling tools have been exploited to generate the 3D model of a traditional settlement in the region of Central Zagori in Greece. The detailed geometries of 3D models derived from the application of shape grammars on selected footprints, and the process resulted in a final 3D model, optimally describing the built environment of Central Zagori, in three levels of Detail (LoD). The final 3D scene was exported and published as 3D web-scene which can be viewed with 3D CityEngine viewer, giving a walkthrough the whole model, same as in virtual reality or game environments. This research work addresses issues regarding textures' precision, LoD for 3D objects and interactive visualization within one 3D scene, as well as the effectiveness of large scale modelling, along with the benefits and drawbacks that derive from procedural modelling techniques in the field of cultural heritage and more specifically on 3D modelling of traditional settlements.

Framework for 3D histologic reconstruction and fusion with in vivo MRI: Preliminary results of characterizing pulmonary inflammation in a mouse model.

PubMed

Rusu, Mirabela; Golden, Thea; Wang, Haibo; Gow, Andrew; Madabhushi, Anant

2015-08-01

Pulmonary inflammation is associated with a variety of diseases. Assessing pulmonary inflammation on in vivo imaging may facilitate the early detection and treatment of lung diseases. Although routinely used in thoracic imaging, computed tomography has thus far not been compellingly shown to characterize inflammation in vivo. Alternatively, magnetic resonance imaging (MRI) is a nonionizing radiation technique to better visualize and characterize pulmonary tissue. Prior to routine adoption of MRI for early characterization of inflammation in humans, a rigorous and quantitative characterization of the utility of MRI to identify inflammation is required. Such characterization may be achieved by considering ex vivo histology as the ground truth, since it enables the definitive spatial assessment of inflammation. In this study, the authors introduce a novel framework to integrate 2D histology, ex vivo and in vivo imaging to enable the mapping of the extent of disease from ex vivo histology onto in vivo imaging, with the goal of facilitating computerized feature analysis and interrogation of disease appearance on in vivo imaging. The authors' framework was evaluated in a preclinical preliminary study aimed to identify computer extracted features on in vivo MRI associated with chronic pulmonary inflammation. The authors' image analytics framework first involves reconstructing the histologic volume in 3D from individual histology slices. Second, the authors map the disease ground truth onto in vivo MRI via coregistration with 3D histology using the ex vivo lung MRI as a conduit. Finally, computerized feature analysis of the disease extent is performed to identify candidate in vivo imaging signatures of disease presence and extent. The authors evaluated the framework by assessing the quality of the 3D histology reconstruction and the histology-MRI fusion, in the context of an initial use case involving characterization of chronic inflammation in a mouse model. The authors' evaluation considered three mice, two with an inflammation phenotype and one control. The authors' iterative 3D histology reconstruction yielded a 70.1% ± 2.7% overlap with the ex vivo MRI volume. Across a total of 17 anatomic landmarks manually delineated at the division of airways, the target registration error between the ex vivo MRI and 3D histology reconstruction was 0.85 ± 0.44 mm, suggesting that a good alignment of the ex vivo 3D histology and ex vivo MRI had been achieved. The 3D histology-in vivo MRI coregistered volumes resulted in an overlap of 73.7% ± 0.9%. Preliminary computerized feature analysis was performed on an additional four control mice, for a total of seven mice considered in this study. Gabor texture filters appeared to best capture differences between the inflamed and noninflamed regions on MRI. The authors' 3D histology reconstruction and multimodal registration framework were successfully employed to reconstruct the histology volume of the lung and fuse it with in vivo MRI to create a ground truth map for inflammation on in vivo MRI. The analytic platform presented here lays the framework for a rigorous validation of the identified imaging features for chronic lung inflammation on MRI in a large prospective cohort.

Optical-CT 3D Dosimetry Using Fresnel Lenses with Minimal Refractive-Index Matching Fluid

PubMed Central

Bache, Steven; Malcolm, Javian; Adamovics, John; Oldham, Mark

2016-01-01

Telecentric optical computed tomography (optical-CT) is a state-of-the-art method for visualizing and quantifying 3-dimensional dose distributions in radiochromic dosimeters. In this work a prototype telecentric system (DFOS—Duke Fresnel Optical-CT Scanner) is evaluated which incorporates two substantial design changes: the use of Fresnel lenses (reducing lens costs from $10-30K t0 $1-3K) and the use of a ‘solid tank’ (which reduces noise, and the volume of refractively matched fluid from 1ltr to 10cc). The efficacy of DFOS was evaluated by direct comparison against commissioned scanners in our lab. Measured dose distributions from all systems were compared against the predicted dose distributions from a commissioned treatment planning system (TPS). Three treatment plans were investigated including a simple four-field box treatment, a multiple small field delivery, and a complex IMRT treatment. Dosimeters were imaged within 2h post irradiation, using consistent scanning techniques (360 projections acquired at 1 degree intervals, reconstruction at 2mm). DFOS efficacy was evaluated through inspection of dose line-profiles, and 2D and 3D dose and gamma maps. DFOS/TPS gamma pass rates with 3%/3mm dose difference/distance-to-agreement criteria ranged from 89.3% to 92.2%, compared to from 95.6% to 99.0% obtained with the commissioned system. The 3D gamma pass rate between the commissioned system and DFOS was 98.2%. The typical noise rates in DFOS reconstructions were up to 3%, compared to under 2% for the commissioned system. In conclusion, while the introduction of a solid tank proved advantageous with regards to cost and convenience, further work is required to improve the image quality and dose reconstruction accuracy of the new DFOS optical-CT system. PMID:27019460

Optical-CT 3D Dosimetry Using Fresnel Lenses with Minimal Refractive-Index Matching Fluid.

PubMed

Bache, Steven; Malcolm, Javian; Adamovics, John; Oldham, Mark

2016-01-01

Telecentric optical computed tomography (optical-CT) is a state-of-the-art method for visualizing and quantifying 3-dimensional dose distributions in radiochromic dosimeters. In this work a prototype telecentric system (DFOS-Duke Fresnel Optical-CT Scanner) is evaluated which incorporates two substantial design changes: the use of Fresnel lenses (reducing lens costs from $10-30K t0 $1-3K) and the use of a 'solid tank' (which reduces noise, and the volume of refractively matched fluid from 1 ltr to 10 cc). The efficacy of DFOS was evaluated by direct comparison against commissioned scanners in our lab. Measured dose distributions from all systems were compared against the predicted dose distributions from a commissioned treatment planning system (TPS). Three treatment plans were investigated including a simple four-field box treatment, a multiple small field delivery, and a complex IMRT treatment. Dosimeters were imaged within 2 h post irradiation, using consistent scanning techniques (360 projections acquired at 1 degree intervals, reconstruction at 2mm). DFOS efficacy was evaluated through inspection of dose line-profiles, and 2D and 3D dose and gamma maps. DFOS/TPS gamma pass rates with 3%/3mm dose difference/distance-to-agreement criteria ranged from 89.3% to 92.2%, compared to from 95.6% to 99.0% obtained with the commissioned system. The 3D gamma pass rate between the commissioned system and DFOS was 98.2%. The typical noise rates in DFOS reconstructions were up to 3%, compared to under 2% for the commissioned system. In conclusion, while the introduction of a solid tank proved advantageous with regards to cost and convenience, further work is required to improve the image quality and dose reconstruction accuracy of the new DFOS optical-CT system.

Twin robotic x-ray system for 2D radiographic and 3D cone-beam CT imaging

NASA Astrophysics Data System (ADS)

Fieselmann, Andreas; Steinbrener, Jan; Jerebko, Anna K.; Voigt, Johannes M.; Scholz, Rosemarie; Ritschl, Ludwig; Mertelmeier, Thomas

2016-03-01

In this work, we provide an initial characterization of a novel twin robotic X-ray system. This system is equipped with two motor-driven telescopic arms carrying X-ray tube and flat-panel detector, respectively. 2D radiographs and fluoroscopic image sequences can be obtained from different viewing angles. Projection data for 3D cone-beam CT reconstruction can be acquired during simultaneous movement of the arms along dedicated scanning trajectories. We provide an initial evaluation of the 3D image quality based on phantom scans and clinical images. Furthermore, initial evaluation of patient dose is conducted. The results show that the system delivers high image quality for a range of medical applications. In particular, high spatial resolution enables adequate visualization of bone structures. This system allows 3D X-ray scanning of patients in standing and weight-bearing position. It could enable new 2D/3D imaging workflows in musculoskeletal imaging and improve diagnosis of musculoskeletal disorders.

Determination of left ventricular volume, ejection fraction, and myocardial mass by real-time three-dimensional echocardiography

NASA Technical Reports Server (NTRS)

Qin, J. X.; Shiota, T.; Thomas, J. D.

2000-01-01

Reconstructed three-dimensional (3-D) echocardiography is an accurate and reproducible method of assessing left ventricular (LV) functions. However, it has limitations for clinical study due to the requirement of complex computer and echocardiographic analysis systems, electrocardiographic/respiratory gating, and prolonged imaging times. Real-time 3-D echocardiography has a major advantage of conveniently visualizing the entire cardiac anatomy in three dimensions and of potentially accurately quantifying LV volumes, ejection fractions, and myocardial mass in patients even in the presence of an LV aneurysm. Although the image quality of the current real-time 3-D echocardiographic methods is not optimal, its widespread clinical application is possible because of the convenient and fast image acquisition. We review real-time 3-D echocardiographic image acquisition and quantitative analysis for the evaluation of LV function and LV mass.

Interactive and Stereoscopic Hybrid 3D Viewer of Radar Data with Gesture Recognition

NASA Astrophysics Data System (ADS)

Goenetxea, Jon; Moreno, Aitor; Unzueta, Luis; Galdós, Andoni; Segura, Álvaro

This work presents an interactive and stereoscopic 3D viewer of weather information coming from a Doppler radar. The hybrid system shows a GIS model of the regional zone where the radar is located and the corresponding reconstructed 3D volume weather data. To enhance the immersiveness of the navigation, stereoscopic visualization has been added to the viewer, using a polarized glasses based system. The user can interact with the 3D virtual world using a Nintendo Wiimote for navigating through it and a Nintendo Wii Nunchuk for giving commands by means of hand gestures. We also present a dynamic gesture recognition procedure that measures the temporal advance of the performed gesture postures. Experimental results show how dynamic gestures are effectively recognized so that a more natural interaction and immersive navigation in the virtual world is achieved.

Determination of left ventricular volume, ejection fraction, and myocardial mass by real-time three-dimensional echocardiography.

PubMed

Qin, J X; Shiota, T; Thomas, J D

2000-11-01

Reconstructed three-dimensional (3-D) echocardiography is an accurate and reproducible method of assessing left ventricular (LV) functions. However, it has limitations for clinical study due to the requirement of complex computer and echocardiographic analysis systems, electrocardiographic/respiratory gating, and prolonged imaging times. Real-time 3-D echocardiography has a major advantage of conveniently visualizing the entire cardiac anatomy in three dimensions and of potentially accurately quantifying LV volumes, ejection fractions, and myocardial mass in patients even in the presence of an LV aneurysm. Although the image quality of the current real-time 3-D echocardiographic methods is not optimal, its widespread clinical application is possible because of the convenient and fast image acquisition. We review real-time 3-D echocardiographic image acquisition and quantitative analysis for the evaluation of LV function and LV mass.

Navigation-supported diagnosis of the substantia nigra by matching midbrain sonography and MRI

NASA Astrophysics Data System (ADS)

Salah, Zein; Weise, David; Preim, Bernhard; Classen, Joseph; Rose, Georg

2012-03-01

Transcranial sonography (TCS) is a well-established neuroimaging technique that allows for visualizing several brainstem structures, including the substantia nigra, and helps for the diagnosis and differential diagnosis of various movement disorders, especially in Parkinsonian syndromes. However, proximate brainstem anatomy can hardly be recognized due to the limited image quality of B-scans. In this paper, a visualization system for the diagnosis of the substantia nigra is presented, which utilizes neuronavigated TCS to reconstruct tomographical slices from registered MRI datasets and visualizes them simultaneously with corresponding TCS planes in realtime. To generate MRI tomographical slices, the tracking data of the calibrated ultrasound probe are passed to an optimized slicing algorithm, which computes cross sections at arbitrary positions and orientations from the registered MRI dataset. The extracted MRI cross sections are finally fused with the region of interest from the ultrasound image. The system allows for the computation and visualization of slices at a near real-time rate. Primary tests of the system show an added value to the pure sonographic imaging. The system also allows for reconstructing volumetric (3D) ultrasonic data of the region of interest, and thus contributes to enhancing the diagnostic yield of midbrain sonography.

Evaluating image reconstruction methods for tumor detection performance in whole-body PET oncology imaging

NASA Astrophysics Data System (ADS)

Lartizien, Carole; Kinahan, Paul E.; Comtat, Claude; Lin, Michael; Swensson, Richard G.; Trebossen, Regine; Bendriem, Bernard

2000-04-01

This work presents initial results from observer detection performance studies using the same volume visualization software tools that are used in clinical PET oncology imaging. Research into the FORE+OSEM and FORE+AWOSEM statistical image reconstruction methods tailored to whole- body 3D PET oncology imaging have indicated potential improvements in image SNR compared to currently used analytic reconstruction methods (FBP). To assess the resulting impact of these reconstruction methods on the performance of human observers in detecting and localizing tumors, we use a non- Monte Carlo technique to generate multiple statistically accurate realizations of 3D whole-body PET data, based on an extended MCAT phantom and with clinically realistic levels of statistical noise. For each realization, we add a fixed number of randomly located 1 cm diam. lesions whose contrast is varied among pre-calibrated values so that the range of true positive fractions is well sampled. The observer is told the number of tumors and, similar to the AFROC method, asked to localize all of them. The true positive fraction for the three algorithms (FBP, FORE+OSEM, FORE+AWOSEM) as a function of lesion contrast is calculated, although other protocols could be compared. A confidence level for each tumor is also recorded for incorporation into later AFROC analysis.

Visually lossless compression of digital hologram sequences

NASA Astrophysics Data System (ADS)

Darakis, Emmanouil; Kowiel, Marcin; Näsänen, Risto; Naughton, Thomas J.

2010-01-01

Digital hologram sequences have great potential for the recording of 3D scenes of moving macroscopic objects as their numerical reconstruction can yield a range of perspective views of the scene. Digital holograms inherently have large information content and lossless coding of holographic data is rather inefficient due to the speckled nature of the interference fringes they contain. Lossy coding of still holograms and hologram sequences has shown promising results. By definition, lossy compression introduces errors in the reconstruction. In all of the previous studies, numerical metrics were used to measure the compression error and through it, the coding quality. Digital hologram reconstructions are highly speckled and the speckle pattern is very sensitive to data changes. Hence, numerical quality metrics can be misleading. For example, for low compression ratios, a numerically significant coding error can have visually negligible effects. Yet, in several cases, it is of high interest to know how much lossy compression can be achieved, while maintaining the reconstruction quality at visually lossless levels. Using an experimental threshold estimation method, the staircase algorithm, we determined the highest compression ratio that was not perceptible to human observers for objects compressed with Dirac and MPEG-4 compression methods. This level of compression can be regarded as the point below which compression is perceptually lossless although physically the compression is lossy. It was found that up to 4 to 7.5 fold compression can be obtained with the above methods without any perceptible change in the appearance of video sequences.

Simultaneous maximum a posteriori longitudinal PET image reconstruction

NASA Astrophysics Data System (ADS)

Ellis, Sam; Reader, Andrew J.

2017-09-01

Positron emission tomography (PET) is frequently used to monitor functional changes that occur over extended time scales, for example in longitudinal oncology PET protocols that include routine clinical follow-up scans to assess the efficacy of a course of treatment. In these contexts PET datasets are currently reconstructed into images using single-dataset reconstruction methods. Inspired by recently proposed joint PET-MR reconstruction methods, we propose to reconstruct longitudinal datasets simultaneously by using a joint penalty term in order to exploit the high degree of similarity between longitudinal images. We achieved this by penalising voxel-wise differences between pairs of longitudinal PET images in a one-step-late maximum a posteriori (MAP) fashion, resulting in the MAP simultaneous longitudinal reconstruction (SLR) method. The proposed method reduced reconstruction errors and visually improved images relative to standard maximum likelihood expectation-maximisation (ML-EM) in simulated 2D longitudinal brain tumour scans. In reconstructions of split real 3D data with inserted simulated tumours, noise across images reconstructed with MAP-SLR was reduced to levels equivalent to doubling the number of detected counts when using ML-EM. Furthermore, quantification of tumour activities was largely preserved over a variety of longitudinal tumour changes, including changes in size and activity, with larger changes inducing larger biases relative to standard ML-EM reconstructions. Similar improvements were observed for a range of counts levels, demonstrating the robustness of the method when used with a single penalty strength. The results suggest that longitudinal regularisation is a simple but effective method of improving reconstructed PET images without using resolution degrading priors.

Optical scanning holography based on compressive sensing using a digital micro-mirror device

NASA Astrophysics Data System (ADS)

A-qian, Sun; Ding-fu, Zhou; Sheng, Yuan; You-jun, Hu; Peng, Zhang; Jian-ming, Yue; xin, Zhou

2017-02-01

Optical scanning holography (OSH) is a distinct digital holography technique, which uses a single two-dimensional (2D) scanning process to record the hologram of a three-dimensional (3D) object. Usually, these 2D scanning processes are in the form of mechanical scanning, and the quality of recorded hologram may be affected due to the limitation of mechanical scanning accuracy and unavoidable vibration of stepper motor's start-stop. In this paper, we propose a new framework, which replaces the 2D mechanical scanning mirrors with a Digital Micro-mirror Device (DMD) to modulate the scanning light field, and we call it OSH based on Compressive Sensing (CS) using a digital micro-mirror device (CS-OSH). CS-OSH can reconstruct the hologram of an object through the use of compressive sensing theory, and then restore the image of object itself. Numerical simulation results confirm this new type OSH can get a reconstructed image with favorable visual quality even under the condition of a low sample rate.

ART 3.5D: an algorithm to label arteries and veins from three-dimensional angiography.

PubMed

Barra, Beatrice; De Momi, Elena; Ferrigno, Giancarlo; Pero, Guglielmo; Cardinale, Francesco; Baselli, Giuseppe

2016-10-01

Preoperative three-dimensional (3-D) visualization of brain vasculature by digital subtraction angiography from computerized tomography (CT) in neurosurgery is gaining more and more importance, since vessels are the primary landmarks both for organs at risk and for navigation. Surgical embolization of cerebral aneurysms and arteriovenous malformations, epilepsy surgery, and stereoelectroencephalography are a few examples. Contrast-enhanced cone-beam computed tomography (CE-CBCT) represents a powerful facility, since it is capable of acquiring images in the operation room, shortly before surgery. However, standard 3-D reconstructions do not provide a direct distinction between arteries and veins, which is of utmost importance and is left to the surgeon's inference so far. Pioneering attempts by true four-dimensional (4-D) CT perfusion scans were already described, though at the expense of longer acquisition protocols, higher dosages, and sensible resolution losses. Hence, space is open to approaches attempting to recover the contrast dynamics from standard CE-CBCT, on the basis of anomalies overlooked in the standard 3-D approach. This paper aims at presenting algebraic reconstruction technique (ART) 3.5D, a method that overcomes the clinical limitations of 4-D CT, from standard 3-D CE-CBCT scans. The strategy works on the 3-D angiography, previously segmented in the standard way, and reprocesses the dynamics hidden in the raw data to recover an approximate dynamics in each segmented voxel. Next, a classification algorithm labels the angiographic voxels and artery or vein. Numerical simulations were performed on a digital phantom of a simplified 3-D vasculature with contrast transit. CE-CBCT projections were simulated and used for ART 3.5D testing. We achieved up to 90% classification accuracy in simulations, proving the feasibility of the presented approach for dynamic information recovery for arteries and veins segmentation.

[Design of visualized medical images network and web platform based on MeVisLab].

PubMed

Xiang, Jun; Ye, Qing; Yuan, Xun

2017-04-01

With the trend of the development of "Internet +", some further requirements for the mobility of medical images have been required in the medical field. In view of this demand, this paper presents a web-based visual medical imaging platform. First, the feasibility of medical imaging is analyzed and technical points. CT (Computed Tomography) or MRI (Magnetic Resonance Imaging) images are reconstructed three-dimensionally by MeVisLab and packaged as X3D (Extensible 3D Graphics) files shown in the present paper. Then, the B/S (Browser/Server) system specially designed for 3D image is designed by using the HTML 5 and WebGL rendering engine library, and the X3D image file is parsed and rendered by the system. The results of this study showed that the platform was suitable for multiple operating systems to realize the platform-crossing and mobilization of medical image data. The development of medical imaging platform is also pointed out in this paper. It notes that web application technology will not only promote the sharing of medical image data, but also facilitate image-based medical remote consultations and distance learning.

Parallel image reconstruction for 3D positron emission tomography from incomplete 2D projection data

NASA Astrophysics Data System (ADS)

Guerrero, Thomas M.; Ricci, Anthony R.; Dahlbom, Magnus; Cherry, Simon R.; Hoffman, Edward T.

1993-07-01

The problem of excessive computational time in 3D Positron Emission Tomography (3D PET) reconstruction is defined, and we present an approach for solving this problem through the construction of an inexpensive parallel processing system and the adoption of the FAVOR algorithm. Currently, the 3D reconstruction of the 610 images of a total body procedure would require 80 hours and the 3D reconstruction of the 620 images of a dynamic study would require 110 hours. An inexpensive parallel processing system for 3D PET reconstruction is constructed from the integration of board level products from multiple vendors. The system achieves its computational performance through the use of 6U VME four i860 processor boards, the processor boards from five manufacturers are discussed from our perspective. The new 3D PET reconstruction algorithm FAVOR, FAst VOlume Reconstructor, that promises a substantial speed improvement is adopted. Preliminary results from parallelizing FAVOR are utilized in formulating architectural improvements for this problem. In summary, we are addressing the problem of excessive computational time in 3D PET image reconstruction, through the construction of an inexpensive parallel processing system and the parallelization of a 3D reconstruction algorithm that uses the incomplete data set that is produced by current PET systems.

A terrestrial lidar-based workflow for determining three-dimensional slip vectors and associated uncertainties

USGS Publications Warehouse

Gold, Peter O.; Cowgill, Eric; Kreylos, Oliver; Gold, Ryan D.

2012-01-01

Three-dimensional (3D) slip vectors recorded by displaced landforms are difficult to constrain across complex fault zones, and the uncertainties associated with such measurements become increasingly challenging to assess as landforms degrade over time. We approach this problem from a remote sensing perspective by using terrestrial laser scanning (TLS) and 3D structural analysis. We have developed an integrated TLS data collection and point-based analysis workflow that incorporates accurate assessments of aleatoric and epistemic uncertainties using experimental surveys, Monte Carlo simulations, and iterative site reconstructions. Our scanning workflow and equipment requirements are optimized for single-operator surveying, and our data analysis process is largely completed using new point-based computing tools in an immersive 3D virtual reality environment. In a case study, we measured slip vector orientations at two sites along the rupture trace of the 1954 Dixie Valley earthquake (central Nevada, United States), yielding measurements that are the first direct constraints on the 3D slip vector for this event. These observations are consistent with a previous approximation of net extension direction for this event. We find that errors introduced by variables in our survey method result in <2.5 cm of variability in components of displacement, and are eclipsed by the 10–60 cm epistemic errors introduced by reconstructing the field sites to their pre-erosion geometries. Although the higher resolution TLS data sets enabled visualization and data interactivity critical for reconstructing the 3D slip vector and for assessing uncertainties, dense topographic constraints alone were not sufficient to significantly narrow the wide (<26°) range of allowable slip vector orientations that resulted from accounting for epistemic uncertainties.

Managing multiple image stacks from confocal laser scanning microscopy

NASA Astrophysics Data System (ADS)

Zerbe, Joerg; Goetze, Christian H.; Zuschratter, Werner

1999-05-01

A major goal in neuroanatomy is to obtain precise information about the functional organization of neuronal assemblies and their interconnections. Therefore, the analysis of histological sections frequently requires high resolution images in combination with an overview about the structure. To overcome this conflict we have previously introduced a software for the automatic acquisition of multiple image stacks (3D-MISA) in confocal laser scanning microscopy. Here, we describe a Windows NT based software for fast and easy navigation through the multiple images stacks (MIS-browser), the visualization of individual channels and layers and the selection of user defined subregions. In addition, the MIS browser provides useful tools for the visualization and evaluation of the datavolume, as for instance brightness and contrast corrections of individual layers and channels. Moreover, it includes a maximum intensity projection, panning and zoom in/out functions within selected channels or focal planes (x/y) and tracking along the z-axis. The import module accepts any tiff-format and reconstructs the original image arrangement after the user has defined the sequence of images in x/y and z and the number of channels. The implemented export module allows storage of user defined subregions (new single image stacks) for further 3D-reconstruction and evaluation.

3D Reconstructed Cyto-, Muscarinic M2 Receptor, and Fiber Architecture of the Rat Brain Registered to the Waxholm Space Atlas

PubMed Central

Schubert, Nicole; Axer, Markus; Schober, Martin; Huynh, Anh-Minh; Huysegoms, Marcel; Palomero-Gallagher, Nicola; Bjaalie, Jan G.; Leergaard, Trygve B.; Kirlangic, Mehmet E.; Amunts, Katrin; Zilles, Karl

2016-01-01

High-resolution multiscale and multimodal 3D models of the brain are essential tools to understand its complex structural and functional organization. Neuroimaging techniques addressing different aspects of brain organization should be integrated in a reference space to enable topographically correct alignment and subsequent analysis of the various datasets and their modalities. The Waxholm Space (http://software.incf.org/software/waxholm-space) is a publicly available 3D coordinate-based standard reference space for the mapping and registration of neuroanatomical data in rodent brains. This paper provides a newly developed pipeline combining imaging and reconstruction steps with a novel registration strategy to integrate new neuroimaging modalities into the Waxholm Space atlas. As a proof of principle, we incorporated large scale high-resolution cyto-, muscarinic M2 receptor, and fiber architectonic images of rat brains into the 3D digital MRI based atlas of the Sprague Dawley rat in Waxholm Space. We describe the whole workflow, from image acquisition to reconstruction and registration of these three modalities into the Waxholm Space rat atlas. The registration of the brain sections into the atlas is performed by using both linear and non-linear transformations. The validity of the procedure is qualitatively demonstrated by visual inspection, and a quantitative evaluation is performed by measurement of the concordance between representative atlas-delineated regions and the same regions based on receptor or fiber architectonic data. This novel approach enables for the first time the generation of 3D reconstructed volumes of nerve fibers and fiber tracts, or of muscarinic M2 receptor density distributions, in an entire rat brain. Additionally, our pipeline facilitates the inclusion of further neuroimaging datasets, e.g., 3D reconstructed volumes of histochemical stainings or of the regional distributions of multiple other receptor types, into the Waxholm Space. Thereby, a multiscale and multimodal rat brain model was created in the Waxholm Space atlas of the rat brain. Since the registration of these multimodal high-resolution datasets into the same coordinate system is an indispensable requisite for multi-parameter analyses, this approach enables combined studies on receptor and cell distributions as well as fiber densities in the same anatomical structures at microscopic scales for the first time. PMID:27199682

3D Reconstructed Cyto-, Muscarinic M2 Receptor, and Fiber Architecture of the Rat Brain Registered to the Waxholm Space Atlas.

PubMed

Schubert, Nicole; Axer, Markus; Schober, Martin; Huynh, Anh-Minh; Huysegoms, Marcel; Palomero-Gallagher, Nicola; Bjaalie, Jan G; Leergaard, Trygve B; Kirlangic, Mehmet E; Amunts, Katrin; Zilles, Karl

2016-01-01

High-resolution multiscale and multimodal 3D models of the brain are essential tools to understand its complex structural and functional organization. Neuroimaging techniques addressing different aspects of brain organization should be integrated in a reference space to enable topographically correct alignment and subsequent analysis of the various datasets and their modalities. The Waxholm Space (http://software.incf.org/software/waxholm-space) is a publicly available 3D coordinate-based standard reference space for the mapping and registration of neuroanatomical data in rodent brains. This paper provides a newly developed pipeline combining imaging and reconstruction steps with a novel registration strategy to integrate new neuroimaging modalities into the Waxholm Space atlas. As a proof of principle, we incorporated large scale high-resolution cyto-, muscarinic M2 receptor, and fiber architectonic images of rat brains into the 3D digital MRI based atlas of the Sprague Dawley rat in Waxholm Space. We describe the whole workflow, from image acquisition to reconstruction and registration of these three modalities into the Waxholm Space rat atlas. The registration of the brain sections into the atlas is performed by using both linear and non-linear transformations. The validity of the procedure is qualitatively demonstrated by visual inspection, and a quantitative evaluation is performed by measurement of the concordance between representative atlas-delineated regions and the same regions based on receptor or fiber architectonic data. This novel approach enables for the first time the generation of 3D reconstructed volumes of nerve fibers and fiber tracts, or of muscarinic M2 receptor density distributions, in an entire rat brain. Additionally, our pipeline facilitates the inclusion of further neuroimaging datasets, e.g., 3D reconstructed volumes of histochemical stainings or of the regional distributions of multiple other receptor types, into the Waxholm Space. Thereby, a multiscale and multimodal rat brain model was created in the Waxholm Space atlas of the rat brain. Since the registration of these multimodal high-resolution datasets into the same coordinate system is an indispensable requisite for multi-parameter analyses, this approach enables combined studies on receptor and cell distributions as well as fiber densities in the same anatomical structures at microscopic scales for the first time.

Digital 3D facial reconstruction of George Washington

NASA Astrophysics Data System (ADS)

Razdan, Anshuman; Schwartz, Jeff; Tocheri, Mathew; Hansford, Dianne

2006-02-01

PRISM is a focal point of interdisciplinary research in geometric modeling, computer graphics and visualization at Arizona State University. Many projects in the last ten years have involved laser scanning, geometric modeling and feature extraction from such data as archaeological vessels, bones, human faces, etc. This paper gives a brief overview of a recently completed project on the 3D reconstruction of George Washington (GW). The project brought together forensic anthropologists, digital artists and computer scientists in the 3D digital reconstruction of GW at 57, 45 and 19 including detailed heads and bodies. Although many other scanning projects such as the Michelangelo project have successfully captured fine details via laser scanning, our project took it a step further, i.e. to predict what that individual (in the sculpture) might have looked like both in later and earlier years, specifically the process to account for reverse aging. Our base data was GWs face mask at Morgan Library and Hudons bust of GW at Mount Vernon, both done when GW was 53. Additionally, we scanned the statue at the Capitol in Richmond, VA; various dentures, and other items. Other measurements came from clothing and even portraits of GW. The digital GWs were then milled in high density foam for a studio to complete the work. These will be unveiled at the opening of the new education center at Mt Vernon in fall 2006.

Three-dimensional reconstruction of indoor whole elements based on mobile LiDAR point cloud data

NASA Astrophysics Data System (ADS)

Gong, Yuejian; Mao, Wenbo; Bi, Jiantao; Ji, Wei; He, Zhanjun

2014-11-01

Ground-based LiDAR is one of the most effective city modeling tools at present, which has been widely used for three-dimensional reconstruction of outdoor objects. However, as for indoor objects, there are some technical bottlenecks due to lack of GPS signal. In this paper, based on the high-precision indoor point cloud data which was obtained by LiDAR, an international advanced indoor mobile measuring equipment, high -precision model was fulfilled for all indoor ancillary facilities. The point cloud data we employed also contain color feature, which is extracted by fusion with CCD images. Thus, it has both space geometric feature and spectral information which can be used for constructing objects' surface and restoring color and texture of the geometric model. Based on Autodesk CAD platform and with help of PointSence plug, three-dimensional reconstruction of indoor whole elements was realized. Specifically, Pointools Edit Pro was adopted to edit the point cloud, then different types of indoor point cloud data was processed, including data format conversion, outline extracting and texture mapping of the point cloud model. Finally, three-dimensional visualization of the real-world indoor was completed. Experiment results showed that high-precision 3D point cloud data obtained by indoor mobile measuring equipment can be used for indoor whole elements' 3-d reconstruction and that methods proposed in this paper can efficiently realize the 3 -d construction of indoor whole elements. Moreover, the modeling precision could be controlled within 5 cm, which was proved to be a satisfactory result.

High precision localization of intracerebral hemorrhage based on 3D MPR on head CT images

NASA Astrophysics Data System (ADS)

Sun, Jianyong; Hou, Xiaoshuai; Sun, Shujie; Zhang, Jianguo

2017-03-01

The key step for minimally invasive intracerebral hemorrhage surgery is precisely positioning the hematoma location in the brain before and during the hematoma surgery, which can significantly improves the success rate of puncture hematoma. We designed a 3D computerized surgical plan (CSP) workstation precisely to locate brain hematoma based on Multi-Planar Reconstruction (MPR) visualization technique. We used ten patients' CT/MR studies to verify our designed CSP intracerebral hemorrhage localization method. With the doctor's assessment and comparing with the results of manual measurements, the output of CSP WS for hematoma surgery is more precise and reliable than manual procedure.

Visualising a rare and complex case of advanced hilar cholangiocarcinoma.

PubMed

Qu, Jia; Fung, Albert; Kelly, Paul; Tait, Gordon; Greig, Paul D; Agur, Anne; McGilvray, Ian D; Jenkinson, Jodie

2017-01-01

The Toronto Video Atlas of Liver, Pancreas, Biliary, and Transplant Surgery (TVASurg) is a free online library of three-dimensional (3D) animation-enhanced surgical videos, designed to instruct surgical fellows in hepato-pancreato-biliary (HPB) and transplant procedures. The video 'Klatskin tumours: Extended left hepatectomy with complex portal vein reconstruction and in situ cold perfusion of the liver', which is available to watch at http://TVASurg.ca , is a unique and valuable visual resource for surgeons in training to assist them in learning this rare procedure. This paper describes the methodologies used in producing this 3D animation-enhanced surgical video.

New and emerging patient-centered CT imaging and image-guided treatment paradigms for maxillofacial trauma.

PubMed

Dreizin, David; Nam, Arthur J; Hirsch, Jeffrey; Bernstein, Mark P

2018-06-20

This article reviews the conceptual framework, available evidence, and practical considerations pertaining to nascent and emerging advances in patient-centered CT-imaging and CT-guided surgery for maxillofacial trauma. These include cinematic rendering-a novel method for advanced 3D visualization, incorporation of quantitative CT imaging into the assessment of orbital fractures, low-dose CT imaging protocols made possible with contemporary scanners and reconstruction techniques, the rapidly growing use of cone-beam CT, virtual fracture reduction with design software for surgical pre-planning, the use of 3D printing for fabricating models and implants, and new avenues in CT-guided computer-aided surgery.

Silhouettes - An automated three-dimensional plume visualization and tracking system for environmental monitoring

NASA Technical Reports Server (NTRS)

Cambridge, Vivien J.; Magee, Ronald G.

1993-01-01

The method of silhouettes proceeds from the premise that the 3D location and shape of an arbitrary object can be approximated via the cross section of a series of conical volumes whose focal points are arranged at sites surrounding the object; the projection of each conical volume onto a picture plane at each focal point is identical to a projection of the outline of the object onto that picture plane. Attention is presently given to the use of the silhouettes method for gas plume dispersion monitoring through the 3D reconstruction of plumes from imagery acquired at strategically located stations in the plumes' path.

The use of 3D-printed titanium mesh tray in treating complex comminuted mandibular fractures

PubMed Central

Ma, Junli; Ma, Limin; Wang, Zhifa; Zhu, Xiongjie; Wang, Weijian

2017-01-01

Abstract Rationale: Precise bony reduction and reconstruction of optimal contour in treating comminuted mandibular fractures is very difficult using traditional techniques and devices. The aim of this report is to introduce our experiences in using virtual surgery and three-dimensional (3D) printing technique in treating this clinical challenge. Patient concerns: A 26-year-old man presented with severe trauma in the maxillofacial area due to fall from height. Diagnosis: Computed tomography images revealed middle face fractures and comminuted mandibular fracture including bilateral condyles. Interventions and outcomes: The computed tomography data was used to construct the 3D cranio-maxillofacial models; then the displaced bone fragments were virtually reduced. On the basis of the finalized model, a customized titanium mesh tray was designed and fabricated using selective laser melting technology. During the surgery, a submandibular approach was adopted to repair the mandibular fracture. The reduction and fixation were performed according to preoperative plan, the bone defects in the mental area were reconstructed with iliac bone graft. The 3D-printed mesh tray served as an intraoperative template and carrier of bone graft. The healing process was uneventful, and the patient was satisfied with the mandible contour. Lessons: Virtual surgical planning combined with 3D printing technology enables surgeon to visualize the reduction process preoperatively and guide intraoperative reduction, making the reduction less time consuming and more precise. 3D-printed titanium mesh tray can provide more satisfactory esthetic outcomes in treating complex comminuted mandibular fractures. PMID:28682875

MultiMap: A Tool to Automatically Extract and Analyse Spatial Microscopic Data From Large Stacks of Confocal Microscopy Images

PubMed Central

Varando, Gherardo; Benavides-Piccione, Ruth; Muñoz, Alberto; Kastanauskaite, Asta; Bielza, Concha; Larrañaga, Pedro; DeFelipe, Javier

2018-01-01

The development of 3D visualization and reconstruction methods to analyse microscopic structures at different levels of resolutions is of great importance to define brain microorganization and connectivity. MultiMap is a new tool that allows the visualization, 3D segmentation and quantification of fluorescent structures selectively in the neuropil from large stacks of confocal microscopy images. The major contribution of this tool is the posibility to easily navigate and create regions of interest of any shape and size within a large brain area that will be automatically 3D segmented and quantified to determine the density of puncta in the neuropil. As a proof of concept, we focused on the analysis of glutamatergic and GABAergic presynaptic axon terminals in the mouse hippocampal region to demonstrate its use as a tool to provide putative excitatory and inhibitory synaptic maps. The segmentation and quantification method has been validated over expert labeled images of the mouse hippocampus and over two benchmark datasets, obtaining comparable results to the expert detections. PMID:29875639

MultiMap: A Tool to Automatically Extract and Analyse Spatial Microscopic Data From Large Stacks of Confocal Microscopy Images.

PubMed

Varando, Gherardo; Benavides-Piccione, Ruth; Muñoz, Alberto; Kastanauskaite, Asta; Bielza, Concha; Larrañaga, Pedro; DeFelipe, Javier

2018-01-01

The development of 3D visualization and reconstruction methods to analyse microscopic structures at different levels of resolutions is of great importance to define brain microorganization and connectivity. MultiMap is a new tool that allows the visualization, 3D segmentation and quantification of fluorescent structures selectively in the neuropil from large stacks of confocal microscopy images. The major contribution of this tool is the posibility to easily navigate and create regions of interest of any shape and size within a large brain area that will be automatically 3D segmented and quantified to determine the density of puncta in the neuropil. As a proof of concept, we focused on the analysis of glutamatergic and GABAergic presynaptic axon terminals in the mouse hippocampal region to demonstrate its use as a tool to provide putative excitatory and inhibitory synaptic maps. The segmentation and quantification method has been validated over expert labeled images of the mouse hippocampus and over two benchmark datasets, obtaining comparable results to the expert detections.

High-resolution T1-weighted 3D real IR imaging of the temporal bone using triple-dose contrast material.

PubMed

Naganawa, Shinji; Koshikawa, Tokiko; Nakamura, Tatsuya; Fukatsu, Hiroshi; Ishigaki, Takeo; Aoki, Ikuo

2003-12-01

The small structures in the temporal bone are surrounded by bone and air. The objectives of this study were (a) to compare contrast-enhanced T1-weighted images acquired by fast spin-echo-based three-dimensional real inversion recovery (3D rIR) against those acquired by gradient echo-based 3D SPGR in the visualization of the enhancement of small structures in the temporal bone, and (b) to determine whether either 3D rIR or 3D SPGR is useful for visualizing enhancement of the cochlear lymph fluid. Seven healthy men (age range 27-46 years) volunteered to participate in this study. All MR imaging was performed using a dedicated bilateral quadrature surface phased-array coil for temporal bone imaging at 1.5 T (Visart EX, Toshiba, Tokyo, Japan). The 3D rIR images (TR/TE/TI: 1800 ms/10 ms/500 ms) and flow-compensated 3D SPGR images (TR/TE/FA: 23 ms/10 ms/25 degrees) were obtained with a reconstructed voxel size of 0.6 x 0.7 x 0.8 mm3. Images were acquired before and 1, 90, 180, and 270 min after the administration of triple-dose Gd-DTPA-BMA (0.3 mmol/kg). In post-contrast MR images, the degree of enhancement of the cochlear aqueduct, endolymphatic sac, subarcuate artery, geniculate ganglion of the facial nerve, and cochlear lymph fluid space was assessed by two radiologists. The degree of enhancement was scored as follows: 0 (no enhancement); 1 (slight enhancement); 2 (intermediate between 1 and 3); and 3 (enhancement similar to that of vessels). Enhancement scores for the endolymphatic sac, subarcuate artery, and geniculate ganglion were higher in 3D rIR than in 3D SPGR. Washout of enhancement in the endolymphatic sac appeared to be delayed compared with that in the subarcuate artery, suggesting that the enhancement in the endolymphatic sac may have been due in part to non-vascular tissue enhancement. Enhancement of the cochlear lymph space was not observed in any of the subjects in 3D rIR and 3D SPGR. The 3D rIR sequence may be more sensitive than the 3D SPGR sequence in visualizing the enhancement of small structures in the temporal bone; however, enhancement of the cochlear fluid space could not be visualized even with 3D rIR, triple-dose contrast, and dedicated coils at 1.5 T.

MO-DE-BRA-06: 3D Image Acquisition and Reconstruction Explained with Online Animations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kesner, A

Purpose: Understanding the principles of 3D imaging and image reconstruction is fundamental to the field of medical imaging. Clinicians, technologists, physicists, patients, students, and inquisitive minds all stand to benefit from greater comprehension of the supporting technologies. To help explain the basic principles of 3D imaging, we developed multi-frame animations that convey the concepts of tomographic imaging. The series of free (gif) animations are accessible online, and provide a multimedia introduction to the main concepts of image reconstruction. Methods: Text and animations were created to convey the principles of analytic tomography in CT, PET, and SPECT. Specific topics covered included:more » principles of sinograms/image data storage, forward projection, principles of PET acquisitions, and filtered backprojection. A total of 8 animations were created and presented for CT, PET, and digital phantom formats. In addition, a free executable is also provided to allow users to create their own tomographic animations – providing an opportunity for interaction and personalization to help foster user interest. Results: Tutorial text and animations have been posted online, freely available to view or download. The animations are in first position in a google search of “image reconstruction animations”. The website currently receives approximately 200 hits/month, from all over the world, and the usage is growing. Positive feedback has been collected from users. Conclusion: We identified a need for improved teaching tools to help visualize the (temporally variant) concepts of image reconstruction, and have shown that animations can be a useful tool for this aspect of education. Furthermore, posting animations freely on the web has shown to be a good way to maximize their impact in the community. In future endeavors, we hope to expand this animated content, to cover principles of iterative reconstruction, as well as other phenomena relating to imaging.« less

Combinatorial clustering and Its Application to 3D Polygonal Traffic Sign Reconstruction From Multiple Images

NASA Astrophysics Data System (ADS)

Vallet, B.; Soheilian, B.; Brédif, M.

2014-08-01

The 3D reconstruction of similar 3D objects detected in 2D faces a major issue when it comes to grouping the 2D detections into clusters to be used to reconstruct the individual 3D objects. Simple clustering heuristics fail as soon as similar objects are close. This paper formulates a framework to use the geometric quality of the reconstruction as a hint to do a proper clustering. We present a methodology to solve the resulting combinatorial optimization problem with some simplifications and approximations in order to make it tractable. The proposed method is applied to the reconstruction of 3D traffic signs from their 2D detections to demonstrate its capacity to solve ambiguities.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Harmon, S; Jeraj, R; Galavis, P

Purpose: Sensitivity of PET-derived texture features to reconstruction methods has been reported for features extracted from axial planes; however, studies often utilize three dimensional techniques. This work aims to quantify the impact of multi-plane (3D) vs. single-plane (2D) feature extraction on radiomics-based analysis, including sensitivity to reconstruction parameters and potential loss of spatial information. Methods: Twenty-three patients with solid tumors underwent [{sup 18}F]FDG PET/CT scans under identical protocols. PET data were reconstructed using five sets of reconstruction parameters. Tumors were segmented using an automatic, in-house algorithm robust to reconstruction variations. 50 texture features were extracted using two Methods: 2D patchesmore » along axial planes and 3D patches. For each method, sensitivity of features to reconstruction parameters was calculated as percent difference relative to the average value across reconstructions. Correlations between feature values were compared when using 2D and 3D extraction. Results: 21/50 features showed significantly different sensitivity to reconstruction parameters when extracted in 2D vs 3D (wilcoxon α<0.05), assessed by overall range of variation, Rangevar(%). Eleven showed greater sensitivity to reconstruction in 2D extraction, primarily first-order and co-occurrence features (average Rangevar increase 83%). The remaining ten showed higher variation in 3D extraction (average Range{sub var}increase 27%), mainly co-occurence and greylevel run-length features. Correlation of feature value extracted in 2D and feature value extracted in 3D was poor (R<0.5) in 12/50 features, including eight co-occurrence features. Feature-to-feature correlations in 2D were marginally higher than 3D, ∣R∣>0.8 in 16% and 13% of all feature combinations, respectively. Larger sensitivity to reconstruction parameters were seen for inter-feature correlation in 2D(σ=6%) than 3D (σ<1%) extraction. Conclusion: Sensitivity and correlation of various texture features were shown to significantly differ between 2D and 3D extraction. Additionally, inter-feature correlations were more sensitive to reconstruction variation using single-plane extraction. This work highlights a need for standardized feature extraction/selection techniques in radiomics.« less

Real-time 3D image reconstruction guidance in liver resection surgery.

PubMed

Soler, Luc; Nicolau, Stephane; Pessaux, Patrick; Mutter, Didier; Marescaux, Jacques

2014-04-01

Minimally invasive surgery represents one of the main evolutions of surgical techniques. However, minimally invasive surgery adds difficulty that can be reduced through computer technology. From a patient's medical image [US, computed tomography (CT) or MRI], we have developed an Augmented Reality (AR) system that increases the surgeon's intraoperative vision by providing a virtual transparency of the patient. AR is based on two major processes: 3D modeling and visualization of anatomical or pathological structures appearing in the medical image, and the registration of this visualization onto the real patient. We have thus developed a new online service, named Visible Patient, providing efficient 3D modeling of patients. We have then developed several 3D visualization and surgical planning software tools to combine direct volume rendering and surface rendering. Finally, we have developed two registration techniques, one interactive and one automatic providing intraoperative augmented reality view. From January 2009 to June 2013, 769 clinical cases have been modeled by the Visible Patient service. Moreover, three clinical validations have been realized demonstrating the accuracy of 3D models and their great benefit, potentially increasing surgical eligibility in liver surgery (20% of cases). From these 3D models, more than 50 interactive AR-assisted surgical procedures have been realized illustrating the potential clinical benefit of such assistance to gain safety, but also current limits that automatic augmented reality will overcome. Virtual patient modeling should be mandatory for certain interventions that have now to be defined, such as liver surgery. Augmented reality is clearly the next step of the new surgical instrumentation but remains currently limited due to the complexity of organ deformations during surgery. Intraoperative medical imaging used in new generation of automated augmented reality should solve this issue thanks to the development of Hybrid OR.

Intraoperative spatial frequency domain diffuse optical tomography with indo-cyanine green (ICG) fluorescence contrast (Conference Presentation)

NASA Astrophysics Data System (ADS)

Chong, Sang Hoon; Parthasarathy, Ashwin B.; Kavuri, Venkaiah C.; Moscatelli, Frank A.; Singhal, Sunil; Yodh, Arjun G.

2017-02-01

Surgical resection is the most effective treatment strategy for solid tumors, but complete removal of the tumor is critical for post-surgical recovery/long-term survival and is dependent on correct identification of the tumor margin and accurate excision of microscopic residual tumor in the surgical field. Fluorescence image guided surgery is an emerging technique that has shown promise for intraoperative location of tumors and tumor margins. Current versions of such intraoperative fluorescence imaging, however, are generally limited to 2D near-surface images, i.e., without information about tumor depth. Here we present an intraoperative fluorescence imaging system for 3D volumetric imaging of tumors; the system uses spatial frequency domain diffuse optical tomography with an analytic inversion reconstruction method. The new instrument can derive depth-sensitive 3D tumor images at depths up to 1 cm, and it employs compact epi-imaging and illumination suitable for the operating room, with quasi-real-time image reconstruction for surgical visualization. We present experimental results with FDA-approved Indocynanine Green using an extensive array of tissue phantoms and in a pilot in-vivo study.

A micro X-ray computed tomography dataset of South African hermit crabs (Crustacea: Decapoda: Anomura: Paguroidea) containing scans of two rare specimens and three recently described species.

PubMed

Landschoff, Jannes; Du Plessis, Anton; Griffiths, Charles L

2018-04-01

Along with the conventional deposition of physical types at natural history museums, the deposition of 3-dimensional (3D) image data has been proposed for rare and valuable museum specimens, such as irreplaceable type material. Micro computed tomography (μCT) scan data of 5 hermit crab species from South Africa, including rare specimens and type material, depicted main identification characteristics of calcified body parts. However, low-image contrasts, especially in larger (>50 mm total length) specimens, did not allow sufficient 3D reconstructions of weakly calcified and fine characteristics, such as soft tissue of the pleon, mouthparts, gills, and setation. Reconstructions of soft tissue were sometimes possible, depending on individual sample and scanning characteristics. The raw data of seven scans are publicly available for download from the GigaDB repository. Calcified body parts visualized from μCT data can aid taxonomic validation and provide additional, virtual deposition of rare specimens. The use of a nondestructive, nonstaining μCT approach for taxonomy, reconstructions of soft tissue structures, microscopic spines, and setae depend on species characteristics. Constrained to these limitations, the presented dataset can be used for future morphological studies. However, our virtual specimens will be most valuable to taxonomists who can download a digital avatar for 3D examination. Simultaneously, in the event of physical damage to or loss of the original physical specimen, this dataset serves as a vital insurance policy.

Spatial Mapping of Structural and Connectional Imaging Data for the Developing Human Brain with Diffusion Tensor Imaging

PubMed Central

Ouyang, Austin; Jeon, Tina; Sunkin, Susan M.; Pletikos, Mihovil; Sedmak, Goran; Sestan, Nenad; Lein, Ed S.; Huang, Hao

2014-01-01

During human brain development from fetal stage to adulthood, the white matter (WM) tracts undergo dramatic changes. Diffusion tensor imaging (DTI), a widely used magnetic resonance imaging (MRI) modality, offers insight into the dynamic changes of WM fibers as these fibers can be noninvasively traced and three-dimensionally (3D) reconstructed with DTI tractography. The DTI and conventional T1 weighted MRI images also provide sufficient cortical anatomical details for mapping the cortical regions of interests (ROIs). In this paper, we described basic concepts and methods of DTI techniques that can be used to trace major WM tracts noninvasively from fetal brain of 14 postconceptional weeks (pcw) to adult brain. We applied these techniques to acquire DTI data and trace, reconstruct and visualize major WM tracts during development. After categorizing major WM fiber bundles into five unique functional tract groups, namely limbic, brain stem, projection, commissural and association tracts, we revealed formation and maturation of these 3D reconstructed WM tracts of the developing human brain. The structural and connectional imaging data offered by DTI provides the anatomical backbone of transcriptional atlas of the developing human brain. PMID:25448302

Three-Dimensional Reconstruction of the Virtual Plant Branching Structure Based on Terrestrial LIDAR Technologies and L-System

NASA Astrophysics Data System (ADS)

Gong, Y.; Yang, Y.; Yang, X.

2018-04-01

For the purpose of extracting productions of some specific branching plants effectively and realizing its 3D reconstruction, Terrestrial LiDAR data was used as extraction source of production, and a 3D reconstruction method based on Terrestrial LiDAR technologies combined with the L-system was proposed in this article. The topology structure of the plant architectures was extracted using the point cloud data of the target plant with space level segmentation mechanism. Subsequently, L-system productions were obtained and the structural parameters and production rules of branches, which fit the given plant, was generated. A three-dimensional simulation model of target plant was established combined with computer visualization algorithm finally. The results suggest that the method can effectively extract a given branching plant topology and describes its production, realizing the extraction of topology structure by the computer algorithm for given branching plant and also simplifying the extraction of branching plant productions which would be complex and time-consuming by L-system. It improves the degree of automation in the L-system extraction of productions of specific branching plants, providing a new way for the extraction of branching plant production rules.

Automatic segmentation and 3D reconstruction of intravascular ultrasound images for a fast preliminar evaluation of vessel pathologies.

PubMed

Sanz-Requena, Roberto; Moratal, David; García-Sánchez, Diego Ramón; Bodí, Vicente; Rieta, José Joaquín; Sanchis, Juan Manuel

2007-03-01

Intravascular ultrasound (IVUS) imaging is used along with X-ray coronary angiography to detect vessel pathologies. Manual analysis of IVUS images is slow and time-consuming and it is not feasible for clinical purposes. A semi-automated method is proposed to generate 3D reconstructions from IVUS video sequences, so that a fast diagnose can be easily done, quantifying plaque length and severity as well as plaque volume of the vessels under study. The methodology described in this work has four steps: a pre-processing of IVUS images, a segmentation of media-adventitia contour, a detection of intima and plaque and a 3D reconstruction of the vessel. Preprocessing is intended to remove noise from the images without blurring the edges. Segmentation of media-adventitia contour is achieved using active contours (snakes). In particular, we use the gradient vector flow (GVF) as external force for the snakes. The detection of lumen border is obtained taking into account gray-level information of the inner part of the previously detected contours. A knowledge-based approach is used to determine which level of gray corresponds statistically to the different regions of interest: intima, plaque and lumen. The catheter region is automatically discarded. An estimate of plaque type is also given. Finally, 3D reconstruction of all detected regions is made. The suitability of this methodology has been verified for the analysis and visualization of plaque length, stenosis severity, automatic detection of the most problematic regions, calculus of plaque volumes and a preliminary estimation of plaque type obtaining for automatic measures of lumen and vessel area an average error smaller than 1mm(2) (equivalent aproximately to 10% of the average measure), for calculus of plaque and lumen volume errors smaller than 0.5mm(3) (equivalent approximately to 20% of the average measure) and for plaque type estimates a mismatch of less than 8% in the analysed frames.

Comparison of alternative image reformatting techniques in micro-computed tomography and tooth clearing for detailed canal morphology.

PubMed

Lee, Ki-Wook; Kim, Yeun; Perinpanayagam, Hiran; Lee, Jong-Ki; Yoo, Yeon-Jee; Lim, Sang-Min; Chang, Seok Woo; Ha, Byung-Hyun; Zhu, Qiang; Kum, Kee-Yeon

2014-03-01

Micro-computed tomography (MCT) shows detailed root canal morphology that is not seen with traditional tooth clearing. However, alternative image reformatting techniques in MCT involving 2-dimensional (2D) minimum intensity projection (MinIP) and 3-dimensional (3D) volume-rendering reconstruction have not been directly compared with clearing. The aim was to compare alternative image reformatting techniques in MCT with tooth clearing on the mesiobuccal (MB) root of maxillary first molars. Eighteen maxillary first molar MB roots were scanned, and 2D MinIP and 3D volume-rendered images were reconstructed. Subsequently, the same MB roots were processed by traditional tooth clearing. Images from 2D, 3D, 2D + 3D, and clearing techniques were assessed by 4 endodontists to classify canal configuration and to identify fine anatomic structures such as accessory canals, intercanal communications, and loops. All image reformatting techniques in MCT showed detailed configurations and numerous fine structures, such that none were classified as simple type I or II canals; several were classified as types III and IV according to Weine classification or types IV, V, and VI according to Vertucci; and most were nonclassifiable because of their complexity. The clearing images showed less detail, few fine structures, and numerous type I canals. Classification of canal configuration was in 100% intraobserver agreement for all 18 roots visualized by any of the image reformatting techniques in MCT but for only 4 roots (22.2%) classified according to Weine and 6 (33.3%) classified according to Vertucci, when using the clearing technique. The combination of 2D MinIP and 3D volume-rendered images showed the most detailed canal morphology and fine anatomic structures. Copyright © 2014 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

A dataset of stereoscopic images and ground-truth disparity mimicking human fixations in peripersonal space

PubMed Central

Canessa, Andrea; Gibaldi, Agostino; Chessa, Manuela; Fato, Marco; Solari, Fabio; Sabatini, Silvio P.

2017-01-01

Binocular stereopsis is the ability of a visual system, belonging to a live being or a machine, to interpret the different visual information deriving from two eyes/cameras for depth perception. From this perspective, the ground-truth information about three-dimensional visual space, which is hardly available, is an ideal tool both for evaluating human performance and for benchmarking machine vision algorithms. In the present work, we implemented a rendering methodology in which the camera pose mimics realistic eye pose for a fixating observer, thus including convergent eye geometry and cyclotorsion. The virtual environment we developed relies on highly accurate 3D virtual models, and its full controllability allows us to obtain the stereoscopic pairs together with the ground-truth depth and camera pose information. We thus created a stereoscopic dataset: GENUA PESTO—GENoa hUman Active fixation database: PEripersonal space STereoscopic images and grOund truth disparity. The dataset aims to provide a unified framework useful for a number of problems relevant to human and computer vision, from scene exploration and eye movement studies to 3D scene reconstruction. PMID:28350382

StructMap: Elastic Distance Analysis of Electron Microscopy Maps for Studying Conformational Changes.

PubMed

Sanchez Sorzano, Carlos Oscar; Alvarez-Cabrera, Ana Lucia; Kazemi, Mohsen; Carazo, Jose María; Jonić, Slavica

2016-04-26

Single-particle electron microscopy (EM) has been shown to be very powerful for studying structures and associated conformational changes of macromolecular complexes. In the context of analyzing conformational changes of complexes, distinct EM density maps obtained by image analysis and three-dimensional (3D) reconstruction are usually analyzed in 3D for interpretation of structural differences. However, graphic visualization of these differences based on a quantitative analysis of elastic transformations (deformations) among density maps has not been done yet due to a lack of appropriate methods. Here, we present an approach that allows such visualization. This approach is based on statistical analysis of distances among elastically aligned pairs of EM maps (one map is deformed to fit the other map), and results in visualizing EM maps as points in a lower-dimensional distance space. The distances among points in the new space can be analyzed in terms of clusters or trajectories of points related to potential conformational changes. The results of the method are shown with synthetic and experimental EM maps at different resolutions. Copyright © 2016 Biophysical Society. Published by Elsevier Inc. All rights reserved.

LONI visualization environment.

PubMed

Dinov, Ivo D; Valentino, Daniel; Shin, Bae Cheol; Konstantinidis, Fotios; Hu, Guogang; MacKenzie-Graham, Allan; Lee, Erh-Fang; Shattuck, David; Ma, Jeff; Schwartz, Craig; Toga, Arthur W

2006-06-01

Over the past decade, the use of informatics to solve complex neuroscientific problems has increased dramatically. Many of these research endeavors involve examining large amounts of imaging, behavioral, genetic, neurobiological, and neuropsychiatric data. Superimposing, processing, visualizing, or interpreting such a complex cohort of datasets frequently becomes a challenge. We developed a new software environment that allows investigators to integrate multimodal imaging data, hierarchical brain ontology systems, on-line genetic and phylogenic databases, and 3D virtual data reconstruction models. The Laboratory of Neuro Imaging visualization environment (LONI Viz) consists of the following components: a sectional viewer for imaging data, an interactive 3D display for surface and volume rendering of imaging data, a brain ontology viewer, and an external database query system. The synchronization of all components according to stereotaxic coordinates, region name, hierarchical ontology, and genetic labels is achieved via a comprehensive BrainMapper functionality, which directly maps between position, structure name, database, and functional connectivity information. This environment is freely available, portable, and extensible, and may prove very useful for neurobiologists, neurogenetisists, brain mappers, and for other clinical, pedagogical, and research endeavors.

A Visual Servoing-Based Method for ProCam Systems Calibration

PubMed Central

Berry, Francois; Aider, Omar Ait; Mosnier, Jeremie

2013-01-01

Projector-camera systems are currently used in a wide field of applications, such as 3D reconstruction and augmented reality, and can provide accurate measurements, depending on the configuration and calibration. Frequently, the calibration task is divided into two steps: camera calibration followed by projector calibration. The latter still poses certain problems that are not easy to solve, such as the difficulty in obtaining a set of 2D–3D points to compute the projection matrix between the projector and the world. Existing methods are either not sufficiently accurate or not flexible. We propose an easy and automatic method to calibrate such systems that consists in projecting a calibration pattern and superimposing it automatically on a known printed pattern. The projected pattern is provided by a virtual camera observing a virtual pattern in an OpenGL model. The projector displays what the virtual camera visualizes. Thus, the projected pattern can be controlled and superimposed on the printed one with the aid of visual servoing. Our experimental results compare favorably with those of other methods considering both usability and accuracy. PMID:24084121

Validation of percutaneous puncture trajectory during renal access using 4D ultrasound reconstruction

NASA Astrophysics Data System (ADS)

Rodrigues, Pedro L.; Rodrigues, Nuno F.; Fonseca, Jaime C.; Vilaça, João. L.

2015-03-01

An accurate percutaneous puncture is essential for disintegration and removal of renal stones. Although this procedure has proven to be safe, some organs surrounding the renal target might be accidentally perforated. This work describes a new intraoperative framework where tracked surgical tools are superimposed within 4D ultrasound imaging for security assessment of the percutaneous puncture trajectory (PPT). A PPT is first generated from the skin puncture site towards an anatomical target, using the information retrieved by electromagnetic motion tracking sensors coupled to surgical tools. Then, 2D ultrasound images acquired with a tracked probe are used to reconstruct a 4D ultrasound around the PPT under GPU processing. Volume hole-filling was performed in different processing time intervals by a tri-linear interpolation method. At spaced time intervals, the volume of the anatomical structures was segmented to ascertain if any vital structure is in between PPT and might compromise the surgical success. To enhance the volume visualization of the reconstructed structures, different render transfer functions were used. Results: Real-time US volume reconstruction and rendering with more than 25 frames/s was only possible when rendering only three orthogonal slice views. When using the whole reconstructed volume one achieved 8-15 frames/s. 3 frames/s were reached when one introduce the segmentation and detection if some structure intersected the PPT. The proposed framework creates a virtual and intuitive platform that can be used to identify and validate a PPT to safely and accurately perform the puncture in percutaneous nephrolithotomy.

Evaluation of algorithms for point cloud surface reconstruction through the analysis of shape parameters

NASA Astrophysics Data System (ADS)

Cao, Lu; Verbeek, Fons J.

2012-03-01

In computer graphics and visualization, reconstruction of a 3D surface from a point cloud is an important research area. As the surface contains information that can be measured, i.e. expressed in features, the application of surface reconstruction can be potentially important for application in bio-imaging. Opportunities in this application area are the motivation for this study. In the past decade, a number of algorithms for surface reconstruction have been proposed. Generally speaking, these methods can be separated into two categories: i.e., explicit representation and implicit approximation. Most of the aforementioned methods are firmly based in theory; however, so far, no analytical evaluation between these methods has been presented. The straightforward way of evaluation has been by convincing through visual inspection. Through evaluation we search for a method that can precisely preserve the surface characteristics and that is robust in the presence of noise. The outcome will be used to improve reliability in surface reconstruction of biological models. We, therefore, use an analytical approach by selecting features as surface descriptors and measure these features in varying conditions. We selected surface distance, surface area and surface curvature as three major features to compare quality of the surface created by the different algorithms. Our starting point has been ground truth values obtained from analytical shapes such as the sphere and the ellipsoid. In this paper we present four classical surface reconstruction methods from the two categories mentioned above, i.e. the Power Crust, the Robust Cocone, the Fourier-based method and the Poisson reconstruction method. The results obtained from our experiments indicate that Poisson reconstruction method performs the best in the presence of noise.

An improved three-dimension reconstruction method based on guided filter and Delaunay

NASA Astrophysics Data System (ADS)

Liu, Yilin; Su, Xiu; Liang, Haitao; Xu, Huaiyuan; Wang, Yi; Chen, Xiaodong

2018-01-01

Binocular stereo vision is becoming a research hotspot in the area of image processing. Based on traditional adaptive-weight stereo matching algorithm, we improve the cost volume by averaging the AD (Absolute Difference) of RGB color channels and adding x-derivative of the grayscale image to get the cost volume. Then we use guided filter in the cost aggregation step and weighted median filter for post-processing to address the edge problem. In order to get the location in real space, we combine the deep information with the camera calibration to project each pixel in 2D image to 3D coordinate matrix. We add the concept of projection to region-growing algorithm for surface reconstruction, its specific operation is to project all the points to a 2D plane through the normals of clouds and return the results back to 3D space according to these connection relationship among the points in 2D plane. During the triangulation in 2D plane, we use Delaunay algorithm because it has optimal quality of mesh. We configure OpenCV and pcl on Visual Studio for testing, and the experimental results show that the proposed algorithm have higher computational accuracy of disparity and can realize the details of the real mesh model.

A novel cost-effective computer-assisted imaging technology for accurate placement of thoracic pedicle screws.

PubMed

Abe, Yuichiro; Ito, Manabu; Abumi, Kuniyoshi; Kotani, Yoshihisa; Sudo, Hideki; Minami, Akio

2011-11-01

Use of computer-assisted spine surgery (CASS) technologies, such as navigation systems, to improve the accuracy of pedicle screw (PS) placement is increasingly popular. Despite of their benefits, previous CASS systems are too expensive to be ubiquitously employed, and more affordable and portable systems are desirable. The aim of this study was to introduce a novel and affordable computer-assisted technique that 3-dimensionally visualizes anatomical features of the pedicles and assists in PS insertion. The authors have termed this the 3D-visual guidance technique for inserting pedicle screws (3D-VG TIPS). The 3D-VG technique for placing PSs requires only a consumer-class computer with an inexpensive 3D DICOM viewer; other special equipment is unnecessary. Preoperative CT data of the spine were collected for each patient using the 3D-VG TIPS. In this technique, the anatomical axis of each pedicle can be analyzed by volume-rendered 3D models, as with existing navigation systems, and both the ideal entry point and the trajectory of each PS can be visualized on the surface of 3D-rendered images. Intraoperative guidance slides are made from these images and displayed on a TV monitor in the operating room. The surgeon can insert PSs according to these guidance slides. The authors enrolled 30 patients with adolescent idiopathic scoliosis (AIS) who underwent posterior fusion with segmental screw fixation for validation of this technique. The novel technique allowed surgeons, from office or home, to evaluate the precise anatomy of each pedicle and the risks of screw misplacement, and to perform 3D preoperative planning for screw placement on their own computer. Looking at both 3D guidance images on a TV monitor and the bony structures of the posterior elements in each patient in the operating theater, surgeons were able to determine the best entry point for each PS with ease and confidence. Using the current technique, the screw malposition rate was 4.5% in the thoracic region in corrective surgery for AIS. The authors found that 3D-VG TIPS worked on a consumer-class computer and easily visualized the ideal entry point and trajectory of PSs in any operating theater without costly special equipment. This new technique is suitable for preoperative planning and intraoperative guidance when performing reconstructive surgery with PSs.

3D coherent X-ray diffractive imaging of an Individual colloidal crystal grain

NASA Astrophysics Data System (ADS)

Shabalin, A.; Meijer, J.-M.; Sprung, M.; Petukhov, A. V.; Vartanyants, I. A.

Self-assembled colloidal crystals represent an important model system to study nucleation phenomena and solid-solid phase transitions. They are attractive for applications in photonics and sensorics. We present results of a coherent x-ray diffractive imaging experiment performed on a single colloidal crystal grain. The full three-dimensional (3D) reciprocal space map measured by an azimuthal rotational scan contained several orders of Bragg reflections together with the coherent interference signal between them. Applying the iterative phase retrieval approach, the 3D structure of the crystal grain was reconstructed and positions of individual colloidal particles were resolved. We identified an exact stacking sequence of hexagonal close-packed layers including planar and linear defects. Our results open up a breakthrough in applications of coherent x-ray diffraction for visualization of the inner 3D structure of different mesoscopic materials, such as photonic crystals. Present address: University of California - San Diego, USA.

Rectification of curved document images based on single view three-dimensional reconstruction.

PubMed

Kang, Lai; Wei, Yingmei; Jiang, Jie; Bai, Liang; Lao, Songyang

2016-10-01

Since distortions in camera-captured document images significantly affect the accuracy of optical character recognition (OCR), distortion removal plays a critical role for document digitalization systems using a camera for image capturing. This paper proposes a novel framework that performs three-dimensional (3D) reconstruction and rectification of camera-captured document images. While most existing methods rely on additional calibrated hardware or multiple images to recover the 3D shape of a document page, or make a simple but not always valid assumption on the corresponding 3D shape, our framework is more flexible and practical since it only requires a single input image and is able to handle a general locally smooth document surface. The main contributions of this paper include a new iterative refinement scheme for baseline fitting from connected components of text line, an efficient discrete vertical text direction estimation algorithm based on convex hull projection profile analysis, and a 2D distortion grid construction method based on text direction function estimation using 3D regularization. In order to examine the performance of our proposed method, both qualitative and quantitative evaluation and comparison with several recent methods are conducted in our experiments. The experimental results demonstrate that the proposed method outperforms relevant approaches for camera-captured document image rectification, in terms of improvements on both visual distortion removal and OCR accuracy.

3D reconstructions with pixel-based images are made possible by digitally clearing plant and animal tissue

USDA-ARS?s Scientific Manuscript database

Reconstruction of 3D images from a series of 2D images has been restricted by the limited capacity to decrease the opacity of surrounding tissue. Commercial software that allows color-keying and manipulation of 2D images in true 3D space allowed us to produce 3D reconstructions from pixel based imag...

Segeberg 1600 - Reconstructing a Historic Town for Virtual Reality Visualisation as AN Immersive Experience

NASA Astrophysics Data System (ADS)

Deggim, S.; Kersten, T. P.; Tschirschwitz, F.; Hinrichsen, N.

2017-11-01

The 3D reconstruction of historic buildings and cities offers an opportunity to experience the history of relevant objects and their development over the centuries. Digital visualisations of such historic objects allow for a more natural view of history as well as showing information that is not possible in a real world setting. New presentation forms, such as the virtual reality (VR) system HTC Vive, can be used to disseminate information in another dimension and simplify the access by changing the user's viewpoint from a listener and viewer into being an integrated part of an interactive situation. In general, this approach is a combination of education and entertainment, also known as "edutainment" or "gamification", a term used in the education sector as describing where motivation to learn is encouraged through adding a competitive element. It is thus a step away from simple consumption of information towards experiencing information and a more literal interpretation of "living history". In this contribution, we present the development of a 3D reconstruction of the two towns Segeberg and Gieschenhagen (today: Bad Segeberg) in Schleswig-Holstein, Germany in the Early Modern Age around 1600. The historic landscape and its conversion from a reconstructed virtual town model into an interactive VR application is also described. The reconstruction is based on a recent digital terrain model as well as survey data of surviving buildings, historic visual information based on historic drawings and written accounts from that era. All datasets are combined to a single walkable virtual world that spans approximately 3 km2.

3D reconstruction of SEM images by use of optical photogrammetry software.

PubMed

Eulitz, Mona; Reiss, Gebhard

2015-08-01

Reconstruction of the three-dimensional (3D) surface of an object to be examined is widely used for structure analysis in science and many biological questions require information about their true 3D structure. For Scanning Electron Microscopy (SEM) there has been no efficient non-destructive solution for reconstruction of the surface morphology to date. The well-known method of recording stereo pair images generates a 3D stereoscope reconstruction of a section, but not of the complete sample surface. We present a simple and non-destructive method of 3D surface reconstruction from SEM samples based on the principles of optical close range photogrammetry. In optical close range photogrammetry a series of overlapping photos is used to generate a 3D model of the surface of an object. We adapted this method to the special SEM requirements. Instead of moving a detector around the object, the object itself was rotated. A series of overlapping photos was stitched and converted into a 3D model using the software commonly used for optical photogrammetry. A rabbit kidney glomerulus was used to demonstrate the workflow of this adaption. The reconstruction produced a realistic and high-resolution 3D mesh model of the glomerular surface. The study showed that SEM micrographs are suitable for 3D reconstruction by optical photogrammetry. This new approach is a simple and useful method of 3D surface reconstruction and suitable for various applications in research and teaching. Copyright © 2015 Elsevier Inc. All rights reserved.

Ghost Particle Velocimetry: Accurate 3D Flow Visualization Using Standard Lab Equipment

NASA Astrophysics Data System (ADS)

Buzzaccaro, Stefano; Secchi, Eleonora; Piazza, Roberto

2013-07-01

We describe and test a new approach to particle velocimetry, based on imaging and cross correlating the scattering speckle pattern generated on a near-field plane by flowing tracers with a size far below the diffraction limit, which allows reconstructing the velocity pattern in microfluidic channels without perturbing the flow. As a matter of fact, adding tracers is not even strictly required, provided that the sample displays sufficiently refractive-index fluctuations. For instance, phase separation in liquid mixtures in the presence of shear is suitable to be directly investigated by this “ghost particle velocimetry” technique, which just requires a microscope with standard lamp illumination equipped with a low-cost digital camera. As a further bonus, the peculiar spatial coherence properties of the illuminating source, which displays a finite longitudinal coherence length, allows for a 3D reconstruction of the profile with a resolution of few tenths of microns and makes the technique suitable to investigate turbid samples with negligible multiple scattering effects.

Framework for 3D histologic reconstruction and fusion with in vivo MRI: Preliminary results of characterizing pulmonary inflammation in a mouse model

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rusu, Mirabela, E-mail: mirabela.rusu@gmail.com; Wang, Haibo; Madabhushi, Anant

Purpose: Pulmonary inflammation is associated with a variety of diseases. Assessing pulmonary inflammation on in vivo imaging may facilitate the early detection and treatment of lung diseases. Although routinely used in thoracic imaging, computed tomography has thus far not been compellingly shown to characterize inflammation in vivo. Alternatively, magnetic resonance imaging (MRI) is a nonionizing radiation technique to better visualize and characterize pulmonary tissue. Prior to routine adoption of MRI for early characterization of inflammation in humans, a rigorous and quantitative characterization of the utility of MRI to identify inflammation is required. Such characterization may be achieved by considering exmore » vivo histology as the ground truth, since it enables the definitive spatial assessment of inflammation. In this study, the authors introduce a novel framework to integrate 2D histology, ex vivo and in vivo imaging to enable the mapping of the extent of disease from ex vivo histology onto in vivo imaging, with the goal of facilitating computerized feature analysis and interrogation of disease appearance on in vivo imaging. The authors’ framework was evaluated in a preclinical preliminary study aimed to identify computer extracted features on in vivo MRI associated with chronic pulmonary inflammation. Methods: The authors’ image analytics framework first involves reconstructing the histologic volume in 3D from individual histology slices. Second, the authors map the disease ground truth onto in vivo MRI via coregistration with 3D histology using the ex vivo lung MRI as a conduit. Finally, computerized feature analysis of the disease extent is performed to identify candidate in vivo imaging signatures of disease presence and extent. Results: The authors evaluated the framework by assessing the quality of the 3D histology reconstruction and the histology—MRI fusion, in the context of an initial use case involving characterization of chronic inflammation in a mouse model. The authors’ evaluation considered three mice, two with an inflammation phenotype and one control. The authors’ iterative 3D histology reconstruction yielded a 70.1% ± 2.7% overlap with the ex vivo MRI volume. Across a total of 17 anatomic landmarks manually delineated at the division of airways, the target registration error between the ex vivo MRI and 3D histology reconstruction was 0.85 ± 0.44 mm, suggesting that a good alignment of the ex vivo 3D histology and ex vivo MRI had been achieved. The 3D histology-in vivo MRI coregistered volumes resulted in an overlap of 73.7% ± 0.9%. Preliminary computerized feature analysis was performed on an additional four control mice, for a total of seven mice considered in this study. Gabor texture filters appeared to best capture differences between the inflamed and noninflamed regions on MRI. Conclusions: The authors’ 3D histology reconstruction and multimodal registration framework were successfully employed to reconstruct the histology volume of the lung and fuse it with in vivo MRI to create a ground truth map for inflammation on in vivo MRI. The analytic platform presented here lays the framework for a rigorous validation of the identified imaging features for chronic lung inflammation on MRI in a large prospective cohort.« less

High-contrast differentiation resolution 3D imaging of rodent brain by X-ray computed microtomography

NASA Astrophysics Data System (ADS)

Zikmund, T.; Novotná, M.; Kavková, M.; Tesařová, M.; Kaucká, M.; Szarowská, B.; Adameyko, I.; Hrubá, E.; Buchtová, M.; Dražanová, E.; Starčuk, Z.; Kaiser, J.

2018-02-01

The biomedically focused brain research is largely performed on laboratory mice considering a high homology between the human and mouse genomes. A brain has an intricate and highly complex geometrical structure that is hard to display and analyse using only 2D methods. Applying some fast and efficient methods of brain visualization in 3D will be crucial for the neurobiology in the future. A post-mortem analysis of experimental animals' brains usually involves techniques such as magnetic resonance and computed tomography. These techniques are employed to visualize abnormalities in the brains' morphology or reparation processes. The X-ray computed microtomography (micro CT) plays an important role in the 3D imaging of internal structures of a large variety of soft and hard tissues. This non-destructive technique is applied in biological studies because the lab-based CT devices enable to obtain a several-micrometer resolution. However, this technique is always used along with some visualization methods, which are based on the tissue staining and thus differentiate soft tissues in biological samples. Here, a modified chemical contrasting protocol of tissues for a micro CT usage is introduced as the best tool for ex vivo 3D imaging of a post-mortem mouse brain. This way, the micro CT provides a high spatial resolution of the brain microscopic anatomy together with a high tissue differentiation contrast enabling to identify more anatomical details in the brain. As the micro CT allows a consequent reconstruction of the brain structures into a coherent 3D model, some small morphological changes can be given into context of their mutual spatial relationships.

Research of cartographer laser SLAM algorithm

NASA Astrophysics Data System (ADS)

Xu, Bo; Liu, Zhengjun; Fu, Yiran; Zhang, Changsai

2017-11-01

As the indoor is a relatively closed and small space, total station, GPS, close-range photogrammetry technology is difficult to achieve fast and accurate indoor three-dimensional space reconstruction task. LIDAR SLAM technology does not rely on the external environment a priori knowledge, only use their own portable lidar, IMU, odometer and other sensors to establish an independent environment map, a good solution to this problem. This paper analyzes the Google Cartographer laser SLAM algorithm from the point cloud matching and closed loop detection. Finally, the algorithm is presented in the 3D visualization tool RViz from the data acquisition and processing to create the environment map, complete the SLAM technology and realize the process of indoor threedimensional space reconstruction

Bio-Inspired Sampling and Reconstruction Framework for Scientific Visualization

DTIC Science & Technology

2015-09-17

Framework for Sc ent f c V sua zat on Grant/Contract Number AFOSR assigned control number. It must begin with "FA9550" or "F49620" or "FA2386". FA9550-12-1...project nvest gated samp ng theoret c ssues that ar se n v sua zat on of 3-D (e.g., n s mu at on or b omed ca ) datasets. As samp ng and reconstruct on...are key e ements n the v sua zat on p pe ne, the r mathemat ca mode ng and ana ys s are foundat ona to re ab ty of the resu t ng v sua zat ons. An

Overview of EVE - the event visualization environment of ROOT

NASA Astrophysics Data System (ADS)

Tadel, Matevž

2010-04-01

EVE is a high-level visualization library using ROOT's data-processing, GUI and OpenGL interfaces. It is designed as a framework for object management offering hierarchical data organization, object interaction and visualization via GUI and OpenGL representations. Automatic creation of 2D projected views is also supported. On the other hand, it can serve as an event visualization toolkit satisfying most HEP requirements: visualization of geometry, simulated and reconstructed data such as hits, clusters, tracks and calorimeter information. Special classes are available for visualization of raw-data. Object-interaction layer allows for easy selection and highlighting of objects and their derived representations (projections) across several views (3D, Rho-Z, R-Phi). Object-specific tooltips are provided in both GUI and GL views. The visual-configuration layer of EVE is built around a data-base of template objects that can be applied to specific instances of visualization objects to ensure consistent object presentation. The data-base can be retrieved from a file, edited during the framework operation and stored to file. EVE prototype was developed within the ALICE collaboration and has been included into ROOT in December 2007. Since then all EVE components have reached maturity. EVE is used as the base of AliEve visualization framework in ALICE, Firework physics-oriented event-display in CMS, and as the visualization engine of FairRoot in FAIR.

Experimental study of sector and linear array ultrasound accuracy and the influence of navigated 3D-reconstruction as compared to MRI in a brain tumor model.

PubMed

Siekmann, Max; Lothes, Thomas; König, Ralph; Wirtz, Christian Rainer; Coburger, Jan

2018-03-01

Currently, intraoperative ultrasound in brain tumor surgery is a rapidly propagating option in imaging technology. We examined the accuracy and resolution limits of different ultrasound probes and the influence of 3D-reconstruction in a phantom and compared these results to MRI in an intraoperative setting (iMRI). An agarose gel phantom with predefined gel targets was examined with iMRI, a sector (SUS) and a linear (LUS) array probe with two-dimensional images. Additionally, 3D-reconstructed sweeps in perpendicular directions were made of every target with both probes, resulting in 392 measurements. Statistical calculations were performed, and comparative boxplots were generated. Every measurement of iMRI and LUS was more precise than SUS, while there was no apparent difference in height of iMRI and 3D-reconstructed LUS. Measurements with 3D-reconstructed LUS were always more accurate than in 2D-LUS, while 3D-reconstruction of SUS showed nearly no differences to 2D-SUS in some measurements. We found correlations of 3D-reconstructed SUS and LUS length and width measurements with 2D results in the same image orientation. LUS provides an accuracy and resolution comparable to iMRI, while SUS is less exact than LUS and iMRI. 3D-reconstruction showed the potential to distinctly improve accuracy and resolution of ultrasound images, although there is a strong correlation with the sweep direction during data acquisition.

3D and 4D magnetic susceptibility tomography based on complex MR images

DOEpatents

Chen, Zikuan; Calhoun, Vince D

2014-11-11

Magnetic susceptibility is the physical property for T2*-weighted magnetic resonance imaging (T2*MRI). The invention relates to methods for reconstructing an internal distribution (3D map) of magnetic susceptibility values, .chi. (x,y,z), of an object, from 3D T2*MRI phase images, by using Computed Inverse Magnetic Resonance Imaging (CIMRI) tomography. The CIMRI technique solves the inverse problem of the 3D convolution by executing a 3D Total Variation (TV) regularized iterative convolution scheme, using a split Bregman iteration algorithm. The reconstruction of .chi. (x,y,z) can be designed for low-pass, band-pass, and high-pass features by using a convolution kernel that is modified from the standard dipole kernel. Multiple reconstructions can be implemented in parallel, and averaging the reconstructions can suppress noise. 4D dynamic magnetic susceptibility tomography can be implemented by reconstructing a 3D susceptibility volume from a 3D phase volume by performing 3D CIMRI magnetic susceptibility tomography at each snapshot time.

Statistical shape model-based reconstruction of a scaled, patient-specific surface model of the pelvis from a single standard AP x-ray radiograph

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zheng Guoyan

2010-04-15

Purpose: The aim of this article is to investigate the feasibility of using a statistical shape model (SSM)-based reconstruction technique to derive a scaled, patient-specific surface model of the pelvis from a single standard anteroposterior (AP) x-ray radiograph and the feasibility of estimating the scale of the reconstructed surface model by performing a surface-based 3D/3D matching. Methods: Data sets of 14 pelvises (one plastic bone, 12 cadavers, and one patient) were used to validate the single-image based reconstruction technique. This reconstruction technique is based on a hybrid 2D/3D deformable registration process combining a landmark-to-ray registration with a SSM-based 2D/3D reconstruction.more » The landmark-to-ray registration was used to find an initial scale and an initial rigid transformation between the x-ray image and the SSM. The estimated scale and rigid transformation were used to initialize the SSM-based 2D/3D reconstruction. The optimal reconstruction was then achieved in three stages by iteratively matching the projections of the apparent contours extracted from a 3D model derived from the SSM to the image contours extracted from the x-ray radiograph: Iterative affine registration, statistical instantiation, and iterative regularized shape deformation. The image contours are first detected by using a semiautomatic segmentation tool based on the Livewire algorithm and then approximated by a set of sparse dominant points that are adaptively sampled from the detected contours. The unknown scales of the reconstructed models were estimated by performing a surface-based 3D/3D matching between the reconstructed models and the associated ground truth models that were derived from a CT-based reconstruction method. Such a matching also allowed for computing the errors between the reconstructed models and the associated ground truth models. Results: The technique could reconstruct the surface models of all 14 pelvises directly from the landmark-based initialization. Depending on the surface-based matching techniques, the reconstruction errors were slightly different. When a surface-based iterative affine registration was used, an average reconstruction error of 1.6 mm was observed. This error was increased to 1.9 mm, when a surface-based iterative scaled rigid registration was used. Conclusions: It is feasible to reconstruct a scaled, patient-specific surface model of the pelvis from single standard AP x-ray radiograph using the present approach. The unknown scale of the reconstructed model can be estimated by performing a surface-based 3D/3D matching.« less

Industry and Academic Consortium for Computer Based Subsurface Geology Laboratory

NASA Astrophysics Data System (ADS)

Brown, A. L.; Nunn, J. A.; Sears, S. O.

2008-12-01

Twenty two licenses for Petrel Software acquired through a grant from Schlumberger are being used to redesign the laboratory portion of Subsurface Geology at Louisiana State University. The course redesign is a cooperative effort between LSU's Geology and Geophysics and Petroleum Engineering Departments and Schlumberger's Technical Training Division. In spring 2008, two laboratory sections were taught with 22 students in each section. The class contained geology majors, petroleum engineering majors, and geology graduate students. Limited enrollments and 3 hour labs make it possible to incorporate hands-on visualization, animation, manipulation of data and images, and access to geological data available online. 24/7 access to the laboratory and step by step instructions for Petrel exercises strongly promoted peer instruction and individual learning. Goals of the course redesign include: enhancing visualization of earth materials; strengthening student's ability to acquire, manage, and interpret multifaceted geological information; fostering critical thinking, the scientific method; improving student communication skills; providing cross training between geologists and engineers and increasing the quantity, quality, and diversity of students pursuing Earth Science and Petroleum Engineering careers. IT resources available in the laboratory provide students with sophisticated visualization tools, allowing them to switch between 2-D and 3-D reconstructions more seamlessly, and enabling them to manipulate larger integrated data-sets, thus permitting more time for critical thinking and hypothesis testing. IT resources also enable faculty and students to simultaneously work with the software to visually interrogate a 3D data set and immediately test hypothesis formulated in class. Preliminary evaluation of class results indicate that students found MS-Windows based Petrel easy to learn. By the end of the semester, students were able to not only map horizons and faults using seismic and well data but also compute volumetrics. Exam results indicated that while students could complete sophisticated exercises using the software, their understanding of key concepts such as conservation of volume in a palinspastic reconstruction or association of structures with a particular stress regime was limited. Future classes will incorporate more paper and pencil exercises to illustrate basic concepts. The equipment, software, and exercises developed will be used in additional upper level undergraduate and graduate classes.

Improving 3D Genome Reconstructions Using Orthologous and Functional Constraints

PubMed Central

Diament, Alon; Tuller, Tamir

2015-01-01

The study of the 3D architecture of chromosomes has been advancing rapidly in recent years. While a number of methods for 3D reconstruction of genomic models based on Hi-C data were proposed, most of the analyses in the field have been performed on different 3D representation forms (such as graphs). Here, we reproduce most of the previous results on the 3D genomic organization of the eukaryote Saccharomyces cerevisiae using analysis of 3D reconstructions. We show that many of these results can be reproduced in sparse reconstructions, generated from a small fraction of the experimental data (5% of the data), and study the properties of such models. Finally, we propose for the first time a novel approach for improving the accuracy of 3D reconstructions by introducing additional predicted physical interactions to the model, based on orthologous interactions in an evolutionary-related organism and based on predicted functional interactions between genes. We demonstrate that this approach indeed leads to the reconstruction of improved models. PMID:26000633

Morphology of the utricular otolith organ in the toadfish, Opsanus tau.

PubMed

Boyle, Richard; Ehsanian, Reza; Mofrad, Alireza; Popova, Yekaterina; Varelas, Joseph

2018-06-15

The utricle provides the vestibular reflex pathways with the sensory codes of inertial acceleration of self-motion and head orientation with respect to gravity to control balance and equilibrium. Here we present an anatomical description of this structure in the adult oyster toadfish and establish a morphological basis for interpretation of subsequent functional studies. Light, scanning, and transmission electron microscopy techniques were applied to visualize the sensory epithelium at varying levels of detail, its neural innervation and its synaptic organization. Scanning electron microscopy was used to visualize otolith mass and morphological polarization patterns of hair cells. Afferent nerve fibers were visualized following labeling with biocytin, and light microscope images were used to make three-dimensional (3-D) reconstructions of individual labeled afferents to identify dendritic morphology with respect to epithelial location. Transmission electron micrographs were compiled to create a serial 3-D reconstruction of a labeled afferent over a segment of its dendritic field and to examine the cell-afferent synaptic contacts. Major observations are: a well-defined striola, medial and lateral extra-striolar regions with a zonal organization of hair bundles; prominent lacinia projecting laterally; dependence of hair cell density on macular location; narrow afferent dendritic fields that follow the hair bundle polarization; synaptic specializations issued by afferents are typically directed towards a limited number of 7-13 hair cells, but larger dendritic fields in the medial extra-striola can be associated with > 20 hair cells also; and hair cell synaptic bodies can be confined to only an individual afferent or can synapse upon several afferents. © 2018 Wiley Periodicals, Inc.

Photogrammetry for rapid prototyping: development of noncontact 3D reconstruction technologies

NASA Astrophysics Data System (ADS)

Knyaz, Vladimir A.

2002-04-01

An important stage of rapid prototyping technology is generating computer 3D model of an object to be reproduced. Wide variety of techniques for 3D model generation exists beginning with manual 3D models generation and finishing with full-automated reverse engineering system. The progress in CCD sensors and computers provides the background for integration of photogrammetry as an accurate 3D data source with CAD/CAM. The paper presents the results of developing photogrammetric methods for non-contact spatial coordinates measurements and generation of computer 3D model of real objects. The technology is based on object convergent images processing for calculating its 3D coordinates and surface reconstruction. The hardware used for spatial coordinates measurements is based on PC as central processing unit and video camera as image acquisition device. The original software for Windows 9X realizes the complete technology of 3D reconstruction for rapid input of geometry data in CAD/CAM systems. Technical characteristics of developed systems are given along with the results of applying for various tasks of 3D reconstruction. The paper describes the techniques used for non-contact measurements and the methods providing metric characteristics of reconstructed 3D model. Also the results of system application for 3D reconstruction of complex industrial objects are presented.

Interactive 3d Landscapes on Line

NASA Astrophysics Data System (ADS)

Fanini, B.; Calori, L.; Ferdani, D.; Pescarin, S.

2011-09-01

The paper describes challenges identified while developing browser embedded 3D landscape rendering applications, our current approach and work-flow and how recent development in browser technologies could affect. All the data, even if processed by optimization and decimation tools, result in very huge databases that require paging, streaming and Level-of-Detail techniques to be implemented to allow remote web based real time fruition. Our approach has been to select an open source scene-graph based visual simulation library with sufficient performance and flexibility and adapt it to the web by providing a browser plug-in. Within the current Montegrotto VR Project, content produced with new pipelines has been integrated. The whole Montegrotto Town has been generated procedurally by CityEngine. We used this procedural approach, based on algorithms and procedures because it is particularly functional to create extensive and credible urban reconstructions. To create the archaeological sites we used optimized mesh acquired with laser scanning and photogrammetry techniques whereas to realize the 3D reconstructions of the main historical buildings we adopted computer-graphic software like blender and 3ds Max. At the final stage, semi-automatic tools have been developed and used up to prepare and clusterise 3D models and scene graph routes for web publishing. Vegetation generators have also been used with the goal of populating the virtual scene to enhance the user perceived realism during the navigation experience. After the description of 3D modelling and optimization techniques, the paper will focus and discuss its results and expectations.

[Three-dimensional tooth model reconstruction based on fusion of dental computed tomography images and laser-scanned images].

PubMed

Zhang, Dongxia; Gan, Yangzhou; Xiong, Jing; Xia, Zeyang

2017-02-01

Complete three-dimensional(3D) tooth model provides essential information to assist orthodontists for diagnosis and treatment planning. Currently, 3D tooth model is mainly obtained by segmentation and reconstruction from dental computed tomography(CT) images. However, the accuracy of 3D tooth model reconstructed from dental CT images is low and not applicable for invisalign design. And another serious problem also occurs, i.e. frequentative dental CT scan during different intervals of orthodontic treatment often leads to radiation to the patients. Hence, this paper proposed a method to reconstruct tooth model based on fusion of dental CT images and laser-scanned images. A complete3 D tooth model was reconstructed with the registration and fusion between the root reconstructed from dental CT images and the crown reconstructed from laser-scanned images. The crown of the complete 3D tooth model reconstructed with the proposed method has higher accuracy. Moreover, in order to reconstruct complete 3D tooth model of each orthodontic treatment interval, only one pre-treatment CT scan is needed and in the orthodontic treatment process only the laser-scan is required. Therefore, radiation to the patients can be reduced significantly.

Reconstruction dynamics of recorded holograms in photochromic glass.

PubMed

Mihailescu, Mona; Pavel, Eugen; Nicolae, Vasile B

2011-06-20

We have investigated the dynamics of the record-erase process of holograms in photochromic glass using continuum Nd:YVO₄ laser radiation (λ=532 nm). A bidimensional microgrid pattern was formed and visualized in photochromic glass, and its diffraction efficiency decay versus time (during reconstruction step) gave us information (D, Δn) about the diffusion process inside the material. The recording and reconstruction processes were carried out in an off-axis setup, and the images of the reconstructed object were recorded by a CCD camera. Measurements realized on reconstructed object images using holograms recorded at a different incident power laser have shown a two-stage process involved in silver atom kinetics.

Fusion of CTA and XA data using 3D centerline registration for plaque visualization during coronary intervention

NASA Astrophysics Data System (ADS)

Kaila, Gaurav; Kitslaar, Pieter; Tu, Shengxian; Penicka, Martin; Dijkstra, Jouke; Lelieveldt, Boudewijn

2016-03-01

Coronary Artery Disease (CAD) results in the buildup of plaque below the intima layer inside the vessel wall of the coronary arteries causing narrowing of the vessel and obstructing blood flow. Percutaneous coronary intervention (PCI) is usually done to enlarge the vessel lumen and regain back normal flow of blood to the heart. During PCI, X-ray imaging is done to assist guide wire movement through the vessels to the area of stenosis. While X-ray imaging allows for good lumen visualization, information on plaque type is unavailable. Also due to the projection nature of the X-ray imaging, additional drawbacks such as foreshortening and overlap of vessels limit the efficacy of the cardiac intervention. Reconstruction of 3D vessel geometry from biplane X-ray acquisitions helps to overcome some of these projection drawbacks. However, the plaque type information remains an issue. In contrast, imaging using computed tomography angiography (CTA) can provide us with information on both lumen and plaque type and allows us to generate a complete 3D coronary vessel tree unaffected by the foreshortening and overlap problems of the X-ray imaging. In this paper, we combine x-ray biplane images with CT angiography to visualize three plaque types (dense calcium, fibrous fatty and necrotic core) on x-ray images. 3D registration using three different registration methods is done between coronary centerlines available from x-ray images and from the CTA volume along with 3D plaque information available from CTA. We compare the different registration methods and evaluate their performance based on 3D root mean squared errors. Two methods are used to project this 3D information onto 2D plane of the x-ray biplane images. Validation of our approach is performed using artificial biplane x-ray datasets.

Motion and positional error correction for cone beam 3D-reconstruction with mobile C-arms.

PubMed

Bodensteiner, C; Darolti, C; Schumacher, H; Matthäus, L; Schweikard, A

2007-01-01

CT-images acquired by mobile C-arm devices can contain artefacts caused by positioning errors. We propose a data driven method based on iterative 3D-reconstruction and 2D/3D-registration to correct projection data inconsistencies. With a 2D/3D-registration algorithm, transformations are computed to align the acquired projection images to a previously reconstructed volume. In an iterative procedure, the reconstruction algorithm uses the results of the registration step. This algorithm also reduces small motion artefacts within 3D-reconstructions. Experiments with simulated projections from real patient data show the feasibility of the proposed method. In addition, experiments with real projection data acquired with an experimental robotised C-arm device have been performed with promising results.

A modified sparse reconstruction method for three-dimensional synthetic aperture radar image

NASA Astrophysics Data System (ADS)

Zhang, Ziqiang; Ji, Kefeng; Song, Haibo; Zou, Huanxin

2018-03-01

There is an increasing interest in three-dimensional Synthetic Aperture Radar (3-D SAR) imaging from observed sparse scattering data. However, the existing 3-D sparse imaging method requires large computing times and storage capacity. In this paper, we propose a modified method for the sparse 3-D SAR imaging. The method processes the collection of noisy SAR measurements, usually collected over nonlinear flight paths, and outputs 3-D SAR imagery. Firstly, the 3-D sparse reconstruction problem is transformed into a series of 2-D slices reconstruction problem by range compression. Then the slices are reconstructed by the modified SL0 (smoothed l0 norm) reconstruction algorithm. The improved algorithm uses hyperbolic tangent function instead of the Gaussian function to approximate the l0 norm and uses the Newton direction instead of the steepest descent direction, which can speed up the convergence rate of the SL0 algorithm. Finally, numerical simulation results are given to demonstrate the effectiveness of the proposed algorithm. It is shown that our method, compared with existing 3-D sparse imaging method, performs better in reconstruction quality and the reconstruction time.

Label-Free 3D Visualization of Cellular and Tissue Structures in Intact Muscle with Second and Third Harmonic Generation Microscopy

PubMed Central

Rehberg, Markus; Krombach, Fritz; Pohl, Ulrich; Dietzel, Steffen

2011-01-01

Second and Third Harmonic Generation (SHG and THG) microscopy is based on optical effects which are induced by specific inherent physical properties of a specimen. As a multi-photon laser scanning approach which is not based on fluorescence it combines the advantages of a label-free technique with restriction of signal generation to the focal plane, thus allowing high resolution 3D reconstruction of image volumes without out-of-focus background several hundred micrometers deep into the tissue. While in mammalian soft tissues SHG is mostly restricted to collagen fibers and striated muscle myosin, THG is induced at a large variety of structures, since it is generated at interfaces such as refraction index changes within the focal volume of the excitation laser. Besides, colorants such as hemoglobin can cause resonance enhancement, leading to intense THG signals. We applied SHG and THG microscopy to murine (Mus musculus) muscles, an established model system for physiological research, to investigate their potential for label-free tissue imaging. In addition to collagen fibers and muscle fiber substructure, THG allowed us to visualize blood vessel walls and erythrocytes as well as white blood cells adhering to vessel walls, residing in or moving through the extravascular tissue. Moreover peripheral nerve fibers could be clearly identified. Structure down to the nuclear chromatin distribution was visualized in 3D and with more detail than obtainable by bright field microscopy. To our knowledge, most of these objects have not been visualized previously by THG or any label-free 3D approach. THG allows label-free microscopy with inherent optical sectioning and therefore may offer similar improvements compared to bright field microscopy as does confocal laser scanning microscopy compared to conventional fluorescence microscopy. PMID:22140560

Anatomy structure creation and editing using 3D implicit surfaces

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hibbard, Lyndon S.

2012-05-15

Purpose: To accurately reconstruct, and interactively reshape 3D anatomy structures' surfaces using small numbers of 2D contours drawn in the most visually informative views of 3D imagery. The innovation of this program is that the number of 2D contours can be very much smaller than the number of transverse sections, even for anatomy structures spanning many sections. This program can edit 3D structures from prior segmentations, including those from autosegmentation programs. The reconstruction and surface editing works with any image modality. Methods: Structures are represented by variational implicit surfaces defined by weighted sums of radial basis functions (RBFs). Such surfacesmore » are smooth, continuous, and closed and can be reconstructed with RBFs optimally located to efficiently capture shape in any combination of transverse (T), sagittal (S), and coronal (C) views. The accuracy of implicit surface reconstructions was measured by comparisons with the corresponding expert-contoured surfaces in 103 prostate cancer radiotherapy plans. Editing a pre-existing surface is done by overdrawing its profiles in image views spanning the affected part of the structure, deleting an appropriate set of prior RBFs, and merging the remainder with the new edit contour RBFs. Two methods were devised to identify RBFs to be deleted based only on the geometry of the initial surface and the locations of the new RBFs. Results: Expert-contoured surfaces were compared with implicit surfaces reconstructed from them over varying numbers and combinations of T/S/C planes. Studies revealed that surface-surface agreement increases monotonically with increasing RBF-sample density, and that the rate of increase declines over the same range. These trends were observed for all surface agreement metrics and for all the organs studied--prostate, bladder, and rectum. In addition, S and C contours may convey more shape information than T views for CT studies in which the axial slice thickness is greater than the pixel size. Surface editing accuracy likewise improves with larger sampling densities, and the rate of improvement similarly declines over the same conditions. Conclusions: Implicit surfaces based on RBFs are accurate representations of anatomic structures and can be interactively generated or modified to correct segmentation errors. The number of input contours is typically smaller than the number of T contours spanned by the structure.« less

Three-Dimensional Printing and Its Applications in Otorhinolaryngology-Head and Neck Surgery.

PubMed

Crafts, Trevor D; Ellsperman, Susan E; Wannemuehler, Todd J; Bellicchi, Travis D; Shipchandler, Taha Z; Mantravadi, Avinash V

2017-06-01

Objective Three-dimensional (3D)-printing technology is being employed in a variety of medical and surgical specialties to improve patient care and advance resident physician training. As the costs of implementing 3D printing have declined, the use of this technology has expanded, especially within surgical specialties. This article explores the types of 3D printing available, highlights the benefits and drawbacks of each methodology, provides examples of how 3D printing has been applied within the field of otolaryngology-head and neck surgery, discusses future innovations, and explores the financial impact of these advances. Data Sources Articles were identified from PubMed and Ovid MEDLINE. Review Methods PubMed and Ovid Medline were queried for English articles published between 2011 and 2016, including a few articles prior to this time as relevant examples. Search terms included 3-dimensional printing, 3 D printing, otolaryngology, additive manufacturing, craniofacial, reconstruction, temporal bone, airway, sinus, cost, and anatomic models. Conclusions Three-dimensional printing has been used in recent years in otolaryngology for preoperative planning, education, prostheses, grafting, and reconstruction. Emerging technologies include the printing of tissue scaffolds for the auricle and nose, more realistic training models, and personalized implantable medical devices. Implications for Practice After the up-front costs of 3D printing are accounted for, its utilization in surgical models, patient-specific implants, and custom instruments can reduce operating room time and thus decrease costs. Educational and training models provide an opportunity to better visualize anomalies, practice surgical technique, predict problems that might arise, and improve quality by reducing mistakes.

Four-dimensional volume-of-interest reconstruction for cone-beam computed tomography-guided radiation therapy.

PubMed

Ahmad, Moiz; Balter, Peter; Pan, Tinsu

2011-10-01

Data sufficiency are a major problem in four-dimensional cone-beam computed tomography (4D-CBCT) on linear accelerator-integrated scanners for image-guided radiotherapy. Scan times must be in the range of 4-6 min to avoid undersampling artifacts. Various image reconstruction algorithms have been proposed to accommodate undersampled data acquisitions, but these algorithms are computationally expensive, may require long reconstruction times, and may require algorithm parameters to be optimized. The authors present a novel reconstruction method, 4D volume-of-interest (4D-VOI) reconstruction which suppresses undersampling artifacts and resolves lung tumor motion for undersampled 1-min scans. The 4D-VOI reconstruction is much less computationally expensive than other 4D-CBCT algorithms. The 4D-VOI method uses respiration-correlated projection data to reconstruct a four-dimensional (4D) image inside a VOI containing the moving tumor, and uncorrelated projection data to reconstruct a three-dimensional (3D) image outside the VOI. Anatomical motion is resolved inside the VOI and blurred outside the VOI. The authors acquired a 1-min. scan of an anthropomorphic chest phantom containing a moving water-filled sphere. The authors also used previously acquired 1-min scans for two lung cancer patients who had received CBCT-guided radiation therapy. The same raw data were used to test and compare the 4D-VOI reconstruction with the standard 4D reconstruction and the McKinnon-Bates (MB) reconstruction algorithms. Both the 4D-VOI and the MB reconstructions suppress nearly all the streak artifacts compared with the standard 4D reconstruction, but the 4D-VOI has 3-8 times greater contrast-to-noise ratio than the MB reconstruction. In the dynamic chest phantom study, the 4D-VOI and the standard 4D reconstructions both resolved a moving sphere with an 18 mm displacement. The 4D-VOI reconstruction shows a motion blur of only 3 mm, whereas the MB reconstruction shows a motion blur of 13 mm. With graphics processing unit hardware used to accelerate computations, the 4D-VOI reconstruction required a 40-s reconstruction time. 4D-VOI reconstruction effectively reduces undersampling artifacts and resolves lung tumor motion in 4D-CBCT. The 4D-VOI reconstruction is computationally inexpensive compared with more sophisticated iterative algorithms. Compared with these algorithms, our 4D-VOI reconstruction is an attractive alternative in 4D-CBCT for reconstructing target motion without generating numerous streak artifacts.

Four-dimensional volume-of-interest reconstruction for cone-beam computed tomography-guided radiation therapy

PubMed Central

Ahmad, Moiz; Balter, Peter; Pan, Tinsu

2011-01-01

Purpose: Data sufficiency are a major problem in four-dimensional cone-beam computed tomography (4D-CBCT) on linear accelerator-integrated scanners for image-guided radiotherapy. Scan times must be in the range of 4–6 min to avoid undersampling artifacts. Various image reconstruction algorithms have been proposed to accommodate undersampled data acquisitions, but these algorithms are computationally expensive, may require long reconstruction times, and may require algorithm parameters to be optimized. The authors present a novel reconstruction method, 4D volume-of-interest (4D-VOI) reconstruction which suppresses undersampling artifacts and resolves lung tumor motion for undersampled 1-min scans. The 4D-VOI reconstruction is much less computationally expensive than other 4D-CBCT algorithms. Methods: The 4D-VOI method uses respiration-correlated projection data to reconstruct a four-dimensional (4D) image inside a VOI containing the moving tumor, and uncorrelated projection data to reconstruct a three-dimensional (3D) image outside the VOI. Anatomical motion is resolved inside the VOI and blurred outside the VOI. The authors acquired a 1-min. scan of an anthropomorphic chest phantom containing a moving water-filled sphere. The authors also used previously acquired 1-min scans for two lung cancer patients who had received CBCT-guided radiation therapy. The same raw data were used to test and compare the 4D-VOI reconstruction with the standard 4D reconstruction and the McKinnon-Bates (MB) reconstruction algorithms. Results: Both the 4D-VOI and the MB reconstructions suppress nearly all the streak artifacts compared with the standard 4D reconstruction, but the 4D-VOI has 3–8 times greater contrast-to-noise ratio than the MB reconstruction. In the dynamic chest phantom study, the 4D-VOI and the standard 4D reconstructions both resolved a moving sphere with an 18 mm displacement. The 4D-VOI reconstruction shows a motion blur of only 3 mm, whereas the MB reconstruction shows a motion blur of 13 mm. With graphics processing unit hardware used to accelerate computations, the 4D-VOI reconstruction required a 40-s reconstruction time. Conclusions: 4D-VOI reconstruction effectively reduces undersampling artifacts and resolves lung tumor motion in 4D-CBCT. The 4D-VOI reconstruction is computationally inexpensive compared with more sophisticated iterative algorithms. Compared with these algorithms, our 4D-VOI reconstruction is an attractive alternative in 4D-CBCT for reconstructing target motion without generating numerous streak artifacts. PMID:21992381

Lie group model neuromorphic geometric engine for real-time terrain reconstruction from stereoscopic aerial photos

NASA Astrophysics Data System (ADS)

Tsao, Thomas R.; Tsao, Doris

1997-04-01

In the 1980's, neurobiologist suggested a simple mechanism in primate visual cortex for maintaining a stable and invariant representation of a moving object. The receptive field of visual neurons has real-time transforms in response to motion, to maintain a stable representation. When the visual stimulus is changed due to motion, the geometric transform of the stimulus triggers a dual transform of the receptive field. This dual transform in the receptive fields compensates geometric variation in the stimulus. This process can be modelled using a Lie group method. The massive array of affine parameter sensing circuits will function as a smart sensor tightly coupled to the passive imaging sensor (retina). Neural geometric engine is a neuromorphic computing device simulating our Lie group model of spatial perception of primate's primal visual cortex. We have developed the computer simulation and experimented on realistic and synthetic image data, and performed a preliminary research of using analog VLSI technology for implementation of the neural geometric engine. We have benchmark tested on DMA's terrain data with their result and have built an analog integrated circuit to verify the computational structure of the engine. When fully implemented on ANALOG VLSI chip, we will be able to accurately reconstruct a 3D terrain surface in real-time from stereoscopic imagery.

A 3D Freehand Ultrasound System for Multi-view Reconstructions from Sparse 2D Scanning Planes

PubMed Central

2011-01-01

Background A significant limitation of existing 3D ultrasound systems comes from the fact that the majority of them work with fixed acquisition geometries. As a result, the users have very limited control over the geometry of the 2D scanning planes. Methods We present a low-cost and flexible ultrasound imaging system that integrates several image processing components to allow for 3D reconstructions from limited numbers of 2D image planes and multiple acoustic views. Our approach is based on a 3D freehand ultrasound system that allows users to control the 2D acquisition imaging using conventional 2D probes. For reliable performance, we develop new methods for image segmentation and robust multi-view registration. We first present a new hybrid geometric level-set approach that provides reliable segmentation performance with relatively simple initializations and minimum edge leakage. Optimization of the segmentation model parameters and its effect on performance is carefully discussed. Second, using the segmented images, a new coarse to fine automatic multi-view registration method is introduced. The approach uses a 3D Hotelling transform to initialize an optimization search. Then, the fine scale feature-based registration is performed using a robust, non-linear least squares algorithm. The robustness of the multi-view registration system allows for accurate 3D reconstructions from sparse 2D image planes. Results Volume measurements from multi-view 3D reconstructions are found to be consistently and significantly more accurate than measurements from single view reconstructions. The volume error of multi-view reconstruction is measured to be less than 5% of the true volume. We show that volume reconstruction accuracy is a function of the total number of 2D image planes and the number of views for calibrated phantom. In clinical in-vivo cardiac experiments, we show that volume estimates of the left ventricle from multi-view reconstructions are found to be in better agreement with clinical measures than measures from single view reconstructions. Conclusions Multi-view 3D reconstruction from sparse 2D freehand B-mode images leads to more accurate volume quantification compared to single view systems. The flexibility and low-cost of the proposed system allow for fine control of the image acquisition planes for optimal 3D reconstructions from multiple views. PMID:21251284

A 3D freehand ultrasound system for multi-view reconstructions from sparse 2D scanning planes.

PubMed

Yu, Honggang; Pattichis, Marios S; Agurto, Carla; Beth Goens, M

2011-01-20

A significant limitation of existing 3D ultrasound systems comes from the fact that the majority of them work with fixed acquisition geometries. As a result, the users have very limited control over the geometry of the 2D scanning planes. We present a low-cost and flexible ultrasound imaging system that integrates several image processing components to allow for 3D reconstructions from limited numbers of 2D image planes and multiple acoustic views. Our approach is based on a 3D freehand ultrasound system that allows users to control the 2D acquisition imaging using conventional 2D probes.For reliable performance, we develop new methods for image segmentation and robust multi-view registration. We first present a new hybrid geometric level-set approach that provides reliable segmentation performance with relatively simple initializations and minimum edge leakage. Optimization of the segmentation model parameters and its effect on performance is carefully discussed. Second, using the segmented images, a new coarse to fine automatic multi-view registration method is introduced. The approach uses a 3D Hotelling transform to initialize an optimization search. Then, the fine scale feature-based registration is performed using a robust, non-linear least squares algorithm. The robustness of the multi-view registration system allows for accurate 3D reconstructions from sparse 2D image planes. Volume measurements from multi-view 3D reconstructions are found to be consistently and significantly more accurate than measurements from single view reconstructions. The volume error of multi-view reconstruction is measured to be less than 5% of the true volume. We show that volume reconstruction accuracy is a function of the total number of 2D image planes and the number of views for calibrated phantom. In clinical in-vivo cardiac experiments, we show that volume estimates of the left ventricle from multi-view reconstructions are found to be in better agreement with clinical measures than measures from single view reconstructions. Multi-view 3D reconstruction from sparse 2D freehand B-mode images leads to more accurate volume quantification compared to single view systems. The flexibility and low-cost of the proposed system allow for fine control of the image acquisition planes for optimal 3D reconstructions from multiple views.

Effects of the approximations of light propagation on quantitative photoacoustic tomography using two-dimensional photon diffusion equation and linearization

NASA Astrophysics Data System (ADS)

Okawa, Shinpei; Hirasawa, Takeshi; Kushibiki, Toshihiro; Ishihara, Miya

2017-12-01

Quantitative photoacoustic tomography (QPAT) employing a light propagation model will play an important role in medical diagnoses by quantifying the concentration of hemoglobin or a contrast agent. However, QPAT by the light propagation model with the three-dimensional (3D) radiative transfer equation (RTE) requires a huge computational load in the iterative forward calculations involved in the updating process to reconstruct the absorption coefficient. The approximations of the light propagation improve the efficiency of the image reconstruction for the QPAT. In this study, we compared the 3D/two-dimensional (2D) photon diffusion equation (PDE) approximating 3D RTE with the Monte Carlo simulation based on 3D RTE. Then, the errors in a 2D PDE-based linearized image reconstruction caused by the approximations were quantitatively demonstrated and discussed in the numerical simulations. It was clearly observed that the approximations affected the reconstructed absorption coefficient. The 2D PDE-based linearized algorithm succeeded in the image reconstruction of the region with a large absorption coefficient in the 3D phantom. The value reconstructed in the phantom experiment agreed with that in the numerical simulation, so that it was validated that the numerical simulation of the image reconstruction predicted the relationship between the true absorption coefficient of the target in the 3D medium and the reconstructed value with the 2D PDE-based linearized algorithm. Moreover, the the true absorption coefficient in 3D medium was estimated from the 2D reconstructed image on the basis of the prediction by the numerical simulation. The estimation was successful in the phantom experiment, although some limitations were revealed.

Cardiac C-arm computed tomography using a 3D + time ROI reconstruction method with spatial and temporal regularization

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mory, Cyril, E-mail: cyril.mory@philips.com; Philips Research Medisys, 33 rue de Verdun, 92156 Suresnes; Auvray, Vincent

2014-02-15

Purpose: Reconstruction of the beating heart in 3D + time in the catheter laboratory using only the available C-arm system would improve diagnosis, guidance, device sizing, and outcome control for intracardiac interventions, e.g., electrophysiology, valvular disease treatment, structural or congenital heart disease. To obtain such a reconstruction, the patient's electrocardiogram (ECG) must be recorded during the acquisition and used in the reconstruction. In this paper, the authors present a 4D reconstruction method aiming to reconstruct the heart from a single sweep 10 s acquisition. Methods: The authors introduce the 4D RecOnstructiOn using Spatial and TEmporal Regularization (short 4D ROOSTER) method,more » which reconstructs all cardiac phases at once, as a 3D + time volume. The algorithm alternates between a reconstruction step based on conjugate gradient and four regularization steps: enforcing positivity, averaging along time outside a motion mask that contains the heart and vessels, 3D spatial total variation minimization, and 1D temporal total variation minimization. Results: 4D ROOSTER recovers the different temporal representations of a moving Shepp and Logan phantom, and outperforms both ECG-gated simultaneous algebraic reconstruction technique and prior image constrained compressed sensing on a clinical case. It generates 3D + time reconstructions with sharp edges which can be used, for example, to estimate the patient's left ventricular ejection fraction. Conclusions: 4D ROOSTER can be applied for human cardiac C-arm CT, and potentially in other dynamic tomography areas. It can easily be adapted to other problems as regularization is decoupled from projection and back projection.« less

3D multimodal cardiac data reconstruction using angiography and computerized tomographic angiography registration.

PubMed

Moosavi Tayebi, Rohollah; Wirza, Rahmita; Sulaiman, Puteri S B; Dimon, Mohd Zamrin; Khalid, Fatimah; Al-Surmi, Aqeel; Mazaheri, Samaneh

2015-04-22

Computerized tomographic angiography (3D data representing the coronary arteries) and X-ray angiography (2D X-ray image sequences providing information about coronary arteries and their stenosis) are standard and popular assessment tools utilized for medical diagnosis of coronary artery diseases. At present, the results of both modalities are individually analyzed by specialists and it is difficult for them to mentally connect the details of these two techniques. The aim of this work is to assist medical diagnosis by providing specialists with the relationship between computerized tomographic angiography and X-ray angiography. In this study, coronary arteries from two modalities are registered in order to create a 3D reconstruction of the stenosis position. The proposed method starts with coronary artery segmentation and labeling for both modalities. Then, stenosis and relevant labeled artery in X-ray angiography image are marked by a specialist. Proper control points for the marked artery in both modalities are automatically detected and normalized. Then, a geometrical transformation function is computed using these control points. Finally, this function is utilized to register the marked artery from the X-ray angiography image on the computerized tomographic angiography and get the 3D position of the stenosis lesion. The result is a 3D informative model consisting of stenosis and coronary arteries' information from the X-ray angiography and computerized tomographic angiography modalities. The results of the proposed method for coronary artery segmentation, labeling and 3D reconstruction are evaluated and validated on the dataset containing both modalities. The advantage of this method is to aid specialists to determine a visual relationship between the correspondent coronary arteries from two modalities and also set up a connection between stenosis points from an X-ray angiography along with their 3D positions on the coronary arteries from computerized tomographic angiography. Moreover, another benefit of this work is that the medical acquisition standards remain unchanged, which means that no calibration in the acquisition devices is required. It can be applied on most computerized tomographic angiography and angiography devices.

D Survey and Augmented Reality for Cultural Heritage. The Case Study of Aurelian Wall at Castra Praetoria in Rome

NASA Astrophysics Data System (ADS)

Canciani, M.; Conigliaro, E.; Del Grasso, M.; Papalini, P.; Saccone, M.

2016-06-01

The development of close-range photogrammetry has produced a lot of new possibility to study cultural heritage. 3D data acquired with conventional and low cost cameras can be used to document, investigate the full appearance, materials and conservation status, to help the restoration process and identify intervention priorities. At the same time, with 3D survey a lot of three-dimensional data are collected and analyzed by researchers, but there are a very few possibility of 3D output. The augmented reality is one of this possible output with a very low cost technology but a very interesting result. Using simple mobile technology (for iPad and Android Tablets) and shareware software (in the case presented "Augment") it is possible to share and visualize a large number of 3D models with your own device. The case study presented is a part of an architecture graduate thesis, made in Rome at Department of Architecture of Roma Tre University. We have developed a photogrammetric survey to study the Aurelian Wall at Castra Praetoria in Rome. The surveys of 8000 square meters of surface have allowed to identify stratigraphy and construction phases of a complex portion of Aurelian Wall, specially about the Northern door of Castra. During this study, the data coming out of 3D survey (photogrammetric and topographic), are stored and used to create a reverse 3D model, or virtual reconstruction, of the Northern door of Castra. This virtual reconstruction shows the door in the Tiberian period, nowadays it's totally hidden by a curtain wall but, little and significative architectural details allow to know its original feature. The 3D model of the ancient walls has been mapped with the exact type of bricks and mortar, oriented and scaled according to the existing one to use augmented reality. Finally, two kind of application have been developed, one on site, were you can see superimposed the virtual reconstruction on the existing walls using the image recognition. On the other hand, to show the results also during the graduation day, the same application has been created in off-site condition using a poster.

Noise and signal properties in PSF-based fully 3D PET image reconstruction: an experimental evaluation

NASA Astrophysics Data System (ADS)

Tong, S.; Alessio, A. M.; Kinahan, P. E.

2010-03-01

The addition of accurate system modeling in PET image reconstruction results in images with distinct noise texture and characteristics. In particular, the incorporation of point spread functions (PSF) into the system model has been shown to visually reduce image noise, but the noise properties have not been thoroughly studied. This work offers a systematic evaluation of noise and signal properties in different combinations of reconstruction methods and parameters. We evaluate two fully 3D PET reconstruction algorithms: (1) OSEM with exact scanner line of response modeled (OSEM+LOR), (2) OSEM with line of response and a measured point spread function incorporated (OSEM+LOR+PSF), in combination with the effects of four post-reconstruction filtering parameters and 1-10 iterations, representing a range of clinically acceptable settings. We used a modified NEMA image quality (IQ) phantom, which was filled with 68Ge and consisted of six hot spheres of different sizes with a target/background ratio of 4:1. The phantom was scanned 50 times in 3D mode on a clinical system to provide independent noise realizations. Data were reconstructed with OSEM+LOR and OSEM+LOR+PSF using different reconstruction parameters, and our implementations of the algorithms match the vendor's product algorithms. With access to multiple realizations, background noise characteristics were quantified with four metrics. Image roughness and the standard deviation image measured the pixel-to-pixel variation; background variability and ensemble noise quantified the region-to-region variation. Image roughness is the image noise perceived when viewing an individual image. At matched iterations, the addition of PSF leads to images with less noise defined as image roughness (reduced by 35% for unfiltered data) and as the standard deviation image, while it has no effect on background variability or ensemble noise. In terms of signal to noise performance, PSF-based reconstruction has a 7% improvement in contrast recovery at matched ensemble noise levels and 20% improvement of quantitation SNR in unfiltered data. In addition, the relations between different metrics are studied. A linear correlation is observed between background variability and ensemble noise for all different combinations of reconstruction methods and parameters, suggesting that background variability is a reasonable surrogate for ensemble noise when multiple realizations of scans are not available.

Virtual unfolding of light sheet fluorescence microscopy dataset for quantitative analysis of the mouse intestine

NASA Astrophysics Data System (ADS)

Candeo, Alessia; Sana, Ilenia; Ferrari, Eleonora; Maiuri, Luigi; D'Andrea, Cosimo; Valentini, Gianluca; Bassi, Andrea

2016-05-01

Light sheet fluorescence microscopy has proven to be a powerful tool to image fixed and chemically cleared samples, providing in depth and high resolution reconstructions of intact mouse organs. We applied light sheet microscopy to image the mouse intestine. We found that large portions of the sample can be readily visualized, assessing the organ status and highlighting the presence of regions with impaired morphology. Yet, three-dimensional (3-D) sectioning of the intestine leads to a large dataset that produces unnecessary storage and processing overload. We developed a routine that extracts the relevant information from a large image stack and provides quantitative analysis of the intestine morphology. This result was achieved by a three step procedure consisting of: (1) virtually unfold the 3-D reconstruction of the intestine; (2) observe it layer-by-layer; and (3) identify distinct villi and statistically analyze multiple samples belonging to different intestinal regions. Even if the procedure has been developed for the murine intestine, most of the underlying concepts have a general applicability.

3D surface and body documentation in forensic medicine: 3-D/CAD Photogrammetry merged with 3D radiological scanning.

PubMed

Thali, Michael J; Braun, Marcel; Wirth, Joachim; Vock, Peter; Dirnhofer, Richard

2003-11-01

A main goal of forensic medicine is to document and to translate medical findings to a language and/or visualization that is readable and understandable for judicial persons and for medical laymen. Therefore, in addition to classical methods, scientific cutting-edge technologies can and should be used. Through the use of the Forensic, 3-D/CAD-supported Photogrammetric method the documentation of so-called "morphologic fingerprints" has been realized. Forensic, 3-D/CAD-supported Photogrammetry creates morphologic data models of the injury and of the suspected injury-causing instrument allowing the evaluation of a match between the injury and the instrument. In addition to the photogrammetric body surface registration, the radiological documentation provided by a volume scan (i.e., spiral, multi-detector CT, or MRI) registers the sub-surface injury, which is not visible to Photogrammetry. The new, combined method of merging Photogrammetry and Radiology data sets creates the potential to perform many kinds of reconstructions and postprocessing of (patterned) injuries in the realm of forensic medical case work. Using this merging method of colored photogrammetric surface and gray-scale radiological internal documentation, a great step towards a new kind of reality-based, high-tech wound documentation and visualization in forensic medicine is made. The combination of the methods of 3D/CAD Photogrammetry and Radiology has the advantage of being observer-independent, non-subjective, non-invasive, digitally storable over years or decades and even transferable over the web for second opinion.

The Palladiolibrary Geo-Models AN Open 3d Archive to Manage and Visualize Information-Communication Resources about Palladio

NASA Astrophysics Data System (ADS)

Apollonio, F. I.; Baldissini, S.; Clini, P.; Gaiani, M.; Palestini, C.; Trevisan, C.

2013-07-01

The paper describes objectives, methods, procedures and outcomes of the development of the digital archive of Palladio works and documentation: the PALLADIOLibrary of Centro Internazionale di Studi di Architettura Andrea Palladio di Vicenza (CISAAP). The core of the application consists of fifty-one reality-based 3D models usable and navigable within a system grounded on GoogleEarth. This information system, a collaboration of four universities bearers of specific skills returns a comprehensive, structured and coherent semantic interpretation of Palladian landscape through shapes realistically reconstructed from historical sources and surveys and treated for GE with Ambient Occlusion techniques, overcoming the traditional display mode.

Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images

NASA Technical Reports Server (NTRS)

Shekhar, R.; Cothren, R. M.; Vince, D. G.; Chandra, S.; Thomas, J. D.; Cornhill, J. F.

1999-01-01

Intravascular ultrasound (IVUS) provides exact anatomy of arteries, allowing accurate quantitative analysis. Automated segmentation of IVUS images is a prerequisite for routine quantitative analyses. We present a new three-dimensional (3D) segmentation technique, called active surface segmentation, which detects luminal and adventitial borders in IVUS pullback examinations of coronary arteries. The technique was validated against expert tracings by computing correlation coefficients (range 0.83-0.97) and William's index values (range 0.37-0.66). The technique was statistically accurate, robust to image artifacts, and capable of segmenting a large number of images rapidly. Active surface segmentation enabled geometrically accurate 3D reconstruction and visualization of coronary arteries and volumetric measurements.

[Sound improves distinction of low intensities of light in the visual cortex of a rabbit].

PubMed

Polianskiĭ, V B; Alymkulov, D E; Evtikhin, D V; Chernyshev, B V

2011-01-01

Electrodes were implanted into cranium above the primary visual cortex of four rabbits (Orictolagus cuniculus). At the first stage, visual evoked potentials (VEPs) were recorded in response to substitution of threshold visual stimuli (0.28 and 0.31 cd/m2). Then the sound (2000 Hz, 84 dB, duration 40 ms) was added simultaneously to every visual stimulus. Single sounds (without visual stimuli) did not produce a VEP-response. It was found that the amplitude ofVEP component N1 (85-110 ms) in response to complex stimuli (visual and sound) increased 1.6 times as compared to "simple" visual stimulation. At the second stage, paired substitutions of 8 different visual stimuli (range 0.38-20.2 cd/m2) by each other were performed. Sensory spaces of intensity were reconstructed on the basis of factor analysis. Sensory spaces of complexes were reconstructed in a similar way for simultaneous visual and sound stimulation. Comparison of vectors representing the stimuli in the spaces showed that the addition of a sound led to a 1.4-fold expansion of the space occupied by smaller intensities (0.28; 1.02; 3.05; 6.35 cd/m2). Also, the addition of the sound led to an arrangement of intensities in an ascending order. At the same time, the sound 1.33-times narrowed the space of larger intensities (8.48; 13.7; 16.8; 20.2 cd/m2). It is suggested that the addition of a sound improves a distinction of smaller intensities and impairs a dis- tinction of larger intensities. Sensory spaces revealed by complex stimuli were two-dimensional. This fact can be a consequence of integration of sound and light in a unified complex at simultaneous stimulation.

Representation of the visual field in the primary visual area of the marmoset monkey: magnification factors, point-image size, and proportionality to retinal ganglion cell density.

PubMed

Chaplin, Tristan A; Yu, Hsin-Hao; Rosa, Marcello G P

2013-04-01

The primary visual area (V1) forms a systematic map of the visual field, in which adjacent cell clusters represent adjacent points of visual space. A precise quantification of this map is key to understanding the anatomical relationships between neurons located in different stations of the visual pathway, as well as the neural bases of visual performance in different regions of the visual field. We used computational methods to quantify the visual topography of V1 in the marmoset (Callithrix jacchus), a small diurnal monkey. The receptive fields of neurons throughout V1 were mapped in two anesthetized animals using electrophysiological recordings. Following histological reconstruction, precise 3D reconstructions of the V1 surface and recording sites were generated. We found that the areal magnification factor (M(A) ) decreases with eccentricity following a function that has the same slope as that observed in larger diurnal primates, including macaque, squirrel, and capuchin monkeys, and humans. However, there was no systematic relationship between M(A) and polar angle. Despite individual variation in the shape of V1, the relationship between M(A) and eccentricity was preserved across cases. Comparison between V1 and the retinal ganglion cell density demonstrated preferential magnification of central space in the cortex. The size of the cortical compartment activated by a punctiform stimulus decreased from the foveal representation towards the peripheral representation. Nonetheless, the relationship between the receptive field sizes of V1 cells and the density of ganglion cells suggested that each V1 cell receives information from a similar number of retinal neurons, throughout the visual field. Copyright © 2012 Wiley Periodicals, Inc.

Ultrafast dynamic contrast-enhanced mri of the breast using compressed sensing: breast cancer diagnosis based on separate visualization of breast arteries and veins.

PubMed

Onishi, Natsuko; Kataoka, Masako; Kanao, Shotaro; Sagawa, Hajime; Iima, Mami; Nickel, Marcel Dominik; Toi, Masakazu; Togashi, Kaori

2018-01-01

To evaluate the feasibility of ultrafast dynamic contrast-enhanced (UF-DCE) magnetic resonance imaging (MRI) with compressed sensing (CS) for the separate identification of breast arteries/veins and perform temporal evaluations of breast arteries and veins with a focus on the association with ipsilateral cancers. Our Institutional Review Board approved this study with retrospective design. Twenty-five female patients who underwent UF-DCE MRI at 3T were included. UF-DCE MRI consisting of 20 continuous frames was acquired using a prototype 3D gradient-echo volumetric interpolated breath-hold sequence including a CS reconstruction: temporal resolution, 3.65 sec/frame; spatial resolution, 0.9 × 1.3 × 2.5 mm. Two readers analyzed 19 maximum intensity projection images reconstructed from subtracted images, separately identified breast arteries/veins and the earliest frame in which they were respectively visualized, and calculated the time interval between arterial and venous visualization (A-V interval) for each breast. In total, 49 breasts including 31 lesions (breast cancer, 16; benign lesion, 15) were identified. In 39 of the 49 breasts (breasts with cancers, 16; breasts with benign lesions, 10; breasts with no lesions, 13), both breast arteries and veins were separately identified. The A-V intervals for breasts with cancers were significantly shorter than those for breasts with benign lesions (P = 0.043) and no lesions (P = 0.007). UF-DCE MRI using CS enables the separate identification of breast arteries/veins. Temporal evaluations calculating the time interval between arterial and venous visualization might be helpful in the differentiation of ipsilateral breast cancers from benign lesions. 3 Technical Efficacy: Stage 1 J. Magn. Reson. Imaging 2018;47:97-104. © 2017 International Society for Magnetic Resonance in Medicine.

Three-dimensional monochromatic x-ray computed tomography using synchrotron radiation

NASA Astrophysics Data System (ADS)

Saito, Tsuneo; Kudo, Hiroyuki; Takeda, Tohoru; Itai, Yuji; Tokumori, Kenji; Toyofuku, Fukai; Hyodo, Kazuyuki; Ando, Masami; Nishimura, Katsuyuki; Uyama, Chikao

1998-08-01

We describe a technique of 3D computed tomography (3D CT) using monochromatic x rays generated by synchrotron radiation, which performs a direct reconstruction of a 3D volume image of an object from its cone-beam projections. For the development, we propose a practical scanning orbit of the x-ray source to obtain complete 3D information on an object, and its corresponding 3D image reconstruction algorithm. The validity and usefulness of the proposed scanning orbit and reconstruction algorithm were confirmed by computer simulation studies. Based on these investigations, we have developed a prototype 3D monochromatic x-ray CT using synchrotron radiation, which provides exact 3D reconstruction and material-selective imaging by using the K-edge energy subtraction technique.

Nanoscale measurements of proton tracks using fluorescent nuclear track detectors

PubMed Central

Sawakuchi, Gabriel O.; Ferreira, Felisberto A.; McFadden, Conor H.; Hallacy, Timothy M.; Granville, Dal A.; Sahoo, Narayan; Akselrod, Mark S.

2016-01-01

Purpose: The authors describe a method in which fluorescence nuclear track detectors (FNTDs), novel track detectors with nanoscale spatial resolution, are used to determine the linear energy transfer (LET) of individual proton tracks from proton therapy beams by allowing visualization and 3D reconstruction of such tracks. Methods: FNTDs were exposed to proton therapy beams with nominal energies ranging from 100 to 250 MeV. Proton track images were then recorded by confocal microscopy of the FNTDs. Proton tracks in the FNTD images were fit by using a Gaussian function to extract fluorescence amplitudes. Histograms of fluorescence amplitudes were then compared with LET spectra. Results: The authors successfully used FNTDs to register individual proton tracks from high-energy proton therapy beams, allowing reconstruction of 3D images of proton tracks along with delta rays. The track amplitudes from FNTDs could be used to parameterize LET spectra, allowing the LET of individual proton tracks from therapeutic proton beams to be determined. Conclusions: FNTDs can be used to directly visualize proton tracks and their delta rays at the nanoscale level. Because the track intensities in the FNTDs correlate with LET, they could be used further to measure LET of individual proton tracks. This method may be useful for measuring nanoscale radiation quantities and for measuring the LET of individual proton tracks in radiation biology experiments. PMID:27147359

Nanoscale measurements of proton tracks using fluorescent nuclear track detectors

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sawakuchi, Gabriel O., E-mail: gsawakuchi@mdanderson.org; Sahoo, Narayan; Ferreira, Felisberto A.

Purpose: The authors describe a method in which fluorescence nuclear track detectors (FNTDs), novel track detectors with nanoscale spatial resolution, are used to determine the linear energy transfer (LET) of individual proton tracks from proton therapy beams by allowing visualization and 3D reconstruction of such tracks. Methods: FNTDs were exposed to proton therapy beams with nominal energies ranging from 100 to 250 MeV. Proton track images were then recorded by confocal microscopy of the FNTDs. Proton tracks in the FNTD images were fit by using a Gaussian function to extract fluorescence amplitudes. Histograms of fluorescence amplitudes were then compared withmore » LET spectra. Results: The authors successfully used FNTDs to register individual proton tracks from high-energy proton therapy beams, allowing reconstruction of 3D images of proton tracks along with delta rays. The track amplitudes from FNTDs could be used to parameterize LET spectra, allowing the LET of individual proton tracks from therapeutic proton beams to be determined. Conclusions: FNTDs can be used to directly visualize proton tracks and their delta rays at the nanoscale level. Because the track intensities in the FNTDs correlate with LET, they could be used further to measure LET of individual proton tracks. This method may be useful for measuring nanoscale radiation quantities and for measuring the LET of individual proton tracks in radiation biology experiments.« less

Surgical planning and manual image fusion based on 3D model facilitate laparoscopic partial nephrectomy for intrarenal tumors.

PubMed

Chen, Yuanbo; Li, Hulin; Wu, Dingtao; Bi, Keming; Liu, Chunxiao

2014-12-01

Construction of three-dimensional (3D) model of renal tumor facilitated surgical planning and imaging guidance of manual image fusion in laparoscopic partial nephrectomy (LPN) for intrarenal tumors. Fifteen patients with intrarenal tumors underwent LPN between January and December 2012. Computed tomography-based reconstruction of the 3D models of renal tumors was performed using Mimics 12.1 software. Surgical planning was performed through morphometry and multi-angle visual views of the tumor model. Two-step manual image fusion superimposed 3D model images onto 2D laparoscopic images. The image fusion was verified by intraoperative ultrasound. Imaging-guided laparoscopic hilar clamping and tumor excision was performed. Manual fusion time, patient demographics, surgical details, and postoperative treatment parameters were analyzed. The reconstructed 3D tumor models accurately represented the patient's physiological anatomical landmarks. The surgical planning markers were marked successfully. Manual image fusion was flexible and feasible with fusion time of 6 min (5-7 min). All surgeries were completed laparoscopically. The median tumor excision time was 5.4 min (3.5-10 min), whereas the median warm ischemia time was 25.5 min (16-32 min). Twelve patients (80 %) demonstrated renal cell carcinoma on final pathology, and all surgical margins were negative. No tumor recurrence was detected after a media follow-up of 1 year (3-15 months). The surgical planning and two-step manual image fusion based on 3D model of renal tumor facilitated visible-imaging-guided tumor resection with negative margin in LPN for intrarenal tumor. It is promising and moves us one step closer to imaging-guided surgery.

3D reconstruction based on light field images

NASA Astrophysics Data System (ADS)

Zhu, Dong; Wu, Chunhong; Liu, Yunluo; Fu, Dongmei

2018-04-01

This paper proposed a method of reconstructing three-dimensional (3D) scene from two light field images capture by Lytro illium. The work was carried out by first extracting the sub-aperture images from light field images and using the scale-invariant feature transform (SIFT) for feature registration on the selected sub-aperture images. Structure from motion (SFM) algorithm is further used on the registration completed sub-aperture images to reconstruct the three-dimensional scene. 3D sparse point cloud was obtained in the end. The method shows that the 3D reconstruction can be implemented by only two light field camera captures, rather than at least a dozen times captures by traditional cameras. This can effectively solve the time-consuming, laborious issues for 3D reconstruction based on traditional digital cameras, to achieve a more rapid, convenient and accurate reconstruction.

Blind Compressed Sensing Enables 3-Dimensional Dynamic Free Breathing Magnetic Resonance Imaging of Lung Volumes and Diaphragm Motion.

PubMed

Bhave, Sampada; Lingala, Sajan Goud; Newell, John D; Nagle, Scott K; Jacob, Mathews

2016-06-01

The objective of this study was to increase the spatial and temporal resolution of dynamic 3-dimensional (3D) magnetic resonance imaging (MRI) of lung volumes and diaphragm motion. To achieve this goal, we evaluate the utility of the proposed blind compressed sensing (BCS) algorithm to recover data from highly undersampled measurements. We evaluated the performance of the BCS scheme to recover dynamic data sets from retrospectively and prospectively undersampled measurements. We also compared its performance against that of view-sharing, the nuclear norm minimization scheme, and the l1 Fourier sparsity regularization scheme. Quantitative experiments were performed on a healthy subject using a fully sampled 2D data set with uniform radial sampling, which was retrospectively undersampled with 16 radial spokes per frame to correspond to an undersampling factor of 8. The images obtained from the 4 reconstruction schemes were compared with the fully sampled data using mean square error and normalized high-frequency error metrics. The schemes were also compared using prospective 3D data acquired on a Siemens 3 T TIM TRIO MRI scanner on 8 healthy subjects during free breathing. Two expert cardiothoracic radiologists (R1 and R2) qualitatively evaluated the reconstructed 3D data sets using a 5-point scale (0-4) on the basis of spatial resolution, temporal resolution, and presence of aliasing artifacts. The BCS scheme gives better reconstructions (mean square error = 0.0232 and normalized high frequency = 0.133) than the other schemes in the 2D retrospective undersampling experiments, producing minimally distorted reconstructions up to an acceleration factor of 8 (16 radial spokes per frame). The prospective 3D experiments show that the BCS scheme provides visually improved reconstructions than the other schemes do. The BCS scheme provides improved qualitative scores over nuclear norm and l1 Fourier sparsity regularization schemes in the temporal blurring and spatial blurring categories. The qualitative scores for aliasing artifacts in the images reconstructed by nuclear norm scheme and BCS scheme are comparable.The comparisons of the tidal volume changes also show that the BCS scheme has less temporal blurring as compared with the nuclear norm minimization scheme and the l1 Fourier sparsity regularization scheme. The minute ventilation estimated by BCS for tidal breathing in supine position (4 L/min) and the measured supine inspiratory capacity (1.5 L) is in good correlation with the literature. The improved performance of BCS can be explained by its ability to efficiently adapt to the data, thus providing a richer representation of the signal. The feasibility of the BCS scheme was demonstrated for dynamic 3D free breathing MRI of lung volumes and diaphragm motion. A temporal resolution of ∼500 milliseconds, spatial resolution of 2.7 × 2.7 × 10 mm, with whole lung coverage (16 slices) was achieved using the BCS scheme.

Beat to beat 3-dimensional intracardiac echocardiography: theoretical approach and practical experiences.

PubMed

Stapf, Daniel; Franke, Andreas; Schreckenberg, Marcus; Schummers, Georg; Mischke, Karl; Marx, Nikolaus; Schauerte, Patrick; Knackstedt, Christian

2013-04-01

Three-dimensional (3D)-imaging provides important information on cardiac anatomy during electrophysiological procedures. Real-time updates of modalities with high soft-tissue contrast are particularly advantageous during cardiac procedures. Therefore, a beat to beat 3D visualization of cardiac anatomy by intracardiac echocardiography (ICE) was developed and tested in phantoms and animals. An electronic phased-array 5-10 MHz ICE-catheter (Acuson, AcuNav/Siemens Medical Solutions USA/64 elements) providing a 90° sector image was used for ICE-imaging. A custom-made mechanical prototype controlled by a servo motor allowed automatic rotation of the ICE-catheter around its longitudinal axis. During a single heartbeat, the ICE-catheter was rotated and 2D-images were acquired. Reconstruction into a 3D volume and rendering by a prototype software was performed beat to beat. After experimental validation using a rigid phantom, the system was tested in an animal study and afterwards, for quantitative validation, in a dynamic phantom. Acquisition of beat to beat 3D-reconstruction was technically feasible. However, twisting of the ICE-catheter shaft due to friction and torsion was found and rotation was hampered. Also, depiction of catheters was not always ensured in case of parallel alignment. Using a curved sheath for depiction of cardiac anatomy there was no congruent depiction of shape and dimension of static and moving objects. Beat to beat 3D-ICE-imaging is feasible. However, shape and dimension of static and moving objects cannot always be displayed with necessary steadiness as needed in the clinical setting. As catheter depiction is also limited, clinical use seems impossible.

3D Viewing: Odd Perception - Illusion? reality? or both?

NASA Astrophysics Data System (ADS)

Kisimoto, K.; Iizasa, K.

2008-12-01

We live in the three dimensional space, don't we? It could be at least four dimensions, but that is another story. In either way our perceptual capability of 3D-Viewing is constrained by our 2D-perception (our intrinsic tools of perception). I carried out a few visual experiments using topographic data to show our intrinsic (or biological) disability (or shortcoming) in 3D-recognition of our world. Results of the experiments suggest: (1) 3D-surface model displayed on a 2D-computer screen (or paper) always has two interpretations of the 3D- surface geometry, if we choose one of the interpretation (in other word, if we are hooked by one perception of the two), we maintain its perception even if the 3D-model changes its viewing perspective in time shown on the screen, (2) more interesting is that 3D-real solid object (e.g.,made of clay) also gives above mentioned two interpretations of the geometry of the object, if we observe the object with one-eye. Most famous example of this viewing illusion is exemplified by a magician, who died in 2007, Jerry Andrus who made a super-cool paper crafted dragon which causes visual illusion to one-eyed viewer. I, by the experiments, confirmed this phenomenon in another perceptually persuasive (deceptive?) way. My conclusion is that this illusion is intrinsic, i.e. reality for human, because, even if we live in 3D-space, our perceptional tool (eyes) is composed of 2D sensors whose information is reconstructed or processed to 3D by our experience-based brain. So, (3) when we observe the 3D-surface-model on the computer screen, we are always one eye short even if we use both eyes. One last suggestion from my experiments is that recent highly sophisticated 3D- models might include too many information that human perceptions cannot handle properly, i.e. we might not be understanding the 3D world (geospace) at all, just illusioned.

A Review on Real-Time 3D Ultrasound Imaging Technology

PubMed Central

Zeng, Zhaozheng

2017-01-01

Real-time three-dimensional (3D) ultrasound (US) has attracted much more attention in medical researches because it provides interactive feedback to help clinicians acquire high-quality images as well as timely spatial information of the scanned area and hence is necessary in intraoperative ultrasound examinations. Plenty of publications have been declared to complete the real-time or near real-time visualization of 3D ultrasound using volumetric probes or the routinely used two-dimensional (2D) probes. So far, a review on how to design an interactive system with appropriate processing algorithms remains missing, resulting in the lack of systematic understanding of the relevant technology. In this article, previous and the latest work on designing a real-time or near real-time 3D ultrasound imaging system are reviewed. Specifically, the data acquisition techniques, reconstruction algorithms, volume rendering methods, and clinical applications are presented. Moreover, the advantages and disadvantages of state-of-the-art approaches are discussed in detail. PMID:28459067

A Review on Real-Time 3D Ultrasound Imaging Technology.

PubMed

Huang, Qinghua; Zeng, Zhaozheng

2017-01-01

Real-time three-dimensional (3D) ultrasound (US) has attracted much more attention in medical researches because it provides interactive feedback to help clinicians acquire high-quality images as well as timely spatial information of the scanned area and hence is necessary in intraoperative ultrasound examinations. Plenty of publications have been declared to complete the real-time or near real-time visualization of 3D ultrasound using volumetric probes or the routinely used two-dimensional (2D) probes. So far, a review on how to design an interactive system with appropriate processing algorithms remains missing, resulting in the lack of systematic understanding of the relevant technology. In this article, previous and the latest work on designing a real-time or near real-time 3D ultrasound imaging system are reviewed. Specifically, the data acquisition techniques, reconstruction algorithms, volume rendering methods, and clinical applications are presented. Moreover, the advantages and disadvantages of state-of-the-art approaches are discussed in detail.

Liquid metal angiography for mega contrast X-ray visualization of vascular network in reconstructing in-vitro organ anatomy.

PubMed

Wang, Qian; Yu, Yang; Pan, Keqin; Liu, Jing

2014-07-01

Visualization on the anatomical vessel networks plays a vital role in the physiological or pathological investigations. However, so far it still remains a big challenge to identify the fine structures of the smallest capillary vessel networks via conventional imaging ways. Here, the room temperature liquid metal angiography was proposed for the first time to generate mega contrast X-ray images for multiscale vasculature mapping. Particularly, gallium was adopted as the room temperature liquid metal contrast agent and infused into the vessels of in vitro pig hearts and kidneys. We scanned the samples under X-ray and compared the angiograms with those obtained via conventional contrast agent--the iohexol. As quantitatively demonstrated by the grayscale histograms and numerical indexes, the contrast of the vessels to the surrounding tissues in the liquid metal angiograms is orders higher than that of the iohexol enhanced images. And the angiogram has reached detailed enough width of 0.1 mm for the tiny vessels, which indicated that the capillaries can be clearly distinguished under the liquid metal enhanced images. Further, with tomography from the micro-CT, we also managed to reconstruct the 3-D structures of the kidney vessels. Tremendous clarity and efficiency of the method over existing approaches have been experimentally clarified. It was disclosed that the usually invisible capillary networks now become distinctively clear in the gallium angiograms. This basic mechanism has generalized purpose and can be extended to a wide spectrum of 3-D computational tomographic areas. It opens a new soft tool for quickly reconstructing high-resolution spatial channel networks for scientific researches as well as engineering practices where complicated and time-consuming resections are no longer a necessity.

Challenges in Flying Quadrotor Unmanned Aerial Vehicle for 3d Indoor Reconstruction

NASA Astrophysics Data System (ADS)

Yan, J.; Grasso, N.; Zlatanova, S.; Braggaar, R. C.; Marx, D. B.

2017-09-01

Three-dimensional modelling plays a vital role in indoor 3D tracking, navigation, guidance and emergency evacuation. Reconstruction of indoor 3D models is still problematic, in part, because indoor spaces provide challenges less-documented than their outdoor counterparts. Challenges include obstacles curtailing image and point cloud capture, restricted accessibility and a wide array of indoor objects, each with unique semantics. Reconstruction of indoor environments can be achieved through a photogrammetric approach, e.g. by using image frames, aligned using recurring corresponding image points (CIP) to build coloured point clouds. Our experiments were conducted by flying a QUAV in three indoor environments and later reconstructing 3D models which were analysed under different conditions. Point clouds and meshes were created using Agisoft PhotoScan Professional. We concentrated on flight paths from two vantage points: 1) safety and security while flying indoors and 2) data collection needed for reconstruction of 3D models. We surmised that the main challenges in providing safe flight paths are related to the physical configuration of indoor environments, privacy issues, the presence of people and light conditions. We observed that the quality of recorded video used for 3D reconstruction has a high dependency on surface materials, wall textures and object types being reconstructed. Our results show that 3D indoor reconstruction predicated on video capture using a QUAV is indeed feasible, but close attention should be paid to flight paths and conditions ultimately influencing the quality of 3D models. Moreover, it should be decided in advance which objects need to be reconstructed, e.g. bare rooms or detailed furniture.

[Combined use of wide-detector and adaptive statistical iterative reconstruction-V technique in abdominal CT with low radiation dose].

PubMed

Wang, H X; Lü, P J; Yue, S W; Chang, L Y; Li, Y; Zhao, H P; Li, W R; Gao, J B

2017-12-05

Objective: To investigate the image quality and radiation dose with wide-detector(80 mm) and adaptive statistical iterative reconstruction-V (ASIR-V) technique at abdominal contrast enhanced CT scan. Methods: In the first phantom experiment part, the percentage of ASIR-V for half dose of combined wide detector with ASIR-V technique as compared with standard-detector (40 mm) technique was determined. The human experiment was performed based on the phantom study, 160 patients underwent contrast-enhanced abdominal CT scan were prospectively collected and divided into the control group ( n =40) with image reconstruction using 40% ASIR (group A) and the study group ( n =120) with random number table. According to pre-ASIR-V percentage, the study group was assigned into three groups[40 cases in each group, group B: 0 pre-ASIR-V scan with image reconstruction of 0-100% post-ASIR-V (interval 10%, subgroups B0-B10); group C: 20% pre-ASIR-V with 20%, 40% and 60% post-ASIR-V (subgroups C1-C3); group D: 40%pre-ASIR-V with 40% and 60% post-ASIR-V (subgroups D1-D2)]. Image noise, CT attenuation values and CNR of the liver, pancreas, aorta and portal vein were compared by using two sample t test and One-way ANOVA. Qualitative visual parameters (overall image quality as graded on a 5-point scale) was compared by Mann-Whitney U test and Kruskal-Wallis H test. Results: The phantom experiment showed that the percentage of pre-ASIR-V for half dose was 40%. With the 40% pre-ASIR-V, radiation dose in the study group was reduced by 35.5% as compared with the control group. Image noise in the subgroups of B2-B10, C2-C3 and D1-D2 were lower ( t =-14.681--3.046, all P <0.05) while CNR in the subgroups of B4-B10, C2-3 and D1-D2 were higher( t =2.048-9.248, all P <0.05)than those in group A, except the CNR of liver in the arterial phase (AP) in C2, D1 and D2 and the CNR of pancreas in AP in D1 ( t =0.574-1.327, all P >0.05). The subjective image quality scores increased gradually in the range of 0-60% post-ASIR-V and decreased with post-ASIR-V larger than 70%. The overall image quality of subgroup B3-B8, C2-C3 and D1-D2 were higher than that in group A ( Z =-2.229--6.533, all P <0.05). Conclusion: Compared with stand-detector together with ASIR technique, wide-detector combined with 40% pre-ASIR-V technique with 60% post-ASIR-V image reconstruction can reduce radiation dose while maintain good overall image quality.

Two-dimensional and three-dimensional dynamic imaging of live biofilms in a microchannel by time-of-flight secondary ion mass spectrometry

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hua, Xin; Marshall, Matthew J.; Xiong, Yijia

2015-05-01

A vacuum compatible microfluidic reactor, SALVI (System for Analysis at the Liquid Vacuum Interface) was employed for in situ chemical imaging of live biofilms using time-of-flight secondary ion mass spectrometry (ToF-SIMS). Depth profiling by sputtering materials in sequential layers resulted in live biofilm spatial chemical mapping. 2D images were reconstructed to report the first 3D images of hydrated biofilm elucidating spatial and chemical heterogeneity. 2D image principal component analysis (PCA) was conducted among biofilms at different locations in the microchannel. Our approach directly visualized spatial and chemical heterogeneity within the living biofilm by dynamic liquid ToF-SIMS.

In vivo liver visualizations with magnetic particle imaging based on the calibration measurement approach

NASA Astrophysics Data System (ADS)

Dieckhoff, J.; Kaul, M. G.; Mummert, T.; Jung, C.; Salamon, J.; Adam, G.; Knopp, T.; Ludwig, F.; Balceris, C.; Ittrich, H.

2017-05-01

Magnetic particle imaging (MPI) facilitates the rapid determination of 3D in vivo magnetic nanoparticle distributions. In this work, liver MPI following intravenous injections of ferucarbotran (Resovist®) was studied. The image reconstruction was based on a calibration measurement, the so called system function. The application of an enhanced system function sample reflecting the particle mobility and aggregation status of ferucarbotran resulted in significantly improved image reconstructions. The finding was supported by characterizations of different ferucarbotran compositions with the magnetorelaxometry and magnetic particle spectroscopy technique. For instance, similar results were obtained between ferucarbotran embedded in freeze-dried mannitol sugar and liver tissue harvested after a ferucarbotran injection. In addition, the combination of multiple shifted measurement patches for a joint reconstruction of the MPI data enlarged the field of view and increased the covering of liver MPI on magnetic resonance images noticeably.

In vivo liver visualizations with magnetic particle imaging based on the calibration measurement approach.

PubMed

Dieckhoff, J; Kaul, M G; Mummert, T; Jung, C; Salamon, J; Adam, G; Knopp, T; Ludwig, F; Balceris, C; Ittrich, H

2017-05-07

Magnetic particle imaging (MPI) facilitates the rapid determination of 3D in vivo magnetic nanoparticle distributions. In this work, liver MPI following intravenous injections of ferucarbotran (Resovist ® ) was studied. The image reconstruction was based on a calibration measurement, the so called system function. The application of an enhanced system function sample reflecting the particle mobility and aggregation status of ferucarbotran resulted in significantly improved image reconstructions. The finding was supported by characterizations of different ferucarbotran compositions with the magnetorelaxometry and magnetic particle spectroscopy technique. For instance, similar results were obtained between ferucarbotran embedded in freeze-dried mannitol sugar and liver tissue harvested after a ferucarbotran injection. In addition, the combination of multiple shifted measurement patches for a joint reconstruction of the MPI data enlarged the field of view and increased the covering of liver MPI on magnetic resonance images noticeably.

Validation of a novel CARTOSEG™ segmentation module software for contrast-enhanced computed tomography-guided radiofrequency ablation in patients with atrial fibrillation.

PubMed

Imanli, Hasan; Bhatty, Shaun; Jeudy, Jean; Ghzally, Yousra; Ume, Kiddy; Vunnam, Rama; Itah, Refael; Amit, Mati; Duell, John; See, Vincent; Shorofsky, Stephen; Dickfeld, Timm M

2017-11-01

Visualization of left atrial (LA) anatomy using image integration modules has been associated with decreased radiation exposure and improved procedural outcome when used for guidance of pulmonary vein isolation (PVI) in atrial fibrillation (AF) ablation. We evaluated the CARTOSEG™ CT Segmentation Module (Biosense Webster, Inc.) that offers a new CT-specific semiautomatic reconstruction of the atrial endocardium. The CARTOSEG™ CT Segmentation Module software was assessed prospectively in 80 patients undergoing AF ablation. Using preprocedural contrast-enhanced computed tomography (CE-CT), cardiac chambers, coronary sinus (CS), and esophagus were semiautomatically segmented. Segmentation quality was assessed from 1 (poor) to 4 (excellent). The reconstructed structures were registered with the electroanatomic map (EAM). PVI was performed using the registered 3D images. Semiautomatic reconstruction of the heart chambers was successfully performed in all 80 patients with AF. CE-CT DICOM file import, semiautomatic segmentation of cardiac chambers, esophagus, and CS was performed in 185 ± 105, 18 ± 5, 119 ± 47, and 69 ± 19 seconds, respectively. Average segmentation quality was 3.9 ± 0.2, 3.8 ± 0.3, and 3.8 ± 0.2 for LA, esophagus, and CS, respectively. Registration accuracy between the EAM and CE-CT-derived segmentation was 4.2 ± 0.9 mm. Complications consisted of one perforation (1%) which required pericardiocentesis, one increased pericardial effusion treated conservatively (1%), and one early termination of ablation due to thrombus formation on the ablation sheath without TIA/stroke (1%). All targeted PVs (n  =  309) were successfully isolated. The novel CT- CARTOSEG™ CT Segmentation Module enables a rapid and reliable semiautomatic 3D reconstruction of cardiac chambers and adjacent anatomy, which facilitates successful and safe PVI. © 2017 Wiley Periodicals, Inc.

Mineral and organic matrix interaction in normally calcifying tendon visualized in three dimensions by high-voltage electron microscopic tomography and graphic image reconstruction

NASA Technical Reports Server (NTRS)

Landis, W. J.; Song, M. J.; Leith, A.; McEwen, L.; McEwen, B. F.

1993-01-01

To define the ultrastructural accommodation of mineral crystals by collagen fibrils and other organic matrix components during vertebrate calcification, electron microscopic 3-D reconstructions were generated from the normally mineralizing leg tendons from the domestic turkey, Meleagris gallopavo. Embedded specimens containing initial collagen mineralizing sites were cut into 0.5-micron-thick sections and viewed and photographed at 1.0 MV in the Albany AEI-EM7 high-voltage electron microscope. Tomographic 3-D reconstructions were computed from a 2 degree tilt series of micrographs taken over a minimum angular range of +/- 60 degrees. Reconstructions of longitudinal tendon profiles confirm the presence of irregularly shaped mineral platelets, whose crystallographic c-axes are oriented generally parallel to one another and directed along the collagen long axes. The reconstructions also corroborate observations of a variable crystal length (up to 170 nm measured along crystallographic c-axes), the presence of crystals initially in either the hole or overlap zones of collagen, and crystal growth in the c-axis direction beyond these zones into adjacent overlap and other hole regions. Tomography shows for the first time that crystal width varies (30-45 nm) but crystal thickness is uniform (approximately 4-6 nm at the resolution limit of tomography); more crystals are located in the collagen hole zones than in the overlap regions at the earliest stages of tendon mineralization; the crystallographic c-axes of the platelets lie within +/- 15-20 degrees of one another rather than being perfectly parallel; adjacent platelets are spatially separated by a minimum of 4.2 +/- 1.0 nm; crystals apparently fuse in coplanar alignment to form larger platelets; development of crystals in width occurs to dimensions beyond single collagen hole zones; and a thin envelope of organic origin may be present along or just beneath the surfaces of individual mineral platelets. Implicit in the results is that the formation of crystals occurs at different sites and times by independent nucleation events in local regions of collagen. These data provide the first direct visual evidence from 3-D imaging describing the size, shape, orientation, and growth of mineral crystals in association with collagen of a normally mineralizing vertebrate tissue. They support concepts that c-axial crystal growth is unhindered by collage hole zone dimensions, that crystals are organized in the tendon in a series of generally parallel platelets, and that crystal growth in width across collagen fibrils may follow channels or grooves formed by adjacent hole zones in register.

3D noise power spectrum applied on clinical MDCT scanners: effects of reconstruction algorithms and reconstruction filters

NASA Astrophysics Data System (ADS)

Miéville, Frédéric A.; Bolard, Gregory; Benkreira, Mohamed; Ayestaran, Paul; Gudinchet, François; Bochud, François; Verdun, Francis R.

2011-03-01

The noise power spectrum (NPS) is the reference metric for understanding the noise content in computed tomography (CT) images. To evaluate the noise properties of clinical multidetector (MDCT) scanners, local 2D and 3D NPSs were computed for different acquisition reconstruction parameters. A 64- and a 128-MDCT scanners were employed. Measurements were performed on a water phantom in axial and helical acquisition modes. CT dose index was identical for both installations. Influence of parameters such as the pitch, the reconstruction filter (soft, standard and bone) and the reconstruction algorithm (filtered-back projection (FBP), adaptive statistical iterative reconstruction (ASIR)) were investigated. Images were also reconstructed in the coronal plane using a reformat process. Then 2D and 3D NPS methods were computed. In axial acquisition mode, the 2D axial NPS showed an important magnitude variation as a function of the z-direction when measured at the phantom center. In helical mode, a directional dependency with lobular shape was observed while the magnitude of the NPS was kept constant. Important effects of the reconstruction filter, pitch and reconstruction algorithm were observed on 3D NPS results for both MDCTs. With ASIR, a reduction of the NPS magnitude and a shift of the NPS peak to the low frequency range were visible. 2D coronal NPS obtained from the reformat images was impacted by the interpolation when compared to 2D coronal NPS obtained from 3D measurements. The noise properties of volume measured in last generation MDCTs was studied using local 3D NPS metric. However, impact of the non-stationarity noise effect may need further investigations.

Hierarchical event selection for video storyboards with a case study on snooker video visualization.

PubMed

Parry, Matthew L; Legg, Philip A; Chung, David H S; Griffiths, Iwan W; Chen, Min

2011-12-01

Video storyboard, which is a form of video visualization, summarizes the major events in a video using illustrative visualization. There are three main technical challenges in creating a video storyboard, (a) event classification, (b) event selection and (c) event illustration. Among these challenges, (a) is highly application-dependent and requires a significant amount of application specific semantics to be encoded in a system or manually specified by users. This paper focuses on challenges (b) and (c). In particular, we present a framework for hierarchical event representation, and an importance-based selection algorithm for supporting the creation of a video storyboard from a video. We consider the storyboard to be an event summarization for the whole video, whilst each individual illustration on the board is also an event summarization but for a smaller time window. We utilized a 3D visualization template for depicting and annotating events in illustrations. To demonstrate the concepts and algorithms developed, we use Snooker video visualization as a case study, because it has a concrete and agreeable set of semantic definitions for events and can make use of existing techniques of event detection and 3D reconstruction in a reliable manner. Nevertheless, most of our concepts and algorithms developed for challenges (b) and (c) can be applied to other application areas. © 2010 IEEE

Whole lung morphometry with 3D multiple b-value hyperpolarized gas MRI and compressed sensing.

PubMed

Chan, Ho-Fung; Stewart, Neil J; Parra-Robles, Juan; Collier, Guilhem J; Wild, Jim M

2017-05-01

To demonstrate three-dimensional (3D) multiple b-value diffusion-weighted (DW) MRI of hyperpolarized 3 He gas for whole lung morphometry with compressed sensing (CS). A fully-sampled, two b-value, 3D hyperpolarized 3 He DW-MRI dataset was acquired from the lungs of a healthy volunteer and retrospectively undersampled in the k y and k z phase-encoding directions for CS simulations. Optimal k-space undersampling patterns were determined by minimizing the mean absolute error between reconstructed and fully-sampled 3 He apparent diffusion coefficient (ADC) maps. Prospective three-fold, undersampled, 3D multiple b-value 3 He DW-MRI datasets were acquired from five healthy volunteers and one chronic obstructive pulmonary disease (COPD) patient, and the mean values of maps of ADC and mean alveolar dimension (Lm D ) were validated against two-dimensional (2D) and 3D fully-sampled 3 He DW-MRI experiments. Reconstructed undersampled datasets showed no visual artifacts and good preservation of the main image features and quantitative information. A good agreement between fully-sampled and prospective undersampled datasets was found, with a mean difference of +3.4% and +5.1% observed in mean global ADC and Lm D values, respectively. These differences were within the standard deviation range and consistent with values reported from healthy and COPD lungs. Accelerated CS acquisition has facilitated 3D multiple b-value 3 He DW-MRI scans in a single breath-hold, enabling whole lung morphometry mapping. Magn Reson Med 77:1916-1925, 2017. © 2016 The Authors Magnetic Resonance in Medicine published by Wiley Periodicals, Inc. on behalf of International Society for Magnetic Resonance in Medicine. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. © 2016 The Authors Magnetic Resonance in Medicine published by Wiley Periodicals, Inc. on behalf of International Society for Magnetic Resonance in Medicine.

Hybrid 3D reconstruction and image-based rendering techniques for reality modeling

NASA Astrophysics Data System (ADS)

Sequeira, Vitor; Wolfart, Erik; Bovisio, Emanuele; Biotti, Ester; Goncalves, Joao G. M.

2000-12-01

This paper presents a component approach that combines in a seamless way the strong features of laser range acquisition with the visual quality of purely photographic approaches. The relevant components of the system are: (i) Panoramic images for distant background scenery where parallax is insignificant; (ii) Photogrammetry for background buildings and (iii) High detailed laser based models for the primary environment, structure of exteriors of buildings and interiors of rooms. These techniques have a wide range of applications in visualization, virtual reality, cost effective as-built analysis of architectural and industrial environments, building facilities management, real-estate, E-commerce, remote inspection of hazardous environments, TV production and many others.

Hearing improvement with softband and implanted bone-anchored hearing devices and modified implantation surgery in patients with bilateral microtia-atresia.

PubMed

Wang, Yibei; Fan, Xinmiao; Wang, Pu; Fan, Yue; Chen, Xiaowei

2018-01-01

To evaluate auditory development and hearing improvement in patients with bilateral microtia-atresia using softband and implanted bone-anchored hearing devices and to modify the implantation surgery. The subjects were divided into two groups: the softband group (40 infants, 3 months to 2 years old, Ponto softband) and the implanted group (6 patients, 6-28 years old, Ponto). The Infant-Toddler Meaning Auditory Integration Scale was used conducted to evaluate auditory development at baseline and after 3, 6, 12, and 24 months, and visual reinforcement audiometry was used to assess the auditory threshold in the softband group. In the implanted group, bone-anchored hearing devices were implanted combined with the auricular reconstruction surgery, and high-resolution CT was used to assess the deformity preoperatively. Auditory threshold and speech discrimination scores of the patients with implants were measured under the unaided, softband, and implanted conditions. Total Infant-Toddler Meaning Auditory Integration Scale scores in the softband group improved significantly and approached normal levels. The average visual reinforcement audiometry values under the unaided and softband conditions were 76.75 ± 6.05 dB HL and 32.25 ± 6.20 dB HL (P < 0.01), respectively. In the implanted group, the auditory thresholds under the unaided, softband, and implanted conditions were 59.17 ± 3.76 dB HL, 32.5 ± 2.74 dB HL, and 17.5 ± 5.24 dB HL (P < 0.01), respectively. The respective speech discrimination scores were 23.33 ± 14.72%, 77.17 ± 6.46%, and 96.50 ± 2.66% (P < 0.01). Using softband bone-anchored hearing devices is effective for auditory development and hearing improvement in infants with bilateral microtia-atresia. Wearing softband bone-anchored hearing devices before auricle reconstruction and combining bone-anchored hearing device implantation with auricular reconstruction surgery may bethe optimal clinical choice for these patients, and results in more significant hearing improvement and minimal surgical and anesthetic injury. Copyright © 2017 Elsevier B.V. All rights reserved.

Toward a 3D transrectal ultrasound system for verification of needle placement during high-dose-rate interstitial gynecologic brachytherapy.

PubMed

Rodgers, Jessica Robin; Surry, Kathleen; Leung, Eric; D'Souza, David; Fenster, Aaron

2017-05-01

Treatment for gynecologic cancers, such as cervical, recurrent endometrial, and vaginal malignancies, commonly includes external-beam radiation and brachytherapy. In high-dose-rate (HDR) interstitial gynecologic brachytherapy, radiation treatment is delivered via hollow needles that are typically inserted through a template on the perineum with a cylinder placed in the vagina for stability. Despite the need for precise needle placement to minimize complications and provide optimal treatment, there is no standard intra-operative image-guidance for this procedure. While some image-guidance techniques have been proposed, including magnetic resonance (MR) imaging, X-ray computed tomography (CT), and two-dimensional (2D) transrectal ultrasound (TRUS), these techniques have not been widely adopted. In order to provide intra-operative needle visualization and localization during interstitial brachytherapy, we have developed a three-dimensional (3D) TRUS system. This study describes the 3D TRUS system and reports on the system validation and results from a proof-of-concept patient study. To obtain a 3D TRUS image, the system rotates a conventional 2D endocavity transducer through 170 degrees in 12 s, reconstructing the 2D frames into a 3D image in real-time. The geometry of the reconstruction was validated using two geometric phantoms to ensure the accuracy of the linear measurements in each of the image coordinate directions and the volumetric accuracy of the system. An agar phantom including vaginal and rectal canals, as well as a model uterus and tumor, was designed and used to test the visualization and localization of the interstitial needles under idealized conditions by comparing the needles' positions between the 3D TRUS scan and a registered MR image. Five patients undergoing HDR interstitial gynecologic brachytherapy were imaged using the 3D TRUS system following the insertion of all needles. This image was manually, rigidly registered to the clinical postinsertion CT scan based on the vaginal cylinder of the needle template. The positions of the tips and the trajectory of the needle paths were compared between the modalities. The observed geometric errors of the system were ≤ 0.3 mm in each of the three coordinate planes of the 3D US image and the mean measured volumetric error was 0.10 cm 3 . In the phantom study, the mean needle tip difference was 1.54 ± 0.71 mm and the mean trajectory difference was 0.94 ± 0.89 degrees (n = 14). In the in vivo study, a total of 73 needles were placed, of which 88% of needles were visible and 79% of tips were identifiable in the 3D TRUS images. Six of the nine needles that were not visible were due to shadowing artifacts created by the presence of the vaginal cylinder of the needle template. The mean distance between corresponding needle tips in the two modalities was 3.82 ± 1.86 mm and the mean trajectory difference was 3.04 ± 1.63 degrees for the five patients. In this proof-of-concept study, the 3D TRUS system allowed for localization of needles not obscured by shadowing artifacts, providing a method for visualizing needles intra-operatively during HDR interstitial brachytherapy of gynecologic cancers and providing the potential for 3D image-guidance. © 2017 American Association of Physicists in Medicine.

5D Modelling: An Efficient Approach for Creating Spatiotemporal Predictive 3D Maps of Large-Scale Cultural Resources

NASA Astrophysics Data System (ADS)

Doulamis, A.; Doulamis, N.; Ioannidis, C.; Chrysouli, C.; Grammalidis, N.; Dimitropoulos, K.; Potsiou, C.; Stathopoulou, E.-K.; Ioannides, M.

2015-08-01

Outdoor large-scale cultural sites are mostly sensitive to environmental, natural and human made factors, implying an imminent need for a spatio-temporal assessment to identify regions of potential cultural interest (material degradation, structuring, conservation). On the other hand, in Cultural Heritage research quite different actors are involved (archaeologists, curators, conservators, simple users) each of diverse needs. All these statements advocate that a 5D modelling (3D geometry plus time plus levels of details) is ideally required for preservation and assessment of outdoor large scale cultural sites, which is currently implemented as a simple aggregation of 3D digital models at different time and levels of details. The main bottleneck of such an approach is its complexity, making 5D modelling impossible to be validated in real life conditions. In this paper, a cost effective and affordable framework for 5D modelling is proposed based on a spatial-temporal dependent aggregation of 3D digital models, by incorporating a predictive assessment procedure to indicate which regions (surfaces) of an object should be reconstructed at higher levels of details at next time instances and which at lower ones. In this way, dynamic change history maps are created, indicating spatial probabilities of regions needed further 3D modelling at forthcoming instances. Using these maps, predictive assessment can be made, that is, to localize surfaces within the objects where a high accuracy reconstruction process needs to be activated at the forthcoming time instances. The proposed 5D Digital Cultural Heritage Model (5D-DCHM) is implemented using open interoperable standards based on the CityGML framework, which also allows the description of additional semantic metadata information. Visualization aspects are also supported to allow easy manipulation, interaction and representation of the 5D-DCHM geometry and the respective semantic information. The open source 3DCityDB incorporating a PostgreSQL geo-database is used to manage and manipulate 3D data and their semantics.

D Reconstruction from Multi-View Medical X-Ray Images - Review and Evaluation of Existing Methods

NASA Astrophysics Data System (ADS)

Hosseinian, S.; Arefi, H.

2015-12-01

The 3D concept is extremely important in clinical studies of human body. Accurate 3D models of bony structures are currently required in clinical routine for diagnosis, patient follow-up, surgical planning, computer assisted surgery and biomechanical applications. However, 3D conventional medical imaging techniques such as computed tomography (CT) scan and magnetic resonance imaging (MRI) have serious limitations such as using in non-weight-bearing positions, costs and high radiation dose(for CT). Therefore, 3D reconstruction methods from biplanar X-ray images have been taken into consideration as reliable alternative methods in order to achieve accurate 3D models with low dose radiation in weight-bearing positions. Different methods have been offered for 3D reconstruction from X-ray images using photogrammetry which should be assessed. In this paper, after demonstrating the principles of 3D reconstruction from X-ray images, different existing methods of 3D reconstruction of bony structures from radiographs are classified and evaluated with various metrics and their advantages and disadvantages are mentioned. Finally, a comparison has been done on the presented methods with respect to several metrics such as accuracy, reconstruction time and their applications. With regards to the research, each method has several advantages and disadvantages which should be considered for a specific application.

A defocus-information-free autostereoscopic three-dimensional (3D) digital reconstruction method using direct extraction of disparity information (DEDI)

NASA Astrophysics Data System (ADS)

Li, Da; Cheung, Chifai; Zhao, Xing; Ren, Mingjun; Zhang, Juan; Zhou, Liqiu

2016-10-01

Autostereoscopy based three-dimensional (3D) digital reconstruction has been widely applied in the field of medical science, entertainment, design, industrial manufacture, precision measurement and many other areas. The 3D digital model of the target can be reconstructed based on the series of two-dimensional (2D) information acquired by the autostereoscopic system, which consists multiple lens and can provide information of the target from multiple angles. This paper presents a generalized and precise autostereoscopic three-dimensional (3D) digital reconstruction method based on Direct Extraction of Disparity Information (DEDI) which can be used to any transform autostereoscopic systems and provides accurate 3D reconstruction results through error elimination process based on statistical analysis. The feasibility of DEDI method has been successfully verified through a series of optical 3D digital reconstruction experiments on different autostereoscopic systems which is highly efficient to perform the direct full 3D digital model construction based on tomography-like operation upon every depth plane with the exclusion of the defocused information. With the absolute focused information processed by DEDI method, the 3D digital model of the target can be directly and precisely formed along the axial direction with the depth information.

Opti-acoustic stereo imaging: on system calibration and 3-D target reconstruction.

PubMed

Negahdaripour, Shahriar; Sekkati, Hicham; Pirsiavash, Hamed

2009-06-01

Utilization of an acoustic camera for range measurements is a key advantage for 3-D shape recovery of underwater targets by opti-acoustic stereo imaging, where the associated epipolar geometry of optical and acoustic image correspondences can be described in terms of conic sections. In this paper, we propose methods for system calibration and 3-D scene reconstruction by maximum likelihood estimation from noisy image measurements. The recursive 3-D reconstruction method utilized as initial condition a closed-form solution that integrates the advantages of two other closed-form solutions, referred to as the range and azimuth solutions. Synthetic data tests are given to provide insight into the merits of the new target imaging and 3-D reconstruction paradigm, while experiments with real data confirm the findings based on computer simulations, and demonstrate the merits of this novel 3-D reconstruction paradigm.

Digital tomosynthesis rendering of joint margins for arthritis assessment

NASA Astrophysics Data System (ADS)

Duryea, Jeffrey W.; Neumann, Gesa; Yoshioka, Hiroshi; Dobbins, James T., III

2004-05-01

PURPOSE: Rheumatoid arthritis (RA) of the hand is a significant healthcare problem. Techniques to accurately quantity the structural changes from RA are crucial for the development and prescription of therapies. Analysis of radiographic joint space width (JSW) is widely used and has demonstrated promise. However, radiography presents a 2D view of the joint. In this study we performed tomosynthesis reconstructions of proximal interphalangeal (PIP), and metacarpophalangeal (MCP) joints to measure the 3D joint structure. METHODS: We performed a reader study using simulated radiographs of 12 MCP and 12 PIP joints from skeletal specimens imaged with micro-CT. The tomosynthesis technique provided images of reconstructed planes with 0.75 mm spacing, which were presented to 2 readers with a computer tool. The readers were instructed to delineate the joint surfaces on tomosynthetic slices where they could visualize the margins. We performed a quantitative analysis of 5 slices surrounding the central portion of each joint. Reader-determined JSW was compared to a gold standard. As a figure of merit we calculated the average root-mean square deviation (RMSD). RESULTS: RMSD was 0.22 mm for both joints. For the individual joints, RMSD was 0.18 mm (MCP), and 0.26 mm (PIP). The reduced performance for the smaller PIP joints suggests that a slice spacing less than 0.75 mm may be more appropriate. CONCLUSIONS: We have demonstrated the capability of limited 3D rendering of joint surfaces using digital tomosynthesis. This technique promises to provide an improved method to visualize the structural changes of RA.

Comparison of reconstruction methods and quantitative accuracy in Siemens Inveon PET scanner

NASA Astrophysics Data System (ADS)

Ram Yu, A.; Kim, Jin Su; Kang, Joo Hyun; Moo Lim, Sang

2015-04-01

PET reconstruction is key to the quantification of PET data. To our knowledge, no comparative study of reconstruction methods has been performed to date. In this study, we compared reconstruction methods with various filters in terms of their spatial resolution, non-uniformities (NU), recovery coefficients (RCs), and spillover ratios (SORs). In addition, the linearity of reconstructed radioactivity between linearity of measured and true concentrations were also assessed. A Siemens Inveon PET scanner was used in this study. Spatial resolution was measured with NEMA standard by using a 1 mm3 sized 18F point source. Image quality was assessed in terms of NU, RC and SOR. To measure the effect of reconstruction algorithms and filters, data was reconstructed using FBP, 3D reprojection algorithm (3DRP), ordered subset expectation maximization 2D (OSEM 2D), and maximum a posteriori (MAP) with various filters or smoothing factors (β). To assess the linearity of reconstructed radioactivity, image quality phantom filled with 18F was used using FBP, OSEM and MAP (β =1.5 & 5 × 10-5). The highest achievable volumetric resolution was 2.31 mm3 and the highest RCs were obtained when OSEM 2D was used. SOR was 4.87% for air and 3.97% for water, obtained OSEM 2D reconstruction was used. The measured radioactivity of reconstruction image was proportional to the injected one for radioactivity below 16 MBq/ml when FBP or OSEM 2D reconstruction methods were used. By contrast, when the MAP reconstruction method was used, activity of reconstruction image increased proportionally, regardless of the amount of injected radioactivity. When OSEM 2D or FBP were used, the measured radioactivity concentration was reduced by 53% compared with true injected radioactivity for radioactivity <16 MBq/ml. The OSEM 2D reconstruction method provides the highest achievable volumetric resolution and highest RC among all the tested methods and yields a linear relation between the measured and true concentrations for radioactivity Our data collectively showed that OSEM 2D reconstruction method provides quantitatively accurate reconstructed PET data results.

A Regularized Volumetric Fusion Framework for Large-Scale 3D Reconstruction

NASA Astrophysics Data System (ADS)

Rajput, Asif; Funk, Eugen; Börner, Anko; Hellwich, Olaf

2018-07-01

Modern computational resources combined with low-cost depth sensing systems have enabled mobile robots to reconstruct 3D models of surrounding environments in real-time. Unfortunately, low-cost depth sensors are prone to produce undesirable estimation noise in depth measurements which result in either depth outliers or introduce surface deformations in the reconstructed model. Conventional 3D fusion frameworks integrate multiple error-prone depth measurements over time to reduce noise effects, therefore additional constraints such as steady sensor movement and high frame-rates are required for high quality 3D models. In this paper we propose a generic 3D fusion framework with controlled regularization parameter which inherently reduces noise at the time of data fusion. This allows the proposed framework to generate high quality 3D models without enforcing additional constraints. Evaluation of the reconstructed 3D models shows that the proposed framework outperforms state of art techniques in terms of both absolute reconstruction error and processing time.

Palmyra as it Once Was: 3d Virtual Reconstruction and Visualization of AN Irreplacable Lost Treasure

NASA Astrophysics Data System (ADS)

Denker, A.

2017-05-01

Palmyra was a mosaic which was composed through its colourful past, by Assyrians, Parthians, Greeks and Romans. For centuries, the spectacular ruins and impressive panorama of the antique city used to captivate and inspire the visitors as the witnesses of its illustrious history. As a grim consequence of the horrific conflict that engulfed Syria, since May 2015 they are no more to be seen. Palmyra has been purposely targeted and obliterated, the ruins have been reduced to rubble. The immense beauty and rich heritage of Palmyra which has been lost forever is reconstructed here as it was once was, at the top of its glory, with the hope of preserving its memory.

Localizing Protein in 3D Neural Stem Cell Culture: a Hybrid Visualization Methodology

PubMed Central

Fai, Stephen; Bennett, Steffany A.L.

2010-01-01

The importance of 3-dimensional (3D) topography in influencing neural stem and progenitor cell (NPC) phenotype is widely acknowledged yet challenging to study. When dissociated from embryonic or post-natal brain, single NPCs will proliferate in suspension to form neurospheres. Daughter cells within these cultures spontaneously adopt distinct developmental lineages (neurons, oligodendrocytes, and astrocytes) over the course of expansion despite being exposed to the same extracellular milieu. This progression recapitulates many of the stages observed over the course of neurogenesis and gliogenesis in post-natal brain and is often used to study basic NPC biology within a controlled environment. Assessing the full impact of 3D topography and cellular positioning within these cultures on NPC fate is, however, difficult. To localize target proteins and identify NPC lineages by immunocytochemistry, free-floating neurospheres must be plated on a substrate or serially sectioned. This processing is required to ensure equivalent cell permeabilization and antibody access throughout the sphere. As a result, 2D epifluorescent images of cryosections or confocal reconstructions of 3D Z-stacks can only provide spatial information about cell position within discrete physical or digital 3D slices and do not visualize cellular position in the intact sphere. Here, to reiterate the topography of the neurosphere culture and permit spatial analysis of protein expression throughout the entire culture, we present a protocol for isolation, expansion, and serial sectioning of post-natal hippocampal neurospheres suitable for epifluorescent or confocal immunodetection of target proteins. Connexin29 (Cx29) is analyzed as an example. Next, using a hybrid of graphic editing and 3D modelling softwares rigorously applied to maintain biological detail, we describe how to re-assemble the 3D structural positioning of these images and digitally map labelled cells within the complete neurosphere. This methodology enables visualization and analysis of the cellular position of target proteins and cells throughout the entire 3D culture topography and will facilitate a more detailed analysis of the spatial relationships between cells over the course of neurogenesis and gliogenesis in vitro. Both Imbeault and Valenzuela contributed equally and should be considered joint first authors. PMID:21258319

[The dynamic concision for three-dimensional reconstruction of human organ built with virtual reality modeling language (VRML)].

PubMed

Yu, Zhengyang; Zheng, Shusen; Chen, Huaiqing; Wang, Jianjun; Xiong, Qingwen; Jing, Wanjun; Zeng, Yu

2006-10-01

This research studies the process of dynamic concision and 3D reconstruction from medical body data using VRML and JavaScript language, focuses on how to realize the dynamic concision of 3D medical model built with VRML. The 2D medical digital images firstly are modified and manipulated by 2D image software. Then, based on these images, 3D mould is built with VRML and JavaScript language. After programming in JavaScript to control 3D model, the function of dynamic concision realized by Script node and sensor node in VRML. The 3D reconstruction and concision of body internal organs can be formed in high quality near to those got in traditional methods. By this way, with the function of dynamic concision, VRML browser can offer better windows of man-computer interaction in real time environment than before. 3D reconstruction and dynamic concision with VRML can be used to meet the requirement for the medical observation of 3D reconstruction and has a promising prospect in the fields of medical image.

Satisfactory rate of post-processing visualization of fetal cerebral axial, sagittal, and coronal planes from three-dimensional volumes acquired in routine second trimester ultrasound practice by sonographers of peripheral centers.

PubMed

Rizzo, Giuseppe; Pietrolucci, Maria Elena; Capece, Giuseppe; Cimmino, Ernesto; Colosi, Enrico; Ferrentino, Salvatore; Sica, Carmine; Di Meglio, Aniello; Arduini, Domenico

2011-08-01

The aim of this study was to evaluate the feasibility to visualize central nervous system (CNS) diagnostic planes from three-dimensional (3D) brain volumes obtained in ultrasound facilities with no specific experience in fetal neurosonography. Five sonographers prospectively recorded transabdominal 3D CNS volumes starting from an axial approach on 500 consecutive pregnancies at 19-24 weeks of gestation undergoing routine ultrasound examination. Volumes were sent to the referral center (Department of Obstetrics and Gynecology, Università Roma Tor Vergata, Italy) and two independent reviewers with experience in 3D ultrasound assessed their quality in the display of axial, coronal, and sagittal planes. CNS volumes were acquired in 491/500 pregnancies (98.2%). The two reviewers acknowledged the presence of satisfactory images with a visualization rate ranging respectively between 95.1% and 97.14% for axial planes, 73.72% and 87.16% for coronal planes, and 78.41% and 94.29% for sagittal planes. The agreement rate between the two reviewers as expressed by Cohen's kappa coefficient was >0.87 for axial planes, >0.89 for coronal planes, and >0.94 for sagittal planes. The presence of a maternal body mass index >30 alters the probability of achieving satisfactory CNS views, while existence of previous maternal lower abdomen surgery does not affect the quality of the reconstructed planes. CNS volumes acquired by 3D ultrasonography in peripheral centers showed a quality high enough to allow a detailed fetal neurosonogram.

Recent advances in 3D computed tomography techniques for simulation and navigation in hepatobiliary pancreatic surgery.

PubMed

Uchida, Masafumi

2014-04-01

A few years ago it could take several hours to complete a 3D image using a 3D workstation. Thanks to advances in computer science, obtaining results of interest now requires only a few minutes. Many recent 3D workstations or multimedia computers are equipped with onboard 3D virtual patient modeling software, which enables patient-specific preoperative assessment and virtual planning, navigation, and tool positioning. Although medical 3D imaging can now be conducted using various modalities, including computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), and ultrasonography (US) among others, the highest quality images are obtained using CT data, and CT images are now the most commonly used source of data for 3D simulation and navigation image. If the 2D source image is bad, no amount of 3D image manipulation in software will provide a quality 3D image. In this exhibition, the recent advances in CT imaging technique and 3D visualization of the hepatobiliary and pancreatic abnormalities are featured, including scan and image reconstruction technique, contrast-enhanced techniques, new application of advanced CT scan techniques, and new virtual reality simulation and navigation imaging. © 2014 Japanese Society of Hepato-Biliary-Pancreatic Surgery.

An "artificial retina" processor for track reconstruction at the full LHC crossing rate

NASA Astrophysics Data System (ADS)

Abba, A.; Bedeschi, F.; Caponio, F.; Cenci, R.; Citterio, M.; Cusimano, A.; Fu, J.; Geraci, A.; Grizzuti, M.; Lusardi, N.; Marino, P.; Morello, M. J.; Neri, N.; Ninci, D.; Petruzzo, M.; Piucci, A.; Punzi, G.; Ristori, L.; Spinella, F.; Stracka, S.; Tonelli, D.; Walsh, J.

2016-07-01

We present the latest results of an R&D study for a specialized processor capable of reconstructing, in a silicon pixel detector, high-quality tracks from high-energy collision events at 40 MHz. The processor applies a highly parallel pattern-recognition algorithm inspired to quick detection of edges in mammals visual cortex. After a detailed study of a real-detector application, demonstrating that online reconstruction of offline-quality tracks is feasible at 40 MHz with sub-microsecond latency, we are implementing a prototype using common high-bandwidth FPGA devices.

An "artificial retina" processor for track reconstruction at the full LHC crossing rate

DOE PAGES

Abba, A.; F. Bedeschi; Caponio, F.; ...

2015-10-23

Here, we present the latest results of an R&D; study for a specialized processor capable of reconstructing, in a silicon pixel detector, high-quality tracks from high-energy collision events at 40 MHz. The processor applies a highly parallel pattern-recognition algorithm inspired to quick detection of edges in mammals visual cortex. After a detailed study of a real-detector application, demonstrating that online reconstruction of offline-quality tracks is feasible at 40 MHz with sub-microsecond latency, we are implementing a prototype using common high-bandwidth FPGA devices.

Analysis of bite marks in foodstuffs by computer tomography (cone beam CT)--3D reconstruction.

PubMed

Marques, Jeidson; Musse, Jamilly; Caetano, Catarina; Corte-Real, Francisco; Corte-Real, Ana Teresa

2013-12-01

The use of three-dimensional (3D) analysis of forensic evidence is highlighted in comparison with traditional methods. This three-dimensional analysis is based on the registration of the surface from a bitten object. The authors propose to use Cone Beam Computed Tomography (CBCT), which is used in dental practice, in order to study the surface and interior of bitten objects and dental casts of suspects. In this study, CBCT is applied to the analysis of bite marks in foodstuffs, which may be found in a forensic case scenario. 6 different types of foodstuffs were used: chocolate, cheese, apple, chewing gum, pizza and tart (flaky pastry and custard). The food was bitten into and dental casts of the possible suspects were made. The dental casts and bitten objects were registered using an x-ray source and the CBCT equipment iCAT® (Pennsylvania, EUA). The software InVivo5® (Anatomage Inc, EUA) was used to visualize and analyze the tomographic slices and 3D reconstructions of the objects. For each material an estimate of its density was assessed by two methods: HU values and specific gravity. All the used materials were successfully reconstructed as good quality 3D images. The relative densities of the materials in study were compared. Amongst the foodstuffs, the chocolate had the highest density (median value 100.5 HU and 1,36 g/cm(3)), while the pizza showed to have the lowest (median value -775 HU and 0,39 g/cm(3)), on both scales. Through tomographic slices and three-dimensional reconstructions it was possible to perform the metric analysis of the bite marks in all the foodstuffs, except for the pizza. These measurements could also be obtained from the dental casts. The depth of the bite mark was also successfully determined in all the foodstuffs except for the pizza. Cone Beam Computed Tomography has the potential to become an important tool for forensic sciences, namely for the registration and analysis of bite marks in foodstuffs that may be found in a crime scene.

Towards Automated Large-Scale 3D Phenotyping of Vineyards under Field Conditions

PubMed Central

Rose, Johann Christian; Kicherer, Anna; Wieland, Markus; Klingbeil, Lasse; Töpfer, Reinhard; Kuhlmann, Heiner

2016-01-01

In viticulture, phenotypic data are traditionally collected directly in the field via visual and manual means by an experienced person. This approach is time consuming, subjective and prone to human errors. In recent years, research therefore has focused strongly on developing automated and non-invasive sensor-based methods to increase data acquisition speed, enhance measurement accuracy and objectivity and to reduce labor costs. While many 2D methods based on image processing have been proposed for field phenotyping, only a few 3D solutions are found in the literature. A track-driven vehicle consisting of a camera system, a real-time-kinematic GPS system for positioning, as well as hardware for vehicle control, image storage and acquisition is used to visually capture a whole vine row canopy with georeferenced RGB images. In the first post-processing step, these images were used within a multi-view-stereo software to reconstruct a textured 3D point cloud of the whole grapevine row. A classification algorithm is then used in the second step to automatically classify the raw point cloud data into the semantic plant components, grape bunches and canopy. In the third step, phenotypic data for the semantic objects is gathered using the classification results obtaining the quantity of grape bunches, berries and the berry diameter. PMID:27983669

Towards Automated Large-Scale 3D Phenotyping of Vineyards under Field Conditions.

PubMed

Rose, Johann Christian; Kicherer, Anna; Wieland, Markus; Klingbeil, Lasse; Töpfer, Reinhard; Kuhlmann, Heiner

2016-12-15

In viticulture, phenotypic data are traditionally collected directly in the field via visual and manual means by an experienced person. This approach is time consuming, subjective and prone to human errors. In recent years, research therefore has focused strongly on developing automated and non-invasive sensor-based methods to increase data acquisition speed, enhance measurement accuracy and objectivity and to reduce labor costs. While many 2D methods based on image processing have been proposed for field phenotyping, only a few 3D solutions are found in the literature. A track-driven vehicle consisting of a camera system, a real-time-kinematic GPS system for positioning, as well as hardware for vehicle control, image storage and acquisition is used to visually capture a whole vine row canopy with georeferenced RGB images. In the first post-processing step, these images were used within a multi-view-stereo software to reconstruct a textured 3D point cloud of the whole grapevine row. A classification algorithm is then used in the second step to automatically classify the raw point cloud data into the semantic plant components, grape bunches and canopy. In the third step, phenotypic data for the semantic objects is gathered using the classification results obtaining the quantity of grape bunches, berries and the berry diameter.

Integrated Approach to Reconstruction of Microbial Regulatory Networks

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rodionov, Dmitry A; Novichkov, Pavel S

2013-11-04

This project had the goal(s) of development of integrated bioinformatics platform for genome-scale inference and visualization of transcriptional regulatory networks (TRNs) in bacterial genomes. The work was done in Sanford-Burnham Medical Research Institute (SBMRI, P.I. D.A. Rodionov) and Lawrence Berkeley National Laboratory (LBNL, co-P.I. P.S. Novichkov). The developed computational resources include: (1) RegPredict web-platform for TRN inference and regulon reconstruction in microbial genomes, and (2) RegPrecise database for collection, visualization and comparative analysis of transcriptional regulons reconstructed by comparative genomics. These analytical resources were selected as key components in the DOE Systems Biology KnowledgeBase (SBKB). The high-quality data accumulated inmore » RegPrecise will provide essential datasets of reference regulons in diverse microbes to enable automatic reconstruction of draft TRNs in newly sequenced genomes. We outline our progress toward the three aims of this grant proposal, which were: Develop integrated platform for genome-scale regulon reconstruction; Infer regulatory annotations in several groups of bacteria and building of reference collections of microbial regulons; and Develop KnowledgeBase on microbial transcriptional regulation.« less

A new strategic neurosurgical planning tool for brainstem cavernous malformations using interactive computer graphics with multimodal fusion images.

PubMed

Kin, Taichi; Nakatomi, Hirofumi; Shojima, Masaaki; Tanaka, Minoru; Ino, Kenji; Mori, Harushi; Kunimatsu, Akira; Oyama, Hiroshi; Saito, Nobuhito

2012-07-01

In this study, the authors used preoperative simulation employing 3D computer graphics (interactive computer graphics) to fuse all imaging data for brainstem cavernous malformations. The authors evaluated whether interactive computer graphics or 2D imaging correlated better with the actual operative field, particularly in identifying a developmental venous anomaly (DVA). The study population consisted of 10 patients scheduled for surgical treatment of brainstem cavernous malformations. Data from preoperative imaging (MRI, CT, and 3D rotational angiography) were automatically fused using a normalized mutual information method, and then reconstructed by a hybrid method combining surface rendering and volume rendering methods. With surface rendering, multimodality and multithreshold techniques for 1 tissue were applied. The completed interactive computer graphics were used for simulation of surgical approaches and assumed surgical fields. Preoperative diagnostic rates for a DVA associated with brainstem cavernous malformation were compared between conventional 2D imaging and interactive computer graphics employing receiver operating characteristic (ROC) analysis. The time required for reconstruction of 3D images was 3-6 hours for interactive computer graphics. Observation in interactive mode required approximately 15 minutes. Detailed anatomical information for operative procedures, from the craniotomy to microsurgical operations, could be visualized and simulated three-dimensionally as 1 computer graphic using interactive computer graphics. Virtual surgical views were consistent with actual operative views. This technique was very useful for examining various surgical approaches. Mean (±SEM) area under the ROC curve for rate of DVA diagnosis was significantly better for interactive computer graphics (1.000±0.000) than for 2D imaging (0.766±0.091; p<0.001, Mann-Whitney U-test). The authors report a new method for automatic registration of preoperative imaging data from CT, MRI, and 3D rotational angiography for reconstruction into 1 computer graphic. The diagnostic rate of DVA associated with brainstem cavernous malformation was significantly better using interactive computer graphics than with 2D images. Interactive computer graphics was also useful in helping to plan the surgical access corridor.

An interactive display system for large-scale 3D models

NASA Astrophysics Data System (ADS)

Liu, Zijian; Sun, Kun; Tao, Wenbing; Liu, Liman

2018-04-01

With the improvement of 3D reconstruction theory and the rapid development of computer hardware technology, the reconstructed 3D models are enlarging in scale and increasing in complexity. Models with tens of thousands of 3D points or triangular meshes are common in practical applications. Due to storage and computing power limitation, it is difficult to achieve real-time display and interaction with large scale 3D models for some common 3D display software, such as MeshLab. In this paper, we propose a display system for large-scale 3D scene models. We construct the LOD (Levels of Detail) model of the reconstructed 3D scene in advance, and then use an out-of-core view-dependent multi-resolution rendering scheme to realize the real-time display of the large-scale 3D model. With the proposed method, our display system is able to render in real time while roaming in the reconstructed scene and 3D camera poses can also be displayed. Furthermore, the memory consumption can be significantly decreased via internal and external memory exchange mechanism, so that it is possible to display a large scale reconstructed scene with over millions of 3D points or triangular meshes in a regular PC with only 4GB RAM.

Optical diffraction tomography using a digital micromirror device for stable measurements of 4D refractive index tomography of cells

NASA Astrophysics Data System (ADS)

Shin, Seungwoo; Kim, Kyoohyun; Kim, Taeho; Yoon, Jonghee; Hong, Kihyun; Park, Jinah; Park, YongKeun

2016-03-01

Optical diffraction tomography (ODT) is an interferometric microscopy technique capable of measuring 3-D refractive index (RI) distribution of transparent samples. Multiple 2-D holograms of a sample illuminated with various angles are measured, from which 3-D RI map of the sample is reconstructed via the diffraction theory. ODT has been proved as a powerful tool for the study of biological cells, due to its non-invasiveness, label-free and quantitative imaging capability. Recently, our group has demonstrated that a digital micromirror device (DMD) can be exploited for fast and precise control of illumination beams for ODT. In this work, we systematically study the precision and stability of the ODT system equipped with a DMD and present measurements of 3-D and 4-D RI maps of various types of live cells including human red blood cells, white blood cells, hepatocytes, and HeLa cells. Furthermore, we also demonstrate the effective visualization of 3-D RI maps of live cells utilizing the measured information about the values and gradient of RI tomograms.

Oblique reconstructions in tomosynthesis. II. Super-resolution

PubMed Central

Acciavatti, Raymond J.; Maidment, Andrew D. A.

2013-01-01

Purpose: In tomosynthesis, super-resolution has been demonstrated using reconstruction planes parallel to the detector. Super-resolution allows for subpixel resolution relative to the detector. The purpose of this work is to develop an analytical model that generalizes super-resolution to oblique reconstruction planes. Methods: In a digital tomosynthesis system, a sinusoidal test object is modeled along oblique angles (i.e., “pitches”) relative to the plane of the detector in a 3D divergent-beam acquisition geometry. To investigate the potential for super-resolution, the input frequency is specified to be greater than the alias frequency of the detector. Reconstructions are evaluated in an oblique plane along the extent of the object using simple backprojection (SBP) and filtered backprojection (FBP). By comparing the amplitude of the reconstruction against the attenuation coefficient of the object at various frequencies, the modulation transfer function (MTF) is calculated to determine whether modulation is within detectable limits for super-resolution. For experimental validation of super-resolution, a goniometry stand was used to orient a bar pattern phantom along various pitches relative to the breast support in a commercial digital breast tomosynthesis system. Results: Using theoretical modeling, it is shown that a single projection image cannot resolve a sine input whose frequency exceeds the detector alias frequency. The high frequency input is correctly visualized in SBP or FBP reconstruction using a slice along the pitch of the object. The Fourier transform of this reconstructed slice is maximized at the input frequency as proof that the object is resolved. Consistent with the theoretical results, experimental images of a bar pattern phantom showed super-resolution in oblique reconstructions. At various pitches, the highest frequency with detectable modulation was determined by visual inspection of the bar patterns. The dependency of the highest detectable frequency on pitch followed the same trend as the analytical model. It was demonstrated that super-resolution is not achievable if the pitch of the object approaches 90°, corresponding to the case in which the test frequency is perpendicular to the breast support. Only low frequency objects are detectable at pitches close to 90°. Conclusions: This work provides a platform for investigating super-resolution in oblique reconstructions for tomosynthesis. In breast imaging, this study should have applications in visualizing microcalcifications and other subtle signs of cancer. PMID:24320445

NeuroLines: A Subway Map Metaphor for Visualizing Nanoscale Neuronal Connectivity.

PubMed

Al-Awami, Ali K; Beyer, Johanna; Strobelt, Hendrik; Kasthuri, Narayanan; Lichtman, Jeff W; Pfister, Hanspeter; Hadwiger, Markus

2014-12-01

We present NeuroLines, a novel visualization technique designed for scalable detailed analysis of neuronal connectivity at the nanoscale level. The topology of 3D brain tissue data is abstracted into a multi-scale, relative distance-preserving subway map visualization that allows domain scientists to conduct an interactive analysis of neurons and their connectivity. Nanoscale connectomics aims at reverse-engineering the wiring of the brain. Reconstructing and analyzing the detailed connectivity of neurons and neurites (axons, dendrites) will be crucial for understanding the brain and its development and diseases. However, the enormous scale and complexity of nanoscale neuronal connectivity pose big challenges to existing visualization techniques in terms of scalability. NeuroLines offers a scalable visualization framework that can interactively render thousands of neurites, and that supports the detailed analysis of neuronal structures and their connectivity. We describe and analyze the design of NeuroLines based on two real-world use-cases of our collaborators in developmental neuroscience, and investigate its scalability to large-scale neuronal connectivity data.

Image-based reconstruction of three-dimensional myocardial infarct geometry for patient-specific modeling of cardiac electrophysiology

PubMed Central

Ukwatta, Eranga; Arevalo, Hermenegild; Rajchl, Martin; White, James; Pashakhanloo, Farhad; Prakosa, Adityo; Herzka, Daniel A.; McVeigh, Elliot; Lardo, Albert C.; Trayanova, Natalia A.; Vadakkumpadan, Fijoy

2015-01-01

Purpose: Accurate three-dimensional (3D) reconstruction of myocardial infarct geometry is crucial to patient-specific modeling of the heart aimed at providing therapeutic guidance in ischemic cardiomyopathy. However, myocardial infarct imaging is clinically performed using two-dimensional (2D) late-gadolinium enhanced cardiac magnetic resonance (LGE-CMR) techniques, and a method to build accurate 3D infarct reconstructions from the 2D LGE-CMR images has been lacking. The purpose of this study was to address this need. Methods: The authors developed a novel methodology to reconstruct 3D infarct geometry from segmented low-resolution (Lo-res) clinical LGE-CMR images. Their methodology employed the so-called logarithm of odds (LogOdds) function to implicitly represent the shape of the infarct in segmented image slices as LogOdds maps. These 2D maps were then interpolated into a 3D image, and the result transformed via the inverse of LogOdds to a binary image representing the 3D infarct geometry. To assess the efficacy of this method, the authors utilized 39 high-resolution (Hi-res) LGE-CMR images, including 36 in vivo acquisitions of human subjects with prior myocardial infarction and 3 ex vivo scans of canine hearts following coronary ligation to induce infarction. The infarct was manually segmented by trained experts in each slice of the Hi-res images, and the segmented data were downsampled to typical clinical resolution. The proposed method was then used to reconstruct 3D infarct geometry from the downsampled images, and the resulting reconstructions were compared with the manually segmented data. The method was extensively evaluated using metrics based on geometry as well as results of electrophysiological simulations of cardiac sinus rhythm and ventricular tachycardia in individual hearts. Several alternative reconstruction techniques were also implemented and compared with the proposed method. Results: The accuracy of the LogOdds method in reconstructing 3D infarct geometry, as measured by the Dice similarity coefficient, was 82.10% ± 6.58%, a significantly higher value than those of the alternative reconstruction methods. Among outcomes of electrophysiological simulations with infarct reconstructions generated by various methods, the simulation results corresponding to the LogOdds method showed the smallest deviation from those corresponding to the manual reconstructions, as measured by metrics based on both activation maps and pseudo-ECGs. Conclusions: The authors have developed a novel method for reconstructing 3D infarct geometry from segmented slices of Lo-res clinical 2D LGE-CMR images. This method outperformed alternative approaches in reproducing expert manual 3D reconstructions and in electrophysiological simulations. PMID:26233186

Image-based reconstruction of three-dimensional myocardial infarct geometry for patient-specific modeling of cardiac electrophysiology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ukwatta, Eranga, E-mail: eukwatt1@jhu.edu; Arevalo, Hermenegild; Pashakhanloo, Farhad

Purpose: Accurate three-dimensional (3D) reconstruction of myocardial infarct geometry is crucial to patient-specific modeling of the heart aimed at providing therapeutic guidance in ischemic cardiomyopathy. However, myocardial infarct imaging is clinically performed using two-dimensional (2D) late-gadolinium enhanced cardiac magnetic resonance (LGE-CMR) techniques, and a method to build accurate 3D infarct reconstructions from the 2D LGE-CMR images has been lacking. The purpose of this study was to address this need. Methods: The authors developed a novel methodology to reconstruct 3D infarct geometry from segmented low-resolution (Lo-res) clinical LGE-CMR images. Their methodology employed the so-called logarithm of odds (LogOdds) function to implicitlymore » represent the shape of the infarct in segmented image slices as LogOdds maps. These 2D maps were then interpolated into a 3D image, and the result transformed via the inverse of LogOdds to a binary image representing the 3D infarct geometry. To assess the efficacy of this method, the authors utilized 39 high-resolution (Hi-res) LGE-CMR images, including 36 in vivo acquisitions of human subjects with prior myocardial infarction and 3 ex vivo scans of canine hearts following coronary ligation to induce infarction. The infarct was manually segmented by trained experts in each slice of the Hi-res images, and the segmented data were downsampled to typical clinical resolution. The proposed method was then used to reconstruct 3D infarct geometry from the downsampled images, and the resulting reconstructions were compared with the manually segmented data. The method was extensively evaluated using metrics based on geometry as well as results of electrophysiological simulations of cardiac sinus rhythm and ventricular tachycardia in individual hearts. Several alternative reconstruction techniques were also implemented and compared with the proposed method. Results: The accuracy of the LogOdds method in reconstructing 3D infarct geometry, as measured by the Dice similarity coefficient, was 82.10% ± 6.58%, a significantly higher value than those of the alternative reconstruction methods. Among outcomes of electrophysiological simulations with infarct reconstructions generated by various methods, the simulation results corresponding to the LogOdds method showed the smallest deviation from those corresponding to the manual reconstructions, as measured by metrics based on both activation maps and pseudo-ECGs. Conclusions: The authors have developed a novel method for reconstructing 3D infarct geometry from segmented slices of Lo-res clinical 2D LGE-CMR images. This method outperformed alternative approaches in reproducing expert manual 3D reconstructions and in electrophysiological simulations.« less

Visualization and quantitation of abundant macroautophagy in virus-infected cells by confocal three-dimensional fluorescence imaging.

PubMed

Jackson, Wallen; Yamada, Masaki; Moninger, Thomas; Grose, Charles

2013-10-01

Varicella-zoster virus (VZV) is a human herpesvirus. Primary infection causes varicella (chickenpox), a viremic illness typified by an exanthem consisting of several hundred vesicles. When VZV reactivates from latency in the spinal ganglia during late adulthood, the emerging virus causes a vesicular dermatomal rash (herpes zoster or shingles). To expand investigations of autophagy during varicella and zoster, newer 3D imaging technology was combined with laser scanning confocal microscopy to provide animations of autophagosomes in the vesicular rash. First, the cells were immunolabeled with antibodies against VZV proteins and the LC3 protein, an integral autophagosomal protein. Antibody reagents lacking activity against the human blood group A1 antigen were selected. After laser excitation of the samples, optimized emission detection bandwidths were configured by Zeiss Zen control software. Confocal Z-stacks comprising up to 40 optical slices were reconstructed into 3D animations with the aid of Imaris software. With this imaging technology, individual autophagosomes were clearly detectable as spheres within each vesicular cell. To enumerate the number of autophagosomes, data sets from 50 cells were reconstructed as 3D fluorescence images and analyzed with MeasurementPro software. The mean number of autophagosomes per infected vesicular cell was >100, although over 200 autophagosomes were seen in a few cells. In summary, macroautophagy was easily quantitated within VZV-infected cells after immunolabeling and imaging by 3D confocal animation technology. These same 3D imaging techniques will be applicable for investigations of autophagy in other virus-infected cells. Copyright © 2013 The Authors. Published by Elsevier B.V. All rights reserved.

ESC-Track: A computer workflow for 4-D segmentation, tracking, lineage tracing and dynamic context analysis of ESCs.

PubMed

Fernández-de-Manúel, Laura; Díaz-Díaz, Covadonga; Jiménez-Carretero, Daniel; Torres, Miguel; Montoya, María C

2017-05-01

Embryonic stem cells (ESCs) can be established as permanent cell lines, and their potential to differentiate into adult tissues has led to widespread use for studying the mechanisms and dynamics of stem cell differentiation and exploring strategies for tissue repair. Imaging live ESCs during development is now feasible due to advances in optical imaging and engineering of genetically encoded fluorescent reporters; however, a major limitation is the low spatio-temporal resolution of long-term 3-D imaging required for generational and neighboring reconstructions. Here, we present the ESC-Track (ESC-T) workflow, which includes an automated cell and nuclear segmentation and tracking tool for 4-D (3-D + time) confocal image data sets as well as a manual editing tool for visual inspection and error correction. ESC-T automatically identifies cell divisions and membrane contacts for lineage tree and neighborhood reconstruction and computes quantitative features from individual cell entities, enabling analysis of fluorescence signal dynamics and tracking of cell morphology and motion. We use ESC-T to examine Myc intensity fluctuations in the context of mouse ESC (mESC) lineage and neighborhood relationships. ESC-T is a powerful tool for evaluation of the genealogical and microenvironmental cues that maintain ESC fitness.

Dynamic concision for three-dimensional reconstruction of human organ built with virtual reality modelling language (VRML).

PubMed

Yu, Zheng-yang; Zheng, Shu-sen; Chen, Lei-ting; He, Xiao-qian; Wang, Jian-jun

2005-07-01

This research studies the process of 3D reconstruction and dynamic concision based on 2D medical digital images using virtual reality modelling language (VRML) and JavaScript language, with a focus on how to realize the dynamic concision of 3D medical model with script node and sensor node in VRML. The 3D reconstruction and concision of body internal organs can be built with such high quality that they are better than those obtained from the traditional methods. With the function of dynamic concision, the VRML browser can offer better windows for man-computer interaction in real-time environment than ever before. 3D reconstruction and dynamic concision with VRML can be used to meet the requirement for the medical observation of 3D reconstruction and have a promising prospect in the fields of medical imaging.

Dynamic concision for three-dimensional reconstruction of human organ built with virtual reality modelling language (VRML)*

PubMed Central

Yu, Zheng-yang; Zheng, Shu-sen; Chen, Lei-ting; He, Xiao-qian; Wang, Jian-jun

2005-01-01

This research studies the process of 3D reconstruction and dynamic concision based on 2D medical digital images using virtual reality modelling language (VRML) and JavaScript language, with a focus on how to realize the dynamic concision of 3D medical model with script node and sensor node in VRML. The 3D reconstruction and concision of body internal organs can be built with such high quality that they are better than those obtained from the traditional methods. With the function of dynamic concision, the VRML browser can offer better windows for man-computer interaction in real-time environment than ever before. 3D reconstruction and dynamic concision with VRML can be used to meet the requirement for the medical observation of 3D reconstruction and have a promising prospect in the fields of medical imaging. PMID:15973760

Cervical vertebrae maturation index estimates on cone beam CT: 3D reconstructions vs sagittal sections.

PubMed

Bonfim, Marco A E; Costa, André L F; Fuziy, Acácio; Ximenez, Michel E L; Cotrim-Ferreira, Flávio A; Ferreira-Santos, Rívea I

2016-01-01

The aim of this study was to evaluate the performance of CBCT three-dimensional (3D) reconstructions and sagittal sections for estimates of cervical vertebrae maturation index (CVMI). The sample consisted of 72 CBCT examinations from patients aged 8-16 years (45 females and 27 males) selected from the archives of two private clinics. Two calibrated observers (kappa scores: ≥0.901) interpreted the CBCT settings twice. Intra- and interobserver agreement for both imaging exhibition modes was analyzed by kappa statistics, which was also used to analyze the agreement between 3D reconstructions and sagittal sections. Correlations between cervical vertebrae maturation estimates and chronological age, as well as between the assessments by 3D reconstructions and sagittal sections, were analyzed using gamma Goodman-Kruskal coefficients (α = 0.05). The kappa scores evidenced almost perfect agreement between the first and second assessments of the cervical vertebrae by 3D reconstructions (0.933-0.983) and sagittal sections (0.983-1.000). Similarly, the agreement between 3D reconstructions and sagittal sections was almost perfect (kappa index: 0.983). In most divergent cases, the difference between 3D reconstructions and sagittal sections was one stage of CVMI. Strongly positive correlations (>0.8, p < 0.001) were found not only between chronological age and CVMI but also between the estimates by 3D reconstructions and sagittal sections (p < 0.001). Although CBCT imaging must not be used exclusively for this purpose, it may be suitable for skeletal maturity assessments.

Cervical vertebrae maturation index estimates on cone beam CT: 3D reconstructions vs sagittal sections

PubMed Central

Bonfim, Marco A E; Costa, André L F; Ximenez, Michel E L; Cotrim-Ferreira, Flávio A; Ferreira-Santos, Rívea I

2016-01-01

Objectives: The aim of this study was to evaluate the performance of CBCT three-dimensional (3D) reconstructions and sagittal sections for estimates of cervical vertebrae maturation index (CVMI). Methods: The sample consisted of 72 CBCT examinations from patients aged 8–16 years (45 females and 27 males) selected from the archives of two private clinics. Two calibrated observers (kappa scores: ≥0.901) interpreted the CBCT settings twice. Intra- and interobserver agreement for both imaging exhibition modes was analyzed by kappa statistics, which was also used to analyze the agreement between 3D reconstructions and sagittal sections. Correlations between cervical vertebrae maturation estimates and chronological age, as well as between the assessments by 3D reconstructions and sagittal sections, were analyzed using gamma Goodman–Kruskal coefficients (α = 0.05). Results: The kappa scores evidenced almost perfect agreement between the first and second assessments of the cervical vertebrae by 3D reconstructions (0.933–0.983) and sagittal sections (0.983–1.000). Similarly, the agreement between 3D reconstructions and sagittal sections was almost perfect (kappa index: 0.983). In most divergent cases, the difference between 3D reconstructions and sagittal sections was one stage of CVMI. Strongly positive correlations (>0.8, p < 0.001) were found not only between chronological age and CVMI but also between the estimates by 3D reconstructions and sagittal sections (p < 0.001). Conclusions: Although CBCT imaging must not be used exclusively for this purpose, it may be suitable for skeletal maturity assessments. PMID:26509559

3D equilibrium reconstruction with islands

NASA Astrophysics Data System (ADS)

Cianciosa, M.; Hirshman, S. P.; Seal, S. K.; Shafer, M. W.

2018-04-01

This paper presents the development of a 3D equilibrium reconstruction tool and the results of the first-ever reconstruction of an island equilibrium. The SIESTA non-nested equilibrium solver has been coupled to the V3FIT 3D equilibrium reconstruction code. Computed from a coupled VMEC and SIESTA model, synthetic signals are matched to measured signals by finding an optimal set of equilibrium parameters. By using the normalized pressure in place of normalized flux, non-equilibrium quantities needed by diagnostic signals can be efficiently mapped to the equilibrium. The effectiveness of this tool is demonstrated by reconstructing an island equilibrium of a DIII-D inner wall limited L-mode case with an n = 1 error field applied. Flat spots in Thomson and ECE temperature diagnostics show the reconstructed islands have the correct size and phase. ).

Noise Power Spectrum in PROPELLER MR Imaging.

PubMed

Ichinoseki, Yuki; Nagasaka, Tatsuo; Miyamoto, Kota; Tamura, Hajime; Mori, Issei; Machida, Yoshio

2015-01-01

The noise power spectrum (NPS), an index for noise evaluation, represents the frequency characteristics of image noise. We measured the NPS in PROPELLER (Periodically Rotated Overlapping ParallEL Lines with Enhanced Reconstruction) magnetic resonance (MR) imaging, a nonuniform data sampling technique, as an initial study for practical MR image evaluation using the NPS. The 2-dimensional (2D) NPS reflected the k-space sampling density and showed agreement with the shape of the k-space trajectory as expected theoretically. Additionally, the 2D NPS allowed visualization of a part of the image reconstruction process, such as filtering and motion correction.

Designing patient-specific 3D printed craniofacial implants using a novel topology optimization method.

PubMed

Sutradhar, Alok; Park, Jaejong; Carrau, Diana; Nguyen, Tam H; Miller, Michael J; Paulino, Glaucio H

2016-07-01

Large craniofacial defects require efficient bone replacements which should not only provide good aesthetics but also possess stable structural function. The proposed work uses a novel multiresolution topology optimization method to achieve the task. Using a compliance minimization objective, patient-specific bone replacement shapes can be designed for different clinical cases that ensure revival of efficient load transfer mechanisms in the mid-face. In this work, four clinical cases are introduced and their respective patient-specific designs are obtained using the proposed method. The optimized designs are then virtually inserted into the defect to visually inspect the viability of the design . Further, once the design is verified by the reconstructive surgeon, prototypes are fabricated using a 3D printer for validation. The robustness of the designs are mechanically tested by subjecting them to a physiological loading condition which mimics the masticatory activity. The full-field strain result through 3D image correlation and the finite element analysis implies that the solution can survive the maximum mastication of 120 lb. Also, the designs have the potential to restore the buttress system and provide the structural integrity. Using the topology optimization framework in designing the bone replacement shapes would deliver surgeons new alternatives for rather complicated mid-face reconstruction.

Low-Cost 3D Printing Orbital Implant Templates in Secondary Orbital Reconstructions.

PubMed

Callahan, Alison B; Campbell, Ashley A; Petris, Carisa; Kazim, Michael

Despite its increasing use in craniofacial reconstructions, three-dimensional (3D) printing of customized orbital implants has not been widely adopted. Limitations include the cost of 3D printers able to print in a biocompatible material suitable for implantation in the orbit and the breadth of available implant materials. The authors report the technique of low-cost 3D printing of orbital implant templates used in complex, often secondary, orbital reconstructions. A retrospective case series of 5 orbital reconstructions utilizing a technique of 3D printed orbital implant templates is presented. Each patient's Digital Imaging and Communications in Medicine data were uploaded and processed to create 3D renderings upon which a customized implant was designed and sent electronically to printers open for student use at our affiliated institutions. The mock implants were sterilized and used intraoperatively as a stencil and mold. The final implant material was chosen by the surgeons based on the requirements of the case. Five orbital reconstructions were performed with this technique: 3 tumor reconstructions and 2 orbital fractures. Four of the 5 cases were secondary reconstructions. Molded Medpor Titan (Stryker, Kalamazoo, MI) implants were used in 4 cases and titanium mesh in 1 case. The stenciled and molded implants were adjusted no more than 2 times before anchored in place (mean 1). No case underwent further revision. The technique and cases presented demonstrate 1) the feasibility and accessibility of low-cost, independent use of 3D printing technology to fashion patient-specific implants in orbital reconstructions, 2) the ability to apply this technology to the surgeon's preference of any routinely implantable material, and 3) the utility of this technique in complex, secondary reconstructions.

Three-dimensional monochromatic x-ray CT

NASA Astrophysics Data System (ADS)

Saito, Tsuneo; Kudo, Hiroyuki; Takeda, Tohoru; Itai, Yuji; Tokumori, Kenji; Toyofuku, Fukai; Hyodo, Kazuyuki; Ando, Masami; Nishimura, Ktsuyuki; Uyama, Chikao

1995-08-01

In this paper, we describe a 3D computed tomography (3D CT) using monochromatic x-rays generated by synchrotron radiation, which performs a direct reconstruction of 3D volume image of an object from its cone-beam projections. For the develpment of 3D CT, scanning orbit of x-ray source to obtain complete 3D information about an object and corresponding 3D image reconstruction algorithm are considered. Computer simulation studies demonstrate the validities of proposed scanning method and reconstruction algorithm. A prototype experimental system of 3D CT was constructed. Basic phantom examinations and specific material CT image by energy subtraction obtained in this experimental system are shown.

Reconstruction and Visualization of Fiber and Laminar Structure inthe Normal Human Heart from Ex Vivo DTMRI Data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rohmer, Damien; Sitek, Arkadiusz; Gullberg, Grant T.

2006-12-18

Background - The human heart is composed of a helicalnetwork of muscle fibers. These fibers are organized to form sheets thatare separated by cleavage surfaces. This complex structure of fibers andsheets is responsible for the orthotropic mechanical properties ofcardiac muscle. The understanding of the configuration of the 3D fiberand sheet structure is important for modeling the mechanical andelectrical properties of the heart and changes in this configuration maybe of significant importance to understand the remodeling aftermyocardial infarction.Methods - Anisotropic least square filteringfollowed by fiber and sheet tracking techniques were applied to DiffusionTensor Magnetic Resonance Imaging (DTMRI) data of the excisedmore » humanheart. The fiber configuration was visualized by using thin tubes toincrease 3-dimensional visual perception of the complex structure. Thesheet structures were reconstructed from the DTMRI data, obtainingsurfaces that span the wall from the endo- to the epicardium. Allvisualizations were performed using the high-quality ray-tracing softwarePOV-Ray. Results - The fibers are shown to lie in sheets that haveconcave or convex transmural structure which correspond to histologicalstudies published in the literature. The fiber angles varied depending onthe position between the epi- and endocardium. The sheets had a complexstructure that depended on the location within the myocardium. In theapex region the sheets had more curvature. Conclusions - A high-qualityvisualization algorithm applied to demonstrated high quality DTMRI datais able to elicit the comprehension of the complex 3 dimensionalstructure of the fibers and sheets in the heart.« less

3D visualization of sheath folds in Ancient Roman marble wall coverings from Ephesos, Turkey

NASA Astrophysics Data System (ADS)

Wex, Sebastian; Passchier, Cees W.; de Kemp, Eric A.; İlhan, Sinan

2014-10-01

Archaeological excavations and restoration of a palatial Roman housing complex in Ephesos, Turkey yielded 40 wall-decorating plates of folded mylonitic marble (Cipollino verde), derived from the internal Hellenides near Karystos, Greece. Cipollino verde was commonly used for decoration purposes in Roman buildings. The plates were serial-sectioned from a single quarried block of 1,25 m3 and provided a research opportunity for detailed reconstruction of the 3D geometry of meterscale folds in mylonitized marble. A GOCAD model is used to visualize the internal fold structures of the marble, comprising curtain folds and multilayered sheath folds. The sheath folds are unusual in that they have their intermediate axis normal to the parent layering. This agrees with regional tectonic studies, which suggest that Cipollino verde structures formed by local constrictional non-coaxial flow. Sheath fold cross-section geometry, exposed on the surface of a plate or outcrop, is found to be independent of the intersection angle of the fold structure with the studied plane. Consequently, a single surface cannot be used as an indicator of the three-dimensional geometry of transected sheath folds.

3D Reconstruction and Standardization of the Rat Vibrissal Cortex for Precise Registration of Single Neuron Morphology

PubMed Central

Egger, Robert; Narayanan, Rajeevan T.; Helmstaedter, Moritz; de Kock, Christiaan P. J.; Oberlaender, Marcel

2012-01-01

The three-dimensional (3D) structure of neural circuits is commonly studied by reconstructing individual or small groups of neurons in separate preparations. Investigation of structural organization principles or quantification of dendritic and axonal innervation thus requires integration of many reconstructed morphologies into a common reference frame. Here we present a standardized 3D model of the rat vibrissal cortex and introduce an automated registration tool that allows for precise placement of single neuron reconstructions. We (1) developed an automated image processing pipeline to reconstruct 3D anatomical landmarks, i.e., the barrels in Layer 4, the pia and white matter surfaces and the blood vessel pattern from high-resolution images, (2) quantified these landmarks in 12 different rats, (3) generated an average 3D model of the vibrissal cortex and (4) used rigid transformations and stepwise linear scaling to register 94 neuron morphologies, reconstructed from in vivo stainings, to the standardized cortex model. We find that anatomical landmarks vary substantially across the vibrissal cortex within an individual rat. In contrast, the 3D layout of the entire vibrissal cortex remains remarkably preserved across animals. This allows for precise registration of individual neuron reconstructions with approximately 30 µm accuracy. Our approach could be used to reconstruct and standardize other anatomically defined brain areas and may ultimately lead to a precise digital reference atlas of the rat brain. PMID:23284282

Exploratory benchtop study evaluating the use of surgical design and simulation in fibula free flap mandibular reconstruction

PubMed Central

2013-01-01

Background Surgical design and simulation (SDS) is a useful tool to help surgeons visualize the anatomy of the patient and perform operative maneuvers on the computer before implementation in the operating room. While these technologies have many advantages, further evidence of their potential to improve outcomes is required. The present benchtop study was intended to identify if there is a difference in surgical outcome between free-hand surgery completed without virtual surgical planning (VSP) software and preoperatively planned surgery completed with the use of VSP software. Methods Five surgeons participated in the study. In Session A, participants were asked to do a free-hand reconstruction of a 3d printed mandible with a defect using a 3d printed fibula. Four weeks later, in Session B, the participants were asked to do the same reconstruction, but in this case using a preoperatively digitally designed surgical plan. Digital registration computer software, hard tissue measures and duration of the task were used to compare the outcome of the benchtop reconstructions. Results The study revealed that: (1) superimposed images produced in a computer aided design (CAD) software were effective in comparing pre and post-surgical outcomes, (2) there was a difference, based on hard tissue measures, in surgical outcome between the two scenarios and (3) there was no difference in the time it took to complete the sessions. Conclusion The study revealed that the participants were more consistent in the preoperatively digitally planned surgery than they were in the free hand surgery. PMID:23800209

Nanotomography of brain networks

NASA Astrophysics Data System (ADS)

Saiga, Rino; Mizutani, Ryuta; Takekoshi, Susumu; Osawa, Motoki; Arai, Makoto; Takeuchi, Akihisa; Uesugi, Kentaro; Terada, Yasuko; Suzuki, Yoshio; de Andrade, Vincent; de Carlo, Francesco

The first step to understanding how the brain functions is to analyze its 3D network. The brain network consists of neurons having micrometer to nanometer sized structures. Therefore, 3D analysis of brain tissue at the relevant resolution is essential for elucidating brain's functional mechanisms. Here, we report 3D structures of human and fly brain networks revealed with synchrotron radiation nanotomography, or nano-CT. Neurons were stained with high-Z elements to visualize their structures with X-rays. Nano-CT experiments were then performed at the 32-ID beamline of the Advanced Photon Source, Argonne National Laboratory and at the BL37XU and BL47XU beamlines of SPring-8. Reconstructed 3D images illustrated precise structures of human neurons, including dendritic spines responsible for synaptic connections. The network of the fly brain hemisphere was traced to build a skeletonized wire model. An article reviewing our study appeared in MIT Technology Review. Movies of the obtained structures can be found in our YouTube channel.

Measurable realistic image-based 3D mapping

NASA Astrophysics Data System (ADS)

Liu, W.; Wang, J.; Wang, J. J.; Ding, W.; Almagbile, A.

2011-12-01

Maps with 3D visual models are becoming a remarkable feature of 3D map services. High-resolution image data is obtained for the construction of 3D visualized models.The3D map not only provides the capabilities of 3D measurements and knowledge mining, but also provides the virtual experienceof places of interest, such as demonstrated in the Google Earth. Applications of 3D maps are expanding into the areas of architecture, property management, and urban environment monitoring. However, the reconstruction of high quality 3D models is time consuming, and requires robust hardware and powerful software to handle the enormous amount of data. This is especially for automatic implementation of 3D models and the representation of complicated surfacesthat still need improvements with in the visualisation techniques. The shortcoming of 3D model-based maps is the limitation of detailed coverage since a user can only view and measure objects that are already modelled in the virtual environment. This paper proposes and demonstrates a 3D map concept that is realistic and image-based, that enables geometric measurements and geo-location services. Additionally, image-based 3D maps provide more detailed information of the real world than 3D model-based maps. The image-based 3D maps use geo-referenced stereo images or panoramic images. The geometric relationships between objects in the images can be resolved from the geometric model of stereo images. The panoramic function makes 3D maps more interactive with users but also creates an interesting immersive circumstance. Actually, unmeasurable image-based 3D maps already exist, such as Google street view, but only provide virtual experiences in terms of photos. The topographic and terrain attributes, such as shapes and heights though are omitted. This paper also discusses the potential for using a low cost land Mobile Mapping System (MMS) to implement realistic image 3D mapping, and evaluates the positioning accuracy that a measureable realistic image-based (MRI) system can produce. The major contribution here is the implementation of measurable images on 3D maps to obtain various measurements from real scenes.

Lensfree diffractive tomography for the imaging of 3D cell cultures

NASA Astrophysics Data System (ADS)

Berdeu, Anthony; Momey, Fabien; Dinten, Jean-Marc; Gidrol, Xavier; Picollet-D'hahan, Nathalie; Allier, Cédric

2017-02-01

New microscopes are needed to help reaching the full potential of 3D organoid culture studies by gathering large quantitative and systematic data over extended periods of time while preserving the integrity of the living sample. In order to reconstruct large volumes while preserving the ability to catch every single cell, we propose new imaging platforms based on lens-free microscopy, a technic which is addressing these needs in the context of 2D cell culture, providing label-free and non-phototoxic acquisition of large datasets. We built lens-free diffractive tomography setups performing multi-angle acquisitions of 3D organoid cultures embedded in Matrigel and developed dedicated 3D holographic reconstruction algorithms based on the Fourier diffraction theorem. Nonetheless, holographic setups do not record the phase of the incident wave front and the biological samples in Petri dish strongly limit the angular coverage. These limitations introduce numerous artefacts in the sample reconstruction. We developed several methods to overcome them, such as multi-wavelength imaging or iterative phase retrieval. The most promising technic currently developed is based on a regularised inverse problem approach directly applied on the 3D volume to reconstruct. 3D reconstructions were performed on several complex samples such as 3D networks or spheroids embedded in capsules with large reconstructed volumes up to 25 mm3 while still being able to identify single cells. To our knowledge, this is the first time that such an inverse problem approach is implemented in the context of lens-free diffractive tomography enabling to reconstruct large fully 3D volumes of unstained biological samples.

Dynamic tracking of prosthetic valve motion and deformation from bi-plane x-ray views: feasibility study

NASA Astrophysics Data System (ADS)

Hatt, Charles R.; Wagner, Martin; Raval, Amish N.; Speidel, Michael A.

2016-03-01

Transcatheter aortic valve replacement (TAVR) requires navigation and deployment of a prosthetic valve within the aortic annulus under fluoroscopic guidance. To support improved device visualization in this procedure, this study investigates the feasibility of frame-by-frame 3D reconstruction of a moving and expanding prosthetic valve structure from simultaneous bi-plane x-ray views. In the proposed method, a dynamic 3D model of the valve is used in a 2D/3D registration framework to obtain a reconstruction of the valve. For each frame, valve model parameters describing position, orientation, expansion state, and deformation are iteratively adjusted until forward projections of the model match both bi-plane views. Simulated bi-plane imaging of a valve at different signal-difference-to-noise ratio (SDNR) levels was performed to test the approach. 20 image sequences with 50 frames of valve deployment were simulated at each SDNR. The simulation achieved a target registration error (TRE) of the estimated valve model of 0.93 +/- 2.6 mm (mean +/- S.D.) for the lowest SDNR of 2. For higher SDNRs (5 to 50) a TRE of 0.04 mm +/- 0.23 mm was achieved. A tabletop phantom study was then conducted using a TAVR valve. The dynamic 3D model was constructed from high resolution CT scans and a simple expansion model. TRE was 1.22 +/- 0.35 mm for expansion states varying from undeployed to fully deployed, and for moderate amounts of inter-frame motion. Results indicate that it is feasible to use bi-plane imaging to recover the 3D structure of deformable catheter devices.

Dynamic tracking of prosthetic valve motion and deformation from bi-plane x-ray views: feasibility study.

PubMed

Hatt, Charles R; Wagner, Martin; Raval, Amish N; Speidel, Michael A

2016-01-01

Transcatheter aortic valve replacement (TAVR) requires navigation and deployment of a prosthetic valve within the aortic annulus under fluoroscopic guidance. To support improved device visualization in this procedure, this study investigates the feasibility of frame-by-frame 3D reconstruction of a moving and expanding prosthetic valve structure from simultaneous bi-plane x-ray views. In the proposed method, a dynamic 3D model of the valve is used in a 2D/3D registration framework to obtain a reconstruction of the valve. For each frame, valve model parameters describing position, orientation, expansion state, and deformation are iteratively adjusted until forward projections of the model match both bi-plane views. Simulated bi-plane imaging of a valve at different signal-difference-to-noise ratio (SDNR) levels was performed to test the approach. 20 image sequences with 50 frames of valve deployment were simulated at each SDNR. The simulation achieved a target registration error (TRE) of the estimated valve model of 0.93 ± 2.6 mm (mean ± S.D.) for the lowest SDNR of 2. For higher SDNRs (5 to 50) a TRE of 0.04 mm ± 0.23 mm was achieved. A tabletop phantom study was then conducted using a TAVR valve. The dynamic 3D model was constructed from high resolution CT scans and a simple expansion model. TRE was 1.22 ± 0.35 mm for expansion states varying from undeployed to fully deployed, and for moderate amounts of inter-frame motion. Results indicate that it is feasible to use bi-plane imaging to recover the 3D structure of deformable catheter devices.

Real-time 3D image reconstruction guidance in liver resection surgery

PubMed Central

Nicolau, Stephane; Pessaux, Patrick; Mutter, Didier; Marescaux, Jacques

2014-01-01

Background Minimally invasive surgery represents one of the main evolutions of surgical techniques. However, minimally invasive surgery adds difficulty that can be reduced through computer technology. Methods From a patient’s medical image [US, computed tomography (CT) or MRI], we have developed an Augmented Reality (AR) system that increases the surgeon’s intraoperative vision by providing a virtual transparency of the patient. AR is based on two major processes: 3D modeling and visualization of anatomical or pathological structures appearing in the medical image, and the registration of this visualization onto the real patient. We have thus developed a new online service, named Visible Patient, providing efficient 3D modeling of patients. We have then developed several 3D visualization and surgical planning software tools to combine direct volume rendering and surface rendering. Finally, we have developed two registration techniques, one interactive and one automatic providing intraoperative augmented reality view. Results From January 2009 to June 2013, 769 clinical cases have been modeled by the Visible Patient service. Moreover, three clinical validations have been realized demonstrating the accuracy of 3D models and their great benefit, potentially increasing surgical eligibility in liver surgery (20% of cases). From these 3D models, more than 50 interactive AR-assisted surgical procedures have been realized illustrating the potential clinical benefit of such assistance to gain safety, but also current limits that automatic augmented reality will overcome. Conclusions Virtual patient modeling should be mandatory for certain interventions that have now to be defined, such as liver surgery. Augmented reality is clearly the next step of the new surgical instrumentation but remains currently limited due to the complexity of organ deformations during surgery. Intraoperative medical imaging used in new generation of automated augmented reality should solve this issue thanks to the development of Hybrid OR. PMID:24812598

Stable and efficient retrospective 4D-MRI using non-uniformly distributed quasi-random numbers

NASA Astrophysics Data System (ADS)

Breuer, Kathrin; Meyer, Cord B.; Breuer, Felix A.; Richter, Anne; Exner, Florian; Weng, Andreas M.; Ströhle, Serge; Polat, Bülent; Jakob, Peter M.; Sauer, Otto A.; Flentje, Michael; Weick, Stefan

2018-04-01

The purpose of this work is the development of a robust and reliable three-dimensional (3D) Cartesian imaging technique for fast and flexible retrospective 4D abdominal MRI during free breathing. To this end, a non-uniform quasi random (NU-QR) reordering of the phase encoding (k y –k z ) lines was incorporated into 3D Cartesian acquisition. The proposed sampling scheme allocates more phase encoding points near the k-space origin while reducing the sampling density in the outer part of the k-space. Respiratory self-gating in combination with SPIRiT-reconstruction is used for the reconstruction of abdominal data sets in different respiratory phases (4D-MRI). Six volunteers and three patients were examined at 1.5 T during free breathing. Additionally, data sets with conventional two-dimensional (2D) linear and 2D quasi random phase encoding order were acquired for the volunteers for comparison. A quantitative evaluation of image quality versus scan times (from 70 s to 626 s) for the given sampling schemes was obtained by calculating the normalized mutual information (NMI) for all volunteers. Motion estimation was accomplished by calculating the maximum derivative of a signal intensity profile of a transition (e.g. tumor or diaphragm). The 2D non-uniform quasi-random distribution of phase encoding lines in Cartesian 3D MRI yields more efficient undersampling patterns for parallel imaging compared to conventional uniform quasi-random and linear sampling. Median NMI values of NU-QR sampling are the highest for all scan times. Therefore, within the same scan time 4D imaging could be performed with improved image quality. The proposed method allows for the reconstruction of motion artifact reduced 4D data sets with isotropic spatial resolution of 2.1  ×  2.1  ×  2.1 mm3 in a short scan time, e.g. 10 respiratory phases in only 3 min. Cranio-caudal tumor displacements between 23 and 46 mm could be observed. NU-QR sampling enables for stable 4D-MRI with high temporal and spatial resolution within short scan time for visualization of organ or tumor motion during free breathing. Further studies, e.g. the application of the method for radiotherapy planning are needed to investigate the clinical applicability and diagnostic value of the approach.

Omnidirectional structured light in a flexible configuration.

PubMed

Paniagua, Carmen; Puig, Luis; Guerrero, José J

2013-10-14

Structured light is a perception method that allows us to obtain 3D information from images of the scene by projecting synthetic features with a light emitter. Traditionally, this method considers a rigid configuration, where the position and orientation of the light emitter with respect to the camera are known and calibrated beforehand. In this paper we propose a new omnidirectional structured light system in flexible configuration, which overcomes the rigidness of the traditional structured light systems. We propose the use of an omnidirectional camera combined with a conic pattern light emitter. Since the light emitter is visible in the omnidirectional image, the computation of its location is possible. With this information and the projected conic in the omnidirectional image, we are able to compute the conic reconstruction, i.e., the 3D information of the conic in the space. This reconstruction considers the recovery of the depth and orientation of the scene surface where the conic pattern is projected. One application of our proposed structured light system in flexible configuration consists of a wearable omnicamera with a low-cost laser in hand for visual impaired personal assistance.

Dynamic motion analysis of dart throwers motion visualized through computerized tomography and calculation of the axis of rotation.

PubMed

Edirisinghe, Y; Troupis, J M; Patel, M; Smith, J; Crossett, M

2014-05-01

We used a dynamic three-dimensional (3D) mapping method to model the wrist in dynamic unrestricted dart throwers motion in three men and four women. With the aid of precision landmark identification, a 3D coordinate system was applied to the distal radius and the movement of the carpus was described. Subsequently, with dynamic 3D reconstructions and freedom to position the camera viewpoint anywhere in space, we observed the motion pathways of all carpal bones in dart throwers motion and calculated its axis of rotation. This was calculated to lie in 27° of anteversion from the coronal plane and 44° of varus angulation relative to the transverse plane. This technique is a safe and a feasible carpal imaging method to gain key information for decision making in future hand surgical and rehabilitative practices.

Investigation of undersampling and reconstruction algorithm dependence on respiratory correlated 4D-MRI for online MR-guided radiation therapy

NASA Astrophysics Data System (ADS)

Mickevicius, Nikolai J.; Paulson, Eric S.

2017-04-01

The purpose of this work is to investigate the effects of undersampling and reconstruction algorithm on the total processing time and image quality of respiratory phase-resolved 4D MRI data. Specifically, the goal is to obtain quality 4D-MRI data with a combined acquisition and reconstruction time of five minutes or less, which we reasoned would be satisfactory for pre-treatment 4D-MRI in online MRI-gRT. A 3D stack-of-stars, self-navigated, 4D-MRI acquisition was used to scan three healthy volunteers at three image resolutions and two scan durations. The NUFFT, CG-SENSE, SPIRiT, and XD-GRASP reconstruction algorithms were used to reconstruct each dataset on a high performance reconstruction computer. The overall image quality, reconstruction time, artifact prevalence, and motion estimates were compared. The CG-SENSE and XD-GRASP reconstructions provided superior image quality over the other algorithms. The combination of a 3D SoS sequence and parallelized reconstruction algorithms using computing hardware more advanced than those typically seen on product MRI scanners, can result in acquisition and reconstruction of high quality respiratory correlated 4D-MRI images in less than five minutes.

Three-dimensional dictionary-learning reconstruction of (23)Na MRI data.

PubMed

Behl, Nicolas G R; Gnahm, Christine; Bachert, Peter; Ladd, Mark E; Nagel, Armin M

2016-04-01

To reduce noise and artifacts in (23)Na MRI with a Compressed Sensing reconstruction and a learned dictionary as sparsifying transform. A three-dimensional dictionary-learning compressed sensing reconstruction algorithm (3D-DLCS) for the reconstruction of undersampled 3D radial (23)Na data is presented. The dictionary used as the sparsifying transform is learned with a K-singular-value-decomposition (K-SVD) algorithm. The reconstruction parameters are optimized on simulated data, and the quality of the reconstructions is assessed with peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). The performance of the algorithm is evaluated in phantom and in vivo (23)Na MRI data of seven volunteers and compared with nonuniform fast Fourier transform (NUFFT) and other Compressed Sensing reconstructions. The reconstructions of simulated data have maximal PSNR and SSIM for an undersampling factor (USF) of 10 with numbers of averages equal to the USF. For 10-fold undersampling, the PSNR is increased by 5.1 dB compared with the NUFFT reconstruction, and the SSIM by 24%. These results are confirmed by phantom and in vivo (23)Na measurements in the volunteers that show markedly reduced noise and undersampling artifacts in the case of 3D-DLCS reconstructions. The 3D-DLCS algorithm enables precise reconstruction of undersampled (23)Na MRI data with markedly reduced noise and artifact levels compared with NUFFT reconstruction. Small structures are well preserved. © 2015 Wiley Periodicals, Inc.

3-dimensional electron microscopic imaging of the zebrafish olfactory bulb and dense reconstruction of neurons.

PubMed

Wanner, Adrian A; Genoud, Christel; Friedrich, Rainer W

2016-11-08

Large-scale reconstructions of neuronal populations are critical for structural analyses of neuronal cell types and circuits. Dense reconstructions of neurons from image data require ultrastructural resolution throughout large volumes, which can be achieved by automated volumetric electron microscopy (EM) techniques. We used serial block face scanning EM (SBEM) and conductive sample embedding to acquire an image stack from an olfactory bulb (OB) of a zebrafish larva at a voxel resolution of 9.25×9.25×25 nm 3 . Skeletons of 1,022 neurons, 98% of all neurons in the OB, were reconstructed by manual tracing and efficient error correction procedures. An ergonomic software package, PyKNOSSOS, was created in Python for data browsing, neuron tracing, synapse annotation, and visualization. The reconstructions allow for detailed analyses of morphology, projections and subcellular features of different neuron types. The high density of reconstructions enables geometrical and topological analyses of the OB circuitry. Image data can be accessed and viewed through the neurodata web services (http://www.neurodata.io). Raw data and reconstructions can be visualized in PyKNOSSOS.

3-dimensional electron microscopic imaging of the zebrafish olfactory bulb and dense reconstruction of neurons

PubMed Central

Wanner, Adrian A.; Genoud, Christel; Friedrich, Rainer W.

2016-01-01

Large-scale reconstructions of neuronal populations are critical for structural analyses of neuronal cell types and circuits. Dense reconstructions of neurons from image data require ultrastructural resolution throughout large volumes, which can be achieved by automated volumetric electron microscopy (EM) techniques. We used serial block face scanning EM (SBEM) and conductive sample embedding to acquire an image stack from an olfactory bulb (OB) of a zebrafish larva at a voxel resolution of 9.25×9.25×25 nm3. Skeletons of 1,022 neurons, 98% of all neurons in the OB, were reconstructed by manual tracing and efficient error correction procedures. An ergonomic software package, PyKNOSSOS, was created in Python for data browsing, neuron tracing, synapse annotation, and visualization. The reconstructions allow for detailed analyses of morphology, projections and subcellular features of different neuron types. The high density of reconstructions enables geometrical and topological analyses of the OB circuitry. Image data can be accessed and viewed through the neurodata web services (http://www.neurodata.io). Raw data and reconstructions can be visualized in PyKNOSSOS. PMID:27824337

Rotational X-ray angiography: a method for intra-operative volume imaging of the left-atrium and pulmonary veins for atrial fibrillation ablation guidance

NASA Astrophysics Data System (ADS)

Manzke, R.; Zagorchev, L.; d'Avila, A.; Thiagalingam, A.; Reddy, V. Y.; Chan, R. C.

2007-03-01

Catheter-based ablation in the left atrium and pulmonary veins (LAPV) for treatment of atrial fibrillation in cardiac electrophysiology (EP) are complex and require knowledge of heart chamber anatomy. Electroanatomical mapping (EAM) is typically used to define cardiac structures by combining electromagnetic spatial catheter localization with surface models which interpolate the anatomy between EAM point locations in 3D. Recently, the incorporation of pre-operative volumetric CT or MR data sets has allowed for more detailed maps of LAPV anatomy to be used intra-operatively. Preoperative data sets are however a rough guide since they can be acquired several days to weeks prior to EP intervention. Due to positional and physiological changes, the intra-operative cardiac anatomy can be different from that depicted in the pre-operative data. We present an application of contrast-enhanced rotational X-ray imaging for CT-like reconstruction of 3D LAPV anatomy during the intervention itself. Depending on the heart size a single or two selective contrastenhanced rotational acquisitions are performed and CT-like volumes are reconstructed with 3D filtered back projection. In case of dual injection, the two volumes depicting the left and right portions of the LAPV are registered and fused. The data sets are visualized and segmented intra-procedurally to provide anatomical data and surface models for intervention guidance. Our results from animal and human experiments indicate that the anatomical information from intra-operative CT-like reconstructions compares favorably with preacquired imaging data and can be of sufficient quality for intra-operative guidance.

Investigation of second harmonic generation and multispectral imaging as new contrast mechanisms in scanning laser optical tomography

NASA Astrophysics Data System (ADS)

Nolte, Lena; Antonopoulos, Georgios C.; Heisterkamp, Alexander; Ripken, Tammo; Meyer, Heiko

2018-02-01

Scanning laser optical tomography (SLOT) is a 3D imaging technique, based on the principle of computed tomography to visualize samples up to magnitude of several centimeters. Intrinsic contrast mechanisms as absorption, scattering and autofluorescence provide information about the 3D architecture and composition of the sample. Another valuable intrinsic contrast mechanism is second harmonic generation (SHG), which is generated in noncentrosymmetric materials and commonly used to image collagen in biological samples. The angular dependence of the SHG signal, however, produces artifacts in reconstructed optical tomography datasets (OPT, SLOT). Thus, successful use of this intrinsic contrast mechanism is impaired. We investigate these artifacts by simulation and experiment and propose an elimination procedure that enables successful reconstruction of SHG-SLOT data. Nevertheless, in many cases specific labeling of certain structures is necessary to make them visible. Using multiple dyes in one sample can lead to crosstalk between the different channels and reduce contrast of the images. Also autofluorescence of the sample itself can account for that. By using multispectral imaging in combination with spectral unmixing techniques, this loss can be compensated. Therefore either a spectrally resolved detection path, or spectrally resolved excitation is required. Therefore we integrated a white supercontinuum light source in our SLOT-setup that enables a spectral selection of the excitation beam and extended the detection path to a four channel setup. This enables the detection of three fluorescence channels and one absorption channel in parallel, and increases the contrast in the reconstructed 3D images significantly.

SU-G-IeP4-08: Initial Investigations of Up-Converting Nanoparticles (UCNP) for 3D Tissue Imaging in Optical-ECT

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yoon, S; Dewhirst, M; Oldham, M

Purpose: Near-IR absorptive up-converting nanoparticles (UCNPs) is a novel contrast for optical-ECT that allows auto-fluorescence-free 3D imaging of labeled cells in a matrix of large (∼1cm{sup 3}) unsectioned normal tissue. This has the potential to image small metastases or dormant cells that is difficult with down-converting fluorescing dyes due to auto-fluorescence. The feasibility of imaging UCNP in agarose phantoms and a mouse lung is demonstrated, aided by a 3D-printed optical-ECT stage designed to excite UCNP in a mouse lung. Methods: The UCNP, NaYF{sub 4}:Yb/Er (20/2%), studied in this work up-converts 980nm light to visible light peaking sharply at ∼540nm. Tomore » characterize the UCNP emission as a function of UCNP concentration, cylindrical 2.5%wt agarose phantoms infused with UCNP at concentrations of 25µg/mL and 50µg/mL were exposed to 1.5W 980nm laser coupled to an optical fiber. The fiber was held stably at 1cm above the stage via a custom 3D-printed stage. An optically cleared lung harvested from a BALBc mice was then injected with 100µL of 1mg/mL UCNP solution ex vivo. Tomographic imaging of the UCNP emission in lung was performed. Results: The laser beam tract is visualized within the agarose phantom. A line profile of UCNP emission at 25µg/mL versus 50µg/mL shows that increasing the UCNP concentration increases emission count. UCNPs injected into a cleared mouse lung disperse throughout the respiratory tract, allowing for visualization and 3D reconstruction. Excitation before and after UCNP injection shows the tissue exhibits no auto-fluorescence at 980nm, allowing clear view of the UCNP without any obscuring features such as conventional down-converting fluorescent tags. Conclusion: We confirm that up-conversion in tissue circumvents completely tissue auto-fluorescence, which allowed background-free 3D reconstruction of the UCNP distribution. We also confirm that raising the UCNP concentration increases emission and that UCNPs are retained in agarose samples during the optical clearing process.« less

Interpreting three-dimensional structures from two-dimensional images: a web-based interactive 3D teaching model of surgical liver anatomy

PubMed Central

Crossingham, Jodi L; Jenkinson, Jodie; Woolridge, Nick; Gallinger, Steven; Tait, Gordon A; Moulton, Carol-Anne E

2009-01-01

Background: Given the increasing number of indications for liver surgery and the growing complexity of operations, many trainees in surgical, imaging and related subspecialties require a good working knowledge of the complex intrahepatic anatomy. Computed tomography (CT), the most commonly used liver imaging modality, enhances our understanding of liver anatomy, but comprises a two-dimensional (2D) representation of a complex 3D organ. It is challenging for trainees to acquire the necessary skills for converting these 2D images into 3D mental reconstructions because learning opportunities are limited and internal hepatic anatomy is complicated, asymmetrical and variable. We have created a website that uses interactive 3D models of the liver to assist trainees in understanding the complex spatial anatomy of the liver and to help them create a 3D mental interpretation of this anatomy when viewing CT scans. Methods: Computed tomography scans were imported into DICOM imaging software (OsiriX™) to obtain 3D surface renderings of the liver and its internal structures. Using these 3D renderings as a reference, 3D models of the liver surface and the intrahepatic structures, portal veins, hepatic veins, hepatic arteries and the biliary system were created using 3D modelling software (Cinema 4D™). Results: Using current best practices for creating multimedia tools, a unique, freely available, online learning resource has been developed, entitled Visual Interactive Resource for Teaching, Understanding And Learning Liver Anatomy (VIRTUAL Liver) (http://pie.med.utoronto.ca/VLiver). This website uses interactive 3D models to provide trainees with a constructive resource for learning common liver anatomy and liver segmentation, and facilitates the development of the skills required to mentally reconstruct a 3D version of this anatomy from 2D CT scans. Discussion: Although the intended audience for VIRTUAL Liver consists of residents in various medical and surgical specialties, the website will also be useful for other health care professionals (i.e. radiologists, nurses, hepatologists, radiation oncologists, family doctors) and educators because it provides a comprehensive resource for teaching liver anatomy. PMID:19816618

Quantification of tumor morphology via 3D histology: application to oral cavity cancers

NASA Astrophysics Data System (ADS)

Doyle, Scott; Brandwein-Gensler, Margaret; Tomaszewski, John

2016-03-01

Traditional histopathology quantifies disease through the study of glass slides, i.e. two-dimensional samples that are representative of the overall process. We hypothesize that 3D reconstruction can enhance our understanding of histopathologic interpretations. To test this hypothesis, we perform a pilot study of the risk model for oral cavity cancer (OCC), which stratifies patients into low-, intermediate-, and high-risk for locoregional disease-free survival. Classification is based on study of hematoxylin and eosin (H and E) stained tissues sampled from the resection specimens. In this model, the Worst Pattern of Invasion (WPOI) is assessed, representing specific architectural features at the interface between cancer and non-cancer tissue. Currently, assessment of WPOI is based on 2D sections of tissue, representing complex 3D structures of tumor growth. We believe that by reconstructing a 3D model of tumor growth and quantifying the tumor-host interface, we can obtain important diagnostic information that is difficult to assess in 2D. Therefore, we introduce a pilot study framework for visualizing tissue architecture and morphology in 3D from serial sections of histopathology. This framework can be used to enhance predictive models for diseases where severity is determined by 3D biological structure. In this work we utilize serial H and E-stained OCC resections obtained from 7 patients exhibiting WPOI-3 (low risk of recurrence) through WPOI-5 (high risk of recurrence). A supervised classifier automatically generates a map of tumor regions on each slide, which are then co-registered using an elastic deformation algorithm. A smooth 3D model of the tumor region is generated from the registered maps, which is suitable for quantitative tumor interface morphology feature extraction. We report our preliminary models created with this system and suggest further enhancements to traditional histology scoring mechanisms that take spatial architecture into consideration.

Wave-CAIPI ViSTa: highly accelerated whole-brain direct myelin water imaging with zero-padding reconstruction.

PubMed

Wu, Zhe; Bilgic, Berkin; He, Hongjian; Tong, Qiqi; Sun, Yi; Du, Yiping; Setsompop, Kawin; Zhong, Jianhui

2018-09-01

This study introduces a highly accelerated whole-brain direct visualization of short transverse relaxation time component (ViSTa) imaging using a wave controlled aliasing in parallel imaging (CAIPI) technique, for acquisition within a clinically acceptable scan time, with the preservation of high image quality and sufficient spatial resolution, and reduced residual point spread function artifacts. Double inversion RF pulses were applied to preserve the signal from short T 1 components for directly extracting myelin water signal in ViSTa imaging. A 2D simultaneous multislice and a 3D acquisition of ViSTa images incorporating wave-encoding were used for data acquisition. Improvements brought by a zero-padding method in wave-CAIPI reconstruction were also investigated. The zero-padding method in wave-CAIPI reconstruction reduced the root-mean-square errors between the wave-encoded and Cartesian gradient echoes for all wave gradient configurations in simulation, and reduced the side-main lobe intensity ratio from 34.5 to 16% in the thin-slab in vivo ViSTa images. In a 4 × acceleration simultaneous-multislice scenario, wave-CAIPI ViSTa achieved negligible g-factors (g mean /g max  = 1.03/1.10), while retaining minimal interslice artifacts. An 8 × accelerated acquisition of 3D wave-CAIPI ViSTa imaging covering the whole brain with 1.1 × 1.1 × 3 mm 3 voxel size was achieved within 15 minutes, and only incurred a small g-factor penalty (g mean /g max  = 1.05/1.16). Whole-brain ViSTa images were obtained within 15 minutes with negligible g-factor penalty by using wave-CAIPI acquisition and zero-padding reconstruction. The proposed zero-padding method was shown to be effective in reducing residual point spread function for wave-encoded images, particularly for ViSTa. © 2018 International Society for Magnetic Resonance in Medicine.

Geomatic Archaeological Reconstruction and a Hybrid Viewer for the Archaelogical Site of CÁPARRA (spain)

NASA Astrophysics Data System (ADS)

Tejeda-Sánchez, C.; Muñoz-Nieto, A.; Rodríguez-Gonzálvez, P.

2018-05-01

Visualization and analysis use to be the final steps in Geomatics. This paper shows the workflow followed to set up a hybrid 3D archaeological viewer. Data acquisition of the site survey was done by means of low-cost close-range photogrammetric methods. With the aim not only to satisfy the general public but also the technicians, a large group of Geomatic products has been obtained (2d plans, 3d models, orthophotos, CAD models coming from vectorization, virtual anastylosis, and cross sections). Finally, all these products have been integrated into a three-dimensional archaeological information system. The hybrid archaeological viewer designed allows a metric and quality approach to the scientific analysis of the ruins, improving, thanks to the implementation of a database, and its potential for queries, the benefits of an ordinary topographic survey.

3D equilibrium reconstruction with islands

DOE PAGES

Cianciosa, M.; Hirshman, S. P.; Seal, S. K.; ...

2018-02-15

This study presents the development of a 3D equilibrium reconstruction tool and the results of the first-ever reconstruction of an island equilibrium. The SIESTA non-nested equilibrium solver has been coupled to the V3FIT 3D equilibrium reconstruction code. Computed from a coupled VMEC and SIESTA model, synthetic signals are matched to measured signals by finding an optimal set of equilibrium parameters. By using the normalized pressure in place of normalized flux, non-equilibrium quantities needed by diagnostic signals can be efficiently mapped to the equilibrium. The effectiveness of this tool is demonstrated by reconstructing an island equilibrium of a DIII-D inner wallmore » limited L-mode case with an n = 1 error field applied. Finally, flat spots in Thomson and ECE temperature diagnostics show the reconstructed islands have the correct size and phase.« less

3D equilibrium reconstruction with islands

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cianciosa, M.; Hirshman, S. P.; Seal, S. K.

This study presents the development of a 3D equilibrium reconstruction tool and the results of the first-ever reconstruction of an island equilibrium. The SIESTA non-nested equilibrium solver has been coupled to the V3FIT 3D equilibrium reconstruction code. Computed from a coupled VMEC and SIESTA model, synthetic signals are matched to measured signals by finding an optimal set of equilibrium parameters. By using the normalized pressure in place of normalized flux, non-equilibrium quantities needed by diagnostic signals can be efficiently mapped to the equilibrium. The effectiveness of this tool is demonstrated by reconstructing an island equilibrium of a DIII-D inner wallmore » limited L-mode case with an n = 1 error field applied. Finally, flat spots in Thomson and ECE temperature diagnostics show the reconstructed islands have the correct size and phase.« less

Bayesian penalized-likelihood reconstruction algorithm suppresses edge artifacts in PET reconstruction based on point-spread-function.

PubMed

Yamaguchi, Shotaro; Wagatsuma, Kei; Miwa, Kenta; Ishii, Kenji; Inoue, Kazumasa; Fukushi, Masahiro

2018-03-01

The Bayesian penalized-likelihood reconstruction algorithm (BPL), Q.Clear, uses relative difference penalty as a regularization function to control image noise and the degree of edge-preservation in PET images. The present study aimed to determine the effects of suppression on edge artifacts due to point-spread-function (PSF) correction using a Q.Clear. Spheres of a cylindrical phantom contained a background of 5.3 kBq/mL of [ 18 F]FDG and sphere-to-background ratios (SBR) of 16, 8, 4 and 2. The background also contained water and spheres containing 21.2 kBq/mL of [ 18 F]FDG as non-background. All data were acquired using a Discovery PET/CT 710 and were reconstructed using three-dimensional ordered-subset expectation maximization with time-of-flight (TOF) and PSF correction (3D-OSEM), and Q.Clear with TOF (BPL). We investigated β-values of 200-800 using BPL. The PET images were analyzed using visual assessment and profile curves, edge variability and contrast recovery coefficients were measured. The 38- and 27-mm spheres were surrounded by higher radioactivity concentration when reconstructed with 3D-OSEM as opposed to BPL, which suppressed edge artifacts. Images of 10-mm spheres had sharper overshoot at high SBR and non-background when reconstructed with BPL. Although contrast recovery coefficients of 10-mm spheres in BPL decreased as a function of increasing β, higher penalty parameter decreased the overshoot. BPL is a feasible method for the suppression of edge artifacts of PSF correction, although this depends on SBR and sphere size. Overshoot associated with BPL caused overestimation in small spheres at high SBR. Higher penalty parameter in BPL can suppress overshoot more effectively. Copyright © 2018 Associazione Italiana di Fisica Medica. Published by Elsevier Ltd. All rights reserved.

A Dynamic Multi-Projection-Contour Approximating Framework for the 3D Reconstruction of Buildings by Super-Generalized Optical Stereo-Pairs.

PubMed

Yan, Yiming; Su, Nan; Zhao, Chunhui; Wang, Liguo

2017-09-19

In this paper, a novel framework of the 3D reconstruction of buildings is proposed, focusing on remote sensing super-generalized stereo-pairs (SGSPs). As we all know, 3D reconstruction cannot be well performed using nonstandard stereo pairs, since reliable stereo matching could not be achieved when the image-pairs are collected at a great difference of views, and we always failed to obtain dense 3D points for regions of buildings, and cannot do further 3D shape reconstruction. We defined SGSPs as two or more optical images collected in less constrained views but covering the same buildings. It is even more difficult to reconstruct the 3D shape of a building by SGSPs using traditional frameworks. As a result, a dynamic multi-projection-contour approximating (DMPCA) framework was introduced for SGSP-based 3D reconstruction. The key idea is that we do an optimization to find a group of parameters of a simulated 3D model and use a binary feature-image that minimizes the total differences between projection-contours of the building in the SGSPs and that in the simulated 3D model. Then, the simulated 3D model, defined by the group of parameters, could approximate the actual 3D shape of the building. Certain parameterized 3D basic-unit-models of typical buildings were designed, and a simulated projection system was established to obtain a simulated projection-contour in different views. Moreover, the artificial bee colony algorithm was employed to solve the optimization. With SGSPs collected by the satellite and our unmanned aerial vehicle, the DMPCA framework was verified by a group of experiments, which demonstrated the reliability and advantages of this work.

Design and experimental validation of novel 3D optical scanner with zoom lens unit

NASA Astrophysics Data System (ADS)

Huang, Jyun-Cheng; Liu, Chien-Sheng; Chiang, Pei-Ju; Hsu, Wei-Yan; Liu, Jian-Liang; Huang, Bai-Hao; Lin, Shao-Ru

2017-10-01

Optical scanners play a key role in many three-dimensional (3D) printing and CAD/CAM applications. However, existing optical scanners are generally designed to provide either a wide scanning area or a high 3D reconstruction accuracy from a lens with a fixed focal length. In the former case, the scanning area is increased at the expense of the reconstruction accuracy, while in the latter case, the reconstruction performance is improved at the expense of a more limited scanning range. In other words, existing optical scanners compromise between the scanning area and the reconstruction accuracy. Accordingly, the present study proposes a new scanning system including a zoom-lens unit, which combines both a wide scanning area and a high 3D reconstruction accuracy. In the proposed approach, the object is scanned initially under a suitable low-magnification setting for the object size (setting 1), resulting in a wide scanning area but a poor reconstruction resolution in complicated regions of the object. The complicated regions of the object are then rescanned under a high-magnification setting (setting 2) in order to improve the accuracy of the original reconstruction results. Finally, the models reconstructed after each scanning pass are combined to obtain the final reconstructed 3D shape of the object. The feasibility of the proposed method is demonstrated experimentally using a laboratory-built prototype. It is shown that the scanner has a high reconstruction accuracy over a large scanning area. In other words, the proposed optical scanner has significant potential for 3D engineering applications.

Geometric reconstruction using tracked ultrasound strain imaging

NASA Astrophysics Data System (ADS)

Pheiffer, Thomas S.; Simpson, Amber L.; Ondrake, Janet E.; Miga, Michael I.

2013-03-01

The accurate identification of tumor margins during neurosurgery is a primary concern for the surgeon in order to maximize resection of malignant tissue while preserving normal function. The use of preoperative imaging for guidance is standard of care, but tumor margins are not always clear even when contrast agents are used, and so margins are often determined intraoperatively by visual and tactile feedback. Ultrasound strain imaging creates a quantitative representation of tissue stiffness which can be used in real-time. The information offered by strain imaging can be placed within a conventional image-guidance workflow by tracking the ultrasound probe and calibrating the image plane, which facilitates interpretation of the data by placing it within a common coordinate space with preoperative imaging. Tumor geometry in strain imaging is then directly comparable to the geometry in preoperative imaging. This paper presents a tracked ultrasound strain imaging system capable of co-registering with preoperative tomograms and also of reconstructing a 3D surface using the border of the strain lesion. In a preliminary study using four phantoms with subsurface tumors, tracked strain imaging was registered to preoperative image volumes and then tumor surfaces were reconstructed using contours extracted from strain image slices. The volumes of the phantom tumors reconstructed from tracked strain imaging were approximately between 1.5 to 2.4 cm3, which was similar to the CT volumes of 1.0 to 2.3 cm3. Future work will be done to robustly characterize the reconstruction accuracy of the system.