A review of training research and virtual reality simulators for the da Vinci surgical system.

PubMed

Liu, May; Curet, Myriam

2015-01-01

PHENOMENON: Virtual reality simulators are the subject of several recent studies of skills training for robot-assisted surgery. Yet no consensus exists regarding what a core skill set comprises or how to measure skill performance. Defining a core skill set and relevant metrics would help surgical educators evaluate different simulators. This review draws from published research to propose a core technical skill set for using the da Vinci surgeon console. Publications on three commercial simulators were used to evaluate the simulators' content addressing these skills and associated metrics. An analysis of published research suggests that a core technical skill set for operating the surgeon console includes bimanual wristed manipulation, camera control, master clutching to manage hand position, use of third instrument arm, activating energy sources, appropriate depth perception, and awareness of forces applied by instruments. Validity studies of three commercial virtual reality simulators for robot-assisted surgery suggest that all three have comparable content and metrics. However, none have comprehensive content and metrics for all core skills. INSIGHTS: Virtual reality simulation remains a promising tool to support skill training for robot-assisted surgery, yet existing commercial simulator content is inadequate for performing and assessing a comprehensive basic skill set. The results of this evaluation help identify opportunities and challenges that exist for future developments in virtual reality simulation for robot-assisted surgery. Specifically, the inclusion of educational experts in the development cycle alongside clinical and technological experts is recommended.

Computational Virtual Reality (VR) as a human-computer interface in the operation of telerobotic systems

NASA Technical Reports Server (NTRS)

Bejczy, Antal K.

1995-01-01

This presentation focuses on the application of computer graphics or 'virtual reality' (VR) techniques as a human-computer interface tool in the operation of telerobotic systems. VR techniques offer very valuable task realization aids for planning, previewing and predicting robotic actions, operator training, and for visual perception of non-visible events like contact forces in robotic tasks. The utility of computer graphics in telerobotic operation can be significantly enhanced by high-fidelity calibration of virtual reality images to actual TV camera images. This calibration will even permit the creation of artificial (synthetic) views of task scenes for which no TV camera views are available.

Open multi-agent control architecture to support virtual-reality-based man-machine interfaces

NASA Astrophysics Data System (ADS)

Freund, Eckhard; Rossmann, Juergen; Brasch, Marcel

2001-10-01

Projective Virtual Reality is a new and promising approach to intuitively operable man machine interfaces for the commanding and supervision of complex automation systems. The user interface part of Projective Virtual Reality heavily builds on latest Virtual Reality techniques, a task deduction component and automatic action planning capabilities. In order to realize man machine interfaces for complex applications, not only the Virtual Reality part has to be considered but also the capabilities of the underlying robot and automation controller are of great importance. This paper presents a control architecture that has proved to be an ideal basis for the realization of complex robotic and automation systems that are controlled by Virtual Reality based man machine interfaces. The architecture does not just provide a well suited framework for the real-time control of a multi robot system but also supports Virtual Reality metaphors and augmentations which facilitate the user's job to command and supervise a complex system. The developed control architecture has already been used for a number of applications. Its capability to integrate sensor information from sensors of different levels of abstraction in real-time helps to make the realized automation system very responsive to real world changes. In this paper, the architecture will be described comprehensively, its main building blocks will be discussed and one realization that is built based on an open source real-time operating system will be presented. The software design and the features of the architecture which make it generally applicable to the distributed control of automation agents in real world applications will be explained. Furthermore its application to the commanding and control of experiments in the Columbus space laboratory, the European contribution to the International Space Station (ISS), is only one example which will be described.

STS-61 crew utilizing Virtual Reality in training for HST repair mission

NASA Image and Video Library

1993-06-11

Astronaut Jeffrey A. Hoffman, one of four crewmembers for STS-61 that will conduct scheduled spacewalks during the flight, wears a special helmet and gloves designed to assist in proper positioning near the telescope while on the end of the robot arm. Crewmembers are utilizing a new virtual reality training aid which assists in refining positioning patterns for Space Shuttle Endeavour's Remote Manipulator System (RMS) (36890); Astronaut Claude Nicollier looks at a computer display of the Shuttle's robot arm movements as Thomas D. Akers and Kathryn C. Thornton, mission specialists look on. Nicollier will be responsible for maneuvering the astronauts while they stand in a foot restraint on the end of the RMS arm (36891,36894); Hoffman wears a special helmet and gloves designed to assist in proper positioning near the telescope while on the end of the robot arm (35892); Nicollier looks at a computer display of the Shuttle's robot arm movements as Akers looks on (36893); While (l-r) Astronauts Kenneth Bowersox, Kathryn Thornton, Richard O. Covey and Thomas D. Akers watch, Nicollier moves the Robot arm to desired locations in the Shuttle's payload bay using the Virtual Reality program (36895); Bowersox takes his turn maneuvering the RMS while mission specialist Hoffman, wearing the Virtual Reality helmet, follows his own progress on the end of the robot arm. Crewmembers participating during the training session are (l-r) Astronauts Akers, Hoffman, Bowersox, Nicollier, Covey, and Thornton. In the background, David Homan, an engineer in the JSC Engineering Directorate's Automation and Robotics Division, looks on (36896).

Comparative assessment of three standardized robotic surgery training methods.

PubMed

Hung, Andrew J; Jayaratna, Isuru S; Teruya, Kara; Desai, Mihir M; Gill, Inderbir S; Goh, Alvin C

2013-10-01

To evaluate three standardized robotic surgery training methods, inanimate, virtual reality and in vivo, for their construct validity. To explore the concept of cross-method validity, where the relative performance of each method is compared. Robotic surgical skills were prospectively assessed in 49 participating surgeons who were classified as follows: 'novice/trainee': urology residents, previous experience <30 cases (n = 38) and 'experts': faculty surgeons, previous experience ≥30 cases (n = 11). Three standardized, validated training methods were used: (i) structured inanimate tasks; (ii) virtual reality exercises on the da Vinci Skills Simulator (Intuitive Surgical, Sunnyvale, CA, USA); and (iii) a standardized robotic surgical task in a live porcine model with performance graded by the Global Evaluative Assessment of Robotic Skills (GEARS) tool. A Kruskal-Wallis test was used to evaluate performance differences between novices and experts (construct validity). Spearman's correlation coefficient (ρ) was used to measure the association of performance across inanimate, simulation and in vivo methods (cross-method validity). Novice and expert surgeons had previously performed a median (range) of 0 (0-20) and 300 (30-2000) robotic cases, respectively (P < 0.001). Construct validity: experts consistently outperformed residents with all three methods (P < 0.001). Cross-method validity: overall performance of inanimate tasks significantly correlated with virtual reality robotic performance (ρ = -0.7, P < 0.001) and in vivo robotic performance based on GEARS (ρ = -0.8, P < 0.0001). Virtual reality performance and in vivo tissue performance were also found to be strongly correlated (ρ = 0.6, P < 0.001). We propose the novel concept of cross-method validity, which may provide a method of evaluating the relative value of various forms of skills education and assessment. We externally confirmed the construct validity of each featured training tool. © 2013 BJU International.

Virtual Reality Based Support System for Layout Planning and Programming of an Industrial Robotic Work Cell

PubMed Central

Yap, Hwa Jen; Taha, Zahari; Md Dawal, Siti Zawiah; Chang, Siow-Wee

2014-01-01

Traditional robotic work cell design and programming are considered inefficient and outdated in current industrial and market demands. In this research, virtual reality (VR) technology is used to improve human-robot interface, whereby complicated commands or programming knowledge is not required. The proposed solution, known as VR-based Programming of a Robotic Work Cell (VR-Rocell), consists of two sub-programmes, which are VR-Robotic Work Cell Layout (VR-RoWL) and VR-based Robot Teaching System (VR-RoT). VR-RoWL is developed to assign the layout design for an industrial robotic work cell, whereby VR-RoT is developed to overcome safety issues and lack of trained personnel in robot programming. Simple and user-friendly interfaces are designed for inexperienced users to generate robot commands without damaging the robot or interrupting the production line. The user is able to attempt numerous times to attain an optimum solution. A case study is conducted in the Robotics Laboratory to assemble an electronics casing and it is found that the output models are compatible with commercial software without loss of information. Furthermore, the generated KUKA commands are workable when loaded into a commercial simulator. The operation of the actual robotic work cell shows that the errors may be due to the dynamics of the KUKA robot rather than the accuracy of the generated programme. Therefore, it is concluded that the virtual reality based solution approach can be implemented in an industrial robotic work cell. PMID:25360663

Virtual reality based support system for layout planning and programming of an industrial robotic work cell.

PubMed

Yap, Hwa Jen; Taha, Zahari; Dawal, Siti Zawiah Md; Chang, Siow-Wee

2014-01-01

Traditional robotic work cell design and programming are considered inefficient and outdated in current industrial and market demands. In this research, virtual reality (VR) technology is used to improve human-robot interface, whereby complicated commands or programming knowledge is not required. The proposed solution, known as VR-based Programming of a Robotic Work Cell (VR-Rocell), consists of two sub-programmes, which are VR-Robotic Work Cell Layout (VR-RoWL) and VR-based Robot Teaching System (VR-RoT). VR-RoWL is developed to assign the layout design for an industrial robotic work cell, whereby VR-RoT is developed to overcome safety issues and lack of trained personnel in robot programming. Simple and user-friendly interfaces are designed for inexperienced users to generate robot commands without damaging the robot or interrupting the production line. The user is able to attempt numerous times to attain an optimum solution. A case study is conducted in the Robotics Laboratory to assemble an electronics casing and it is found that the output models are compatible with commercial software without loss of information. Furthermore, the generated KUKA commands are workable when loaded into a commercial simulator. The operation of the actual robotic work cell shows that the errors may be due to the dynamics of the KUKA robot rather than the accuracy of the generated programme. Therefore, it is concluded that the virtual reality based solution approach can be implemented in an industrial robotic work cell.

Summer Students in Virtual Reality: A Pilot Study on Educational Applications of Virtual Reality Technology.

ERIC Educational Resources Information Center

Bricken, Meredith; Byrne, Chris M.

The goal of this study was to take a first step in evaluating the potential of virtual reality (VR) as a learning environment. The context of the study was The Technology Academy, a technology-oriented summer day camp for students ages 5-18, where student activities center around hands-on exploration of new technology (e.g., robotics, MIDI digital…

The RoboCup Mixed Reality League - A Case Study

NASA Astrophysics Data System (ADS)

Gerndt, Reinhard; Bohnen, Matthias; da Silva Guerra, Rodrigo; Asada, Minoru

In typical mixed reality systems there is only a one-way interaction from real to virtual. A human user or the physics of a real object may influence the behavior of virtual objects, but real objects usually cannot be influenced by the virtual world. By introducing real robots into the mixed reality system, we allow a true two-way interaction between virtual and real worlds. Our system has been used since 2007 to implement the RoboCup mixed reality soccer games and other applications for research and edutainment. Our framework system is freely programmable to generate any virtual environment, which may then be further supplemented with virtual and real objects. The system allows for control of any real object based on differential drive robots. The robots may be adapted for different applications, e.g., with markers for identification or with covers to change shape and appearance. They may also be “equipped” with virtual tools. In this chapter we present the hardware and software architecture of our system and some applications. The authors believe this can be seen as a first implementation of Ivan Sutherland’s 1965 idea of the ultimate display: “The ultimate display would, of course, be a room within which the computer can control the existence of matter …” (Sutherland, 1965, Proceedings of IFIPS Congress 2:506-508).

Virtual reality in surgery and medicine.

PubMed

Chinnock, C

1994-01-01

This report documents the state of development of enhanced and virtual reality-based systems in medicine. Virtual reality systems seek to simulate a surgical procedure in a computer-generated world in order to improve training. Enhanced reality systems seek to augment or enhance reality by providing improved imaging alternatives for specific patient data. Virtual reality represents a paradigm shift in the way we teach and evaluate the skills of medical personnel. Driving the development of virtual reality-based simulators is laparoscopic abdominal surgery, where there is a perceived need for better training techniques; within a year, systems will be fielded for second-year residency students. Further refinements over perhaps the next five years should allow surgeons to evaluate and practice new techniques in a simulator before using them on patients. Technical developments are rapidly improving the realism of these machines to an amazing degree, as well as bringing the price down to affordable levels. In the next five years, many new anatomical models, procedures, and skills are likely to become available on simulators. Enhanced reality systems are generally being developed to improve visualization of specific patient data. Three-dimensional (3-D) stereovision systems for endoscopic applications, head-mounted displays, and stereotactic image navigation systems are being fielded now, with neurosurgery and laparoscopic surgery being major driving influences. Over perhaps the next five years, enhanced and virtual reality systems are likely to merge. This will permit patient-specific images to be used on virtual reality simulators or computer-generated landscapes to be input into surgical visualization instruments. Percolating all around these activities are developments in robotics and telesurgery. An advanced information infrastructure eventually will permit remote physicians to share video, audio, medical records, and imaging data with local physicians in real time. Surgical robots are likely to be deployed for specific tasks in the operating room (OR) and to support telesurgery applications. Technical developments in robotics and motion control are key components of many virtual reality systems. Since almost all of the virtual reality and enhanced reality systems will be digitally based, they are also capable of being put "on-line" for tele-training, consulting, and even surgery. Advancements in virtual and enhanced reality systems will be driven in part by consumer applications of this technology. Many of the companies that will supply systems for medical applications are also working on commercial products. A big consumer hit can benefit the entire industry by increasing volumes and bringing down costs.(ABSTRACT TRUNCATED AT 400 WORDS)

Virtual Reality and Simulation in Neurosurgical Training.

PubMed

Bernardo, Antonio

2017-10-01

Recent biotechnological advances, including three-dimensional microscopy and endoscopy, virtual reality, surgical simulation, surgical robotics, and advanced neuroimaging, have continued to mold the surgeon-computer relationship. For developing neurosurgeons, such tools can reduce the learning curve, improve conceptual understanding of complex anatomy, and enhance visuospatial skills. We explore the current and future roles and application of virtual reality and simulation in neurosurgical training. Copyright © 2017 Elsevier Inc. All rights reserved.

[Robot-assisted and computer-based neurorehabilitation for children: the story behind].

PubMed

Meyer-Heim, Andreas; van Hedel, Hub J A

2014-07-23

Impairments of the central motor system can either be congenital (e. g. cerebral palsy) or acquired (e. g. traumatic brain injury, stroke). These lesions are the most frequent morbidities necessitating neuro-rehabilitative measures in childhood. Robot-assisted rehabilitation in combination with virtual reality can complement conventional therapies and provide a task-specific training, with a high number of repetitions over a prolonged time period. The advantage of virtual reality is that it can provide a real time feedback about the patient's performance. Furthermore, challenging virtual scenarios especially motivate young patients to continue with otherwise monotonous exercises. Preliminary findings indicate that robot-assisted training in children with central motor impairment could be beneficial, but conclusive evidence about its efficacy is still missing.

Validation of a novel virtual reality simulator for robotic surgery.

PubMed

Schreuder, Henk W R; Persson, Jan E U; Wolswijk, Richard G H; Ihse, Ingmar; Schijven, Marlies P; Verheijen, René H M

2014-01-01

With the increase in robotic-assisted laparoscopic surgery there is a concomitant rising demand for training methods. The objective was to establish face and construct validity of a novel virtual reality simulator (dV-Trainer, Mimic Technologies, Seattle, WA) for the use in training of robot-assisted surgery. A comparative cohort study was performed. Participants (n = 42) were divided into three groups according to their robotic experience. To determine construct validity, participants performed three different exercises twice. Performance parameters were measured. To determine face validity, participants filled in a questionnaire after completion of the exercises. Experts outperformed novices in most of the measured parameters. The most discriminative parameters were "time to complete" and "economy of motion" (P < 0.001). The training capacity of the simulator was rated 4.6 ± 0.5 SD on a 5-point Likert scale. The realism of the simulator in general, visual graphics, movements of instruments, interaction with objects, and the depth perception were all rated as being realistic. The simulator is considered to be a very useful training tool for residents and medical specialist starting with robotic surgery. Face and construct validity for the dV-Trainer could be established. The virtual reality simulator is a useful tool for training robotic surgery.

Validation of a Novel Virtual Reality Simulator for Robotic Surgery

PubMed Central

Schreuder, Henk W. R.; Persson, Jan E. U.; Wolswijk, Richard G. H.; Ihse, Ingmar; Schijven, Marlies P.; Verheijen, René H. M.

2014-01-01

Objective. With the increase in robotic-assisted laparoscopic surgery there is a concomitant rising demand for training methods. The objective was to establish face and construct validity of a novel virtual reality simulator (dV-Trainer, Mimic Technologies, Seattle, WA) for the use in training of robot-assisted surgery. Methods. A comparative cohort study was performed. Participants (n = 42) were divided into three groups according to their robotic experience. To determine construct validity, participants performed three different exercises twice. Performance parameters were measured. To determine face validity, participants filled in a questionnaire after completion of the exercises. Results. Experts outperformed novices in most of the measured parameters. The most discriminative parameters were “time to complete” and “economy of motion” (P < 0.001). The training capacity of the simulator was rated 4.6 ± 0.5 SD on a 5-point Likert scale. The realism of the simulator in general, visual graphics, movements of instruments, interaction with objects, and the depth perception were all rated as being realistic. The simulator is considered to be a very useful training tool for residents and medical specialist starting with robotic surgery. Conclusions. Face and construct validity for the dV-Trainer could be established. The virtual reality simulator is a useful tool for training robotic surgery. PMID:24600328

Mastery-Based Virtual Reality Robotic Simulation Curriculum: The First Step Toward Operative Robotic Proficiency.

PubMed

Hogg, Melissa E; Tam, Vernissia; Zenati, Mazen; Novak, Stephanie; Miller, Jennifer; Zureikat, Amer H; Zeh, Herbert J

Hepatobiliary surgery is a highly complex, low-volume specialty with long learning curves necessary to achieve optimal outcomes. This creates significant challenges in both training and measuring surgical proficiency. We hypothesize that a virtual reality curriculum with mastery-based simulation is a valid tool to train fellows toward operative proficiency. This study evaluates the content and predictive validity of robotic simulation curriculum as a first step toward developing a comprehensive, proficiency-based pathway. A mastery-based simulation curriculum was performed in a virtual reality environment. A pretest/posttest experimental design used both virtual reality and inanimate environments to evaluate improvement. Participants self-reported previous robotic experience and assessed the curriculum by rating modules based on difficulty and utility. This study was conducted at the University of Pittsburgh Medical Center (Pittsburgh, PA), a tertiary care academic teaching hospital. A total of 17 surgical oncology fellows enrolled in the curriculum, 16 (94%) completed. Of 16 fellows who completed the curriculum, 4 fellows (25%) achieved mastery on all 24 modules; on average, fellows mastered 86% of the modules. Following curriculum completion, individual test scores improved (p < 0.0001). An average of 2.4 attempts was necessary to master each module (range: 1-17). Median time spent completing the curriculum was 4.2 hours (range: 1.1-6.6). Total 8 (50%) fellows continued practicing modules beyond mastery. Survey results show that "needle driving" and "endowrist 2" modules were perceived as most difficult although "needle driving" modules were most useful. Overall, 15 (94%) fellows perceived improvement in robotic skills after completing the curriculum. In a cohort of board-certified general surgeons who are novices in robotic surgery, a mastery-based simulation curriculum demonstrated internal validity with overall score improvement. Time to complete the curriculum was manageable. Published by Elsevier Inc.

Surgeon Design Interface for Patient-Specific Concentric Tube Robots

PubMed Central

Morimoto, Tania K.; Greer, Joseph D.; Hsieh, Michael H.; Okamura, Allison M.

2017-01-01

Concentric tube robots have potential for use in a wide variety of surgical procedures due to their small size, dexterity, and ability to move in highly curved paths. Unlike most existing clinical robots, the design of these robots can be developed and manufactured on a patient- and procedure-specific basis. The design of concentric tube robots typically requires significant computation and optimization, and it remains unclear how the surgeon should be involved. We propose to use a virtual reality-based design environment for surgeons to easily and intuitively visualize and design a set of concentric tube robots for a specific patient and procedure. In this paper, we describe a novel patient-specific design process in the context of the virtual reality interface. We also show a resulting concentric tube robot design, created by a pediatric urologist to access a kidney stone in a pediatric patient. PMID:28656124

Surgeon Design Interface for Patient-Specific Concentric Tube Robots.

PubMed

Morimoto, Tania K; Greer, Joseph D; Hsieh, Michael H; Okamura, Allison M

2016-06-01

Concentric tube robots have potential for use in a wide variety of surgical procedures due to their small size, dexterity, and ability to move in highly curved paths. Unlike most existing clinical robots, the design of these robots can be developed and manufactured on a patient- and procedure-specific basis. The design of concentric tube robots typically requires significant computation and optimization, and it remains unclear how the surgeon should be involved. We propose to use a virtual reality-based design environment for surgeons to easily and intuitively visualize and design a set of concentric tube robots for a specific patient and procedure. In this paper, we describe a novel patient-specific design process in the context of the virtual reality interface. We also show a resulting concentric tube robot design, created by a pediatric urologist to access a kidney stone in a pediatric patient.

Current state of virtual reality simulation in robotic surgery training: a review.

PubMed

Bric, Justin D; Lumbard, Derek C; Frelich, Matthew J; Gould, Jon C

2016-06-01

Worldwide, the annual number of robotic surgical procedures continues to increase. Robotic surgical skills are unique from those used in either open or laparoscopic surgery. The acquisition of a basic robotic surgical skill set may be best accomplished in the simulation laboratory. We sought to review the current literature pertaining to the use of virtual reality (VR) simulation in the acquisition of robotic surgical skills on the da Vinci Surgical System. A PubMed search was conducted between December 2014 and January 2015 utilizing the following keywords: virtual reality, robotic surgery, da Vinci, da Vinci skills simulator, SimSurgery Educational Platform, Mimic dV-Trainer, and Robotic Surgery Simulator. Articles were included if they were published between 2007 and 2015, utilized VR simulation for the da Vinci Surgical System, and utilized a commercially available VR platform. The initial search criteria returned 227 published articles. After all inclusion and exclusion criteria were applied, a total of 47 peer-reviewed manuscripts were included in the final review. There are many benefits to utilizing VR simulation for robotic skills acquisition. Four commercially available simulators have been demonstrated to be capable of assessing robotic skill. Three of the four simulators demonstrate the ability of a VR training curriculum to improve basic robotic skills, with proficiency-based training being the most effective training style. The skills obtained on a VR training curriculum are comparable with those obtained on dry laboratory simulation. The future of VR simulation includes utilization in assessment for re-credentialing purposes, advanced procedural-based training, and as a warm-up tool prior to surgery.

Combined virtual and real robotic test-bed for single operator control of multiple robots

NASA Astrophysics Data System (ADS)

Lee, Sam Y.-S.; Hunt, Shawn; Cao, Alex; Pandya, Abhilash

2010-04-01

Teams of heterogeneous robots with different dynamics or capabilities could perform a variety of tasks such as multipoint surveillance, cooperative transport and explorations in hazardous environments. In this study, we work with heterogeneous robots of semi-autonomous ground and aerial robots for contaminant localization. We developed a human interface system which linked every real robot to its virtual counterpart. A novel virtual interface has been integrated with Augmented Reality that can monitor the position and sensory information from video feed of ground and aerial robots in the 3D virtual environment, and improve user situational awareness. An operator can efficiently control the real multi-robots using the Drag-to-Move method on the virtual multi-robots. This enables an operator to control groups of heterogeneous robots in a collaborative way for allowing more contaminant sources to be pursued simultaneously. The advanced feature of the virtual interface system is guarded teleoperation. This can be used to prevent operators from accidently driving multiple robots into walls and other objects. Moreover, the feature of the image guidance and tracking is able to reduce operator workload.

Evaluation of robotic cardiac surgery simulation training: A randomized controlled trial.

PubMed

Valdis, Matthew; Chu, Michael W A; Schlachta, Christopher; Kiaii, Bob

2016-06-01

To compare the currently available simulation training modalities used to teach robotic surgery. Forty surgical trainees completed a standardized robotic 10-cm dissection of the internal thoracic artery and placed 3 sutures of a mitral valve annuloplasty in porcine models and were then randomized to a wet lab, a dry lab, a virtual reality lab, or a control group that received no additional training. All groups trained to a level of proficiency determined by 2 expert robotic cardiac surgeons. All assessments were evaluated using the Global Evaluative Assessment of Robotic Skills in a blinded fashion. Wet lab trainees showed the greatest improvement in time-based scoring and the objective scoring tool compared with the experts (mean, 24.9 ± 1.7 vs 24.9 ± 2.6; P = .704). The virtual reality lab improved their scores and met the level of proficiency set by our experts for all primary outcomes (mean, 24.9 ± 1.7 vs 22.8 ± 3.7; P = .103). Only the control group trainees were not able to meet the expert level of proficiency for both time-based scores and the objective scoring tool (mean, 24.9 ± 1.7 vs 11.0 ± 4.5; P < .001). The average duration of training was shortest for the dry lab and longest for the virtual reality simulation (1.6 hours vs 9.3 hours; P < .001). We have completed the first randomized controlled trial to objectively compare the different training modalities of robotic surgery. Our data demonstrate the significant benefits of wet lab and virtual reality robotic simulation training and highlight key differences in current training methods. This study can help guide training programs in investing resources in cost-effective, high-yield simulation exercises. Copyright © 2016 The American Association for Thoracic Surgery. All rights reserved.

The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review.

PubMed

van der Meijden, O A J; Schijven, M P

2009-06-01

Virtual reality (VR) as surgical training tool has become a state-of-the-art technique in training and teaching skills for minimally invasive surgery (MIS). Although intuitively appealing, the true benefits of haptic (VR training) platforms are unknown. Many questions about haptic feedback in the different areas of surgical skills (training) need to be answered before adding costly haptic feedback in VR simulation for MIS training. This study was designed to review the current status and value of haptic feedback in conventional and robot-assisted MIS and training by using virtual reality simulation. A systematic review of the literature was undertaken using PubMed and MEDLINE. The following search terms were used: Haptic feedback OR Haptics OR Force feedback AND/OR Minimal Invasive Surgery AND/OR Minimal Access Surgery AND/OR Robotics AND/OR Robotic Surgery AND/OR Endoscopic Surgery AND/OR Virtual Reality AND/OR Simulation OR Surgical Training/Education. The results were assessed according to level of evidence as reflected by the Oxford Centre of Evidence-based Medicine Levels of Evidence. In the current literature, no firm consensus exists on the importance of haptic feedback in performing minimally invasive surgery. Although the majority of the results show positive assessment of the benefits of force feedback, results are ambivalent and not unanimous on the subject. Benefits are least disputed when related to surgery using robotics, because there is no haptic feedback in currently used robotics. The addition of haptics is believed to reduce surgical errors resulting from a lack of it, especially in knot tying. Little research has been performed in the area of robot-assisted endoscopic surgical training, but results seem promising. Concerning VR training, results indicate that haptic feedback is important during the early phase of psychomotor skill acquisition.

Virtual Presence: One Step Beyond Reality

NASA Technical Reports Server (NTRS)

Budden, Nancy Ann

1997-01-01

Our primary objective was to team up a group consisting of scientists and engineers from two different NASA cultures, and simulate an interactive teleoperated robot conducting geologic field work on the Moon or Mars. The information derived from the experiment will benefit both the robotics team and the planetary exploration team in the areas of robot design and development, and mission planning and analysis. The Earth Sciences and Space and Life Sciences Division combines the past with the future contributing experience from Apollo crews exploring the lunar surface, knowledge of reduced gravity environments, the performance limits of EVA suits, and future goals for human exploration beyond low Earth orbit. The Automation, Robotics. and Simulation Division brings to the table the technical expertise of robotic systems, the future goals of highly interactive robotic capabilities, treading on the edge of technology by joining for the first time a unique combination of telepresence with virtual reality.

Robotics and Virtual Reality for Cultural Heritage Digitization and Fruition

NASA Astrophysics Data System (ADS)

Calisi, D.; Cottefoglie, F.; D'Agostini, L.; Giannone, F.; Nenci, F.; Salonia, P.; Zaratti, M.; Ziparo, V. A.

2017-05-01

In this paper we present our novel approach for acquiring and managing digital models of archaeological sites, and the visualization techniques used to showcase them. In particular, we will demonstrate two technologies: our robotic system for digitization of archaeological sites (DigiRo) result of over three years of efforts by a group of cultural heritage experts, computer scientists and roboticists, and our cloud-based archaeological information system (ARIS). Finally we describe the viewers we developed to inspect and navigate the 3D models: a viewer for the web (ROVINA Web Viewer) and an immersive viewer for Virtual Reality (ROVINA VR Viewer).

Technological advances in robotic-assisted laparoscopic surgery.

PubMed

Tan, Gerald Y; Goel, Raj K; Kaouk, Jihad H; Tewari, Ashutosh K

2009-05-01

In this article, the authors describe the evolution of urologic robotic systems and the current state-of-the-art features and existing limitations of the da Vinci S HD System (Intuitive Surgical, Inc.). They then review promising innovations in scaling down the footprint of robotic platforms, the early experience with mobile miniaturized in vivo robots, advances in endoscopic navigation systems using augmented reality technologies and tracking devices, the emergence of technologies for robotic natural orifice transluminal endoscopic surgery and single-port surgery, advances in flexible robotics and haptics, the development of new virtual reality simulator training platforms compatible with the existing da Vinci system, and recent experiences with remote robotic surgery and telestration.

Virtual reality robotic telesurgery simulations using MEMICA haptic system

NASA Technical Reports Server (NTRS)

Bar-Cohen, Yoseph; Mavroidis, Constantinos; Bouzit, Mourad; Dolgin, Benjamin; Harm, Deborah L.; Kopchok, George E.; White, Rodney

2001-01-01

The authors conceived a haptic mechanism called MEMICA (Remote Mechanical Mirroring using Controlled stiffness and Actuators) that can enable the design of high dexterity, rapid response, and large workspace haptic system. The development of a novel MEMICA gloves and virtual reality models are being explored to allow simulation of telesurgery and other applications. The MEMICA gloves are being designed to provide intuitive mirroring of the conditions at a virtual site where a robot simulates the presence of a human operator. The key components of MEMICA are miniature electrically controlled stiffness (ECS) elements and electrically controlled force and stiffness (ECFS) actuators that are based on the use of Electro-Rheological Fluids (ERF. In this paper the design of the MEMICA system and initial experimental results are presented.

Small-Group Technology-Assisted Instruction: Virtual Teacher and Robot Peer for Individuals with Autism Spectrum Disorder.

PubMed

Saadatzi, Mohammad Nasser; Pennington, Robert C; Welch, Karla C; Graham, James H

2018-06-20

The authors combined virtual reality technology and social robotics to develop a tutoring system that resembled a small-group arrangement. This tutoring system featured a virtual teacher instructing sight words, and included a humanoid robot emulating a peer. The authors used a multiple-probe design across word sets to evaluate the effects of the instructional package on the explicit acquisition and vicarious learning of sight words instructed to three children with autism spectrum disorder (ASD) and the robot peer. Results indicated that participants acquired, maintained, and generalized 100% of the words explicitly instructed to them, made fewer errors while learning the words common between them and the robot peer, and vicariously learned 94% of the words solely instructed to the robot.

Virtual reality surgical simulators- a prerequisite for robotic surgery.

PubMed

Rajanbabu, Anupama; Drudi, Laura; Lau, Susie; Press, Joshua Z; Gotlieb, Walter H

2014-06-01

The field of computer assisted minimally invasive surgery is rapidly expanding worldwide, including in India. With more hospitals in India contemplating the acquisition of a robotic platform, training of robotic surgeons is becoming essential. Virtual reality simulators can be used for surgeons to become acquainted with the robotic console prior to live surgery. Our aim was to evaluate the amount of simulator training required before a surgeon first operates on the da Vinci® Surgical System. Simulations were conducted on the Intuitive Surgical's da Vinci® Robot Skill Simulator using the software obtained from Mimic Technologies. Participants included attending staff surgeons experienced in robotic surgery and novices. A set of seven activities were chosen for each participant. Based on the mean exercise score from the first attempt, staff surgeons outperformed the novices in all exercises. However, the difference in score between the staff and the novices decreased after the participants repeated the exercises and by the sixth attempt most of the novices obtained similar scores to the staff, suggesting that this might be at present the minimum set of repetitions indicated (or required) prior to performing life robotic surgery.

The AMEDD Futures 2039 Project: Phase 2 Final Report

DTIC Science & Technology

2009-06-30

healthcare education. Tools such as virtual reality trainers, robotic trainers, simulations and artificial intelligence will cause self directed and...functions monitoring * robotic arm applies blood to lab-in-the-field chips * robotic self -sustaining energy sources *wireless transmission of...Biotechnology, and Robotics for Far Forward Diagnosis and Treatment of Casualties in Future Warfare – Dr. Cynthia Abbott

Assessing neuro-motor recovery in a stroke survivor with high-resolution EEG, robotics and Virtual Reality.

PubMed

Comani, Silvia; Schinaia, Lorenzo; Tamburro, Gabriella; Velluto, Lucia; Sorbi, Sandro; Conforto, Silvia; Guarnieri, Biancamaria

2015-01-01

One post-stroke patient underwent neuro-motor rehabilitation of one upper limb with a novel system combining a passive robotic device, Virtual Reality training applications and high resolution electroencephalography (HR-EEG). The outcome of the clinical tests and the evaluation of the kinematic parameters recorded with the robotic device concurred to highlight an improved motor recovery of the impaired limb despite the age of the patient, his compromised motor function, and the start of rehabilitation at the 3rd week post stroke. The time frequency and functional source analysis of the HR-EEG signals permitted to quantify the functional changes occurring in the brain in association with the rehabilitation motor tasks, and to highlight the recovery of the neuro-motor function.

Virtual Reality Simulator Systems in Robotic Surgical Training.

PubMed

Mangano, Alberto; Gheza, Federico; Giulianotti, Pier Cristoforo

2018-06-01

The number of robotic surgical procedures has been increasing worldwide. It is important to maximize the cost-effectiveness of robotic surgical training and safely reduce the time needed for trainees to reach proficiency. The use of preliminary lab training in robotic skills is a good strategy for the rapid acquisition of further, standardized robotic skills. Such training can be done either by using a simulator or by exercises in a dry or wet lab. While the use of an actual robotic surgical system for training may be problematic (high cost, lack of availability), virtual reality (VR) simulators can overcome many of these obstacles. However, there is still a lack of standardization. Although VR training systems have improved, they cannot yet replace experience in a wet lab. In particular, simulated scenarios are not yet close enough to a real operative experience. Indeed, there is a difference between technical skills (i.e., mechanical ability to perform a simulated task) and surgical competence (i.e., ability to perform a real surgical operation). Thus, while a VR simulator can replace a dry lab, it cannot yet replace training in a wet lab or operative training in actual patients. However, in the near future, it is expected that VR surgical simulators will be able to provide total reality simulation and replace training in a wet lab. More research is needed to produce more wide-ranging, trans-specialty robotic curricula.

Virtual reality applications in robotic simulations

NASA Technical Reports Server (NTRS)

Homan, David J.; Gott, Charles J.; Goza, S. Michael

1994-01-01

Virtual reality (VR) provides a means to practice integrated extravehicular activities (EVA)/remote manipulator system (RMS) operations in the on-orbit configuration with no discomfort or risk to crewmembers. VR afforded the STS-61 crew the luxury of practicing the integrated EVA/RMS operations in an on-orbit configuration prior to the actual flight. The VR simulation was developed by the Automation and Robotics Division's Telepresence/Virtual Reality Lab and Integrated Graphics, Operations, and Analysis Lab (IGOAL) at JSC. The RMS Part Task Trainer (PTT) was developed by the IGOAL for RMS training in 1988 as a fully functional, kinematic simulation of the shuttle RMS and served as the RMS portion of the integrated VR simulation. Because the EVA crewmember could get a realistic view of the shuttle and payload bay in the VR simulation, he/she could explore different positions and views to determine the best method for performing a specific task, thus greatly increasing the efficiency of use of the neutral buoyancy facilities.

Robot Rocket Rally

NASA Image and Video Library

2014-03-14

CAPE CANAVERAL, Fla. – A visitor to the Robot Rocket Rally tries his hand at virtual reality in a demonstration of the Oculus Rift technology, provided by the Open Source Robotics Foundation. The three-day event at Florida's Kennedy Space Center Visitor Complex is highlighted by exhibits, games and demonstrations of a variety of robots, with exhibitors ranging from school robotics clubs to veteran NASA scientists and engineers. Photo credit: NASA/Kim Shiflett

Virtual Rehabilitation with Children: Challenges for Clinical Adoption [From the Field].

PubMed

Glegg, Stephanie

2017-01-01

Virtual, augmented, and mixed reality environments are increasingly being developed and used to address functional rehabilitation goals related to physical, cognitive, social, and psychological impairments. For example, a child with an acquired brain injury may participate in virtual rehabilitation to address impairments in balance, attention, turn taking, and engagement in therapy. The trend toward virtual rehabilitation first gained momentum with the adoption of commercial off-the-shelf active video gaming consoles (e.g., Nintendo Wii and XBox). Now, we are seeing the rapid emergence of customized rehabilitation-specific systems that integrate technological advances in virtual reality, visual effects, motion tracking, physiological monitoring, and robotics.

STS-61 crew utilizing Virtual Reality in training for HST repair mission

NASA Technical Reports Server (NTRS)

1993-01-01

Astronaut Jeffrey A. Hoffman, one of four crewmembers for STS-61 that will conduct scheduled spacewalks during the flight, wears a special helmet and gloves designed to assist in proper positioning near the telescope while on the end of the robot arm. Crewmembers are utilizing a new virtual reality training aid which assists in refining positioning patterns for Space Shuttle Endeavour's Remote Manipulator System (RMS) (36890); Astronaut Claude Nicollier looks at a computer display of the Shuttle's robot arm movements as Thomas D. Akers and Kathryn C. Thornton, mission specialists look on. Nicollier will be responsible for maneuvering the astronauts while they stand in a foot restraint on the end of the RMS arm (36891,36894); Hoffman wears a special helmet and gloves designed to assist in proper positioning near the telescope while on the end of the robot arm (35892); Nicollier looks at a computer display of the Shuttle's robot arm movements as Akers looks on (36893); While (l-r) Astron

Virtual Reality Robotic Operation Simulations Using MEMICA Haptic System

NASA Technical Reports Server (NTRS)

Bar-Cohen, Y.; Mavroidis, C.; Bouzit, M.; Dolgin, B.; Harm, D. L.; Kopchok, G. E.; White, R.

2000-01-01

There is an increasing realization that some tasks can be performed significantly better by humans than robots but, due to associated hazards, distance, etc., only a robot can be employed. Telemedicine is one area where remotely controlled robots can have a major impact by providing urgent care at remote sites. In recent years, remotely controlled robotics has been greatly advanced. The robotic astronaut, "Robonaut," at NASA Johnson Space Center is one such example. Unfortunately, due to the unavailability of force and tactile feedback capability the operator must determine the required action using only visual feedback from the remote site, which limits the tasks that Robonaut can perform. There is a great need for dexterous, fast, accurate teleoperated robots with the operator?s ability to "feel" the environment at the robot's field. Recently, we conceived a haptic mechanism called MEMICA (Remote MEchanical MIrroring using Controlled stiffness and Actuators) that can enable the design of high dexterity, rapid response, and large workspace system. Our team is developing novel MEMICA gloves and virtual reality models to allow the simulation of telesurgery and other applications. The MEMICA gloves are designed to have a high dexterity, rapid response, and large workspace and intuitively mirror the conditions at a virtual site where a robot is simulating the presence of the human operator. The key components of MEMICA are miniature electrically controlled stiffness (ECS) elements and Electrically Controlled Force and Stiffness (ECFS) actuators that are based on the sue of Electro-Rheological Fluids (ERF). In this paper the design of the MEMICA system and initial experimental results are presented.

Virtual reality and hallucination: a technoetic perspective

NASA Astrophysics Data System (ADS)

Slattery, Diana R.

2008-02-01

Virtual Reality (VR), especially in a technologically focused discourse, is defined by a class of hardware and software, among them head-mounted displays (HMDs), navigation and pointing devices; and stereoscopic imaging. This presentation examines the experiential aspect of VR. Putting "virtual" in front of "reality" modifies the ontological status of a class of experience-that of "reality." Reality has also been modified [by artists, new media theorists, technologists and philosophers] as augmented, mixed, simulated, artificial, layered, and enhanced. Modifications of reality are closely tied to modifications of perception. Media theorist Roy Ascott creates a model of three "VR's": Verifiable Reality, Virtual Reality, and Vegetal (entheogenically induced) Reality. The ways in which we shift our perceptual assumptions, create and verify illusions, and enter "the willing suspension of disbelief" that allows us entry into imaginal worlds is central to the experience of VR worlds, whether those worlds are explicitly representational (robotic manipulations by VR) or explicitly imaginal (VR artistic creations). The early rhetoric surrounding VR was interwoven with psychedelics, a perception amplified by Timothy Leary's presence on the historic SIGGRAPH panel, and the Wall Street Journal's tag of VR as "electronic LSD." This paper discusses the connections-philosophical, social-historical, and psychological-perceptual between these two domains.

Develop virtual joint laboratory for education like distance engineering system for robotic applications

NASA Astrophysics Data System (ADS)

Latinovic, T. S.; Deaconu, S. I.; Latinović, M. T.; Malešević, N.; Barz, C.

2015-06-01

This paper work with a new system that provides distance learning and online training engineers. The purpose of this paper is to develop and provide web-based system for the handling and control of remote devices via the Internet. Remote devices are currently the industry or mobile robots [13]. For future product development machine in the factory will be included in the system. This article also discusses the current use of virtual reality tools in the fields of science and engineering education. One programming tool in particular, virtual reality modeling language (VRML) is presented in the light of its applications and capabilities in the development of computer visualization tool for education. One contribution of this paper is to present the software tools and examples that can encourage educators to develop a virtual reality model to improve teaching in their discipline. [12] This paper aims to introduce a software platform, called VALIP where users can build, share, and manipulate 3D content in cooperation with the interaction processes in a 3D context, while participating hardware and software devices can be physical and / or logical distributed and connected together via the Internet. VALIP the integration of virtual laboratories to appropriate partners; therefore, allowing access to all laboratories in any of the partners in the project. VALIP provides advanced laboratory for training and research within robotics and production engineering, and thus, provides a great laboratory facilities with only having to invest a limited amount of resources at the local level to the partner site.

Extending the Body to Virtual Tools Using a Robotic Surgical Interface: Evidence from the Crossmodal Congruency Task

PubMed Central

Sengül, Ali; van Elk, Michiel; Rognini, Giulio; Aspell, Jane Elizabeth; Bleuler, Hannes; Blanke, Olaf

2012-01-01

The effects of real-world tool use on body or space representations are relatively well established in cognitive neuroscience. Several studies have shown, for example, that active tool use results in a facilitated integration of multisensory information in peripersonal space, i.e. the space directly surrounding the body. However, it remains unknown to what extent similar mechanisms apply to the use of virtual-robotic tools, such as those used in the field of surgical robotics, in which a surgeon may use bimanual haptic interfaces to control a surgery robot at a remote location. This paper presents two experiments in which participants used a haptic handle, originally designed for a commercial surgery robot, to control a virtual tool. The integration of multisensory information related to the virtual-robotic tool was assessed by means of the crossmodal congruency task, in which subjects responded to tactile vibrations applied to their fingers while ignoring visual distractors superimposed on the tip of the virtual-robotic tool. Our results show that active virtual-robotic tool use changes the spatial modulation of the crossmodal congruency effects, comparable to changes in the representation of peripersonal space observed during real-world tool use. Moreover, when the virtual-robotic tools were held in a crossed position, the visual distractors interfered strongly with tactile stimuli that was connected with the hand via the tool, reflecting a remapping of peripersonal space. Such remapping was not only observed when the virtual-robotic tools were actively used (Experiment 1), but also when passively held the tools (Experiment 2). The present study extends earlier findings on the extension of peripersonal space from physical and pointing tools to virtual-robotic tools using techniques from haptics and virtual reality. We discuss our data with respect to learning and human factors in the field of surgical robotics and discuss the use of new technologies in the field of cognitive neuroscience. PMID:23227142

Extending the body to virtual tools using a robotic surgical interface: evidence from the crossmodal congruency task.

PubMed

Sengül, Ali; van Elk, Michiel; Rognini, Giulio; Aspell, Jane Elizabeth; Bleuler, Hannes; Blanke, Olaf

2012-01-01

The effects of real-world tool use on body or space representations are relatively well established in cognitive neuroscience. Several studies have shown, for example, that active tool use results in a facilitated integration of multisensory information in peripersonal space, i.e. the space directly surrounding the body. However, it remains unknown to what extent similar mechanisms apply to the use of virtual-robotic tools, such as those used in the field of surgical robotics, in which a surgeon may use bimanual haptic interfaces to control a surgery robot at a remote location. This paper presents two experiments in which participants used a haptic handle, originally designed for a commercial surgery robot, to control a virtual tool. The integration of multisensory information related to the virtual-robotic tool was assessed by means of the crossmodal congruency task, in which subjects responded to tactile vibrations applied to their fingers while ignoring visual distractors superimposed on the tip of the virtual-robotic tool. Our results show that active virtual-robotic tool use changes the spatial modulation of the crossmodal congruency effects, comparable to changes in the representation of peripersonal space observed during real-world tool use. Moreover, when the virtual-robotic tools were held in a crossed position, the visual distractors interfered strongly with tactile stimuli that was connected with the hand via the tool, reflecting a remapping of peripersonal space. Such remapping was not only observed when the virtual-robotic tools were actively used (Experiment 1), but also when passively held the tools (Experiment 2). The present study extends earlier findings on the extension of peripersonal space from physical and pointing tools to virtual-robotic tools using techniques from haptics and virtual reality. We discuss our data with respect to learning and human factors in the field of surgical robotics and discuss the use of new technologies in the field of cognitive neuroscience.

Can a virtual reality surgical simulation training provide a self-driven and mentor-free skills learning? Investigation of the practical influence of the performance metrics from the virtual reality robotic surgery simulator on the skill learning and associated cognitive workloads.

PubMed

Lee, Gyusung I; Lee, Mija R

2018-01-01

While it is often claimed that virtual reality (VR) training system can offer self-directed and mentor-free skill learning using the system's performance metrics (PM), no studies have yet provided evidence-based confirmation. This experimental study investigated what extent to which trainees achieved their self-learning with a current VR simulator and whether additional mentoring improved skill learning, skill transfer and cognitive workloads in robotic surgery simulation training. Thirty-two surgical trainees were randomly assigned to either the Control-Group (CG) or Experiment-Group (EG). While the CG participants reviewed the PM at their discretion, the EG participants had explanations about PM and instructions on how to improve scores. Each subject completed a 5-week training using four simulation tasks. Pre- and post-training data were collected using both a simulator and robot. Peri-training data were collected after each session. Skill learning, time spent on PM (TPM), and cognitive workloads were compared between groups. After the simulation training, CG showed substantially lower simulation task scores (82.9 ± 6.0) compared with EG (93.2 ± 4.8). Both groups demonstrated improved physical model tasks performance with the actual robot, but the EG had a greater improvement in two tasks. The EG exhibited lower global mental workload/distress, higher engagement, and a better understanding regarding using PM to improve performance. The EG's TPM was initially long but substantially shortened as the group became familiar with PM. Our study demonstrated that the current VR simulator offered limited self-skill learning and additional mentoring still played an important role in improving the robotic surgery simulation training.

Training Surgical Residents With a Haptic Robotic Central Venous Catheterization Simulator.

PubMed

Pepley, David F; Gordon, Adam B; Yovanoff, Mary A; Mirkin, Katelin A; Miller, Scarlett R; Han, David C; Moore, Jason Z

Ultrasound guided central venous catheterization (CVC) is a common surgical procedure with complication rates ranging from 5 to 21 percent. Training is typically performed using manikins that do not simulate anatomical variations such as obesity and abnormal vessel positioning. The goal of this study was to develop and validate the effectiveness of a new virtual reality and force haptic based simulation platform for CVC of the right internal jugular vein. A CVC simulation platform was developed using a haptic robotic arm, 3D position tracker, and computer visualization. The haptic robotic arm simulated needle insertion force that was based on cadaver experiments. The 3D position tracker was used as a mock ultrasound device with realistic visualization on a computer screen. Upon completion of a practice simulation, performance feedback is given to the user through a graphical user interface including scoring factors based on good CVC practice. The effectiveness of the system was evaluated by training 13 first year surgical residents using the virtual reality haptic based training system over a 3 month period. The participants' performance increased from 52% to 96% on the baseline training scenario, approaching the average score of an expert surgeon: 98%. This also resulted in improvement in positive CVC practices including a 61% decrease between final needle tip position and vein center, a decrease in mean insertion attempts from 1.92 to 1.23, and a 12% increase in time spent aspirating the syringe throughout the procedure. A virtual reality haptic robotic simulator for CVC was successfully developed. Surgical residents training on the simulation improved to near expert levels after three robotic training sessions. This suggests that this system could act as an effective training device for CVC. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Current status of robotic simulators in acquisition of robotic surgical skills.

PubMed

Kumar, Anup; Smith, Roger; Patel, Vipul R

2015-03-01

This article provides an overview of the current status of simulator systems in robotic surgery training curriculum, focusing on available simulators for training, their comparison, new technologies introduced in simulation focusing on concepts of training along with existing challenges and future perspectives of simulator training in robotic surgery. The different virtual reality simulators available in the market like dVSS, dVT, RoSS, ProMIS and SEP have shown face, content and construct validity in robotic skills training for novices outside the operating room. Recently, augmented reality simulators like HoST, Maestro AR and RobotiX Mentor have been introduced in robotic training providing a more realistic operating environment, emphasizing more on procedure-specific robotic training . Further, the Xperience Team Trainer, which provides training to console surgeon and bed-side assistant simultaneously, has been recently introduced to emphasize the importance of teamwork and proper coordination. Simulator training holds an important place in current robotic training curriculum of future robotic surgeons. There is a need for more procedure-specific augmented reality simulator training, utilizing advancements in computing and graphical capabilities for new innovations in simulator technology. Further studies are required to establish its cost-benefit ratio along with concurrent and predictive validity.

Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy.

PubMed

Pessaux, Patrick; Diana, Michele; Soler, Luc; Piardi, Tullio; Mutter, Didier; Marescaux, Jacques

2015-04-01

Augmented reality (AR) in surgery consists in the fusion of synthetic computer-generated images (3D virtual model) obtained from medical imaging preoperative workup and real-time patient images in order to visualize unapparent anatomical details. The 3D model could be used for a preoperative planning of the procedure. The potential of AR navigation as a tool to improve safety of the surgical dissection is outlined for robotic hepatectomy. Three patients underwent a fully robotic and AR-assisted hepatic segmentectomy. The 3D virtual anatomical model was obtained using a thoracoabdominal CT scan with a customary software (VR-RENDER®, IRCAD). The model was then processed using a VR-RENDER® plug-in application, the Virtual Surgical Planning (VSP®, IRCAD), to delineate surgical resection planes including the elective ligature of vascular structures. Deformations associated with pneumoperitoneum were also simulated. The virtual model was superimposed to the operative field. A computer scientist manually registered virtual and real images using a video mixer (MX 70; Panasonic, Secaucus, NJ) in real time. Two totally robotic AR segmentectomy V and one segmentectomy VI were performed. AR allowed for the precise and safe recognition of all major vascular structures during the procedure. Total time required to obtain AR was 8 min (range 6-10 min). Each registration (alignment of the vascular anatomy) required a few seconds. Hepatic pedicle clamping was never performed. At the end of the procedure, the remnant liver was correctly vascularized. Resection margins were negative in all cases. The postoperative period was uneventful without perioperative transfusion. AR is a valuable navigation tool which may enhance the ability to achieve safe surgical resection during robotic hepatectomy.

Robotic Surgery Readiness (RSR): A Prospective Randomized Skills Decay Recognition and Prevention Study

DTIC Science & Technology

2017-08-01

Evaluative Assessment of Robotic Skills (GEARS) scoring will be correlated by the Principal Investigator (Dr. Thomas Lendvay - UW) and Co-Investigator (Dr...be evaluated and developed through collaboration with the Intuitive Surgical Consultant (Simon DiMaio, Senior Research Manager). We will deliver...Virtual Reality Simulation Curriculum GEARS - Global Evaluative Assessment of Robotic Skills Surgical Education 6 of 41 3. ACCOMPLISHMENTS: What

Virtual reality and telerobotics applications of an Address Recalculation Pipeline

NASA Technical Reports Server (NTRS)

Regan, Matthew; Pose, Ronald

1994-01-01

The technology described in this paper was designed to reduce latency to user interactions in immersive virtual reality environments. It is also ideally suited to telerobotic applications such as interaction with remote robotic manipulators in space or in deep sea operations. in such circumstances the significant latency is observed response to user stimulus which is due to communications delays, and the disturbing jerkiness due to low and unpredictable frame rates on compressed video user feedback or computationally limited virtual worlds, can be masked by our techniques. The user is provided with highly responsive visual feedback independent of communication or computational delays in providing physical video feedback or in rendering virtual world images. Virtual and physical environments can be combined seamlessly using these techniques.

Virtual Reality Robotic Programming Software in the Technology Classroom

ERIC Educational Resources Information Center

Geissler, Jason; Knott, Patrick J.; Vazquez, Matthew R.; Wright, John R., Jr.

2004-01-01

Robots make a wonderful context for teaching students about many concepts important to technological literacy. They can provide an authentic context and produce high levels of motivation. According to Standards for Technological Literacy: Content for the Study of Technology (STL) (ITEA, 2000, 2002), there are six core concepts that should be…

Framework and Implications of Virtual Neurorobotics

PubMed Central

Goodman, Philip H.; Zou, Quan; Dascalu, Sergiu-Mihai

2008-01-01

Despite decades of societal investment in artificial learning systems, truly “intelligent” systems have yet to be realized. These traditional models are based on input-output pattern optimization and/or cognitive production rule modeling. One response has been social robotics, using the interaction of human and robot to capture important cognitive dynamics such as cooperation and emotion; to date, these systems still incorporate traditional learning algorithms. More recently, investigators are focusing on the core assumptions of the brain “algorithm” itself—trying to replicate uniquely “neuromorphic” dynamics such as action potential spiking and synaptic learning. Only now are large-scale neuromorphic models becoming feasible, due to the availability of powerful supercomputers and an expanding supply of parameters derived from research into the brain's interdependent electrophysiological, metabolomic and genomic networks. Personal computer technology has also led to the acceptance of computer-generated humanoid images, or “avatars”, to represent intelligent actors in virtual realities. In a recent paper, we proposed a method of virtual neurorobotics (VNR) in which the approaches above (social-emotional robotics, neuromorphic brain architectures, and virtual reality projection) are hybridized to rapidly forward-engineer and develop increasingly complex, intrinsically intelligent systems. In this paper, we synthesize our research and related work in the field and provide a framework for VNR, with wider implications for research and practical applications. PMID:18982115

Wearable computer for mobile augmented-reality-based controlling of an intelligent robot

NASA Astrophysics Data System (ADS)

Turunen, Tuukka; Roening, Juha; Ahola, Sami; Pyssysalo, Tino

2000-10-01

An intelligent robot can be utilized to perform tasks that are either hazardous or unpleasant for humans. Such tasks include working in disaster areas or conditions that are, for example, too hot. An intelligent robot can work on its own to some extent, but in some cases the aid of humans will be needed. This requires means for controlling the robot from somewhere else, i.e. teleoperation. Mobile augmented reality can be utilized as a user interface to the environment, as it enhances the user's perception of the situation compared to other interfacing methods and allows the user to perform other tasks while controlling the intelligent robot. Augmented reality is a method that combines virtual objects into the user's perception of the real world. As computer technology evolves, it is possible to build very small devices that have sufficient capabilities for augmented reality applications. We have evaluated the existing wearable computers and mobile augmented reality systems to build a prototype of a future mobile terminal- the CyPhone. A wearable computer with sufficient system resources for applications, wireless communication media with sufficient throughput and enough interfaces for peripherals has been built at the University of Oulu. It is self-sustained in energy, with enough operating time for the applications to be useful, and uses accurate positioning systems.

Using a virtual world for robot planning

NASA Astrophysics Data System (ADS)

Benjamin, D. Paul; Monaco, John V.; Lin, Yixia; Funk, Christopher; Lyons, Damian

2012-06-01

We are building a robot cognitive architecture that constructs a real-time virtual copy of itself and its environment, including people, and uses the model to process perceptual information and to plan its movements. This paper describes the structure of this architecture. The software components of this architecture include PhysX for the virtual world, OpenCV and the Point Cloud Library for visual processing, and the Soar cognitive architecture that controls the perceptual processing and task planning. The RS (Robot Schemas) language is implemented in Soar, providing the ability to reason about concurrency and time. This Soar/RS component controls visual processing, deciding which objects and dynamics to render into PhysX, and the degree of detail required for the task. As the robot runs, its virtual model diverges from physical reality, and errors grow. The Match-Mediated Difference component monitors these errors by comparing the visual data with corresponding data from virtual cameras, and notifies Soar/RS of significant differences, e.g. a new object that appears, or an object that changes direction unexpectedly. Soar/RS can then run PhysX much faster than real-time and search among possible future world paths to plan the robot's actions. We report experimental results in indoor environments.

Hybrid Reality Lab Capabilities - Video 2

NASA Technical Reports Server (NTRS)

Delgado, Francisco J.; Noyes, Matthew

2016-01-01

Our Hybrid Reality and Advanced Operations Lab is developing incredibly realistic and immersive systems that could be used to provide training, support engineering analysis, and augment data collection for various human performance metrics at NASA. To get a better understanding of what Hybrid Reality is, let's go through the two most commonly known types of immersive realities: Virtual Reality, and Augmented Reality. Virtual Reality creates immersive scenes that are completely made up of digital information. This technology has been used to train astronauts at NASA, used during teleoperation of remote assets (arms, rovers, robots, etc.) and other activities. One challenge with Virtual Reality is that if you are using it for real time-applications (like landing an airplane) then the information used to create the virtual scenes can be old (i.e. visualized long after physical objects moved in the scene) and not accurate enough to land the airplane safely. This is where Augmented Reality comes in. Augmented Reality takes real-time environment information (from a camera, or see through window, and places digitally created information into the scene so that it matches with the video/glass information). Augmented Reality enhances real environment information collected with a live sensor or viewport (e.g. camera, window, etc.) with the information-rich visualization provided by Virtual Reality. Hybrid Reality takes Augmented Reality even further, by creating a higher level of immersion where interactivity can take place. Hybrid Reality takes Virtual Reality objects and a trackable, physical representation of those objects, places them in the same coordinate system, and allows people to interact with both objects' representations (virtual and physical) simultaneously. After a short period of adjustment, the individuals begin to interact with all the objects in the scene as if they were real-life objects. The ability to physically touch and interact with digitally created objects that have the same shape, size, location to their physical object counterpart in virtual reality environment can be a game changer when it comes to training, planning, engineering analysis, science, entertainment, etc. Our Project is developing such capabilities for various types of environments. The video outlined with this abstract is a representation of an ISS Hybrid Reality experience. In the video you can see various Hybrid Reality elements that provide immersion beyond just standard Virtual Reality or Augmented Reality.

Training and learning robotic surgery, time for a more structured approach: a systematic review.

PubMed

Schreuder, H W R; Wolswijk, R; Zweemer, R P; Schijven, M P; Verheijen, R H M

2012-01-01

Robotic assisted laparoscopic surgery is growing rapidly and there is an increasing need for a structured approach to train future robotic surgeons. To review the literature on training and learning strategies for robotic assisted laparoscopic surgery. A systematic search of MEDLINE, EMBASE, the Cochrane Library and the Journal of Robotic Surgery was performed. We included articles concerning training, learning, education and teaching of robotic assisted laparoscopic surgery in any specialism. Two authors independently selected articles to be included. We categorised the included articles into: training modalities, learning curve, training future surgeons, curriculum design and implementation. We included 114 full text articles. Training modalities such as didactic training, skills training (dry lab, virtual reality, animal or cadaver models), case observation, bedside assisting, proctoring and the mentoring console can be used for training in robotic assisted laparoscopic surgery. Several training programmes in general and specific programmes designed for residents, fellows and surgeons are described in the literature. We provide guidelines for development of a structured training programme. Robotic surgical training consists of system training and procedural training. System training should be formally organised and should be competence based, instead of time based. Virtual reality training will play an import role in the near future. Procedural training should be organised in a stepwise approach with objective assessment of each step. This review aims to facilitate and improve the implementation of structured robotic surgical training programmes. © 2011 The Authors BJOG An International Journal of Obstetrics and Gynaecology © 2011 RCOG.

[Computerization and robotics in medical practice].

PubMed

Dervaderics, J

1997-10-26

The article gives the outlines of all principles used in computing included the non-electrical and analog computers and the artifical intelligence followed by citing examples as well. The principles and medical utilization of virtual reality are also mentioned. There are discussed: surgical planning, image guided surgery, robotic surgery, telepresence and telesurgery, and telemedicine implemented partially via Internet.

Development and validation of a composite scoring system for robot-assisted surgical training--the Robotic Skills Assessment Score.

PubMed

Chowriappa, Ashirwad J; Shi, Yi; Raza, Syed Johar; Ahmed, Kamran; Stegemann, Andrew; Wilding, Gregory; Kaouk, Jihad; Peabody, James O; Menon, Mani; Hassett, James M; Kesavadas, Thenkurussi; Guru, Khurshid A

2013-12-01

A standardized scoring system does not exist in virtual reality-based assessment metrics to describe safe and crucial surgical skills in robot-assisted surgery. This study aims to develop an assessment score along with its construct validation. All subjects performed key tasks on previously validated Fundamental Skills of Robotic Surgery curriculum, which were recorded, and metrics were stored. After an expert consensus for the purpose of content validation (Delphi), critical safety determining procedural steps were identified from the Fundamental Skills of Robotic Surgery curriculum and a hierarchical task decomposition of multiple parameters using a variety of metrics was used to develop Robotic Skills Assessment Score (RSA-Score). Robotic Skills Assessment mainly focuses on safety in operative field, critical error, economy, bimanual dexterity, and time. Following, the RSA-Score was further evaluated for construct validation and feasibility. Spearman correlation tests performed between tasks using the RSA-Scores indicate no cross correlation. Wilcoxon rank sum tests were performed between the two groups. The proposed RSA-Score was evaluated on non-robotic surgeons (n = 15) and on expert-robotic surgeons (n = 12). The expert group demonstrated significantly better performance on all four tasks in comparison to the novice group. Validation of the RSA-Score in this study was carried out on the Robotic Surgical Simulator. The RSA-Score is a valid scoring system that could be incorporated in any virtual reality-based surgical simulator to achieve standardized assessment of fundamental surgical tents during robot-assisted surgery. Copyright © 2013 Elsevier Inc. All rights reserved.

Renal surgery in the new millennium.

PubMed

Delvecchio, F C; Preminger, G M

2000-11-01

In the not too distant future, the minimally invasive renal surgeon will be able to practice an operation on a difficult case on a three-dimensional virtual reality simulator, providing all attributes of the real procedure. The patient's imaging studies will be imported into the simulator to better mimic particular anatomy. When confident enough of his or her skills, the surgeon will start operating on the patient using the same virtual reality simulator/telepresence surgery console system, which will permit the live surgery to be conducted by robots hundreds of miles away. The robots will manipulate miniature endoscopes or control minimally or noninvasive ablative technologies. Endoscopic/laparoscopic footage of the surgical procedure will be stored digitally in optical disks to be used later in telementoring of a surgery resident. All this and more will be possible in the not so distant third millennium.

Evolution of robotics in surgery and implementing a perioperative robotics nurse specialist role.

PubMed

Francis, Paula

2006-03-01

Use of robotics is expanding rapidly in the medical arena. Not only are a growing number of facilities purchasing robotic systems, but the number of surgeons using them also is increasing, which creates many challenges (eg, cost, training, safety). The evolution of robotics in surgery is presented within the context of virtual reality, telepresence, telemanipulation, and passive (ie, master-slave) robotic surgical systems. A new perioperative nursing role, the robotics nurse specialist, was developed and implemented at one facility. The need for a robotics nurse specialist and how this role can help the entire surgical team promote positive patient and facility outcomes also is discussed.

Virtual reality robotic surgical simulation: an analysis of gynecology trainees.

PubMed

Sheth, Sangini S; Fader, Amanda N; Tergas, Ana I; Kushnir, Christina L; Green, Isabel C

2014-01-01

To analyze the learning curves of gynecology trainees on several virtual reality da Vinci Skills Simulator exercises. Prospective cohort pilot study. Academic hospital-based gynecology training program. Novice robotic surgeons from a gynecology training program. Novice robotic surgeons from an academic gynecology training program completed 10 repetitions of 4 exercises on the da Vinci Skills Simulator: matchboard, ring and rail, suture sponge, and energy switching. Performance metrics measured included time to completion, economy of instrument movement, excessive force, collisions, master workspace range, missed targets, misapplied energy, critical errors, and overall score. Statistical analyses were conducted to define the learning curve for trainees and the optimal number of repetitions for each exercise. A total of 34 participants were enrolled, of which 9 were medical students, 22 were residents, and 3 were fellows. There was a significant improvement in performance between the 1st and 10th repetitions across multiple metrics for all exercises. Senior trainees performed the suture exercise significantly faster than the junior trainees during the first and last repetitions (p = 0.004 and p = 0.003, respectively). However, the performance gap between seniors and juniors narrowed significantly by the 10th repetition. The mean number of repetitions required to achieve performance plateau ranged from 6.4 to 9.3. Virtual reality robotic simulation improves ability through repetition at all levels of training. Further, a performance plateau may exist during a single training session. Larger studies are needed to further define the most high-yield simulator exercises, the ideal number of repetitions, and recommended intervals between training sessions to improve operative performance. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Beaming into the Rat World: Enabling Real-Time Interaction between Rat and Human Each at Their Own Scale

PubMed Central

Normand, Jean-Marie; Sanchez-Vives, Maria V.; Waechter, Christian; Giannopoulos, Elias; Grosswindhager, Bernhard; Spanlang, Bernhard; Guger, Christoph; Klinker, Gudrun; Srinivasan, Mandayam A.; Slater, Mel

2012-01-01

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human’s movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale. PMID:23118987

Beaming into the rat world: enabling real-time interaction between rat and human each at their own scale.

PubMed

Normand, Jean-Marie; Sanchez-Vives, Maria V; Waechter, Christian; Giannopoulos, Elias; Grosswindhager, Bernhard; Spanlang, Bernhard; Guger, Christoph; Klinker, Gudrun; Srinivasan, Mandayam A; Slater, Mel

2012-01-01

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human's movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale.

Towards multi-platform software architecture for Collaborative Teleoperation

NASA Astrophysics Data System (ADS)

Domingues, Christophe; Otmane, Samir; Davesne, Frederic; Mallem, Malik

2009-03-01

Augmented Reality (AR) can provide to a Human Operator (HO) a real help in achieving complex tasks, such as remote control of robots and cooperative teleassistance. Using appropriate augmentations, the HO can interact faster, safer and easier with the remote real world. In this paper, we present an extension of an existing distributed software and network architecture for collaborative teleoperation based on networked human-scaled mixed reality and mobile platform. The first teleoperation system was composed by a VR application and a Web application. However the 2 systems cannot be used together and it is impossible to control a distant robot simultaneously. Our goal is to update the teleoperation system to permit a heterogeneous collaborative teleoperation between the 2 platforms. An important feature of this interface is based on the use of different Virtual Reality platforms and different Mobile platforms to control one or many robots.

Stereoscopic, Force-Feedback Trainer For Telerobot Operators

NASA Technical Reports Server (NTRS)

Kim, Won S.; Schenker, Paul S.; Bejczy, Antal K.

1994-01-01

Computer-controlled simulator for training technicians to operate remote robots provides both visual and kinesthetic virtual reality. Used during initial stage of training; saves time and expense, increases operational safety, and prevents damage to robots by inexperienced operators. Computes virtual contact forces and torques of compliant robot in real time, providing operator with feel of forces experienced by manipulator as well as view in any of three modes: single view, two split views, or stereoscopic view. From keyboard, user specifies force-reflection gain and stiffness of manipulator hand for three translational and three rotational axes. System offers two simulated telerobotic tasks: insertion of peg in hole in three dimensions, and removal and insertion of drawer.

Virtual university applied to telesurgery: from teleeducation to telemanipulation.

PubMed

Marescaux, J; Soler, L; Mutter, D; Leroy, J; Vix, M; Koehl, C; Clément, J M

2000-01-01

PROBLEM/BACKGROUND: In order to improve patient care by minimal invasive surgery (MIS), we perfected a Virtual TeleSurgical University that allows for teleeducation, teleconcertation, surgical planning and telemanipulation, through new Virtual Reality and multimedia systems. The organization of this innovative school was federated around three major research programs. First, the TESUS program focused on the teletransmission of medical information, allowing for videoconferencing around the world and telementoring. Next, the WeBS-Surg program is a multimedia continuous surgical education system on internet, that allows for teleeducation and teleconcertation between world experts in MIS. Then, the MASTER program (Minimal Access Surgery by Telecommunications and Robotics) allowed the development of the third millenium Operating room. It included Virtual Reality systems that delineate automatically anatomical and pathological structures of a patients from him CT-scan, and that allow for an interactive surgical planning and force-feed-back simulation. It also included a telesurgical robot named Zeus controlled by surgeons through telemanipulation system. Tests and validation shows that all these systems improved all steps of the surgical procedure: preoperatively due to a better continuous education and a computer assisted surgical planning, and peroperatively due to teleconcertation, telementoring and telemanipulation systems. Revolutionary tools for minimal invasive surgery learning, planning and performing are all ready available. These tools represents the first prototype of the computer assisted tele-robotical surgery that will be the future of surgery.

Haptic/graphic rehabilitation: integrating a robot into a virtual environment library and applying it to stroke therapy.

PubMed

Sharp, Ian; Patton, James; Listenberger, Molly; Case, Emily

2011-08-08

Recent research that tests interactive devices for prolonged therapy practice has revealed new prospects for robotics combined with graphical and other forms of biofeedback. Previous human-robot interactive systems have required different software commands to be implemented for each robot leading to unnecessary developmental overhead time each time a new system becomes available. For example, when a haptic/graphic virtual reality environment has been coded for one specific robot to provide haptic feedback, that specific robot would not be able to be traded for another robot without recoding the program. However, recent efforts in the open source community have proposed a wrapper class approach that can elicit nearly identical responses regardless of the robot used. The result can lead researchers across the globe to perform similar experiments using shared code. Therefore modular "switching out"of one robot for another would not affect development time. In this paper, we outline the successful creation and implementation of a wrapper class for one robot into the open-source H3DAPI, which integrates the software commands most commonly used by all robots.

Surface matching for correlation of virtual models: Theory and application

NASA Technical Reports Server (NTRS)

Caracciolo, Roberto; Fanton, Francesco; Gasparetto, Alessandro

1994-01-01

Virtual reality can enable a robot user to off line generate and test in a virtual environment a sequence of operations to be executed by the robot in an assembly cell. Virtual models of objects are to be correlated to the real entities they represent by means of a suitable transformation. A solution to the correlation problem, which is basically a problem of 3-dimensional adjusting, has been found exploiting the surface matching theory. An iterative algorithm has been developed, which matches the geometric surface representing the shape of the virtual model of an object, with a set of points measured on the surface in the real world. A peculiar feature of the algorithm is to work also if there is no one-to-one correspondence between the measured points and those representing the surface model. Furthermore the problem of avoiding convergence to local minima is solved, by defining a starting point of states ensuring convergence to the global minimum. The developed algorithm has been tested by simulation. Finally, this paper proposes a specific application, i.e., correlating a robot cell, equipped for biomedical use with its virtual representation.

Virtual reality applied to teletesting

NASA Astrophysics Data System (ADS)

van den Berg, Thomas J.; Smeenk, Roland J. M.; Mazy, Alain; Jacques, Patrick; Arguello, Luis; Mills, Simon

2003-05-01

The activity "Virtual Reality applied to Teletesting" is related to a wider European Space Agency (ESA) initiative of cost reduction, in particular the reduction of test costs. Reduction of costs of space related projects have to be performed on test centre operating costs and customer company costs. This can accomplished by increasing the automation and remote testing ("teletesting") capabilities of the test centre. Main problems related to teletesting are a lack of situational awareness and the separation of control over the test environment. The objective of the activity is to evaluate the use of distributed computing and Virtual Reality technology to support the teletesting of a payload under vacuum conditions, and to provide a unified man-machine interface for the monitoring and control of payload, vacuum chamber and robotics equipment. The activity includes the development and testing of a "Virtual Reality Teletesting System" (VRTS). The VRTS is deployed at one of the ESA certified test centres to perform an evaluation and test campaign using a real payload. The VRTS is entirely written in the Java programming language, using the J2EE application model. The Graphical User Interface runs as an applet in a Web browser, enabling easy access from virtually any place.

Haptic feedback in OP:Sense - augmented reality in telemanipulated robotic surgery.

PubMed

Beyl, T; Nicolai, P; Mönnich, H; Raczkowksy, J; Wörn, H

2012-01-01

In current research, haptic feedback in robot assisted interventions plays an important role. However most approaches to haptic feedback only regard the mapping of the current forces at the surgical instrument to the haptic input devices, whereas surgeons demand a combination of medical imaging and telemanipulated robotic setups. In this paper we describe how this feature is integrated in our robotic research platform OP:Sense. The proposed method allows the automatic transfer of segmented imaging data to the haptic renderer and therefore allows enriching the haptic feedback with virtual fixtures based on imaging data. Anatomical structures are extracted from pre-operative generated medical images or virtual walls are defined by the surgeon inside the imaging data. Combining real forces with virtual fixtures can guide the surgeon to the regions of interest as well as helps to prevent the risk of damage to critical structures inside the patient. We believe that the combination of medical imaging and telemanipulation is a crucial step for the next generation of MIRS-systems.

Technology 2004, Vol. 2

NASA Technical Reports Server (NTRS)

1995-01-01

Proceedings from symposia of the Technology 2004 Conference, November 8-10, 1994, Washington, DC. Volume 2 features papers on computers and software, virtual reality simulation, environmental technology, video and imaging, medical technology and life sciences, robotics and artificial intelligence, and electronics.

Special Feature: Teaching about High Tech.

ERIC Educational Resources Information Center

Kopf, Michael; And Others

1992-01-01

Includes four articles: "Virtual Reality" (Kopf), description of its uses in computer-assisted design, architecture, and technical training; "SME (Society of Manufacturing Engineers) Robotics Contest Opens Doors to Future" (Wagner); "Superconductivity" (Canady), description of classroom demonstrations and experiments;…

Clinical effectiveness of combined virtual reality and robot assisted fine hand motion rehabilitation in subacute stroke patients.

PubMed

Huang, Xianwei; Naghdy, Fazel; Naghdy, Golshah; Du, Haiping

2017-07-01

Robot-assisted therapy is regarded as an effective and reliable method for the delivery of highly repetitive rehabilitation training in restoring motor skills after a stroke. This study focuses on the rehabilitation of fine hand motion skills due to their vital role in performing delicate activities of daily living (ADL) tasks. The proposed rehabilitation system combines an adaptive assist-as-needed (AAN) control algorithm and a Virtual Reality (VR) based rehabilitation gaming system (RGS). The developed system is described and its effectiveness is validated through clinical trials on a group of eight subacute stroke patients for a period of six weeks. The impact of the training is verified through standard clinical evaluation methods and measuring key kinematic parameters. A comparison of the pre- and post-training results indicates that the method proposed in this study can improve fine hand motion rehabilitation training effectiveness.

A decade of telerobotics in rehabilitation: Demonstrated utility blocked by the high cost of manipulation and the complexity of the user interface

NASA Technical Reports Server (NTRS)

Leifer, Larry; Michalowski, Stefan; Vanderloos, Machiel

1991-01-01

The Stanford/VA Interactive Robotics Laboratory set out in 1978 to test the hypothesis that industrial robotics technology could be applied to serve the manipulation needs of severely impaired individuals. Five generations of hardware, three generations of system software, and over 125 experimental subjects later, we believe that genuine utility is achievable. The experience includes development of over 65 task applications using voiced command, joystick control, natural language command and 3D object designation technology. A brief foray into virtual environments, using flight simulator technology, was instructive. If reality and virtuality come for comparable prices, you cannot beat reality. A detailed review of assistive robot anatomy and the performance specifications needed to achieve cost/beneficial utility will be used to support discussion of the future of rehabilitation telerobotics. Poised on the threshold of commercial viability, but constrained by the high cost of technically adequate manipulators, this worthy application domain flounders temporarily. In the long run, it will be the user interface that governs utility.

Sensor supervision and multiagent commanding by means of projective virtual reality

NASA Astrophysics Data System (ADS)

Rossmann, Juergen

1998-10-01

When autonomous systems with multiple agents are considered, conventional control- and supervision technologies are often inadequate because the amount of information available is often presented in a way that the user is effectively overwhelmed by the displayed data. New virtual reality (VR) techniques can help to cope with this problem, because VR offers the chance to convey information in an intuitive manner and can combine supervision capabilities and new, intuitive approaches to the control of autonomous systems. In the approach taken, control and supervision issues were equally stressed and finally led to the new ideas and the general framework for Projective Virtual Reality. The key idea of this new approach for an intuitively operable man machine interface for decentrally controlled multi-agent systems is to let the user act in the virtual world, detect the changes and have an action planning component automatically generate task descriptions for the agents involved to project actions that have been carried out by users in the virtual world into the physical world, e.g. with the help of robots. Thus the Projective Virtual Reality approach is to split the job between the task deduction in the VR and the task `projection' onto the physical automation components by the automatic action planning component. Besides describing the realized projective virtual reality system, the paper will also describe in detail the metaphors and visualization aids used to present different types of (e.g. sensor-) information in an intuitively comprehensible manner.

Army Logistician. Volume 38, Issue 6, November-December 2006

DTIC Science & Technology

2006-12-01

functioning electrically, magnetically, or thermally; or performing self -diagnosis and self - healing actions)—will offer extraordinary capabilities for...receives sufficient information about a remote, real-world site (a battlefield) through a machine (a robot ) so that the user feels physically present at...collaborative planning. • Improved training and education because of ad- vances in virtual reality environments and perception capabilities. Robots have been

Robotic gait training in multiple sclerosis rehabilitation: Can virtual reality make the difference? Findings from a randomized controlled trial.

PubMed

Calabrò, Rocco Salvatore; Russo, Margherita; Naro, Antonino; De Luca, Rosaria; Leo, Antonino; Tomasello, Provvidenza; Molonia, Francesco; Dattola, Vincenzo; Bramanti, Alessia; Bramanti, Placido

2017-06-15

Gait, coordination, and balance may be severely compromised in patients with multiple sclerosis (MS), with considerable consequences on the patient's daily living activities, psychological status and quality of life. For this reason, MS patients may benefit from robotic-rehabilitation and virtual reality training sessions. Aim of the present study was to assess the efficacy of robot-assisted gait training (RAGT) equipped with virtual reality (VR) system in MS patients with walking disabilities (EDSS 4.0 to 5.5) as compared to RAGT without VR. We enrolled 40 patients (randomized into two groups) undergoing forty RAGT±VR sessions over eight weeks. All the patients were assessed at baseline and at the end of the treatment by using specific scales. Effect sizes were very small and non-significant between the groups for Berg Balance Scale (-0.019, CI95% -2.403 to 2.365) and TUG (-0.064, 95%CI -0.408 to 0.536) favoring RAGT+VR. Effects were moderate-to-large and significant for positive attitude (-0.505, 95%CI -3.615 to 2.604) and problem-solving (-0.905, 95%CI -2.113 to 0.302) sub-items of Coping Orientation to Problem Experienced, thus largely favoring RAGT+VR. Our findings show that RAGT combined with VR is an effective therapeutic option in MS patients with walking disability as compared to RAGT without VR. We may hypothesize that VR may strengthen RAGT thanks to the entrainment of different brain areas involved in motor panning and learning. Copyright © 2017 Elsevier B.V. All rights reserved.

Magnetosensitive e-skins with directional perception for augmented reality

PubMed Central

Cañón Bermúdez, Gilbert Santiago; Karnaushenko, Dmitriy D.; Karnaushenko, Daniil; Lebanov, Ana; Bischoff, Lothar; Kaltenbrunner, Martin; Fassbender, Jürgen; Schmidt, Oliver G.; Makarov, Denys

2018-01-01

Electronic skins equipped with artificial receptors are able to extend our perception beyond the modalities that have naturally evolved. These synthetic receptors offer complimentary information on our surroundings and endow us with novel means of manipulating physical or even virtual objects. We realize highly compliant magnetosensitive skins with directional perception that enable magnetic cognition, body position tracking, and touchless object manipulation. Transfer printing of eight high-performance spin valve sensors arranged into two Wheatstone bridges onto 1.7-μm-thick polyimide foils ensures mechanical imperceptibility. This resembles a new class of interactive devices extracting information from the surroundings through magnetic tags. We demonstrate this concept in augmented reality systems with virtual knob-turning functions and the operation of virtual dialing pads, based on the interaction with magnetic fields. This technology will enable a cornucopia of applications from navigation, motion tracking in robotics, regenerative medicine, and sports and gaming to interaction in supplemented reality. PMID:29376121

A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery.

PubMed

Moglia, Andrea; Ferrari, Vincenzo; Morelli, Luca; Ferrari, Mauro; Mosca, Franco; Cuschieri, Alfred

2016-06-01

No single large published randomized controlled trial (RCT) has confirmed the efficacy of virtual simulators in the acquisition of skills to the standard required for safe clinical robotic surgery. This remains the main obstacle for the adoption of these virtual simulators in surgical residency curricula. To evaluate the level of evidence in published studies on the efficacy of training on virtual simulators for robotic surgery. In April 2015 a literature search was conducted on PubMed, Web of Science, Scopus, Cochrane Library, the Clinical Trials Database (US) and the Meta Register of Controlled Trials. All publications were scrutinized for relevance to the review and for assessment of the levels of evidence provided using the classification developed by the Oxford Centre for Evidence-Based Medicine. The publications included in the review consisted of one RCT and 28 cohort studies on validity, and seven RCTs and two cohort studies on skills transfer from virtual simulators to robot-assisted surgery. Simulators were rated good for realism (face validity) and for usefulness as a training tool (content validity). However, the studies included used various simulation training methodologies, limiting the assessment of construct validity. The review confirms the absence of any consensus on which tasks and metrics are the most effective for the da Vinci Skills Simulator and dV-Trainer, the most widely investigated systems. Although there is consensus for the RoSS simulator, this is based on only two studies on construct validity involving four exercises. One study on initial evaluation of an augmented reality module for partial nephrectomy using the dV-Trainer reported high correlation (r=0.8) between in vivo porcine nephrectomy and a virtual renorrhaphy task according to the overall Global Evaluation Assessment of Robotic Surgery (GEARS) score. In one RCT on skills transfer, the experimental group outperformed the control group, with a significant difference in overall GEARS score (p=0.012) during performance of urethrovesical anastomosis on an inanimate model. Only one study included assessment of a surgical procedure on real patients: subjects trained on a virtual simulator outperformed the control group following traditional training. However, besides the small numbers, this study was not randomized. There is an urgent need for a large, well-designed, preferably multicenter RCT to study the efficacy of virtual simulation for acquisition competence in and safe execution of clinical robotic-assisted surgery. We reviewed the literature on virtual simulators for robot-assisted surgery. Validity studies used various simulation training methodologies. It is not clear which exercises and metrics are the most effective in distinguishing different levels of experience on the da Vinci robot. There is no reported evidence of skills transfer from simulation to clinical surgery on real patients. Copyright © 2015 European Association of Urology. Published by Elsevier B.V. All rights reserved.

Competency based training in robotic surgery: benchmark scores for virtual reality robotic simulation.

PubMed

Raison, Nicholas; Ahmed, Kamran; Fossati, Nicola; Buffi, Nicolò; Mottrie, Alexandre; Dasgupta, Prokar; Van Der Poel, Henk

2017-05-01

To develop benchmark scores of competency for use within a competency based virtual reality (VR) robotic training curriculum. This longitudinal, observational study analysed results from nine European Association of Urology hands-on-training courses in VR simulation. In all, 223 participants ranging from novice to expert robotic surgeons completed 1565 exercises. Competency was set at 75% of the mean expert score. Benchmark scores for all general performance metrics generated by the simulator were calculated. Assessment exercises were selected by expert consensus and through learning-curve analysis. Three basic skill and two advanced skill exercises were identified. Benchmark scores based on expert performance offered viable targets for novice and intermediate trainees in robotic surgery. Novice participants met the competency standards for most basic skill exercises; however, advanced exercises were significantly more challenging. Intermediate participants performed better across the seven metrics but still did not achieve the benchmark standard in the more difficult exercises. Benchmark scores derived from expert performances offer relevant and challenging scores for trainees to achieve during VR simulation training. Objective feedback allows both participants and trainers to monitor educational progress and ensures that training remains effective. Furthermore, the well-defined goals set through benchmarking offer clear targets for trainees and enable training to move to a more efficient competency based curriculum. © 2016 The Authors BJU International © 2016 BJU International Published by John Wiley & Sons Ltd.

Evolving a Neural Olfactorimotor System in Virtual and Real Olfactory Environments

PubMed Central

Rhodes, Paul A.; Anderson, Todd O.

2012-01-01

To provide a platform to enable the study of simulated olfactory circuitry in context, we have integrated a simulated neural olfactorimotor system with a virtual world which simulates both computational fluid dynamics as well as a robotic agent capable of exploring the simulated plumes. A number of the elements which we developed for this purpose have not, to our knowledge, been previously assembled into an integrated system, including: control of a simulated agent by a neural olfactorimotor system; continuous interaction between the simulated robot and the virtual plume; the inclusion of multiple distinct odorant plumes and background odor; the systematic use of artificial evolution driven by olfactorimotor performance (e.g., time to locate a plume source) to specify parameter values; the incorporation of the realities of an imperfect physical robot using a hybrid model where a physical robot encounters a simulated plume. We close by describing ongoing work toward engineering a high dimensional, reversible, low power electronic olfactory sensor which will allow olfactorimotor neural circuitry evolved in the virtual world to control an autonomous olfactory robot in the physical world. The platform described here is intended to better test theories of olfactory circuit function, as well as provide robust odor source localization in realistic environments. PMID:23112772

Validity evidence for procedural competency in virtual reality robotic simulation, establishing a credible pass/fail standard for the vaginal cuff closure procedure.

PubMed

Hovgaard, Lisette Hvid; Andersen, Steven Arild Wuyts; Konge, Lars; Dalsgaard, Torur; Larsen, Christian Rifbjerg

2018-03-30

The use of robotic surgery for minimally invasive procedures has increased considerably over the last decade. Robotic surgery has potential advantages compared to laparoscopic surgery but also requires new skills. Using virtual reality (VR) simulation to facilitate the acquisition of these new skills could potentially benefit training of robotic surgical skills and also be a crucial step in developing a robotic surgical training curriculum. The study's objective was to establish validity evidence for a simulation-based test for procedural competency for the vaginal cuff closure procedure that can be used in a future simulation-based, mastery learning training curriculum. Eleven novice gynaecological surgeons without prior robotic experience and 11 experienced gynaecological robotic surgeons (> 30 robotic procedures) were recruited. After familiarization with the VR simulator, participants completed the module 'Guided Vaginal Cuff Closure' six times. Validity evidence was investigated for 18 preselected simulator metrics. The internal consistency was assessed using Cronbach's alpha and a composite score was calculated based on metrics with significant discriminative ability between the two groups. Finally, a pass/fail standard was established using the contrasting groups' method. The experienced surgeons significantly outperformed the novice surgeons on 6 of the 18 metrics. The internal consistency was 0.58 (Cronbach's alpha). The experienced surgeons' mean composite score for all six repetitions were significantly better than the novice surgeons' (76.1 vs. 63.0, respectively, p < 0.001). A pass/fail standard of 75/100 was established. Four novice surgeons passed this standard (false positives) and three experienced surgeons failed (false negatives). Our study has gathered validity evidence for a simulation-based test for procedural robotic surgical competency in the vaginal cuff closure procedure and established a credible pass/fail standard for future proficiency-based training.

Urology residents experience comparable workload profiles when performing live porcine nephrectomies and robotic surgery virtual reality training modules.

PubMed

Mouraviev, Vladimir; Klein, Martina; Schommer, Eric; Thiel, David D; Samavedi, Srinivas; Kumar, Anup; Leveillee, Raymond J; Thomas, Raju; Pow-Sang, Julio M; Su, Li-Ming; Mui, Engy; Smith, Roger; Patel, Vipul

2016-03-01

In pursuit of improving the quality of residents' education, the Southeastern Section of the American Urological Association (SES AUA) hosts an annual robotic training course for its residents. The workshop involves performing a robotic live porcine nephrectomy as well as virtual reality robotic training modules. The aim of this study was to evaluate workload levels of urology residents when performing a live porcine nephrectomy and the virtual reality robotic surgery training modules employed during this workshop. Twenty-one residents from 14 SES AUA programs participated in 2015. On the first-day residents were taught with didactic lectures by faculty. On the second day, trainees were divided into two groups. Half were asked to perform training modules of the Mimic da Vinci-Trainer (MdVT, Mimic Technologies, Inc., Seattle, WA, USA) for 4 h, while the other half performed nephrectomy procedures on a live porcine model using the da Vinci Si robot (Intuitive Surgical Inc., Sunnyvale, CA, USA). After the first 4 h the groups changed places for another 4-h session. All trainees were asked to complete the NASA-TLX 1-page questionnaire following both the MdVT simulation and live animal model sessions. A significant interface and TLX interaction was observed. The interface by TLX interaction was further analyzed to determine whether the scores of each of the six TLX scales varied across the two interfaces. The means of the TLX scores observed at the two interfaces were similar. The only significant difference was observed for frustration, which was significantly higher at the simulation than the animal model, t (20) = 4.12, p = 0.001. This could be due to trainees' familiarity with live anatomical structures over skill set simulations which remain a real challenge to novice surgeons. Another reason might be that the simulator provides performance metrics for specific performance traits as well as composite scores for entire exercises. Novice trainees experienced substantial mental workload while performing tasks on both the simulator and the live animal model during the robotics course. The NASA-TLX profiles demonstrated that the live animal model and the MdVT were similar in difficulty, as indicated by their comparable workload profiles.

An instrumented glove for grasp specification in virtual-reality-based point-and-direct telerobotics.

PubMed

Yun, M H; Cannon, D; Freivalds, A; Thomas, G

1997-10-01

Hand posture and force, which define aspects of the way an object is grasped, are features of robotic manipulation. A means for specifying these grasping "flavors" has been developed that uses an instrumented glove equipped with joint and force sensors. The new grasp specification system will be used at the Pennsylvania State University (Penn State) in a Virtual Reality based Point-and-Direct (VR-PAD) robotics implementation. Here, an operator gives directives to a robot in the same natural way that human may direct another. Phrases such as "put that there" cause the robot to define a grasping strategy and motion strategy to complete the task on its own. In the VR-PAD concept, pointing is done using virtual tools such that an operator can appear to graphically grasp real items in live video. Rather than requiring full duplication of forces and kinesthetic movement throughout a task as is required in manual telemanipulation, hand posture and force are now specified only once. The grasp parameters then become object flavors. The robot maintains the specified force and hand posture flavors for an object throughout the task in handling the real workpiece or item of interest. In the Computer integrated Manufacturing (CIM) Laboratory at Penn State, hand posture and force data were collected for manipulating bricks and other items that require varying amounts of force at multiple pressure points. The feasibility of measuring desired grasp characteristics was demonstrated for a modified Cyberglove impregnated with Force-Sensitive Resistor (FSR) (pressure sensors in the fingertips. A joint/force model relating the parameters of finger articulation and pressure to various lifting tasks was validated for the instrumented "wired" glove. Operators using such a modified glove may ultimately be able to configure robot grasping tasks in environments involving hazardous waste remediation, flexible manufacturing, space operations and other flexible robotics applications. In each case, the VR-PAD approach will finesse the computational and delay problems of real-time multiple-degree-of-freedom force feedback telemanipulation.

An over-view of robot assisted surgery curricula and the status of their validation.

PubMed

Fisher, Rebecca A; Dasgupta, Prokar; Mottrie, Alex; Volpe, Alessandro; Khan, Mohammed S; Challacombe, Ben; Ahmed, Kamran

2015-01-01

Robotic surgery is a rapidly expanding field. Thus far training for robotic techniques has been unstructured and the requirements are variable across various regions. Several projects are currently underway to develop a robotic surgery curriculum and are in various stages of validation. We aimed to outline the structures of available curricula, their process of development, validation status and current utilization. We undertook a literature review of papers including the MeSH terms "Robotics" and "Education". When we had an overview of curricula in development, we searched recent conference abstracts to gain up to date information. The main curricula are the FRS, the FSRS, the Canadian BSTC and the ERUS initiative. They are in various stages of validation and offer a mixture of theoretical and practical training, using both physical and simulated models. Whilst the FSRS is based on tasks on the RoSS virtual reality simulator, FRS and BSTC are designed for use on simulators and the robot itself. The ERUS curricula benefits from a combination of dry lab, wet lab and virtual reality components, which may allow skills to be more transferable to the OR as tasks are completed in several formats. Finally, the ERUS curricula includes the OR modular training programme as table assistant and console surgeon. Curricula are a crucial step in global standardisation of training and certification of surgeons for robotic surgical procedures. Many curricula are in early stages of development and more work is needed in development and validation of these programmes before training can be standardised. Copyright © 2014 Surgical Associates Ltd. Published by Elsevier Ltd. All rights reserved.

Proficiency training on a virtual reality robotic surgical skills curriculum.

PubMed

Bric, Justin; Connolly, Michael; Kastenmeier, Andrew; Goldblatt, Matthew; Gould, Jon C

2014-12-01

The clinical application of robotic surgery is increasing. The skills necessary to perform robotic surgery are unique from those required in open and laparoscopic surgery. A validated laparoscopic surgical skills curriculum (Fundamentals of Laparoscopic Surgery or FLS™) has transformed the way surgeons acquire laparoscopic skills. There is a need for a similar skills training and assessment tool for robotic surgery. Our research group previously developed and validated a robotic training curriculum in a virtual reality (VR) simulator. We hypothesized that novice robotic surgeons could achieve proficiency levels defined by more experienced robotic surgeons on the VR robotic curriculum, and that this would result in improved performance on the actual daVinci Surgical System™. 25 medical students with no prior robotic surgery experience were recruited. Prior to VR training, subjects performed 2 FLS tasks 3 times each (Peg Transfer, Intracorporeal Knot Tying) using the daVinci Surgical System™ docked to a video trainer box. Task performance for the FLS tasks was scored objectively. Subjects then practiced on the VR simulator (daVinci Skills Simulator) until proficiency levels on all 5 tasks were achieved before completing a post-training assessment of the 2 FLS tasks on the daVinci Surgical System™ in the video trainer box. All subjects to complete the study (1 dropped out) reached proficiency levels on all VR tasks in an average of 71 (± 21.7) attempts, accumulating 164.3 (± 55.7) minutes of console training time. There was a significant improvement in performance on the robotic FLS tasks following completion of the VR training curriculum. Novice robotic surgeons are able to attain proficiency levels on a VR simulator. This leads to improved performance in the daVinci surgical platform on simulated tasks. Training to proficiency on a VR robotic surgery simulator is an efficient and viable method for acquiring robotic surgical skills.

A geometric method for computing ocular kinematics and classifying gaze events using monocular remote eye tracking in a robotic environment.

PubMed

Singh, Tarkeshwar; Perry, Christopher M; Herter, Troy M

2016-01-26

Robotic and virtual-reality systems offer tremendous potential for improving assessment and rehabilitation of neurological disorders affecting the upper extremity. A key feature of these systems is that visual stimuli are often presented within the same workspace as the hands (i.e., peripersonal space). Integrating video-based remote eye tracking with robotic and virtual-reality systems can provide an additional tool for investigating how cognitive processes influence visuomotor learning and rehabilitation of the upper extremity. However, remote eye tracking systems typically compute ocular kinematics by assuming eye movements are made in a plane with constant depth (e.g. frontal plane). When visual stimuli are presented at variable depths (e.g. transverse plane), eye movements have a vergence component that may influence reliable detection of gaze events (fixations, smooth pursuits and saccades). To our knowledge, there are no available methods to classify gaze events in the transverse plane for monocular remote eye tracking systems. Here we present a geometrical method to compute ocular kinematics from a monocular remote eye tracking system when visual stimuli are presented in the transverse plane. We then use the obtained kinematics to compute velocity-based thresholds that allow us to accurately identify onsets and offsets of fixations, saccades and smooth pursuits. Finally, we validate our algorithm by comparing the gaze events computed by the algorithm with those obtained from the eye-tracking software and manual digitization. Within the transverse plane, our algorithm reliably differentiates saccades from fixations (static visual stimuli) and smooth pursuits from saccades and fixations when visual stimuli are dynamic. The proposed methods provide advancements for examining eye movements in robotic and virtual-reality systems. Our methods can also be used with other video-based or tablet-based systems in which eye movements are performed in a peripersonal plane with variable depth.

Augmented reality system

NASA Astrophysics Data System (ADS)

Lin, Chien-Liang; Su, Yu-Zheng; Hung, Min-Wei; Huang, Kuo-Cheng

2010-08-01

In recent years, Augmented Reality (AR)[1][2][3] is very popular in universities and research organizations. The AR technology has been widely used in Virtual Reality (VR) fields, such as sophisticated weapons, flight vehicle development, data model visualization, virtual training, entertainment and arts. AR has characteristics to enhance the display output as a real environment with specific user interactive functions or specific object recognitions. It can be use in medical treatment, anatomy training, precision instrument casting, warplane guidance, engineering and distance robot control. AR has a lot of vantages than VR. This system developed combines sensors, software and imaging algorithms to make users feel real, actual and existing. Imaging algorithms include gray level method, image binarization method, and white balance method in order to make accurate image recognition and overcome the effects of light.

[Image fusion, virtual reality, robotics and navigation. Effects on surgical practice].

PubMed

Maresceaux, J; Soler, L; Ceulemans, R; Garcia, A; Henri, M; Dutson, E

2002-05-01

In the new minimally invasive surgical era, virtual reality, robotics, and image merging have become topics on their own, offering the potential to revolutionize current surgical treatment and assessment. Improved patient care in the digital age seems to be the primary impetus for continued efforts in the field of telesurgery. The progress in endoscopic surgery with regard to telesurgery is manifested by digitization of the pre-, intra-, and postoperative interaction with the patients' surgical disease via computer system integration: so-called Computer Assisted Surgery (CAS). The preoperative assessment can be improved by 3D organ reconstruction, as in virtual colonoscopy or cholangiography, and by planning and practicing surgery using virtual or simulated organs. When integrating all of the data recorded during this preoperative stage, an enhanced reality can be made possible to improve intra-operative patient interactions. CAS allows for increased three-dimensional accuracy, improved precision and the reproducibility of procedures. The ability to store the actions of the surgeon as digitized information also allows for universal, rapid distribution: i.e., the surgeon's activity can be transmitted to the other side of the operating room or to a remote site via high-speed communications links, as was recently demonstrated by our own team during the Lindbergh operation. Furthermore, the surgeon will be able to share his expertise and skill through teleconsultation and telemanipulation, bringing the patient closer to the expert surgical team through electronic means and opening the way to advanced and continuous surgical learning. Finally, for postoperative interaction, virtual reality and simulation can provide us with 4 dimensional images, time being the fourth dimension. This should allow physicians to have a better idea of the disease process in evolution, and treatment modifications based on this view can be anticipated. We are presently determining the accuracy and efficacy of 4 dimensional imaging compared to conventional evaluations.

Surgical robotics in otolaryngology: expanding the technology envelope.

PubMed

Gourin, Christine G; Terris, David J

2004-06-01

Surgical robotics arose as an extension of virtual reality and robotic technology developed by the United States Department of Defense. Current surgical robotic systems have been used to perform a variety of minimally invasive surgical procedures. The Food and Drug Administration recently granted approval for the clinical use of two surgical robotic systems. Laboratory and clinical experience suggests that the use of surgical robotics is associated with some distinct advantages and disadvantages when compared with conventional open procedures. Robotic surgery has recently been described in the head and neck, and as a result the otolaryngologist should have a basic understanding of the potential applications of surgical robotics in head and neck surgery. Surgical robotic technology is evolving but appears to have a distinct place in the surgical armamentarium.

Computer assisted surgery with 3D robot models and visualisation of the telesurgical action.

PubMed

Rovetta, A

2000-01-01

This paper deals with the support of virtual reality computer action in the procedures of surgical robotics. Computer support gives a direct representation of the surgical theatre. The modelization of the procedure in course and in development gives a psychological reaction towards safety and reliability. Robots similar to the ones used by the manufacturing industry can be used with little modification as very effective surgical tools. They have high precision, repeatability and are versatile in integrating with the medical instrumentation. Now integrated surgical rooms, with computer and robot-assisted intervention, are operating. The computer is the element for a decision taking aid, and the robot works as a very effective tool.

Validation of Robotic Surgery Simulator (RoSS).

PubMed

Kesavadas, Thenkurussi; Stegemann, Andrew; Sathyaseelan, Gughan; Chowriappa, Ashirwad; Srimathveeravalli, Govindarajan; Seixas-Mikelus, Stéfanie; Chandrasekhar, Rameella; Wilding, Gregory; Guru, Khurshid

2011-01-01

Recent growth of daVinci Robotic Surgical System as a minimally invasive surgery tool has led to a call for better training of future surgeons. In this paper, a new virtual reality simulator, called RoSS is presented. Initial results from two studies - face and content validity, are very encouraging. 90% of the cohort of expert robotic surgeons felt that the simulator was excellent or somewhat close to the touch and feel of the daVinci console. Content validity of the simulator received 90% approval in some cases. These studies demonstrate that RoSS has the potential of becoming an important training tool for the daVinci surgical robot.

Position versus force control: using the 2-DOF robotic ankle trainer to assess ankle's motor control.

PubMed

Farjadian, Amir B; Nabian, Mohsen; Hartman, Amber; Corsino, Johnathan; Mavroidis, Constantinos; Holden, Maureen K

2014-01-01

An estimated of 2,000,000 acute ankle sprains occur annually in the United States. Furthermore, ankle disabilities are caused by neurological impairments such as traumatic brain injury, cerebral palsy and stroke. The virtually interfaced robotic ankle and balance trainer (vi-RABT) was introduced as a cost-effective platform-based rehabilitation robot to improve overall ankle/balance strength, mobility and control. The system is equipped with 2 degrees of freedom (2-DOF) controlled actuation along with complete means of angle and torque measurement mechanisms. Vi-RABT was used to assess ankle strength, flexibility and motor control in healthy human subjects, while playing interactive virtual reality games on the screen. The results suggest that in the task with 2-DOF, subjects have better control over ankle's position vs. force.

Utility fog: A universal physical substance

NASA Technical Reports Server (NTRS)

Hall, J. Storrs

1993-01-01

Active, polymorphic material ('Utility Fog') can be designed as a conglomeration of 100-micron robotic cells ('foglets'). Such robots could be built with the techniques of molecular nanotechnology. Controllers with processing capabilities of 1000 MIPS per cubic micron, and electric motors with power densities of one milliwatt per cubic micron are assumed. Utility Fog should be capable of simulating most everyday materials, dynamically changing its form and properties, and forms a substrate for an integrated virtual reality and telerobotics.

Control of a Supernumerary Robotic Hand by Foot: An Experimental Study in Virtual Reality

PubMed Central

Abdi, Elahe; Burdet, Etienne; Bouri, Mohamed; Bleuler, Hannes

2015-01-01

In the operational theater, the surgical team could highly benefit from a robotic supplementary hand under the surgeon’s full control. The surgeon may so become more autonomous; this may reduce communication errors with the assistants and take over difficult tasks such as holding tools without tremor. In this paper, we therefore examine the possibility to control a third robotic hand with one foot’s movements. Three experiments in virtual reality were designed to assess the feasibility of this control strategy, the learning curve of the subjects in different tasks and the coordination of foot movements with the two natural hands. Results show that the limbs are moved simultaneously, in parallel rather than serially. Participants’ performance improved within a few minutes of practice without any specific difficulty to complete the tasks. Subjective assessment by the subjects indicated that controlling a third hand by foot has been easy and required only negligible physical and mental efforts. The sense of ownership was reported to improve through the experiments. The mental burden was not directly related to the level of motion required by a task, but depended on the type of activity and practice. The most difficult task was moving two hands and foot in opposite directions. These results suggest that a combination of practice and appropriate tasks can enhance the learning process for controlling a robotic hand by foot. PMID:26225938

[A new concept in digestive surgery: the computer assisted surgical procedure, from virtual reality to telemanipulation].

PubMed

Marescaux, J; Clément, J M; Nord, M; Russier, Y; Tassetti, V; Mutter, D; Cotin, S; Ayache, N

1997-11-01

Surgical simulation increasingly appears to be an essential aspect of tomorrow's surgery. The development of a hepatic surgery simulator is an advanced concept calling for a new writing system which will transform the medical world: virtual reality. Virtual reality extends the perception of our five senses by representing more than the real state of things by the means of computer sciences and robotics. It consists of three concepts: immersion, navigation and interaction. Three reasons have led us to develop this simulator: the first is to provide the surgeon with a comprehensive visualisation of the organ. The second reason is to allow for planning and surgical simulation that could be compared with the detailed flight-plan for a commercial jet pilot. The third lies in the fact that virtual reality is an integrated part of the concept of computer assisted surgical procedure. The project consists of a sophisticated simulator which has to include five requirements: visual fidelity, interactivity, physical properties, physiological properties, sensory input and output. In this report we will describe how to get a realistic 3D model of the liver from bi-dimensional 2D medical images for anatomical and surgical training. The introduction of a tumor and the consequent planning and virtual resection is also described, as are force feedback and real-time interaction.

Robotic/virtual reality intervention program individualized to meet the specific sensorimotor impairments of an individual patient: a case study.

PubMed

Fluet, Gerard G; Merians, Alma S; Qiu, Qinyin; Saleh, Soha; Ruano, Viviana; Delmonico, Andrea R; Adamovich, Sergei V

2014-09-01

A majority of studies examining repetitive task practice facilitated by robots for the treatment of upper extremity paresis utilize standardized protocols applied to large groups. This study will describe a virtually simulated, robot-based intervention customized to match the goals and clinical presentation of a gentleman with upper extremity hemiparesis secondary to stroke. MP, the subject of this case, is an 85-year-old man with left hemiparesis secondary to an intracerebral hemorrhage 5 years prior to examination. Outcomes were measured before and after a 1-month period of home therapy and after a 1-month virtually simulated, robotic intervention. The intervention was designed to address specific impairments identified during his PT examination. When necessary, activities were modified based on MP's response to his first week of treatment. MP's home training program produced a 3-s decline in Wolf Motor Function Test (WMFT) time and a 5-s improvement in Jebsen Test of Hand Function (JTHF) time. He demonstrated an additional 35-s improvement in JTHF and an additional 44-s improvement in WMFT subsequent to the robotic training intervention. A 24-h activity measurement and the Hand and Activities of Daily Living scales of the Stroke Impact Scale improved following the robotic intervention. Based on his responses to training we feel that we have established that a customized program of virtually simulated, robotically facilitated rehabilitation was feasible and resulted in larger improvements than an intensive home training program in several measurements of upper extremity function in our patient with chronic hemiparesis.

Towards multi-platform software architecture for Collaborative Teleoperation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Domingues, Christophe; Otmane, Samir; Davesne, Frederic

2009-03-05

Augmented Reality (AR) can provide to a Human Operator (HO) a real help in achieving complex tasks, such as remote control of robots and cooperative teleassistance. Using appropriate augmentations, the HO can interact faster, safer and easier with the remote real world. In this paper, we present an extension of an existing distributed software and network architecture for collaborative teleoperation based on networked human-scaled mixed reality and mobile platform. The first teleoperation system was composed by a VR application and a Web application. However the 2 systems cannot be used together and it is impossible to control a distant robotmore » simultaneously. Our goal is to update the teleoperation system to permit a heterogeneous collaborative teleoperation between the 2 platforms. An important feature of this interface is based on the use of different Virtual Reality platforms and different Mobile platforms to control one or many robots.« less

Intuitive operability evaluation of surgical robot using brain activity measurement to determine immersive reality.

PubMed

Miura, Satoshi; Kobayashi, Yo; Kawamura, Kazuya; Seki, Masatoshi; Nakashima, Yasutaka; Noguchi, Takehiko; Kasuya, Masahiro; Yokoo, Yuki; Fujie, Masakatsu G

2012-01-01

Surgical robots have improved considerably in recent years, but intuitive operability, which represents user inter-operability, has not been quantitatively evaluated. Therefore, for design of a robot with intuitive operability, we propose a method to measure brain activity to determine intuitive operability. The objective of this paper is to determine the master configuration against the monitor that allows users to perceive the manipulator as part of their own body. We assume that the master configuration produces an immersive reality experience for the user of putting his own arm into the monitor. In our experiments, as subjects controlled the hand controller to position the tip of the virtual slave manipulator on a target in a surgical simulator, we measured brain activity through brain-imaging devices. We performed our experiments for a variety of master manipulator configurations with the monitor position fixed. For all test subjects, we found that brain activity was stimulated significantly when the master manipulator was located behind the monitor. We conclude that this master configuration produces immersive reality through the body image, which is related to visual and somatic sense feedback.

Virtual reality for health care: a survey.

PubMed

Moline, J

1997-01-01

This report surveys the state of the art in applications of virtual environments and related technologies for health care. Applications of these technologies are being developed for health care in the following areas: surgical procedures (remote surgery or telepresence, augmented or enhanced surgery, and planning and simulation of procedures before surgery); medical therapy; preventive medicine and patient education; medical education and training; visualization of massive medical databases; skill enhancement and rehabilitation; and architectural design for health-care facilities. To date, such applications have improved the quality of health care, and in the future they will result in substantial cost savings. Tools that respond to the needs of present virtual environment systems are being refined or developed. However, additional large-scale research is necessary in the following areas: user studies, use of robots for telepresence procedures, enhanced system reality, and improved system functionality.

Technology 2003: The Fourth National Technology Transfer Conference and Exposition, volume 2

NASA Technical Reports Server (NTRS)

Hackett, Michael (Compiler)

1994-01-01

Proceedings from symposia of the Technology 2003 Conference and Exposition, Dec. 7-9, 1993, Anaheim, CA, are presented. Volume 2 features papers on artificial intelligence, CAD&E, computer hardware, computer software, information management, photonics, robotics, test and measurement, video and imaging, and virtual reality/simulation.

RoboLab and virtual environments

NASA Technical Reports Server (NTRS)

Giarratano, Joseph C.

1994-01-01

A useful adjunct to the manned space station would be a self-contained free-flying laboratory (RoboLab). This laboratory would have a robot operated under telepresence from the space station or ground. Long duration experiments aboard RoboLab could be performed by astronauts or scientists using telepresence to operate equipment and perform experiments. Operating the lab by telepresence would eliminate the need for life support such as food, water and air. The robot would be capable of motion in three dimensions, have binocular vision TV cameras, and two arms with manipulators to simulate hands. The robot would move along a two-dimensional grid and have a rotating, telescoping periscope section for extension in the third dimension. The remote operator would wear a virtual reality type headset to allow the superposition of computer displays over the real-time video of the lab. The operators would wear exoskeleton type arms to facilitate the movement of objects and equipment operation. The combination of video displays, motion, and the exoskeleton arms would provide a high degree of telepresence, especially for novice users such as scientists doing short-term experiments. The RoboLab could be resupplied and samples removed on other space shuttle flights. A self-contained RoboLab module would be designed to fit within the cargo bay of the space shuttle. Different modules could be designed for specific applications, i.e., crystal-growing, medicine, life sciences, chemistry, etc. This paper describes a RoboLab simulation using virtual reality (VR). VR provides an ideal simulation of telepresence before the actual robot and laboratory modules are constructed. The easy simulation of different telepresence designs will produce a highly optimum design before construction rather than the more expensive and time consuming hardware changes afterwards.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hayes, Birchard P; Michel, Kelly D; Few, Douglas A

From stereophonic, positional sound to high-definition imagery that is crisp and clean, high fidelity computer graphics enhance our view, insight, and intuition regarding our environments and conditions. Contemporary 3-D modeling tools offer an open architecture framework that enables integration with other technologically innovative arenas. One innovation of great interest is Augmented Reality, the merging of virtual, digital environments with physical, real-world environments creating a mixed reality where relevant data and information augments the real or actual experience in real-time by spatial or semantic context. Pairing 3-D virtual immersive models with a dynamic platform such as semi-autonomous robotics or personnel odometrymore » systems to create a mixed reality offers a new and innovative design information verification inspection capability, evaluation accuracy, and information gathering capability for nuclear facilities. Our paper discusses the integration of two innovative technologies, 3-D visualizations with inertial positioning systems, and the resulting augmented reality offered to the human inspector. The discussion in the paper includes an exploration of human and non-human (surrogate) inspections of a nuclear facility, integrated safeguards knowledge within a synchronized virtual model operated, or worn, by a human inspector, and the anticipated benefits to safeguards evaluations of facility operations.« less

Virtual Reality for Artificial Intelligence: human-centered simulation for social science.

PubMed

Cipresso, Pietro; Riva, Giuseppe

2015-01-01

There is a long last tradition in Artificial Intelligence as use of Robots endowing human peculiarities, from a cognitive and emotional point of view, and not only in shape. Today Artificial Intelligence is more oriented to several form of collective intelligence, also building robot simulators (hardware or software) to deeply understand collective behaviors in human beings and society as a whole. Modeling has also been crucial in the social sciences, to understand how complex systems can arise from simple rules. However, while engineers' simulations can be performed in the physical world using robots, for social scientist this is impossible. For decades, researchers tried to improve simulations by endowing artificial agents with simple and complex rules that emulated human behavior also by using artificial intelligence (AI). To include human beings and their real intelligence within artificial societies is now the big challenge. We present an hybrid (human-artificial) platform where experiments can be performed by simulated artificial worlds in the following manner: 1) agents' behaviors are regulated by the behaviors shown in Virtual Reality involving real human beings exposed to specific situations to simulate, and 2) technology transfers these rules into the artificial world. These form a closed-loop of real behaviors inserted into artificial agents, which can be used to study real society.

Fire training in a virtual-reality environment

NASA Astrophysics Data System (ADS)

Freund, Eckhard; Rossmann, Jurgen; Bucken, Arno

2005-03-01

Although fire is very common in our daily environment - as a source of energy at home or as a tool in industry - most people cannot estimate the danger of a conflagration. Therefore it is important to train people in combating fire. Beneath training with propane simulators or real fires and real extinguishers, fire training can be performed in virtual reality, which means a pollution-free and fast way of training. In this paper we describe how to enhance a virtual-reality environment with a real-time fire simulation and visualisation in order to establish a realistic emergency-training system. The presented approach supports extinguishing of the virtual fire including recordable performance data as needed in teletraining environments. We will show how to get realistic impressions of fire using advanced particle-simulation and how to use the advantages of particles to trigger states in a modified cellular automata used for the simulation of fire-behaviour. Using particle systems that interact with cellular automata it is possible to simulate a developing, spreading fire and its reaction on different extinguishing agents like water, CO2 or oxygen. The methods proposed in this paper have been implemented and successfully tested on Cosimir, a commercial robot-and VR-simulation-system.

Examining validity evidence for a simulation-based assessment tool for basic robotic surgical skills.

PubMed

Havemann, Maria Cecilie; Dalsgaard, Torur; Sørensen, Jette Led; Røssaak, Kristin; Brisling, Steffen; Mosgaard, Berit Jul; Høgdall, Claus; Bjerrum, Flemming

2018-05-14

Increasing focus on patient safety makes it important to ensure surgical competency among surgeons before operating on patients. The objective was to gather validity evidence for a virtual-reality simulator test for robotic surgical skills and evaluate its potential as a training tool. Surgeons with varying experience in robotic surgery were recruited: novices (zero procedures), intermediates (1-50), experienced (> 50). Five experienced surgeons rated five exercises on the da Vinci Skills Simulator. Participants were tested using the five exercises. Participants were invited back 3 times and completed a total of 10 attempts per exercise. The outcome was the average simulator performance score for the 5 exercises. 32 participants from 5 surgical specialties were included. 38 participants completed all 4 sessions. A moderate correlation between the average total score and robotic experience was identified for the first attempt (Spearman r = 0.58; p = 0.0004). A difference in average total score was observed between novices and intermediates [median score 61% (IQR 52-66) vs. 83% (IQR 75-91), adjusted p < 0.0001], as well as novices and experienced [median score 61% (IQR 52-66) vs. 80 (IQR 69-85), adjusted p = 0.002]. All three groups improved their performance between the 1st and 10th attempts (p < 0.00). This study describes validity evidence for a virtual-reality simulator for basic robotic surgical skills, which can be used for assessment of basic competency and as a training tool. However, more validity evidence is needed before it can be used for certification or high-stakes assessment.

Innovative Technology-Based Interventions for Autism Spectrum Disorders: A Meta-Analysis

ERIC Educational Resources Information Center

Grynszpan, Ouriel; Weiss, Patrice L.; Perez-Diaz, Fernando; Gal, Eynat

2014-01-01

This article reports the results of a meta-analysis of technology-based intervention studies for children with autism spectrum disorders. We conducted a systematic review of research that used a pre-post design to assess innovative technology interventions, including computer programs, virtual reality, and robotics. The selected studies provided…

Virtual Reality to control active participation in a subacute stroke patient during robot-assisted gait training.

PubMed

Bergmann, J; Krewer, C; Müller, F; Koenig, A; Riener, R

2011-01-01

Virtual Reality (VR) provides a promising medium to enrich robot assisted rehabilitation. VR applications present the opportunity to engage patients in therapy and control participation. The aim of this study was to investigate two strategies to control active participation of a stroke patient focusing on the involvement of the paretic leg in task solution. A subacute stroke patient with a severe hemiparesis performed two experiments on the driven gait orthosis Lokomat. Patient activity was quantified by weighted interaction torques measured in both legs (experiment A) and the paretic leg only (experiment B). The patient was able to successfully implement both the bilateral and unilateral control modality. Both control modes increased the motor output of the paretic leg, however the paretic leg control mode resulted in a much more differentiated regulation of the activity in the leg. Both control modes are appropriate approaches to enhance active participation and increase motor output in the paretic leg. Further research should evaluate the therapeutic benefit of patients with hemiparesis using the unilateral control mode depending on the severity of their impairment. © 2011 IEEE

Innovative technology-based interventions for autism spectrum disorders: a meta-analysis.

PubMed

Grynszpan, Ouriel; Weiss, Patrice L Tamar; Perez-Diaz, Fernando; Gal, Eynat

2014-05-01

This article reports the results of a meta-analysis of technology-based intervention studies for children with autism spectrum disorders. We conducted a systematic review of research that used a pre-post design to assess innovative technology interventions, including computer programs, virtual reality, and robotics. The selected studies provided interventions via a desktop computer, interactive DVD, shared active surface, and virtual reality. None employed robotics. The results provide evidence for the overall effectiveness of technology-based training. The overall mean effect size for posttests of controlled studies of children with autism spectrum disorders who received technology-based interventions was significantly different from zero and approached the medium magnitude, d = 0.47 (confidence interval: 0.08-0.86). The influence of age and IQ was not significant. Differences in training procedures are discussed in the light of the negative correlation that was found between the intervention durations and the studies' effect sizes. The results of this meta-analysis provide support for the continuing development, evaluation, and clinical usage of technology-based intervention for individuals with autism spectrum disorders.

A virtual reality-based method of decreasing transmission time of visual feedback for a tele-operative robotic catheter operating system.

PubMed

Guo, Jin; Guo, Shuxiang; Tamiya, Takashi; Hirata, Hideyuki; Ishihara, Hidenori

2016-03-01

An Internet-based tele-operative robotic catheter operating system was designed for vascular interventional surgery, to afford unskilled surgeons the opportunity to learn basic catheter/guidewire skills, while allowing experienced physicians to perform surgeries cooperatively. Remote surgical procedures, limited by variable transmission times for visual feedback, have been associated with deterioration in operability and vascular wall damage during surgery. At the patient's location, the catheter shape/position was detected in real time and converted into three-dimensional coordinates in a world coordinate system. At the operation location, the catheter shape was reconstructed in a virtual-reality environment, based on the coordinates received. The data volume reduction significantly reduced visual feedback transmission times. Remote transmission experiments, conducted over inter-country distances, demonstrated the improved performance of the proposed prototype. The maximum error for the catheter shape reconstruction was 0.93 mm and the transmission time was reduced considerably. The results were positive and demonstrate the feasibility of remote surgery using conventional network infrastructures. Copyright © 2015 John Wiley & Sons, Ltd.

VEVI: A Virtual Reality Tool For Robotic Planetary Explorations

NASA Technical Reports Server (NTRS)

Piguet, Laurent; Fong, Terry; Hine, Butler; Hontalas, Phil; Nygren, Erik

1994-01-01

The Virtual Environment Vehicle Interface (VEVI), developed by the NASA Ames Research Center's Intelligent Mechanisms Group, is a modular operator interface for direct teleoperation and supervisory control of robotic vehicles. Virtual environments enable the efficient display and visualization of complex data. This characteristic allows operators to perceive and control complex systems in a natural fashion, utilizing the highly-evolved human sensory system. VEVI utilizes real-time, interactive, 3D graphics and position / orientation sensors to produce a range of interface modalities from the flat panel (windowed or stereoscopic) screen displays to head mounted/head-tracking stereo displays. The interface provides generic video control capability and has been used to control wheeled, legged, air bearing, and underwater vehicles in a variety of different environments. VEVI was designed and implemented to be modular, distributed and easily operated through long-distance communication links, using a communication paradigm called SYNERGY.

STS-88 crew use simulators and virtual reality in preflight training

NASA Image and Video Library

1998-04-08

S98-05075 (8 Apr. 1998) --- Astronaut Nancy J. Currie, assigned as a mission specialist for the mission, uses hardware in the virtual reality lab at the Johnson Space Center (JSC) to train for her duties aboard the Space Shuttle Endeavour. This type computer interface paired with virtual reality training hardware for the assigned space-walking astronauts -- in this case, Jerry L. Ross and James H. Newman -- helps to prepare the entire team for dealing with International Space Station (ISS) elements. One of those elements will be the Functional Cargo Block (FGB), which will have been launched a couple of weeks prior to STS-88. Once the FGB is captured using the Remote Manipulator System (RMS) of the Endeavour, Currie will maneuver the robot arm to dock the FGB to the conical mating adapter at the top of Node 1, to be carried in the Endeavour?s cargo bay. In ensuing days, three Extravehicular Activity?s (EVA) by Ross and Newman will be performed to make power, data and utility connections between the two modules.

Comprehensive modelling and simulation of cylindrical nanoparticles manipulation by using a virtual reality environment.

PubMed

Korayem, Moharam Habibnejad; Hoshiar, Ali Kafash; Ghofrani, Maedeh

2017-08-01

With the expansion of nanotechnology, robots based on atomic force microscope (AFM) have been widely used as effective tools for displacing nanoparticles and constructing nanostructures. One of the most limiting factors in AFM-based manipulation procedures is the inability of simultaneously observing the controlled pushing and displacing of nanoparticles while performing the operation. To deal with this limitation, a virtual reality environment has been used in this paper for observing the manipulation operation. In the simulations performed in this paper, first, the images acquired by the atomic force microscope have been processed and the positions and dimensions of nanoparticles have been determined. Then, by dynamically modelling the transfer of nanoparticles and simulating the critical force-time diagrams, a controlled displacement of nanoparticles has been accomplished. The simulations have been further developed for the use of rectangular, V-shape and dagger-shape cantilevers. The established virtual reality environment has made it possible to simulate the manipulation of biological particles in a liquid medium. Copyright © 2017 Elsevier Inc. All rights reserved.

The virtual reality simulator dV-Trainer(®) is a valid assessment tool for robotic surgical skills.

PubMed

Perrenot, Cyril; Perez, Manuela; Tran, Nguyen; Jehl, Jean-Philippe; Felblinger, Jacques; Bresler, Laurent; Hubert, Jacques

2012-09-01

Exponential development of minimally invasive techniques, such as robotic-assisted devices, raises the question of how to assess robotic surgery skills. Early development of virtual simulators has provided efficient tools for laparoscopic skills certification based on objective scoring, high availability, and lower cost. However, similar evaluation is lacking for robotic training. The purpose of this study was to assess several criteria, such as reliability, face, content, construct, and concurrent validity of a new virtual robotic surgery simulator. This prospective study was conducted from December 2009 to April 2010 using three simulators dV-Trainers(®) (MIMIC Technologies(®)) and one Da Vinci S(®) (Intuitive Surgical(®)). Seventy-five subjects, divided into five groups according to their initial surgical training, were evaluated based on five representative exercises of robotic specific skills: 3D perception, clutching, visual force feedback, EndoWrist(®) manipulation, and camera control. Analysis was extracted from (1) questionnaires (realism and interest), (2) automatically generated data from simulators, and (3) subjective scoring by two experts of depersonalized videos of similar exercises with robot. Face and content validity were generally considered high (77 %). Five levels of ability were clearly identified by the simulator (ANOVA; p = 0.0024). There was a strong correlation between automatic data from dV-Trainer and subjective evaluation with robot (r = 0.822). Reliability of scoring was high (r = 0.851). The most relevant criteria were time and economy of motion. The most relevant exercises were Pick and Place and Ring and Rail. The dV-Trainer(®) simulator proves to be a valid tool to assess basic skills of robotic surgery.

Sign Language Recognition and Translation: A Multidisciplined Approach from the Field of Artificial Intelligence

ERIC Educational Resources Information Center

Parton, Becky Sue

2006-01-01

In recent years, research has progressed steadily in regard to the use of computers to recognize and render sign language. This paper reviews significant projects in the field beginning with finger-spelling hands such as "Ralph" (robotics), CyberGloves (virtual reality sensors to capture isolated and continuous signs), camera-based…

Virtual reality robotic surgery warm-up improves task performance in a dry laboratory environment: a prospective randomized controlled study.

PubMed

Lendvay, Thomas S; Brand, Timothy C; White, Lee; Kowalewski, Timothy; Jonnadula, Saikiran; Mercer, Laina D; Khorsand, Derek; Andros, Justin; Hannaford, Blake; Satava, Richard M

2013-06-01

Preoperative simulation warm-up has been shown to improve performance and reduce errors in novice and experienced surgeons, yet existing studies have only investigated conventional laparoscopy. We hypothesized that a brief virtual reality (VR) robotic warm-up would enhance robotic task performance and reduce errors. In a 2-center randomized trial, 51 residents and experienced minimally invasive surgery faculty in General Surgery, Urology, and Gynecology underwent a validated robotic surgery proficiency curriculum on a VR robotic simulator and on the da Vinci surgical robot (Intuitive Surgical Inc). Once they successfully achieved performance benchmarks, surgeons were randomized to either receive a 3- to 5-minute VR simulator warm-up or read a leisure book for 10 minutes before performing similar and dissimilar (intracorporeal suturing) robotic surgery tasks. The primary outcomes compared were task time, tool path length, economy of motion, technical, and cognitive errors. Task time (-29.29 seconds, p = 0.001; 95% CI, -47.03 to -11.56), path length (-79.87 mm; p = 0.014; 95% CI, -144.48 to -15.25), and cognitive errors were reduced in the warm-up group compared with the control group for similar tasks. Global technical errors in intracorporeal suturing (0.32; p = 0.020; 95% CI, 0.06-0.59) were reduced after the dissimilar VR task. When surgeons were stratified by earlier robotic and laparoscopic clinical experience, the more experienced surgeons (n = 17) demonstrated significant improvements from warm-up in task time (-53.5 seconds; p = 0.001; 95% CI, -83.9 to -23.0) and economy of motion (0.63 mm/s; p = 0.007; 95% CI, 0.18-1.09), and improvement in these metrics was not statistically significantly appreciated in the less-experienced cohort (n = 34). We observed significant performance improvement and error reduction rates among surgeons of varying experience after VR warm-up for basic robotic surgery tasks. In addition, the VR warm-up reduced errors on a more complex task (robotic suturing), suggesting the generalizability of the warm-up. Copyright © 2013 American College of Surgeons. All rights reserved.

Virtual Reality Robotic Surgery Warm-Up Improves Task Performance in a Dry Lab Environment: A Prospective Randomized Controlled Study

PubMed Central

Lendvay, Thomas S.; Brand, Timothy C.; White, Lee; Kowalewski, Timothy; Jonnadula, Saikiran; Mercer, Laina; Khorsand, Derek; Andros, Justin; Hannaford, Blake; Satava, Richard M.

2014-01-01

Background Pre-operative simulation “warm-up” has been shown to improve performance and reduce errors in novice and experienced surgeons, yet existing studies have only investigated conventional laparoscopy. We hypothesized a brief virtual reality (VR) robotic warm-up would enhance robotic task performance and reduce errors. Study Design In a two-center randomized trial, fifty-one residents and experienced minimally invasive surgery faculty in General Surgery, Urology, and Gynecology underwent a validated robotic surgery proficiency curriculum on a VR robotic simulator and on the da Vinci surgical robot. Once successfully achieving performance benchmarks, surgeons were randomized to either receive a 3-5 minute VR simulator warm-up or read a leisure book for 10 minutes prior to performing similar and dissimilar (intracorporeal suturing) robotic surgery tasks. The primary outcomes compared were task time, tool path length, economy of motion, technical and cognitive errors. Results Task time (-29.29sec, p=0.001, 95%CI-47.03,-11.56), path length (-79.87mm, p=0.014, 95%CI -144.48,-15.25), and cognitive errors were reduced in the warm-up group compared to the control group for similar tasks. Global technical errors in intracorporeal suturing (0.32, p=0.020, 95%CI 0.06,0.59) were reduced after the dissimilar VR task. When surgeons were stratified by prior robotic and laparoscopic clinical experience, the more experienced surgeons(n=17) demonstrated significant improvements from warm-up in task time (-53.5sec, p=0.001, 95%CI -83.9,-23.0) and economy of motion (0.63mm/sec, p=0.007, 95%CI 0.18,1.09), whereas improvement in these metrics was not statistically significantly appreciated in the less experienced cohort(n=34). Conclusions We observed a significant performance improvement and error reduction rate among surgeons of varying experience after VR warm-up for basic robotic surgery tasks. In addition, the VR warm-up reduced errors on a more complex task (robotic suturing) suggesting the generalizability of the warm-up. PMID:23583618

Development of virtual reality exercise of hand motion assist robot for rehabilitation therapy by patient self-motion control.

PubMed

Ueki, Satoshi; Nishimoto, Yutaka; Abe, Motoyuki; Kawasaki, Haruhisa; Ito, Satoshi; Ishigure, Yasuhiko; Mizumoto, Jun; Ojika, Takeo

2008-01-01

This paper presents a virtual reality-enhanced hand rehabilitation support system with a symmetric master-slave motion assistant for independent rehabilitation therapies. Our aim is to provide fine motion exercise for a hand and fingers, which allows the impaired hand of a patient to be driven by his or her healthy hand on the opposite side. Since most disabilities caused by cerebral vascular accidents or bone fractures are hemiplegic, we adopted a symmetric master-slave motion assistant system in which the impaired hand is driven by the healthy hand on the opposite side. A VR environment displaying an effective exercise was created in consideration of system's characteristic. To verify the effectiveness of this system, a clinical test was executed by applying to six patients.

[Tools for laparoscopic skill development - available trainers and simulators].

PubMed

Jaksa, László; Haidegger, Tamás; Galambos, Péter; Kiss, Rita

2017-10-01

The laparoscopic minimally invasive surgical technique is widely employed on a global scale. However, the efficient and ethical teaching of this technique requires equipment for surgical simulation. These educational devices are present on the market in the form of box trainers and virtual reality simulators, or some combination of those. In this article, we present a systematic overview of commercially available surgical simulators describing the most important features of each product. Our overview elaborates on box trainers and virtual reality simulators, and also touches on surgical robotics simulators, together with operating room workflow simulators, for the sake of completeness. Apart from presenting educational tools, we evaluated the literature of laparoscopic surgical education and simulation, to provide a complete picture of the unfolding trends in this field. Orv Hetil. 2017; 158(40): 1570-1576.

Validated robotic laparoscopic surgical training in a virtual-reality environment.

PubMed

Katsavelis, Dimitrios; Siu, Ka-Chun; Brown-Clerk, Bernadette; Lee, Irene H; Lee, Yong Kwon; Oleynikov, Dmitry; Stergiou, Nick

2009-01-01

A robotic virtual-reality (VR) simulator has been developed to improve robot-assisted training for laparoscopic surgery and to enhance surgical performance in laparoscopic skills. The simulated VR training environment provides an effective approach to evaluate and improve surgical performance. This study presents our findings of the VR training environment for robotic laparoscopy. Eight volunteers performed two inanimate tasks in both the VR and the actual training environment. The tasks were bimanual carrying (BC) and needle passing (NP). For the BC task, the volunteers simultaneously transferred two plastic pieces in opposite directions five times consecutively. The same volunteers passed a surgical needle through six pairs of holes in the NP task. Both tasks require significant bimanual coordination that mimics actual laparoscopic skills. Data analysis included time to task completion, speed and distance traveled of the instrument tip, as well as range of motion of the subject's wrist and elbow of the right arm. Electromyography of the right wrist flexor and extensor were also analyzed. Paired t-tests and Pearson's r were used to explore the differences and correlations between the two environments. There were no significant differences between the actual and the simulated VR environment with respect to the BC task, while there were significant differences in almost all dependent parameters for the NP task. Moderate to high correlations for most dependent parameters were revealed for both tasks. Our data shows that the VR environment adequately simulated the BC task. The significant differences found for the NP task may be attributed to an oversimplification in the VR environment. However, they do point to the need for improvements in the complexity of our VR simulation. Further research work is needed to develop effective and reliable VR environments for robotic laparoscopic training.

Combining Dopaminergic Facilitation with Robot-Assisted Upper Limb Therapy in Stroke Survivors

PubMed Central

Tran, Duc A.; Pajaro-Blazquez, Marta; Daneault, Jean-Francois; Gallegos, Jaime G.; Pons, Jose; Fregni, Felipe; Bonato, Paolo; Zafonte, Ross

2016-01-01

ABSTRACT Despite aggressive conventional therapy, lasting hemiplegia persists in a large percentage of stroke survivors. The aim of this article is to critically review the rationale behind targeting multiple sites along the motor learning network by combining robotic therapy with pharmacotherapy and virtual reality–based reward learning to alleviate upper extremity impairment in stroke survivors. Methods for personalizing pharmacologic facilitation to each individual’s unique biology are also reviewed. At the molecular level, treatment with levodopa was shown to induce long-term potentiation-like and practice-dependent plasticity. Clinically, trials combining conventional therapy with levodopa in stroke survivors yielded statistically significant but clinically unconvincing outcomes because of limited personalization, standardization, and reproducibility. Robotic therapy can induce neuroplasticity by delivering intensive, reproducible, and functionally meaningful interventions that are objective enough for the rigors of research. Robotic therapy also provides an apt platform for virtual reality, which boosts learning by engaging reward circuits. The future of stroke rehabilitation should target distinct molecular, synaptic, and cortical sites through personalized multimodal treatments to maximize motor recovery. PMID:26829074

Virtual Reality System Offers a Wide Perspective

NASA Technical Reports Server (NTRS)

2008-01-01

Robot Systems Technology Branch engineers at Johnson Space Center created the remotely controlled Robonaut for use as an additional "set of hands" in extravehicular activities (EVAs) and to allow exploration of environments that would be too dangerous or difficult for humans. One of the problems Robonaut developers encountered was that the robot s interface offered an extremely limited field of vision. Johnson robotics engineer, Darby Magruder, explained that the 40-degree field-of-view (FOV) in initial robotic prototypes provided very narrow tunnel vision, which posed difficulties for Robonaut operators trying to see the robot s surroundings. Because of the narrow FOV, NASA decided to reach out to the private sector for assistance. In addition to a wider FOV, NASA also desired higher resolution in a head-mounted display (HMD) with the added ability to capture and display video.

The Tube 3 module designed for practicing vesicourethral anastomosis in a virtual reality robotic simulator: determination of face, content, and construct validity.

PubMed

Kang, Sung Gu; Cho, Seok; Kang, Seok Ho; Haidar, Abdul Muhsin; Samavedi, Srinivas; Palmer, Kenneth J; Patel, Vipul R; Cheon, Jun

2014-08-01

To better use virtual reality robotic simulators and offer surgeons more practical exercises, we developed the Tube 3 module for practicing vesicourethral anastomosis (VUA), one of the most complex steps in the robot-assisted radical prostatectomy procedure. Herein, we describe the principle of the Tube 3 module and evaluate its face, content, and construct validity. Residents and attending surgeons participated in a prospective study approved by the institutional review board. We divided subjects into 2 groups, those with experience and novices. Each subject performed a simulated VUA using the Tube 3 module. A built-in scoring algorithm recorded the data from each performance. After completing the Tube 3 module exercise, each subject answered a questionnaire to provide data to be used for face and content validation. The novice group consisted of 10 residents. The experienced subjects (n = 10) had each previously performed at least 10 robotic surgeries. The experienced group outperformed the novice group in most variables, including task time, total score, total economy of motion, and number of instrument collisions (P <.05). Additionally, 80% of the experienced surgeons agreed that the module reflects the technical skills required to perform VUA and would be a useful training tool. We describe the Tube 3 module for practicing VUA, which showed excellent face, content, and construct validity. The task needs to be refined in the future to reflect VUA under real operating conditions, and concurrent and predictive validity studies are currently underway. Copyright © 2014 Elsevier Inc. All rights reserved.

The role of robotic gait training coupled with virtual reality in boosting the rehabilitative outcomes in patients with multiple sclerosis.

PubMed

Russo, Margherita; Dattola, Vincenzo; De Cola, Maria C; Logiudice, Anna L; Porcari, Bruno; Cannavò, Antonino; Sciarrone, Francesca; De Luca, Rosaria; Molonia, Francesco; Sessa, Edoardo; Bramanti, Placido; Calabrò, Rocco S

2018-06-01

Motor impairment is the most common symptom in multiple sclerosis (MS). Thus, a variety of new rehabilitative strategies, including robotic gait training, have been implemented, showing their effectiveness. The aim of our study was to investigate whether an intensive robotic gait training, preceding a traditional rehabilitative treatment, could be useful in improving and potentiating motor performance in MS patients. Forty-five patients, who fulfilled the inclusion criteria, were enrolled in this study and randomized into either the control group (CG) or the experimental group (EG). A complete clinical evaluation, including the Expanded Disability Severity Scale, the Functional Independence Measure, the Hamilton Rating Scale for Depression, the time up and go test (TUG), and the Tinetti balance scale, was performed at baseline (T0), after 6 week (T1), at the end of rehabilitative training (T2), and 1 month later (T3). A significant improvement was observed in the EG for all the outcome measures, whereas the CG showed an improvement only in TUG. In contrast, from T1 to T2, only CG significantly improved in all outcomes, whereas the EG had an improvement only regarding TUG. From T2 to T3, no significant differences in Functional Independence Measure scores emerged for both the groups, but a significant worsening in Tinetti balance scale and TUG was observed for the CG and in TUG for the EG. Our study provides evidence that robotic rehabilitationn coupled with two-dimensional virtual reality may be a valuable tool in promoting functional recovery in patients with MS.

Controlling robots in the home: Factors that affect the performance of novice robot operators.

PubMed

McGinn, Conor; Sena, Aran; Kelly, Kevin

2017-11-01

For robots to successfully integrate into everyday life, it is important that they can be effectively controlled by laypeople. However, the task of manually controlling mobile robots can be challenging due to demanding cognitive and sensorimotor requirements. This research explores the effect that the built environment has on the manual control of domestic service robots. In this study, a virtual reality simulation of a domestic robot control scenario was developed. The performance of fifty novice users was evaluated, and their subjective experiences recorded through questionnaires. Through quantitative and qualitative analysis, it was found that untrained operators frequently perform poorly at navigation-based robot control tasks. The study found that passing through doorways accounted for the largest number of collisions, and was consistently identified as a very difficult operation to perform. These findings suggest that homes and other human-orientated settings present significant challenges to robot control. Copyright © 2017 Elsevier Ltd. All rights reserved.

Tele-rehabilitation using in-house wearable ankle rehabilitation robot.

PubMed

Jamwal, Prashant K; Hussain, Shahid; Mir-Nasiri, Nazim; Ghayesh, Mergen H; Xie, Sheng Q

2018-01-01

This article explores wide-ranging potential of the wearable ankle robot for in-house rehabilitation. The presented robot has been conceptualized following a brief analysis of the existing technologies, systems, and solutions for in-house physical ankle rehabilitation. Configuration design analysis and component selection for ankle robot have been discussed as part of the conceptual design. The complexities of human robot interaction are closely encountered while maneuvering a rehabilitation robot. We present a fuzzy logic-based controller to perform the required robot-assisted ankle rehabilitation treatment. Designs of visual haptic interfaces have also been discussed, which will make the treatment interesting, and the subject will be motivated to exert more and regain lost functions rapidly. The complex nature of web-based communication between user and remotely sitting physiotherapy staff has also been discussed. A high-level software architecture appended with robot ensures user-friendly operations. This software is made up of three important components: patient-related database, graphical user interface (GUI), and a library of exercises creating virtual reality-specifically developed for ankle rehabilitation.

A low cost indoor localization system for mobile robot experimental setup

NASA Astrophysics Data System (ADS)

Adinandra, S.; Syarif, A.

2018-04-01

Indoor localization becomes one of the most important part in mobile robot system One fundamental requirement is to provide an easy-to-use and practical localization system for real-time experiments. In this paper we propose a combination of a recent open source virtual reality (VR) tools, a simple MATLAB code and a low cost USB webcam as an indoor mobile robot localization system Using the VR tools as a server and MATLAB as a client, the proposed solution can cover up to 1.6 [m] × 3.2 [m] with the measurement position accuracy up to 1.2 [cm]. The system is insensitive to light, easy to move and can be quickly set up. A series of successful real-time experiments with three different mobile robot types has been conducted.

Enhancing Tele-robotics with Immersive Virtual Reality

DTIC Science & Technology

2017-11-03

graduate and undergraduate students within the Digital Gaming and Simulation, Computer Science, and psychology programs have actively collaborated...investigates the use of artificial intelligence and visual computing. Numerous fields across the human-computer interaction and gaming research areas...invested in digital gaming and simulation to cognitively stimulate humans by computers, forming a $10.5B industry [1]. On the other hand, cognitive

War-Fighting in the Early 21st Century: A Remote-Controlled, Robotic, Robust, Size-Reduced, Virtual-Reality Paradigm

DTIC Science & Technology

2006-11-27

clever, but I see that there was nothing in it, after all” – said to Sherlock Holmes – “I begin to think that I make a mistake in explaining... Sherlock Holmes 94 The Criticism from software cont. • Software complexity and performance is improving – Especially in the key area of pattern

Upper Limb Posture Estimation in Robotic and Virtual Reality-Based Rehabilitation

PubMed Central

Cortés, Camilo; Ardanza, Aitor; Molina-Rueda, F.; Cuesta-Gómez, A.; Ruiz, Oscar E.

2014-01-01

New motor rehabilitation therapies include virtual reality (VR) and robotic technologies. In limb rehabilitation, limb posture is required to (1) provide a limb realistic representation in VR games and (2) assess the patient improvement. When exoskeleton devices are used in the therapy, the measurements of their joint angles cannot be directly used to represent the posture of the patient limb, since the human and exoskeleton kinematic models differ. In response to this shortcoming, we propose a method to estimate the posture of the human limb attached to the exoskeleton. We use the exoskeleton joint angles measurements and the constraints of the exoskeleton on the limb to estimate the human limb joints angles. This paper presents (a) the mathematical formulation and solution to the problem, (b) the implementation of the proposed solution on a commercial exoskeleton system for the upper limb rehabilitation, (c) its integration into a rehabilitation VR game platform, and (d) the quantitative assessment of the method during elbow and wrist analytic training. Results show that this method properly estimates the limb posture to (i) animate avatars that represent the patient in VR games and (ii) obtain kinematic data for the patient assessment during elbow and wrist analytic rehabilitation. PMID:25110698

STS-88 crew use simulators and virtual reality in preflight training

NASA Image and Video Library

1998-04-08

S98-05078 (8 Apr. 1998) --- With crew mates looking on, astronaut Nancy J. Currie, mission specialist, uses hardware in the virtual reality lab at the Johnson Space Center (JSC) to train for her duties aboard the Space Shuttle Endeavour. She is flanked by astronaut Robert Cabana (left), commander; and Frederick W. Sturckow (right), pilot. This type computer interface paired with virtual reality training hardware for the assigned space-walking astronauts -- Jerry L. Ross and James H. Newman -- helps to prepare the entire team for dealing with International Space Station (ISS) elements. One of those elements will be the Functional Cargo Block (FGB), which will have been launched a couple of weeks prior to STS-88. Once the FGB is captured using the Remote Manipulator System (RMS) of the Endeavour, Currie will maneuver the robot arm to dock the FGB to the conical mating adapter at the top of Node 1, to be carried in the Endeavour's cargo bay. In ensuing days, three Extravehicular Activity?s (EVA) by Ross and Newman will be performed to make power, data and utility connections between the two modules. Looking on is Scott A. Bleisath (behind Currie), with the EVA Systems Group at JSC.

STS-88 crew use simulators and virtual reality in preflight training

NASA Image and Video Library

1998-04-08

S98-05077 (8 Apr. 1998) --- With crew mates looking on, astronaut Nancy J. Currie, mission specialist, uses hardware in the virtual reality lab at the Johnson Space Center (JSC) to train for her duties aboard the Space Shuttle Endeavour. She is flanked by astronaut Robert Cabana (left), commander; and Frederick W. Sturckow (right), pilot. This type computer interface paired with virtual reality training hardware for the assigned space-walking astronauts -- Jerry L. Ross and James H. Newman -- helps to prepare the entire team for dealing with International Space Station (ISS) elements. One of those elements will be the Functional Cargo Block (FGB), which will have been launched a couple of weeks prior to STS-88. Once the FGB is captured using the Remote Manipulator System (RMS) of the Endeavour, Currie will maneuver the robot arm to dock the FGB to the conical mating adapter at the top of Node 1, to be carried in the Endeavour's cargo bay. In ensuing days, three Extravehicular Activity?s (EVA) by Ross and Newman will be performed to make power, data and utility connections between the two modules. Looking on is Scott A. Bleisath (behind Currie), with the EVA Systems Group at JSC.

Battle of the bots: a comparison of the standard da Vinci and the da Vinci Surgical Skills Simulator in surgical skills acquisition.

PubMed

Brown, Kevin; Mosley, Natalie; Tierney, James

2017-06-01

Virtual reality simulators are increasingly used to gain robotic surgical skills. This study compared use of the da Vinci Surgical Skills Simulator (dVSSS) to the standard da Vinci (SdV) robot for skills acquisition in a prospective randomized study. Residents from urology, gynecology, and general surgery programs performed three virtual reality tasks (thread the ring, ring rail, and tubes) on the dvSSS. Participants were then randomized to one of the two study groups (dVSSS and SdV). Each participant then practiced on either the dVSSS or the SdV (depending on randomization) for 30 min per week over a 4-week time period. The dVSSS arm was not permitted to practice ring rail (due to no similar practice scenario available for the SdV group). Following 4 weeks of practice, participants performed the same three virtual reality tasks and the results were recorded and compared to baseline. Overall and percent improvement were recorded for all participants from pre-test to post-test. Two-way ANOVA analyses were used to compare the dVSSS and SdV groups and three tasks. Initially, 30 participants were identified and enrolled in the study. Randomization resulted in 15 participants in each arm. During the course of the study, four participants were unable to complete all tasks and practice sessions and were, therefore, excluded. This resulted in a total of 26 participants (15 in the dVSSS group and 11 in the SdV group) who completed the study. Overall total improvement score was found to be 23.23 and 23.48 for the SdV and dVSSS groups, respectively (p = 0.9245). The percent improvement was 60 and 47 % for the SdV and dVSSS groups respectively, which was a statistically significant difference between the two groups and three tasks. Practicing on the standard da Vinci is comparable to practicing on the da Vinci simulator for acquiring robotic surgical skills. In spite of several potential advantages, the dVSSS arm performed no better than the SdV arm in the final assessment of participant scores. Our findings indicate that both the SdV and dVSSS can be beneficial to residents in improving their robotic surgery skills.

Robotically facilitated virtual rehabilitation of arm transport integrated with finger movement in persons with hemiparesis.

PubMed

Merians, Alma S; Fluet, Gerard G; Qiu, Qinyin; Saleh, Soha; Lafond, Ian; Davidow, Amy; Adamovich, Sergei V

2011-05-16

Recovery of upper extremity function is particularly recalcitrant to successful rehabilitation. Robotic-assisted arm training devices integrated with virtual targets or complex virtual reality gaming simulations are being developed to deal with this problem. Neural control mechanisms indicate that reaching and hand-object manipulation are interdependent, suggesting that training on tasks requiring coordinated effort of both the upper arm and hand may be a more effective method for improving recovery of real world function. However, most robotic therapies have focused on training the proximal, rather than distal effectors of the upper extremity. This paper describes the effects of robotically-assisted, integrated upper extremity training. Twelve subjects post-stroke were trained for eight days on four upper extremity gaming simulations using adaptive robots during 2-3 hour sessions. The subjects demonstrated improved proximal stability, smoothness and efficiency of the movement path. This was in concert with improvement in the distal kinematic measures of finger individuation and improved speed. Importantly, these changes were accompanied by a robust 16-second decrease in overall time in the Wolf Motor Function Test and a 24-second decrease in the Jebsen Test of Hand Function. Complex gaming simulations interfaced with adaptive robots requiring integrated control of shoulder, elbow, forearm, wrist and finger movements appear to have a substantial effect on improving hemiparetic hand function. We believe that the magnitude of the changes and the stability of the patient's function prior to training, along with maintenance of several aspects of the gains demonstrated at retention make a compelling argument for this approach to training.

Robotically facilitated virtual rehabilitation of arm transport integrated with finger movement in persons with hemiparesis

PubMed Central

2011-01-01

Background Recovery of upper extremity function is particularly recalcitrant to successful rehabilitation. Robotic-assisted arm training devices integrated with virtual targets or complex virtual reality gaming simulations are being developed to deal with this problem. Neural control mechanisms indicate that reaching and hand-object manipulation are interdependent, suggesting that training on tasks requiring coordinated effort of both the upper arm and hand may be a more effective method for improving recovery of real world function. However, most robotic therapies have focused on training the proximal, rather than distal effectors of the upper extremity. This paper describes the effects of robotically-assisted, integrated upper extremity training. Methods Twelve subjects post-stroke were trained for eight days on four upper extremity gaming simulations using adaptive robots during 2-3 hour sessions. Results The subjects demonstrated improved proximal stability, smoothness and efficiency of the movement path. This was in concert with improvement in the distal kinematic measures of finger individuation and improved speed. Importantly, these changes were accompanied by a robust 16-second decrease in overall time in the Wolf Motor Function Test and a 24-second decrease in the Jebsen Test of Hand Function. Conclusions Complex gaming simulations interfaced with adaptive robots requiring integrated control of shoulder, elbow, forearm, wrist and finger movements appear to have a substantial effect on improving hemiparetic hand function. We believe that the magnitude of the changes and the stability of the patient's function prior to training, along with maintenance of several aspects of the gains demonstrated at retention make a compelling argument for this approach to training. PMID:21575185

A comparative analysis and guide to virtual reality robotic surgical simulators.

PubMed

Julian, Danielle; Tanaka, Alyssa; Mattingly, Patricia; Truong, Mireille; Perez, Manuela; Smith, Roger

2018-02-01

Since the US Food and Drug Administration approved robotically assisted surgical devices for human surgery in 2000, the number of surgeries utilizing this innovative technology has risen. In 2015, approximately 650 000 robot-assisted procedures were performed worldwide. Surgeons must be properly trained to safely transition to using such innovative technology. Multiple virtual reality robotic simulators are now commercially available for educational and training purposes. There is a need for comparative evaluations of these simulators to aid users in selecting an appropriate device for their purposes. We conducted a comparison of the design and capabilities of all dedicated simulators of the da Vinci robot - the da Vinci Skills Simulator (dVSS), dV-Trainer (dVT), Robotic Skills Simulators (RoSS) and the RobotiX Mentor. This paper provides the base specifications of the hardware and software, with an emphasis on the training capabilities of each system. Each simulator contains a large number of training exercises for skills development: dVSS n = 40, dVT n = 65, RoSS n = 52, RobotiX Mentor n = 31. All four offer 3D visual images but use different display technologies. The dVSS leverages the real robotic surgical console to provide visualization, hand controls and foot pedals. The dVT, RoSS and RobotiX Mentor created simulated versions of all of these control systems. Each includes systems management services that allow instructors to collect, export and analyze the scores of students using the simulators. This study provides comparative information on the four simulators' functional capabilities. Each device offers unique advantages and capabilities for training robotic surgeons. Each has been the subject of validation experiments, which have been published in the literature. But those do not provide specific details on the capabilities of the simulators, which are necessary for an understanding sufficient to select the one best suited for an organization's needs. This article provides comparative information to assist with that type of selection. Copyright © 2017 John Wiley & Sons, Ltd.

Coordinated control of a dual-arm dexterous robot using full immersion telepresence and virtual reality

NASA Technical Reports Server (NTRS)

Li, Larry; Cox, Brian; Shelton, Susan; Diftler, Myron

1994-01-01

Telepresence is an approach to teleoperation that provides egocentric, intuitive interactions between an operator and a remote environment. This approach takes advantage of the natural cognitive and sensory motor skills of an on-board crew and effectively transfers them to a slave robot. A dual alarm dexterous robot operating under telepresence control has been developed and initial evaluations of the system performing candidate EVA, IVA and planetary geological tasks were conducted. The results of our evaluation showed that telepresence control is very effective in transferring the operator's skills to the slave robot. However, the results also showed that, due to the kinematic and dynamics inconsistencies between the operator and the robot, a limited amount of intelligent automation is also required to carry out some to the tasks. Therefore, several enhancements have been made to the original system to increase the automated capabilities of the control system without losing the benefits of telepresence.

Beaming into the News: A System for and Case Study of Tele-Immersive Journalism.

PubMed

Kishore, Sameer; Navarro, Xavi; Dominguez, Eva; de la Pena, Nonny; Slater, Mel

2016-05-25

We show how a combination of virtual reality and robotics can be used to beam a physical representation of a person to a distant location, and describe an application of this system in the context of journalism. Full body motion capture data of a person is streamed and mapped in real time, onto the limbs of a humanoid robot present at the remote location. A pair of cameras in the robot's 'eyes' stream stereoscopic video back to the HMD worn by the visitor, and a two-way audio connection allows the visitor to talk to people in the remote destination. By fusing the multisensory data of the visitor with the robot, the visitor's 'consciousness' is transformed to the robot's body. This system was used by a journalist to interview a neuroscientist and a chef 900 miles distant, about food for the brain, resulting in an article published in the popular press.

Beaming into the News: A System for and Case Study of Tele-Immersive Journalism.

PubMed

Kishore, Sameer; Navarro, Xavi; Dominguez, Eva; De La Pena, Nonny; Slater, Mel

2018-03-01

We show how a combination of virtual reality and robotics can be used to beam a physical representation of a person to a distant location, and describe an application of this system in the context of journalism. Full body motion capture data of a person is streamed and mapped in real time, onto the limbs of a humanoid robot present at the remote location. A pair of cameras in the robots eyes stream stereoscopic video back to the HMD worn by the visitor, and a two-way audio connection allows the visitor to talk to people in the remote destination. By fusing the multisensory data of the visitor with the robot, the visitors consciousness is transformed to the robots body. This system was used by a journalist to interview a neuroscientist and a chef 900 miles distant, about food for the brain, resulting in an article published in the popular press.

Telerobotic surgery: applications on human patients and training with virtual reality.

PubMed

Rovetta, A; Bejczy, A K; Sala, R

1997-01-01

This paper deals with the developed researches and applications on telerobotic surgery, devoted to human patients and with training by virtual reality. The researches have been developed in cooperation between Telerobotics Laboratory, Department of Mechanics, Politecnico di Milano, Italy, and Automation and Control Section, Jet Propulsion Laboratory, Pasadena, USA. The researches carried to a telesurgery robotic operation on a dummy on 7th July 1993, by means of satellites communications, to a prostatic biopsy on a human patient on 1st September 1995 with optical fibers, to results on time delay effects, to results on virtual reality applications for training on laparoscopy and surgery. The search implied time delay when the control input originated in Politecnico di Milano, Italy. The results were satisfactory, but also pointed out the need for specific new control transformations to ease the operator's or surgeon's visual/mental workload for hand-eye coordination. In the same research, dummy force commands from JPL to Milan were sent, and were echoed immediately back to JPL, measuring the round-trip time of the command signal. This, to some degree, simulates a contact force feedback situation. The results were very surprising; despite the fact that the ISDN calls are closed and "private" calls, the round-trip time exhibited great variations not only between calls but also within the same call. The results proved that telerobotics and telecontrol may be applied to surgery. Time latency variations are caused by features of communication network, of sending and receiving end computer software. The problem and its solution is also an architectural issue, and considerable improvements are possible. Virtual reality in the application of the research is a strong support to training on virtual objects and not on living beings.

Human computer confluence applied in healthcare and rehabilitation.

PubMed

Viaud-Delmon, Isabelle; Gaggioli, Andrea; Ferscha, Alois; Dunne, Stephen

2012-01-01

Human computer confluence (HCC) is an ambitious research program studying how the emerging symbiotic relation between humans and computing devices can enable radically new forms of sensing, perception, interaction, and understanding. It is an interdisciplinary field, bringing together researches from horizons as various as pervasive computing, bio-signals processing, neuroscience, electronics, robotics, virtual & augmented reality, and provides an amazing potential for applications in medicine and rehabilitation.

Quantitative 3-D imaging topogrammetry for telemedicine applications

NASA Technical Reports Server (NTRS)

Altschuler, Bruce R.

1994-01-01

The technology to reliably transmit high-resolution visual imagery over short to medium distances in real time has led to the serious considerations of the use of telemedicine, telepresence, and telerobotics in the delivery of health care. These concepts may involve, and evolve toward: consultation from remote expert teaching centers; diagnosis; triage; real-time remote advice to the surgeon; and real-time remote surgical instrument manipulation (telerobotics with virtual reality). Further extrapolation leads to teledesign and telereplication of spare surgical parts through quantitative teleimaging of 3-D surfaces tied to CAD/CAM devices and an artificially intelligent archival data base of 'normal' shapes. The ability to generate 'topogrames' or 3-D surface numerical tables of coordinate values capable of creating computer-generated virtual holographic-like displays, machine part replication, and statistical diagnostic shape assessment is critical to the progression of telemedicine. Any virtual reality simulation will remain in 'video-game' realm until realistic dimensional and spatial relational inputs from real measurements in vivo during surgeries are added to an ever-growing statistical data archive. The challenges of managing and interpreting this 3-D data base, which would include radiographic and surface quantitative data, are considerable. As technology drives toward dynamic and continuous 3-D surface measurements, presenting millions of X, Y, Z data points per second of flexing, stretching, moving human organs, the knowledge base and interpretive capabilities of 'brilliant robots' to work as a surgeon's tireless assistants becomes imaginable. The brilliant robot would 'see' what the surgeon sees--and more, for the robot could quantify its 3-D sensing and would 'see' in a wider spectral range than humans, and could zoom its 'eyes' from the macro world to long-distance microscopy. Unerring robot hands could rapidly perform machine-aided suturing with precision micro-sewing machines, splice neural connections with laser welds, micro-bore through constricted vessels, and computer combine ultrasound, microradiography, and 3-D mini-borescopes to quickly assess and trace vascular problems in situ. The spatial relationships between organs, robotic arms, and end-effector diagnostic, manipulative, and surgical instruments would be constantly monitored by the robot 'brain' using inputs from its multiple 3-D quantitative 'eyes' remote sensing, as well as by contact and proximity force measuring devices. Methods to create accurate and quantitative 3-D topograms at continuous video data rates are described.

Establishing objective benchmarks in robotic virtual reality simulation at the level of a competent surgeon using the RobotiX Mentor simulator.

PubMed

Watkinson, William; Raison, Nicholas; Abe, Takashige; Harrison, Patrick; Khan, Shamim; Van der Poel, Henk; Dasgupta, Prokar; Ahmed, Kamran

2018-05-01

To establish objective benchmarks at the level of a competent robotic surgeon across different exercises and metrics for the RobotiX Mentor virtual reality (VR) simulator suitable for use within a robotic surgical training curriculum. This retrospective observational study analysed results from multiple data sources, all of which used the RobotiX Mentor VR simulator. 123 participants with varying experience from novice to expert completed the exercises. Competency was established as the 25th centile of the mean advanced intermediate score. Three basic skill exercises and two advanced skill exercises were used. King's College London. 84 Novice, 26 beginner intermediates, 9 advanced intermediates and 4 experts were used in this retrospective observational study. Objective benchmarks derived from the 25th centile of the mean scores of the advanced intermediates provided suitably challenging yet also achievable targets for training surgeons. The disparity in scores was greatest for the advanced exercises. Novice surgeons are able to achieve the benchmarks across all exercises in the majority of metrics. We have successfully created this proof-of-concept study, which requires validation in a larger cohort. Objective benchmarks obtained from the 25th centile of the mean scores of advanced intermediates provide clinically relevant benchmarks at the standard of a competent robotic surgeon that are challenging yet also attainable. That can be used within a VR training curriculum allowing participants to track and monitor their progress in a structured and progressional manner through five exercises. Providing clearly defined targets, ensuring that a universal training standard has been achieved across training surgeons. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

RoboCup-Rescue: an international cooperative research project of robotics and AI for the disaster mitigation problem

NASA Astrophysics Data System (ADS)

Tadokoro, Satoshi; Kitano, Hiroaki; Takahashi, Tomoichi; Noda, Itsuki; Matsubara, Hitoshi; Shinjoh, Atsushi; Koto, Tetsuo; Takeuchi, Ikuo; Takahashi, Hironao; Matsuno, Fumitoshi; Hatayama, Mitsunori; Nobe, Jun; Shimada, Susumu

2000-07-01

This paper introduces the RoboCup-Rescue Simulation Project, a contribution to the disaster mitigation, search and rescue problem. A comprehensive urban disaster simulator is constructed on distributed computers. Heterogeneous intelligent agents such as fire fighters, victims and volunteers conduct search and rescue activities in this virtual disaster world. A real world interface integrates various sensor systems and controllers of infrastructures in the real cities with the real world. Real-time simulation is synchronized with actual disasters, computing complex relationship between various damage factors and agent behaviors. A mission-critical man-machine interface provides portability and robustness of disaster mitigation centers, and augmented-reality interfaces for rescue in real disasters. It also provides a virtual- reality training function for the public. This diverse spectrum of RoboCup-Rescue contributes to the creation of the safer social system.

Does intervention using virtual reality improve upper limb function in children with neurological impairment: a systematic review of the evidence.

PubMed

Galvin, Jane; McDonald, Rachael; Catroppa, Cathy; Anderson, Vicki

2011-01-01

Virtual reality (VR) is an emerging area of paediatric clinical and research practice, however the majority of research to date has focused on outcomes for adults following stroke. This paper appraises and describes current evidence for use of virtual reality interventions to improve upper limb function of children with neurological impairment. A comprehensive database search was undertaken to explore literature on the use of VR systems for rehabilitation of upper limb skills of children with neurological impairment. Studies investigating the use of robotics or other mechanical devices were excluded. Five studies were found and were critiqued using the Downs and Black scale for measuring study quality. One randomized control trial and four case studies were found. No study scored over 50% on the Downs and Black scale, indicating methodological limitations that limit generalizability. Current evidence for the use of VR to improve hand and arm skills is at an emerging stage. Small sample sizes and inconsistencies in outcome measurement limit the ability to generalize findings. Further studies are required to investigate the ability to maintain gains made in VR over time and to determine whether gains transfer from the VR to real life tasks and activities.

Embedded Augmented Reality Training System for Dynamic Human-Robot Cooperation

DTIC Science & Technology

2009-10-01

through (OST) head- mounted displays ( HMDs ) still lack in usability and ergonomics because of their size, weight, resolution, and the hard-to-realize...with addressable focal planes [10], for example. Accurate and easy-to-use calibration routines for OST HMDs remains a challenging task; established...methods are based on matching of virtual over real objects [11], newer approaches use cameras looking directly through the HMD optics to exploit both

Virtual Planning, Control, and Machining for a Modular-Based Automated Factory Operation in an Augmented Reality Environment

PubMed Central

Pai, Yun Suen; Yap, Hwa Jen; Md Dawal, Siti Zawiah; Ramesh, S.; Phoon, Sin Ye

2016-01-01

This study presents a modular-based implementation of augmented reality to provide an immersive experience in learning or teaching the planning phase, control system, and machining parameters of a fully automated work cell. The architecture of the system consists of three code modules that can operate independently or combined to create a complete system that is able to guide engineers from the layout planning phase to the prototyping of the final product. The layout planning module determines the best possible arrangement in a layout for the placement of various machines, in this case a conveyor belt for transportation, a robot arm for pick-and-place operations, and a computer numerical control milling machine to generate the final prototype. The robotic arm module simulates the pick-and-place operation offline from the conveyor belt to a computer numerical control (CNC) machine utilising collision detection and inverse kinematics. Finally, the CNC module performs virtual machining based on the Uniform Space Decomposition method and axis aligned bounding box collision detection. The conducted case study revealed that given the situation, a semi-circle shaped arrangement is desirable, whereas the pick-and-place system and the final generated G-code produced the highest deviation of 3.83 mm and 5.8 mm respectively. PMID:27271840

Virtual Planning, Control, and Machining for a Modular-Based Automated Factory Operation in an Augmented Reality Environment.

PubMed

Pai, Yun Suen; Yap, Hwa Jen; Md Dawal, Siti Zawiah; Ramesh, S; Phoon, Sin Ye

2016-06-07

This study presents a modular-based implementation of augmented reality to provide an immersive experience in learning or teaching the planning phase, control system, and machining parameters of a fully automated work cell. The architecture of the system consists of three code modules that can operate independently or combined to create a complete system that is able to guide engineers from the layout planning phase to the prototyping of the final product. The layout planning module determines the best possible arrangement in a layout for the placement of various machines, in this case a conveyor belt for transportation, a robot arm for pick-and-place operations, and a computer numerical control milling machine to generate the final prototype. The robotic arm module simulates the pick-and-place operation offline from the conveyor belt to a computer numerical control (CNC) machine utilising collision detection and inverse kinematics. Finally, the CNC module performs virtual machining based on the Uniform Space Decomposition method and axis aligned bounding box collision detection. The conducted case study revealed that given the situation, a semi-circle shaped arrangement is desirable, whereas the pick-and-place system and the final generated G-code produced the highest deviation of 3.83 mm and 5.8 mm respectively.

Virtual Planning, Control, and Machining for a Modular-Based Automated Factory Operation in an Augmented Reality Environment

NASA Astrophysics Data System (ADS)

Pai, Yun Suen; Yap, Hwa Jen; Md Dawal, Siti Zawiah; Ramesh, S.; Phoon, Sin Ye

2016-06-01

This study presents a modular-based implementation of augmented reality to provide an immersive experience in learning or teaching the planning phase, control system, and machining parameters of a fully automated work cell. The architecture of the system consists of three code modules that can operate independently or combined to create a complete system that is able to guide engineers from the layout planning phase to the prototyping of the final product. The layout planning module determines the best possible arrangement in a layout for the placement of various machines, in this case a conveyor belt for transportation, a robot arm for pick-and-place operations, and a computer numerical control milling machine to generate the final prototype. The robotic arm module simulates the pick-and-place operation offline from the conveyor belt to a computer numerical control (CNC) machine utilising collision detection and inverse kinematics. Finally, the CNC module performs virtual machining based on the Uniform Space Decomposition method and axis aligned bounding box collision detection. The conducted case study revealed that given the situation, a semi-circle shaped arrangement is desirable, whereas the pick-and-place system and the final generated G-code produced the highest deviation of 3.83 mm and 5.8 mm respectively.

Two innovative healthcare technologies at the intersection of serious games, alternative realities, and play therapy.

PubMed

Brahnam, Sheryl; Brooks, Anthony L

2014-01-01

Using game technologies and digital media for improving physical and mental health and for the therapeutic benefit and well-being of a wide range of people is an area of study that is rapidly expanding. Much research in this emerging field is centered at the intersection of serious games, alternative realities, and play therapy. In this paper the authors describe their transdisciplinary work at this intersection: i) an integrative system of psychotherapy technologies called MyPsySpace currently being prototyped in Second Life with the aim of offering new and virtual translations of traditional expressive therapies (virtual sandplay, virtual drama therapy, digital expressive therapy, and virtual safe spaces) and ii) a mature body of research entitled SoundScapes that is exploring the use of interactive video games and abstract creative expression (making music, digital painting, and robotic device control) as a supplement to traditional physical rehabilitation intervention. Aside from introducing our work to a broader audience, our goal is to encourage peers to investigate ideas that reach across disciplines-to both risk and reap the benefits of combining technologies, theories, and methods stemming from multiple disciplines.

The role of virtual reality in improving motor performance as revealed by EEG: a randomized clinical trial.

PubMed

Calabrò, Rocco Salvatore; Naro, Antonino; Russo, Margherita; Leo, Antonino; De Luca, Rosaria; Balletta, Tina; Buda, Antonio; La Rosa, Gianluca; Bramanti, Alessia; Bramanti, Placido

2017-06-07

Many studies have demonstrated the usefulness of repetitive task practice by using robotic-assisted gait training (RAGT) devices, including Lokomat, for the treatment of lower limb paresis. Virtual reality (VR) has proved to be a valuable tool to improve neurorehabilitation training. The aim of our pilot randomized clinical trial was to understand the neurophysiological basis of motor function recovery induced by the association between RAGT (by using Lokomat device) and VR (an animated avatar in a 2D VR) by studying electroencephalographic (EEG) oscillations. Twenty-four patients suffering from a first unilateral ischemic stroke in the chronic phase were randomized into two groups. One group performed 40 sessions of Lokomat with VR (RAGT + VR), whereas the other group underwent Lokomat without VR (RAGT-VR). The outcomes (clinical, kinematic, and EEG) were measured before and after the robotic intervention. As compared to the RAGT-VR group, all the patients of the RAGT + VR group improved in the Rivermead Mobility Index and Tinetti Performance Oriented Mobility Assessment. Moreover, they showed stronger event-related spectral perturbations in the high-γ and β bands and larger fronto-central cortical activations in the affected hemisphere. The robotic-based rehabilitation combined with VR in patients with chronic hemiparesis induced an improvement in gait and balance. EEG data suggest that the use of VR may entrain several brain areas (probably encompassing the mirror neuron system) involved in motor planning and learning, thus leading to an enhanced motor performance. Retrospectively registered in Clinical Trials on 21-11-2016, n. NCT02971371 .

Augmented reality and haptic interfaces for robot-assisted surgery.

PubMed

Yamamoto, Tomonori; Abolhassani, Niki; Jung, Sung; Okamura, Allison M; Judkins, Timothy N

2012-03-01

Current teleoperated robot-assisted minimally invasive surgical systems do not take full advantage of the potential performance enhancements offered by various forms of haptic feedback to the surgeon. Direct and graphical haptic feedback systems can be integrated with vision and robot control systems in order to provide haptic feedback to improve safety and tissue mechanical property identification. An interoperable interface for teleoperated robot-assisted minimally invasive surgery was developed to provide haptic feedback and augmented visual feedback using three-dimensional (3D) graphical overlays. The software framework consists of control and command software, robot plug-ins, image processing plug-ins and 3D surface reconstructions. The feasibility of the interface was demonstrated in two tasks performed with artificial tissue: palpation to detect hard lumps and surface tracing, using vision-based forbidden-region virtual fixtures to prevent the patient-side manipulator from entering unwanted regions of the workspace. The interoperable interface enables fast development and successful implementation of effective haptic feedback methods in teleoperation. Copyright © 2011 John Wiley & Sons, Ltd.

The Virtual Tablet: Virtual Reality as a Control System

NASA Technical Reports Server (NTRS)

Chronister, Andrew

2016-01-01

In the field of human-computer interaction, Augmented Reality (AR) and Virtual Reality (VR) have been rapidly growing areas of interest and concerted development effort thanks to both private and public research. At NASA, a number of groups have explored the possibilities afforded by AR and VR technology, among which is the IT Advanced Concepts Lab (ITACL). Within ITACL, the AVR (Augmented/Virtual Reality) Lab focuses on VR technology specifically for its use in command and control. Previous work in the AVR lab includes the Natural User Interface (NUI) project and the Virtual Control Panel (VCP) project, which created virtual three-dimensional interfaces that users could interact with while wearing a VR headset thanks to body- and hand-tracking technology. The Virtual Tablet (VT) project attempts to improve on these previous efforts by incorporating a physical surrogate which is mirrored in the virtual environment, mitigating issues with difficulty of visually determining the interface location and lack of tactile feedback discovered in the development of previous efforts. The physical surrogate takes the form of a handheld sheet of acrylic glass with several infrared-range reflective markers and a sensor package attached. Using the sensor package to track orientation and a motion-capture system to track the marker positions, a model of the surrogate is placed in the virtual environment at a position which corresponds with the real-world location relative to the user's VR Head Mounted Display (HMD). A set of control mechanisms is then projected onto the surface of the surrogate such that to the user, immersed in VR, the control interface appears to be attached to the object they are holding. The VT project was taken from an early stage where the sensor package, motion-capture system, and physical surrogate had been constructed or tested individually but not yet combined or incorporated into the virtual environment. My contribution was to combine the pieces of hardware, write software to incorporate each piece of position or orientation data into a coherent description of the object's location in space, place the virtual analogue accordingly, and project the control interface onto it, resulting in a functioning object which has both a physical and a virtual presence. Additionally, the virtual environment was enhanced with two live video feeds from cameras mounted on the robotic device being used as an example target of the virtual interface. The working VT allows users to naturally interact with a control interface with little to no training and without the issues found in previous efforts.

Exploring Virtual Reality for Classroom Use: The Virtual Reality and Education Lab at East Carolina University.

ERIC Educational Resources Information Center

Auld, Lawrence W. S.; Pantelidis, Veronica S.

1994-01-01

Describes the Virtual Reality and Education Lab (VREL) established at East Carolina University to study the implications of virtual reality for elementary and secondary education. Highlights include virtual reality software evaluation; hardware evaluation; computer-based curriculum objectives which could use virtual reality; and keeping current…

Comparison of three different techniques for camera and motion control of a teleoperated robot.

PubMed

Doisy, Guillaume; Ronen, Adi; Edan, Yael

2017-01-01

This research aims to evaluate new methods for robot motion control and camera orientation control through the operator's head orientation in robot teleoperation tasks. Specifically, the use of head-tracking in a non-invasive way, without immersive virtual reality devices was combined and compared with classical control modes for robot movements and camera control. Three control conditions were tested: 1) a condition with classical joystick control of both the movements of the robot and the robot camera, 2) a condition where the robot movements were controlled by a joystick and the robot camera was controlled by the user head orientation, and 3) a condition where the movements of the robot were controlled by hand gestures and the robot camera was controlled by the user head orientation. Performance, workload metrics and their evolution as the participants gained experience with the system were evaluated in a series of experiments: for each participant, the metrics were recorded during four successive similar trials. Results shows that the concept of robot camera control by user head orientation has the potential of improving the intuitiveness of robot teleoperation interfaces, specifically for novice users. However, more development is needed to reach a margin of progression comparable to a classical joystick interface. Copyright © 2016 Elsevier Ltd. All rights reserved.

Potential of robots as next-generation technology for clinical assessment of neurological disorders and upper-limb therapy.

PubMed

Scott, Stephen H; Dukelow, Sean P

2011-01-01

Robotic technologies have profoundly affected the identification of fundamental properties of brain function. This success is attributable to robots being able to control the position of or forces applied to limbs, and their inherent ability to easily, objectively, and reliably quantify sensorimotor behavior. Our general hypothesis is that these same attributes make robotic technologies ideal for clinically assessing sensory, motor, and cognitive impairments in stroke and other neurological disorders. Further, they provide opportunities for novel therapeutic strategies. The present opinionated review describes how robotic technologies combined with virtual/augmented reality systems can support a broad range of behavioral tasks to objectively quantify brain function. This information could potentially be used to provide more accurate diagnostic and prognostic information than is available from current clinical assessment techniques. The review also highlights the potential benefits of robots to provide upper-limb therapy. Although the capital cost of these technologies is substantial, it pales in comparison with the potential cost reductions to the overall healthcare system that improved assessment and therapeutic interventions offer.

Toward the Design of Personalized Continuum Surgical Robots.

PubMed

Morimoto, Tania K; Greer, Joseph D; Hawkes, Elliot W; Hsieh, Michael H; Okamura, Allison M

2018-05-31

Robot-assisted minimally invasive surgical systems enable procedures with reduced pain, recovery time, and scarring compared to traditional surgery. While these improvements benefit a large number of patients, safe access to diseased sites is not always possible for specialized patient groups, including pediatric patients, due to their anatomical differences. We propose a patient-specific design paradigm that leverages the surgeon's expertise to design and fabricate robots based on preoperative medical images. The components of the patient-specific robot design process are a virtual reality design interface enabling the surgeon to design patient-specific tools, 3-D printing of these tools with a biodegradable polyester, and an actuation and control system for deployment. The designed robot is a concentric tube robot, a type of continuum robot constructed from precurved, elastic, nesting tubes. We demonstrate the overall patient-specific design workflow, from preoperative images to physical implementation, for an example clinical scenario: nonlinear renal access to a pediatric kidney. We also measure the system's behavior as it is deployed through real and artificial tissue. System integration and successful benchtop experiments in ex vivo liver and in a phantom patient model demonstrate the feasibility of using a patient-specific design workflow to plan, fabricate, and deploy personalized, flexible continuum robots.

Future of robotic surgery.

PubMed

Lendvay, Thomas Sean; Hannaford, Blake; Satava, Richard M

2013-01-01

In just over a decade, robotic surgery has penetrated almost every surgical subspecialty and has even replaced some of the most commonly performed open oncologic procedures. The initial reports on patient outcomes yielded mixed results, but as more medical centers develop high-volume robotics programs, outcomes appear comparable if not improved for some applications. There are limitations to the current commercially available system, and new robotic platforms, some designed to compete in the current market and some to address niche surgical considerations, are being developed that will change the robotic landscape in the next decade. Adoption of these new systems will be dependent on overcoming barriers to true telesurgery that range from legal to logistical. As additional surgical disciplines embrace robotics and open surgery continues to be replaced by robotic approaches, it will be imperative that adequate education and training keep pace with technology. Methods to enhance surgical performance in robotics through the use of simulation and telementoring promise to accelerate learning curves and perhaps even improve surgical readiness through brief virtual-reality warm-ups and presurgical rehearsal. All these advances will need to be carefully and rigorously validated through not only patient outcomes, but also cost efficiency.

The University of Pennsylvania curriculum for training otorhinolaryngology residents in transoral robotic surgery.

PubMed

Sperry, Steven M; O'Malley, Bert W; Weinstein, Gregory S

2014-01-01

To define a curriculum for the development of robotic surgical skills in otorhinolaryngology residency training. A systematic review of the current literature on robotic surgery training was performed. Based on prior reports in other specialties, a curriculum for otorhinolaryngology residents was created that progresses through several modules, including didactics, inanimate skills laboratory, and operative experience. The curriculum for residents in otorhinolaryngology was designed as follows: didactics include an overview of the robotic device and instruments, a tutorial in basic controls and function, and a room setup and positioning. The anatomy and steps of transoral procedures are taught through books, videos, operative observations, and cadaver dissections. Skills are developed with a virtual reality robotic simulator and robotics labs. The operative experience progresses from case observation to bedside assistant to console surgeon. The role of the console surgeon progresses in a stepwise fashion, and the procedures of radical tonsillectomy, supraglottic partial laryngectomy, and base of tongue resection have been organized as a series of steps. A structured curriculum for training residents in transoral robotic surgery was developed. This training is important for otorhinolaryngology residents to acquire the knowledge and skills to perform robotic surgery safely. © 2015 S. Karger AG, Basel.

Control of repulsive force in a virtual environment using an electrorheological haptic master for a surgical robot application

NASA Astrophysics Data System (ADS)

Oh, Jong-Seok; Choi, Seung-Hyun; Choi, Seung-Bok

2014-01-01

This paper presents control performances of a new type of four-degrees-of-freedom (4-DOF) haptic master that can be used for robot-assisted minimally invasive surgery (RMIS). By adopting a controllable electrorheological (ER) fluid, the function of the proposed master is realized as a haptic feedback as well as remote manipulation. In order to verify the efficacy of the proposed master and method, an experiment is conducted with deformable objects featuring human organs. Since the use of real human organs is difficult for control due to high cost and moral hazard, an excellent alternative method, the virtual reality environment, is used for control in this work. In order to embody a human organ in the virtual space, the experiment adopts a volumetric deformable object represented by a shape-retaining chain linked (S-chain) model which has salient properties such as fast and realistic deformation of elastic objects. In haptic architecture for RMIS, the desired torque/force and desired position originating from the object of the virtual slave and operator of the haptic master are transferred to each other. In order to achieve the desired torque/force trajectories, a sliding mode controller (SMC) which is known to be robust to uncertainties is designed and empirically implemented. Tracking control performances for various torque/force trajectories from the virtual slave are evaluated and presented in the time domain.

Virtual reality, robotics, and other wizardry in 21st century trauma care.

PubMed

Maniscalco-Theberge, M E; Elliott, D C

1999-12-01

The former Special Assistant to the Director on Biomedical Technology, Defense Advanced Research Projects Agency (DARPA), COL RM Satava, notes "Predicting the future trends in any profession jeopardizes the credibility of the author." Thus, we have attempted to outline current systems and prototype models in testing phases. Technologic advances will enable enhanced care of trauma patients. In the acute care setting, they also will affect the educational system in theory and practice.

STS-109 Crew Training

NASA Technical Reports Server (NTRS)

2002-01-01

Footage shows the crew of STS-109 (Commander Scott Altman, Pilot Duane Carey, Payload Commander John Grunsfeld, and Mission Specialists Nancy Currie, James Newman, Richard Linnehan, and Michael Massimino) during various parts of their training. Scenes show the crew's photo session, Post Landing Egress practice, training in Dome Simulator, Extravehicular Activity Training in the Neutral Buoyancy Laboratory (NBL), and using the Virtual Reality Laboratory Robotic Arm. The crew is also seen tasting food as they choose their menus for on-orbit meals.

Active tactile exploration using a brain-machine-brain interface.

PubMed

O'Doherty, Joseph E; Lebedev, Mikhail A; Ifft, Peter J; Zhuang, Katie Z; Shokur, Solaiman; Bleuler, Hannes; Nicolelis, Miguel A L

2011-10-05

Brain-machine interfaces use neuronal activity recorded from the brain to establish direct communication with external actuators, such as prosthetic arms. It is hoped that brain-machine interfaces can be used to restore the normal sensorimotor functions of the limbs, but so far they have lacked tactile sensation. Here we report the operation of a brain-machine-brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and allows signalling of artificial tactile feedback through intracortical microstimulation (ICMS) of the primary somatosensory cortex. Monkeys performed an active exploration task in which an actuator (a computer cursor or a virtual-reality arm) was moved using a BMBI that derived motor commands from neuronal ensemble activity recorded in the primary motor cortex. ICMS feedback occurred whenever the actuator touched virtual objects. Temporal patterns of ICMS encoded the artificial tactile properties of each object. Neuronal recordings and ICMS epochs were temporally multiplexed to avoid interference. Two monkeys operated this BMBI to search for and distinguish one of three visually identical objects, using the virtual-reality arm to identify the unique artificial texture associated with each. These results suggest that clinical motor neuroprostheses might benefit from the addition of ICMS feedback to generate artificial somatic perceptions associated with mechanical, robotic or even virtual prostheses.

Innovative application of virtual display technique in virtual museum

NASA Astrophysics Data System (ADS)

Zhang, Jiankang

2017-09-01

Virtual museum refers to display and simulate the functions of real museum on the Internet in the form of 3 Dimensions virtual reality by applying interactive programs. Based on Virtual Reality Modeling Language, virtual museum building and its effective interaction with the offline museum lie in making full use of 3 Dimensions panorama technique, virtual reality technique and augmented reality technique, and innovatively taking advantages of dynamic environment modeling technique, real-time 3 Dimensions graphics generating technique, system integration technique and other key virtual reality techniques to make sure the overall design of virtual museum.3 Dimensions panorama technique, also known as panoramic photography or virtual reality, is a technique based on static images of the reality. Virtual reality technique is a kind of computer simulation system which can create and experience the interactive 3 Dimensions dynamic visual world. Augmented reality, also known as mixed reality, is a technique which simulates and mixes the information (visual, sound, taste, touch, etc.) that is difficult for human to experience in reality. These technologies make virtual museum come true. It will not only bring better experience and convenience to the public, but also be conducive to improve the influence and cultural functions of the real museum.

The Combined Effects of Adaptive Control and Virtual Reality on Robot-Assisted Fine Hand Motion Rehabilitation in Chronic Stroke Patients: A Case Study.

PubMed

Huang, Xianwei; Naghdy, Fazel; Naghdy, Golshah; Du, Haiping; Todd, Catherine

2018-01-01

Robot-assisted therapy is regarded as an effective and reliable method for the delivery of highly repetitive training that is needed to trigger neuroplasticity following a stroke. However, the lack of fully adaptive assist-as-needed control of the robotic devices and an inadequate immersive virtual environment that can promote active participation during training are obstacles hindering the achievement of better training results with fewer training sessions required. This study thus focuses on these research gaps by combining these 2 key components into a rehabilitation system, with special attention on the rehabilitation of fine hand motion skills. The effectiveness of the proposed system is tested by conducting clinical trials on a chronic stroke patient and verified through clinical evaluation methods by measuring the key kinematic features such as active range of motion (ROM), finger strength, and velocity. By comparing the pretraining and post-training results, the study demonstrates that the proposed method can further enhance the effectiveness of fine hand motion rehabilitation training by improving finger ROM, strength, and coordination. Copyright © 2018 National Stroke Association. Published by Elsevier Inc. All rights reserved.

The New Jersey Institute of Technology Robot-Assisted Virtual Rehabilitation (NJIT-RAVR) system for children with cerebral palsy: a feasibility study.

PubMed

Qiu, Qinyin; Ramirez, Diego A; Saleh, Soha; Fluet, Gerard G; Parikh, Heta D; Kelly, Donna; Adamovich, Sergei V

2009-11-16

We hypothesize that the integration of virtual reality (VR) with robot assisted rehabilitation could be successful if applied to children with hemiparetic CP. The combined benefits of increased attention provided by VR and the larger training stimulus afforded by adaptive robotics may increase the beneficial effects of these two approaches synergistically. This paper will describe the NJIT-RAVR system, which combines adaptive robotics with complex VR simulations for the rehabilitation of upper extremity impairments and function in children with CP and examine the feasibility of this system in the context of a two subject training study. The NJIT-RAVR system consists of the Haptic Master, a 6 degrees of freedom, admittance controlled robot and a suite of rehabilitation simulations that provide adaptive algorithms for the Haptic Master, allowing the user to interact with rich virtual environments. Two children, a ten year old boy and a seven year old girl, both with spastic hemiplegia secondary to Cerebral Palsy were recruited from the outpatient center of a comprehensive pediatric rehabilitation facility. Subjects performed a battery of clinical testing and kinematic measurements of reaching collected by the NJIT-RAVR system. Subjects trained with the NJIT-RAVR System for one hour, 3 days a week for three weeks. The subjects played a combination of four or five simulations depending on their therapeutic goals, tolerances and preferences. Games were modified to increase difficulty in order to challenge the subjects as their performance improved. The testing battery was repeated following the training period. Both participants completed 9 hours of training in 3 weeks. No untoward events occurred and no adverse responses to treatment or complaints of cyber sickness were reported. One participant showed improvements in overall performance on the functional aspects of the testing battery. The second subject made improvements in upper extremity active range of motion and in kinematic measures of reaching movements. We feel that this study establishes the feasibility of integrating robotics and rich virtual environments to address functional limitations and decreased motor performance in children with mild to moderate cerebral palsy.

Reasons to Use Virtual Reality in Education and Training Courses and a Model to Determine When to Use Virtual Reality

ERIC Educational Resources Information Center

Pantelidis, Veronica S.

2009-01-01

Many studies have been conducted on the use of virtual reality in education and training. This article lists examples of such research. Reasons to use virtual reality are discussed. Advantages and disadvantages of using virtual reality are presented, as well as suggestions on when to use and when not to use virtual reality. A model that can be…

Augmented reality to the rescue of the minimally invasive surgeon. The usefulness of the interposition of stereoscopic images in the Da Vinci™ robotic console.

PubMed

Volonté, Francesco; Buchs, Nicolas C; Pugin, François; Spaltenstein, Joël; Schiltz, Boris; Jung, Minoa; Hagen, Monika; Ratib, Osman; Morel, Philippe

2013-09-01

Computerized management of medical information and 3D imaging has become the norm in everyday medical practice. Surgeons exploit these emerging technologies and bring information previously confined to the radiology rooms into the operating theatre. The paper reports the authors' experience with integrated stereoscopic 3D-rendered images in the da Vinci surgeon console. Volume-rendered images were obtained from a standard computed tomography dataset using the OsiriX DICOM workstation. A custom OsiriX plugin was created that permitted the 3D-rendered images to be displayed in the da Vinci surgeon console and to appear stereoscopic. These rendered images were displayed in the robotic console using the TilePro multi-input display. The upper part of the screen shows the real endoscopic surgical field and the bottom shows the stereoscopic 3D-rendered images. These are controlled by a 3D joystick installed on the console, and are updated in real time. Five patients underwent a robotic augmented reality-enhanced procedure. The surgeon was able to switch between the classical endoscopic view and a combined virtual view during the procedure. Subjectively, the addition of the rendered images was considered to be an undeniable help during the dissection phase. With the rapid evolution of robotics, computer-aided surgery is receiving increasing interest. This paper details the authors' experience with 3D-rendered images projected inside the surgical console. The use of this intra-operative mixed reality technology is considered very useful by the surgeon. It has been shown that the usefulness of this technique is a step toward computer-aided surgery that will progress very quickly over the next few years. Copyright © 2012 John Wiley & Sons, Ltd.

Adaptation of a haptic robot in a 3T fMRI.

PubMed

Snider, Joseph; Plank, Markus; May, Larry; Liu, Thomas T; Poizner, Howard

2011-10-04

Functional magnetic resonance imaging (fMRI) provides excellent functional brain imaging via the BOLD signal with advantages including non-ionizing radiation, millimeter spatial accuracy of anatomical and functional data, and nearly real-time analyses. Haptic robots provide precise measurement and control of position and force of a cursor in a reasonably confined space. Here we combine these two technologies to allow precision experiments involving motor control with haptic/tactile environment interaction such as reaching or grasping. The basic idea is to attach an 8 foot end effecter supported in the center to the robot allowing the subject to use the robot, but shielding it and keeping it out of the most extreme part of the magnetic field from the fMRI machine (Figure 1). The Phantom Premium 3.0, 6DoF, high-force robot (SensAble Technologies, Inc.) is an excellent choice for providing force-feedback in virtual reality experiments, but it is inherently non-MR safe, introduces significant noise to the sensitive fMRI equipment, and its electric motors may be affected by the fMRI's strongly varying magnetic field. We have constructed a table and shielding system that allows the robot to be safely introduced into the fMRI environment and limits both the degradation of the fMRI signal by the electrically noisy motors and the degradation of the electric motor performance by the strongly varying magnetic field of the fMRI. With the shield, the signal to noise ratio (SNR: mean signal/noise standard deviation) of the fMRI goes from a baseline of ~380 to ~330, and ~250 without the shielding. The remaining noise appears to be uncorrelated and does not add artifacts to the fMRI of a test sphere (Figure 2). The long, stiff handle allows placement of the robot out of range of the most strongly varying parts of the magnetic field so there is no significant effect of the fMRI on the robot. The effect of the handle on the robot's kinematics is minimal since it is lightweight (~2.6 lbs) but extremely stiff 3/4" graphite and well balanced on the 3DoF joint in the middle. The end result is an fMRI compatible, haptic system with about 1 cubic foot of working space, and, when combined with virtual reality, it allows for a new set of experiments to be performed in the fMRI environment including naturalistic reaching, passive displacement of the limb and haptic perception, adaptation learning in varying force fields, or texture identification.

Modulation of thermal pain-related brain activity with virtual reality: evidence from fMRI.

PubMed

Hoffman, Hunter G; Richards, Todd L; Coda, Barbara; Bills, Aric R; Blough, David; Richards, Anne L; Sharar, Sam R

2004-06-07

This study investigated the neural correlates of virtual reality analgesia. Virtual reality significantly reduced subjective pain ratings (i.e. analgesia). Using fMRI, pain-related brain activity was measured for each participant during conditions of no virtual reality and during virtual reality (order randomized). As predicted, virtual reality significantly reduced pain-related brain activity in all five regions of interest; the anterior cingulate cortex, primary and secondary somatosensory cortex, insula, and thalamus (p<0.002, corrected). Results showed direct modulation of human brain pain responses by virtual reality distraction. Copyright 2004 Lippincott Williams and Wilkins

Learning in a Virtual Environment Using Haptic Systems for Movement Re-Education: Can This Medium Be Used for Remodeling Other Behaviors and Actions?

PubMed Central

Merians, Alma S; Fluet, Gerard G; Qiu, Qinyin; Lafond, Ian; Adamovich, Sergei V

2011-01-01

Robotic systems that are interfaced with virtual reality gaming and task simulations are increasingly being developed to provide repetitive intensive practice to promote increased compliance and facilitate better outcomes in rehabilitation post-stroke. A major development in the use of virtual environments (VEs) has been to incorporate tactile information and interaction forces into what was previously an essentially visual experience. Robots of varying complexity are being interfaced with more traditional virtual presentations to provide haptic feedback that enriches the sensory experience and adds physical task parameters. This provides forces that produce biomechanical and neuromuscular interactions with the VE that approximate real-world movement more accurately than visual-only VEs, simulating the weight and force found in upper extremity tasks. The purpose of this article is to present an overview of several systems that are commercially available for ambulation training and for training movement of the upper extremity. We will also report on the system that we have developed (NJIT-RAVR system) that incorporates motivating and challenging haptic feedback effects into VE simulations to facilitate motor recovery of the upper extremity post-stroke. The NJIT-RAVR system trains both the upper arm and the hand. The robotic arm acts as an interface between the participants and the VEs, enabling multiplanar movements against gravity in a three-dimensional workspace. The ultimate question is whether this medium can provide a motivating, challenging, gaming experience with dramatically decreased physical difficulty levels, which would allow for participation by an obese person and facilitate greater adherence to exercise regimes. PMID:21527097

Sensory-motor deficits in children with fetal alcohol spectrum disorder assessed using a robotic virtual reality platform.

PubMed

Williams, Loriann; Jackson, Carl P T; Choe, Noreen; Pelland, Lucie; Scott, Stephen H; Reynolds, James N

2014-01-01

Fetal alcohol spectrum disorder (FASD) is associated with a large number of cognitive and sensory-motor deficits. In particular, the accurate assessment of sensory-motor deficits in children with FASD is not always simple and relies on clinical assessment tools that may be coarse and subjective. Here we present a new approach: using robotic technology to accurately and objectively assess motor deficits of children with FASD in a center-out reaching task. A total of 152 typically developing children and 31 children with FASD, all aged between 5 and 18 were assessed using a robotic exoskeleton device coupled with a virtual reality projection system. Children made reaching movements to 8 peripheral targets in a random order. Reach trajectories were subsequently analyzed to extract 12 parameters that had been previously determined to be good descriptors of a reaching movement, and these parameters were compared for each child with FASD to a normative model derived from the performance of the typically developing population. Compared with typically developing children, the children with FASD were found to be significantly impaired on most of the parameters measured, with the greatest deficits found in initial movement direction error. Also, children with FASD tended to fail more parameters than typically developing children: 95% of typically developing children failed fewer than 3 parameters compared with 69% of children with FASD. These results were particularly pronounced for younger children. The current study has shown that robotic technology is a sensitive and powerful tool that provides increased specificity regarding the type of motor problems exhibited by children with FASD. The high frequency of motor deficits in children with FASD suggests that interventions aimed at stimulating and/or improving motor development should routinely be considered for this population. Copyright © 2013 by the Research Society on Alcoholism.

My thoughts through a robot's eyes: an augmented reality-brain-machine interface.

PubMed

Kansaku, Kenji; Hata, Naoki; Takano, Kouji

2010-02-01

A brain-machine interface (BMI) uses neurophysiological signals from the brain to control external devices, such as robot arms or computer cursors. Combining augmented reality with a BMI, we show that the user's brain signals successfully controlled an agent robot and operated devices in the robot's environment. The user's thoughts became reality through the robot's eyes, enabling the augmentation of real environments outside the anatomy of the human body.

Augmented Reality Robot-assisted Radical Prostatectomy: Preliminary Experience.

PubMed

Porpiglia, Francesco; Fiori, Cristian; Checcucci, Enrico; Amparore, Daniele; Bertolo, Riccardo

2018-05-01

To present our preliminary experience with augmented reality robot-assisted radical prostatectomy (AR-RARP). From June to August 2017, patients candidate to RARP were enrolled and underwent high-resolution multi-parametric magnetic resonance imaging (1-mm slices) according to dedicated protocol. The obtained three-dimensional (3D) reconstruction was integrated in the robotic console to perform AR-RARP. According to the staging at magnetic resonance imaging or reconstruction, in case of cT2 prostate cancer, intrafascial nerve sparing (NS) was performed: a mark was placed on the prostate capsule to indicate the virtual underlying intraprostatic lesion; in case of cT3, standard NS AR-RARP was scheduled with AR-guided biopsy at the level of suspected extracapsular extension (ECE). Prostate specimens were scanned to assess the 3D model concordance. Sixteen patients underwent intrafascial NS technique (cT2), whereas 14 underwent standard NS+ selective biopsy of suspected ECE (cT3). Final pathology confirmed clinical staging. Positive surgical margins' rate was 30% (no positive surgical margins in pT2). In patients whose intraprostatic lesions were marked, final pathology confirmed lesion location. In patients with suspected ECE, AR-guided selective biopsies confirmed the ECE location, with 11 of 14 biopsies (78%) positive for prostate cancer. Prostate specimens were scanned with finding of a good overlap. The mismatch between 3D reconstruction and scanning ranged from 1 to 5 mm. In 85% of the entire surface, the mismatch was <3 mm. In our preliminary experience, AR-RARP seems to be safe and effective. The accuracy of 3D reconstruction seemed to be promising. This technology has still limitations: the virtual models are manually oriented and rigid. Future collaborations with bioengineers will allow overcoming these limitations. Copyright © 2018 Elsevier Inc. All rights reserved.

Environments for online maritime simulators with cloud computing capabilities

NASA Astrophysics Data System (ADS)

Raicu, Gabriel; Raicu, Alexandra

2016-12-01

This paper presents the cloud computing environments, network principles and methods for graphical development in realistic naval simulation, naval robotics and virtual interactions. The aim of this approach is to achieve a good simulation quality in large networked environments using open source solutions designed for educational purposes. Realistic rendering of maritime environments requires near real-time frameworks with enhanced computing capabilities during distance interactions. E-Navigation concepts coupled with the last achievements in virtual and augmented reality will enhance the overall experience leading to new developments and innovations. We have to deal with a multiprocessing situation using advanced technologies and distributed applications using remote ship scenario and automation of ship operations.

Development of a precision multimodal surgical navigation system for lung robotic segmentectomy

PubMed Central

Soldea, Valentin; Lachkar, Samy; Rinieri, Philippe; Sarsam, Mathieu; Bottet, Benjamin; Peillon, Christophe

2018-01-01

Minimally invasive sublobar anatomical resection is becoming more and more popular to manage early lung lesions. Robotic-assisted thoracic surgery (RATS) is unique in comparison with other minimally invasive techniques. Indeed, RATS is able to better integrate multiple streams of information including advanced imaging techniques, in an immersive experience at the level of the robotic console. Our aim was to describe three-dimensional (3D) imaging throughout the surgical procedure from preoperative planning to intraoperative assistance and complementary investigations such as radial endobronchial ultrasound (R-EBUS) and virtual bronchoscopy for pleural dye marking. All cases were operated using the DaVinci SystemTM. Modelisation was provided by Visible Patient™ (Strasbourg, France). Image integration in the operative field was achieved using the Tile Pro multi display input of the DaVinci console. Our experience was based on 114 robotic segmentectomies performed between January 2012 and October 2017. The clinical value of 3D imaging integration was evaluated in 2014 in a pilot study. Progressively, we have reached the conclusion that the use of such an anatomic model improves the safety and reliability of procedures. The multimodal system including 3D imaging has been used in more than 40 patients so far and demonstrated a perfect operative anatomic accuracy. Currently, we are developing an original virtual reality experience by exploring 3D imaging models at the robotic console level. The act of operating is being transformed and the surgeon now oversees a complex system that improves decision making. PMID:29785294

Development of a precision multimodal surgical navigation system for lung robotic segmentectomy.

PubMed

Baste, Jean Marc; Soldea, Valentin; Lachkar, Samy; Rinieri, Philippe; Sarsam, Mathieu; Bottet, Benjamin; Peillon, Christophe

2018-04-01

Minimally invasive sublobar anatomical resection is becoming more and more popular to manage early lung lesions. Robotic-assisted thoracic surgery (RATS) is unique in comparison with other minimally invasive techniques. Indeed, RATS is able to better integrate multiple streams of information including advanced imaging techniques, in an immersive experience at the level of the robotic console. Our aim was to describe three-dimensional (3D) imaging throughout the surgical procedure from preoperative planning to intraoperative assistance and complementary investigations such as radial endobronchial ultrasound (R-EBUS) and virtual bronchoscopy for pleural dye marking. All cases were operated using the DaVinci System TM . Modelisation was provided by Visible Patient™ (Strasbourg, France). Image integration in the operative field was achieved using the Tile Pro multi display input of the DaVinci console. Our experience was based on 114 robotic segmentectomies performed between January 2012 and October 2017. The clinical value of 3D imaging integration was evaluated in 2014 in a pilot study. Progressively, we have reached the conclusion that the use of such an anatomic model improves the safety and reliability of procedures. The multimodal system including 3D imaging has been used in more than 40 patients so far and demonstrated a perfect operative anatomic accuracy. Currently, we are developing an original virtual reality experience by exploring 3D imaging models at the robotic console level. The act of operating is being transformed and the surgeon now oversees a complex system that improves decision making.

Robots integrated with virtual reality simulations for customized motor training in a person with upper extremity hemiparesis: a case report

PubMed Central

Fluet, Gerard G.; Merians, Alma S.; Qiu, Qinyin; Lafond, Ian; Saleh, Soha; Ruano, Viviana; Delmonico, Andrea R.; Adamovich, Sergei V.

2014-01-01

Background and Purpose A majority of studies examining repetitive task practice facilitated by robots for the treatment of upper extremity paresis utilize standardized protocols applied to large groups. Others utilize interventions tailored to patients but don't describe the clinical decision making process utilized to develop and modify interventions. This case report will describe a robot-based intervention customized to match the goals and clinical presentation of a gentleman with upper extremity hemiparesis secondary to stroke. Methods PM is an 85 year-old man with left hemiparesis secondary to an intracerebral hemorrhage five years prior to examination. Outcomes were measured before and after a one month period of home therapy and after a one month robotic intervention. The intervention was designed to address specific impairments identified during his PT examination. When necessary, activities were modified based on the patient's response to his first week of treatment. Outcomes PM trained twelve sessions using six virtually simulated activities. Modifications to original configurations of these activities resulted in performance improvements in five of these activities. PM demonstrated a 35 second improvement in Jebsen Test of Hand Function time and a 44 second improvement in Wolf Motor Function Test time subsequent to the robotic training intervention. Reaching kinematics, 24 hour activity measurement and the Hand and Activities of Daily Living scales of the Stroke Impact Scale all improved as well. Discussion A customized program of robotically facilitated rehabilitation resulted in large short-term improvements in several measurements of upper extremity function in a patient with chronic hemiparesis. PMID:22592063

Virtual reality in the treatment of persecutory delusions: randomised controlled experimental study testing how to reduce delusional conviction.

PubMed

Freeman, Daniel; Bradley, Jonathan; Antley, Angus; Bourke, Emilie; DeWeever, Natalie; Evans, Nicole; Černis, Emma; Sheaves, Bryony; Waite, Felicity; Dunn, Graham; Slater, Mel; Clark, David M

2016-07-01

Persecutory delusions may be unfounded threat beliefs maintained by safety-seeking behaviours that prevent disconfirmatory evidence being successfully processed. Use of virtual reality could facilitate new learning. To test the hypothesis that enabling patients to test the threat predictions of persecutory delusions in virtual reality social environments with the dropping of safety-seeking behaviours (virtual reality cognitive therapy) would lead to greater delusion reduction than exposure alone (virtual reality exposure). Conviction in delusions and distress in a real-world situation were assessed in 30 patients with persecutory delusions. Patients were then randomised to virtual reality cognitive therapy or virtual reality exposure, both with 30 min in graded virtual reality social environments. Delusion conviction and real-world distress were then reassessed. In comparison with exposure, virtual reality cognitive therapy led to large reductions in delusional conviction (reduction 22.0%, P = 0.024, Cohen's d = 1.3) and real-world distress (reduction 19.6%, P = 0.020, Cohen's d = 0.8). Cognitive therapy using virtual reality could prove highly effective in treating delusions. © The Royal College of Psychiatrists 2016.

Virtual reality in the treatment of persecutory delusions: randomised controlled experimental study testing how to reduce delusional conviction

PubMed Central

Freeman, Daniel; Bradley, Jonathan; Antley, Angus; Bourke, Emilie; DeWeever, Natalie; Evans, Nicole; Černis, Emma; Sheaves, Bryony; Waite, Felicity; Dunn, Graham; Slater, Mel; Clark, David M.

2016-01-01

Background Persecutory delusions may be unfounded threat beliefs maintained by safety-seeking behaviours that prevent disconfirmatory evidence being successfully processed. Use of virtual reality could facilitate new learning. Aims To test the hypothesis that enabling patients to test the threat predictions of persecutory delusions in virtual reality social environments with the dropping of safety-seeking behaviours (virtual reality cognitive therapy) would lead to greater delusion reduction than exposure alone (virtual reality exposure). Method Conviction in delusions and distress in a real-world situation were assessed in 30 patients with persecutory delusions. Patients were then randomised to virtual reality cognitive therapy or virtual reality exposure, both with 30 min in graded virtual reality social environments. Delusion conviction and real-world distress were then reassessed. Results In comparison with exposure, virtual reality cognitive therapy led to large reductions in delusional conviction (reduction 22.0%, P = 0.024, Cohen's d = 1.3) and real-world distress (reduction 19.6%, P = 0.020, Cohen's d = 0.8). Conclusion Cognitive therapy using virtual reality could prove highly effective in treating delusions. PMID:27151071

Virtual reality and paranoid ideations in people with an 'at-risk mental state' for psychosis.

PubMed

Valmaggia, Lucia R; Freeman, Daniel; Green, Catherine; Garety, Philippa; Swapp, David; Antley, Angus; Prescott, Corinne; Fowler, David; Kuipers, Elizabeth; Bebbington, Paul; Slater, Mel; Broome, Matthew; McGuire, Philip K

2007-12-01

Virtual reality provides a means of studying paranoid thinking in controlled laboratory conditions. However, this method has not been used with a clinical group. To establish the feasibility and safety of using virtual reality methodology in people with an at-risk mental state and to investigate the applicability of a cognitive model of paranoia to this group. Twenty-one participants with an at-risk mental state were assessed before and after entering a virtual reality environment depicting the inside of an underground train. Virtual reality did not raise levels of distress at the time of testing or cause adverse experiences over the subsequent week. Individuals attributed mental states to virtual reality characters including hostile intent. Persecutory ideation in virtual reality was predicted by higher levels of trait paranoia, anxiety, stress, immersion in virtual reality, perseveration and interpersonal sensitivity. Virtual reality is an acceptable experimental technique for use with individuals with at-risk mental states. Paranoia in virtual reality was understandable in terms of the cognitive model of persecutory delusions.

Transferability of Virtual Reality, Simulation-Based, Robotic Suturing Skills to a Live Porcine Model in Novice Surgeons: A Single-Blind Randomized Controlled Trial.

PubMed

Vargas, Maria V; Moawad, Gaby; Denny, Kathryn; Happ, Lindsey; Misa, Nana Yaa; Margulies, Samantha; Opoku-Anane, Jessica; Abi Khalil, Elias; Marfori, Cherie

To assess whether a robotic simulation curriculum for novice surgeons can improve performance of a suturing task in a live porcine model. Randomized controlled trial (Canadian Task Force classification I). Academic medical center. Thirty-five medical students without robotic surgical experience. Participants were enrolled in an online session of training modules followed by an in-person orientation. Baseline performance testing on the Mimic Technologies da Vinci Surgical Simulator (dVSS) was also performed. Participants were then randomly assigned to the completion of 4 dVSS training tasks (camera clutching 1, suture sponge 1 and 2, and tubes) versus no further training. The intervention group performed each dVSS task until proficiency or up to 10 times. A final suturing task was performed on a live porcine model, which was video recorded and blindly assessed by experienced surgeons. The primary outcomes were Global Evaluative Assessment of Robotic Skills (GEARS) scores and task time. The study had 90% power to detect a mean difference of 3 points on the GEARS scale, assuming a standard deviation (SD) of 2.65, and 80% power to detect a mean difference of 3 minutes, assuming an SD of 3 minutes. There were no differences in demographics and baseline skills between the 2 groups. No significant differences in task time in minutes or GEARS scores were seen for the final suturing task between the intervention and control groups, respectively (9.2 [2.65] vs 9.9 [2.07] minutes, p = .406; and 15.37 [2.51] vs 15.25 [3.38], p = .603). The 95% confidence interval for the difference in mean task times was -2.36 to .96 minutes and for mean GEARS scores -1.91 to 2.15 points. Live suturing task performance was not improved with a proficiency-based virtual reality simulation suturing curriculum compared with standard orientation to the da Vinci robotic console in a group of novice surgeons. Published by Elsevier Inc.

Virtual reality simulators and training in laparoscopic surgery.

PubMed

Yiannakopoulou, Eugenia; Nikiteas, Nikolaos; Perrea, Despina; Tsigris, Christos

2015-01-01

Virtual reality simulators provide basic skills training without supervision in a controlled environment, free of pressure of operating on patients. Skills obtained through virtual reality simulation training can be transferred on the operating room. However, relative evidence is limited with data available only for basic surgical skills and for laparoscopic cholecystectomy. No data exist on the effect of virtual reality simulation on performance on advanced surgical procedures. Evidence suggests that performance on virtual reality simulators reliably distinguishes experienced from novice surgeons Limited available data suggest that independent approach on virtual reality simulation training is not different from proctored approach. The effect of virtual reality simulators training on acquisition of basic surgical skills does not seem to be different from the effect the physical simulators. Limited data exist on the effect of virtual reality simulation training on the acquisition of visual spatial perception and stress coping skills. Undoubtedly, virtual reality simulation training provides an alternative means of improving performance in laparoscopic surgery. However, future research efforts should focus on the effect of virtual reality simulation on performance in the context of advanced surgical procedure, on standardization of training, on the possibility of synergistic effect of virtual reality simulation training combined with mental training, on personalized training. Copyright © 2014 Surgical Associates Ltd. Published by Elsevier Ltd. All rights reserved.

A telemedicine system for enabling teaching activities.

PubMed

Masero, V; Sanchez, F M; Uson, J

2000-01-01

In order to improve the distance teaching of minimally invasive surgery techniques, an integrated system has been developed. It comprises a telecommunications system, a server, a workstation, some medical peripherals and several computer applications developed in the Minimally Invasive Surgery Centre. The latest peripherals, such as robotized teleoperating systems for telesurgery and virtual reality peripherals, have been added. The visualization of the zone to be treated, along with the teacher's explanations, enables the student to understand the procedures of the operation much better.

Mobile Applications and Multi-User Virtual Reality Simulations

NASA Technical Reports Server (NTRS)

Gordillo, Orlando Enrique

2016-01-01

This is my third internship with NASA and my second one at the Johnson Space Center. I work within the engineering directorate in ER7 (Software Robotics and Simulations Division) at a graphics lab called IGOAL. We are a very well-rounded lab because we have dedicated software developers and dedicated 3D artist, and when you combine the two, what you get is the ability to create many different things such as interactive simulations, 3D models, animations, and mobile applications.

Construction of a high-tech operating room for image-guided surgery using VR.

PubMed

Suzuki, Naoki; Hattori, Asaki; Suzuki, Shigeyuki; Otake, Yoshito; Hayashibe, Mitsuhiro; Kobayashi, Susumu; Nezu, Takehiko; Sakai, Haruo; Umezawa, Yuji

2005-01-01

This project aimed to construct an operating room to implement high dimensional (3D, 4D) medical imaging and medical virtual reality techniques that would enable clinical tests for new surgical procedures. We designed and constructed such an operating room at Dai-san Hospital, the Jikei Univ. School of Medicine, Tokyo, Japan. The room was equipped with various facilities for image-guided, robot and tele- surgery. In this report, we describe an outline of our "high-tech operating room" and future plans.

Virtual Reality Pain Control During Burn Wound Debridement of Combat-Related Burn Injuries Using Robot-Like Arm Mounted VR Goggles

DTIC Science & Technology

2011-07-01

naturally contracts as it heals. Physical therapy stretches help to counteract contraction, increasing skin elasticity, and en- hancing range of motion.3...excru- ciating pain during medical procedures such as wound clean- ing and physical therapy .4 Although opioids are the cornerstone analgesic for patients...Used at low doses, ketamine is a non-barbiturate intravenous anesthetic that is used as part of a multi-modal therapy . Ketamine does not cause

Small Business Innovations

NASA Technical Reports Server (NTRS)

1995-01-01

The PER-Force Handcontroller was originally developed for the International Space Station under a Johnson Space Center Small Business Innovation Research (SBIR) contract. Produced by Cybernet Systems Corporation, the unit is a force-reflecting system that manipulates robots or objects by "feel." The Handcontroller moves in six degrees of freedom, with real and virtual reality forces simulated by a 3-D molecular modeling software package. It is used in molecular modeling in metallurgy applications, satellite docking research, and in research on military unmanned ground vehicles.

Combining Upper Limb Robotic Rehabilitation with Other Therapeutic Approaches after Stroke: Current Status, Rationale, and Challenges

PubMed Central

Grosmaire, Anne Gaëlle; Battini, Elena

2017-01-01

A better understanding of the neural substrates that underlie motor recovery after stroke has led to the development of innovative rehabilitation strategies and tools that incorporate key elements of motor skill relearning, that is, intensive motor training involving goal-oriented repeated movements. Robotic devices for the upper limb are increasingly used in rehabilitation. Studies have demonstrated the effectiveness of these devices in reducing motor impairments, but less so for the improvement of upper limb function. Other studies have begun to investigate the benefits of combined approaches that target muscle function (functional electrical stimulation and botulinum toxin injections), modulate neural activity (noninvasive brain stimulation), and enhance motivation (virtual reality) in an attempt to potentialize the benefits of robot-mediated training. The aim of this paper is to overview the current status of such combined treatments and to analyze the rationale behind them. PMID:29057269

Using virtual robot-mediated play activities to assess cognitive skills.

PubMed

Encarnação, Pedro; Alvarez, Liliana; Rios, Adriana; Maya, Catarina; Adams, Kim; Cook, Al

2014-05-01

To evaluate the feasibility of using virtual robot-mediated play activities to assess cognitive skills. Children with and without disabilities utilized both a physical robot and a matching virtual robot to perform the same play activities. The activities were designed such that successfully performing them is an indication of understanding of the underlying cognitive skills. Participants' performance with both robots was similar when evaluated by the success rates in each of the activities. Session video analysis encompassing participants' behavioral, interaction and communication aspects revealed differences in sustained attention, visuospatial and temporal perception, and self-regulation, favoring the virtual robot. The study shows that virtual robots are a viable alternative to the use of physical robots for assessing children's cognitive skills, with the potential of overcoming limitations of physical robots such as cost, reliability and the need for on-site technical support. Virtual robots can provide a vehicle for children to demonstrate cognitive understanding. Virtual and physical robots can be used as augmentative manipulation tools allowing children with disabilities to actively participate in play, educational and therapeutic activities. Virtual robots have the potential of overcoming limitations of physical robots such as cost, reliability and the need for on-site technical support.

Learning Rationales and Virtual Reality Technology in Education.

ERIC Educational Resources Information Center

Chiou, Guey-Fa

1995-01-01

Defines and describes virtual reality technology and differentiates between virtual learning environment, learning material, and learning tools. Links learning rationales to virtual reality technology to pave conceptual foundations for application of virtual reality technology education. Constructivism, case-based learning, problem-based learning,…

Virtual reality for emergency training

DOE Office of Scientific and Technical Information (OSTI.GOV)

Altinkemer, K.

1995-12-31

Virtual reality is a sequence of scenes generated by a computer as a response to the five different senses. These senses are sight, sound, taste, touch, smell. Other senses that can be used in virtual reality include balance, pheromonal, and immunological senses. Many application areas include: leisure and entertainment, medicine, architecture, engineering, manufacturing, and training. Virtual reality is especially important when it is used for emergency training and management of natural disasters including earthquakes, floods, tornados and other situations which are hard to emulate. Classical training methods for these extraordinary environments lack the realistic surroundings that virtual reality can provide.more » In order for virtual reality to be a successful training tool the design needs to include certain aspects; such as how real virtual reality should be and how much fixed cost is entailed in setting up the virtual reality trainer. There are also pricing questions regarding the price per training session on virtual reality trainer, and the appropriate training time length(s).« less

Recent trends in robot-assisted therapy environments to improve real-life functional performance after stroke.

PubMed

Johnson, Michelle J

2006-12-18

Upper and lower limb robotic tools for neuro-rehabilitation are effective in reducing motor impairment but they are limited in their ability to improve real world function. There is a need to improve functional outcomes after robot-assisted therapy. Improvements in the effectiveness of these environments may be achieved by incorporating into their design and control strategies important elements key to inducing motor learning and cerebral plasticity such as mass-practice, feedback, task-engagement, and complex problem solving. This special issue presents nine articles. Novel strategies covered in this issue encourage more natural movements through the use of virtual reality and real objects and faster motor learning through the use of error feedback to guide acquisition of natural movements that are salient to real activities. In addition, several articles describe novel systems and techniques that use of custom and commercial games combined with new low-cost robot systems and a humanoid robot to embody the " supervisory presence" of the therapy as possible solutions to exercise compliance in under-supervised environments such as the home.

Recent trends in robot-assisted therapy environments to improve real-life functional performance after stroke

PubMed Central

Johnson, Michelle J

2006-01-01

Upper and lower limb robotic tools for neuro-rehabilitation are effective in reducing motor impairment but they are limited in their ability to improve real world function. There is a need to improve functional outcomes after robot-assisted therapy. Improvements in the effectiveness of these environments may be achieved by incorporating into their design and control strategies important elements key to inducing motor learning and cerebral plasticity such as mass-practice, feedback, task-engagement, and complex problem solving. This special issue presents nine articles. Novel strategies covered in this issue encourage more natural movements through the use of virtual reality and real objects and faster motor learning through the use of error feedback to guide acquisition of natural movements that are salient to real activities. In addition, several articles describe novel systems and techniques that use of custom and commercial games combined with new low-cost robot systems and a humanoid robot to embody the " supervisory presence" of the therapy as possible solutions to exercise compliance in under-supervised environments such as the home. PMID:17176474

Research on the man in the loop control system of the robot arm based on gesture control

NASA Astrophysics Data System (ADS)

Xiao, Lifeng; Peng, Jinbao

2017-03-01

The Man in the loop control system of the robot arm based on gesture control research complex real-world environment, which requires the operator to continuously control and adjust the remote manipulator, as the background, completes the specific mission human in the loop entire system as the research object. This paper puts forward a kind of robot arm control system of Man in the loop based on gesture control, by robot arm control system based on gesture control and Virtual reality scene feedback to enhance immersion and integration of operator, to make operator really become a part of the whole control loop. This paper expounds how to construct a man in the loop control system of the robot arm based on gesture control. The system is a complex system of human computer cooperative control, but also people in the loop control problem areas. The new system solves the problems that the traditional method has no immersion feeling and the operation lever is unnatural, the adjustment time is long, and the data glove mode wears uncomfortable and the price is expensive.

[Initial results with the Munich knee simulator].

PubMed

Frey, M; Riener, R; Burgkart, R; Pröll, T

2002-01-01

In orthopaedics more than 50 different clinical knee joint evaluation tests exist that have to be trained in orthopaedic education. Often it is not possible to obtain sufficient practical training in a clinical environment. The training can be improved by Virtual Reality technology. In the frame of the Munich Knee Joint Simulation project an artificial leg with anatomical properties is attached by a force-torque sensor to an industrial robot. The recorded forces and torques are the input for a simple biomechanical model of the human knee joint. The robot is controlled in such way that the user gets the feeling he moves a real leg. The leg is embedded in a realistic environment with a couch and a patient on it.

Virtual Reality and the Virtual Library.

ERIC Educational Resources Information Center

Oppenheim, Charles

1993-01-01

Explains virtual reality, including proper and improper uses of the term, and suggests ways that libraries might be affected by it. Highlights include elements of virtual reality systems; possible virtual reality applications, including architecture, the chemical industry, transport planning, armed forces, and entertainment; and the virtual…

Virtual Reality

DTIC Science & Technology

1993-04-01

until exhausted. SECURITY CLASSIFICATION OF THIS PAGE All other editions are obsolete. UNCLASSIFIED " VIRTUAL REALITY JAMES F. DAILEY, LIEUTENANT COLONEL...US" This paper reviews the exciting field of virtual reality . The author describes the basic concepts of virtual reality and finds that its numerous...potential benefits to society could revolutionize everyday life. The various components that make up a virtual reality system are described in detail

Physical Scaffolding Accelerates the Evolution of Robot Behavior.

PubMed

Buckingham, David; Bongard, Josh

2017-01-01

In some evolutionary robotics experiments, evolved robots are transferred from simulation to reality, while sensor/motor data flows back from reality to improve the next transferral. We envision a generalization of this approach: a simulation-to-reality pipeline. In this pipeline, increasingly embodied agents flow up through a sequence of increasingly physically realistic simulators, while data flows back down to improve the next transferral between neighboring simulators; physical reality is the last link in this chain. As a first proof of concept, we introduce a two-link chain: A fast yet low-fidelity ( lo-fi) simulator hosts minimally embodied agents, which gradually evolve controllers and morphologies to colonize a slow yet high-fidelity ( hi-fi) simulator. The agents are thus physically scaffolded. We show here that, given the same computational budget, these physically scaffolded robots reach higher performance in the hi-fi simulator than do robots that only evolve in the hi-fi simulator, but only for a sufficiently difficult task. These results suggest that a simulation-to-reality pipeline may strike a good balance between accelerating evolution in simulation while anchoring the results in reality, free the investigator from having to prespecify the robot's morphology, and pave the way to scalable, automated, robot-generating systems.

A Comparison of Robotic Simulation Performance on Basic Virtual Reality Skills: Simulator Subjective Versus Objective Assessment Tools.

PubMed

Dubin, Ariel K; Smith, Roger; Julian, Danielle; Tanaka, Alyssa; Mattingly, Patricia

To answer the question of whether there is a difference between robotic virtual reality simulator performance assessment and validated human reviewers. Current surgical education relies heavily on simulation. Several assessment tools are available to the trainee, including the actual robotic simulator assessment metrics and the Global Evaluative Assessment of Robotic Skills (GEARS) metrics, both of which have been independently validated. GEARS is a rating scale through which human evaluators can score trainees' performances on 6 domains: depth perception, bimanual dexterity, efficiency, force sensitivity, autonomy, and robotic control. Each domain is scored on a 5-point Likert scale with anchors. We used 2 common robotic simulators, the dV-Trainer (dVT; Mimic Technologies Inc., Seattle, WA) and the da Vinci Skills Simulator (dVSS; Intuitive Surgical, Sunnyvale, CA), to compare the performance metrics of robotic surgical simulators with the GEARS for a basic robotic task on each simulator. A prospective single-blinded randomized study. A surgical education and training center. Surgeons and surgeons in training. Demographic information was collected including sex, age, level of training, specialty, and previous surgical and simulator experience. Subjects performed 2 trials of ring and rail 1 (RR1) on each of the 2 simulators (dVSS and dVT) after undergoing randomization and warm-up exercises. The second RR1 trial simulator performance was recorded, and the deidentified videos were sent to human reviewers using GEARS. Eight different simulator assessment metrics were identified and paired with a similar performance metric in the GEARS tool. The GEARS evaluation scores and simulator assessment scores were paired and a Spearman rho calculated for their level of correlation. Seventy-four subjects were enrolled in this randomized study with 9 subjects excluded for missing or incomplete data. There was a strong correlation between the GEARS score and the simulator metric score for time to complete versus efficiency, time to complete versus total score, economy of motion versus depth perception, and overall score versus total score with rho coefficients greater than or equal to 0.70; these were significant (p < .0001). Those with weak correlation (rho ≥0.30) were bimanual dexterity versus economy of motion, efficiency versus master workspace range, bimanual dexterity versus master workspace range, and robotic control versus instrument collisions. On basic VR tasks, several simulator metrics are well matched with GEARS scores assigned by human reviewers, but others are not. Identifying these matches/mismatches can improve the training and assessment process when using robotic surgical simulators. Copyright © 2017 American Association of Gynecologic Laparoscopists. Published by Elsevier Inc. All rights reserved.

Virtual Reality and Its Potential Application in Education and Training.

ERIC Educational Resources Information Center

Milheim, William D.

1995-01-01

An overview is provided of current trends in virtual reality research and development, including discussion of hardware, types of virtual reality, and potential problems with virtual reality. Implications for education and training are explored. (Author/JKP)

A Virtual Reality-Based Simulation of Abdominal Surgery

DTIC Science & Technology

1994-06-30

415) 591-7881 In! IhNiI 1 SHORT TITLE: A Virtual Reality -Based Simulation of Abdominal Surgery REPORTING PERIOD: October 31, 1993-June 30, 1994 The...Report - A Virtual Reality -Based Simulation Of Abdominal Surgery Page 2 June 21, 1994 TECHNICAL REPORT SUMMARY Virtual Reality is a marriage between...applications of this technology. Virtual reality systems can be used to teach surgical anatomy, diagnose surgical problems, plan operations. simulate and

Establishment of Next-Generation Neurosurgery Research and Training Laboratory with Integrated Human Performance Monitoring.

PubMed

Bernardo, Antonio

2017-10-01

Quality of neurosurgical care and patient outcomes are inextricably linked to surgical and technical proficiency and a thorough working knowledge of microsurgical anatomy. Neurosurgical laboratory-based cadaveric training is essential for the development and refinement of technical skills before their use on a living patient. Recent biotechnological advances including 3-dimensional (3D) microscopy and endoscopy, 3D printing, virtual reality, surgical simulation, surgical robotics, and advanced neuroimaging have proved to reduce the learning curve, improve conceptual understanding of complex anatomy, and enhance visuospatial skills in neurosurgical training. Until recently, few means have allowed surgeons to obtain integrated surgical and technological training in an operating room setting. We report on a new model, currently in use at our institution, for technologically integrated surgical training and innovation using a next-generation microneurosurgery skull base laboratory designed to recreate the setting of a working operating room. Each workstation is equipped with a 3D surgical microscope, 3D endoscope, surgical drills, operating table with a Mayfield head holder, and a complete set of microsurgical tools. The laboratory also houses a neuronavigation system, a surgical robotic, a surgical planning system, 3D visualization, virtual reality, and computerized simulation for training of surgical procedures and visuospatial skills. In addition, the laboratory is equipped with neurophysiological monitoring equipment in order to conduct research into human factors in surgery and the respective roles of workload and fatigue on surgeons' performance. Copyright © 2017 Elsevier Inc. All rights reserved.

Learning in a virtual environment using haptic systems for movement re-education: can this medium be used for remodeling other behaviors and actions?

PubMed

Merians, Alma S; Fluet, Gerard G; Qiu, Qinyin; Lafond, Ian; Adamovich, Sergei V

2011-03-01

Robotic systems that are interfaced with virtual reality gaming and task simulations are increasingly being developed to provide repetitive intensive practice to promote increased compliance and facilitate better outcomes in rehabilitation post-stroke. A major development in the use of virtual environments (VEs) has been to incorporate tactile information and interaction forces into what was previously an essentially visual experience. Robots of varying complexity are being interfaced with more traditional virtual presentations to provide haptic feedback that enriches the sensory experience and adds physical task parameters. This provides forces that produce biomechanical and neuromuscular interactions with the VE that approximate real-world movement more accurately than visual-only VEs, simulating the weight and force found in upper extremity tasks. The purpose of this article is to present an overview of several systems that are commercially available for ambulation training and for training movement of the upper extremity. We will also report on the system that we have developed (NJIT-RAVR system) that incorporates motivating and challenging haptic feedback effects into VE simulations to facilitate motor recovery of the upper extremity post-stroke. The NJIT-RAVR system trains both the upper arm and the hand. The robotic arm acts as an interface between the participants and the VEs, enabling multiplanar movements against gravity in a three-dimensional workspace. The ultimate question is whether this medium can provide a motivating, challenging, gaming experience with dramatically decreased physical difficulty levels, which would allow for participation by an obese person and facilitate greater adherence to exercise regimes. © 2011 Diabetes Technology Society.

Neural Patterns of Reorganization after Intensive Robot-Assisted Virtual Reality Therapy and Repetitive Task Practice in Patients with Chronic Stroke

PubMed Central

Saleh, Soha; Fluet, Gerard; Qiu, Qinyin; Merians, Alma; Adamovich, Sergei V.; Tunik, Eugene

2017-01-01

Several approaches to rehabilitation of the hand following a stroke have emerged over the last two decades. These treatments, including repetitive task practice (RTP), robotically assisted rehabilitation and virtual rehabilitation activities, produce improvements in hand function but have yet to reinstate function to pre-stroke levels—which likely depends on developing the therapies to impact cortical reorganization in a manner that favors or supports recovery. Understanding cortical reorganization that underlies the above interventions is therefore critical to inform how such therapies can be utilized and improved and is the focus of the current investigation. Specifically, we compare neural reorganization elicited in stroke patients participating in two interventions: a hybrid of robot-assisted virtual reality (RAVR) rehabilitation training and a program of RTP training. Ten chronic stroke subjects participated in eight 3-h sessions of RAVR therapy. Another group of nine stroke subjects participated in eight sessions of matched RTP therapy. Functional magnetic resonance imaging (fMRI) data were acquired during paretic hand movement, before and after training. We compared the difference between groups and sessions (before and after training) in terms of BOLD intensity, laterality index of activation in sensorimotor areas, and the effective connectivity between ipsilesional motor cortex (iMC), contralesional motor cortex, ipsilesional primary somatosensory cortex (iS1), ipsilesional ventral premotor area (iPMv), and ipsilesional supplementary motor area. Last, we analyzed the relationship between changes in fMRI data and functional improvement measured by the Jebsen Taylor Hand Function Test (JTHFT), in an attempt to identify how neurophysiological changes are related to motor improvement. Subjects in both groups demonstrated motor recovery after training, but fMRI data revealed RAVR-specific changes in neural reorganization patterns. First, BOLD signal in multiple regions of interest was reduced and re-lateralized to the ipsilesional side. Second, these changes correlated with improvement in JTHFT scores. Our findings suggest that RAVR training may lead to different neurophysiological changes when compared with traditional therapy. This effect may be attributed to the influence that augmented visual and haptic feedback during RAVR training exerts over higher-order somatosensory and visuomotor areas. PMID:28928708

Virtual Reality as Innovative Approach to the Interior Designing

NASA Astrophysics Data System (ADS)

Kaleja, Pavol; Kozlovská, Mária

2017-06-01

We can observe significant potential of information and communication technologies (ICT) in interior designing field, by development of software and hardware virtual reality tools. Using ICT tools offer realistic perception of proposal in its initial idea (the study). A group of real-time visualization, supported by hardware tools like Oculus Rift HTC Vive, provides free walkthrough and movement in virtual interior with the possibility of virtual designing. By improving of ICT software tools for designing in virtual reality we can achieve still more realistic virtual environment. The contribution presented proposal of an innovative approach of interior designing in virtual reality, using the latest software and hardware ICT virtual reality technologies

The virtues of virtual reality in exposure therapy.

PubMed

Gega, Lina

2017-04-01

Virtual reality can be more effective and less burdensome than real-life exposure. Optimal virtual reality delivery should incorporate in situ direct dialogues with a therapist, discourage safety behaviours, allow for a mismatch between virtual and real exposure tasks, and encourage self-directed real-life practice between and beyond virtual reality sessions. © The Royal College of Psychiatrists 2017.

Recent results in visual servoing

NASA Astrophysics Data System (ADS)

Chaumette, François

2008-06-01

Visual servoing techniques consist in using the data provided by a vision sensor in order to control the motions of a dynamic system. Such systems are usually robot arms, mobile robots, aerial robots,… but can also be virtual robots for applications in computer animation, or even a virtual camera for applications in computer vision and augmented reality. A large variety of positioning tasks, or mobile target tracking, can be implemented by controlling from one to all the degrees of freedom of the system. Whatever the sensor configuration, which can vary from one on-board camera on the robot end-effector to several free-standing cameras, a set of visual features has to be selected at best from the image measurements available, allowing to control the degrees of freedom desired. A control law has also to be designed so that these visual features reach a desired value, defining a correct realization of the task. With a vision sensor providing 2D measurements, potential visual features are numerous, since as well 2D data (coordinates of feature points in the image, moments, …) as 3D data provided by a localization algorithm exploiting the extracted 2D measurements can be considered. It is also possible to combine 2D and 3D visual features to take the advantages of each approach while avoiding their respective drawbacks. From the selected visual features, the behavior of the system will have particular properties as for stability, robustness with respect to noise or to calibration errors, robot 3D trajectory, etc. The talk will present the main basic aspects of visual servoing, as well as technical advances obtained recently in the field inside the Lagadic group at INRIA/INRISA Rennes. Several application results will be also described.

Virtual Reality in the Classroom.

ERIC Educational Resources Information Center

Pantelidis, Veronica S.

1993-01-01

Considers the concept of virtual reality; reviews its history; describes general uses of virtual reality, including entertainment, medicine, and design applications; discusses classroom uses of virtual reality, including a software program called Virtus WalkThrough for use with a computer monitor; and suggests future possibilities. (34 references)…

Development of a virtual reality training system for endoscope-assisted submandibular gland removal.

PubMed

Miki, Takehiro; Iwai, Toshinori; Kotani, Kazunori; Dang, Jianwu; Sawada, Hideyuki; Miyake, Minoru

2016-11-01

Endoscope-assisted surgery has widely been adopted as a basic surgical procedure, with various training systems using virtual reality developed for this procedure. In the present study, a basic training system comprising virtual reality for the removal of submandibular glands under endoscope assistance was developed. The efficacy of the training system was verified in novice oral surgeons. A virtual reality training system was developed using existing haptic devices. Virtual reality models were constructed from computed tomography data to ensure anatomical accuracy. Novice oral surgeons were trained using the developed virtual reality training system. The developed virtual reality training system included models of the submandibular gland and surrounding connective tissues and blood vessels entering the submandibular gland. Cutting or abrasion of the connective tissue and manipulations, such as elevation of blood vessels, were reproduced by the virtual reality system. A training program using the developed system was devised. Novice oral surgeons were trained in accordance with the devised training program. Our virtual reality training system for endoscope-assisted removal of the submandibular gland is effective in the training of novice oral surgeons in endoscope-assisted surgery. Copyright © 2016 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Virtual reality: past, present and future.

PubMed

Gobbetti, E; Scateni, R

1998-01-01

This report provides a short survey of the field of virtual reality, highlighting application domains, technological requirements, and currently available solutions. The report is organized as follows: section 1 presents the background and motivation of virtual environment research and identifies typical application domain, section 2 discusses the characteristics a virtual reality system must have in order to exploit the perceptual and spatial skills of users, section 3 surveys current input/output devices for virtual reality, section 4 surveys current software approaches to support the creation of virtual reality systems, and section 5 summarizes the report.

Virtual Reality: Toward Fundamental Improvements in Simulation-Based Training.

ERIC Educational Resources Information Center

Thurman, Richard A.; Mattoon, Joseph S.

1994-01-01

Considers the role and effectiveness of virtual reality in simulation-based training. The theoretical and practical implications of verity, integration, and natural versus artificial interface are discussed; a three-dimensional classification scheme for virtual reality is described; and the relationship between virtual reality and other…

Virtual Reality in Schools: The Ultimate Educational Technology.

ERIC Educational Resources Information Center

Reid, Robert D.; Sykes, Wylmarie

1999-01-01

Discusses the use of virtual reality as an educational tool. Highlights include examples of virtual reality in public schools that lead to a more active learning process, simulated environments, integrating virtual reality into any curriculum, benefits to teachers and students, and overcoming barriers to implementation. (LRW)

The need for virtual reality simulators in dental education: A review.

PubMed

Roy, Elby; Bakr, Mahmoud M; George, Roy

2017-04-01

Virtual reality simulators are becoming an essential part of modern education. The benefits of Virtual reality in dentistry is constantly being assessed as a method or an adjunct to improve fine motor skills, hand-eye coordination in pre-clinical settings and overcome the monetary and intellectual challenges involved with such training. This article, while providing an overview of the virtual reality dental simulators, also looks at the link between virtual reality simulation and current pedagogical knowledge.

Manipulation and handling processes off-line programming and optimization with use of K-Roset

NASA Astrophysics Data System (ADS)

Gołda, G.; Kampa, A.

2017-08-01

Contemporary trends in development of efficient, flexible manufacturing systems require practical implementation of modern “Lean production” concepts for maximizing customer value through minimizing all wastes in manufacturing and logistics processes. Every FMS is built on the basis of automated and robotized production cells. Except flexible CNC machine tools and other equipments, the industrial robots are primary elements of the system. In the studies, authors look for wastes of time and cost in real tasks of robots, during manipulation processes. According to aspiration for optimization of handling and manipulation processes with use of the robots, the application of modern off-line programming methods and computer simulation, is the best solution and it is only way to minimize unnecessary movements and other instructions. The modelling process of robotized production cell and offline programming of Kawasaki robots in AS-Language will be described. The simulation of robotized workstation will be realized with use of virtual reality software K-Roset. Authors show the process of industrial robot’s programs improvement and optimization in terms of minimizing the number of useless manipulator movements and unnecessary instructions. This is realized in order to shorten the time of production cycles. This will also reduce costs of handling, manipulations and technological process.

Walking training associated with virtual reality-based training increases walking speed of individuals with chronic stroke: systematic review with meta-analysis.

PubMed

Rodrigues-Baroni, Juliana M; Nascimento, Lucas R; Ada, Louise; Teixeira-Salmela, Luci F

2014-01-01

To systematically review the available evidence on the efficacy of walking training associated with virtual reality-based training in patients with stroke. The specific questions were: Is walking training associated with virtual reality-based training effective in increasing walking speed after stroke? Is this type of intervention more effective in increasing walking speed, than non-virtual reality-based walking interventions? A systematic review with meta-analysis of randomized clinical trials was conducted. Participants were adults with chronic stroke and the experimental intervention was walking training associated with virtual reality-based training to increase walking speed. The outcome data regarding walking speed were extracted from the eligible trials and were combined using a meta-analysis approach. Seven trials representing eight comparisons were included in this systematic review. Overall, the virtual reality-based training increased walking speed by 0.17 m/s (IC 95% 0.08 to 0.26), compared with placebo/nothing or non-walking interventions. In addition, the virtual reality-based training increased walking speed by 0.15 m/s (IC 95% 0.05 to 0.24), compared with non-virtual reality walking interventions. This review provided evidence that walking training associated with virtual reality-based training was effective in increasing walking speed after stroke, and resulted in better results than non-virtual reality interventions.

Walking training associated with virtual reality-based training increases walking speed of individuals with chronic stroke: systematic review with meta-analysis

PubMed Central

Rodrigues-Baroni, Juliana M.; Nascimento, Lucas R.; Ada, Louise; Teixeira-Salmela, Luci F.

2014-01-01

OBJECTIVE: To systematically review the available evidence on the efficacy of walking training associated with virtual reality-based training in patients with stroke. The specific questions were: Is walking training associated with virtual reality-based training effective in increasing walking speed after stroke? Is this type of intervention more effective in increasing walking speed, than non-virtual reality-based walking interventions? METHOD: A systematic review with meta-analysis of randomized clinical trials was conducted. Participants were adults with chronic stroke and the experimental intervention was walking training associated with virtual reality-based training to increase walking speed. The outcome data regarding walking speed were extracted from the eligible trials and were combined using a meta-analysis approach. RESULTS: Seven trials representing eight comparisons were included in this systematic review. Overall, the virtual reality-based training increased walking speed by 0.17 m/s (IC 95% 0.08 to 0.26), compared with placebo/nothing or non-walking interventions. In addition, the virtual reality-based training increased walking speed by 0.15 m/s (IC 95% 0.05 to 0.24), compared with non-virtual reality walking interventions. CONCLUSIONS: This review provided evidence that walking training associated with virtual reality-based training was effective in increasing walking speed after stroke, and resulted in better results than non-virtual reality interventions. PMID:25590442

A magnetic compatible supernumerary robotic finger for functional magnetic resonance imaging (fMRI) acquisitions: Device description and preliminary results.

PubMed

Hussain, Irfan; Santarnecchi, Emiliano; Leo, Andrea; Ricciardi, Emiliano; Rossi, Simone; Prattichizzo, Domenico

2017-07-01

The Supernumerary robotic limbs are a recently introduced class of wearable robots that, differently from traditional prostheses and exoskeletons, aim at adding extra effectors (i.e., arms, legs, or fingers) to the human user, rather than substituting or enhancing the natural ones. However, it is still undefined whether the use of supernumerary robotic limbs could specifically lead to neural modifications in brain dynamics. The illusion of owning the part of body has been already proven in many experimental observations, such as those relying on multisensory integration (e.g., rubber hand illusion), prosthesis and even on virtual reality. In this paper we present a description of a novel magnetic compatible supernumerary robotic finger together with preliminary observations from two functional magnetic resonance imaging (fMRI) experiments, in which brain activity was measured before and after a period of training with the robotic device, and during the use of the novel MRI-compatible version of the supernumerary robotic finger. Results showed that the usage of the MR-compatible robotic finger is safe and does not produce artifacts on MRI images. Moreover, the training with the supernumerary robotic finger recruits a network of motor-related cortical regions (i.e. primary and supplementary motor areas), hence the same motor network of a fully physiological voluntary motor gestures.

Therapists' perception of benefits and costs of using virtual reality treatments.

PubMed

Segal, Robert; Bhatia, Maneet; Drapeau, Martin

2011-01-01

Research indicates that virtual reality is effective in the treatment of many psychological difficulties and is being used more frequently. However, little is known about therapists' perception of the benefits and costs related to the use of virtual therapy in treatment delivery. In the present study, 271 therapists completed an online questionnaire that assessed their perceptions about the potential benefits and costs of using virtual reality in psychotherapy. Results indicated that therapists perceived the potential benefits as outweighing the potential costs. Therapists' self-reported knowledge of virtual reality, theoretical orientation, and interest in using virtual reality were found to be associated with perceptual measures. These findings contribute to the current knowledge of the perception of virtual reality amongst psychotherapists.

Systems and Technologies for Space Exploration: the regional project STEPS

NASA Astrophysics Data System (ADS)

Boggiatto, D.; Moncalvo, D.

The Aerospace technology network of Piemonte represents ˜25% of the italian capacity and handles a comprehensive spectrum of products (aircraft, propulsion, satellites, space station modules, avionics. components, services...). The cooperation between the Comitato Distretto Aerospaziale Piemonte and the European Regional Development Fund 2007-2013 has enabled Regione Piemonte to launch three regional Projects capable to enhance the synergy and competitiveness of the network, among which: STEPS - Sistemi e Tecnologie per l'EsPlorazione Spaziale, a joint development of technologies for robotic and human Space Exploration by 3 large Industries, 27 SMEs, 3 Universities and one public Research Centre. STEPS develops virtual and hardware demonstrators for a range of technologies to do with a Lander's descent and soft landing, and a Rover's surface mobility, of both robotic and manned equipment on Moon and Mars. It also foresees the development of Teleoperations labs and Virtual Reality environments and physical simulations of Moon and Mars surface conditions and ground. Mid-way along STEPS planned development, initial results in several technology domains are available and are presented in this paper.

The Perceptions of CEIT Postgraduate Students Regarding Reality Concepts: Augmented, Virtual, Mixed and Mirror Reality

ERIC Educational Resources Information Center

Taçgin, Zeynep; Arslan, Ahmet

2017-01-01

The purpose of this study is to determine perception of postgraduate Computer Education and Instructional Technologies (CEIT) students regarding the concepts of Augmented Reality (AR), Virtual Reality (VR), Mixed Reality (MR), Augmented Virtuality (AV) and Mirror Reality; and to offer a table that includes differences and similarities between…

Simulators and virtual reality in surgical education.

PubMed

Chou, Betty; Handa, Victoria L

2006-06-01

This article explores the pros and cons of virtual reality simulators, their abilities to train and assess surgical skills, and their potential future applications. Computer-based virtual reality simulators and more conventional box trainers are compared and contrasted. The virtual reality simulator provides objective assessment of surgical skills and immediate feedback further to enhance training. With this ability to provide standardized, unbiased assessment of surgical skills, the virtual reality trainer has the potential to be a tool for selecting, instructing, certifying, and recertifying gynecologists.

Will Anything Useful Come Out of Virtual Reality? Examination of a Naval Application

DTIC Science & Technology

1993-05-01

The term virtual reality can encompass varying meanings, but some generally accepted attributes of a virtual environment are that it is immersive...technology, but at present there are few practical applications which are utilizing the broad range of virtual reality technology. This paper will discuss an...Operability, operator functions, Virtual reality , Man-machine interface, Decision aids/decision making, Decision support. ASW.

Advanced technology in interventional cardiology: A roadmap for the future of precision coronary interventions.

PubMed

Dugas, Chad M; Schussler, Jeffrey M

2016-07-01

Several specific new technologies [high-resolution CT coronary imaging with fractional flow reserve (CTCA-FFR), virtual reality (VR), vascular robotic systems (VRS), and three-dimensional printing] are poised to improve the treatment of patients with cardiovascular disease and at the same time the safety of the physicians who care for them. This article focuses on the potential clinical impact each of these modalities will have, as well as speculating on synergies that use of them together may achieve. Copyright © 2016 Elsevier Inc. All rights reserved.

Integrated Artificial Intelligence Approaches for Disease Diagnostics.

PubMed

Vashistha, Rajat; Chhabra, Deepak; Shukla, Pratyoosh

2018-06-01

Mechanocomputational techniques in conjunction with artificial intelligence (AI) are revolutionizing the interpretations of the crucial information from the medical data and converting it into optimized and organized information for diagnostics. It is possible due to valuable perfection in artificial intelligence, computer aided diagnostics, virtual assistant, robotic surgery, augmented reality and genome editing (based on AI) technologies. Such techniques are serving as the products for diagnosing emerging microbial or non microbial diseases. This article represents a combinatory approach of using such approaches and providing therapeutic solutions towards utilizing these techniques in disease diagnostics.

Cognitive training on stroke patients via virtual reality-based serious games.

PubMed

Gamito, Pedro; Oliveira, Jorge; Coelho, Carla; Morais, Diogo; Lopes, Paulo; Pacheco, José; Brito, Rodrigo; Soares, Fabio; Santos, Nuno; Barata, Ana Filipa

2017-02-01

Use of virtual reality environments in cognitive rehabilitation offers cost benefits and other advantages. In order to test the effectiveness of a virtual reality application for neuropsychological rehabilitation, a cognitive training program using virtual reality was applied to stroke patients. A virtual reality-based serious games application for cognitive training was developed, with attention and memory tasks consisting of daily life activities. Twenty stroke patients were randomly assigned to two conditions: exposure to the intervention, and waiting list control. The results showed significant improvements in attention and memory functions in the intervention group, but not in the controls. Overall findings provide further support for the use of VR cognitive training applications in neuropsychological rehabilitation. Implications for Rehabilitation Improvements in memory and attention functions following a virtual reality-based serious games intervention. Training of daily-life activities using a virtual reality application. Accessibility to training contents.

The Potential of Using Virtual Reality Technology in Physical Activity Settings

ERIC Educational Resources Information Center

Pasco, Denis

2013-01-01

In recent years, virtual reality technology has been successfully used for learning purposes. The purposes of the article are to examine current research on the role of virtual reality in physical activity settings and discuss potential application of using virtual reality technology to enhance learning in physical education. The article starts…

Education about Hallucinations Using an Internet Virtual Reality System: A Qualitative Survey

ERIC Educational Resources Information Center

Yellowlees, Peter M.; Cook, James N.

2006-01-01

Objective: The authors evaluate an Internet virtual reality technology as an education tool about the hallucinations of psychosis. Method: This is a pilot project using Second Life, an Internet-based virtual reality system, in which a virtual reality environment was constructed to simulate the auditory and visual hallucinations of two patients…

Virtual reality measures in neuropsychological assessment: a meta-analytic review.

PubMed

Neguț, Alexandra; Matu, Silviu-Andrei; Sava, Florin Alin; David, Daniel

2016-02-01

Virtual reality-based assessment is a new paradigm for neuropsychological evaluation, that might provide an ecological assessment, compared to paper-and-pencil or computerized neuropsychological assessment. Previous research has focused on the use of virtual reality in neuropsychological assessment, but no meta-analysis focused on the sensitivity of virtual reality-based measures of cognitive processes in measuring cognitive processes in various populations. We found eighteen studies that compared the cognitive performance between clinical and healthy controls on virtual reality measures. Based on a random effects model, the results indicated a large effect size in favor of healthy controls (g = .95). For executive functions, memory and visuospatial analysis, subgroup analysis revealed moderate to large effect sizes, with superior performance in the case of healthy controls. Participants' mean age, type of clinical condition, type of exploration within virtual reality environments, and the presence of distractors were significant moderators. Our findings support the sensitivity of virtual reality-based measures in detecting cognitive impairment. They highlight the possibility of using virtual reality measures for neuropsychological assessment in research applications, as well as in clinical practice.

Effects of virtual reality-based bilateral upper-extremity training on brain activity in post-stroke patients.

PubMed

Lee, Su-Hyun; Kim, Yu-Mi; Lee, Byoung-Hee

2015-07-01

[Purpose] This study investigated the therapeutic effects of virtual reality-based bilateral upper-extremity training on brain activity in patients with stroke. [Subjects and Methods] Eighteen chronic stroke patients were divided into two groups: the virtual reality-based bilateral upper-extremity training group (n = 10) and the bilateral upper-limb training group (n = 8). The virtual reality-based bilateral upper-extremity training group performed bilateral upper-extremity exercises in a virtual reality environment, while the bilateral upper-limb training group performed only bilateral upper-extremity exercise. All training was conducted 30 minutes per day, three times per week for six weeks, followed by brain activity evaluation. [Results] Electroencephalography showed significant increases in concentration in the frontopolar 2 and frontal 4 areas, and significant increases in brain activity in the frontopolar 1 and frontal 3 areas in the virtual reality-based bilateral upper-extremity training group. [Conclusion] Virtual reality-based bilateral upper-extremity training can improve the brain activity of stroke patients. Thus, virtual reality-based bilateral upper-extremity training is feasible and beneficial for improving brain activation in stroke patients.

Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis.

PubMed

Bergeron, Mathieu; Lortie, Catherine L; Guitton, Matthieu J

2015-01-01

Classical peripheral vestibular disorders rehabilitation is a long and costly process. While virtual reality settings have been repeatedly suggested to represent possible tools to help the rehabilitation process, no systematic study had been conducted so far. We systematically reviewed the current literature to analyze the published protocols documenting the use of virtual reality settings for peripheral vestibular disorders rehabilitation. There is an important diversity of settings and protocols involving virtual reality settings for the treatment of this pathology. Evaluation of the symptoms is often not standardized. However, our results unveil a clear effect of virtual reality settings-based rehabilitation of the patients' symptoms, assessed by objectives tools such as the DHI (mean decrease of 27 points), changing symptoms handicap perception from moderate to mild impact on life. Furthermore, we detected a relationship between the duration of the exposure to virtual reality environments and the magnitude of the therapeutic effects, suggesting that virtual reality treatments should last at least 150 minutes of cumulated exposure to ensure positive outcomes. Virtual reality offers a pleasant and safe environment for the patient. Future studies should standardize evaluation tools, document putative side effects further, compare virtual reality to conventional physical therapy, and evaluate economical costs/benefits of such strategies.

Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis

PubMed Central

Bergeron, Mathieu; Lortie, Catherine L.; Guitton, Matthieu J.

2015-01-01

Classical peripheral vestibular disorders rehabilitation is a long and costly process. While virtual reality settings have been repeatedly suggested to represent possible tools to help the rehabilitation process, no systematic study had been conducted so far. We systematically reviewed the current literature to analyze the published protocols documenting the use of virtual reality settings for peripheral vestibular disorders rehabilitation. There is an important diversity of settings and protocols involving virtual reality settings for the treatment of this pathology. Evaluation of the symptoms is often not standardized. However, our results unveil a clear effect of virtual reality settings-based rehabilitation of the patients' symptoms, assessed by objectives tools such as the DHI (mean decrease of 27 points), changing symptoms handicap perception from moderate to mild impact on life. Furthermore, we detected a relationship between the duration of the exposure to virtual reality environments and the magnitude of the therapeutic effects, suggesting that virtual reality treatments should last at least 150 minutes of cumulated exposure to ensure positive outcomes. Virtual reality offers a pleasant and safe environment for the patient. Future studies should standardize evaluation tools, document putative side effects further, compare virtual reality to conventional physical therapy, and evaluate economical costs/benefits of such strategies. PMID:26556560

Virtual reality training improves balance function.

PubMed

Mao, Yurong; Chen, Peiming; Li, Le; Huang, Dongfeng

2014-09-01

Virtual reality is a new technology that simulates a three-dimensional virtual world on a computer and enables the generation of visual, audio, and haptic feedback for the full immersion of users. Users can interact with and observe objects in three-dimensional visual space without limitation. At present, virtual reality training has been widely used in rehabilitation therapy for balance dysfunction. This paper summarizes related articles and other articles suggesting that virtual reality training can improve balance dysfunction in patients after neurological diseases. When patients perform virtual reality training, the prefrontal, parietal cortical areas and other motor cortical networks are activated. These activations may be involved in the reconstruction of neurons in the cerebral cortex. Growing evidence from clinical studies reveals that virtual reality training improves the neurological function of patients with spinal cord injury, cerebral palsy and other neurological impairments. These findings suggest that virtual reality training can activate the cerebral cortex and improve the spatial orientation capacity of patients, thus facilitating the cortex to control balance and increase motion function.

Virtual reality training improves balance function

PubMed Central

Mao, Yurong; Chen, Peiming; Li, Le; Huang, Dongfeng

2014-01-01

Virtual reality is a new technology that simulates a three-dimensional virtual world on a computer and enables the generation of visual, audio, and haptic feedback for the full immersion of users. Users can interact with and observe objects in three-dimensional visual space without limitation. At present, virtual reality training has been widely used in rehabilitation therapy for balance dysfunction. This paper summarizes related articles and other articles suggesting that virtual reality training can improve balance dysfunction in patients after neurological diseases. When patients perform virtual reality training, the prefrontal, parietal cortical areas and other motor cortical networks are activated. These activations may be involved in the reconstruction of neurons in the cerebral cortex. Growing evidence from clinical studies reveals that virtual reality training improves the neurological function of patients with spinal cord injury, cerebral palsy and other neurological impairments. These findings suggest that virtual reality training can activate the cerebral cortex and improve the spatial orientation capacity of patients, thus facilitating the cortex to control balance and increase motion function. PMID:25368651

A novel 3D-printed hybrid simulation model for robotic-assisted kidney transplantation (RAKT).

PubMed

Uwechue, Raphael; Gogalniceanu, Petrut; Kessaris, Nicos; Byrne, Nick; Chandak, Pankaj; Olsburgh, Jonathon; Ahmed, Kamran; Mamode, Nizam; Loukopoulos, Ioannis

2018-01-27

Robotic-assisted kidney transplantation (RAKT) offers key benefits for patients that have been demonstrated in several studies. A barrier to the wider uptake of RAKT is surgical skill acquisition. This is exacerbated by the challenges of modern surgery with reduced surgical training time, patient safety concerns and financial pressures. Simulation is a well-established method of developing surgical skill in a safe and controlled environment away from the patient. We have developed a 3D printed simulation model for the key step of the kidney transplant operation which is the vascular anastomosis. The model is anatomically accurate, based on the CT scans of patients and it incorporates deceased donor vascular tissue. Crucially, it was developed to be used in the robotic operating theatre with the operating robot to enhance its fidelity. It is portable and relatively inexpensive when compared with other forms of simulation such as virtual reality or animal lab training. It thus has the potential of being more accessible as a training tool for the safe acquisition of RAKT specific skills. We demonstrate this model here.

Man, mind, and machine: the past and future of virtual reality simulation in neurologic surgery.

PubMed

Robison, R Aaron; Liu, Charles Y; Apuzzo, Michael L J

2011-11-01

To review virtual reality in neurosurgery, including the history of simulation and virtual reality and some of the current implementations; to examine some of the technical challenges involved; and to propose a potential paradigm for the development of virtual reality in neurosurgery going forward. A search was made on PubMed using key words surgical simulation, virtual reality, haptics, collision detection, and volumetric modeling to assess the current status of virtual reality in neurosurgery. Based on previous results, investigators extrapolated the possible integration of existing efforts and potential future directions. Simulation has a rich history in surgical training, and there are numerous currently existing applications and systems that involve virtual reality. All existing applications are limited to specific task-oriented functions and typically sacrifice visual realism for real-time interactivity or vice versa, owing to numerous technical challenges in rendering a virtual space in real time, including graphic and tissue modeling, collision detection, and direction of the haptic interface. With ongoing technical advancements in computer hardware and graphic and physical rendering, incremental or modular development of a fully immersive, multipurpose virtual reality neurosurgical simulator is feasible. The use of virtual reality in neurosurgery is predicted to change the nature of neurosurgical education, and to play an increased role in surgical rehearsal and the continuing education and credentialing of surgical practitioners. Copyright © 2011 Elsevier Inc. All rights reserved.

Rationale and Roadmap for Moon Exploration

NASA Astrophysics Data System (ADS)

Foing, B. H.; ILEWG Team

We discuss the different rationale for Moon exploration. This starts with areas of scientific investigations: clues on the formation and evolution of rocky planets, accretion and bombardment in the inner solar system, comparative planetology processes (tectonic, volcanic, impact cratering, volatile delivery), records astrobiology, survival of organics; past, present and future life. The rationale includes also the advancement of instrumentation: Remote sensing miniaturised instruments; Surface geophysical and geochemistry package; Instrument deployment and robotic arm, nano-rover, sampling, drilling; Sample finder and collector. There are technologies in robotic and human exploration that are a drive for the creativity and economical competitivity of our industries: Mecha-electronics-sensors; Tele control, telepresence, virtual reality; Regional mobility rover; Autonomy and Navigation; Artificially intelligent robots, Complex systems, Man-Machine interface and performances. Moon-Mars Exploration can inspire solutions to global Earth sustained development: In-Situ Utilisation of resources; Establishment of permanent robotic infrastructures, Environmental protection aspects; Life sciences laboratories; Support to human exploration. We also report on the IAA Cosmic Study on Next Steps In Exploring Deep Space, and ongoing IAA Cosmic Studies, ILEWG/IMEWG ongoing activities, and we finally discuss possible roadmaps for robotic and human exploration, starting with the Moon-Mars missions for the coming decade, and building effectively on joint technology developments.

Virtual Realities and the Future of Text.

ERIC Educational Resources Information Center

Marcus, Stephen

1992-01-01

Discusses issues surrounding virtual reality and "virtual books." Suggests that those who are exploring the territory of virtual realities are already helping to expand and enrich expectations and visions for integrating technology into reading and writing. (RS)

A Comparative Analysis of 2D and 3D Tasks for Virtual Reality Therapies Based on Robotic-Assisted Neurorehabilitation for Post-stroke Patients

PubMed Central

Lledó, Luis D.; Díez, Jorge A.; Bertomeu-Motos, Arturo; Ezquerro, Santiago; Badesa, Francisco J.; Sabater-Navarro, José M.; García-Aracil, Nicolás

2016-01-01

Post-stroke neurorehabilitation based on virtual therapies are performed completing repetitive exercises shown in visual electronic devices, whose content represents imaginary or daily life tasks. Currently, there are two ways of visualization of these task. 3D virtual environments are used to get a three dimensional space that represents the real world with a high level of detail, whose realism is determinated by the resolucion and fidelity of the objects of the task. Furthermore, 2D virtual environments are used to represent the tasks with a low degree of realism using techniques of bidimensional graphics. However, the type of visualization can influence the quality of perception of the task, affecting the patient's sensorimotor performance. The purpose of this paper was to evaluate if there were differences in patterns of kinematic movements when post-stroke patients performed a reach task viewing a virtual therapeutic game with two different type of visualization of virtual environment: 2D and 3D. Nine post-stroke patients have participated in the study receiving a virtual therapy assisted by PUPArm rehabilitation robot. Horizontal movements of the upper limb were performed to complete the aim of the tasks, which consist in reaching peripheral or perspective targets depending on the virtual environment shown. Various parameter types such as the maximum speed, reaction time, path length, or initial movement are analyzed from the data acquired objectively by the robotic device to evaluate the influence of the task visualization. At the end of the study, a usability survey was provided to each patient to analysis his/her satisfaction level. For all patients, the movement trajectories were enhanced when they completed the therapy. This fact suggests that patient's motor recovery was increased. Despite of the similarity in majority of the kinematic parameters, differences in reaction time and path length were higher using the 3D task. Regarding the success rates were very similar. In conclusion, the using of 2D environments in virtual therapy may be a more appropriate and comfortable way to perform tasks for upper limb rehabilitation of post-stroke patients, in terms of accuracy in order to effectuate optimal kinematic trajectories. PMID:27616992

Using Virtual Reality Environment to Improve Joint Attention Associated with Pervasive Developmental Disorder

ERIC Educational Resources Information Center

Cheng, Yufang; Huang, Ruowen

2012-01-01

The focus of this study is using data glove to practice Joint attention skill in virtual reality environment for people with pervasive developmental disorder (PDD). The virtual reality environment provides a safe environment for PDD people. Especially, when they made errors during practice in virtual reality environment, there is no suffering or…

Naval Applications of Virtual Reality,

DTIC Science & Technology

1993-01-01

Expert Virtual Reality Special Report 󈨡, pp. 67- 72. 14. SUBJECT TERMS 15 NUMBER o0 PAGES man-machine interface virtual reality decision support...collective and individual performance. -" Virtual reality projects could help *y by Mark Gembicki Av-t-abilty CodesA Avafllat Idt Iofe and David Rousseau...alt- 67 VIRTUAL . REALITY SPECIAl, REPORT r-OPY avcriaikxb to DD)C qg .- 154,41X~~~~~~~~~~~~j 1411 iI..:41 T a].’ 1,1 4 1111 I 4 1 * .11 ~ 4 l.~w111511 I

Magical Stories: Blending Virtual Reality and Artificial Intelligence.

ERIC Educational Resources Information Center

McLellan, Hilary

Artificial intelligence (AI) techniques and virtual reality (VR) make possible powerful interactive stories, and this paper focuses on examples of virtual characters in three dimensional (3-D) worlds. Waldern, a virtual reality game designer, has theorized about and implemented software design of virtual teammates and opponents that incorporate AI…

Virtual Reality: An Overview.

ERIC Educational Resources Information Center

Franchi, Jorge

1994-01-01

Highlights of this overview of virtual reality include optics; interface devices; virtual worlds; potential applications, including medicine and archaeology; problems, including costs; current research and development; future possibilities; and a listing of vendors and suppliers of virtual reality products. (Contains 11 references.) (LRW)

Psychological benefits of virtual reality for patients in rehabilitation therapy.

PubMed

Chen, Chih-Hung; Jeng, Ming-Chang; Fung, Chin-Ping; Doong, Ji-Liang; Chuang, Tien-Yow

2009-05-01

Whether virtual rehabilitation is beneficial has not been determined. To investigate the psychological benefits of virtual reality in rehabilitation. An experimental group underwent therapy with a virtual-reality-based exercise bike, and a control group underwent the therapy without virtual-reality equipment. Hospital laboratory. 30 patients suffering from spinal-cord injury. A designed rehabilitation therapy. Endurance, Borg's rating-of-perceived-exertion scale, the Activation-Deactivation Adjective Check List (AD-ACL), and the Simulator Sickness Questionnaire. The differences between the experimental and control groups were significant for AD-ACL calmness and tension. A virtual-reality-based rehabilitation program can ease patients' tension and induce calm.

Effect of feedback from a socially interactive humanoid robot on reaching kinematics in children with and without cerebral palsy: A pilot study.

PubMed

Chen, Yuping; Garcia-Vergara, Sergio; Howard, Ayanna M

2017-08-17

To examine whether children with or without cerebral palsy (CP) would follow a humanoid robot's (i.e., Darwin) feedback to move their arm faster when playing virtual reality (VR) games. Seven children with mild CP and 10 able-bodied children participated. Real-time reaching was evaluated by playing the Super Pop VR TM system, including 2-game baseline, 3-game acquisition, and another 2-game extinction. During acquisition, Darwin provided verbal feedback to direct the child to reach a kinematically defined target goal (i.e., 80% of average movement time in baseline). Outcome variables included the percentage of successful reaches ("% successful reaches"), movement time (MT), average speed, path, and number of movement units. All games during acquisition and extinction had larger "%successful reaches," faster speeds, and faster MTs than the 2 games during baseline (p < .05). Children with and without CP could follow the robot's feedback for changing their reaching kinematics when playing VR games.

Virtual Reality for Pediatric Sedation: A Randomized Controlled Trial Using Simulation.

PubMed

Zaveri, Pavan P; Davis, Aisha B; O'Connell, Karen J; Willner, Emily; Aronson Schinasi, Dana A; Ottolini, Mary

2016-02-09

Team training for procedural sedation for pediatric residents has traditionally consisted of didactic presentations and simulated scenarios using high-fidelity mannequins. We assessed the effectiveness of a virtual reality module in teaching preparation for and management of sedation for procedures. After developing a virtual reality environment in Second Life® (Linden Lab, San Francisco, CA) where providers perform and recover patients from procedural sedation, we conducted a randomized controlled trial to assess the effectiveness of the virtual reality module versus a traditional web-based educational module. A 20 question pre- and post-test was administered to assess knowledge change. All subjects participated in a simulated pediatric procedural sedation scenario that was video recorded for review and assessed using a 32-point checklist. A brief survey elicited feedback on the virtual reality module and the simulation scenario. The median score on the assessment checklist was 75% for the intervention group and 70% for the control group (P = 0.32). For the knowledge tests, there was no statistically significant difference between the groups (P = 0.14). Users had excellent reviews of the virtual reality module and reported that the module added to their education. Pediatric residents performed similarly in simulation and on a knowledge test after a virtual reality module compared with a traditional web-based module on procedural sedation. Although users enjoyed the virtual reality experience, these results question the value virtual reality adds in improving the performance of trainees. Further inquiry is needed into how virtual reality provides true value in simulation-based education.

Virtual Reality for Pediatric Sedation: A Randomized Controlled Trial Using Simulation

PubMed Central

Davis, Aisha B; O'Connell, Karen J; Willner, Emily; Aronson Schinasi, Dana A; Ottolini, Mary

2016-01-01

Introduction: Team training for procedural sedation for pediatric residents has traditionally consisted of didactic presentations and simulated scenarios using high-fidelity mannequins. We assessed the effectiveness of a virtual reality module in teaching preparation for and management of sedation for procedures. Methods: After developing a virtual reality environment in Second Life® (Linden Lab, San Francisco, CA) where providers perform and recover patients from procedural sedation, we conducted a randomized controlled trial to assess the effectiveness of the virtual reality module versus a traditional web-based educational module. A 20 question pre- and post-test was administered to assess knowledge change. All subjects participated in a simulated pediatric procedural sedation scenario that was video recorded for review and assessed using a 32-point checklist. A brief survey elicited feedback on the virtual reality module and the simulation scenario. Results: The median score on the assessment checklist was 75% for the intervention group and 70% for the control group (P = 0.32). For the knowledge tests, there was no statistically significant difference between the groups (P = 0.14). Users had excellent reviews of the virtual reality module and reported that the module added to their education. Conclusions: Pediatric residents performed similarly in simulation and on a knowledge test after a virtual reality module compared with a traditional web-based module on procedural sedation. Although users enjoyed the virtual reality experience, these results question the value virtual reality adds in improving the performance of trainees. Further inquiry is needed into how virtual reality provides true value in simulation-based education. PMID:27014520

Human-like object tracking and gaze estimation with PKD android

PubMed Central

Wijayasinghe, Indika B.; Miller, Haylie L.; Das, Sumit K; Bugnariu, Nicoleta L.; Popa, Dan O.

2018-01-01

As the use of robots increases for tasks that require human-robot interactions, it is vital that robots exhibit and understand human-like cues for effective communication. In this paper, we describe the implementation of object tracking capability on Philip K. Dick (PKD) android and a gaze tracking algorithm, both of which further robot capabilities with regard to human communication. PKD's ability to track objects with human-like head postures is achieved with visual feedback from a Kinect system and an eye camera. The goal of object tracking with human-like gestures is twofold : to facilitate better human-robot interactions and to enable PKD as a human gaze emulator for future studies. The gaze tracking system employs a mobile eye tracking system (ETG; SensoMotoric Instruments) and a motion capture system (Cortex; Motion Analysis Corp.) for tracking the head orientations. Objects to be tracked are displayed by a virtual reality system, the Computer Assisted Rehabilitation Environment (CAREN; MotekForce Link). The gaze tracking algorithm converts eye tracking data and head orientations to gaze information facilitating two objectives: to evaluate the performance of the object tracking system for PKD and to use the gaze information to predict the intentions of the user, enabling the robot to understand physical cues by humans. PMID:29416193

Medical robotics.

PubMed

Ferrigno, Giancarlo; Baroni, Guido; Casolo, Federico; De Momi, Elena; Gini, Giuseppina; Matteucci, Matteo; Pedrocchi, Alessandra

2011-01-01

Information and communication technology (ICT) and mechatronics play a basic role in medical robotics and computer-aided therapy. In the last three decades, in fact, ICT technology has strongly entered the health-care field, bringing in new techniques to support therapy and rehabilitation. In this frame, medical robotics is an expansion of the service and professional robotics as well as other technologies, as surgical navigation has been introduced especially in minimally invasive surgery. Localization systems also provide treatments in radiotherapy and radiosurgery with high precision. Virtual or augmented reality plays a role for both surgical training and planning and for safe rehabilitation in the first stage of the recovery from neurological diseases. Also, in the chronic phase of motor diseases, robotics helps with special assistive devices and prostheses. Although, in the past, the actual need and advantage of navigation, localization, and robotics in surgery and therapy has been in doubt, today, the availability of better hardware (e.g., microrobots) and more sophisticated algorithms(e.g., machine learning and other cognitive approaches)has largely increased the field of applications of these technologies,making it more likely that, in the near future, their presence will be dramatically increased, taking advantage of the generational change of the end users and the increasing request of quality in health-care delivery and management.

Human-like object tracking and gaze estimation with PKD android

NASA Astrophysics Data System (ADS)

Wijayasinghe, Indika B.; Miller, Haylie L.; Das, Sumit K.; Bugnariu, Nicoleta L.; Popa, Dan O.

2016-05-01

As the use of robots increases for tasks that require human-robot interactions, it is vital that robots exhibit and understand human-like cues for effective communication. In this paper, we describe the implementation of object tracking capability on Philip K. Dick (PKD) android and a gaze tracking algorithm, both of which further robot capabilities with regard to human communication. PKD's ability to track objects with human-like head postures is achieved with visual feedback from a Kinect system and an eye camera. The goal of object tracking with human-like gestures is twofold: to facilitate better human-robot interactions and to enable PKD as a human gaze emulator for future studies. The gaze tracking system employs a mobile eye tracking system (ETG; SensoMotoric Instruments) and a motion capture system (Cortex; Motion Analysis Corp.) for tracking the head orientations. Objects to be tracked are displayed by a virtual reality system, the Computer Assisted Rehabilitation Environment (CAREN; MotekForce Link). The gaze tracking algorithm converts eye tracking data and head orientations to gaze information facilitating two objectives: to evaluate the performance of the object tracking system for PKD and to use the gaze information to predict the intentions of the user, enabling the robot to understand physical cues by humans.

Developing a telepresence robot for interpersonal communication with the elderly in a home environment.

PubMed

Tsai, Tzung-Cheng; Hsu, Yeh-Liang; Ma, An-I; King, Trevor; Wu, Chang-Huei

2007-08-01

"Telepresence" is an interesting field that includes virtual reality implementations with human-system interfaces, communication technologies, and robotics. This paper describes the development of a telepresence robot called Telepresence Robot for Interpersonal Communication (TRIC) for the purpose of interpersonal communication with the elderly in a home environment. The main aim behind TRIC's development is to allow elderly populations to remain in their home environments, while loved ones and caregivers are able to maintain a higher level of communication and monitoring than via traditional methods. TRIC aims to be a low-cost, lightweight robot, which can be easily implemented in the home environment. Under this goal, decisions on the design elements included are discussed. In particular, the implementation of key autonomous behaviors in TRIC to increase the user's capability of projection of self and operation of the telepresence robot, in addition to increasing the interactive capability of the participant as a dialogist are emphasized. The technical development and integration of the modules in TRIC, as well as human factors considerations are then described. Preliminary functional tests show that new users were able to effectively navigate TRIC and easily locate visual targets. Finally the future developments of TRIC, especially the possibility of using TRIC for home tele-health monitoring and tele-homecare visits are discussed.

History Educators and the Challenge of Immersive Pasts: A Critical Review of Virtual Reality "Tools" and History Pedagogy

ERIC Educational Resources Information Center

Allison, John

2008-01-01

This paper will undertake a critical review of the impact of virtual reality tools on the teaching of history. Virtual reality is useful in several different ways. History educators, elementary and secondary school teachers and professors, can all profit from the digital environment. Challenges arise quickly however. Virtual reality technologies…

Immersive virtual reality simulations in nursing education.

PubMed

Kilmon, Carol A; Brown, Leonard; Ghosh, Sumit; Mikitiuk, Artur

2010-01-01

This article explores immersive virtual reality as a potential educational strategy for nursing education and describes an immersive learning experience now being developed for nurses. This pioneering project is a virtual reality application targeting speed and accuracy of nurse response in emergency situations requiring cardiopulmonary resuscitation. Other potential uses and implications for the development of virtual reality learning programs are discussed.

Virtual reality simulation: using three-dimensional technology to teach nursing students.

PubMed

Jenson, Carole E; Forsyth, Diane McNally

2012-06-01

The use of computerized technology is rapidly growing in the classroom and in healthcare. An emerging computer technology strategy for nursing education is the use of virtual reality simulation. This computer-based three-dimensional educational tool simulates real-life patient experiences in a risk-free environment, allows for repeated practice sessions, requires clinical decision making, exposes students to diverse patient conditions, provides immediate feedback, and is portable. The purpose of this article was to review the importance of virtual reality simulation as a computerized teaching strategy. In addition, a project to explore readiness of nursing faculty at one major Midwestern university for the use of virtual reality simulation as a computerized teaching strategy is described where faculty thought virtual reality simulation would increase students' knowledge of an intravenous line insertion procedure. Faculty who practiced intravenous catheter insertion via virtual reality simulation expressed a wide range of learning experiences from using virtual reality simulation that is congruent with the literature regarding the barriers to student learning. Innovative teaching strategies, such as virtual reality simulation, address barriers of increasing patient acuity, high student-to-faculty ratio, patient safety concerns from faculty, and student anxiety and can offer rapid feedback to students.

Virtual Reality at the PC Level

NASA Technical Reports Server (NTRS)

Dean, John

1998-01-01

The main objective of my research has been to incorporate virtual reality at the desktop level; i.e., create virtual reality software that can be run fairly inexpensively on standard PC's. The standard language used for virtual reality on PC's is VRML (Virtual Reality Modeling Language). It is a new language so it is still undergoing a lot of changes. VRML 1.0 came out only a couple years ago and VRML 2.0 came out around last September. VRML is an interpreted language that is run by a web browser plug-in. It is fairly flexible in terms of allowing you to create different shapes and animations. Before this summer, I knew very little about virtual reality and I did not know VRML at all. I learned the VRML language by reading two books and experimenting on a PC. The following topics are presented: CAD to VRML, VRML 1.0 to VRML 2.0, VRML authoring tools, VRML browsers, finding virtual reality applications, the AXAF project, the VRML generator program, web communities and future plans.

Interpretations of virtual reality.

PubMed

Voiskounsky, Alexander

2011-01-01

University students were surveyed to learn what they know about virtual realities. The two studies were administered with a half-year interval in which the students (N=90, specializing either in mathematics and science, or in social science and humanities) were asked to name particular examples of virtual realities. The second, but not the first study, was administered after the participants had the chance to see the movie "Avatar" (no investigation was held into whether they really saw it). While the students in both studies widely believed that activities such as social networking and online gaming represent virtual realities, some other examples provided by the students in the two studies differ: in the second study the participants expressed a better understanding of the items related to virtual realities. At the same time, not a single participant reported particular psychological states (either regular or altered) as examples of virtual realities. Profound popularization efforts need to be done to acquaint the public, including college students, with virtual realities and let the public adequately understand how such systems work.

Stepping into the virtual unknown: feasibility study of a virtual reality-based test of ocular misalignment.

PubMed

Nesaratnam, N; Thomas, P; Vivian, A

2017-10-01

IntroductionDissociated tests of strabismus provide valuable information for diagnosis and monitoring of ocular misalignment in patients with normal retinal correspondence. However, they are vulnerable to operator error and rely on a fixed head position. Virtual reality headsets obviate the need for head fixation, while providing other clear theoretical advantages, including complete control over the illumination and targets presented for the patient's interaction.PurposeWe compared the performance of a virtual reality-based test of ocular misalignment to that of the traditional Lees screen, to establish the feasibility of using virtual reality technology in ophthalmic settings in the future.MethodsThree patients underwent a traditional Lees screen test, and a virtual reality headset-based test of ocular motility. The virtual reality headset-based programme consisted of an initial test to measure horizontal and vertical deviation, followed by a test for torsion.ResultsThe pattern of deviation obtained using the virtual reality-based test showed agreement with that obtained from the Lees screen for patients with a fourth nerve palsy, comitant esotropia, and restrictive thyroid eye disease.ConclusionsThis study reports the first use of a virtual reality headset in assessing ocular misalignment, and demonstrates that it is a feasible dissociative test of strabismus.

A standardized set of 3-D objects for virtual reality research and applications.

PubMed

Peeters, David

2018-06-01

The use of immersive virtual reality as a research tool is rapidly increasing in numerous scientific disciplines. By combining ecological validity with strict experimental control, immersive virtual reality provides the potential to develop and test scientific theories in rich environments that closely resemble everyday settings. This article introduces the first standardized database of colored three-dimensional (3-D) objects that can be used in virtual reality and augmented reality research and applications. The 147 objects have been normed for name agreement, image agreement, familiarity, visual complexity, and corresponding lexical characteristics of the modal object names. The availability of standardized 3-D objects for virtual reality research is important, because reaching valid theoretical conclusions hinges critically on the use of well-controlled experimental stimuli. Sharing standardized 3-D objects across different virtual reality labs will allow for science to move forward more quickly.

[Application of virtual reality in surgical treatment of complex head and neck carcinoma].

PubMed

Zhou, Y Q; Li, C; Shui, C Y; Cai, Y C; Sun, R H; Zeng, D F; Wang, W; Li, Q L; Huang, L; Tu, J; Jiang, J

2018-01-07

Objective: To investigate the application of virtual reality technology in the preoperative evaluation of complex head and neck carcinoma and he value of virtual reality technology in surgical treatment of head and neck carcinoma. Methods: The image data of eight patients with complex head and neck carcinoma treated from December 2016 to May 2017 was acquired. The data were put into virtual reality system to built the three-dimensional anatomical model of carcinoma and to created the surgical scene. The process of surgery was stimulated by recognizing the relationship between tumor and surrounding important structures. Finally all patients were treated with surgery. And two typical cases were reported. Results: With the help of virtual reality, surgeons could adequately assess the condition of carcinoma and the security of operation and ensured the safety of operations. Conclusions: Virtual reality can provide the surgeons with the sensory experience in virtual surgery scenes and achieve the man-computer cooperation and stereoscopic assessment, which will ensure the safety of surgery. Virtual reality has a huge impact on guiding the traditional surgical procedure of head and neck carcinoma.

Role of virtual reality simulation in endoscopy training

PubMed Central

Harpham-Lockyer, Louis; Laskaratos, Faidon-Marios; Berlingieri, Pasquale; Epstein, Owen

2015-01-01

Recent advancements in virtual reality graphics and models have allowed virtual reality simulators to be incorporated into a variety of endoscopic training programmes. Use of virtual reality simulators in training programmes is thought to improve skill acquisition amongst trainees which is reflected in improved patient comfort and safety. Several studies have already been carried out to ascertain the impact that usage of virtual reality simulators may have upon trainee learning curves and how this may translate to patient comfort. This article reviews the available literature in this area of medical education which is particularly relevant to all parties involved in endoscopy training and curriculum development. Assessment of the available evidence for an optimal exposure time with virtual reality simulators and the long-term benefits of their use are also discussed. PMID:26675895

Role of virtual reality simulation in endoscopy training.

PubMed

Harpham-Lockyer, Louis; Laskaratos, Faidon-Marios; Berlingieri, Pasquale; Epstein, Owen

2015-12-10

Recent advancements in virtual reality graphics and models have allowed virtual reality simulators to be incorporated into a variety of endoscopic training programmes. Use of virtual reality simulators in training programmes is thought to improve skill acquisition amongst trainees which is reflected in improved patient comfort and safety. Several studies have already been carried out to ascertain the impact that usage of virtual reality simulators may have upon trainee learning curves and how this may translate to patient comfort. This article reviews the available literature in this area of medical education which is particularly relevant to all parties involved in endoscopy training and curriculum development. Assessment of the available evidence for an optimal exposure time with virtual reality simulators and the long-term benefits of their use are also discussed.

Applications of Intelligent Tutoring Systems to Human-Robotic Exploration of Mars

NASA Technical Reports Server (NTRS)

Clancey, William J.

2004-01-01

Space missions with small crews extending over several years with time-delay preventing normal conversations with people on earth will raise many challenges for training. Of special interest are possible three-year missions to Mars, requiring refresher instruction and learning new skills based on unexpected problems with machines and environmental conditions. For example, the crew will be required to monitor and repair more complex life support systems for air and water recycling than we even know how to build today. Highly educated astronauts, often with several doctorate degrees, require a very different mode of interaction than we have developed for school children or even typical college students. Explanation methods may need to differ-using analogies and techniques from different domains-depending on whether the astronaut is an astrophysicist, a pilot, or a geologist.Virtual reality (e.g., for Hubble repair missions) and "integrated" simulations (involving role-playing and emphasizing failure scenarios) are the most common advanced forms of instruction used in space flight today. The emphasis is on collaborative, embodied interaction with the same workstations and tools used in practice (e.g., a cockpit simulator). Otherwise, computerized instructional technology used by NASA is not model-based or tutorial in nature. This discussion will review some of the key instructional methods used at NASA over the past two decades and consider why ITS methods have not been exploited. Some of the problems and opportunities for training for Mars missions are examined, including how using robots in exploration activities will help but raise new training problems. These ideas will be illustrated with examples from the BrahmsVE system in which a browser- based virtual reality display with avatars allows interacting with a distributed multiagent system, in which agents can be people, robots, or software programs. Using BrahmsVE may provide a way for astronauts to interact with proxies of people who serve as instructional coaches on Mars.

Virtual Reality Exploration and Planning for Precision Colorectal Surgery.

PubMed

Guerriero, Ludovica; Quero, Giuseppe; Diana, Michele; Soler, Luc; Agnus, Vincent; Marescaux, Jacques; Corcione, Francesco

2018-06-01

Medical software can build a digital clone of the patient with 3-dimensional reconstruction of Digital Imaging and Communication in Medicine images. The virtual clone can be manipulated (rotations, zooms, etc), and the various organs can be selectively displayed or hidden to facilitate a virtual reality preoperative surgical exploration and planning. We present preliminary cases showing the potential interest of virtual reality in colorectal surgery for both cases of diverticular disease and colonic neoplasms. This was a single-center feasibility study. The study was conducted at a tertiary care institution. Two patients underwent a laparoscopic left hemicolectomy for diverticular disease, and 1 patient underwent a laparoscopic right hemicolectomy for cancer. The 3-dimensional virtual models were obtained from preoperative CT scans. The virtual model was used to perform preoperative exploration and planning. Intraoperatively, one of the surgeons was manipulating the virtual reality model, using the touch screen of a tablet, which was interactively displayed to the surgical team. The main outcome was evaluation of the precision of virtual reality in colorectal surgery planning and exploration. In 1 patient undergoing laparoscopic left hemicolectomy, an abnormal origin of the left colic artery beginning as an extremely short common trunk from the inferior mesenteric artery was clearly seen in the virtual reality model. This finding was missed by the radiologist on CT scan. The precise identification of this vascular variant granted a safe and adequate surgery. In the remaining cases, the virtual reality model helped to precisely estimate the vascular anatomy, providing key landmarks for a safer dissection. A larger sample size would be necessary to definitively assess the efficacy of virtual reality in colorectal surgery. Virtual reality can provide an enhanced understanding of crucial anatomical details, both preoperatively and intraoperatively, which could contribute to improve safety in colorectal surgery.

Outcomes from the Delphi process of the Thoracic Robotic Curriculum Development Committee.

PubMed

Veronesi, Giulia; Dorn, Patrick; Dunning, Joel; Cardillo, Giuseppe; Schmid, Ralph A; Collins, Justin; Baste, Jean-Marc; Limmer, Stefan; Shahin, Ghada M M; Egberts, Jan-Hendrik; Pardolesi, Alessandro; Meacci, Elisa; Stamenkovic, Sasha; Casali, Gianluca; Rueckert, Jens C; Taurchini, Mauro; Santelmo, Nicola; Melfi, Franca; Toker, Alper

2018-06-01

As the adoption of robotic procedures becomes more widespread, additional risk related to the learning curve can be expected. This article reports the results of a Delphi process to define procedures to optimize robotic training of thoracic surgeons and to promote safe performance of established robotic interventions as, for example, lung cancer and thymoma surgery. In June 2016, a working panel was spontaneously created by members of the European Society of Thoracic Surgeons (ESTS) and European Association for Cardio-Thoracic Surgery (EACTS) with a specialist interest in robotic thoracic surgery and/or surgical training. An e-consensus-finding exercise using the Delphi methodology was applied requiring 80% agreement to reach consensus on each question. Repeated iterations of anonymous voting continued over 3 rounds. Agreement was reached on many points: a standardized robotic training curriculum for robotic thoracic surgery should be divided into clearly defined sections as a staged learning pathway; the basic robotic curriculum should include a baseline evaluation, an e-learning module, a simulation-based training (including virtual reality simulation, Dry lab and Wet lab) and a robotic theatre (bedside) observation. Advanced robotic training should include e-learning on index procedures (right upper lobe) with video demonstration, access to video library of robotic procedures, simulation training, modular console training to index procedure, transition to full-procedure training with a proctor and final evaluation of the submitted video to certified independent examiners. Agreement was reached on a large number of questions to optimize and standardize training and education of thoracic surgeons in robotic activity. The production of the content of the learning material is ongoing.

Virtual reality in surgical training.

PubMed

Lange, T; Indelicato, D J; Rosen, J M

2000-01-01

Virtual reality in surgery and, more specifically, in surgical training, faces a number of challenges in the future. These challenges are building realistic models of the human body, creating interface tools to view, hear, touch, feel, and manipulate these human body models, and integrating virtual reality systems into medical education and treatment. A final system would encompass simulators specifically for surgery, performance machines, telemedicine, and telesurgery. Each of these areas will need significant improvement for virtual reality to impact medicine successfully in the next century. This article gives an overview of, and the challenges faced by, current systems in the fast-changing field of virtual reality technology, and provides a set of specific milestones for a truly realistic virtual human body.

Immersive Education, an Annotated Webliography

ERIC Educational Resources Information Center

Pricer, Wayne F.

2011-01-01

In this second installment of a two-part feature on immersive education a webliography will provide resources discussing the use of various types of computer simulations including: (a) augmented reality, (b) virtual reality programs, (c) gaming resources for teaching with technology, (d) virtual reality lab resources, (e) virtual reality standards…

Augmented Reality in Neurosurgery: A Review of Current Concepts and Emerging Applications.

PubMed

Guha, Daipayan; Alotaibi, Naif M; Nguyen, Nhu; Gupta, Shaurya; McFaul, Christopher; Yang, Victor X D

2017-05-01

Augmented reality (AR) superimposes computer-generated virtual objects onto the user's view of the real world. Among medical disciplines, neurosurgery has long been at the forefront of image-guided surgery, and it continues to push the frontiers of AR technology in the operating room. In this systematic review, we explore the history of AR in neurosurgery and examine the literature on current neurosurgical applications of AR. Significant challenges to surgical AR exist, including compounded sources of registration error, impaired depth perception, visual and tactile temporal asynchrony, and operator inattentional blindness. Nevertheless, the ability to accurately display multiple three-dimensional datasets congruently over the area where they are most useful, coupled with future advances in imaging, registration, display technology, and robotic actuation, portend a promising role for AR in the neurosurgical operating room.

Fully Three-Dimensional Virtual-Reality System

NASA Technical Reports Server (NTRS)

Beckman, Brian C.

1994-01-01

Proposed virtual-reality system presents visual displays to simulate free flight in three-dimensional space. System, virtual space pod, is testbed for control and navigation schemes. Unlike most virtual-reality systems, virtual space pod would not depend for orientation on ground plane, which hinders free flight in three dimensions. Space pod provides comfortable seating, convenient controls, and dynamic virtual-space images for virtual traveler. Controls include buttons plus joysticks with six degrees of freedom.

Transduction between worlds: using virtual and mixed reality for earth and planetary science

NASA Astrophysics Data System (ADS)

Hedley, N.; Lochhead, I.; Aagesen, S.; Lonergan, C. D.; Benoy, N.

2017-12-01

Virtual reality (VR) and augmented reality (AR) have the potential to transform the way we visualize multidimensional geospatial datasets in support of geoscience research, exploration and analysis. The beauty of virtual environments is that they can be built at any scale, users can view them at many levels of abstraction, move through them in unconventional ways, and experience spatial phenomena as if they had superpowers. Similarly, augmented reality allows you to bring the power of virtual 3D data visualizations into everyday spaces. Spliced together, these interface technologies hold incredible potential to support 21st-century geoscience. In my ongoing research, my team and I have made significant advances to connect data and virtual simulations with real geographic spaces, using virtual environments, geospatial augmented reality and mixed reality. These research efforts have yielded new capabilities to connect users with spatial data and phenomena. These innovations include: geospatial x-ray vision; flexible mixed reality; augmented 3D GIS; situated augmented reality 3D simulations of tsunamis and other phenomena interacting with real geomorphology; augmented visual analytics; and immersive GIS. These new modalities redefine the ways in which we can connect digital spaces of spatial analysis, simulation and geovisualization, with geographic spaces of data collection, fieldwork, interpretation and communication. In a way, we are talking about transduction between real and virtual worlds. Taking a mixed reality approach to this, we can link real and virtual worlds. This paper presents a selection of our 3D geovisual interface projects in terrestrial, coastal, underwater and other environments. Using rigorous applied geoscience data, analyses and simulations, our research aims to transform the novelty of virtual and augmented reality interface technologies into game-changing mixed reality geoscience.

The Virtual Reality Roving Vehicle Project.

ERIC Educational Resources Information Center

Winn, William

1995-01-01

Describes the Virtual Reality Roving Vehicle project developed at the University of Washington to teach students in grades 4 through 12 about virtual reality. Topics include teacher workshops; virtual worlds created by students; learning outcomes compared with traditional instruction; and the effect of student characteristics, including gender, on…

World Reaction to Virtual Space

NASA Technical Reports Server (NTRS)

1999-01-01

DRaW Computing developed virtual reality software for the International Space Station. Open Worlds, as the software has been named, can be made to support Java scripting and virtual reality hardware devices. Open Worlds permits the use of VRML script nodes to add virtual reality capabilities to the user's applications.

Virtual Reality: An Instructional Medium for Visual-Spatial Tasks.

ERIC Educational Resources Information Center

Regian, J. Wesley; And Others

1992-01-01

Describes an empirical exploration of the instructional potential of virtual reality as an interface for simulation-based training. Shows that subjects learned spatial-procedural and spatial-navigational skills in virtual reality. (SR)

Mixed Reality with HoloLens: Where Virtual Reality Meets Augmented Reality in the Operating Room.

PubMed

Tepper, Oren M; Rudy, Hayeem L; Lefkowitz, Aaron; Weimer, Katie A; Marks, Shelby M; Stern, Carrie S; Garfein, Evan S

2017-11-01

Virtual reality and augmented reality devices have recently been described in the surgical literature. The authors have previously explored various iterations of these devices, and although they show promise, it has become clear that virtual reality and/or augmented reality devices alone do not adequately meet the demands of surgeons. The solution may lie in a hybrid technology known as mixed reality, which merges many virtual reality and augmented realty features. Microsoft's HoloLens, the first commercially available mixed reality device, provides surgeons intraoperative hands-free access to complex data, the real environment, and bidirectional communication. This report describes the use of HoloLens in the operating room to improve decision-making and surgical workflow. The pace of mixed reality-related technological development will undoubtedly be rapid in the coming years, and plastic surgeons are ideally suited to both lead and benefit from this advance.

The Immersive Virtual Reality Experience: A Typology of Users Revealed Through Multiple Correspondence Analysis Combined with Cluster Analysis Technique.

PubMed

Rosa, Pedro J; Morais, Diogo; Gamito, Pedro; Oliveira, Jorge; Saraiva, Tomaz

2016-03-01

Immersive virtual reality is thought to be advantageous by leading to higher levels of presence. However, and despite users getting actively involved in immersive three-dimensional virtual environments that incorporate sound and motion, there are individual factors, such as age, video game knowledge, and the predisposition to immersion, that may be associated with the quality of virtual reality experience. Moreover, one particular concern for users engaged in immersive virtual reality environments (VREs) is the possibility of side effects, such as cybersickness. The literature suggests that at least 60% of virtual reality users report having felt symptoms of cybersickness, which reduces the quality of the virtual reality experience. The aim of this study was thus to profile the right user to be involved in a VRE through head-mounted display. To examine which user characteristics are associated with the most effective virtual reality experience (lower cybersickness), a multiple correspondence analysis combined with cluster analysis technique was performed. Results revealed three distinct profiles, showing that the PC gamer profile is more associated with higher levels of virtual reality effectiveness, that is, higher predisposition to be immersed and reduced cybersickness symptoms in the VRE than console gamer and nongamer. These findings can be a useful orientation in clinical practice and future research as they help identify which users are more predisposed to benefit from immersive VREs.

Virtual Reality: Emerging Applications and Future Directions

ERIC Educational Resources Information Center

Ludlow, Barbara L.

2015-01-01

Virtual reality is an emerging technology that has resulted in rapid expansion in the development of virtual immersive environments for use as educational simulations in schools, colleges and universities. This article presents an overview of virtual reality, describes a number of applications currently being used by special educators for…

Virtual Reality: A Dream Come True or a Nightmare.

ERIC Educational Resources Information Center

Cornell, Richard; Bailey, Dan

Virtual Reality (VR) is a new medium which allows total stimulation of one's senses through human/computer interfaces. VR has applications in training simulators, nano-science, medicine, entertainment, electronic technology, and manufacturing. This paper focuses on some current and potential problems of virtual reality and virtual environments…

Virtual reality in surgical skills training.

PubMed

Palter, Vanessa N; Grantcharov, Teodor P

2010-06-01

With recent concerns regarding patient safety, and legislation regarding resident work hours, it is accepted that a certain amount of surgical skills training will transition to the surgical skills laboratory. Virtual reality offers enormous potential to enhance technical and non-technical skills training outside the operating room. Virtual-reality systems range from basic low-fidelity devices to highly complex virtual environments. These systems can act as training and assessment tools, with the learned skills effectively transferring to an analogous clinical situation. Recent developments include expanding the role of virtual reality to allow for holistic, multidisciplinary team training in simulated operating rooms, and focusing on the role of virtual reality in evidence-based surgical curriculum design. Copyright 2010 Elsevier Inc. All rights reserved.

Virtual Reality and Computer-Enhanced Training Applied to Wheeled Mobility: An Overview of Work in Pittsburgh

ERIC Educational Resources Information Center

Cooper, Rory A.; Ding, Dan; Simpson, Richard; Fitzgerald, Shirley G.; Spaeth, Donald M.; Guo, Songfeng; Koontz, Alicia M.; Cooper, Rosemarie; Kim, Jongbae; Boninger, Michael L.

2005-01-01

Some aspects of assistive technology can be enhanced by the application of virtual reality. Although virtual simulation offers a range of new possibilities, learning to navigate in a virtual environment is not equivalent to learning to navigate in the real world. Therefore, virtual reality simulation is advocated as a useful preparation for…

The benefits of virtual reality simulator training for laparoscopic surgery.

PubMed

Hart, Roger; Karthigasu, Krishnan

2007-08-01

Virtual reality is a computer-generated system that provides a representation of an environment. This review will analyse the literature with regard to any benefit to be derived from training with virtual reality equipment and to describe the current equipment available. Virtual reality systems are not currently realistic of the live operating environment because they lack tactile sensation, and do not represent a complete operation. The literature suggests that virtual reality training is a valuable learning tool for gynaecologists in training, particularly those in the early stages of their careers. Furthermore, it may be of benefit for the ongoing audit of surgical skills and for the early identification of a surgeon's deficiencies before operative incidents occur. It is only a matter of time before realistic virtual reality models of most complete gynaecological operations are available, with improved haptics as a result of improved computer technology. It is inevitable that in the modern climate of litigation virtual reality training will become an essential part of clinical training, as evidence for its effectiveness as a training tool exists, and in many countries training by operating on live animals is not possible.

[What do virtual reality tools bring to child and adolescent psychiatry?

PubMed

Bioulac, S; de Sevin, E; Sagaspe, P; Claret, A; Philip, P; Micoulaud-Franchi, J A; Bouvard, M P

2018-06-01

Virtual reality is a relatively new technology that enables individuals to immerse themselves in a virtual world. It offers several advantages including a more realistic, lifelike environment that may allow subjects to "forget" they are being assessed, allow a better participation and an increased generalization of learning. Moreover, the virtual reality system can provide multimodal stimuli, such as visual and auditory stimuli, and can also be used to evaluate the patient's multimodal integration and to aid rehabilitation of cognitive abilities. The use of virtual reality to treat various psychiatric disorders in adults (phobic anxiety disorders, post-traumatic stress disorder, eating disorders, addictions…) and its efficacy is supported by numerous studies. Similar research for children and adolescents is lagging behind. This may be particularly beneficial to children who often show great interest and considerable success on computer, console or videogame tasks. This article will expose the main studies that have used virtual reality with children and adolescents suffering from psychiatric disorders. The use of virtual reality to treat anxiety disorders in adults is gaining popularity and its efficacy is supported by various studies. Most of the studies attest to the significant efficacy of the virtual reality exposure therapy (or in virtuo exposure). In children, studies have covered arachnophobia social anxiety and school refusal phobia. Despite the limited number of studies, results are very encouraging for treatment in anxiety disorders. Several studies have reported the clinical use of virtual reality technology for children and adolescents with autistic spectrum disorders (ASD). Extensive research has proven the efficiency of technologies as support tools for therapy. Researches are found to be focused on communication and on learning and social imitation skills. Virtual reality is also well accepted by subjects with ASD. The virtual environment offers the opportunity to administer controlled tasks such as the typical neuropsychological tools, but in an environment much more like a standard classroom. The virtual reality classroom offers several advantages compared to classical tools such as more realistic and lifelike environment but also records various measures in standardized conditions. Most of the studies using a virtual classroom have found that children with Attention Deficit/Hyperactivity Disorder make significantly fewer correct hits and more commission errors compared with controls. The virtual classroom has proven to be a good clinical tool for evaluation of attention in ADHD. For eating disorders, cognitive behavioural therapy (CBT) program enhanced by a body image specific component using virtual reality techniques was shown to be more efficient than cognitive behavioural therapy alone. The body image-specific component using virtual reality techniques boots efficiency and accelerates the CBT change process for eating disorders. Virtual reality is a relatively new technology and its application in child and adolescent psychiatry is recent. However, this technique is still in its infancy and much work is needed including controlled trials before it can be introduced in routine clinical use. Virtual reality interventions should also investigate how newly acquired skills are transferred to the real world. At present virtual reality can be considered a useful tool in evaluation and treatment for child and adolescent disorders. Copyright © 2017 L'Encéphale, Paris. Published by Elsevier Masson SAS. All rights reserved.

Improving Balance in TBI Using a Low-Cost Customized Virtual Reality Rehabilitation Tool

DTIC Science & Technology

2016-10-01

AWARD NUMBER: W81XWH-14-2-0150 TITLE: Improving Balance in TBI Using a Low-Cost Customized Virtual Reality Rehabilitation Tool PRINCIPAL...AND SUBTITLE Improving Balance in TBI Using a Low-Cost Customized Virtual Reality Rehabilitation Tool 5a. CONTRACT NUMBER 5b. GRANT NUMBER W81XWH...Distribution Unlimited 13. SUPPLEMENTARY NOTES 14. ABSTRACT The proposed study will implement and evaluate a novel, low-cost, Virtual Reality (VR

Review of virtual reality treatment for mental health.

PubMed

Gourlay, D; Lun, K C; Liya, G

2001-01-01

This paper describes recent research that proposes virtual reality techniques as a therapy for patients with cognitive and psychological problems. Specifically this applies to victims of conditions such as traumatic brain injury, Alzheimers and Parkinsons. Additionally virtual reality therapy offers an alternative to current desensitization techniques for the treatment of phobias Some important issues are examined including means of user interaction, skills transfer to the real world, and side-effects of virtual reality exposure.

Virtual reality for dermatologic surgery: virtually a reality in the 21st century.

PubMed

Gladstone, H B; Raugi, G J; Berg, D; Berkley, J; Weghorst, S; Ganter, M

2000-01-01

In the 20th century, virtual reality has predominantly played a role in training pilots and in the entertainment industry. Despite much publicity, virtual reality did not live up to its perceived potential. During the past decade, it has also been applied for medical uses, particularly as training simulators, for minimally invasive surgery. Because of advances in computer technology, virtual reality is on the cusp of becoming an effective medical educational tool. At the University of Washington, we are developing a virtual reality soft tissue surgery simulator. Based on fast finite element modeling and using a personal computer, this device can simulate three-dimensional human skin deformations with real-time tactile feedback. Although there are many cutaneous biomechanical challenges to solve, it will eventually provide more realistic dermatologic surgery training for medical students and residents than the currently used models.

Evolving Educational Techniques in Surgical Training.

PubMed

Evans, Charity H; Schenarts, Kimberly D

2016-02-01

Training competent and professional surgeons efficiently and effectively requires innovation and modernization of educational methods. Today's medical learner is quite adept at using multiple platforms to gain information, providing surgical educators with numerous innovative avenues to promote learning. With the growth of technology, and the restriction of work hours in surgical education, there has been an increase in use of simulation, including virtual reality, robotics, telemedicine, and gaming. The use of simulation has shifted the learning of basic surgical skills to the laboratory, reserving limited time in the operating room for the acquisition of complex surgical skills". Copyright © 2016 Elsevier Inc. All rights reserved.

Perception and Haptic Rendering of Friction Moments.

PubMed

Kawasaki, H; Ohtuka, Y; Koide, S; Mouri, T

2011-01-01

This paper considers moments due to friction forces on the human fingertip. A computational technique called the friction moment arc method is presented. The method computes the static and/or dynamic friction moment independent of a friction force calculation. In addition, a new finger holder to display friction moment is presented. This device incorporates a small brushless motor and disk, and connects the human's finger to an interface finger of the five-fingered haptic interface robot HIRO II. Subjects' perception of friction moment while wearing the finger holder, as well as perceptions during object manipulation in a virtual reality environment, were evaluated experimentally.

An Intelligent Virtual Human System For Providing Healthcare Information And Support

DTIC Science & Technology

2011-01-01

for clinical purposes. Shifts in the social and scientific landscape have now set the stage for the next major movement in Clinical Virtual Reality ...College; dMadigan Army Medical Center Army Abstract. Over the last 15 years, a virtual revolution has taken place in the use of Virtual Reality ... Virtual Reality with the “birth” of intelligent virtual humans. Seminal research and development has appeared in the creation of highly interactive

Reality Check: Basics of Augmented, Virtual, and Mixed Reality.

PubMed

Brigham, Tara J

2017-01-01

Augmented, virtual, and mixed reality applications all aim to enhance a user's current experience or reality. While variations of this technology are not new, within the last few years there has been a significant increase in the number of artificial reality devices or applications available to the general public. This column will explain the difference between augmented, virtual, and mixed reality and how each application might be useful in libraries. It will also provide an overview of the concerns surrounding these different reality applications and describe how and where they are currently being used.

A Multi-Agent Approach to the Simulation of Robotized Manufacturing Systems

NASA Astrophysics Data System (ADS)

Foit, K.; Gwiazda, A.; Banaś, W.

2016-08-01

The recent years of eventful industry development, brought many competing products, addressed to the same market segment. The shortening of a development cycle became a necessity if the company would like to be competitive. Because of switching to the Intelligent Manufacturing model the industry search for new scheduling algorithms, while the traditional ones do not meet the current requirements. The agent-based approach has been considered by many researchers as an important way of evolution of modern manufacturing systems. Due to the properties of the multi-agent systems, this methodology is very helpful during creation of the model of production system, allowing depicting both processing and informational part. The complexity of such approach makes the analysis impossible without the computer assistance. Computer simulation still uses a mathematical model to recreate a real situation, but nowadays the 2D or 3D virtual environments or even virtual reality have been used for realistic illustration of the considered systems. This paper will focus on robotized manufacturing system and will present the one of possible approaches to the simulation of such systems. The selection of multi-agent approach is motivated by the flexibility of this solution that offers the modularity, robustness and autonomy.

A methodological, task-based approach to Procedure-Specific Simulations training.

PubMed

Setty, Yaki; Salzman, Oren

2016-12-01

Procedure-Specific Simulations (PSS) are 3D realistic simulations that provide a platform to practice complete surgical procedures in a virtual-reality environment. While PSS have the potential to improve surgeons' proficiency, there are no existing standards or guidelines for PSS development in a structured manner. We employ a unique platform inspired by game design to develop virtual reality simulations in three dimensions of urethrovesical anastomosis during radical prostatectomy. 3D visualization is supported by a stereo vision, providing a fully realistic view of the simulation. The software can be executed for any robotic surgery platform. Specifically, we tested the simulation under windows environment on the RobotiX Mentor. Using urethrovesical anastomosis during radical prostatectomy simulation as a representative example, we present a task-based methodological approach to PSS training. The methodology provides tasks in increasing levels of difficulty from a novice level of basic anatomy identification, to an expert level that permits testing new surgical approaches. The modular methodology presented here can be easily extended to support more complex tasks. We foresee this methodology as a tool used to integrate PSS as a complementary training process for surgical procedures.

STS-88 crew use simulators and virtual reality in preflight training

NASA Image and Video Library

1998-04-08

S98-05079 (8 Apr. 1998) --- Astronaut Jerry L. Ross, assigned as a mission specialist for the mission, uses specialized gear to train for his duties aboard the Space Shuttle Endeavour. This type virtual reality training allows each of the assigned Extravehicular Activity (EVA) astronauts -- Ross and James H. Newman -- to wear a helmet and special gloves to look at computer displays simulating actual movements around the various locations on the International Space Station (ISS) hardware with which they'll be working. One of those elements will be the Functional Cargo Block (FGB), which will have been launched a couple of weeks prior to STS-88. Once the FGB is captured using the Remote Manipulator System (RMS) of the Endeavour, astronaut Nancy J. Currie will maneuver the robot arm to dock the FGB to the conical mating adapter at the top of Node 1, to be carried in the Shuttle's cargo bay. In ensuing days, three EVA space walks by Ross and Newman will be performed to make power, data and utility connections between the two modules. Currie also uses this same lab to train for her RMS controlling duties.

STS-88 crew use simulators and virtual reality in preflight training

NASA Image and Video Library

1998-04-08

S98-05074 (8 Apr. 1998) --- Astronaut Jerry L. Ross, assigned as a mission specialist for the mission, uses special gear and software to train for his duties aboard the Space Shuttle Endeavour. This type virtual reality training supplements practice for each of the assigned space-walking astronauts -- Ross and James H. Newman -- during which they wear a helmet and special gloves to look at computer displays simulating actual movements around the various locations on the early International Space Station (ISS) hardware with which they'll be working. One of those elements will be the Functional Cargo Block (FGB), which will have been launched a couple of weeks prior to STS-88. Once the FGB is captured using the Remote Manipulator System (RMS) of the Endeavour, astronaut Nancy J. Currie will maneuver the robot arm to dock the FGB to the conical mating adapter at the top of Node 1, to be carried in the Shuttle's cargo bay. In ensuing days, three space walks by Ross and Newman will be performed to make power, data and utility connections between the two modules. Currie also uses this same lab to train for her RMS controlling duties.

STS-88 crew use simulators and virtual reality in preflight training

NASA Image and Video Library

1998-04-08

S98-05076 (8 Apr. 1998) --- Astronaut Jerry L. Ross, assigned as a mission specialist for the mission, uses special gear and software to train for his duties aboard the Space Shuttle Endeavour. This type virtual reality training supplements practice for each of the assigned space-walking astronauts -- Ross and James H. Newman -- during which they wear a helmet and special gloves to look at computer displays simulating actual movements around the various locations on the early International Space Station (ISS) hardware with which they'll be working. One of those elements will be the Functional Cargo Block (FGB), which will have been launched a couple of weeks prior to STS-88. Once the FGB is captured using the Remote Manipulator System (RMS) of the Endeavour, astronaut Nancy J. Currie will maneuver the robot arm to dock the FGB to the conical mating adapter at the top of Node 1, to be carried in the Shuttle's cargo bay. In ensuing days, three space walks by Ross and Newman will be performed to make power, data and utility connections between the two modules. Currie also uses this same lab to train for her RMS controlling duties.

A Drone Remote Sensing for Virtual Reality Simulation System for Forest Fires: Semantic Neural Network Approach

NASA Astrophysics Data System (ADS)

Narasimha Rao, Gudikandhula; Jagadeeswara Rao, Peddada; Duvvuru, Rajesh

2016-09-01

Wild fires have significant impact on atmosphere and lives. The demand of predicting exact fire area in forest may help fire management team by using drone as a robot. These are flexible, inexpensive and elevated-motion remote sensing systems that use drones as platforms are important for substantial data gaps and supplementing the capabilities of manned aircraft and satellite remote sensing systems. In addition, powerful computational tools are essential for predicting certain burned area in the duration of a forest fire. The reason of this study is to built up a smart system based on semantic neural networking for the forecast of burned areas. The usage of virtual reality simulator is used to support the instruction process of fire fighters and all users for saving of surrounded wild lives by using a naive method Semantic Neural Network System (SNNS). Semantics are valuable initially to have a enhanced representation of the burned area prediction and better alteration of simulation situation to the users. In meticulous, consequences obtained with geometric semantic neural networking is extensively superior to other methods. This learning suggests that deeper investigation of neural networking in the field of forest fires prediction could be productive.

Return to Flight: Crew Activities Resource Reel 1 of 2

NASA Technical Reports Server (NTRS)

2005-01-01

The crew of the STS-114 Discovery Mission is seen in various aspects of training for space flight. The crew activities include: 1) STS-114 Return to Flight Crew Photo Session; 2) Tile Repair Training on Precision Air Bearing Floor; 3) SAFER Tile Inspection Training in Virtual Reality Laboratory; 4) Guidance and Navigation Simulator Tile Survey Training; 5) Crew Inspects Orbital Boom and Sensor System (OBSS); 6) Bailout Training-Crew Compartment; 7) Emergency Egress Training-Crew Compartment Trainer (CCT); 8) Water Survival Training-Neutral Buoyancy Lab (NBL); 9) Ascent Training-Shuttle Motion Simulator; 10) External Tank Photo Training-Full Fuselage Trainer; 11) Rendezvous and Docking Training-Shuttle Engineering Simulator (SES) Dome; 12) Shuttle Robot Arm Training-SES Dome; 13) EVA Training Virtual Reality Lab; 14) EVA Training Neutral Buoyancy Lab; 15) EVA-2 Training-NBL; 16) EVA Tool Training-Partial Gravity Simulator; 17) Cure in Place Ablator Applicator (CIPAA) Training Glove Vacuum Chamber; 16) Crew Visit to Merritt Island Launch Area (MILA); 17) Crew Inspection-Space Shuttle Discovery; and 18) Crew Inspection-External Tank and Orbital Boom and Sensor System (OBSS). The crew are then seen answering questions from the media at the Space Shuttle Landing Facility.

Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

PubMed

Fransson, Boel A; Chen, Chi-Ya; Noyes, Julie A; Ragle, Claude A

2016-11-01

To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. Evaluation study. Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score. © Copyright 2016 by The American College of Veterinary Surgeons.

Augmented Virtuality: A Real-time Process for Presenting Real-world Visual Sensory Information in an Immersive Virtual Environment for Planetary Exploration

NASA Astrophysics Data System (ADS)

McFadden, D.; Tavakkoli, A.; Regenbrecht, J.; Wilson, B.

2017-12-01

Virtual Reality (VR) and Augmented Reality (AR) applications have recently seen an impressive growth, thanks to the advent of commercial Head Mounted Displays (HMDs). This new visualization era has opened the possibility of presenting researchers from multiple disciplines with data visualization techniques not possible via traditional 2D screens. In a purely VR environment researchers are presented with the visual data in a virtual environment, whereas in a purely AR application, a piece of virtual object is projected into the real world with which researchers could interact. There are several limitations to the purely VR or AR application when taken within the context of remote planetary exploration. For example, in a purely VR environment, contents of the planet surface (e.g. rocks, terrain, or other features) should be created off-line from a multitude of images using image processing techniques to generate 3D mesh data that will populate the virtual surface of the planet. This process usually takes a tremendous amount of computational resources and cannot be delivered in real-time. As an alternative, video frames may be superimposed on the virtual environment to save processing time. However, such rendered video frames will lack 3D visual information -i.e. depth information. In this paper, we present a technique to utilize a remotely situated robot's stereoscopic cameras to provide a live visual feed from the real world into the virtual environment in which planetary scientists are immersed. Moreover, the proposed technique will blend the virtual environment with the real world in such a way as to preserve both the depth and visual information from the real world while allowing for the sensation of immersion when the entire sequence is viewed via an HMD such as Oculus Rift. The figure shows the virtual environment with an overlay of the real-world stereoscopic video being presented in real-time into the virtual environment. Notice the preservation of the object's shape, shadows, and depth information. The distortions shown in the image are due to the rendering of the stereoscopic data into a 2D image for the purposes of taking screenshots.

Body Space in Social Interactions: A Comparison of Reaching and Comfort Distance in Immersive Virtual Reality

PubMed Central

Iachini, Tina; Coello, Yann; Frassinetti, Francesca; Ruggiero, Gennaro

2014-01-01

Background Do peripersonal space for acting on objects and interpersonal space for interacting with con-specifics share common mechanisms and reflect the social valence of stimuli? To answer this question, we investigated whether these spaces refer to a similar or different physical distance. Methodology Participants provided reachability-distance (for potential action) and comfort-distance (for social processing) judgments towards human and non-human virtual stimuli while standing still (passive) or walking toward stimuli (active). Principal Findings Comfort-distance was larger than other conditions when participants were passive, but reachability and comfort distances were similar when participants were active. Both spaces were modulated by the social valence of stimuli (reduction with virtual females vs males, expansion with cylinder vs robot) and the gender of participants. Conclusions These findings reveal that peripersonal reaching and interpersonal comfort spaces share a common motor nature and are sensitive, at different degrees, to social modulation. Therefore, social processing seems embodied and grounded in the body acting in space. PMID:25405344

A randomized, controlled trial of immersive virtual reality analgesia, during physical therapy for pediatric burns.

PubMed

Schmitt, Yuko S; Hoffman, Hunter G; Blough, David K; Patterson, David R; Jensen, Mark P; Soltani, Maryam; Carrougher, Gretchen J; Nakamura, Dana; Sharar, Sam R

2011-02-01

This randomized, controlled, within-subjects (crossover design) study examined the effects of immersive virtual reality as an adjunctive analgesic technique for hospitalized pediatric burn inpatients undergoing painful physical therapy. Fifty-four subjects (6-19 years old) performed range-of-motion exercises under a therapist's direction for 1-5 days. During each session, subjects spent equivalent time in both the virtual reality and the control conditions (treatment order randomized and counterbalanced). Graphic rating scale scores assessing the sensory, affective, and cognitive components of pain were obtained for each treatment condition. Secondary outcomes assessed subjects' perception of the virtual reality experience and maximum range-of-motion. Results showed that on study day one, subjects reported significant decreases (27-44%) in pain ratings during virtual reality. They also reported improved affect ("fun") during virtual reality. The analgesia and affect improvements were maintained with repeated virtual reality use over multiple therapy sessions. Maximum range-of-motion was not different between treatment conditions, but was significantly greater after the second treatment condition (regardless of treatment order). These results suggest that immersive virtual reality is an effective nonpharmacologic, adjunctive pain reduction technique in the pediatric burn population undergoing painful rehabilitation therapy. The magnitude of the analgesic effect is clinically meaningful and is maintained with repeated use. Copyright © 2010 Elsevier Ltd and ISBI. All rights reserved.

A Randomized, Controlled Trial of Immersive Virtual Reality Analgesia during Physical Therapy for Pediatric Burn Injuries

PubMed Central

Schmitt, Yuko S.; Hoffman, Hunter G.; Blough, David K.; Patterson, David R.; Jensen, Mark P.; Soltani, Maryam; Carrougher, Gretchen J.; Nakamura, Dana; Sharar, Sam R.

2010-01-01

This randomized, controlled, within-subjects (crossover design) study examined the effects of immersive virtual reality as an adjunctive analgesic technique for hospitalized pediatric burn inpatients undergoing painful physical therapy. Fifty-four subjects (6–19 years old) performed range-of-motion exercises under a therapist’s direction for one to five days. During each session, subjects spent equivalent time in both the virtual reality and the control conditions (treatment order randomized and counterbalanced). Graphic rating scale scores assessing the sensory, affective, and cognitive components of pain were obtained for each treatment condition. Secondary outcomes assessed subjects’ perception of the virtual reality experience and maximum range-of-motion. Results showed that on study day one, subjects reported significant decreases (27–44%) in pain ratings during virtual reality. They also reported improved affect (“fun”) during virtual reality. The analgesia and affect improvements were maintained with repeated virtual reality use over multiple therapy sessions. Maximum range-of-motion was not different between treatment conditions, but was significantly greater after the second treatment condition (regardless of treatment order). These results suggest that immersive virtual reality is an effective nonpharmacologic, adjunctive pain reduction technique in the pediatric burn population undergoing painful rehabilitation therapy. The magnitude of the analgesic effect is clinically meaningful and is maintained with repeated use. PMID:20692769

Operating Room Performance Improves after Proficiency-Based Virtual Reality Cataract Surgery Training.

PubMed

Thomsen, Ann Sofia Skou; Bach-Holm, Daniella; Kjærbo, Hadi; Højgaard-Olsen, Klavs; Subhi, Yousif; Saleh, George M; Park, Yoon Soo; la Cour, Morten; Konge, Lars

2017-04-01

To investigate the effect of virtual reality proficiency-based training on actual cataract surgery performance. The secondary purpose of the study was to define which surgeons benefit from virtual reality training. Multicenter masked clinical trial. Eighteen cataract surgeons with different levels of experience. Cataract surgical training on a virtual reality simulator (EyeSi) until a proficiency-based test was passed. Technical performance in the operating room (OR) assessed by 3 independent, masked raters using a previously validated task-specific assessment tool for cataract surgery (Objective Structured Assessment of Cataract Surgical Skill). Three surgeries before and 3 surgeries after the virtual reality training were video-recorded, anonymized, and presented to the raters in random order. Novices (non-independently operating surgeons) and surgeons having performed fewer than 75 independent cataract surgeries showed significant improvements in the OR-32% and 38%, respectively-after virtual reality training (P = 0.008 and P = 0.018). More experienced cataract surgeons did not benefit from simulator training. The reliability of the assessments was high with a generalizability coefficient of 0.92 and 0.86 before and after the virtual reality training, respectively. Clinically relevant cataract surgical skills can be improved by proficiency-based training on a virtual reality simulator. Novices as well as surgeons with an intermediate level of experience showed improvement in OR performance score. Copyright © 2017 American Academy of Ophthalmology. Published by Elsevier Inc. All rights reserved.

Surgery applications of virtual reality

NASA Technical Reports Server (NTRS)

Rosen, Joseph

1994-01-01

Virtual reality is a computer-generated technology which allows information to be displayed in a simulated, bus lifelike, environment. In this simulated 'world', users can move and interact as if they were actually a part of that world. This new technology will be useful in many different fields, including the field of surgery. Virtual reality systems can be used to teach surgical anatomy, diagnose surgical problems, plan operations, simulate and perform surgical procedures (telesurgery), and predict the outcomes of surgery. The authors of this paper describe the basic components of a virtual reality surgical system. These components include: the virtual world, the virtual tools, the anatomical model, the software platform, the host computer, the interface, and the head-coupled display. In the chapter they also review the progress towards using virtual reality for surgical training, planning, telesurgery, and predicting outcomes. Finally, the authors present a training system being developed for the practice of new procedures in abdominal surgery.

[Virtual reality in neurosurgery].

PubMed

Tronnier, V M; Staubert, A; Bonsanto, M M; Wirtz, C R; Kunze, S

2000-03-01

Virtual reality enables users to immerse themselves in a virtual three-dimensional world and to interact in this world. The simulation is different from the kind in computer games, in which the viewer is active but acts in a nonrealistic world, or on the TV screen, where we are passively driven in an active world. In virtual reality elements look realistic, they change their characteristics and have almost real-world unpredictability. Virtual reality is not only implemented in gambling dens and the entertainment industry but also in manufacturing processes (cars, furniture etc.), military applications and medicine. Especially the last two areas are strongly correlated, because telemedicine or telesurgery was originated for military reasons to operate on war victims from a secure distance or to perform surgery on astronauts in an orbiting space station. In medicine and especially neurosurgery virtual-reality methods are used for education, surgical planning and simulation on a virtual patient.

Virtual local target method for avoiding local minimum in potential field based robot navigation.

PubMed

Zou, Xi-Yong; Zhu, Jing

2003-01-01

A novel robot navigation algorithm with global path generation capability is presented. Local minimum is a most intractable but is an encountered frequently problem in potential field based robot navigation. Through appointing appropriately some virtual local targets on the journey, it can be solved effectively. The key concept employed in this algorithm are the rules that govern when and how to appoint these virtual local targets. When the robot finds itself in danger of local minimum, a virtual local target is appointed to replace the global goal temporarily according to the rules. After the virtual target is reached, the robot continues on its journey by heading towards the global goal. The algorithm prevents the robot from running into local minima anymore. Simulation results showed that it is very effective in complex obstacle environments.

Proof-of-Concept Part Task Trainer for Close Air Support Procedures

DTIC Science & Technology

2016-06-01

TVDL Tactical Video Down Link VE Virtual Environment VR Virtual Reality WTI Weapons and Tactics Instructor xvii ACKNOWLEDGMENTS I would first...in training of USMC pilots for close air support operations? • What is the feasibility of developing a prototype virtual reality (VR) system that...Chapter IV provides a review of virtual reality (VR)/ virtual environment (VE) and part-task trainers currently used in military training

Grasping trajectories in a virtual environment adhere to Weber's law.

PubMed

Ozana, Aviad; Berman, Sigal; Ganel, Tzvi

2018-06-01

Virtual-reality and telerobotic devices simulate local motor control of virtual objects within computerized environments. Here, we explored grasping kinematics within a virtual environment and tested whether, as in normal 3D grasping, trajectories in the virtual environment are performed analytically, violating Weber's law with respect to object's size. Participants were asked to grasp a series of 2D objects using a haptic system, which projected their movements to a virtual space presented on a computer screen. The apparatus also provided object-specific haptic information upon "touching" the edges of the virtual targets. The results showed that grasping movements performed within the virtual environment did not produce the typical analytical trajectory pattern obtained during 3D grasping. Unlike as in 3D grasping, grasping trajectories in the virtual environment adhered to Weber's law, which indicates relative resolution in size processing. In addition, the trajectory patterns differed from typical trajectories obtained during 3D grasping, with longer times to complete the movement, and with maximum grip apertures appearing relatively early in the movement. The results suggest that grasping movements within a virtual environment could differ from those performed in real space, and are subjected to irrelevant effects of perceptual information. Such atypical pattern of visuomotor control may be mediated by the lack of complete transparency between the interface and the virtual environment in terms of the provided visual and haptic feedback. Possible implications of the findings to movement control within robotic and virtual environments are further discussed.

Virtual reality training for surgical trainees in laparoscopic surgery.

PubMed

Nagendran, Myura; Gurusamy, Kurinchi Selvan; Aggarwal, Rajesh; Loizidou, Marilena; Davidson, Brian R

2013-08-27

Standard surgical training has traditionally been one of apprenticeship, where the surgical trainee learns to perform surgery under the supervision of a trained surgeon. This is time-consuming, costly, and of variable effectiveness. Training using a virtual reality simulator is an option to supplement standard training. Virtual reality training improves the technical skills of surgical trainees such as decreased time for suturing and improved accuracy. The clinical impact of virtual reality training is not known. To assess the benefits (increased surgical proficiency and improved patient outcomes) and harms (potentially worse patient outcomes) of supplementary virtual reality training of surgical trainees with limited laparoscopic experience. We searched the Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library, MEDLINE, EMBASE and Science Citation Index Expanded until July 2012. We included all randomised clinical trials comparing virtual reality training versus other forms of training including box-trainer training, no training, or standard laparoscopic training in surgical trainees with little laparoscopic experience. We also planned to include trials comparing different methods of virtual reality training. We included only trials that assessed the outcomes in people undergoing laparoscopic surgery. Two authors independently identified trials and collected data. We analysed the data with both the fixed-effect and the random-effects models using Review Manager 5 analysis. For each outcome we calculated the mean difference (MD) or standardised mean difference (SMD) with 95% confidence intervals based on intention-to-treat analysis. We included eight trials covering 109 surgical trainees with limited laparoscopic experience. Of the eight trials, six compared virtual reality versus no supplementary training. One trial compared virtual reality training versus box-trainer training and versus no supplementary training, and one trial compared virtual reality training versus box-trainer training. There were no trials that compared different forms of virtual reality training. All the trials were at high risk of bias. Operating time and operative performance were the only outcomes reported in the trials. The remaining outcomes such as mortality, morbidity, quality of life (the primary outcomes of this review) and hospital stay (a secondary outcome) were not reported. Virtual reality training versus no supplementary training: The operating time was significantly shorter in the virtual reality group than in the no supplementary training group (3 trials; 49 participants; MD -11.76 minutes; 95% CI -15.23 to -8.30). Two trials that could not be included in the meta-analysis also showed a reduction in operating time (statistically significant in one trial). The numerical values for operating time were not reported in these two trials. The operative performance was significantly better in the virtual reality group than the no supplementary training group using the fixed-effect model (2 trials; 33 participants; SMD 1.65; 95% CI 0.72 to 2.58). The results became non-significant when the random-effects model was used (2 trials; 33 participants; SMD 2.14; 95% CI -1.29 to 5.57). One trial could not be included in the meta-analysis as it did not report the numerical values. The authors stated that the operative performance of virtual reality group was significantly better than the control group. Virtual reality training versus box-trainer training: The only trial that reported operating time did not report the numerical values. In this trial, the operating time in the virtual reality group was significantly shorter than in the box-trainer group. Of the two trials that reported operative performance, only one trial reported the numerical values. The operative performance was significantly better in the virtual reality group than in the box-trainer group (1 trial; 19 participants; SMD 1.46; 95% CI 0.42 to 2.50). In the other trial that did not report the numerical values, the authors stated that the operative performance in the virtual reality group was significantly better than the box-trainer group. Virtual reality training appears to decrease the operating time and improve the operative performance of surgical trainees with limited laparoscopic experience when compared with no training or with box-trainer training. However, the impact of this decreased operating time and improvement in operative performance on patients and healthcare funders in terms of improved outcomes or decreased costs is not known. Further well-designed trials at low risk of bias and random errors are necessary. Such trials should assess the impact of virtual reality training on clinical outcomes.

Virtual Sensors for Advanced Controllers in Rehabilitation Robotics.

PubMed

Mancisidor, Aitziber; Zubizarreta, Asier; Cabanes, Itziar; Portillo, Eva; Jung, Je Hyung

2018-03-05

In order to properly control rehabilitation robotic devices, the measurement of interaction force and motion between patient and robot is an essential part. Usually, however, this is a complex task that requires the use of accurate sensors which increase the cost and the complexity of the robotic device. In this work, we address the development of virtual sensors that can be used as an alternative of actual force and motion sensors for the Universal Haptic Pantograph (UHP) rehabilitation robot for upper limbs training. These virtual sensors estimate the force and motion at the contact point where the patient interacts with the robot using the mathematical model of the robotic device and measurement through low cost position sensors. To demonstrate the performance of the proposed virtual sensors, they have been implemented in an advanced position/force controller of the UHP rehabilitation robot and experimentally evaluated. The experimental results reveal that the controller based on the virtual sensors has similar performance to the one using direct measurement (less than 0.005 m and 1.5 N difference in mean error). Hence, the developed virtual sensors to estimate interaction force and motion can be adopted to replace actual precise but normally high-priced sensors which are fundamental components for advanced control of rehabilitation robotic devices.

Can virtual reality be used to conduct mass prophylaxis clinic training? A pilot program.

PubMed

Yellowlees, Peter; Cook, James N; Marks, Shayna L; Wolfe, Daniel; Mangin, Elanor

2008-03-01

To create and evaluate a pilot bioterrorism defense training environment using virtual reality technology. The present pilot project used Second Life, an internet-based virtual world system, to construct a virtual reality environment to mimic an actual setting that might be used as a Strategic National Stockpile (SNS) distribution site for northern California in the event of a bioterrorist attack. Scripted characters were integrated into the system as mock patients to analyze various clinic workflow scenarios. Users tested the virtual environment over two sessions. Thirteen users who toured the environment were asked to complete an evaluation survey. Respondents reported that the virtual reality system was relevant to their practice and had potential as a method of bioterrorism defense training. Computer simulations of bioterrorism defense training scenarios are feasible with existing personal computer technology. The use of internet-connected virtual environments holds promise for bioterrorism defense training. Recommendations are made for public health agencies regarding the implementation and benefits of using virtual reality for mass prophylaxis clinic training.

User Guide: How to Use and Operate Virtual Reality Equipment in the Systems Assessment and Usability Laboratory (SAUL) for Conducting Demonstrations

DTIC Science & Technology

2017-08-01

ARL-TN-0839 ● AUG 2017 US Army Research Laboratory User Guide: How to Use and Operate Virtual Reality Equipment in the Systems...ARL-TN-0839 ● AUG 2017 US Army Research Laboratory User Guide: How to Use and Operate Virtual Reality Equipment in the Systems...September 2017 4. TITLE AND SUBTITLE User Guide: How to Use and Operate Virtual Reality Equipment in the Systems Assessment and Usability Laboratory

Assessment of individual hand performance in box trainers compared to virtual reality trainers.

PubMed

Madan, Atul K; Frantzides, Constantine T; Shervin, Nina; Tebbit, Christopher L

2003-12-01

Training residents in laparoscopic skills is ideally initiated in an inanimate laboratory with both box trainers and virtual reality trainers. Virtual reality trainers have the ability to score individual hand performance although they are expensive. Here we compared the ability to assess dominant and nondominant hand performance in box trainers with virtual reality trainers. Medical students without laparoscopic experience were utilized in this study (n = 16). Each student performed tasks on the LTS 2000, an inanimate box trainer (placing pegs with both hands and transferring pegs from one hand to another), as well as a task on the MIST-VR, a virtual reality trainer (grasping a virtual object and placing it in a virtual receptable with alternating hands). A surgeon scored students for the inanimate box trainer exercises (time and errors) while the MIST-VR scored students (time, economy of movements, and errors for each hand). Statistical analysis included Pearson correlations. Errors and time for the one-handed tasks on the box trainer did not correlate with errors, time, or economy measured for each hand by the MIST-VR (r = 0.01 to 0.30; P = NS). Total errors on the virtual reality trainer did correlate with errors on transferring pege (r = 0.61; P < 0.05). Economy and time of both dominant and nondominant hand from the MIST-VR correlated with time of transferring pegs in the box trainer (r = 0.53 to 0.77; P < 0.05). While individual hand assessment by the box trainer during 2-handed tasks was related to assessment by the virtual reality trainer, individual hand assessment during 1-handed tasks did not correlate with the virtual reality trainer. Virtual reality trainers, such as the MIST-VR, allow assessment of individual hand skills which may lead to improved laparoscopic skill acquisition. It is difficult to assess individual hand performance with box trainers alone.

A Motionless Camera

NASA Technical Reports Server (NTRS)

1994-01-01

Omniview, a motionless, noiseless, exceptionally versatile camera was developed for NASA as a receiving device for guiding space robots. The system can see in one direction and provide as many as four views simultaneously. Developed by Omniview, Inc. (formerly TRI) under a NASA Small Business Innovation Research (SBIR) grant, the system's image transformation electronics produce a real-time image from anywhere within a hemispherical field. Lens distortion is removed, and a corrected "flat" view appears on a monitor. Key elements are a high resolution charge coupled device (CCD), image correction circuitry and a microcomputer for image processing. The system can be adapted to existing installations. Applications include security and surveillance, teleconferencing, imaging, virtual reality, broadcast video and military operations. Omniview technology is now called IPIX. The company was founded in 1986 as TeleRobotics International, became Omniview in 1995, and changed its name to Interactive Pictures Corporation in 1997.

Stroke rehabilitation.

PubMed

Langhorne, Peter; Bernhardt, Julie; Kwakkel, Gert

2011-05-14

Stroke is a common, serious, and disabling global health-care problem, and rehabilitation is a major part of patient care. There is evidence to support rehabilitation in well coordinated multidisciplinary stroke units or through provision of early supported provision of discharge teams. Potentially beneficial treatment options for motor recovery of the arm include constraint-induced movement therapy and robotics. Promising interventions that could be beneficial to improve aspects of gait include fitness training, high-intensity therapy, and repetitive-task training. Repetitive-task training might also improve transfer functions. Occupational therapy can improve activities of daily living; however, information about the clinical effect of various strategies of cognitive rehabilitation and strategies for aphasia and dysarthria is scarce. Several large trials of rehabilitation practice and of novel therapies (eg, stem-cell therapy, repetitive transcranial magnetic stimulation, virtual reality, robotic therapies, and drug augmentation) are underway to inform future practice. Copyright © 2011 Elsevier Ltd. All rights reserved.

Three-dimensional face pose detection and tracking using monocular videos: tool and application.

PubMed

Dornaika, Fadi; Raducanu, Bogdan

2009-08-01

Recently, we have proposed a real-time tracker that simultaneously tracks the 3-D head pose and facial actions in monocular video sequences that can be provided by low quality cameras. This paper has two main contributions. First, we propose an automatic 3-D face pose initialization scheme for the real-time tracker by adopting a 2-D face detector and an eigenface system. Second, we use the proposed methods-the initialization and tracking-for enhancing the human-machine interaction functionality of an AIBO robot. More precisely, we show how the orientation of the robot's camera (or any active vision system) can be controlled through the estimation of the user's head pose. Applications based on head-pose imitation such as telepresence, virtual reality, and video games can directly exploit the proposed techniques. Experiments on real videos confirm the robustness and usefulness of the proposed methods.

The Reality of Virtual Reality Product Development

NASA Astrophysics Data System (ADS)

Dever, Clark

Virtual Reality and Augmented Reality are emerging areas of research and product development in enterprise companies. This talk will discuss industry standard tools and current areas of application in the commercial market. Attendees will gain insights into how to research, design, and (most importantly) ship, world class products. The presentation will recount the lessons learned to date developing a Virtual Reality tool to solve physics problems resulting from trying to perform aircraft maintenance on ships at sea.

Virtual Reality: A Strategy for Training in Cross-Cultural Communication.

ERIC Educational Resources Information Center

Meyer, Catherine; Dunn-Roberts, Richard

1992-01-01

Defines virtual reality and explains terminology, theoretical concepts, and enabling technologies. Research and applications are described; limitations of current technology are considered; and future possibilities are discussed, including the use of virtual reality in training for cross-cultural communication. (22 references) (LRW)

Making Information Overload Work: The Dragon Software System on a Virtual Reality Responsive Workbench

DTIC Science & Technology

1998-03-01

Research Laboratory’s Virtual Reality Responsive Workbench (VRRWB) and Dragon software system which together address the problem of battle space...and describe the lessons which have been learned. Interactive graphics, workbench, battle space visualization, virtual reality , user interface.

[Virtual reality in medical education].

PubMed

Edvardsen, O; Steensrud, T

1998-02-28

Virtual reality technology has found new applications in industry over the last few years. Medical literature has for several years predicted a break-through in this technology for medical education. Although there is a great potential for this technology in medical education, there seems to be a wide gap between expectations and actual possibilities at present. State of the technology was explored by participation at the conference "Medicine meets virtual reality V" (San Diego Jan. 22-25 1997) and a visit to one of the leading laboratories on virtual reality in medical education. In this paper we introduce some of the basic terminology and technology, review some of the topics covered by the conference, and describe projects running in one of the leading laboratories on virtual reality technology for medical education. With this information in mind, we discuss potential applications of the current technology in medical education. Current virtual reality systems are judged to be too costly and their usefulness in education too limited for routine use in medical education.

Turning Virtual Reality into Reality: A Checklist to Ensure Virtual Reality Studies of Eating Behavior and Physical Activity Parallel the Real World

PubMed Central

Tal, Aner; Wansink, Brian

2011-01-01

Virtual reality (VR) provides a potentially powerful tool for researchers seeking to investigate eating and physical activity. Some unique conditions are necessary to ensure that the psychological processes that influence real eating behavior also influence behavior in VR environments. Accounting for these conditions is critical if VR-assisted research is to accurately reflect real-world situations. The current work discusses key considerations VR researchers must take into account to ensure similar psychological functioning in virtual and actual reality and does so by focusing on the process of spontaneous mental simulation. Spontaneous mental simulation is prevalent under real-world conditions but may be absent under VR conditions, potentially leading to differences in judgment and behavior between virtual and actual reality. For simulation to occur, the virtual environment must be perceived as being available for action. A useful chart is supplied as a reference to help researchers to investigate eating and physical activity more effectively. PMID:21527088

Turning virtual reality into reality: a checklist to ensure virtual reality studies of eating behavior and physical activity parallel the real world.

PubMed

Tal, Aner; Wansink, Brian

2011-03-01

Virtual reality (VR) provides a potentially powerful tool for researchers seeking to investigate eating and physical activity. Some unique conditions are necessary to ensure that the psychological processes that influence real eating behavior also influence behavior in VR environments. Accounting for these conditions is critical if VR-assisted research is to accurately reflect real-world situations. The current work discusses key considerations VR researchers must take into account to ensure similar psychological functioning in virtual and actual reality and does so by focusing on the process of spontaneous mental simulation. Spontaneous mental simulation is prevalent under real-world conditions but may be absent under VR conditions, potentially leading to differences in judgment and behavior between virtual and actual reality. For simulation to occur, the virtual environment must be perceived as being available for action. A useful chart is supplied as a reference to help researchers to investigate eating and physical activity more effectively. © 2011 Diabetes Technology Society.

Exploring Learner Acceptance of the Use of Virtual Reality in Medical Education: A Case Study of Desktop and Projection-Based Display Systems

ERIC Educational Resources Information Center

Huang, Hsiu-Mei; Liaw, Shu-Sheng; Lai, Chung-Min

2016-01-01

Advanced technologies have been widely applied in medical education, including human-patient simulators, immersive virtual reality Cave Automatic Virtual Environment systems, and video conferencing. Evaluating learner acceptance of such virtual reality (VR) learning environments is a critical issue for ensuring that such technologies are used to…

French Military Applications of Virtual Reality

DTIC Science & Technology

2000-11-01

UNCLASSIFIED Defense Technical Information Center Compilation Part Notice ADPO10631 TITLE: French Military Applications of Virtual Reality...numbers comprise the compilation report: ADPO10609 thru ADP010633 UNCLASSIFIED 23-1 FRENCH MILITARY APPLICATIONS OF VIRTUAL REALITY Jean Paul Papin* and...Pascal Hue DGA/DCE/ETC4/ETAS Etablissement Technique d’ Angers BP 36 49460 MONTREUIL JUIGNE, France INTRODUCTION France is now applying virtual

Virtual reality pain control during burn wound debridement of combat-related burn injuries using robot-like arm mounted VR goggles.

PubMed

Maani, Christopher V; Hoffman, Hunter G; Morrow, Michelle; Maiers, Alan; Gaylord, Kathryn; McGhee, Laura L; DeSocio, Peter A

2011-07-01

This is the first controlled study to explore whether adjunctive immersive virtual reality (VR) can reduce excessive pain of soldiers with combat-related burn injuries during wound debridement. Patients were US soldiers burned in combat attacks involving explosive devices in Iraq or Afghanistan. During the same wound care session using a within-subject experimental design, 12 patients received half of their severe burn wound cleaning procedure (~6 minutes) with standard of care pharmacologies and half while in VR (treatment order randomized). Three 0 to 10 Graphic Rating Scale pain scores for each of the treatment conditions served as the primary variables. Patients reported significantly less pain when distracted with VR. "Worst pain" (pain intensity) dropped from 6.25 of 10 to 4.50 of 10. "Pain unpleasantness" ratings dropped from "moderate" (6.25 of 10) to "mild" (2.83 of 10). "Time spent thinking about pain" dropped from 76% during no VR to 22% during VR. Patients rated "no VR" as "no fun at all" (<1 of 10) and rated VR as "pretty fun" (7.5 of 10). Follow-up analyses showed VR was especially effective for the six patients who scored 7 of 10 or higher (severe to excruciating) on the "worst pain" (pain intensity) ratings. These preliminary results provide the first evidence from a controlled study that adjunctive immersive VR reduced pain of patients with combat-related burn injuries during severe burn wound debridement. Pain reduction during VR was greatest in patients with the highest pain during no VR. These patients were the first to use a unique custom robot-like arm mounted VR goggle system.

Virtual Reality Pain Control During Burn Wound Debridement of Combat-Related Burn Injuries Using Robot-Like Arm Mounted VR Goggles

PubMed Central

Maani, Christopher V.; Hoffman, Hunter G.; Morrow, Michelle; Maiers, Alan; Gaylord, Kathryn; McGhee, Laura L.; DeSocio, Peter A.

2015-01-01

Background This is the first controlled study to explore whether adjunctive immersive virtual reality (VR) can reduce excessive pain of soldiers with combat-related burn injuries during wound debridement. Methods Patients were US soldiers burned in combat attacks involving explosive devices in Iraq or Afghanistan. During the same wound care session using a within-subject experimental design, 12 patients received half of their severe burn wound cleaning procedure (∼6 minutes) with standard of care pharmacologies and half while in VR (treatment order randomized). Three 0 to 10 Graphic Rating Scale pain scores for each of the treatment conditions served as the primary variables. Results Patients reported significantly less pain when distracted with VR. “Worst pain” (pain intensity) dropped from 6.25 of 10 to 4.50 of 10. “Pain unpleasantness” ratings dropped from “moderate” (6.25 of 10) to “mild” (2.83 of 10). “Time spent thinking about pain” dropped from 76% during no VR to 22% during VR. Patients rated “no VR” as “no fun at all” (<1 of 10) and rated VR as “pretty fun” (7.5 of 10). Follow-up analyses showed VR was especially effective for the six patients who scored 7 of 10 or higher (severe to excruciating) on the “worst pain” (pain intensity) ratings. Conclusions These preliminary results provide the first evidence from a controlled study that adjunctive immersive VR reduced pain of patients with combat-related burn injuries during severe burn wound debridement. Pain reduction during VR was greatest in patients with the highest pain during no VR. These patients were the first to use a unique custom robot-like arm mounted VR goggle system. PMID:21795888

Similarities and differences between eating disorders and obese patients in a virtual environment for normalizing eating patterns.

PubMed

Perpiñá, Conxa; Roncero, María

2016-05-01

Virtual reality has demonstrated promising results in the treatment of eating disorders (ED); however, few studies have examined its usefulness in treating obesity. The aim of this study was to compare ED and obese patients on their reality judgment of a virtual environment (VE) designed to normalize their eating pattern. A second objective was to study which variables predicted the reality of the experience of eating a virtual forbidden-fattening food. ED patients, obese patients, and a non-clinical group (N=62) experienced a non-immersive VE, and then completed reality judgment and presence measures. All participants rated the VE with similar scores for quality, interaction, engagement, and ecological validity; however, ED patients obtained the highest scores on emotional involvement, attention, reality judgment/presence, and negative effects. The obese group gave the lowest scores to reality judgment/presence, satisfaction and sense of physical space, and they held an intermediate position in the attribution of reality to virtually eating a "fattening" food. The palatability of a virtual food was predicted by attention capturing and belonging to the obese group, while the attribution of reality to the virtual eating was predicted by engagement and belonging to the ED group. This study offers preliminary results about the differential impact on ED and obese patients of the exposure to virtual food, and about the need to implement a VE that can be useful as a virtual lab for studying eating behavior and treating obesity. Copyright © 2016 Elsevier Inc. All rights reserved.

A Discussion of Virtual Reality As a New Tool for Training Healthcare Professionals.

PubMed

Fertleman, Caroline; Aubugeau-Williams, Phoebe; Sher, Carmel; Lim, Ai-Nee; Lumley, Sophie; Delacroix, Sylvie; Pan, Xueni

2018-01-01

Virtual reality technology is an exciting and emerging field with vast applications. Our study sets out the viewpoint that virtual reality software could be a new focus of direction in the development of training tools in medical education. We carried out a panel discussion at the Center for Behavior Change 3rd Annual Conference, prompted by the study, "The Responses of Medical General Practitioners to Unreasonable Patient Demand for Antibiotics--A Study of Medical Ethics Using Immersive Virtual Reality" (1). In Pan et al.'s study, 21 general practitioners (GPs) and GP trainees took part in a videoed, 15-min virtual reality scenario involving unnecessary patient demands for antibiotics. This paper was discussed in-depth at the Center for Behavior Change 3rd Annual Conference; the content of this paper is a culmination of findings and feedback from the panel discussion. The experts involved have backgrounds in virtual reality, general practice, medicines management, medical education and training, ethics, and philosophy. Virtual reality is an unexplored methodology to instigate positive behavioral change among clinicians where other methods have been unsuccessful, such as antimicrobial stewardship. There are several arguments in favor of use of virtual reality in medical education: it can be used for "difficult to simulate" scenarios and to standardize a scenario, for example, for use in exams. However, there are limitations to its usefulness because of the cost implications and the lack of evidence that it results in demonstrable behavior change.

Stereoscopic virtual reality models for planning tumor resection in the sellar region.

PubMed

Wang, Shou-sen; Zhang, Shang-ming; Jing, Jun-jie

2012-11-28

It is difficult for neurosurgeons to perceive the complex three-dimensional anatomical relationships in the sellar region. To investigate the value of using a virtual reality system for planning resection of sellar region tumors. The study included 60 patients with sellar tumors. All patients underwent computed tomography angiography, MRI-T1W1, and contrast enhanced MRI-T1W1 image sequence scanning. The CT and MRI scanning data were collected and then imported into a Dextroscope imaging workstation, a virtual reality system that allows structures to be viewed stereoscopically. During preoperative assessment, typical images for each patient were chosen and printed out for use by the surgeons as references during surgery. All sellar tumor models clearly displayed bone, the internal carotid artery, circle of Willis and its branches, the optic nerve and chiasm, ventricular system, tumor, brain, soft tissue and adjacent structures. Depending on the location of the tumors, we simulated the transmononasal sphenoid sinus approach, transpterional approach, and other approaches. Eleven surgeons who used virtual reality models completed a survey questionnaire. Nine of the participants said that the virtual reality images were superior to other images but that other images needed to be used in combination with the virtual reality images. The three-dimensional virtual reality models were helpful for individualized planning of surgery in the sellar region. Virtual reality appears to be promising as a valuable tool for sellar region surgery in the future.

Novel virtual reality system integrating online self-face viewing and mirror visual feedback for stroke rehabilitation: rationale and feasibility.

PubMed

Shiri, Shimon; Feintuch, Uri; Lorber-Haddad, Adi; Moreh, Elior; Twito, Dvora; Tuchner-Arieli, Maya; Meiner, Zeev

2012-01-01

To introduce the rationale of a novel virtual reality system based on self-face viewing and mirror visual feedback, and to examine its feasibility as a rehabilitation tool for poststroke patients. A novel motion capture virtual reality system integrating online self-face viewing and mirror visual feedback has been developed for stroke rehabilitation.The system allows the replacement of the impaired arm by a virtual arm. Upon making small movements of the paretic arm, patients view themselves virtually performing healthy full-range movements. A sample of 6 patients in the acute poststroke phase received the virtual reality treatment concomitantly with conservative rehabilitation treatment. Feasibility was assessed during 10 sessions for each participant. All participants succeeded in operating the system, demonstrating its feasibility in terms of adherence and improvement in task performance. Patients' performance within the virtual environment and a set of clinical-functional measures recorded before the virtual reality treatment, at 1 week, and after 3 months indicated neurological status and general functioning improvement. These preliminary results indicate that this newly developed virtual reality system is safe and feasible. Future randomized controlled studies are required to assess whether this system has beneficial effects in terms of enhancing upper limb function and quality of life in poststroke patients.

Virtual Reality, Combat, and Communication.

ERIC Educational Resources Information Center

Thrush, Emily Austin; Bodary, Michael

2000-01-01

Presents a brief examination of the evolution of virtual reality devices that illustrates how the development of this new medium is influenced by emerging technologies and by marketing pressures. Notes that understanding these influences may help prepare for the role of technical communicators in building virtual reality applications for education…

Mobile tele-echography: user interface design.

PubMed

Cañero, Cristina; Thomos, Nikolaos; Triantafyllidis, George A; Litos, George C; Strintzis, Michael Gerassimos

2005-03-01

Ultrasound imaging allows the evaluation of the degree of emergency of a patient. However, in some instances, a well-trained sonographer is unavailable to perform such echography. To cope with this issue, the Mobile Tele-Echography Using an Ultralight Robot (OTELO) project aims to develop a fully integrated end-to-end mobile tele-echography system using an ultralight remote-controlled robot for population groups that are not served locally by medical experts. This paper focuses on the user interface of the OTELO system, consisting of the following parts: an ultrasound video transmission system providing real-time images of the scanned area, an audio/video conference to communicate with the paramedical assistant and with the patient, and a virtual-reality environment, providing visual and haptic feedback to the expert, while capturing the expert's hand movements. These movements are reproduced by the robot at the patient site while holding the ultrasound probe against the patient skin. In addition, the user interface includes an image processing facility for enhancing the received images and the possibility to include them into a database.

[Virtual reality therapy in anxiety disorders].

PubMed

Mitrousia, V; Giotakos, O

2016-01-01

During the last decade a number of studies have been conducted in order to examine if virtual reality exposure therapy can be an alternative form of therapy for the treatment of mental disorders and particularly for the treatment of anxiety disorders. Imaginal exposure therapy, which is one of the components of Cognitive Behavioral Therapy, cannot be easily applied to all patients and in cases like those virtual reality can be used as an alternative or a supportive psychotherapeutic technique. Most studies using virtual reality have focused on anxiety disorders, mainly in specific phobias, but some extend to other disorders such as eating disorders, drug dependence, pain control and palliative care and rehabilitation. Main characteristics of virtual reality therapy are: "interaction", "immersion", and "presence". High levels of "immersion" and "presence" are associated with increased response to exposure therapy in virtual environments, as well as better therapeutic outcomes and sustained therapeutic gains. Typical devices that are used in order patient's immersion to be achieved are the Head-Mounted Displays (HMD), which are only for individual use, and the computer automatic virtual environment (CAVE), which is a multiuser. Virtual reality therapy's disadvantages lie in the difficulties that arise due to the demanded specialized technology skills, devices' cost and side effects. Therapists' training is necessary in order for them to be able to manipulate the software and the hardware and to adjust it to each case's needs. Devices' cost is high but as technology continuously improves it constantly decreases. Immersion during virtual reality therapy can induce mild and temporary side effects such as nausea, dizziness or headache. Until today, however, experience shows that virtual reality offers several advantages. Patient's avoidance to be exposed in phobic stimuli is reduced via the use of virtual reality since the patient is exposed to them as many times as he wishes and under the supervision of the therapist. The technique takes place in the therapist's office which ensures confidentiality and privacy. The therapist is able to control unpredicted events that can occur during patient's exposure in real environments. Mainly the therapist can control the intensity of exposure and adapt it to the patient's needs. Virtual reality can be proven particularly useful in some specific psychological states. For instance, patients with post-traumatic stress disorder (PTSD) who prone to avoid the reminders of the traumatic events. Exposure in virtual reality can solve this problem providing to the patient a large number of stimuli that activate the senses causing the necessary physiological and psychological anxiety reactions, regardless of his willingness or ability to recall in his imagination the traumatic event.

Augmenting breath regulation using a mobile driven virtual reality therapy framework.

PubMed

Abushakra, Ahmad; Faezipour, Miad

2014-05-01

This paper presents a conceptual framework of a virtual reality therapy to assist individuals, especially lung cancer patients or those with breathing disorders to regulate their breath through real-time analysis of respiration movements using a smartphone. Virtual reality technology is an attractive means for medical simulations and treatment, particularly for patients with cancer. The theories, methodologies and approaches, and real-world dynamic contents for all the components of this virtual reality therapy (VRT) via a conceptual framework using the smartphone will be discussed. The architecture and technical aspects of the offshore platform of the virtual environment will also be presented.

Intelligent virtual reality in the setting of fuzzy sets

NASA Technical Reports Server (NTRS)

Dockery, John; Littman, David

1992-01-01

The authors have previously introduced the concept of virtual reality worlds governed by artificial intelligence. Creation of an intelligent virtual reality was further proposed as a universal interface for the handicapped. This paper extends consideration of intelligent virtual realty to a context in which fuzzy set principles are explored as a major tool for implementing theory in the domain of applications to the disabled.

A Mobile Mixed-Reality Environment for Children's Storytelling Using a Handheld Projector and a Robot

ERIC Educational Resources Information Center

Sugimoto, Masanori

2011-01-01

This paper describes a system called GENTORO that uses a robot and a handheld projector for supporting children's storytelling activities. GENTORO differs from many existing systems in that children can make a robot play their own story in a physical space augmented by mixed-reality technologies. Pilot studies have been conducted to clarify the…

Mechanically Compliant Electronic Materials for Wearable Photovoltaics and Human-Machine Interfaces

NASA Astrophysics Data System (ADS)

O'Connor, Timothy Francis, III

Applications of stretchable electronic materials for human-machine interfaces are described herein. Intrinsically stretchable organic conjugated polymers and stretchable electronic composites were used to develop stretchable organic photovoltaics (OPVs), mechanically robust wearable OPVs, and human-machine interfaces for gesture recognition, American Sign Language Translation, haptic control of robots, and touch emulation for virtual reality, augmented reality, and the transmission of touch. The stretchable and wearable OPVs comprise active layers of poly-3-alkylthiophene:phenyl-C61-butyric acid methyl ester (P3AT:PCBM) and transparent conductive electrodes of poly(3,4-ethylenedioxythiophene)-poly(styrenesulfonate) (PEDOT:PSS) and devices could only be fabricated through a deep understanding of the connection between molecular structure and the co-engineering of electronic performance with mechanical resilience. The talk concludes with the use of composite piezoresistive sensors two smart glove prototypes. The first integrates stretchable strain sensors comprising a carbon-elastomer composite, a wearable microcontroller, low energy Bluetooth, and a 6-axis accelerometer/gyroscope to construct a fully functional gesture recognition glove capable of wirelessly translating American Sign Language to text on a cell phone screen. The second creates a system for the haptic control of a 3D printed robot arm, as well as the transmission of touch and temperature information.

The Impact of Virtual Reality Programs in Career and Technical Education

ERIC Educational Resources Information Center

Catterson, Anna J.

2013-01-01

Instructional technology has evolved from blackboards with chalk to in some cases three-dimensional virtual reality environments in which students are interacting and engaging with other students worldwide. The use of this new instructional methodology, known as "virtual reality," has experienced substantial growth in higher education…

When Rural Reality Goes Virtual.

ERIC Educational Resources Information Center

Husain, Dilshad D.

1998-01-01

In rural towns where sparse population and few business are barriers, virtual reality may be the only way to bring work-based learning to students. A partnership between a small-town high school, the Ohio Supercomputer Center, and a high-tech business will enable students to explore the workplace using virtual reality. (JOW)

Designing a Virtual-Reality-Based, Gamelike Math Learning Environment

ERIC Educational Resources Information Center

Xu, Xinhao; Ke, Fengfeng

2016-01-01

This exploratory study examined the design issues related to a virtual-reality-based, gamelike learning environment (VRGLE) developed via OpenSimulator, an open-source virtual reality server. The researchers collected qualitative data to examine the VRGLE's usability, playability, and content integration for math learning. They found it important…

Sweaty Palms! Virtual Reality Applied to Training.

ERIC Educational Resources Information Center

Treiber, Karin

A qualitative case study approach was used to identify the psychosocial effects of the high-fidelity, virtual reality simulation provided in the college-level air traffic control (ATC) training program offered at the Minnesota Air Traffic Control Training Center and to evaluate the applicability of virtual reality to academic/training situations.…

Special Experiences for Exceptional Students: Integrating Virtual Reality into Special Education Classrooms.

ERIC Educational Resources Information Center

Miller, Erez Cedric

This paper discusses some of the potential benefits and hazards that virtual reality holds for exceptional children in the special education system. Topics addressed include (1) applications of virtual reality, including developing academic skills via cyberspace, vocational training, and social learning in cyberspace; (2) telepresence and distance…

Assessment method of digital Chinese dance movements based on virtual reality technology

NASA Astrophysics Data System (ADS)

Feng, Wei; Shao, Shuyuan; Wang, Shumin

2008-03-01

Virtual reality has played an increasing role in such areas as medicine, architecture, aviation, engineering science and advertising. However, in the art fields, virtual reality is still in its infancy in the representation of human movements. Based on the techniques of motion capture and reuse of motion capture data in virtual reality environment, this paper presents an assessment method in order to evaluate the quantification of dancers' basic Arm Position movements in Chinese traditional dance. In this paper, the data for quantifying traits of dance motions are defined and measured on dancing which performed by an expert and two beginners, with results indicating that they are beneficial for evaluating dance skills and distinctiveness, and the assessment method of digital Chinese dance movements based on virtual reality technology is validity and feasibility.

Virtual reality in ophthalmology training.

PubMed

Khalifa, Yousuf M; Bogorad, David; Gibson, Vincent; Peifer, John; Nussbaum, Julian

2006-01-01

Current training models are limited by an unstructured curriculum, financial costs, human costs, and time constraints. With the newly mandated resident surgical competency, training programs are struggling to find viable methods of assessing and documenting the surgical skills of trainees. Virtual-reality technologies have been used for decades in flight simulation to train and assess competency, and there has been a recent push in surgical specialties to incorporate virtual-reality simulation into residency programs. These efforts have culminated in an FDA-approved carotid stenting simulator. What role virtual reality will play in the evolution of ophthalmology surgical curriculum is uncertain. The current apprentice system has served the art of surgery for over 100 years, and we foresee virtual reality working synergistically with our current curriculum modalities to streamline and enhance the resident's learning experience.

[Application of 3D virtual reality technology with multi-modality fusion in resection of glioma located in central sulcus region].

PubMed

Chen, T N; Yin, X T; Li, X G; Zhao, J; Wang, L; Mu, N; Ma, K; Huo, K; Liu, D; Gao, B Y; Feng, H; Li, F

2018-05-08

Objective: To explore the clinical and teaching application value of virtual reality technology in preoperative planning and intraoperative guide of glioma located in central sulcus region. Method: Ten patients with glioma in the central sulcus region were proposed to surgical treatment. The neuro-imaging data, including CT, CTA, DSA, MRI, fMRI were input to 3dgo sczhry workstation for image fusion and 3D reconstruction. Spatial relationships between the lesions and the surrounding structures on the virtual reality image were obtained. These images were applied to the operative approach design, operation process simulation, intraoperative auxiliary decision and the training of specialist physician. Results: Intraoperative founding of 10 patients were highly consistent with preoperative simulation with virtual reality technology. Preoperative 3D reconstruction virtual reality images improved the feasibility of operation planning and operation accuracy. This technology had not only shown the advantages for neurological function protection and lesion resection during surgery, but also improved the training efficiency and effectiveness of dedicated physician by turning the abstract comprehension to virtual reality. Conclusion: Image fusion and 3D reconstruction based virtual reality technology in glioma resection is helpful for formulating the operation plan, improving the operation safety, increasing the total resection rate, and facilitating the teaching and training of the specialist physician.

E-virtual reality exposure therapy in acrophobia: A pilot study.

PubMed

Levy, Fanny; Leboucher, Pierre; Rautureau, Gilles; Jouvent, Roland

2016-06-01

Virtual reality therapy is already used for anxiety disorders as an alternative to in vivo and in imagino exposure. To our knowledge, however, no one has yet proposed using remote virtual reality (e-virtual reality). The aim of the present study was to assess e-virtual reality in an acrophobic population. Six individuals with acrophobia each underwent six sessions (two sessions per week) of virtual reality exposure therapy. The first three were remote sessions, while the last three were traditional sessions in the physical presence of the therapist. Anxiety (STAI form Y-A, visual analog scale, heart rate), presence, technical difficulties and therapeutic alliance (Working Alliance Inventory) were measured. In order to control the conditions in which these measures were made, all the sessions were conducted in hospital. None of the participants dropped out. The remote sessions were well accepted. None of the participants verbalized reluctance. No major technical problems were reported. None of the sessions were cancelled or interrupted because of software incidents. Measures (anxiety, presence, therapeutic alliance) were comparable across the two conditions. e-Virtual reality can therefore be used to treat acrophobic disorders. However, control studies are needed to assess online feasibility, therapeutic effects and the mechanisms behind online presence. © The Author(s) 2015.

The effect of virtual reality during dental treatment on child anxiety and behavior.

PubMed

Sullivan, C; Schneider, P E; Musselman, R J; Dummett, C O; Gardiner, D

2000-01-01

Virtual reality, a three-dimensional computer generated world, has been shown to relax adults during dental treatment. The purpose of this study was to investigate the effect of virtual reality on the behavior and anxiety of children during dental treatment. The behavior, anxiety and heart rate of twenty-six children, ages five to seven years were evaluated for the first five minutes of two restorative treatment visits. Thirteen children viewed virtual reality at their first restorative visit and not the second, and thirteen children viewed virtual reality at the second restorative visit and not the first. Before and immediately following the restorative visits, each child was instructed to draw a human figure. The restorative appointments were video recorded and heart rate monitored. The drawings and videotapes were rated independently by two examiners. The Koppitz method of evaluating drawings was used to measure anxiety. The Frankl behavior rating scale was used to evaluate behavior. Differences (ANOVA) in behavior (p < or = 0.50) and anxiety (p < or = 0.65) were not significant. The overall pulse rate was significantly lower (ANOVA p < or = 0.001) when the child was wearing glasses and viewing virtual reality. In conclusion, virtual reality during dental treatment had no significant effect on the behavior or anxiety but significantly reduced the pulse.

Simulation-based training for prostate surgery.

PubMed

Khan, Raheej; Aydin, Abdullatif; Khan, Muhammad Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-10-01

To identify and review the currently available simulators for prostate surgery and to explore the evidence supporting their validity for training purposes. A review of the literature between 1999 and 2014 was performed. The search terms included a combination of urology, prostate surgery, robotic prostatectomy, laparoscopic prostatectomy, transurethral resection of the prostate (TURP), simulation, virtual reality, animal model, human cadavers, training, assessment, technical skills, validation and learning curves. Furthermore, relevant abstracts from the American Urological Association, European Association of Urology, British Association of Urological Surgeons and World Congress of Endourology meetings, between 1999 and 2013, were included. Only studies related to prostate surgery simulators were included; studies regarding other urological simulators were excluded. A total of 22 studies that carried out a validation study were identified. Five validated models and/or simulators were identified for TURP, one for photoselective vaporisation of the prostate, two for holmium enucleation of the prostate, three for laparoscopic radical prostatectomy (LRP) and four for robot-assisted surgery. Of the TURP simulators, all five have demonstrated content validity, three face validity and four construct validity. The GreenLight laser simulator has demonstrated face, content and construct validities. The Kansai HoLEP Simulator has demonstrated face and content validity whilst the UroSim HoLEP Simulator has demonstrated face, content and construct validity. All three animal models for LRP have been shown to have construct validity whilst the chicken skin model was also content valid. Only two robotic simulators were identified with relevance to robot-assisted laparoscopic prostatectomy, both of which demonstrated construct validity. A wide range of different simulators are available for prostate surgery, including synthetic bench models, virtual-reality platforms, animal models, human cadavers, distributed simulation and advanced training programmes and modules. The currently validated simulators can be used by healthcare organisations to provide supplementary training sessions for trainee surgeons. Further research should be conducted to validate simulated environments, to determine which simulators have greater efficacy than others and to assess the cost-effectiveness of the simulators and the transferability of skills learnt. With surgeons investigating new possibilities for easily reproducible and valid methods of training, simulation offers great scope for implementation alongside traditional methods of training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

Can a virtual supermarket bring realism into the lab? Comparing shopping behavior using virtual and pictorial store representations to behavior in a physical store.

PubMed

van Herpen, Erica; van den Broek, Eva; van Trijp, Hans C M; Yu, Tian

2016-12-01

Immersive virtual reality techniques present new opportunities for research into consumer behavior. The current study examines whether the increased realism of a virtual store compared to pictorial (2D) stimuli elicits consumer behavior that is more in line with behavior in a physical store. We examine the number, variety, and type of products selected, amount of money spent, and responses to price promotions and shelf display, in three product categories (fruit & vegetables, milk, and biscuits). We find that virtual reality elicits behavior that is more similar to behavior in the physical store compared to the picture condition for the number of products selected (Milk: M store  = 1.19, M virtual  = 1.53, M pictures  = 2.58) and amount of money spent (Milk: M store  = 1.27, M virtual  = 1.53, M pictures  = 2.60 Euro), and for the selection of products from different areas of the shelf, both vertically (purchases from top shelves, milk and biscuits: P store  = 21.6%, P virtual  = 33.4%, P pictures  = 50.0%) and horizontally (purchase from left shelf, biscuits: P store  = 35.5%, P virtual  = 53.3%, P pictures  = 66.7%). This indicates that virtual reality can improve realism in responses to shelf allocation. Virtual reality was not able to diminish other differences between lab and physical store: participants bought more products and spent more money (for biscuits and fruit & vegetables), bought more national brands, and responded more strongly to price promotions in both virtual reality and pictorial representations than in the physical store. Implications for the use of virtual reality in studies of consumer food choice behavior as well as for future improvement of virtual reality techniques are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

[Virtual + 1] * Reality

NASA Astrophysics Data System (ADS)

Beckhaus, Steffi

Virtual Reality aims at creating an artificial environment that can be perceived as a substitute to a real setting. Much effort in research and development goes into the creation of virtual environments that in their majority are perceivable only by eyes and hands. The multisensory nature of our perception, however, allows and, arguably, also expects more than that. As long as we are not able to simulate and deliver a fully sensory believable virtual environment to a user, we could make use of the fully sensory, multi-modal nature of real objects to fill in for this deficiency. The idea is to purposefully integrate real artifacts into the application and interaction, instead of dismissing anything real as hindering the virtual experience. The term virtual reality - denoting the goal, not the technology - shifts from a core virtual reality to an “enriched” reality, technologically encompassing both the computer generated and the real, physical artifacts. Together, either simultaneously or in a hybrid way, real and virtual jointly provide stimuli that are perceived by users through their senses and are later formed into an experience by the user's mind.

Cybersickness and Anxiety During Simulated Motion: Implications for VRET.

PubMed

Bruck, Susan; Watters, Paul

2009-01-01

Some clinicians have suggested using virtual reality environments to deliver psychological interventions to treat anxiety disorders. However, given a significant body of work on cybersickness symptoms which may arise in virtual environments - especially those involving simulated motion - we tested (a) whether being exposed to a virtual reality environment alone causes anxiety to increase, and (b) whether exposure to simulated motion in a virtual reality environment increases anxiety. Using a repeated measures design, we used Kim's Anxiety Scale questionnaire to compare baseline anxiety, anxiety after virtual environment exposure, and anxiety after simulated motion. While there was no significant effect on anxiety for being in a virtual environment with no simulated motion, the introduction of simulated motion caused anxiety to significantly increase, but not to a severe or extreme level. The implications of this work for virtual reality exposure therapy (VRET) are discussed.

Virtual Reality as an Educational and Training Tool for Medicine.

PubMed

Izard, Santiago González; Juanes, Juan A; García Peñalvo, Francisco J; Estella, Jesús Mª Gonçalvez; Ledesma, Mª José Sánchez; Ruisoto, Pablo

2018-02-01

Until very recently, we considered Virtual Reality as something that was very close, but it was still science fiction. However, today Virtual Reality is being integrated into many different areas of our lives, from videogames to different industrial use cases and, of course, it is starting to be used in medicine. There are two great general classifications for Virtual Reality. Firstly, we find a Virtual Reality in which we visualize a world completely created by computer, three-dimensional and where we can appreciate that the world we are visualizing is not real, at least for the moment as rendered images are improving very fast. Secondly, there is a Virtual Reality that basically consists of a reflection of our reality. This type of Virtual Reality is created using spherical or 360 images and videos, so we lose three-dimensional visualization capacity (until the 3D cameras are more developed), but on the other hand we gain in terms of realism in the images. We could also mention a third classification that merges the previous two, where virtual elements created by computer coexist with 360 images and videos. In this article we will show two systems that we have developed where each of them can be framed within one of the previous classifications, identifying the technologies used for their implementation as well as the advantages of each one. We will also analize how these systems can improve the current methodologies used for medical training. The implications of these developments as tools for teaching, learning and training are discussed.

Immersive virtual reality improves movement patterns in patients after ACL reconstruction: implications for enhanced criteria-based return-to-sport rehabilitation.

PubMed

Gokeler, Alli; Bisschop, Marsha; Myer, Gregory D; Benjaminse, Anne; Dijkstra, Pieter U; van Keeken, Helco G; van Raay, Jos J A M; Burgerhof, Johannes G M; Otten, Egbert

2016-07-01

The purpose of this study was to evaluate the influence of immersion in a virtual reality environment on knee biomechanics in patients after ACL reconstruction (ACLR). It was hypothesized that virtual reality techniques aimed to change attentional focus would influence altered knee flexion angle, knee extension moment and peak vertical ground reaction force (vGRF) in patients following ACLR. Twenty athletes following ACLR and 20 healthy controls (CTRL) performed a step-down task in both a non-virtual reality environment and a virtual reality environment displaying a pedestrian traffic scene. A motion analysis system and force plates were used to measure kinematics and kinetics during a step-down task to analyse each single-leg landing. A significant main effect was found for environment for knee flexion excursion (P = n.s.). Significant interaction differences were found between environment and groups for vGRF (P = 0.004), knee moment (P < 0.001), knee angle at peak vGRF (P = 0.01) and knee flexion excursion (P = 0.03). There was larger effect of virtual reality environment on knee biomechanics in patients after ACLR compared with controls. Patients after ACLR immersed in virtual reality environment demonstrated knee joint biomechanics that approximate those of CTRL. The results of this study indicate that a realistic virtual reality scenario may distract patients after ACLR from conscious motor control. Application of clinically available technology may aid in current rehabilitation programmes to target altered movement patterns after ACLR. Diagnostic study, Level III.

Virtual reality training in laparoscopic surgery: A systematic review & meta-analysis.

PubMed

Alaker, Medhat; Wynn, Greg R; Arulampalam, Tan

2016-05-01

Laparoscopic surgery requires a different and sometimes more complex skill set than does open surgery. Shortened working hours, less training times, and patient safety issues necessitates that these skills need to be acquired outside the operating room. Virtual reality simulation in laparoscopic surgery is a growing field, and many studies have been published to determine its effectiveness. This systematic review and meta-analysis aims to evaluate virtual reality simulation in laparoscopic abdominal surgery in comparison to other simulation models and to no training. A systematic literature search was carried out until January 2014 in full adherence to PRISMA guidelines. All randomised controlled studies comparing virtual reality training to other models of training or to no training were included. Only studies utilizing objective and validated assessment tools were included. Thirty one randomised controlled trials that compare virtual reality training to other models of training or to no training were included. The results of the meta-analysis showed that virtual reality simulation is significantly more effective than video trainers, and at least as good as box trainers. The use of Proficiency-based VR training, under supervision with prompt instructions and feedback, and the use of haptic feedback, has proven to be the most effective way of delivering the virtual reality training. The incorporation of virtual reality training into surgical training curricula is now necessary. A unified platform of training needs to be established. Further studies to assess the impact on patient outcomes and on hospital costs are necessary. (PROSPERO Registration number: CRD42014010030). Copyright © 2016 IJS Publishing Group Ltd. Published by Elsevier Ltd. All rights reserved.

Telemanipulation, telepresence, and virtual reality for surgery in the year 2000

NASA Astrophysics Data System (ADS)

Satava, Richard M.

1995-12-01

The new technologic revolution in medicine is based upon information technologies, and telemanipulation, telepresence and virtual reality are essential components. Telepresence surgery returns the look and feel of `open surgery' to the surgeon and promises enhancement of physical capabilities above normal human performance. Virtual reality provides basic medical education, simulation of surgical procedures, medical forces and disaster medicine practice, and virtual prototyping of medical equipment.

Architecture and Key Techniques of Augmented Reality Maintenance Guiding System for Civil Aircrafts

NASA Astrophysics Data System (ADS)

hong, Zhou; Wenhua, Lu

2017-01-01

Augmented reality technology is introduced into the maintenance related field for strengthened information in real-world scenarios through integration of virtual assistant maintenance information with real-world scenarios. This can lower the difficulty of maintenance, reduce maintenance errors, and improve the maintenance efficiency and quality of civil aviation crews. Architecture of augmented reality virtual maintenance guiding system is proposed on the basis of introducing the definition of augmented reality and analyzing the characteristics of augmented reality virtual maintenance. Key techniques involved, such as standardization and organization of maintenance data, 3D registration, modeling of maintenance guidance information and virtual maintenance man-machine interaction, are elaborated emphatically, and solutions are given.

Comparison of two simulation systems to support robotic-assisted surgical training: a pilot study (Swine model).

PubMed

Whitehurst, Sabrina V; Lockrow, Ernest G; Lendvay, Thomas S; Propst, Anthony M; Dunlow, Susan G; Rosemeyer, Christopher J; Gobern, Joseph M; White, Lee W; Skinner, Anna; Buller, Jerome L

2015-01-01

To compare the efficacy of simulation-based training between the Mimic dV- Trainer and traditional dry lab da Vinci robot training. A prospective randomized study analyzing the performance of 20 robotics-naive participants. Participants were enrolled in an online da Vinci Intuitive Surgical didactic training module, followed by training in use of the da Vinci standard surgical robot. Spatial ability tests were performed as well. Participants were randomly assigned to 1 of 2 training conditions: performance of 3 Fundamentals of Laparoscopic Surgery dry lab tasks using the da Vinci or performance of 4 dV-Trainer tasks. Participants in both groups performed all tasks to empirically establish proficiency criterion. Participants then performed the transfer task, a cystotomy closure using the daVinci robot on a live animal (swine) model. The performance of robotic tasks was blindly assessed by a panel of experienced surgeons using objective tracking data and using the validated Global Evaluative Assessment of Robotic Surgery (GEARS), a structured assessment tool. No statistically significant difference in surgeon performance was found between the 2 training conditions, dV-Trainer and da Vinci robot. Analysis of a 95% confidence interval for the difference in means (-0.803 to 0.543) indicated that the 2 methods are unlikely to differ to an extent that would be clinically meaningful. Based on the results of this study, a curriculum on the dV- Trainer was shown to be comparable to traditional da Vinci robot training. Therefore, we have identified that training on a virtual reality system may be an alternative to live animal training for future robotic surgeons. Published by Elsevier Inc.

NASA AMES Remote Operations Center for 2001

NASA Technical Reports Server (NTRS)

Sims, M.; Marshall, J.; Cox, S.; Galal, K.

1999-01-01

There is a Memorandum of Agreement between NASA Ames, JPL, West Virginia University and University of Arizona which led to funding for the MECA microscope and to the establishment of an Ames facility for science analysis of microscopic and other data. The data and analysis will be by agreement of the Mars Environmental Compatibility Assessment (MECA), Robotic Arm Camera (RAC) and other PI's. This facility is intended to complement other analysis efforts with one objective of this facility being to test the latest information technologies in support of actual mission science operations. Additionally, it will be used as a laboratory for the exploration of collaborative science activities. With a goal of enhancing the science return for both Human Exploration and Development of Space (HEDS) and Astrobiology we shall utilize various tools such as superresolution and the Virtual Environment Vehicle Interface (VEVI) virtual reality visualization tools. In this presentation we will describe the current planning for this facility.

Robotics virtual rail system and method

DOEpatents

Bruemmer, David J [Idaho Falls, ID; Few, Douglas A [Idaho Falls, ID; Walton, Miles C [Idaho Falls, ID

2011-07-05

A virtual track or rail system and method is described for execution by a robot. A user, through a user interface, generates a desired path comprised of at least one segment representative of the virtual track for the robot. Start and end points are assigned to the desired path and velocities are also associated with each of the at least one segment of the desired path. A waypoint file is generated including positions along the virtual track representing the desired path with the positions beginning from the start point to the end point including the velocities of each of the at least one segment. The waypoint file is sent to the robot for traversing along the virtual track.

Advanced technologies in plastic surgery: how new innovations can improve our training and practice.

PubMed

Grunwald, Tiffany; Krummel, Thomas; Sherman, Randy

2004-11-01

Over the last two decades, virtual reality, haptics, simulators, robotics, and other "advanced technologies" have emerged as important innovations in medical learning and practice. Reports on simulator applications in medicine now appear regularly in the medical, computer science, engineering, and popular literature. The goal of this article is to review the emerging intersection between advanced technologies and surgery and how new technology is being utilized in several surgical fields, particularly plastic surgery. The authors also discuss how plastic and reconstructive surgeons can benefit by working to further the development of multimedia and simulated environment technologies in surgical practice and training.

Seven Capital Devices for the Future of Stroke Rehabilitation

PubMed Central

Iosa, M.; Morone, G.; Fusco, A.; Bragoni, M.; Coiro, P.; Multari, M.; Venturiero, V.; De Angelis, D.; Pratesi, L.; Paolucci, S.

2012-01-01

Stroke is the leading cause of long-term disability for adults in industrialized societies. Rehabilitation's efforts are tended to avoid long-term impairments, but, actually, the rehabilitative outcomes are still poor. Novel tools based on new technologies have been developed to improve the motor recovery. In this paper, we have taken into account seven promising technologies that can improve rehabilitation of patients with stroke in the early future: (1) robotic devices for lower and upper limb recovery, (2) brain computer interfaces, (3) noninvasive brain stimulators, (4) neuroprostheses, (5) wearable devices for quantitative human movement analysis, (6) virtual reality, and (7) tablet-pc used for neurorehabilitation. PMID:23304640

Virtual Reality as Treatment for Fear of Flying: A Review of Recent Research

ERIC Educational Resources Information Center

Price, Matthew; Anderson, Page; Rothbaum, Barbara O.

2008-01-01

Virtual reality exposure has recently emerged as an important tool for exposure therapy in the treatment of fear of flying. There have been numerous empirical studies that have evaluated the effectiveness of virtual reality exposure as compared to other treatments including in vivo exposure, progressive muscle relaxation, cognitive therapy,…

Integrating Music into Math in a Virtual Reality Game: Learning Fractions

ERIC Educational Resources Information Center

Lim, Taehyeong; Lee, Sungwoong; Ke, Fengfeng

2016-01-01

The purpose of this study was to investigate future teachers' experiences and perceptions of using a virtual reality game for elementary math education. The virtual reality game was designed and developed to integrate a musical activity (beat-making) into the math learning of fractions. Five math education major students participated in this…

Visualizing Compound Rotations with Virtual Reality

ERIC Educational Resources Information Center

Flanders, Megan; Kavanagh, Richard C.

2013-01-01

Mental rotations are among the most difficult of all spatial tasks to perform, and even those with high levels of spatial ability can struggle to visualize the result of compound rotations. This pilot study investigates the use of the virtual reality-based Rotation Tool, created using the Virtual Reality Modeling Language (VRML) together with…

PTSD in Limb Trauma and Recovery

DTIC Science & Technology

2011-10-01

Virtual reality and Motion Analysis to Characterize Disabilities in Lower...Program 4: “ Virtual reality and Motion Analysis to Characterize Disabilities in Lower Limb Injury” (Christopher Rhea, Ph.D., lead investigator). This...ANSI Std. Z39.18 ANNUAL REPORT 10/16/2011 VIRTUAL REALITY AND MOTION ANALYSIS TO CHARACTERIZE DISABILITIES IN LOWER LIMB INJURY PI: SUSAN

Treatment of Complicated Grief Using Virtual Reality: A Case Report

ERIC Educational Resources Information Center

Botella, C.; Osma, J.; Palacios, A. Garcia; Guillen, V.; Banos, R.

2008-01-01

This is the first work exploring the application of new technologies, concretely virtual reality, to facilitate emotional processing in the treatment of Complicated Grief. Our research team has designed a virtual reality environment (EMMA's World) to foster the expression and processing of emotions. In this study the authors present a description…

Exploring "Magic Cottage": A Virtual Reality Environment for Stimulating Children's Imaginative Writing

ERIC Educational Resources Information Center

Patera, Marianne; Draper, Steve; Naef, Martin

2008-01-01

This paper presents an exploratory study that created a virtual reality environment (VRE) to stimulate motivation and creativity in imaginative writing at primary school level. The main aim of the study was to investigate if an interactive, semi-immersive virtual reality world could increase motivation and stimulate pupils' imagination in the…

Virtual Reality and Medical Inpatients: A Systematic Review of Randomized, Controlled Trials

PubMed Central

Dascal, Julieta; Reid, Mark; IsHak, Waguih William; Spiegel, Brennan; Recacho, Jennifer; Rosen, Bradley

2017-01-01

Objective: We evaluated the evidence supporting the use of virtual reality among patients in acute inpatient medical settings. Method: We conducted a systematic review of randomized controlled trials conducted that examined virtual reality applications in inpatient medical settings between 2005 and 2015. We used PsycINFO, PubMed, and Medline databases to identify studies using the keywords virtual reality, VR therapy, treatment, and inpatient. Results: We identified 2,024 citations, among which 11 met criteria for inclusion. Studies addressed three general areas: pain management, eating disorders, and cognitive and motor rehabilitation. Studies were small and heterogeneous and utilized different designs and measures. Virtual reality was generally well tolerated by patients, and a majority of studies demonstrated clinical efficacy. Studies varied in quality, as measured by an evaluation metric developed by Reisch, Tyson, and Mize (average quality score=0.87; range=0.78–0.96). Conclusion: Virtual reality is a promising intervention with several potential applications in the inpatient medical setting. Studies to date demonstrate some efficacy, but there is a need for larger, well-controlled studies to show clinical and cost-effectiveness. PMID:28386517

The Elderly Perceived Meanings and Values of Virtual Reality Leisure Activities: A Means-End Chain Approach.

PubMed

Lin, Cheng-Shih; Jeng, Mei-Yuan; Yeh, Tsu-Ming

2018-04-03

This study uses means-end chain (MEC) techniques to examine the awareness, decision-making procedure, and personal values of the elderly with regard to virtual reality leisure activities. The results of the study show that elderly respondents value virtual reality leisure activities that are fun, safe, and easy. In terms of outcome benefits, elderly respondents value feeling physically and mentally healthy, firsthand experience, and satisfied curiosity. In value terms, elderly respondents hope that their chosen virtual reality leisure activities improve not only their relationships with others, but also their enjoyment, quality of life, and sense of belonging. The results show that, while consumers with different awarenesses of virtual reality leisure activities have different decision-making processes, they share creating "good memories" as the terminal value with the most significant effect. This presents a potential opportunity to promote virtual reality leisure activities. Relevant bodies or enterprises can seek to create good memories in consumers by developing activities that are safe and fun, promote good health, and provide good service, thereby attracting the interest of elderly consumers.

Virtual Reality and Medical Inpatients: A Systematic Review of Randomized, Controlled Trials.

PubMed

Dascal, Julieta; Reid, Mark; IsHak, Waguih William; Spiegel, Brennan; Recacho, Jennifer; Rosen, Bradley; Danovitch, Itai

2017-01-01

Objective: We evaluated the evidence supporting the use of virtual reality among patients in acute inpatient medical settings. Method: We conducted a systematic review of randomized controlled trials conducted that examined virtual reality applications in inpatient medical settings between 2005 and 2015. We used PsycINFO, PubMed, and Medline databases to identify studies using the keywords virtual reality , VR therapy , treatment , and inpatient. Results: We identified 2,024 citations, among which 11 met criteria for inclusion. Studies addressed three general areas: pain management, eating disorders, and cognitive and motor rehabilitation. Studies were small and heterogeneous and utilized different designs and measures. Virtual reality was generally well tolerated by patients, and a majority of studies demonstrated clinical efficacy. Studies varied in quality, as measured by an evaluation metric developed by Reisch, Tyson, and Mize (average quality score=0.87; range=0.78-0.96). Conclusion: Virtual reality is a promising intervention with several potential applications in the inpatient medical setting. Studies to date demonstrate some efficacy, but there is a need for larger, well-controlled studies to show clinical and cost-effectiveness.

The Elderly Perceived Meanings and Values of Virtual Reality Leisure Activities: A Means-End Chain Approach

PubMed Central

Lin, Cheng-Shih; Jeng, Mei-Yuan

2018-01-01

This study uses means-end chain (MEC) techniques to examine the awareness, decision-making procedure, and personal values of the elderly with regard to virtual reality leisure activities. The results of the study show that elderly respondents value virtual reality leisure activities that are fun, safe, and easy. In terms of outcome benefits, elderly respondents value feeling physically and mentally healthy, firsthand experience, and satisfied curiosity. In value terms, elderly respondents hope that their chosen virtual reality leisure activities improve not only their relationships with others, but also their enjoyment, quality of life, and sense of belonging. The results show that, while consumers with different awarenesses of virtual reality leisure activities have different decision-making processes, they share creating “good memories” as the terminal value with the most significant effect. This presents a potential opportunity to promote virtual reality leisure activities. Relevant bodies or enterprises can seek to create good memories in consumers by developing activities that are safe and fun, promote good health, and provide good service, thereby attracting the interest of elderly consumers. PMID:29614012

Effects of conventional neurological treatment and a virtual reality training program on eye-hand coordination in children with cerebral palsy.

PubMed

Shin, Ji-Won; Song, Gui-Bin; Hwangbo, Gak

2015-07-01

[Purpose] The purpose of the study was to evaluate the effects of conventional neurological treatment and a virtual reality training program on eye-hand coordination in children with cerebral palsy. [Subjects] Sixteen children (9 males, 7 females) with spastic diplegic cerebral palsy were recruited and randomly assigned to the conventional neurological physical therapy group (CG) and virtual reality training group (VRG). [Methods] Eight children in the control group performed 45 minutes of therapeutic exercise twice a week for eight weeks. In the experimental group, the other eight children performed 30 minutes of therapeutic exercise and 15 minutes of a training program using virtual reality twice a week during the experimental period. [Results] After eight weeks of the training program, there were significant differences in eye-hand coordination and visual motor speed in the comparison of the virtual reality training group with the conventional neurological physical therapy group. [Conclusion] We conclude that a well-designed training program using virtual reality can improve eye-hand coordination in children with cerebral palsy.

Virtual rehabilitation: What are the practical barriers for home-based research?

PubMed Central

Threapleton, Kate; Drummond, Avril; Standen, Penny

2016-01-01

Virtual reality technologies are becoming increasingly accessible and affordable to deliver, and consequently the interest in applying virtual reality within rehabilitation is growing. This has resulted in the emergence of research exploring the utility of virtual reality and interactive video gaming interventions for home use by patients. The aim of this paper is to highlight the practical factors and difficulties that may be encountered in research in this area, and to make recommendations for addressing these. Whilst this paper focuses on examples drawn mainly from stroke rehabilitation research, many of the issues raised are relevant to other conditions where virtual reality approaches have the potential to be applied to home-based rehabilitation. PMID:29942551

The role of virtual articulator in prosthetic and restorative dentistry.

PubMed

Koralakunte, Pavankumar Ravi; Aljanakh, Mohammad

2014-07-01

Virtual reality is a computer based technology linked with the future of dentistry and dental practice. The virtual articulator is one such application in prosthetic and restorative dentistry based on virtual reality that will significantly reduce the limitations of the mechanical articulator, and by simulation of real patient data, allow analyses with regard to static and dynamic occlusion as well as to jaw relation. It is the purpose of this article to present the concepts and strategies for a future replacement of the mechanical articulator by a virtual one. Also, a brief note on virtual reality haptic system has been highlighted along with newly developed touch enabled virtual articulator.

Use of the stereoscopic virtual reality display system for the detection and characterization of intracranial aneurysms: A Icomparison with conventional computed tomography workstation and 3D rotational angiography.

PubMed

Liu, Xiujuan; Tao, Haiquan; Xiao, Xigang; Guo, Binbin; Xu, Shangcai; Sun, Na; Li, Maotong; Xie, Li; Wu, Changjun

2018-07-01

This study aimed to compare the diagnostic performance of the stereoscopic virtual reality display system with the conventional computed tomography (CT) workstation and three-dimensional rotational angiography (3DRA) for intracranial aneurysm detection and characterization, with a focus on small aneurysms and those near the bone. First, 42 patients with suspected intracranial aneurysms underwent both 256-row CT angiography (CTA) and 3DRA. Volume rendering (VR) images were captured using the conventional CT workstation. Next, VR images were transferred to the stereoscopic virtual reality display system. Two radiologists independently assessed the results that were obtained using the conventional CT workstation and stereoscopic virtual reality display system. The 3DRA results were considered as the ultimate reference standard. Based on 3DRA images, 38 aneurysms were confirmed in 42 patients. Two cases were misdiagnosed and 1 was missed when the traditional CT workstation was used. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy of the conventional CT workstation were 94.7%, 85.7%, 97.3%, 75%, and99.3%, respectively, on a per-aneurysm basis. The stereoscopic virtual reality display system missed a case. The sensitivity, specificity, PPV, NPV, and accuracy of the stereoscopic virtual reality display system were 100%, 85.7%, 97.4%, 100%, and 97.8%, respectively. No difference was observed in the accuracy of the traditional CT workstation, stereoscopic virtual reality display system, and 3DRA in detecting aneurysms. The stereoscopic virtual reality display system has some advantages in detecting small aneurysms and those near the bone. The virtual reality stereoscopic vision obtained through the system was found as a useful tool in intracranial aneurysm diagnosis and pre-operative 3D imaging. Copyright © 2018 Elsevier B.V. All rights reserved.

Virtual reality for spherical images

NASA Astrophysics Data System (ADS)

Pilarczyk, Rafal; Skarbek, Władysław

2017-08-01

Paper presents virtual reality application framework and application concept for mobile devices. Framework uses Google Cardboard library for Android operating system. Framework allows to create virtual reality 360 video player using standard OpenGL ES rendering methods. Framework provides network methods in order to connect to web server as application resource provider. Resources are delivered using JSON response as result of HTTP requests. Web server also uses Socket.IO library for synchronous communication between application and server. Framework implements methods to create event driven process of rendering additional content based on video timestamp and virtual reality head point of view.

Importance of Virtual Reality to Virtual Reality Exposure Therapy, Study Design of a Randomized Trial.

PubMed

McLay, Robert N; Baird, Alicia; Murphy, Jennifer; Deal, William; Tran, Lily; Anson, Heather; Klam, Warren; Johnston, Scott

2015-01-01

Post Traumatic Stress Disorder (PTSD) can be a debilitating problem in service members who have served in Iraq or Afghanistan. Virtual Reality Exposure Therapy (VRET) is one of the few interventions demonstrated in randomized controlled trials to be effective for PTSD in this population. There are theoretical reasons to expect that Virtual Reality (VR) adds to the effectiveness of exposure therapy, but there is also added expense and difficulty in using VR. Described is a trial comparing outcomes from VRET and a control exposure therapy (CET) protocol in service members with PTSD.

Development and human factors analysis of an augmented reality interface for multi-robot tele-operation and control

NASA Astrophysics Data System (ADS)

Lee, Sam; Lucas, Nathan P.; Ellis, R. Darin; Pandya, Abhilash

2012-06-01

This paper presents a seamlessly controlled human multi-robot system comprised of ground and aerial robots of semiautonomous nature for source localization tasks. The system combines augmented reality interfaces capabilities with human supervisor's ability to control multiple robots. The role of this human multi-robot interface is to allow an operator to control groups of heterogeneous robots in real time in a collaborative manner. It used advanced path planning algorithms to ensure obstacles are avoided and that the operators are free for higher-level tasks. Each robot knows the environment and obstacles and can automatically generate a collision-free path to any user-selected target. It displayed sensor information from each individual robot directly on the robot in the video view. In addition, a sensor data fused AR view is displayed which helped the users pin point source information or help the operator with the goals of the mission. The paper studies a preliminary Human Factors evaluation of this system in which several interface conditions are tested for source detection tasks. Results show that the novel Augmented Reality multi-robot control (Point-and-Go and Path Planning) reduced mission completion times compared to the traditional joystick control for target detection missions. Usability tests and operator workload analysis are also investigated.

Virtual reality as a tool for cross-cultural communication: an example from military team training

NASA Astrophysics Data System (ADS)

Downes-Martin, Stephen; Long, Mark; Alexander, Joanna R.

1992-06-01

A major problem with communication across cultures, whether professional or national, is that simple language translation if often insufficient to communicate the concepts. This is especially true when the communicators come from highly specialized fields of knowledge or from national cultures with long histories of divergence. This problem becomes critical when the goal of the communication is national negotiation dealing with such high risk items as arms negotiation or trade wars. Virtual Reality technology has considerable potential for facilitating communication across cultures, by immersing the communicators within multiple visual representations of the concepts, and providing control over those representations. Military distributed team training provides a model for virtual reality suitable for cross cultural communication such as negotiation. In both team training and negotiation, the participants must cooperate, agree on a set of goals, and achieve mastery over the concepts being negotiated. Team training technologies suitable for supporting cross cultural negotiation exist (branch wargaming, computer image generation and visualization, distributed simulation), and have developed along different lines than traditional virtual reality technology. Team training de-emphasizes the realism of physiological interfaces between the human and the virtual reality, and emphasizes the interaction of humans with each other and with intelligent simulated agents within the virtual reality. This approach to virtual reality is suggested as being more fruitful for future work.

Development of a low-cost virtual reality workstation for training and education

NASA Technical Reports Server (NTRS)

Phillips, James A.

1996-01-01

Virtual Reality (VR) is a set of breakthrough technologies that allow a human being to enter and fully experience a 3-dimensional, computer simulated environment. A true virtual reality experience meets three criteria: (1) it involves 3-dimensional computer graphics; (2) it includes real-time feedback and response to user actions; and (3) it must provide a sense of immersion. Good examples of a virtual reality simulator are the flight simulators used by all branches of the military to train pilots for combat in high performance jet fighters. The fidelity of such simulators is extremely high -- but so is the price tag, typically millions of dollars. Virtual reality teaching and training methods are manifestly effective, but the high cost of VR technology has limited its practical application to fields with big budgets, such as military combat simulation, commercial pilot training, and certain projects within the space program. However, in the last year there has been a revolution in the cost of VR technology. The speed of inexpensive personal computers has increased dramatically, especially with the introduction of the Pentium processor and the PCI bus for IBM-compatibles, and the cost of high-quality virtual reality peripherals has plummeted. The result is that many public schools, colleges, and universities can afford a PC-based workstation capable of running immersive virtual reality applications. My goal this summer was to assemble and evaluate such a system.

Psychology Student Opinion of Virtual Reality as a Tool to Educate about Schizophrenia

ERIC Educational Resources Information Center

Tichon, Jennifer; Loh, Jennifer; King, Robert

2004-01-01

Virtual Reality (VR) techniques are increasingly being used in e-health education, training and in trial clinical programs in the treatment of certain types of mental illness. Undergraduate psychology student opinion of the use of Virtual Reality (VR) to teach them about schizophrenia at the University of Queensland, was determined with reference…

The Effects of Virtual Reality Learning Environment on Student Cognitive and Linguistic Development

ERIC Educational Resources Information Center

Chen, Yu-Li

2016-01-01

Virtual reality (VR) has brought about numerous alternative learning opportunities in the last decade, and with modern products such as Oculus Rift and other wearable Virtual Reality technologies being introduced into society, VR will promisingly continue to provide yet unseen opportunities in the next few decades and therefore is a technology…

Naval Science and Technology Future Force Magazine

Science.gov Websites

Issues Contact Us Links RSS Feed Facebook IT'S EASY TO SEE THE COST SAVINGS OF VIRTUAL REALITY TRAINING THE [...] Not Just a Fad: Virtual Reality Really Does Benefit the Military IT'S EASY TO SEE THE COST SAVINGS OF VIRTUAL REALITY TRAINING-BUT IS IT AS EFFECTIVE AS, OR EVEN BETTER THAN, OTHER TYPES OF

Study of Co-Located and Distant Collaboration with Symbolic Support via a Haptics-Enhanced Virtual Reality Task

ERIC Educational Resources Information Center

Yeh, Shih-Ching; Hwang, Wu-Yuin; Wang, Jin-Liang; Zhan, Shi-Yi

2013-01-01

This study intends to investigate how multi-symbolic representations (text, digits, and colors) could effectively enhance the completion of co-located/distant collaborative work in a virtual reality context. Participants' perceptions and behaviors were also studied. A haptics-enhanced virtual reality task was developed to conduct…

An Analysis of Learners' Intentions toward Virtual Reality Learning Based on Constructivist and Technology Acceptance Approaches

ERIC Educational Resources Information Center

Huang, Hsiu-Mei; Liaw, Shu-Sheng

2018-01-01

Within a constructivist paradigm, the virtual reality technology focuses on the learner's actively interactive learning processes and attempts to reduce the gap between the learner's knowledge and a real-life experience. Recently, virtual reality technologies have been developed for a wide range of applications in education, but further research…

A Desktop Virtual Reality Earth Motion System in Astronomy Education

ERIC Educational Resources Information Center

Chen, Chih Hung; Yang, Jie Chi; Shen, Sarah; Jeng, Ming Chang

2007-01-01

In this study, a desktop virtual reality earth motion system (DVREMS) is designed and developed to be applied in the classroom. The system is implemented to assist elementary school students to clarify earth motion concepts using virtual reality principles. A study was conducted to observe the influences of the proposed system in learning.…

The Use of Virtual Reality Tools in the Reading-Language Arts Classroom

ERIC Educational Resources Information Center

Pilgrim, J. Michael; Pilgrim, Jodi

2016-01-01

This article presents virtual reality as a tool for classroom literacy instruction. Building on the traditional use of images as a way to scaffold prior knowledge, we extend this idea to share ways virtual reality enables experiential learning through field trip-like experiences. The use of technology tools such Google Street view, Google…

Research on Modeling Technology of Virtual Robot Based on LabVIEW

NASA Astrophysics Data System (ADS)

Wang, Z.; Huo, J. L.; Y Sun, L.; Y Hao, X.

2017-12-01

Because of the dangerous working environment, the underwater operation robot for nuclear power station needs manual teleoperation. In the process of operation, it is necessary to guide the position and orientation of the robot in real time. In this paper, the geometric modeling of the virtual robot and the working environment is accomplished by using SolidWorks software, and the accurate modeling and assembly of the robot are realized. Using LabVIEW software to read the model, and established the manipulator forward kinematics and inverse kinematics model, and realized the hierarchical modeling of virtual robot and computer graphics modeling. Experimental results show that the method studied in this paper can be successfully applied to robot control system.

Agreement and reliability of pelvic floor measurements during contraction using three-dimensional pelvic floor ultrasound and virtual reality.

PubMed

Speksnijder, L; Rousian, M; Steegers, E A P; Van Der Spek, P J; Koning, A H J; Steensma, A B

2012-07-01

Virtual reality is a novel method of visualizing ultrasound data with the perception of depth and offers possibilities for measuring non-planar structures. The levator ani hiatus has both convex and concave aspects. The aim of this study was to compare levator ani hiatus volume measurements obtained with conventional three-dimensional (3D) ultrasound and with a virtual reality measurement technique and to establish their reliability and agreement. 100 symptomatic patients visiting a tertiary pelvic floor clinic with a normal intact levator ani muscle diagnosed on translabial ultrasound were selected. Datasets were analyzed using a rendered volume with a slice thickness of 1.5 cm at the level of minimal hiatal dimensions during contraction. The levator area (in cm(2)) was measured and multiplied by 1.5 to get the levator ani hiatus volume in conventional 3D ultrasound (in cm(3)). Levator ani hiatus volume measurements were then measured semi-automatically in virtual reality (cm(3) ) using a segmentation algorithm. An intra- and interobserver analysis of reliability and agreement was performed in 20 randomly chosen patients. The mean difference between levator ani hiatus volume measurements performed using conventional 3D ultrasound and virtual reality was 0.10 (95% CI, - 0.15 to 0.35) cm(3). The intraclass correlation coefficient (ICC) comparing conventional 3D ultrasound with virtual reality measurements was > 0.96. Intra- and interobserver ICCs for conventional 3D ultrasound measurements were > 0.94 and for virtual reality measurements were > 0.97, indicating good reliability for both. Levator ani hiatus volume measurements performed using virtual reality were reliable and the results were similar to those obtained with conventional 3D ultrasonography. Copyright © 2012 ISUOG. Published by John Wiley & Sons, Ltd.

Using Virtual Reality and Videogames for Traumatic Brain Injury Rehabilitation: A Structured Literature Review.

PubMed

Pietrzak, Eva; Pullman, Stephen; McGuire, Annabel

2014-08-01

This article reviews the available literature about the use of novel methods of rehabilitation using virtual reality interventions for people living with posttraumatic brain injuries. The MEDLINE, EMBASE, SCOPUS, and Cochrane Library databases were searched using the terms "virtual reality" OR "video games" AND "traumatic brain injury." Included studies investigated therapeutic use of virtual reality in adults with a brain trauma resulting from acquired closed head injury, reported outcomes that included measures of motor or cognitive functionality, and were published in a peer-reviewed journal written in English. Eighteen articles fulfilled inclusion criteria. Eight were case studies, five studies had a quasi-experimental design with a pre-post comparison, and five were pilot randomized control trials or comparative studies. The virtual reality systems used were commercial or custom designed for the study and ranged from expensive, fully immersive systems to cheap online games or videogames. In before-after comparisons, improvements in balance were seen in four case studies and two small randomized control trials. Between-group comparisons in these randomized control trials showed no difference between virtual reality and traditional therapy. Post-training improvements were also seen for upper extremity functions (five small studies) and for various cognitive function measures (four case studies and one pilot randomized control trial). Attitudes of participants toward virtual reality interventions was more positive than for traditional therapy (three studies). The evidence that the use of virtual reality in rehabilitation of traumatic brain injury improves motor and cognitive functionality is currently very limited. However, this approach has the potential to provide alternative, possibly more affordable and available rehabilitation therapy for traumatic brain injury in settings where access to therapy is limited by geographical or financial constraints.

A virtual tour of virtual reality

NASA Astrophysics Data System (ADS)

Harris, Margaret

2018-03-01

Virtual-reality glasses might still be on the starting blocks, but plenty of companies are working on the technology. Margaret Harris tries on some examples at the Photonics West show in San Francisco

Current status of validation for robotic surgery simulators - a systematic review.

PubMed

Abboudi, Hamid; Khan, Mohammed S; Aboumarzouk, Omar; Guru, Khurshid A; Challacombe, Ben; Dasgupta, Prokar; Ahmed, Kamran

2013-02-01

To analyse studies validating the effectiveness of robotic surgery simulators. The MEDLINE(®), EMBASE(®) and PsycINFO(®) databases were systematically searched until September 2011. References from retrieved articles were reviewed to broaden the search. The simulator name, training tasks, participant level, training duration and evaluation scoring were extracted from each study. We also extracted data on feasibility, validity, cost-effectiveness, reliability and educational impact. We identified 19 studies investigating simulation options in robotic surgery. There are five different robotic surgery simulation platforms available on the market. In all, 11 studies sought opinion and compared performance between two different groups; 'expert' and 'novice'. Experts ranged in experience from 21-2200 robotic cases. The novice groups consisted of participants with no prior experience on a robotic platform and were often medical students or junior doctors. The Mimic dV-Trainer(®), ProMIS(®), SimSurgery Educational Platform(®) (SEP) and Intuitive systems have shown face, content and construct validity. The Robotic Surgical SimulatorTM system has only been face and content validated. All of the simulators except SEP have shown educational impact. Feasibility and cost-effectiveness of simulation systems was not evaluated in any trial. Virtual reality simulators were shown to be effective training tools for junior trainees. Simulation training holds the greatest potential to be used as an adjunct to traditional training methods to equip the next generation of robotic surgeons with the skills required to operate safely. However, current simulation models have only been validated in small studies. There is no evidence to suggest one type of simulator provides more effective training than any other. More research is needed to validate simulated environments further and investigate the effectiveness of animal and cadaveric training in robotic surgery. © 2012 BJU International.

The effects of virtual reality game exercise on balance and gait of the elderly

PubMed Central

Park, Eun-Cho; Kim, Seong-Gil; Lee, Chae-Woo

2015-01-01

[Purpose] The aim of this study was to examine the effects of ball exercise as a general exercise on the balance abilities of elderly individuals by comparing ball exercise with virtual reality exercise. [Subjects and Methods] Thirty elderly individuals residing in communities were randomly divided into a virtual reality game group and a ball exercise group and conducted exercise for 30 min 3 times a week for 8 weeks. [Results] Step length increased significantly, and the average sway speed and Timed Up and Go time significantly decreased in both groups. A comparison of sway length after the intervention between the two groups revealed that the virtual reality game exercise resulted in a reduction than the ball exercise. [Conclusion] The results of this study indicated that the virtual reality game exercise may improve balance and gait of elderly individuals in communities. PMID:25995578

Performance on a virtual reality angled laparoscope task correlates with spatial ability of trainees.

PubMed

Rosenthal, Rachel; Hamel, Christian; Oertli, Daniel; Demartines, Nicolas; Gantert, Walter A

2010-08-01

The aim of the present study was to investigate whether trainees' performance on a virtual reality angled laparoscope navigation task correlates with scores obtained on a validated conventional test of spatial ability. 56 participants of a surgery workshop performed an angled laparoscope navigation task on the Xitact LS 500 virtual reality Simulator. Performance parameters were correlated with the score of a validated paper-and-pencil test of spatial ability. Performance at the conventional spatial ability test significantly correlated with performance at the virtual reality task for overall task score (p < 0.001), task completion time (p < 0.001) and economy of movement (p = 0.035), not for endoscope travel speed (p = 0.947). In conclusion, trainees' performance in a standardized virtual reality camera navigation task correlates with their innate spatial ability. This VR session holds potential to serve as an assessment tool for trainees.

Integration Head Mounted Display Device and Hand Motion Gesture Device for Virtual Reality Laboratory

NASA Astrophysics Data System (ADS)

Rengganis, Y. A.; Safrodin, M.; Sukaridhoto, S.

2018-01-01

Virtual Reality Laboratory (VR Lab) is an innovation for conventional learning media which show us whole learning process in laboratory. There are many tools and materials are needed by user for doing practical in it, so user could feel new learning atmosphere by using this innovation. Nowadays, technologies more sophisticated than before. So it would carry in education and it will be more effective, efficient. The Supported technologies are needed us for making VR Lab such as head mounted display device and hand motion gesture device. The integration among them will be used us for making this research. Head mounted display device for viewing 3D environment of virtual reality laboratory. Hand motion gesture device for catching user real hand and it will be visualized in virtual reality laboratory. Virtual Reality will show us, if using the newest technologies in learning process it could make more interesting and easy to understand.

Visual field examination method using virtual reality glasses compared with the Humphrey perimeter.

PubMed

Tsapakis, Stylianos; Papaconstantinou, Dimitrios; Diagourtas, Andreas; Droutsas, Konstantinos; Andreanos, Konstantinos; Moschos, Marilita M; Brouzas, Dimitrios

2017-01-01

To present a visual field examination method using virtual reality glasses and evaluate the reliability of the method by comparing the results with those of the Humphrey perimeter. Virtual reality glasses, a smartphone with a 6 inch display, and software that implements a fast-threshold 3 dB step staircase algorithm for the central 24° of visual field (52 points) were used to test 20 eyes of 10 patients, who were tested in a random and consecutive order as they appeared in our glaucoma department. The results were compared with those obtained from the same patients using the Humphrey perimeter. High correlation coefficient ( r =0.808, P <0.0001) was found between the virtual reality visual field test and the Humphrey perimeter visual field. Visual field examination results using virtual reality glasses have a high correlation with the Humphrey perimeter allowing the method to be suitable for probable clinical use.

[Real patients in virtual reality: the link between phantom heads and clinical dentistry].

PubMed

Serrano, C M; Wesselink, P R; Vervoorn, J M

2018-05-01

Preclinical training in phantom heads has until now been considered the 'gold standard' for restorative dental education, but the transition from preclinic to the treatment of real patients has remained a challenge. With the introduction of the latest generation of virtual reality simulators, students and dental practitioners can make digital impressions of their patients in virtual reality models and practice procedures in virtual reality before clinically performing them. In this way, clinical decisions can be investigated and practiced prior to actual treatment, enhancing the safety of the treatment and the self-confidence to perform it. With the 3M™ True Definition Scanner and the Moog Simodont Dental Trainer, 3 masters students and a general dental practitioner practiced their procedures in virtual reality prior to performing them on real patients. They were very satisfied with this preparation and the result of the treatment.

Design and Implementation of a Quadruped Bionic Robot Based on Virtual Prototype Technology

NASA Astrophysics Data System (ADS)

Wang, Li

2017-10-01

Design out a quadruped bionic robot with nine degrees of freedom. Conduct virtual assembly and trotting gait simulation on the robot by using NX software. Present the angular velocity and angular displacement curves of the diagonal two legs’ hip joints and knee joints, thus to instruct the practical assemble and control of the robot. The fact that the movement effect of the physical model is consistent with the simulation verifies the validity and practicability of virtual assembly and motion simulation. both.

Reviewing Clinical Effectiveness of Active Training Strategies of Platform-Based Ankle Rehabilitation Robots.

PubMed

Zeng, Xiangfeng; Zhu, Guoli; Zhang, Mingming; Xie, Sheng Q

2018-01-01

This review aims to provide a systematical investigation of clinical effectiveness of active training strategies applied in platform-based ankle robots. English-language studies published from Jan 1980 to Aug 2017 were searched from four databases using key words of "Ankle ∗ " AND "Robot ∗ " AND "Effect ∗ OR Improv ∗ OR Increas ∗ ." Following an initial screening, three rounds of discrimination were successively conducted based on the title, the abstract, and the full paper. A total of 21 studies were selected with 311 patients involved; of them, 13 studies applied a single group while another eight studies used different groups for comparison to verify the therapeutic effect. Virtual-reality (VR) game training was applied in 19 studies, while two studies used proprioceptive neuromuscular facilitation (PNF) training. Active training techniques delivered by platform ankle rehabilitation robots have been demonstrated with great potential for clinical applications. Training strategies are mostly combined with one another by considering rehabilitation schemes and motion ability of ankle joints. VR game environment has been commonly used with active ankle training. Bioelectrical signals integrated with VR game training can implement intelligent identification of movement intention and assessment. These further provide the foundation for advanced interactive training strategies that can lead to enhanced training safety and confidence for patients and better treatment efficacy.

Virtual reality, augmented reality…I call it i-Reality.

PubMed

Grossmann, Rafael J

2015-01-01

The new term improved reality (i-Reality) is suggested to include virtual reality (VR) and augmented reality (AR). It refers to a real world that includes improved, enhanced and digitally created features that would offer an advantage on a particular occasion (i.e., a medical act). I-Reality may help us bridge the gap between the high demand for medical providers and the low supply of them by improving the interaction between providers and patients.

Research on three-dimensional visualization based on virtual reality and Internet

NASA Astrophysics Data System (ADS)

Wang, Zongmin; Yang, Haibo; Zhao, Hongling; Li, Jiren; Zhu, Qiang; Zhang, Xiaohong; Sun, Kai

2007-06-01

To disclose and display water information, a three-dimensional visualization system based on Virtual Reality (VR) and Internet is researched for demonstrating "digital water conservancy" application and also for routine management of reservoir. To explore and mine in-depth information, after completion of modeling high resolution DEM with reliable quality, topographical analysis, visibility analysis and reservoir volume computation are studied. And also, some parameters including slope, water level and NDVI are selected to classify easy-landslide zone in water-level-fluctuating zone of reservoir area. To establish virtual reservoir scene, two kinds of methods are used respectively for experiencing immersion, interaction and imagination (3I). First virtual scene contains more detailed textures to increase reality on graphical workstation with virtual reality engine Open Scene Graph (OSG). Second virtual scene is for internet users with fewer details for assuring fluent speed.

ViRPET--combination of virtual reality and PET brain imaging

DOEpatents

Majewski, Stanislaw; Brefczynski-Lewis, Julie

2017-05-23

Various methods, systems and apparatus are provided for brain imaging during virtual reality stimulation. In one example, among others, a system for virtual ambulatory environment brain imaging includes a mobile brain imager configured to obtain positron emission tomography (PET) scans of a subject in motion, and a virtual reality (VR) system configured to provide one or more stimuli to the subject during the PET scans. In another example, a method for virtual ambulatory environment brain imaging includes providing stimulation to a subject through a virtual reality (VR) system; and obtaining a positron emission tomography (PET) scan of the subject while moving in response to the stimulation from the VR system. The mobile brain imager can be positioned on the subject with an array of imaging photodetector modules distributed about the head of the subject.

Multisensory Integration in the Virtual Hand Illusion with Active Movement

PubMed Central

Satoh, Satoru; Hachimura, Kozaburo

2016-01-01

Improving the sense of immersion is one of the core issues in virtual reality. Perceptual illusions of ownership can be perceived over a virtual body in a multisensory virtual reality environment. Rubber Hand and Virtual Hand Illusions showed that body ownership can be manipulated by applying suitable visual and tactile stimulation. In this study, we investigate the effects of multisensory integration in the Virtual Hand Illusion with active movement. A virtual xylophone playing system which can interactively provide synchronous visual, tactile, and auditory stimulation was constructed. We conducted two experiments regarding different movement conditions and different sensory stimulations. Our results demonstrate that multisensory integration with free active movement can improve the sense of immersion in virtual reality. PMID:27847822

The Role of Virtual Articulator in Prosthetic and Restorative Dentistry

PubMed Central

Aljanakh, Mohammad

2014-01-01

Virtual reality is a computer based technology linked with the future of dentistry and dental practice. The virtual articulator is one such application in prosthetic and restorative dentistry based on virtual reality that will significantly reduce the limitations of the mechanical articulator, and by simulation of real patient data, allow analyses with regard to static and dynamic occlusion as well as to jaw relation. It is the purpose of this article to present the concepts and strategies for a future replacement of the mechanical articulator by a virtual one. Also, a brief note on virtual reality haptic system has been highlighted along with newly developed touch enabled virtual articulator. PMID:25177664

Virtual reality exposure therapy for combat-related posttraumatic stress disorder.

PubMed

Rothbaum, Barbara O; Rizzo, Albert Skip; Difede, JoAnn

2010-10-01

Posttraumatic stress disorder (PTSD) is a chronic, debilitating, psychological condition that occurs in a subset of individuals who experience or witness life-threatening traumatic events. PTSD is highly prevalent in those who served in the military. In this paper, we present the underlying theoretical foundations and existing research on virtual reality exposure therapy, a recently emerging treatment for PTSD. Three virtual reality scenarios used to treat PTSD in active duty military and combat veterans and survivors of terrorism are presented: Virtual Vietnam, Virtual Iraq, and Virtual World Trade Center. Preliminary results of ongoing trials are presented. © 2010 Association for Research in Nervous and Mental Disease.

Augmenting the Thermal Flux Experiment: A Mixed Reality Approach with the HoloLens

ERIC Educational Resources Information Center

Strzys, M. P.; Kapp, S.; Thees, M.; Kuhn, J.; Lukowicz, P.; Knierim, P.; Schmidt, A.

2017-01-01

In the field of Virtual Reality (VR) and Augmented Reality (AR), technologies have made huge progress during the last years and also reached the field of education. The virtuality continuum, ranging from pure virtuality on one side to the real world on the other, has been successfully covered by the use of immersive technologies like head-mounted…

Physical Models and Virtual Reality Simulators in Otolaryngology.

PubMed

Javia, Luv; Sardesai, Maya G

2017-10-01

The increasing role of simulation in the medical education of future otolaryngologists has followed suit with other surgical disciplines. Simulators make it possible for the resident to explore and learn in a safe and less stressful environment. The various subspecialties in otolaryngology use physical simulators and virtual-reality simulators. Although physical simulators allow the operator to make direct contact with its components, virtual-reality simulators allow the operator to interact with an environment that is computer generated. This article gives an overview of the various types of physical simulators and virtual-reality simulators used in otolaryngology that have been reported in the literature. Copyright © 2017 Elsevier Inc. All rights reserved.

New perspectives and limitations in the use of virtual reality in the rehabilitation of motor disorders

NASA Astrophysics Data System (ADS)

De Mauro, Alessandro; Ardanza, Aitor; Monge, Esther; Molina Rueda, Francisco

2013-03-01

Several studies have shown that both virtual and augmented reality are technologies suitable for rehabilitation therapy due to the inherent ability of simulating real daily life activities while improving patient motivation. In this paper we will first present the state of the art in the use of virtual and augmented reality applications for rehabilitation of motor disorders and second we will focus on the analysis of the results of our project. In particular, requirements of patients with cerebrovascular accidents, spinal cord injuries and cerebral palsy to the use of virtual and augmented reality systems will be detailed.

Alleviating travel anxiety through virtual reality and narrated video technology.

PubMed

Ahn, J C; Lee, O

2013-01-01

This study presents an empirical evidence of benefit of narrative video clips in embedded virtual reality websites of hotels for relieving travel anxiety. Even though it was proven that virtual reality functions do provide some relief in travel anxiety, a stronger virtual reality website can be built when narrative video clips that show video clips with narration about important aspects of the hotel. We posit that these important aspects are 1. Escape route and 2. Surrounding neighborhood information, which are derived from the existing research on anxiety disorder as well as travel anxiety. Thus we created a video clip that showed and narrated about the escape route from the hotel room, another video clip that showed and narrated about surrounding neighborhood. We then conducted experiments with this enhanced virtual reality website of a hotel by having human subjects play with the website and fill out a questionnaire. The result confirms our hypothesis that there is a statistically significant relationship between the degree of travel anxiety and psychological relief caused by the use of embedded virtual reality functions with narrative video clips of a hotel website (Tab. 2, Fig. 3, Ref. 26).

AR Feels "Softer" than VR: Haptic Perception of Stiffness in Augmented versus Virtual Reality.

PubMed

Gaffary, Yoren; Le Gouis, Benoit; Marchal, Maud; Argelaguet, Ferran; Arnaldi, Bruno; Lecuyer, Anatole

2017-11-01

Does it feel the same when you touch an object in Augmented Reality (AR) or in Virtual Reality (VR)? In this paper we study and compare the haptic perception of stiffness of a virtual object in two situations: (1) a purely virtual environment versus (2) a real and augmented environment. We have designed an experimental setup based on a Microsoft HoloLens and a haptic force-feedback device, enabling to press a virtual piston, and compare its stiffness successively in either Augmented Reality (the virtual piston is surrounded by several real objects all located inside a cardboard box) or in Virtual Reality (the same virtual piston is displayed in a fully virtual scene composed of the same other objects). We have conducted a psychophysical experiment with 12 participants. Our results show a surprising bias in perception between the two conditions. The virtual piston is on average perceived stiffer in the VR condition compared to the AR condition. For instance, when the piston had the same stiffness in AR and VR, participants would select the VR piston as the stiffer one in 60% of cases. This suggests a psychological effect as if objects in AR would feel "softer" than in pure VR. Taken together, our results open new perspectives on perception in AR versus VR, and pave the way to future studies aiming at characterizing potential perceptual biases.

The 'mad scientists': psychoanalysis, dream and virtual reality.

PubMed

Leclaire, Marie

2003-04-01

The author explores the concept of reality-testing as a means of assessing the relationship with reality that prevails in dream and in virtual reality. Based on a model developed by Jean Laplanche, she compares these activities in detail in order to determine their respective independence from the function of reality-testing. By carefully examining the concept of hallucination in the writings of Freud and Daniel Dennett, the author seeks to pinpoint the specific modalities of interaction between perceptions, ideas, wishes and actions that converge in the 'belief' and in the 'sense of reality'. The paper's main thesis consists of the distinction that it draws between immediacy-testing and reality-testing, with the further argument that this distinction not only dissipates the conceptual vagueness that generally surrounds the latter of the two concepts but also that it promotes a more precise analysis of the function of reality in dream and in virtual reality.

Inertial Motion-Tracking Technology for Virtual 3-D

NASA Technical Reports Server (NTRS)

2005-01-01

In the 1990s, NASA pioneered virtual reality research. The concept was present long before, but, prior to this, the technology did not exist to make a viable virtual reality system. Scientists had theories and ideas they knew that the concept had potential, but the computers of the 1970s and 1980s were not fast enough, sensors were heavy and cumbersome, and people had difficulty blending fluidly with the machines. Scientists at Ames Research Center built upon the research of previous decades and put the necessary technology behind them, making the theories of virtual reality a reality. Virtual reality systems depend on complex motion-tracking sensors to convey information between the user and the computer to give the user the feeling that he is operating in the real world. These motion-tracking sensors measure and report an object s position and orientation as it changes. A simple example of motion tracking would be the cursor on a computer screen moving in correspondence to the shifting of the mouse. Tracking in 3-D, necessary to create virtual reality, however, is much more complex. To be successful, the perspective of the virtual image seen on the computer must be an accurate representation of what is seen in the real world. As the user s head or camera moves, turns, or tilts, the computer-generated environment must change accordingly with no noticeable lag, jitter, or distortion. Historically, the lack of smooth and rapid tracking of the user s motion has thwarted the widespread use of immersive 3-D computer graphics. NASA uses virtual reality technology for a variety of purposes, mostly training of astronauts. The actual missions are costly and dangerous, so any opportunity the crews have to practice their maneuvering in accurate situations before the mission is valuable and instructive. For that purpose, NASA has funded a great deal of virtual reality research, and benefited from the results.

Virtual reality in the assessment and treatment of psychosis: a systematic review of its utility, acceptability and effectiveness.

PubMed

Rus-Calafell, M; Garety, P; Sason, E; Craig, T J K; Valmaggia, L R

2018-02-01

Over the last two decades, there has been a rapid increase of studies testing the efficacy and acceptability of virtual reality in the assessment and treatment of mental health problems. This systematic review was carried out to investigate the use of virtual reality in the assessment and the treatment of psychosis. Web of Science, PsychInfo, EMBASE, Scopus, ProQuest and PubMed databases were searched, resulting in the identification of 638 articles potentially eligible for inclusion; of these, 50 studies were included in the review. The main fields of research in virtual reality and psychosis are: safety and acceptability of the technology; neurocognitive evaluation; functional capacity and performance evaluation; assessment of paranoid ideation and auditory hallucinations; and interventions. The studies reviewed indicate that virtual reality offers a valuable method of assessing the presence of symptoms in ecologically valid environments, with the potential to facilitate learning new emotional and behavioural responses. Virtual reality is a promising method to be used in the assessment of neurocognitive deficits and the study of relevant clinical symptoms. Furthermore, preliminary findings suggest that it can be applied to the delivery of cognitive rehabilitation, social skills training interventions and virtual reality-assisted therapies for psychosis. The potential benefits for enhancing treatment are highlighted. Recommendations for future research include demonstrating generalisability to real-life settings, examining potential negative effects, larger sample sizes and long-term follow-up studies. The present review has been registered in the PROSPERO register: CDR 4201507776.

Evaluation of a haptics-based virtual reality temporal bone simulator for anatomy and surgery training.

PubMed

Fang, Te-Yung; Wang, Pa-Chun; Liu, Chih-Hsien; Su, Mu-Chun; Yeh, Shih-Ching

2014-02-01

Virtual reality simulation training may improve knowledge of anatomy and surgical skills. We evaluated a 3-dimensional, haptic, virtual reality temporal bone simulator for dissection training. The subjects were 7 otolaryngology residents (3 training sessions each) and 7 medical students (1 training session each). The virtual reality temporal bone simulation station included a computer with software that was linked to a force-feedback hand stylus, and the system recorded performance and collisions with vital anatomic structures. Subjects performed virtual reality dissections and completed questionnaires after the training sessions. Residents and students had favorable responses to most questions of the technology acceptance model (TAM) questionnaire. The average TAM scores were above neutral for residents and medical students in all domains, and the average TAM score for residents was significantly higher for the usefulness domain and lower for the playful domain than students. The average satisfaction questionnaire for residents showed that residents had greater overall satisfaction with cadaver temporal bone dissection training than training with the virtual reality simulator or plastic temporal bone. For medical students, the average comprehension score was significantly increased from before to after training for all anatomic structures. Medical students had significantly more collisions with the dura than residents. The residents had similar mean performance scores after the first and third training sessions for all dissection procedures. The virtual reality temporal bone simulator provided satisfactory training for otolaryngology residents and medical students. Copyright © 2013. Published by Elsevier Ireland Ltd.

Cochrane review: virtual reality for stroke rehabilitation.

PubMed

Laver, K; George, S; Thomas, S; Deutsch, J E; Crotty, M

2012-09-01

Virtual reality and interactive video gaming are innovative therapy approaches in the field of stroke rehabilitation. The primary objective of this review was to determine the effectiveness of virtual reality on motor function after stroke. The impact on secondary outcomes including activities of daily living was also assessed. Randomised and quasi-randomised controlled trials that compared virtual reality with an alternative or no intervention were included in the review. The authors searched the Cochrane Stroke Group Trials Register, the Cochrane Central Register of Controlled Trials, electronic databases, trial registers, reference lists, Dissertation Abstracts, conference proceedings and contacted key researchers and virtual reality manufacturers. Search results were independently examined by two review authors to identify studies meeting the inclusion criteria. Nineteen studies with a total of 565 participants were included in the review. Variation in intervention approaches and outcome data collected limited the extent to which studies could be compared. Virtual reality was found to be significantly more effective than conventional therapy in improving upper limb function (standardised mean difference, SMD) 0.53, 95% confidence intervals [CI] 0.25 to 0.81)) based on seven studies, and activities of daily living (ADL) function (SMD 0.81, 95% CI 0.39 to 1.22) based on three studies. No statistically significant effects were found for grip strength (based on two studies) or gait speed (based on three studies). Virtual reality appears to be a promising approach however, further studies are required to confirm these findings.

Validation of virtual reality as a tool to understand and prevent child pedestrian injury.

PubMed

Schwebel, David C; Gaines, Joanna; Severson, Joan

2008-07-01

In recent years, virtual reality has emerged as an innovative tool for health-related education and training. Among the many benefits of virtual reality is the opportunity for novice users to engage unsupervised in a safe environment when the real environment might be dangerous. Virtual environments are only useful for health-related research, however, if behavior in the virtual world validly matches behavior in the real world. This study was designed to test the validity of an immersive, interactive virtual pedestrian environment. A sample of 102 children and 74 adults was recruited to complete simulated road-crossings in both the virtual environment and the identical real environment. In both the child and adult samples, construct validity was demonstrated via significant correlations between behavior in the virtual and real worlds. Results also indicate construct validity through developmental differences in behavior; convergent validity by showing correlations between parent-reported child temperament and behavior in the virtual world; internal reliability of various measures of pedestrian safety in the virtual world; and face validity, as measured by users' self-reported perception of realism in the virtual world. We discuss issues of generalizability to other virtual environments, and the implications for application of virtual reality to understanding and preventing pediatric pedestrian injuries.

Determining of a robot workspace using the integration of a CAD system with a virtual control system

NASA Astrophysics Data System (ADS)

Herbuś, K.; Ociepka, P.

2016-08-01

The paper presents a method for determining the workspace of an industrial robot using an approach consisting in integration a 3D model of an industrial robot with a virtual control system. The robot model with his work environment, prepared for motion simulation, was created in the “Motion Simulation” module of the Siemens PLM NX software. In the mentioned model components of the “link” type were created which map the geometrical form of particular elements of the robot and the components of “joint” type mapping way of cooperation of components of the “link” type. In the paper is proposed the solution in which the control process of a virtual robot is similar to the control process of a real robot using the manual control panel (teach pendant). For this purpose, the control application “JOINT” was created, which provides the manipulation of a virtual robot in accordance with its internal control system. The set of procedures stored in an .xlsx file is the element integrating the 3D robot model working in the CAD/CAE class system with the elaborated control application.

A Practical Guide, with Theoretical Underpinnings, for Creating Effective Virtual Reality Learning Environments

ERIC Educational Resources Information Center

O'Connor, Eileen A.; Domingo, Jelia

2017-01-01

With the advent of open source virtual environments, the associated cost reductions, and the more flexible options, avatar-based virtual reality environments are within reach of educators. By using and repurposing readily available virtual environments, instructors can bring engaging, community-building, and immersive learning opportunities to…

Computer Vision Assisted Virtual Reality Calibration

NASA Technical Reports Server (NTRS)

Kim, W.

1999-01-01

A computer vision assisted semi-automatic virtual reality (VR) calibration technology has been developed that can accurately match a virtual environment of graphically simulated three-dimensional (3-D) models to the video images of the real task environment.

Embodying compassion: a virtual reality paradigm for overcoming excessive self-criticism.

PubMed

Falconer, Caroline J; Slater, Mel; Rovira, Aitor; King, John A; Gilbert, Paul; Antley, Angus; Brewin, Chris R

2014-01-01

Virtual reality has been successfully used to study and treat psychological disorders such as phobias and posttraumatic stress disorder but has rarely been applied to clinically-relevant emotions other than fear and anxiety. Self-criticism is a ubiquitous feature of psychopathology and can be treated by increasing levels of self-compassion. We exploited the known effects of identification with a virtual body to arrange for healthy female volunteers high in self-criticism to experience self-compassion from an embodied first-person perspective within immersive virtual reality. Whereas observation and practice of compassionate responses reduced self-criticism, the additional experience of embodiment also increased self-compassion and feelings of being safe. The results suggest potential new uses for immersive virtual reality in a range of clinical conditions.

Embodying Compassion: A Virtual Reality Paradigm for Overcoming Excessive Self-Criticism

PubMed Central

Falconer, Caroline J.; Slater, Mel; Rovira, Aitor; King, John A.; Gilbert, Paul; Antley, Angus; Brewin, Chris R.

2014-01-01

Virtual reality has been successfully used to study and treat psychological disorders such as phobias and posttraumatic stress disorder but has rarely been applied to clinically-relevant emotions other than fear and anxiety. Self-criticism is a ubiquitous feature of psychopathology and can be treated by increasing levels of self-compassion. We exploited the known effects of identification with a virtual body to arrange for healthy female volunteers high in self-criticism to experience self-compassion from an embodied first-person perspective within immersive virtual reality. Whereas observation and practice of compassionate responses reduced self-criticism, the additional experience of embodiment also increased self-compassion and feelings of being safe. The results suggest potential new uses for immersive virtual reality in a range of clinical conditions. PMID:25389766

Role of virtual reality for cerebral palsy management.

PubMed

Weiss, Patrice L Tamar; Tirosh, Emanuel; Fehlings, Darcy

2014-08-01

Virtual reality is the use of interactive simulations to present users with opportunities to perform in virtual environments that appear, sound, and less frequently, feel similar to real-world objects and events. Interactive computer play refers to the use of a game where a child interacts and plays with virtual objects in a computer-generated environment. Because of their distinctive attributes that provide ecologically realistic and motivating opportunities for active learning, these technologies have been used in pediatric rehabilitation over the past 15 years. The ability of virtual reality to create opportunities for active repetitive motor/sensory practice adds to their potential for neuroplasticity and learning in individuals with neurologic disorders. The objectives of this article is to provide an overview of how virtual reality and gaming are used clinically, to present the results of several example studies that demonstrate their use in research, and to briefly remark on future developments. © The Author(s) 2014.

Sensation of presence and cybersickness in applications of virtual reality for advanced rehabilitation.

PubMed

Kiryu, Tohru; So, Richard H Y

2007-09-25

Around three years ago, in the special issue on augmented and virtual reality in rehabilitation, the topics of simulator sickness was briefly discussed in relation to vestibular rehabilitation. Simulator sickness with virtual reality applications have also been referred to as visually induced motion sickness or cybersickness. Recently, study on cybersickness has been reported in entertainment, training, game, and medical environment in several journals. Virtual stimuli can enlarge sensation of presence, but they sometimes also evoke unpleasant sensation. In order to safely apply augmented and virtual reality for long-term rehabilitation treatment, sensation of presence and cybersickness should be appropriately controlled. This issue presents the results of five studies conducted to evaluate visually-induced effects and speculate influences of virtual rehabilitation. In particular, the influence of visual and vestibular stimuli on cardiovascular responses are reported in terms of academic contribution.

Sensation of presence and cybersickness in applications of virtual reality for advanced rehabilitation

PubMed Central

Kiryu, Tohru; So, Richard HY

2007-01-01

Around three years ago, in the special issue on augmented and virtual reality in rehabilitation, the topics of simulator sickness was briefly discussed in relation to vestibular rehabilitation. Simulator sickness with virtual reality applications have also been referred to as visually induced motion sickness or cybersickness. Recently, study on cybersickness has been reported in entertainment, training, game, and medical environment in several journals. Virtual stimuli can enlarge sensation of presence, but they sometimes also evoke unpleasant sensation. In order to safely apply augmented and virtual reality for long-term rehabilitation treatment, sensation of presence and cybersickness should be appropriately controlled. This issue presents the results of five studies conducted to evaluate visually-induced effects and speculate influences of virtual rehabilitation. In particular, the influence of visual and vestibular stimuli on cardiovascular responses are reported in terms of academic contribution. PMID:17894857

The Virtual Pelvic Floor, a tele-immersive educational environment.

PubMed Central

Pearl, R. K.; Evenhouse, R.; Rasmussen, M.; Dech, F.; Silverstein, J. C.; Prokasy, S.; Panko, W. B.

1999-01-01

This paper describes the development of the Virtual Pelvic Floor, a new method of teaching the complex anatomy of the pelvic region utilizing virtual reality and advanced networking technology. Virtual reality technology allows improved visualization of three-dimensional structures over conventional media because it supports stereo vision, viewer-centered perspective, large angles of view, and interactivity. Two or more ImmersaDesk systems, drafting table format virtual reality displays, are networked together providing an environment where teacher and students share a high quality three-dimensional anatomical model, and are able to converse, see each other, and to point in three dimensions to indicate areas of interest. This project was realized by the teamwork of surgeons, medical artists and sculptors, computer scientists, and computer visualization experts. It demonstrates the future of virtual reality for surgical education and applications for the Next Generation Internet. Images Figure 1 Figure 2 Figure 3 PMID:10566378

Effect of Virtual Reality Exposure and Aural Stimuli on Eye Contact, Directional Focus, and Focus of Attention of Novice Wind Band Conductors

ERIC Educational Resources Information Center

Orman, Evelyn K.

2016-01-01

This study examined the effects of virtual reality immersion with audio on eye contact, directional focus and focus of attention for novice wind band conductors. Participants (N = 34) included a control group (n = 12) and two virtual reality groups with (n = 10) and without (n = 12) head tracking. Participants completed conducting/score study…

The Learner Characteristics, Features of Desktop 3D Virtual Reality Environments, and College Chemistry Instruction: A Structural Equation Modeling Analysis

ERIC Educational Resources Information Center

Merchant, Zahira; Goetz, Ernest T.; Keeney-Kennicutt, Wendy; Kwok, Oi-man; Cifuentes, Lauren; Davis, Trina J.

2012-01-01

We examined a model of the impact of a 3D desktop virtual reality environment on the learner characteristics (i.e. perceptual and psychological variables) that can enhance chemistry-related learning achievements in an introductory college chemistry class. The relationships between the 3D virtual reality features and the chemistry learning test as…

Future Cyborgs: Human-Machine Interface for Virtual Reality Applications

DTIC Science & Technology

2007-04-01

FUTURE CYBORGS : HUMAN-MACHINE INTERFACE FOR VIRTUAL REALITY APPLICATIONS Robert R. Powell, Major, USAF April 2007 Blue Horizons...SUBTITLE Future Cyborgs : Human-Machine Interface for Virtual Reality Applications 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER...Nicholas Negroponte, Being Digital (New York: Alfred A Knopf, Inc, 1995), 123. 23 Ibid. 24 Andy Clark, Natural-Born Cyborgs (New York: Oxford

Virtual Reality and Its Potential Use in Special Education. Identifying Emerging Issues and Trends in Technology for Special Education.

ERIC Educational Resources Information Center

Woodward, John

As part of a 3-year study to identify emerging issues and trends in technology for special education, this paper addresses the possible contributions of virtual reality technology to educational services for students with disabilities. An example of the use of virtual reality in medical imaging introduces the paper and leads to a brief review of…

Integrated Eye Tracking and Neural Monitoring for Enhanced Assessment of Mild TBI

DTIC Science & Technology

2015-04-01

virtual reality driving simulator data acquisition. Data collection for the pilot study is nearly complete and data analyses are currently under way...Training for primary study procedures including neuropsychological testing, eye- tracking, virtual reality driving simulator, and EEG data acquisition is...the virtual reality driving simulator. Participants are instructed to drive along a coastal highway while performing the target detection task

HTC Vive MeVisLab integration via OpenVR for medical applications

PubMed Central

Egger, Jan; Gall, Markus; Wallner, Jürgen; Boechat, Pedro; Hann, Alexander; Li, Xing; Chen, Xiaojun; Schmalstieg, Dieter

2017-01-01

Virtual Reality, an immersive technology that replicates an environment via computer-simulated reality, gets a lot of attention in the entertainment industry. However, VR has also great potential in other areas, like the medical domain, Examples are intervention planning, training and simulation. This is especially of use in medical operations, where an aesthetic outcome is important, like for facial surgeries. Alas, importing medical data into Virtual Reality devices is not necessarily trivial, in particular, when a direct connection to a proprietary application is desired. Moreover, most researcher do not build their medical applications from scratch, but rather leverage platforms like MeVisLab, MITK, OsiriX or 3D Slicer. These platforms have in common that they use libraries like ITK and VTK, and provide a convenient graphical interface. However, ITK and VTK do not support Virtual Reality directly. In this study, the usage of a Virtual Reality device for medical data under the MeVisLab platform is presented. The OpenVR library is integrated into the MeVisLab platform, allowing a direct and uncomplicated usage of the head mounted display HTC Vive inside the MeVisLab platform. Medical data coming from other MeVisLab modules can directly be connected per drag-and-drop to the Virtual Reality module, rendering the data inside the HTC Vive for immersive virtual reality inspection. PMID:28323840

HTC Vive MeVisLab integration via OpenVR for medical applications.

PubMed

Egger, Jan; Gall, Markus; Wallner, Jürgen; Boechat, Pedro; Hann, Alexander; Li, Xing; Chen, Xiaojun; Schmalstieg, Dieter

2017-01-01

Virtual Reality, an immersive technology that replicates an environment via computer-simulated reality, gets a lot of attention in the entertainment industry. However, VR has also great potential in other areas, like the medical domain, Examples are intervention planning, training and simulation. This is especially of use in medical operations, where an aesthetic outcome is important, like for facial surgeries. Alas, importing medical data into Virtual Reality devices is not necessarily trivial, in particular, when a direct connection to a proprietary application is desired. Moreover, most researcher do not build their medical applications from scratch, but rather leverage platforms like MeVisLab, MITK, OsiriX or 3D Slicer. These platforms have in common that they use libraries like ITK and VTK, and provide a convenient graphical interface. However, ITK and VTK do not support Virtual Reality directly. In this study, the usage of a Virtual Reality device for medical data under the MeVisLab platform is presented. The OpenVR library is integrated into the MeVisLab platform, allowing a direct and uncomplicated usage of the head mounted display HTC Vive inside the MeVisLab platform. Medical data coming from other MeVisLab modules can directly be connected per drag-and-drop to the Virtual Reality module, rendering the data inside the HTC Vive for immersive virtual reality inspection.

Investigation of virtual reality concept based on system analysis of conceptual series

NASA Astrophysics Data System (ADS)

Romanova, A.; Shuklin, D. A.; Kalinkina, M. E.; Gotskaya, I. B.; Ponomarev, Y. E.

2018-05-01

The paper covers approaches to the definition of virtual reality from the point of view of the humanitarian sciences and technology. Each approach analyzing problems of concept perception of methods interpreted by representatives of philosophy, psychology and sociology is singled out. Terminological analysis of the basic concepts is carried out and their refinement is constructed in the process of comparing the concepts of virtuality and virtual reality. Using the analysis of selected sources, a number of singularity characteristics of the given concept are singled out and its definition is specified. Results consist in combining the interpretation of all approaches to determine the concept of virtual reality. Due to the use of a comprehensive approach to the definition of the investigated concept, which allows us to consider the object of research as a set of elements that are subject to study with the help of a corresponding set of methods, one can conclude that the concept under study is complex and multifaceted. The authors noted that virtual reality technologies have a flexible concept depending on the field of application.

Virtual reality simulation: basic concepts and use in endoscopic neurosurgery training.

PubMed

Cohen, Alan R; Lohani, Subash; Manjila, Sunil; Natsupakpong, Suriya; Brown, Nathan; Cavusoglu, M Cenk

2013-08-01

Virtual reality simulation is a promising alternative to training surgical residents outside the operating room. It is also a useful aide to anatomic study, residency training, surgical rehearsal, credentialing, and recertification. Surgical simulation is based on a virtual reality with varying degrees of immersion and realism. Simulators provide a no-risk environment for harmless and repeatable practice. Virtual reality has three main components of simulation: graphics/volume rendering, model behavior/tissue deformation, and haptic feedback. The challenge of accurately simulating the forces and tactile sensations experienced in neurosurgery limits the sophistication of a virtual simulator. The limited haptic feedback available in minimally invasive neurosurgery makes it a favorable subject for simulation. Virtual simulators with realistic graphics and force feedback have been developed for ventriculostomy, intraventricular surgery, and transsphenoidal pituitary surgery, thus allowing preoperative study of the individual anatomy and increasing the safety of the procedure. The authors also present experiences with their own virtual simulation of endoscopic third ventriculostomy.

Application of virtual reality GIS in urban planning: an example in Huangdao district

NASA Astrophysics Data System (ADS)

Han, Yong; Qiao, Xin; Sun, Weichen; Zhang, Litao

2007-06-01

As an important development direction of GIS, Virtual Reality GIS was founded in 1950s. After 1990s, due to the fast development of its theory and the computer technology, Virtual Reality has been applied to many fields: military, aerospace, design, manufactory, information management, business, construction, city management, medical, education, etc.. The most famous project is the Virtual Los Angeles implemented by the Urban Simulation Team (UST) of UCLA. The main focus of the UST is a long-term effort to build a real-time Virtual Reality model of the entire Los Angeles basin for use by architects, urban planners, emergency response teams, and the government entities. When completed, the entire Virtual L.A. model will cover an area well in excess of 10000 square miles and will elegantly scale from satellite images to street level views accurate enough to allow the signs in the window of the shops and the graffiti on the walls to be legible. Till now, the virtual L.A. has been applied to urban environments and design analysis, transportation studies, historic reconstruction and education, etc. Compared to the early development abroad, the development of Virtual Reality GIS in China is relatively late. It is researched in some universities in early years. But recently, it has been attended by the populace and been used in many social fields: urban planning, environmental protection, historic protection and recovery, real estate, tourism, education etc.. The application of Virtual Reality in urban planning of Huangdao District, Qingdao City is introduced in this paper.

Robots and ICT to support play in children with severe physical disabilities: a systematic review.

PubMed

van den Heuvel, Renée J F; Lexis, Monique A S; Gelderblom, Gert Jan; Jansens, Rianne M L; de Witte, Luc P

2015-09-02

Play is an essential part of children's lives. Children with physical disabilities experience difficulties in play, especially those with severe physical disabilities. With the progress of innovative technology, the possibilities to support play are increasing. The purpose of this literature study is to gain insight into the aims, control options and commercial availability of information and communication technology (ICT) and robots to support play (especially play for the sake of play) in children with severe physical disabilities. A systematic literature search in the databases PubMed, CINAHL, IEEE and ERIC was carried out. Titles and abstracts were assessed independently by three reviewers. In addition, studies were selected using Google Scholar, conference proceedings and reference lists. Three main groups of technology for play could be distinguished: robots (n = 8), virtual reality systems (n = 15) and computer systems (n = 4). Besides, ICT and robots developed for specific therapy or educational goals using play-like activities, five of the in total 27 technologies in this study described the aim of "play for play's sake". Many ICT systems and robots to support play in children with physical disabilities were found. Numerous technologies use play-like activities to achieve therapeutic or educational goals. Robots especially are used for "play for play's sake". Implications for Rehabilitation This study gives insight into the aims, control options and commercial availability for application of robots and ICT to support play in children with severe physical disabilities. This overview can be used in both the fields of rehabilitation and special education to search for new innovative intervention options and it can stimulate them to use these innovative play materials. Especially robots may have great potential in supporting "play for play's sake".

Validation of a virtual reality-based robotic surgical skills curriculum.

PubMed

Connolly, Michael; Seligman, Johnathan; Kastenmeier, Andrew; Goldblatt, Matthew; Gould, Jon C

2014-05-01

The clinical application of robotic-assisted surgery (RAS) is rapidly increasing. The da Vinci Surgical System™ is currently the only commercially available RAS system. The skills necessary to perform robotic surgery are unique from those required for open and laparoscopic surgery. A validated laparoscopic surgical skills curriculum (fundamentals of laparoscopic surgery or FLS™) has transformed the way surgeons acquire laparoscopic skills. There is a need for a similar skills training and assessment tool specific for robotic surgery. Based on previously published data and expert opinion, we developed a robotic skills curriculum. We sought to evaluate this curriculum for evidence of construct validity (ability to discriminate between users of different skill levels). Four experienced surgeons (>20 RAS) and 20 novice surgeons (first-year medical students with no surgical or RAS experience) were evaluated. The curriculum comprised five tasks utilizing the da Vinci™ Skills Simulator (Pick and Place, Camera Targeting 2, Peg Board 2, Matchboard 2, and Suture Sponge 3). After an orientation to the robot and a period of acclimation in the simulator, all subjects completed three consecutive repetitions of each task. Computer-derived performance metrics included time, economy of motion, master work space, instrument collisions, excessive force, distance of instruments out of view, drops, missed targets, and overall scores (a composite of all metrics). Experienced surgeons significantly outperformed novice surgeons in most metrics. Statistically significant differences were detected for each task in regards to mean overall scores and mean time (seconds) to completion. The curriculum we propose is a valid method of assessing and distinguishing robotic surgical skill levels on the da Vinci Si™ Surgical System. Further study is needed to establish proficiency levels and to demonstrate that training on the simulator with the proposed curriculum leads to improved robotic surgical performance in the operating room.

Virtual Reality: Real Promises and False Expectations.

ERIC Educational Resources Information Center

Homan, Willem J.

1994-01-01

Examines virtual reality (VR), and discusses the dilemma of defining VR, the limitations of the current technology, and the implications of VR for education. Highlights include a VR experience; human factors and the interface; and altered reality versus VR. (Author/AEF)

Virtual button interface

DOEpatents

Jones, Jake S.

1999-01-01

An apparatus and method of issuing commands to a computer by a user interfacing with a virtual reality environment. To issue a command, the user directs gaze at a virtual button within the virtual reality environment, causing a perceptible change in the virtual button, which then sends a command corresponding to the virtual button to the computer, optionally after a confirming action is performed by the user, such as depressing a thumb switch.

Virtual Reality: The Future of Animated Virtual Instructor, the Technology and Its Emergence to a Productive E-Learning Environment.

ERIC Educational Resources Information Center

Jiman, Juhanita

This paper discusses the use of Virtual Reality (VR) in e-learning environments where an intelligent three-dimensional (3D) virtual person plays the role of an instructor. With the existence of this virtual instructor, it is hoped that the teaching and learning in the e-environment will be more effective and productive. This virtual 3D animated…

The Use of Virtual Reality in Patients with Eating Disorders: Systematic Review

PubMed Central

Clus, Damien; Larsen, Mark Erik; Lemey, Christophe

2018-01-01

Background Patients with eating disorders are characterized by pathological eating habits and a tendency to overestimate their weight and body shape. Virtual reality shows promise for the evaluation and management of patients with eating disorders. This technology, when accepted by this population, allows immersion in virtual environments, assessment, and therapeutic approaches, by exposing users to high-calorie foods or changes in body shape. Objective To better understand the value of virtual reality, we conducted a review of the literature, including clinical studies proposing the use of virtual reality for the evaluation and management of patients with eating disorders. Methods We searched PubMed, PsycINFO, ScienceDirect, the Cochrane Library, Scopus, and Web of Science up to April 2017. We created the list of keywords based on two domains: virtual reality and eating disorders. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses to identify, select, and critically appraise relevant research while minimizing bias. Results The initial database searches identified 311 articles, 149 of which we removed as duplicates. We analyzed the resulting set of 26 unique studies that met the inclusion criteria. Of these, 8 studies were randomized controlled trials, 13 were nonrandomized studies, and 5 were clinical trials with only 1 participant. Most articles focused on clinical populations (19/26, 73%), with the remainder reporting case-control studies (7/26, 27%). Most of the studies used visual immersive equipment (16/26, 62%) with a head-mounted display (15/16, 94%). Two main areas of interest emerged from these studies: virtual work on patients’ body image (7/26, 27%) and exposure to virtual food stimuli (10/26, 38%). Conclusions We conducted a broad analysis of studies on the use of virtual reality in patients with eating disorders. This review of the literature showed that virtual reality is an acceptable and promising therapeutic tool for patients with eating disorders. PMID:29703715

Mobile devices, Virtual Reality, Augmented Reality, and Digital Geoscience Education.

NASA Astrophysics Data System (ADS)

Crompton, H.; De Paor, D. G.; Whitmeyer, S. J.; Bentley, C.

2016-12-01

Mobile devices are playing an increasing role in geoscience education. Affordances include instructor-student communication and class management in large classrooms, virtual and augmented reality applications, digital mapping, and crowd-sourcing. Mobile technologies have spawned the sub field of mobile learning or m-learning, which is defined as learning across multiple contexts, through social and content interactions. Geoscientists have traditionally engaged in non-digital mobile learning via fieldwork, but digital devices are greatly extending the possibilities, especially for non-traditional students. Smartphones and tablets are the most common devices but smart glasses such as Pivothead enable live streaming of a first-person view (see for example, https://youtu.be/gWrDaYP5w58). Virtual reality headsets such as Google Cardboard create an immersive virtual field experience and digital imagery such as GigaPan and Structure from Motion enables instructors and/or students to create virtual specimens and outcrops that are sharable across the globe. Whereas virtual reality (VR) replaces the real world with a virtual representation, augmented reality (AR) overlays digital data on the live scene visible to the user in real time. We have previously reported on our use of the AR application called FreshAiR for geoscientific "egg hunts." The popularity of Pokémon Go demonstrates the potential of AR for mobile learning in the geosciences.

Virtual reality and the traditional method for phlebotomy training among college of nursing students in Kuwait: implications for nursing education and practice.

PubMed

Vidal, Victoria L; Ohaeri, Beatrice M; John, Pamela; Helen, Delles

2013-01-01

This quasi-experimental study, with a control group and experimental group, compares the effectiveness of virtual reality simulators on developing phlebotomy skills of nursing students with the effectiveness of traditional methods of teaching. Performance of actual phlebotomy on a live client was assessed after training, using a standardized form. Findings showed that students who were exposed to the virtual reality simulator performed better in the following performance metrics: pain factor, hematoma formation, and number of reinsertions. This study confirms that the use of the virtual reality-based system to supplement the traditional method may be the optimal program for training.

The Influences of the 2D Image-Based Augmented Reality and Virtual Reality on Student Learning

ERIC Educational Resources Information Center

Liou, Hsin-Hun; Yang, Stephen J. H.; Chen, Sherry Y.; Tarng, Wernhuar

2017-01-01

Virtual reality (VR) learning environments can provide students with concepts of the simulated phenomena, but users are not allowed to interact with real elements. Conversely, augmented reality (AR) learning environments blend real-world environments so AR could enhance the effects of computer simulation and promote students' realistic experience.…

Evaluating Virtual Reality and Augmented Reality Training for Industrial Maintenance and Assembly Tasks

ERIC Educational Resources Information Center

Gavish, Nirit; Gutiérrez, Teresa; Webel, Sabine; Rodríguez, Jorge; Peveri, Matteo; Bockholt, Uli; Tecchia, Franco

2015-01-01

The current study evaluated the use of virtual reality (VR) and augmented reality (AR) platforms, developed within the scope of the SKILLS Integrated Project, for industrial maintenance and assembly (IMA) tasks training. VR and AR systems are now widely regarded as promising training platforms for complex and highly demanding IMA tasks. However,…

Personalized Learning in Medical Education: Designing a User Interface for a Dynamic Haptic Robotic Trainer for Central Venous Catheterization

PubMed Central

Yovanoff, Mary; Pepley, David; Mirkin, Katelin; Moore, Jason; Han, David; Miller, Scarlett

2017-01-01

While Virtual Reality (VR) has emerged as a viable method for training new medical residents, it has not yet reached all areas of training. One area lacking such development is surgical residency programs where there are large learning curves associated with skill development. In order to address this gap, a Dynamic Haptic Robotic Trainer (DHRT) was developed to help train surgical residents in the placement of ultrasound guided Internal Jugular Central Venous Catheters and to incorporate personalized learning. In order to accomplish this, a 2-part study was conducted to: (1) systematically analyze the feedback given to 18 third year medical students by trained professionals to identify the items necessary for a personalized learning system and (2) develop and experimentally test the usability of the personalized learning interface within the DHRT system. The results can be used to inform the design of VR and personalized learning systems within the medical community. PMID:29123361

[Contributions of robotic devices to upper limb poststroke rehabilitation].

PubMed

Duret, C

2010-05-01

Poststroke rehabilitation care has evolved considerably over the last decade. The emergence of the concepts of brain plasticity and motor learning has led to the development of new therapeutic approaches. Most of the new strategies are based on movement therapy, which can have a real impact on neurological recovery, sometimes with significant functional benefit for the patient. In this context of evolving practices, the hemiplegic arm is the subject of special attention. Considering the often unfavorable "natural" prognosis and the relatively limited impact of conventional therapies; researchers have focused work on new alternatives. Cooperation between developers of technological advances and the medical community has led to the development of innovative therapeutic options often based on the use of specific technological tools (functional electric stimulation, virtual reality, transcranial magnetic stimulation...) to solicit or facilitate movement. Robot-assisted rehabilitation lies within this scope. The positive results reported in the most recent publications and the growing interest for this type of therapy in the fields of medical and engineering research should open the way for extremely promising prospects. The technological performance of new robots has nevertheless raised a large number of unanswered questions, implying a significant amount of further research. Copyright 2009 Elsevier Masson SAS. All rights reserved.

Virtual reality and planetary exploration

NASA Technical Reports Server (NTRS)

Mcgreevy, Michael W.

1992-01-01

Exploring planetary environments is central to NASA's missions and goals. A new computing technology called Virtual Reality has much to offer in support of planetary exploration. This technology augments and extends human presence within computer-generated and remote spatial environments. Historically, NASA has been a leader in many of the fundamental concepts and technologies that comprise Virtual Reality. Indeed, Ames Research Center has a central role in the development of this rapidly emerging approach to using computers. This ground breaking work has inspired researchers in academia, industry, and the military. Further, NASA's leadership in this technology has spun off new businesses, has caught the attention of the international business community, and has generated several years of positive international media coverage. In the future, Virtual Reality technology will enable greatly improved human-machine interactions for more productive planetary surface exploration. Perhaps more importantly, Virtual Reality technology will democratize the experience of planetary exploration and thereby broaden understanding of, and support for, this historic enterprise.

Virtual reality and planetary exploration

NASA Astrophysics Data System (ADS)

McGreevy, Michael W.

Exploring planetary environments is central to NASA's missions and goals. A new computing technology called Virtual Reality has much to offer in support of planetary exploration. This technology augments and extends human presence within computer-generated and remote spatial environments. Historically, NASA has been a leader in many of the fundamental concepts and technologies that comprise Virtual Reality. Indeed, Ames Research Center has a central role in the development of this rapidly emerging approach to using computers. This ground breaking work has inspired researchers in academia, industry, and the military. Further, NASA's leadership in this technology has spun off new businesses, has caught the attention of the international business community, and has generated several years of positive international media coverage. In the future, Virtual Reality technology will enable greatly improved human-machine interactions for more productive planetary surface exploration. Perhaps more importantly, Virtual Reality technology will democratize the experience of planetary exploration and thereby broaden understanding of, and support for, this historic enterprise.

Clinician perceptions of virtual reality to assess and treat returning veterans.

PubMed

Kramer, Teresa L; Pyne, Jeffrey M; Kimbrell, Timothy A; Savary, Patricia E; Smith, Jeffrey L; Jegley, Susan M

2010-11-01

Implementation of evidence-based, innovative treatments is necessary to address posttraumatic stress disorder (PTSD) and related mental health problems of Operation Enduring Freedom and Operation Iraqi Freedom (OEF-OIF) military service personnel. The purpose of this study was to characterize mental health clinicians' perceptions of virtual reality as an assessment tool or adjunct to exposure therapy. Focus groups were conducted with 18 prescribing and nonprescribing mental health clinicians within the Veterans Health Administration. Group discussion was digitally recorded, downloaded into Ethnograph software, and coded to arrive at primary, secondary, and tertiary themes. Most frequently mentioned barriers pertained to aspects of virtual reality, followed by veteran characteristics. Organizational barriers were more relevant when implementing virtual reality as a treatment adjunct. Although the study demonstrated that use of virtual reality as a therapy was feasible and acceptable to clinicians, successful implementation of the technology as an assessment and treatment tool will depend on consideration of the facilitators and barriers that were identified.

Viewpoints on Medical Image Processing: From Science to Application

PubMed Central

Deserno (né Lehmann), Thomas M.; Handels, Heinz; Maier-Hein (né Fritzsche), Klaus H.; Mersmann, Sven; Palm, Christoph; Tolxdorff, Thomas; Wagenknecht, Gudrun; Wittenberg, Thomas

2013-01-01

Medical image processing provides core innovation for medical imaging. This paper is focused on recent developments from science to applications analyzing the past fifteen years of history of the proceedings of the German annual meeting on medical image processing (BVM). Furthermore, some members of the program committee present their personal points of views: (i) multi-modality for imaging and diagnosis, (ii) analysis of diffusion-weighted imaging, (iii) model-based image analysis, (iv) registration of section images, (v) from images to information in digital endoscopy, and (vi) virtual reality and robotics. Medical imaging and medical image computing is seen as field of rapid development with clear trends to integrated applications in diagnostics, treatment planning and treatment. PMID:24078804

Advances in rehabilitation medicine.

PubMed

Ng, Yee Sien; Chew, Effie; Samuel, Geoffrey S; Tan, Yeow Leng; Kong, Keng He

2013-10-01

Rehabilitation medicine is the medical specialty that integrates rehabilitation as its core therapeutic modality in disability management. More than a billion people worldwide are disabled, and the World Health Organization has developed the International Classification of Functioning, Disability and Health as a framework through which disability is addressed. Herein, we explore paradigm shifts in neurorehabilitation, with a focus on restoration, and provide overviews on developments in neuropharmacology, rehabilitation robotics, virtual reality, constraint-induced therapy and brain stimulation. We also discuss important issues in rehabilitation systems of care, including integrated care pathways, very early rehabilitation, early supported discharge and telerehabilitation. Finally, we highlight major new fields of rehabilitation such as spasticity management, frailty and geriatric rehabilitation, intensive care and cancer rehabilitation.

Viewpoints on Medical Image Processing: From Science to Application.

PubMed

Deserno Né Lehmann, Thomas M; Handels, Heinz; Maier-Hein Né Fritzsche, Klaus H; Mersmann, Sven; Palm, Christoph; Tolxdorff, Thomas; Wagenknecht, Gudrun; Wittenberg, Thomas

2013-05-01

Medical image processing provides core innovation for medical imaging. This paper is focused on recent developments from science to applications analyzing the past fifteen years of history of the proceedings of the German annual meeting on medical image processing (BVM). Furthermore, some members of the program committee present their personal points of views: (i) multi-modality for imaging and diagnosis, (ii) analysis of diffusion-weighted imaging, (iii) model-based image analysis, (iv) registration of section images, (v) from images to information in digital endoscopy, and (vi) virtual reality and robotics. Medical imaging and medical image computing is seen as field of rapid development with clear trends to integrated applications in diagnostics, treatment planning and treatment.

Using mixed methods to evaluate efficacy and user expectations of a virtual reality-based training system for upper-limb recovery in patients after stroke: a study protocol for a randomised controlled trial.

PubMed

Schuster-Amft, Corina; Eng, Kynan; Lehmann, Isabelle; Schmid, Ludwig; Kobashi, Nagisa; Thaler, Irène; Verra, Martin L; Henneke, Andrea; Signer, Sandra; McCaskey, Michael; Kiper, Daniel

2014-09-06

In recent years, virtual reality has been introduced to neurorehabilitation, in particular with the intention of improving upper-limb training options and facilitating motor function recovery. The proposed study incorporates a quantitative part and a qualitative part, termed a mixed-methods approach: (1) a quantitative investigation of the efficacy of virtual reality training compared to conventional therapy in upper-limb motor function are investigated, (2a) a qualitative investigation of patients' experiences and expectations of virtual reality training and (2b) a qualitative investigation of therapists' experiences using the virtual reality training system in the therapy setting. At three participating clinics, 60 patients at least 6 months after stroke onset will be randomly allocated to an experimental virtual reality group (EG) or to a control group that will receive conventional physiotherapy or occupational therapy (16 sessions, 45 minutes each, over the course of 4 weeks). Using custom data gloves, patients' finger and arm movements will be displayed in real time on a monitor, and they will move and manipulate objects in various virtual environments. A blinded assessor will test patients' motor and cognitive performance twice before, once during, and twice after the 4-week intervention. The primary outcome measure is the Box and Block Test. Secondary outcome measures are the Chedoke-McMaster Stroke Assessments (hand, arm and shoulder pain subscales), the Chedoke-McMaster Arm and Hand Activity Inventory, the Line Bisection Test, the Stroke Impact Scale, the MiniMentalState Examination and the Extended Barthel Index. Semistructured face-to-face interviews will be conducted with patients in the EG after intervention finalization with a focus on the patients' expectations and experiences regarding the virtual reality training. Therapists' perspectives on virtual reality training will be reviewed in three focus groups comprising four to six occupational therapists and physiotherapists. The interviews will help to gain a deeper understanding of the phenomena under investigation to provide sound recommendations for the implementation of the virtual reality training system for routine use in neurorehabilitation complementing the quantitative clinical assessments. Cliniclatrials.gov Identifier: NCT01774669 (15 January 2013).

Effects of virtual reality-based training and task-oriented training on balance performance in stroke patients.

PubMed

Lee, Hyung Young; Kim, You Lim; Lee, Suk Min

2015-06-01

[Purpose] This study aimed to investigate the clinical effects of virtual reality-based training and task-oriented training on balance performance in stroke patients. [Subjects and Methods] The subjects were randomly allocated to 2 groups: virtual reality-based training group (n = 12) and task-oriented training group (n = 12). The patients in the virtual reality-based training group used the Nintendo Wii Fit Plus, which provided visual and auditory feedback as well as the movements that enabled shifting of weight to the right and left sides, for 30 min/day, 3 times/week for 6 weeks. The patients in the task-oriented training group practiced additional task-oriented programs for 30 min/day, 3 times/week for 6 weeks. Patients in both groups also underwent conventional physical therapy for 60 min/day, 5 times/week for 6 weeks. [Results] Balance and functional reach test outcomes were examined in both groups. The results showed that the static balance and functional reach test outcomes were significantly higher in the virtual reality-based training group than in the task-oriented training group. [Conclusion] This study suggested that virtual reality-based training might be a more feasible and suitable therapeutic intervention for dynamic balance in stroke patients compared to task-oriented training.

Laparoscopic baseline ability assessment by virtual reality.

PubMed

Madan, Atul K; Frantzides, Constantine T; Sasso, Lisa M

2005-02-01

Assessment of any surgical skill is time-consuming and difficult. Currently, there are no accepted metrics for most surgical skills, especially laparoscopic skills. Virtual reality has been utilized for laparoscopic training of surgical residents. Our hypothesis is that this technology can be utilized for laparoscopic ability metrics. This study involved medical students with no previous laparoscopic experience. All students were taken into a porcine laboratory in order to assess two operative tasks (measuring a piece of bowel and placing a piece of bowel into a laparoscopic bag). Then they were taken into an inanimate lab with a Minimally Invasive Surgery Trainer-Virtual Reality (MIST-VR). Each student repeatedly performed one task (placing a virtual reality ball into a receptacle). The students' scores and times from the animate lab were compared with average economy of movement and times from the MIST-VR. The MIST-VR scored both hands individually. Thirty-two first- and second-year medical students were included in the study. There was statistically significant (P < 0.05) correlation between 11 of 16 possible relationships between the virtual reality trainer and operative tasks. While not all of the possible relationships demonstrated statistically significant correlation, the majority of the possible relationships demonstrated statistically significant correlation. Virtual reality may be an avenue for measuring laparoscopic surgical ability.

Effects of virtual reality-based training and task-oriented training on balance performance in stroke patients

PubMed Central

Lee, Hyung Young; Kim, You Lim; Lee, Suk Min

2015-01-01

[Purpose] This study aimed to investigate the clinical effects of virtual reality-based training and task-oriented training on balance performance in stroke patients. [Subjects and Methods] The subjects were randomly allocated to 2 groups: virtual reality-based training group (n = 12) and task-oriented training group (n = 12). The patients in the virtual reality-based training group used the Nintendo Wii Fit Plus, which provided visual and auditory feedback as well as the movements that enabled shifting of weight to the right and left sides, for 30 min/day, 3 times/week for 6 weeks. The patients in the task-oriented training group practiced additional task-oriented programs for 30 min/day, 3 times/week for 6 weeks. Patients in both groups also underwent conventional physical therapy for 60 min/day, 5 times/week for 6 weeks. [Results] Balance and functional reach test outcomes were examined in both groups. The results showed that the static balance and functional reach test outcomes were significantly higher in the virtual reality-based training group than in the task-oriented training group. [Conclusion] This study suggested that virtual reality-based training might be a more feasible and suitable therapeutic intervention for dynamic balance in stroke patients compared to task-oriented training. PMID:26180341

Effects of virtual reality training using Nintendo Wii and treadmill walking exercise on balance and walking for stroke patients.

PubMed

Bang, Yo-Soon; Son, Kyung Hyun; Kim, Hyun Jin

2016-11-01

[Purpose] The purpose of this study is to investigate the effects of virtual reality training using Nintendo Wii on balance and walking for stroke patients. [Subjects and Methods] Forty stroke patients with stroke were randomly divided into two exercise program groups: virtual reality training (n=20) and treadmill (n=20). The subjects underwent their 40-minute exercise program three times a week for eight weeks. Their balance and walking were measured before and after the complete program. We measured the left/right weight-bearing and the anterior/posterior weight-bearing for balance, as well as stance phase, swing phase, and cadence for walking. [Results] For balance, both groups showed significant differences in the left/right and anterior/posterior weight-bearing, with significant post-program differences between the groups. For walking, there were significant differences in the stance phase, swing phase, and cadence of the virtual reality training group. [Conclusion] The results of this study suggest that virtual reality training providing visual feedback may enable stroke patients to directly adjust their incorrect weight center and shift visually. Virtual reality training may be appropriate for patients who need improved balance and walking ability by inducing their interest for them to perform planned exercises on a consistent basis.

Effects of virtual reality training using Nintendo Wii and treadmill walking exercise on balance and walking for stroke patients

PubMed Central

Bang, Yo-Soon; Son, Kyung Hyun; Kim, Hyun Jin

2016-01-01

[Purpose] The purpose of this study is to investigate the effects of virtual reality training using Nintendo Wii on balance and walking for stroke patients. [Subjects and Methods] Forty stroke patients with stroke were randomly divided into two exercise program groups: virtual reality training (n=20) and treadmill (n=20). The subjects underwent their 40-minute exercise program three times a week for eight weeks. Their balance and walking were measured before and after the complete program. We measured the left/right weight-bearing and the anterior/posterior weight-bearing for balance, as well as stance phase, swing phase, and cadence for walking. [Results] For balance, both groups showed significant differences in the left/right and anterior/posterior weight-bearing, with significant post-program differences between the groups. For walking, there were significant differences in the stance phase, swing phase, and cadence of the virtual reality training group. [Conclusion] The results of this study suggest that virtual reality training providing visual feedback may enable stroke patients to directly adjust their incorrect weight center and shift visually. Virtual reality training may be appropriate for patients who need improved balance and walking ability by inducing their interest for them to perform planned exercises on a consistent basis. PMID:27942130

Use of virtual reality gaming systems for children who are critically ill.

PubMed

Salem, Yasser; Elokda, Ahmed

2014-01-01

Children who are critically ill are frequently viewed as "too sick" to tolerate physical activity. As a result, these children often fail to develop strength or cardiovascular endurance as compared to typically developing children. Previous reports have shown that early participation in physical activity in is safe and feasible for patients who are critically ill and may result in a shorter length of stay and improved functional outcomes. The use of the virtual reality gaming systems has become a popular form of therapy for children with disabilities and has been supported by a growing body of evidence substantiating its effectiveness with this population. The use of the virtual reality gaming systems in pediatric rehabilitation provides the children with opportunity to participate in an exercise program that is fun, enjoyable, playful, and at the same time beneficial. The integration of those systems in rehabilitation of children who are critically ill is appealing and has the potential to offer the possibility of enhancing physical activities. The lack of training studies involving children who are critically ill makes it difficult to set guidelines on the recommended physical activities and virtual reality gaming systems that is needed to confer health benefits. Several considerations should be taken into account before recommended virtual reality gaming systems as a training program for children who are critically ill. This article highlighted guidelines, limitations and challenges that need to be considered when designing exercise program using virtual reality gaming systems for critically ill children. This information is helpful given the popular use of virtual reality gaming systems in rehabilitation, particularly in children who are critically ill.

Controlled interaction: strategies for using virtual reality to study perception.

PubMed

Durgin, Frank H; Li, Zhi

2010-05-01

Immersive virtual reality systems employing head-mounted displays offer great promise for the investigation of perception and action, but there are well-documented limitations to most virtual reality systems. In the present article, we suggest strategies for studying perception/action interactions that try to depend on both scale-invariant metrics (such as power function exponents) and careful consideration of the requirements of the interactions under investigation. New data concerning the effect of pincushion distortion on the perception of surface orientation are presented, as well as data documenting the perception of dynamic distortions associated with head movements with uncorrected optics. A review of several successful uses of virtual reality to study the interaction of perception and action emphasizes scale-free analysis strategies that can achieve theoretical goals while minimizing assumptions about the accuracy of virtual simulations.

Heart rate response to fear conditioning and virtual reality in subthreshold PTSD.

PubMed

Roy, Michael J; Costanzo, Michelle E; Jovanovic, Tanja; Leaman, Suzanne; Taylor, Patricia; Norrholm, Seth D; Rizzo, Albert A

2013-01-01

Posttraumatic stress disorder (PTSD) is a significant health concern for U.S. military service members (SMs) returning from Afghanistan and Iraq. Early intervention to prevent chronic disability requires greater understanding of subthreshold PTSD symptoms, which are associated with impaired physical health, mental health, and risk for delayed onset PTSD. We report a comparison of physiologic responses for recently deployed SMs with high and low subthreshold PTSD symptoms, respectively, to a fear conditioning task and novel virtual reality paradigm (Virtual Iraq). The high symptom group demonstrated elevated heart rate (HR) response during fear conditioning. Virtual reality sequences evoked significant HR responses which predicted variance of the PTSD Checklist-Military Version self-report. Our results support the value of physiologic assessment during fear conditioning and combat-related virtual reality exposure as complementary tools in detecting subthreshold PTSD symptoms in Veterans.

Virtual reality for stroke rehabilitation: an abridged version of a Cochrane review.

PubMed

Laver, K; George, S; Thomas, S; Deutsch, J E; Crotty, M

2015-08-01

Virtual reality and interactive video gaming have emerged as new treatment approaches in stroke rehabilitation settings over the last ten years. The primary objective of this review was to determine the effectiveness of virtual reality on upper limb function and activity after stroke. The impact on secondary outcomes including gait, cognitive function and activities of daily living was also assessed. Randomized and quasi-randomized controlled trials comparing virtual reality with an alternative intervention or no intervention were eligible to be included in the review. The authors searched a number of electronic databases including: the Cochrane Stroke Group Trials Register, the Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, AMED, CINAHL, PsycINFO, clinical trial registers, reference lists, Dissertation Abstracts and contacted key researchers in the field. Search results were independently examined by two review authors to identify studies meeting the inclusion criteria. A total of 37 randomized or quasi randomized controlled trials with a total of 1019 participants were included in the review. Virtual reality was found to be significantly more effective than conventional therapy in improving upper limb function (standardized mean difference [SMD] 0.28, 95% confidence intervals [CI] 0.08 to 0.49) based on 12 studies and significantly more effective than no therapy in improving upper limber function (SMD 0.44 [95% CI 0.15 to 0.73]) based on nine studies. The use of virtual reality also significantly improved activities of daily living function when compared to more conventional therapy approaches (SMD 0.43 [95% CI 0.18 to 0.69]) based on eight studies. While there are a large number of studies assessing the efficacy of virtual reality they tend to be small and many are at risk of bias. While there is evidence to support the use of virtual reality intervention as part of upper limb training programs, more research is required to determine whether it is beneficial in terms of improving lower limb function and gait and cognitive function.

Virtual button interface

DOEpatents

Jones, J.S.

1999-01-12

An apparatus and method of issuing commands to a computer by a user interfacing with a virtual reality environment are disclosed. To issue a command, the user directs gaze at a virtual button within the virtual reality environment, causing a perceptible change in the virtual button, which then sends a command corresponding to the virtual button to the computer, optionally after a confirming action is performed by the user, such as depressing a thumb switch. 4 figs.

Virtual Reality to Maximize Function for Hand and Arm Rehabilitation: Exploration of Neural Mechanisms

PubMed Central

MERIANS, Alma S.; TUNIK, Eugene; ADAMOVICH, Sergei V.

2015-01-01

Stroke patients report hand function as the most disabling motor deficit. Current evidence shows that learning new motor skills is essential for inducing functional neuroplasticity and functional recovery. Adaptive training paradigms that continually and interactively move a motor outcome closer to the targeted skill are important to motor recovery. Computerized virtual reality simulations when interfaced with robots, movement tracking and sensing glove systems are particularly adaptable, allowing for online and offline modifications of task based activities using the participant’s current performance and success rate. We have developed a second generation system that can exercise the hand and the arm together or in isolation and provides for both unilateral and bilateral hand and arm activities in three-dimensional space. We demonstrate that by providing haptic assistance for the hand and arm and adaptive anti-gravity support, the system can accommodate patients with lower level impairments. We hypothesize that combining training in VE with observation of motor actions can bring additional benefits. We present a proof of concept of a novel system that integrates interactive VE with functional neuroimaging to address this issue. Three components of this system are synchronized, the presentation of the visual display of the virtual hands, the collection of fMRI images and the collection of hand joint angles from the instrumented gloves. We show that interactive VEs can facilitate activation of brain areas during training by providing appropriately modified visual feedback. We predict that visual augmentation can become a tool to facilitate functional neuroplasticity. PMID:19592790

Virtual reality for treatment compliance for people with serious mental illness.

PubMed

Välimäki, Maritta; Hätönen, Heli M; Lahti, Mari E; Kurki, Marjo; Hottinen, Anja; Metsäranta, Kiki; Riihimäki, Tanja; Adams, Clive E

2014-10-08

Virtual reality (VR) is computerised real-time technology, which can be used an alternative assessment and treatment tool in the mental health field. Virtual reality may take different forms to simulate real-life activities and support treatment. To investigate the effects of virtual reality to support treatment compliance in people with serious mental illness. We searched the Cochrane Schizophrenia Group Trials Register (most recent, 17th September 2013) and relevant reference lists. All relevant randomised studies comparing virtual reality with standard care for those with serious mental illnesses. We defined virtual reality as a computerised real-time technology using graphics, sound and other sensory input, which creates the interactive computer-mediated world as a therapeutic tool. All review authors independently selected studies and extracted data. For homogeneous dichotomous data the risk difference (RD) and the 95% confidence intervals (CI) were calculated on an intention-to-treat basis. For continuous data, we calculated mean differences (MD). We assessed risk of bias and created a 'Summary of findings' table using the GRADE approach. We identified three short-term trials (total of 156 participants, duration five to 12 weeks). Outcomes were prone to at least a moderate risk of overestimating positive effects. We found that virtual reality had little effects regarding compliance (3 RCTs, n = 156, RD loss to follow-up 0.02 CI -0.08 to 0.12, low quality evidence), cognitive functioning (1 RCT, n = 27, MD average score on Cognistat 4.67 CI -1.76 to 11.10, low quality evidence), social skills (1 RCT, n = 64, MD average score on social problem solving SPSI-R (Social Problem Solving Inventory - Revised) -2.30 CI -8.13 to 3.53, low quality evidence), or acceptability of intervention (2 RCTs, n = 92, RD 0.05 CI -0.09 to 0.19, low quality evidence). There were no data reported on mental state, insight, behaviour, quality of life, costs, service utilisation, or adverse effects. Satisfaction with treatment - measured using an un-referenced scale - and reported as "interest in training" was better for the virtual reality group (1 RCT, n = 64, MD 6.00 CI 1.39 to 10.61,low quality evidence). There is no clear good quality evidence for or against using virtual reality for treatment compliance among people with serious mental illness. If virtual reality is used, the experimental nature of the intervention should be clearly explained. High-quality studies should be undertaken in this area to explore any effects of this novel intervention and variations of approach.

Learning Science in a Virtual Reality Application: The Impacts of Animated-Virtual Actors' Visual Complexity

ERIC Educational Resources Information Center

Kartiko, Iwan; Kavakli, Manolya; Cheng, Ken

2010-01-01

As the technology in computer graphics advances, Animated-Virtual Actors (AVAs) in Virtual Reality (VR) applications become increasingly rich and complex. Cognitive Theory of Multimedia Learning (CTML) suggests that complex visual materials could hinder novice learners from attending to the lesson properly. On the other hand, previous studies have…

But Why Is Everything so Hard to Do? Exploring Learning and the Complexity Factor in Social Virtual Reality

ERIC Educational Resources Information Center

Honebein, Peter C.; Goldsworthy, Richard

2012-01-01

Virtual classrooms and virtual activities have waxed and waned, with most focusing on fostering learning in the cognitive domain and, realistically, most becoming rapidly discontinued. But social virtual realities (SVR) are uniquely "social," so what about interpersonal skills? This article describes the authors' experiences exploring SVR as a…

Open Source Meets Virtual Reality--An Instructor's Journey Unearths New Opportunities for Learning, Community, and Academia

ERIC Educational Resources Information Center

O'Connor, Eileen A.

2015-01-01

Opening with the history, recent advances, and emerging ways to use avatar-based virtual reality, an instructor who has used virtual environments since 2007 shares how these environments bring more options to community building, teaching, and education. With the open-source movement, where the source code for virtual environments was made…

Ecological assessment of divided attention: What about the current tools and the relevancy of virtual reality.

PubMed

Lopez Maïté, C; Gaétane, D; Axel, C

2016-01-01

The ability to perform two tasks simultaneously has become increasingly important as attention-demanding technologies have become more common in daily life. This type of attentional resources allocation is commonly called "divided attention". Because of the importance of divided attention in natural world settings, substantial efforts have been made recently so as to promote an integrated, realistic assessment of functional abilities in dual-task paradigms. In this context, virtual reality methods appear to be a good solution. However to date, there has been little discussion on validity of such methods. Here, we offer a comparative review of conventional tools used to assess divided attention and of the first virtual reality studies (mostly from the field of road and pedestrian safety). The ecological character of virtual environments leads to a better understanding of the influence of dual-task settings and also makes it possible to clarify issues such as the utility of hands-free phones. After discussing the theoretical and clinical contributions of these studies, we discuss the limits of virtual reality assessment, focusing in particular: (i) on the challenges associated with lack of familiarity with new technological devices; (ii) on the validity of the ecological character of virtual environments; and (iii) on the question of whether the results obtained in a specific context can be generalized to all dual-task situations typical of daily life. To overcome the limitations associated with virtual reality, we propose: (i) to include a standardized familiarization phase in assessment protocols so as to limit the interference caused by the use of new technologies; (ii) to systematically compare virtual reality performance with conventional tests or real-life tests; and (iii) to design dual-task scenarios that are independent from the patient's expertise on one of the two tasks. We conclude that virtual reality appears to constitute a useful tool when used in combination with more conventional tests. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

Human Behavior Representation in Constructive Simulation (La representation du comportement humain dans la simulation constructive)

DTIC Science & Technology

2009-09-01

Environmental Medicine USN United States Navy VAE Virtual Air Environment VACP Visual, Auditory, Cognitive, Psychomotor (demand) VR Virtual Reality ...0 .5 m/s. Another useful approach to capturing leg, trunk, whole body, or movement tasks comes from virtual reality - based training research and...referred to as semi-automated forces (SAF). From: http://www.sedris.org/glossary.htm#C_grp. Constructive Models Abstractions from the reality to

Virtual Reality Lab Assistant

NASA Technical Reports Server (NTRS)

Saha, Hrishikesh; Palmer, Timothy A.

1996-01-01

Virtual Reality Lab Assistant (VRLA) demonstration model is aligned for engineering and material science experiments to be performed by undergraduate and graduate students in the course as a pre-lab simulation experience. This will help students to get a preview of how to use the lab equipment and run experiments without using the lab hardware/software equipment. The quality of the time available for laboratory experiments can be significantly improved through the use of virtual reality technology.

Virtual Reality and Online Databases: Will "Look and Feel" Literally Mean "Look" and "Feel"? [and]"Online" Interviews Dr. Thomas A. Furness III, Virtual Reality Pioneer.

ERIC Educational Resources Information Center

Miller, Carmen

1992-01-01

The first of two articles discusses virtual reality (VR) and online databases; the second one reports on an interview with Thomas A. Furness III, who defines VR and explains work at the Human Interface Technology Laboratory (HIT). Sidebars contain a glossary of VR terms and a conversation with Toni Emerson, the HIT lab's librarian. (LRW)

[Parallel virtual reality visualization of extreme large medical datasets].

PubMed

Tang, Min

2010-04-01

On the basis of a brief description of grid computing, the essence and critical techniques of parallel visualization of extreme large medical datasets are discussed in connection with Intranet and common-configuration computers of hospitals. In this paper are introduced several kernel techniques, including the hardware structure, software framework, load balance and virtual reality visualization. The Maximum Intensity Projection algorithm is realized in parallel using common PC cluster. In virtual reality world, three-dimensional models can be rotated, zoomed, translated and cut interactively and conveniently through the control panel built on virtual reality modeling language (VRML). Experimental results demonstrate that this method provides promising and real-time results for playing the role in of a good assistant in making clinical diagnosis.

Could virtual reality be effective in treating children with phobias?

PubMed

Bouchard, Stéphane

2011-02-01

The use of virtual reality to treat anxiety disorders in adults is gaining popularity and its efficacy is supported by numerous outcome studies. Similar research for children is lagging behind. The outcome studies on the use of virtual reality to treat anxiety disorders in children currently address only specific phobias, and all of the available trials are reviewed in this article. Despite the limited number of studies, results are very encouraging for the treatment of school and spider phobias. A study with adolescents suggests that, at least for social anxiety, exposure stimuli would be more effective if they were developed specifically for younger populations. Virtual reality may not increase children's motivation towards therapy unless their fearful apprehension is addressed before initiating the treatment.

Virtual reality in Latin American clinical psychology and the VREPAR project. Virtual Reality Environments for Psycho-Neuro-physiological Assessment and Rehabilitation.

PubMed

Silva, Mauro Rubens

2002-10-01

Starting with the excellent collective work done by the European Community (EC)-funded Virtual Reality Environments for Psycho-Neuro-physiological Assessment and Rehabilitation (VREPAR) projects, I try to indicate some possible pathways that would allow a better integration of this advanced technology into the reality of Latin American psychology. I myself use analyses that I did in my master's degree in the PUCSP-Catholic University in São Paulo, Brazil. I also include a brief description of the CD-ROM Clinical Psychology Uses of Virtual Reality (CPUVR) that accompanies my thesis. I point out the importance of collaboration between psychology and other disciplines, including computer science. I explain the method that I used to work with digital information, important for the formation of a critical mass of people thinking in Portuguese and Spanish to accelerate a technological jump.

Virtual and remote robotic laboratory using EJS, MATLAB and LabVIEW.

PubMed

Chaos, Dictino; Chacón, Jesús; Lopez-Orozco, Jose Antonio; Dormido, Sebastián

2013-02-21

This paper describes the design and implementation of a virtual and remote laboratory based on Easy Java Simulations (EJS) and LabVIEW. The main application of this laboratory is to improve the study of sensors in Mobile Robotics, dealing with the problems that arise on the real world experiments. This laboratory allows the user to work from their homes, tele-operating a real robot that takes measurements from its sensors in order to obtain a map of its environment. In addition, the application allows interacting with a robot simulation (virtual laboratory) or with a real robot (remote laboratory), with the same simple and intuitive graphical user interface in EJS. Thus, students can develop signal processing and control algorithms for the robot in simulation and then deploy them on the real robot for testing purposes. Practical examples of application of the laboratory on the inter-University Master of Systems Engineering and Automatic Control are presented.

Virtual and Remote Robotic Laboratory Using EJS, MATLAB and Lab VIEW

PubMed Central

Chaos, Dictino; Chacón, Jesús; Lopez-Orozco, Jose Antonio; Dormido, Sebastián

2013-01-01

This paper describes the design and implementation of a virtual and remote laboratory based on Easy Java Simulations (EJS) and LabVIEW. The main application of this laboratory is to improve the study of sensors in Mobile Robotics, dealing with the problems that arise on the real world experiments. This laboratory allows the user to work from their homes, tele-operating a real robot that takes measurements from its sensors in order to obtain a map of its environment. In addition, the application allows interacting with a robot simulation (virtual laboratory) or with a real robot (remote laboratory), with the same simple and intuitive graphical user interface in EJS. Thus, students can develop signal processing and control algorithms for the robot in simulation and then deploy them on the real robot for testing purposes. Practical examples of application of the laboratory on the inter-University Master of Systems Engineering and Automatic Control are presented. PMID:23429578

High psychosis liability is associated with altered autonomic balance during exposure to Virtual Reality social stressors.

PubMed

Counotte, Jacqueline; Pot-Kolder, Roos; van Roon, Arie M; Hoskam, Olivier; van der Gaag, Mark; Veling, Wim

2017-06-01

Social stressors are associated with an increased risk of psychosis. Stress sensitisation is thought to be an underlying mechanism and may be reflected in an altered autonomic stress response. Using an experimental Virtual Reality design, the autonomic stress response to social stressors was examined in participants with different liability to psychosis. Fifty-five patients with recent onset psychotic disorder, 20 patients at ultra-high risk for psychosis, 42 siblings of patients with psychosis and 53 controls were exposed to social stressors (crowdedness, ethnic minority status and hostility) in a Virtual Reality environment. Heart rate variability parameters and skin conductance levels were measured at baseline and during Virtual Reality experiments. High psychosis liability groups had significantly increased heart rate and decreased heart rate variability compared to low liability groups both at baseline and during Virtual Reality experiments. Both low frequency (LF) and high frequency (HF) power were reduced, while the LF/HF ratio was similar between groups. The number of virtual social stressors significantly affected heart rate, HF, LF/HF and skin conductance level. There was no interaction between psychosis liability and amount of virtual social stress. High liability to psychosis is associated with decreased parasympathetic activity in virtual social environments, which reflects generally high levels of arousal, rather than increased autonomic reactivity to social stressors. Copyright © 2016 Elsevier B.V. All rights reserved.

3min. poster presentations of B01

NASA Astrophysics Data System (ADS)

Foing, Bernard H.

We give a report on recommendations from ILEWG International conferences held at Cape Canaveral in 2008 (ICEUM10), and in Beijing in May 2010 with IAF (GLUC -ICEUM11). We discuss the different rationale for Moon exploration. Priorities for scientific investigations include: clues on the formation and evolution of rocky planets, accretion and bombardment in the inner solar system, comparative planetology processes (tectonic, volcanic, impact cratering, volatile delivery), historical records, astrobiology, survival of organics; past, present and future life. The ILEWG technology task group set priorities for the advancement of instrumenta-tion: Remote sensing miniaturised instruments; Surface geophysical and geochemistry package; Instrument deployment and robotic arm, nano-rover, sampling, drilling; Sample finder and collector. Regional mobility rover; Autonomy and Navigation; Artificially intelligent robots, Complex systems. The ILEWG ExogeoLab pilot project was developed as support for instru-ments, landers, rovers,and preparation for cooperative robotic village. The ILEWG lunar base task group looked at minimal design concepts, technologies in robotic and human exploration with Tele control, telepresence, virtual reality; Man-Machine interface and performances. The ILEWG ExoHab pilot project has been started with support from agencies and partners. We discuss ILEWG terrestrial Moon-Mars campaigns for validation of technologies, research and human operations. We indicate how Moon-Mars Exploration can inspire solutions to global Earth sustained development: In-Situ Utilisation of resources; Establishment of permanent robotic infrastructures, Environmental protection aspects; Life sciences laboratories; Support to human exploration. Co-Authors: ILEWG Task Groups on: Science, Technology, Robotic village, Lunar Bases , Commercial and Societal aspects, Roadmap synergies with other programmes, Public en-gagemnet and Outreach, Young Lunar Explorers.

Evaluating the Effects of Immersive Embodied Interaction on Cognition in Virtual Reality

NASA Astrophysics Data System (ADS)

Parmar, Dhaval

Virtual reality is on its advent of becoming mainstream household technology, as technologies such as head-mounted displays, trackers, and interaction devices are becoming affordable and easily available. Virtual reality (VR) has immense potential in enhancing the fields of education and training, and its power can be used to spark interest and enthusiasm among learners. It is, therefore, imperative to evaluate the risks and benefits that immersive virtual reality poses to the field of education. Research suggests that learning is an embodied process. Learning depends on grounded aspects of the body including action, perception, and interactions with the environment. This research aims to study if immersive embodiment through the means of virtual reality facilitates embodied cognition. A pedagogical VR solution which takes advantage of embodied cognition can lead to enhanced learning benefits. Towards achieving this goal, this research presents a linear continuum for immersive embodied interaction within virtual reality. This research evaluates the effects of three levels of immersive embodied interactions on cognitive thinking, presence, usability, and satisfaction among users in the fields of science, technology, engineering, and mathematics (STEM) education. Results from the presented experiments show that immersive virtual reality is greatly effective in knowledge acquisition and retention, and highly enhances user satisfaction, interest and enthusiasm. Users experience high levels of presence and are profoundly engaged in the learning activities within the immersive virtual environments. The studies presented in this research evaluate pedagogical VR software to train and motivate students in STEM education, and provide an empirical analysis comparing desktop VR (DVR), immersive VR (IVR), and immersive embodied VR (IEVR) conditions for learning. This research also proposes a fully immersive embodied interaction metaphor (IEIVR) for learning of computational concepts as a future direction, and presents the challenges faced in implementing the IEIVR metaphor due to extended periods of immersion. Results from the conducted studies help in formulating guidelines for virtual reality and education researchers working in STEM education and training, and for educators and curriculum developers seeking to improve student engagement in the STEM fields.

Mixed virtual reality simulation--taking endoscopic simulation one step further.

PubMed

Courteille, O; Felländer-Tsai, L; Hedman, L; Kjellin, A; Enochsson, L; Lindgren, G; Fors, U

2011-01-01

This pilot study aimed to assess medical students' appraisals of a "mixed" virtual reality simulation for endoscopic surgery (with a virtual patient case in addition to a virtual colonoscopy) as well as the impact of this simulation set-up on students' performance. Findings indicate that virtual patients can enhance contextualization of simulated endoscopy and thus facilitate an authentic learning environment, which is important in order to increase motivation.

a Methodology to Adapt Photogrammetric Models to Virtual Reality for Oculus Gear VR

NASA Astrophysics Data System (ADS)

Colmenero Fdez, A.

2017-11-01

In this paper, we will expose the process of adapting a high resolution model (laser and photogrammetry) into a virtual reality application for mobile phones. It is a virtual archeology project carried out on the site of Lugo's Mitreo, Spain.

Virtual Reality Calibration for Telerobotic Servicing

NASA Technical Reports Server (NTRS)

Kim, W.

1994-01-01

A virtual reality calibration technique of matching a virtual environment of simulated graphics models in 3-D geometry and perspective with actual camera views of the remote site task environment has been developed to enable high-fidelity preview/predictive displays with calibrated graphics overlay on live video.

Virtual Reality: A New Learning Environment.

ERIC Educational Resources Information Center

Ferrington, Gary; Loge, Kenneth

1992-01-01

Discusses virtual reality (VR) technology and its possible uses in military training, medical education, industrial design and development, the media industry, and education. Three primary applications of VR in the learning process--visualization, simulation, and construction of virtual worlds--are described, and pedagogical and moral issues are…

Why Virtual, Why Environments? Implementing Virtual Reality Concepts in Computer-Assisted Language Learning.

ERIC Educational Resources Information Center

Schwienhorst, Klaus

2002-01-01

Discussion of computer-assisted language learning focuses on the benefits of virtual reality environments, particularly for foreign language contexts. Topics include three approaches to learner autonomy; supporting reflection, including self-awareness; supporting interaction, including collaboration; and supporting experimentation, including…

Effect of virtual reality in Parkinson's disease: a prospective observational study.

PubMed

Severiano, Maria Izabel Rodrigues; Zeigelboim, Bianca Simone; Teive, Hélio Afonso Ghizoni; Santos, Geslaine Janaína Barbosa; Fonseca, Vinícius Ribas

2018-02-01

To assess the effectiveness of balance exercises by means of virtual reality games in Parkinson's disease. Sixteen patients were submitted to anamnesis, otorhinolaryngological and vestibular examinations, as well as the Dizziness Handicap Inventory, Berg Balance Scale, SF-36 questionnaire, and the SRT, applied before and after rehabilitation with virtual reality games. Final scoring for the Dizziness Handicap Inventory and Berg Balance Scale was better after rehabilitation. The SRT showed a significant result after rehabilitation. The SF-36 showed a significant change in the functional capacity for the Tightrope Walk and Ski Slalom virtual reality games (p < 0.05), as well as in the mental health aspect of the Ski Slalom game (p < 0.05). The Dizziness Handicap Inventory and Berg Balance Scale showed significant changes in the Ski Slalom game (p < 0.05). There was evidence of clinical improvement in patients in the final assessment after virtual rehabilitation. The Tightrope Walk and Ski Slalom virtual games were shown to be the most effective for this population.

Virtual reality training for improving the skills needed for performing surgery of the ear, nose or throat.

PubMed

Piromchai, Patorn; Avery, Alex; Laopaiboon, Malinee; Kennedy, Gregor; O'Leary, Stephen

2015-09-09

Virtual reality simulation uses computer-generated imagery to present a simulated training environment for learners. This review seeks to examine whether there is evidence to support the introduction of virtual reality surgical simulation into ear, nose and throat surgical training programmes. 1. To assess whether surgeons undertaking virtual reality simulation-based training achieve surgical ('patient') outcomes that are at least as good as, or better than, those achieved through conventional training methods.2. To assess whether there is evidence from either the operating theatre, or from controlled (simulation centre-based) environments, that virtual reality-based surgical training leads to surgical skills that are comparable to, or better than, those achieved through conventional training. The Cochrane Ear, Nose and Throat Disorders Group (CENTDG) Trials Search Co-ordinator searched the CENTDG Trials Register; Central Register of Controlled Trials (CENTRAL 2015, Issue 6); PubMed; EMBASE; ERIC; CINAHL; Web of Science; ClinicalTrials.gov; ICTRP and additional sources for published and unpublished trials. The date of the search was 27 July 2015. We included all randomised controlled trials and controlled trials comparing virtual reality training and any other method of training in ear, nose or throat surgery. We used the standard methodological procedures expected by The Cochrane Collaboration. We evaluated both technical and non-technical aspects of skill competency. We included nine studies involving 210 participants. Out of these, four studies (involving 61 residents) assessed technical skills in the operating theatre (primary outcomes). Five studies (comprising 149 residents and medical students) assessed technical skills in controlled environments (secondary outcomes). The majority of the trials were at high risk of bias. We assessed the GRADE quality of evidence for most outcomes across studies as 'low'. Operating theatre environment (primary outcomes) In the operating theatre, there were no studies that examined two of three primary outcomes: real world patient outcomes and acquisition of non-technical skills. The third primary outcome (technical skills in the operating theatre) was evaluated in two studies comparing virtual reality endoscopic sinus surgery training with conventional training. In one study, psychomotor skill (which relates to operative technique or the physical co-ordination associated with instrument handling) was assessed on a 10-point scale. A second study evaluated the procedural outcome of time-on-task. The virtual reality group performance was significantly better, with a better psychomotor score (mean difference (MD) 1.66, 95% CI 0.52 to 2.81; 10-point scale) and a shorter time taken to complete the operation (MD -5.50 minutes, 95% CI -9.97 to -1.03). Controlled training environments (secondary outcomes) In a controlled environment five studies evaluated the technical skills of surgical trainees (one study) and medical students (three studies). One study was excluded from the analysis. Surgical trainees: One study (80 participants) evaluated the technical performance of surgical trainees during temporal bone surgery, where the outcome was the quality of the final dissection. There was no difference in the end-product scores between virtual reality and cadaveric temporal bone training. Medical students: Two other studies (40 participants) evaluated technical skills achieved by medical students in the temporal bone laboratory. Learners' knowledge of the flow of the operative procedure (procedural score) was better after virtual reality than conventional training (SMD 1.11, 95% CI 0.44 to 1.79). There was also a significant difference in end-product score between the virtual reality and conventional training groups (SMD 2.60, 95% CI 1.71 to 3.49). One study (17 participants) revealed that medical students acquired anatomical knowledge (on a scale of 0 to 10) better during virtual reality than during conventional training (MD 4.3, 95% CI 2.05 to 6.55). No studies in a controlled training environment assessed non-technical skills. There is limited evidence to support the inclusion of virtual reality surgical simulation into surgical training programmes, on the basis that it can allow trainees to develop technical skills that are at least as good as those achieved through conventional training. Further investigations are required to determine whether virtual reality training is associated with better real world outcomes for patients and the development of non-technical skills. Virtual reality simulation may be considered as an additional learning tool for medical students.