Effects of Vibrotactile Feedback on Human Learning of Arm Motions

PubMed Central

Bark, Karlin; Hyman, Emily; Tan, Frank; Cha, Elizabeth; Jax, Steven A.; Buxbaum, Laurel J.; Kuchenbecker, Katherine J.

2015-01-01

Tactile cues generated from lightweight, wearable actuators can help users learn new motions by providing immediate feedback on when and how to correct their movements. We present a vibrotactile motion guidance system that measures arm motions and provides vibration feedback when the user deviates from a desired trajectory. A study was conducted to test the effects of vibrotactile guidance on a subject’s ability to learn arm motions. Twenty-six subjects learned motions of varying difficulty with both visual (V), and visual and vibrotactile (VVT) feedback over the course of four days of training. After four days of rest, subjects returned to perform the motions from memory with no feedback. We found that augmenting visual feedback with vibrotactile feedback helped subjects reduce the root mean square (rms) angle error of their limb significantly while they were learning the motions, particularly for 1DOF motions. Analysis of the retention data showed no significant difference in rms angle errors between feedback conditions. PMID:25486644

Effect of visual distraction and auditory feedback on patient effort during robot-assisted movement training after stroke

PubMed Central

2011-01-01

Background Practicing arm and gait movements with robotic assistance after neurologic injury can help patients improve their movement ability, but patients sometimes reduce their effort during training in response to the assistance. Reduced effort has been hypothesized to diminish clinical outcomes of robotic training. To better understand patient slacking, we studied the role of visual distraction and auditory feedback in modulating patient effort during a common robot-assisted tracking task. Methods Fourteen participants with chronic left hemiparesis from stroke, five control participants with chronic right hemiparesis and fourteen non-impaired healthy control participants, tracked a visual target with their arms while receiving adaptive assistance from a robotic arm exoskeleton. We compared four practice conditions: the baseline tracking task alone; tracking while also performing a visual distracter task; tracking with the visual distracter and sound feedback; and tracking with sound feedback. For the distracter task, symbols were randomly displayed in the corners of the computer screen, and the participants were instructed to click a mouse button when a target symbol appeared. The sound feedback consisted of a repeating beep, with the frequency of repetition made to increase with increasing tracking error. Results Participants with stroke halved their effort and doubled their tracking error when performing the visual distracter task with their left hemiparetic arm. With sound feedback, however, these participants increased their effort and decreased their tracking error close to their baseline levels, while also performing the distracter task successfully. These effects were significantly smaller for the participants who used their non-paretic arm and for the participants without stroke. Conclusions Visual distraction decreased participants effort during a standard robot-assisted movement training task. This effect was greater for the hemiparetic arm, suggesting that the increased demands associated with controlling an affected arm make the motor system more prone to slack when distracted. Providing an alternate sensory channel for feedback, i.e., auditory feedback of tracking error, enabled the participants to simultaneously perform the tracking task and distracter task effectively. Thus, incorporating real-time auditory feedback of performance errors might improve clinical outcomes of robotic therapy systems. PMID:21513561

Reproducibility of The Abdominal and Chest Wall Position by Voluntary Breath-Hold Technique Using a Laser-Based Monitoring and Visual Feedback System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nakamura, Katsumasa; Shioyama, Yoshiyuki; Nomoto, Satoru

2007-05-01

Purpose: The voluntary breath-hold (BH) technique is a simple method to control the respiration-related motion of a tumor during irradiation. However, the abdominal and chest wall position may not be accurately reproduced using the BH technique. The purpose of this study was to examine whether visual feedback can reduce the fluctuation in wall motion during BH using a new respiratory monitoring device. Methods and Materials: We developed a laser-based BH monitoring and visual feedback system. For this study, five healthy volunteers were enrolled. The volunteers, practicing abdominal breathing, performed shallow end-expiration BH (SEBH), shallow end-inspiration BH (SIBH), and deep end-inspirationmore » BH (DIBH) with or without visual feedback. The abdominal and chest wall positions were measured at 80-ms intervals during BHs. Results: The fluctuation in the chest wall position was smaller than that of the abdominal wall position. The reproducibility of the wall position was improved by visual feedback. With a monitoring device, visual feedback reduced the mean deviation of the abdominal wall from 2.1 {+-} 1.3 mm to 1.5 {+-} 0.5 mm, 2.5 {+-} 1.9 mm to 1.1 {+-} 0.4 mm, and 6.6 {+-} 2.4 mm to 2.6 {+-} 1.4 mm in SEBH, SIBH, and DIBH, respectively. Conclusions: Volunteers can perform the BH maneuver in a highly reproducible fashion when informed about the position of the wall, although in the case of DIBH, the deviation in the wall position remained substantial.« less

The Role of Direct and Visual Force Feedback in Suturing Using a 7-DOF Dual-Arm Teleoperated System.

PubMed

Talasaz, Ali; Trejos, Ana Luisa; Patel, Rajni V

2017-01-01

The lack of haptic feedback in robotics-assisted surgery can result in tissue damage or accidental tool-tissue hits. This paper focuses on exploring the effect of haptic feedback via direct force reflection and visual presentation of force magnitudes on performance during suturing in robotics-assisted minimally invasive surgery (RAMIS). For this purpose, a haptics-enabled dual-arm master-slave teleoperation system capable of measuring tool-tissue interaction forces in all seven Degrees-of-Freedom (DOFs) was used. Two suturing tasks, tissue puncturing and knot-tightening, were chosen to assess user skills when suturing on phantom tissue. Sixteen subjects participated in the trials and their performance was evaluated from various points of view: force consistency, number of accidental hits with tissue, amount of tissue damage, quality of the suture knot, and the time required to accomplish the task. According to the results, visual force feedback was not very useful during the tissue puncturing task as different users needed different amounts of force depending on the penetration of the needle into the tissue. Direct force feedback, however, was more useful for this task to apply less force and to minimize the amount of damage to the tissue. Statistical results also reveal that both visual and direct force feedback were required for effective knot tightening: direct force feedback could reduce the number of accidental hits with the tissue and also the amount of tissue damage, while visual force feedback could help to securely tighten the suture knots and maintain force consistency among different trials/users. These results provide evidence of the importance of 7-DOF force reflection when performing complex tasks in a RAMIS setting.

Improving lower limb weight distribution asymmetry during the squat using Nintendo Wii Balance Boards and real-time feedback.

PubMed

McGough, Rian; Paterson, Kade; Bradshaw, Elizabeth J; Bryant, Adam L; Clark, Ross A

2012-01-01

Weight-bearing asymmetry (WBA) may be detrimental to performance and could increase the risk of injury; however, detecting and reducing it is difficult in a field setting. This study assessed whether a portable and simple-to-use system designed with multiple Nintendo Wii Balance Boards (NWBBs) and customized software can be used to evaluate and improve WBA. Fifteen elite Australian Rules Footballers and 32 age-matched, untrained participants were tested for measures of WBA while squatting. The NWBB and customized software provided real-time visual feedback of WBA during half of the trials. Outcome measures included the mean mass difference (MMD) between limbs, interlimb symmetry index (SI), and percentage of time spent favoring a single limb (TFSL). Significant reductions in MMD (p = 0.028) and SI (p = 0.007) with visual feedback were observed for the entire group data. Subgroup analysis revealed significant reductions in MMD (p = 0.047) and SI (p = 0.026) with visual feedback in the untrained sample; however, the reductions in the trained sample were nonsignificant. The trained group showed significantly less WBA for TFSL under both visual conditions (no feedback: p = 0.015, feedback: p = 0.017). Correlation analysis revealed that participants with high levels of WBA had the greatest response to feedback (p < 0.001, ρ = 0.557). In conclusion, WBA exists in healthy untrained adults, and these asymmetries can be reduced using real-time visual feedback provided by an NWBB-based system. Healthy, well-trained professional athletes do not possess the same magnitude of WBA. Inexpensive, portable, and widely available gaming technology may be used to evaluate and improve WBA in clinical and sporting settings.

Automated numerical simulation of biological pattern formation based on visual feedback simulation framework

PubMed Central

Sun, Mingzhu; Xu, Hui; Zeng, Xingjuan; Zhao, Xin

2017-01-01

There are various fantastic biological phenomena in biological pattern formation. Mathematical modeling using reaction-diffusion partial differential equation systems is employed to study the mechanism of pattern formation. However, model parameter selection is both difficult and time consuming. In this paper, a visual feedback simulation framework is proposed to calculate the parameters of a mathematical model automatically based on the basic principle of feedback control. In the simulation framework, the simulation results are visualized, and the image features are extracted as the system feedback. Then, the unknown model parameters are obtained by comparing the image features of the simulation image and the target biological pattern. Considering two typical applications, the visual feedback simulation framework is applied to fulfill pattern formation simulations for vascular mesenchymal cells and lung development. In the simulation framework, the spot, stripe, labyrinthine patterns of vascular mesenchymal cells, the normal branching pattern and the branching pattern lacking side branching for lung branching are obtained in a finite number of iterations. The simulation results indicate that it is easy to achieve the simulation targets, especially when the simulation patterns are sensitive to the model parameters. Moreover, this simulation framework can expand to other types of biological pattern formation. PMID:28225811

Automated numerical simulation of biological pattern formation based on visual feedback simulation framework.

PubMed

Sun, Mingzhu; Xu, Hui; Zeng, Xingjuan; Zhao, Xin

2017-01-01

There are various fantastic biological phenomena in biological pattern formation. Mathematical modeling using reaction-diffusion partial differential equation systems is employed to study the mechanism of pattern formation. However, model parameter selection is both difficult and time consuming. In this paper, a visual feedback simulation framework is proposed to calculate the parameters of a mathematical model automatically based on the basic principle of feedback control. In the simulation framework, the simulation results are visualized, and the image features are extracted as the system feedback. Then, the unknown model parameters are obtained by comparing the image features of the simulation image and the target biological pattern. Considering two typical applications, the visual feedback simulation framework is applied to fulfill pattern formation simulations for vascular mesenchymal cells and lung development. In the simulation framework, the spot, stripe, labyrinthine patterns of vascular mesenchymal cells, the normal branching pattern and the branching pattern lacking side branching for lung branching are obtained in a finite number of iterations. The simulation results indicate that it is easy to achieve the simulation targets, especially when the simulation patterns are sensitive to the model parameters. Moreover, this simulation framework can expand to other types of biological pattern formation.

Effects of kinesthetic and cutaneous stimulation during the learning of a viscous force field.

PubMed

Rosati, Giulio; Oscari, Fabio; Pacchierotti, Claudio; Prattichizzo, Domenico

2014-01-01

Haptic stimulation can help humans learn perceptual motor skills, but the precise way in which it influences the learning process has not yet been clarified. This study investigates the role of the kinesthetic and cutaneous components of haptic feedback during the learning of a viscous curl field, taking also into account the influence of visual feedback. We present the results of an experiment in which 17 subjects were asked to make reaching movements while grasping a joystick and wearing a pair of cutaneous devices. Each device was able to provide cutaneous contact forces through a moving platform. The subjects received visual feedback about joystick's position. During the experiment, the system delivered a perturbation through (1) full haptic stimulation, (2) kinesthetic stimulation alone, (3) cutaneous stimulation alone, (4) altered visual feedback, or (5) altered visual feedback plus cutaneous stimulation. Conditions 1, 2, and 3 were also tested with the cancellation of the visual feedback of position error. Results indicate that kinesthetic stimuli played a primary role during motor adaptation to the viscous field, which is a fundamental premise to motor learning and rehabilitation. On the other hand, cutaneous stimulation alone appeared not to bring significant direct or adaptation effects, although it helped in reducing direct effects when used in addition to kinesthetic stimulation. The experimental conditions with visual cancellation of position error showed slower adaptation rates, indicating that visual feedback actively contributes to the formation of internal models. However, modest learning effects were detected when the visual information was used to render the viscous field.

Effect of biased feedback on motor imagery learning in BCI-teleoperation system.

PubMed

Alimardani, Maryam; Nishio, Shuichi; Ishiguro, Hiroshi

2014-01-01

Feedback design is an important issue in motor imagery BCI systems. Regardless, to date it has not been reported how feedback presentation can optimize co-adaptation between a human brain and such systems. This paper assesses the effect of realistic visual feedback on users' BCI performance and motor imagery skills. We previously developed a tele-operation system for a pair of humanlike robotic hands and showed that BCI control of such hands along with first-person perspective visual feedback of movements can arouse a sense of embodiment in the operators. In the first stage of this study, we found that the intensity of this ownership illusion was associated with feedback presentation and subjects' performance during BCI motion control. In the second stage, we probed the effect of positive and negative feedback bias on subjects' BCI performance and motor imagery skills. Although the subject specific classifier, which was set up at the beginning of experiment, detected no significant change in the subjects' online performance, evaluation of brain activity patterns revealed that subjects' self-regulation of motor imagery features improved due to a positive bias of feedback and a possible occurrence of ownership illusion. Our findings suggest that in general training protocols for BCIs, manipulation of feedback can play an important role in the optimization of subjects' motor imagery skills.

Can You Hear That Peak? Utilization of Auditory and Visual Feedback at Peak Limb Velocity.

PubMed

Loria, Tristan; de Grosbois, John; Tremblay, Luc

2016-09-01

At rest, the central nervous system combines and integrates multisensory cues to yield an optimal percept. When engaging in action, the relative weighing of sensory modalities has been shown to be altered. Because the timing of peak velocity is the critical moment in some goal-directed movements (e.g., overarm throwing), the current study sought to test whether visual and auditory cues are optimally integrated at that specific kinematic marker when it is the critical part of the trajectory. Participants performed an upper-limb movement in which they were required to reach their peak limb velocity when the right index finger intersected a virtual target (i.e., a flinging movement). Brief auditory, visual, or audiovisual feedback (i.e., 20 ms in duration) was provided to participants at peak limb velocity. Performance was assessed primarily through the resultant position of peak limb velocity and the variability of that position. Relative to when no feedback was provided, auditory feedback significantly reduced the resultant endpoint variability of the finger position at peak limb velocity. However, no such reductions were found for the visual or audiovisual feedback conditions. Further, providing both auditory and visual cues concurrently also failed to yield the theoretically predicted improvements in endpoint variability. Overall, the central nervous system can make significant use of an auditory cue but may not optimally integrate a visual and auditory cue at peak limb velocity, when peak velocity is the critical part of the trajectory.

Brain-computer interface: changes in performance using virtual reality techniques.

PubMed

Ron-Angevin, Ricardo; Díaz-Estrella, Antonio

2009-01-09

The ability to control electroencephalographic (EEG) signals when different mental tasks are carried out would provide a method of communication for people with serious motor function problems. This system is known as a brain-computer interface (BCI). Due to the difficulty of controlling one's own EEG signals, a suitable training protocol is required to motivate subjects, as it is necessary to provide some type of visual feedback allowing subjects to see their progress. Conventional systems of feedback are based on simple visual presentations, such as a horizontal bar extension. However, virtual reality is a powerful tool with graphical possibilities to improve BCI-feedback presentation. The objective of the study is to explore the advantages of the use of feedback based on virtual reality techniques compared to conventional systems of feedback. Sixteen untrained subjects, divided into two groups, participated in the experiment. A group of subjects was trained using a BCI system, which uses conventional feedback (bar extension), and another group was trained using a BCI system, which submits subjects to a more familiar environment, such as controlling a car to avoid obstacles. The obtained results suggest that EEG behaviour can be modified via feedback presentation. Significant differences in classification error rates between both interfaces were obtained during the feedback period, confirming that an interface based on virtual reality techniques can improve the feedback control, specifically for untrained subjects.

Corticothalamic feedback enhances stimulus response precision in the visual system

PubMed Central

Andolina, Ian M.; Jones, Helen E.; Wang, Wei; Sillito, Adam M.

2007-01-01

There is a tightly coupled bidirectional interaction between visual cortex and visual thalamus [lateral geniculate nucleus (LGN)]. Using drifting sinusoidal grating stimuli, we compared the response of cells in the LGN with and without feedback from the visual cortex. Raster plots revealed a striking difference in the response pattern of cells with and without feedback. This difference was reflected in the results from computing vector sum plots and the ratio of zero harmonic to the fundamental harmonic of the fast Fourier transform (FFT) for these responses. The variability of responses assessed by using the Fano factor was also different for the two groups, with the cells without feedback showing higher variability. We examined the covariance of these measures between pairs of simultaneously recorded cells with and without feedback, and they were much more strongly positively correlated with feedback. We constructed orientation tuning curves from the central 5 ms in the raw cross-correlograms of the outputs of pairs of LGN cells, and these curves revealed much sharper tuning with feedback. We discuss the significance of these data for cortical function and suggest that the precision in stimulus-linked firing in the LGN appears as an emergent factor from the corticothalamic interaction. PMID:17237220

Real-time visual biofeedback during weight bearing improves therapy compliance in patients following lower extremity fractures.

PubMed

Raaben, Marco; Holtslag, Herman R; Leenen, Luke P H; Augustine, Robin; Blokhuis, Taco J

2018-01-01

Individuals with lower extremity fractures are often instructed on how much weight to bear on the affected extremity. Previous studies have shown limited therapy compliance in weight bearing during rehabilitation. In this study we investigated the effect of real-time visual biofeedback on weight bearing in individuals with lower extremity fractures in two conditions: full weight bearing and touch-down weight bearing. 11 participants with full weight bearing and 12 participants with touch-down weight bearing after lower extremity fractures have been measured with an ambulatory biofeedback system. The participants first walked 15m and the biofeedback system was only used to register the weight bearing. The same protocol was then repeated with real-time visual feedback during weight bearing. The participants could thereby adapt their loading to the desired level and improve therapy compliance. In participants with full weight bearing, real-time visual biofeedback resulted in a significant increase in loading from 50.9±7.51% bodyweight (BW) without feedback to 63.2±6.74%BW with feedback (P=0.0016). In participants with touch-down weight bearing, the exerted lower extremity load decreased from 16.7±9.77kg without feedback to 10.27±4.56kg with feedback (P=0.0718). More important, the variance between individual steps significantly decreased after feedback (P=0.018). Ambulatory monitoring weight bearing after lower extremity fractures showed that therapy compliance is low, both in full and touch-down weight bearing. Real-time visual biofeedback resulted in significantly higher peak loads in full weight bearing and increased accuracy of individual steps in touch-down weight bearing. Real-time visual biofeedback therefore results in improved therapy compliance after lower extremity fractures. Copyright © 2017 Elsevier B.V. All rights reserved.

Neural mechanisms of limb position estimation in the primate brain.

PubMed

Shi, Ying; Buneo, Christopher A

2011-01-01

Understanding the neural mechanisms of limb position estimation is important both for comprehending the neural control of goal directed arm movements and for developing neuroprosthetic systems designed to replace lost limb function. Here we examined the role of area 5 of the posterior parietal cortex in estimating limb position based on visual and somatic (proprioceptive, efference copy) signals. Single unit recordings were obtained as monkeys reached to visual targets presented in a semi-immersive virtual reality environment. On half of the trials animals were required to maintain their limb position at these targets while receiving both visual and non-visual feedback of their arm position, while on the other trials visual feedback was withheld. When examined individually, many area 5 neurons were tuned to the position of the limb in the workspace but very few neurons modulated their firing rates based on the presence/absence of visual feedback. At the population level however decoding of limb position was somewhat more accurate when visual feedback was provided. These findings support a role for area 5 in limb position estimation but also suggest that visual signals regarding limb position are only weakly represented in this area, and only at the population level.

Unintentional force changes in cyclical tasks performed by an abundant system: Empirical observations and a dynamical model.

PubMed

Reschechtko, Sasha; Hasanbarani, Fariba; Akulin, Vladimir M; Latash, Mark L

2017-05-14

The study explored unintentional force changes elicited by removing visual feedback during cyclical, two-finger isometric force production tasks. Subjects performed two types of tasks at 1Hz, paced by an auditory metronome. One - Force task - required cyclical changes in total force while maintaining the sharing, defined as relative contribution of a finger to total force. The other task - Share task - required cyclical changes in sharing while keeping total force unchanged. Each trial started under full visual feedback on both force and sharing; subsequently, feedback on the variable that was instructed to stay constant was frozen, and finally feedback on the other variable was also removed. In both tasks, turning off visual feedback on total force elicited a drop in the mid-point of the force cycle and an increase in the peak-to-peak force amplitude. Turning off visual feedback on sharing led to a drift of mean share toward 50:50 across both tasks. Without visual feedback there was consistent deviation of the two force time series from the in-phase pattern (typical of the Force task) and from the out-of-phase pattern (typical of the Share task). This finding is in contrast to most earlier studies that demonstrated only two stable patterns, in-phase and out-of-phase. We interpret the results as consequences of drifts of parameters in a dynamical system leading in particular to drifts in the referent finger coordinates toward their actual coordinates. The relative phase desynchronization is caused by the right-left differences in the hypothesized drift processes, consistent with the dynamic dominance hypothesis. Copyright © 2017 IBRO. Published by Elsevier Ltd. All rights reserved.

Unintentional force changes in cyclical tasks performed by an abundant system: Empirical observations and a dynamical model

PubMed Central

Reschechtko, Sasha; Hasanbarani, Fariba; Akulin, Vladimir M.; Latash, Mark L.

2017-01-01

The study explored unintentional force changes elicited by removing visual feedback during cyclical, two-finger isometric force production tasks. Subjects performed two types of tasks at 1 Hz, paced by an auditory metronome. One – Force task – required cyclical changes in total force while maintaining the sharing, defined as relative contribution of a finger to total force. The other task – Share task – required cyclical changes in sharing while keeping total force unchanged. Each trial started under full visual feedback on both force and sharing; subsequently, feedback on the variable that was instructed to stay constant was frozen, and finally feedback on the other variable was also removed. In both tasks, turning off visual feedback on total force elicited a drop in the mid-point of the force cycle and an increase in the peak-to-peak force amplitude. Turning off visual feedback on sharing led to a drift of mean share toward 50:50 across both tasks. Without visual feedback there was consistent deviation of the two force time series from the in-phase pattern (typical of the Force task) and from the out-of-phase pattern (typical of the Share task). This finding is in contrast to most earlier studies that demonstrated only two stable patterns, in-phase and out-of-phase. We interpret the results as consequences of drifts of parameters in a dynamical system leading in particular to drifts in the referent finger coordinates toward their actual coordinates. The relative phase desynchronization is caused by the right-left differences in the hypothesized drift processes, consistent with the dynamic dominance hypothesis. PMID:28344070

Vibrotactile Feedbacks System for Assisting the Physically Impaired Persons for Easy Navigation

NASA Astrophysics Data System (ADS)

Safa, M.; Geetha, G.; Elakkiya, U.; Saranya, D.

2018-04-01

NAYAN architecture is for a visually impaired person to help for navigation. As well known, all visually impaired people desperately requires special requirements even to access services like the public transportation. This prototype system is a portable device; it is so easy to carry in any conduction to travel through a familiar and unfamiliar environment. The system consists of GPS receiver and it can get NEMA data through the satellite and it is provided to user's Smartphone through Arduino board. This application uses two vibrotactile feedbacks that will be placed in the left and right shoulder for vibration feedback, which gives information about the current location. The ultrasonic sensor is used for obstacle detection which is found in front of the visually impaired person. The Bluetooth modules connected with Arduino board is to send information to the user's mobile phone which it receives from GPS.

Reducing Trunk Compensation in Stroke Survivors: A Randomized Crossover Trial Comparing Visual and Force Feedback Modalities.

PubMed

Valdés, Bulmaro Adolfo; Schneider, Andrea Nicole; Van der Loos, H F Machiel

2017-10-01

To investigate whether the compensatory trunk movements of stroke survivors observed during reaching tasks can be decreased by force and visual feedback, and to examine whether one of these feedback modalities is more efficacious than the other in reducing this compensatory tendency. Randomized crossover trial. University research laboratory. Community-dwelling older adults (N=15; 5 women; mean age, 64±11y) with hemiplegia from nontraumatic hemorrhagic or ischemic stroke (>3mo poststroke), recruited from stroke recovery groups, the research group's website, and the community. In a single session, participants received augmented feedback about their trunk compensation during a bimanual reaching task. Visual feedback (60 trials) was delivered through a computer monitor, and force feedback (60 trials) was delivered through 2 robotic devices. Primary outcome measure included change in anterior trunk displacement measured by motion tracking camera. Secondary outcomes included trunk rotation, index of curvature (measure of straightness of hands' path toward target), root mean square error of hands' movement (differences between hand position on every iteration of the program), completion time for each trial, and posttest questionnaire to evaluate users' experience and system's usability. Both visual (-45.6% [45.8 SD] change from baseline, P=.004) and force (-41.1% [46.1 SD], P=.004) feedback were effective in reducing trunk compensation. Scores on secondary outcome measures did not improve with either feedback modality. Neither feedback condition was superior. Visual and force feedback show promise as 2 modalities that could be used to decrease trunk compensation in stroke survivors during reaching tasks. It remains to be established which one of these 2 feedback modalities is more efficacious than the other as a cue to reduce compensatory trunk movement. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Analysis of Feedback in after Action Reviews

DTIC Science & Technology

1987-06-01

CONNTSM Page INTRODUCTIUN . . . . . . . . . . . . . . . . . . . A Perspective on Feedback. . ....... • • ..... • 1 Overviev of %,•urrent Research...part of their training program . The AAR is in marked contrast to the critique method of feedback which is often used in military training. The AAR...feedback is task-inherent feedback. Task-inherent feedback refers to human-machine interacting systems, e.g., computers , where in a visual tracking task

Learning feedback and feedforward control in a mirror-reversed visual environment.

PubMed

Kasuga, Shoko; Telgen, Sebastian; Ushiba, Junichi; Nozaki, Daichi; Diedrichsen, Jörn

2015-10-01

When we learn a novel task, the motor system needs to acquire both feedforward and feedback control. Currently, little is known about how the learning of these two mechanisms relate to each other. In the present study, we tested whether feedforward and feedback control need to be learned separately, or whether they are learned as common mechanism when a new control policy is acquired. Participants were trained to reach to two lateral and one central target in an environment with mirror (left-right)-reversed visual feedback. One group was allowed to make online movement corrections, whereas the other group only received visual information after the end of the movement. Learning of feedforward control was assessed by measuring the accuracy of the initial movement direction to lateral targets. Feedback control was measured in the responses to sudden visual perturbations of the cursor when reaching to the central target. Although feedforward control improved in both groups, it was significantly better when online corrections were not allowed. In contrast, feedback control only adaptively changed in participants who received online feedback and remained unchanged in the group without online corrections. Our findings suggest that when a new control policy is acquired, feedforward and feedback control are learned separately, and that there may be a trade-off in learning between feedback and feedforward controllers. Copyright © 2015 the American Physiological Society.

Learning feedback and feedforward control in a mirror-reversed visual environment

PubMed Central

Kasuga, Shoko; Telgen, Sebastian; Ushiba, Junichi; Nozaki, Daichi

2015-01-01

When we learn a novel task, the motor system needs to acquire both feedforward and feedback control. Currently, little is known about how the learning of these two mechanisms relate to each other. In the present study, we tested whether feedforward and feedback control need to be learned separately, or whether they are learned as common mechanism when a new control policy is acquired. Participants were trained to reach to two lateral and one central target in an environment with mirror (left-right)-reversed visual feedback. One group was allowed to make online movement corrections, whereas the other group only received visual information after the end of the movement. Learning of feedforward control was assessed by measuring the accuracy of the initial movement direction to lateral targets. Feedback control was measured in the responses to sudden visual perturbations of the cursor when reaching to the central target. Although feedforward control improved in both groups, it was significantly better when online corrections were not allowed. In contrast, feedback control only adaptively changed in participants who received online feedback and remained unchanged in the group without online corrections. Our findings suggest that when a new control policy is acquired, feedforward and feedback control are learned separately, and that there may be a trade-off in learning between feedback and feedforward controllers. PMID:26245313

Auditory display as feedback for a novel eye-tracking system for sterile operating room interaction.

PubMed

Black, David; Unger, Michael; Fischer, Nele; Kikinis, Ron; Hahn, Horst; Neumuth, Thomas; Glaser, Bernhard

2018-01-01

The growing number of technical systems in the operating room has increased attention on developing touchless interaction methods for sterile conditions. However, touchless interaction paradigms lack the tactile feedback found in common input devices such as mice and keyboards. We propose a novel touchless eye-tracking interaction system with auditory display as a feedback method for completing typical operating room tasks. Auditory display provides feedback concerning the selected input into the eye-tracking system as well as a confirmation of the system response. An eye-tracking system with a novel auditory display using both earcons and parameter-mapping sonification was developed to allow touchless interaction for six typical scrub nurse tasks. An evaluation with novice participants compared auditory display with visual display with respect to reaction time and a series of subjective measures. When using auditory display to substitute for the lost tactile feedback during eye-tracking interaction, participants exhibit reduced reaction time compared to using visual-only display. In addition, the auditory feedback led to lower subjective workload and higher usefulness and system acceptance ratings. Due to the absence of tactile feedback for eye-tracking and other touchless interaction methods, auditory display is shown to be a useful and necessary addition to new interaction concepts for the sterile operating room, reducing reaction times while improving subjective measures, including usefulness, user satisfaction, and cognitive workload.

Computer-aided training sensorimotor cortex functions in humans before the upper limb transplantation using virtual reality and sensory feedback.

PubMed

Kurzynski, Marek; Jaskolska, Anna; Marusiak, Jaroslaw; Wolczowski, Andrzej; Bierut, Przemyslaw; Szumowski, Lukasz; Witkowski, Jerzy; Kisiel-Sajewicz, Katarzyna

2017-08-01

One of the biggest problems of upper limb transplantation is lack of certainty as to whether a patient will be able to control voluntary movements of transplanted hands. Based on findings of the recent research on brain cortex plasticity, a premise can be drawn that mental training supported with visual and sensory feedback can cause structural and functional reorganization of the sensorimotor cortex, which leads to recovery of function associated with the control of movements performed by the upper limbs. In this study, authors - based on the above observations - propose the computer-aided training (CAT) system, which generating visual and sensory stimuli, should enhance the effectiveness of mental training applied to humans before upper limb transplantation. The basis for the concept of computer-aided training system is a virtual hand whose reaching and grasping movements the trained patient can observe on the VR headset screen (visual feedback) and whose contact with virtual objects the patient can feel as a touch (sensory feedback). The computer training system is composed of three main components: (1) the system generating 3D virtual world in which the patient sees the virtual limb from the perspective as if it were his/her own hand; (2) sensory feedback transforming information about the interaction of the virtual hand with the grasped object into mechanical vibration; (3) the therapist's panel for controlling the training course. Results of the case study demonstrate that mental training supported with visual and sensory stimuli generated by the computer system leads to a beneficial change of the brain activity related to motor control of the reaching in the patient with bilateral upper limb congenital transverse deficiency. Copyright © 2017 Elsevier Ltd. All rights reserved.

Sensory feedback add-on for upper-limb prostheses.

PubMed

Fallahian, Nader; Saeedi, Hassan; Mokhtarinia, Hamidreza; Tabatabai Ghomshe, Farhad

2017-06-01

Sensory feedback systems have been of great interest in upper-limb prosthetics. Despite tremendous research, there are no commercial modality-matched feedback systems. This article aims to introduce the first detachable and feedback add-on option that can be attached to in-use prostheses. A sensory feedback system was tested on a below-elbow myoelectric prosthesis. The aim was to have the amputee grasp fragile objects without crushing while other accidental feedback sources were blocked. A total of 8 successful trials (out of 10) showed that sensory feedback system decreased the amputee's visual dependency by improving awareness of his prosthesis. Sensory feedback system can be used either as post-fabrication (prosthetic add-on option) or para-fabrication (incorporated into prosthetic design). The use of these direct feedback systems can be explored with a current prosthesis before ordering new high-tech prosthesis. Clinical relevance This technical note introduces the first attach/detach-able sensory feedback system that can simply be added to in-use (myo)electric prosthesis, with no obligation to change prosthesis design or components.

Real-time computer-based visual feedback improves visual acuity in downbeat nystagmus - a pilot study.

PubMed

Teufel, Julian; Bardins, S; Spiegel, Rainer; Kremmyda, O; Schneider, E; Strupp, M; Kalla, R

2016-01-04

Patients with downbeat nystagmus syndrome suffer from oscillopsia, which leads to an unstable visual perception and therefore impaired visual acuity. The aim of this study was to use real-time computer-based visual feedback to compensate for the destabilizing slow phase eye movements. The patients were sitting in front of a computer screen with the head fixed on a chin rest. The eye movements were recorded by an eye tracking system (EyeSeeCam®). We tested the visual acuity with a fixed Landolt C (static) and during real-time feedback driven condition (dynamic) in gaze straight ahead and (20°) sideward gaze. In the dynamic condition, the Landolt C moved according to the slow phase eye velocity of the downbeat nystagmus. The Shapiro-Wilk test was used to test for normal distribution and one-way ANOVA for comparison. Ten patients with downbeat nystagmus were included in the study. Median age was 76 years and the median duration of symptoms was 6.3 years (SD +/- 3.1y). The mean slow phase velocity was moderate during gaze straight ahead (1.44°/s, SD +/- 1.18°/s) and increased significantly in sideward gaze (mean left 3.36°/s; right 3.58°/s). In gaze straight ahead, we found no difference between the static and feedback driven condition. In sideward gaze, visual acuity improved in five out of ten subjects during the feedback-driven condition (p = 0.043). This study provides proof of concept that non-invasive real-time computer-based visual feedback compensates for the SPV in DBN. Therefore, real-time visual feedback may be a promising aid for patients suffering from oscillopsia and impaired text reading on screen. Recent technological advances in the area of virtual reality displays might soon render this approach feasible in fully mobile settings.

Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains.

PubMed

Sklar, A E; Sarter, N B

1999-12-01

Observed breakdowns in human-machine communication can be explained, in part, by the nature of current automation feedback, which relies heavily on focal visual attention. Such feedback is not well suited for capturing attention in case of unexpected changes and events or for supporting the parallel processing of large amounts of data in complex domains. As suggested by multiple-resource theory, one possible solution to this problem is to distribute information across various sensory modalities. A simulator study was conducted to compare the effectiveness of visual, tactile, and redundant visual and tactile cues for indicating unexpected changes in the status of an automated cockpit system. Both tactile conditions resulted in higher detection rates for, and faster response times to, uncommanded mode transitions. Tactile feedback did not interfere with, nor was its effectiveness affected by, the performance of concurrent visual tasks. The observed improvement in task-sharing performance indicates that the introduction of tactile feedback is a promising avenue toward better supporting human-machine communication in event-driven, information-rich domains.

Calibration of visually guided reaching is driven by error-corrective learning and internal dynamics.

PubMed

Cheng, Sen; Sabes, Philip N

2007-04-01

The sensorimotor calibration of visually guided reaching changes on a trial-to-trial basis in response to random shifts in the visual feedback of the hand. We show that a simple linear dynamical system is sufficient to model the dynamics of this adaptive process. In this model, an internal variable represents the current state of sensorimotor calibration. Changes in this state are driven by error feedback signals, which consist of the visually perceived reach error, the artificial shift in visual feedback, or both. Subjects correct for > or =20% of the error observed on each movement, despite being unaware of the visual shift. The state of adaptation is also driven by internal dynamics, consisting of a decay back to a baseline state and a "state noise" process. State noise includes any source of variability that directly affects the state of adaptation, such as variability in sensory feedback processing, the computations that drive learning, or the maintenance of the state. This noise is accumulated in the state across trials, creating temporal correlations in the sequence of reach errors. These correlations allow us to distinguish state noise from sensorimotor performance noise, which arises independently on each trial from random fluctuations in the sensorimotor pathway. We show that these two noise sources contribute comparably to the overall magnitude of movement variability. Finally, the dynamics of adaptation measured with random feedback shifts generalizes to the case of constant feedback shifts, allowing for a direct comparison of our results with more traditional blocked-exposure experiments.

The absence or temporal offset of visual feedback does not influence adaptation to novel movement dynamics.

PubMed

McKenna, Erin; Bray, Laurence C Jayet; Zhou, Weiwei; Joiner, Wilsaan M

2017-10-01

Delays in transmitting and processing sensory information require correctly associating delayed feedback to issued motor commands for accurate error compensation. The flexibility of this alignment between motor signals and feedback has been demonstrated for movement recalibration to visual manipulations, but the alignment dependence for adapting movement dynamics is largely unknown. Here we examined the effect of visual feedback manipulations on force-field adaptation. Three subject groups used a manipulandum while experiencing a lag in the corresponding cursor motion (0, 75, or 150 ms). When the offset was applied at the start of the session (continuous condition), adaptation was not significantly different between groups. However, these similarities may be due to acclimation to the offset before motor adaptation. We tested additional subjects who experienced the same delays concurrent with the introduction of the perturbation (abrupt condition). In this case adaptation was statistically indistinguishable from the continuous condition, indicating that acclimation to feedback delay was not a factor. In addition, end-point errors were not significantly different across the delay or onset conditions, but end-point correction (e.g., deceleration duration) was influenced by the temporal offset. As an additional control, we tested a group of subjects who performed without visual feedback and found comparable movement adaptation results. These results suggest that visual feedback manipulation (absence or temporal misalignment) does not affect adaptation to novel dynamics, independent of both acclimation and perceptual awareness. These findings could have implications for modeling how the motor system adjusts to errors despite concurrent delays in sensory feedback information. NEW & NOTEWORTHY A temporal offset between movement and distorted visual feedback (e.g., visuomotor rotation) influences the subsequent motor recalibration, but the effects of this offset for altered movement dynamics are largely unknown. Here we examined the influence of 1 ) delayed and 2 ) removed visual feedback on the adaptation to novel movement dynamics. These results contribute to understanding of the control strategies that compensate for movement errors when there is a temporal separation between motion state and sensory information. Copyright © 2017 the American Physiological Society.

Development of closed-loop neural interface technology in a rat model: combining motor cortex operant conditioning with visual cortex microstimulation.

PubMed

Marzullo, Timothy Charles; Lehmkuhle, Mark J; Gage, Gregory J; Kipke, Daryl R

2010-04-01

Closed-loop neural interface technology that combines neural ensemble decoding with simultaneous electrical microstimulation feedback is hypothesized to improve deep brain stimulation techniques, neuromotor prosthetic applications, and epilepsy treatment. Here we describe our iterative results in a rat model of a sensory and motor neurophysiological feedback control system. Three rats were chronically implanted with microelectrode arrays in both the motor and visual cortices. The rats were subsequently trained over a period of weeks to modulate their motor cortex ensemble unit activity upon delivery of intra-cortical microstimulation (ICMS) of the visual cortex in order to receive a food reward. Rats were given continuous feedback via visual cortex ICMS during the response periods that was representative of the motor cortex ensemble dynamics. Analysis revealed that the feedback provided the animals with indicators of the behavioral trials. At the hardware level, this preparation provides a tractable test model for improving the technology of closed-loop neural devices.

OpinionSeer: interactive visualization of hotel customer feedback.

PubMed

Wu, Yingcai; Wei, Furu; Liu, Shixia; Au, Norman; Cui, Weiwei; Zhou, Hong; Qu, Huamin

2010-01-01

The rapid development of Web technology has resulted in an increasing number of hotel customers sharing their opinions on the hotel services. Effective visual analysis of online customer opinions is needed, as it has a significant impact on building a successful business. In this paper, we present OpinionSeer, an interactive visualization system that could visually analyze a large collection of online hotel customer reviews. The system is built on a new visualization-centric opinion mining technique that considers uncertainty for faithfully modeling and analyzing customer opinions. A new visual representation is developed to convey customer opinions by augmenting well-established scatterplots and radial visualization. To provide multiple-level exploration, we introduce subjective logic to handle and organize subjective opinions with degrees of uncertainty. Several case studies illustrate the effectiveness and usefulness of OpinionSeer on analyzing relationships among multiple data dimensions and comparing opinions of different groups. Aside from data on hotel customer feedback, OpinionSeer could also be applied to visually analyze customer opinions on other products or services.

Vibrotactile Feedback for Brain-Computer Interface Operation

PubMed Central

Cincotti, Febo; Kauhanen, Laura; Aloise, Fabio; Palomäki, Tapio; Caporusso, Nicholas; Jylänki, Pasi; Mattia, Donatella; Babiloni, Fabio; Vanacker, Gerolf; Nuttin, Marnix; Marciani, Maria Grazia; Millán, José del R.

2007-01-01

To be correctly mastered, brain-computer interfaces (BCIs) need an uninterrupted flow of feedback to the user. This feedback is usually delivered through the visual channel. Our aim was to explore the benefits of vibrotactile feedback during users' training and control of EEG-based BCI applications. A protocol for delivering vibrotactile feedback, including specific hardware and software arrangements, was specified. In three studies with 33 subjects (including 3 with spinal cord injury), we compared vibrotactile and visual feedback, addressing: (I) the feasibility of subjects' training to master their EEG rhythms using tactile feedback; (II) the compatibility of this form of feedback in presence of a visual distracter; (III) the performance in presence of a complex visual task on the same (visual) or different (tactile) sensory channel. The stimulation protocol we developed supports a general usage of the tactors; preliminary experimentations. All studies indicated that the vibrotactile channel can function as a valuable feedback modality with reliability comparable to the classical visual feedback. Advantages of using a vibrotactile feedback emerged when the visual channel was highly loaded by a complex task. In all experiments, vibrotactile feedback felt, after some training, more natural for both controls and SCI users. PMID:18354734

Randomized crossover trial of a pressure sensing visual feedback system to improve mask fitting in noninvasive ventilation.

PubMed

Brill, Anne-Kathrin; Moghal, Mohammad; Morrell, Mary J; Simonds, Anita K

2017-10-01

A good mask fit, avoiding air leaks and pressure effects on the skin are key elements for a successful noninvasive ventilation (NIV). However, delivering practical training for NIV is challenging, and it takes time to build experience and competency. This study investigated whether a pressure sensing system with real-time visual feedback improved mask fitting. During an NIV training session, 30 healthcare professionals (14 trained in mask fitting and 16 untrained) performed two mask fittings on the same healthy volunteer in a randomized order: one using standard mask-fitting procedures and one with additional visual feedback on mask pressure on the nasal bridge. Participants were required to achieve a mask fit with low mask pressure and minimal air leak (<10 L/min). Pressure exerted on the nasal bridge, perceived comfort of mask fit and staff- confidence were measured. Compared with standard mask fitting, a lower pressure was exerted on the nasal bridge using the feedback system (71.1 ± 17.6 mm Hg vs 63.2 ± 14.6 mm Hg, P < 0.001). Both untrained and trained healthcare professionals were able to reduce the pressure on the nasal bridge (74.5 ± 21.2 mm Hg vs 66.1 ± 17.4 mm Hg, P = 0.023 and 67 ± 12.1 mm Hg vs 60 ± 10.6 mm Hg, P = 0.002, respectively) using the feedback system and self-rated confidence increased in the untrained group. Real-time visual feedback using pressure sensing technology supported healthcare professionals during mask-fitting training, resulted in a lower pressure on the skin and better mask fit for the volunteer, with increased staff confidence. © 2017 Asian Pacific Society of Respirology.

Visual feedback system to reduce errors while operating roof bolting machines

PubMed Central

Steiner, Lisa J.; Burgess-Limerick, Robin; Eiter, Brianna; Porter, William; Matty, Tim

2015-01-01

Problem Operators of roof bolting machines in underground coal mines do so in confined spaces and in very close proximity to the moving equipment. Errors in the operation of these machines can have serious consequences, and the design of the equipment interface has a critical role in reducing the probability of such errors. Methods An experiment was conducted to explore coding and directional compatibility on actual roof bolting equipment and to determine the feasibility of a visual feedback system to alert operators of critical movements and to also alert other workers in close proximity to the equipment to the pending movement of the machine. The quantitative results of the study confirmed the potential for both selection errors and direction errors to be made, particularly during training. Results Subjective data confirmed a potential benefit of providing visual feedback of the intended operations and movements of the equipment. Impact This research may influence the design of these and other similar control systems to provide evidence for the use of warning systems to improve operator situational awareness. PMID:23398703

Effects of aging on pointing movements under restricted visual feedback conditions.

PubMed

Zhang, Liancun; Yang, Jiajia; Inai, Yoshinobu; Huang, Qiang; Wu, Jinglong

2015-04-01

The goal of this study was to investigate the effects of aging on pointing movements under restricted visual feedback of hand movement and target location. Fifteen young subjects and fifteen elderly subjects performed pointing movements under four restricted visual feedback conditions that included full visual feedback of hand movement and target location (FV), no visual feedback of hand movement and target location condition (NV), no visual feedback of hand movement (NM) and no visual feedback of target location (NT). This study suggested that Fitts' law applied for pointing movements of the elderly adults under different visual restriction conditions. Moreover, significant main effect of aging on movement times has been found in all four tasks. The peripheral and central changes may be the key factors for these different characteristics. Furthermore, no significant main effects of age on the mean accuracy rate under condition of restricted visual feedback were found. The present study suggested that the elderly subjects made a very similar use of the available sensory information as young subjects under restricted visual feedback conditions. In addition, during the pointing movement, information about the hand's movement was more useful than information about the target location for young and elderly subjects. Copyright © 2014 Elsevier B.V. All rights reserved.

Effects of Visual Feedback Distortion on Gait Adaptation: Comparison of Implicit Visual Distortion Versus Conscious Modulation on Retention of Motor Learning.

PubMed

Kim, Seung-Jae; Ogilvie, Mitchell; Shimabukuro, Nathan; Stewart, Trevor; Shin, Joon-Ho

2015-09-01

Visual feedback can be used during gait rehabilitation to improve the efficacy of training. We presented a paradigm called visual feedback distortion; the visual representation of step length was manipulated during treadmill walking. Our prior work demonstrated that an implicit distortion of visual feedback of step length entails an unintentional adaptive process in the subjects' spatial gait pattern. Here, we investigated whether the implicit visual feedback distortion, versus conscious correction, promotes efficient locomotor adaptation that relates to greater retention of a task. Thirteen healthy subjects were studied under two conditions: (1) we implicitly distorted the visual representation of their gait symmetry over 14 min, and (2) with help of visual feedback, subjects were told to walk on the treadmill with the intent of attaining the gait asymmetry observed during the first implicit trial. After adaptation, the visual feedback was removed while subjects continued walking normally. Over this 6-min period, retention of preserved asymmetric pattern was assessed. We found that there was a greater retention rate during the implicit distortion trial than that of the visually guided conscious modulation trial. This study highlights the important role of implicit learning in the context of gait rehabilitation by demonstrating that training with implicit visual feedback distortion may produce longer lasting effects. This suggests that using visual feedback distortion could improve the effectiveness of treadmill rehabilitation processes by influencing the retention of motor skills.

Brain-Computer Interfaces With Multi-Sensory Feedback for Stroke Rehabilitation: A Case Study.

PubMed

Irimia, Danut C; Cho, Woosang; Ortner, Rupert; Allison, Brendan Z; Ignat, Bogdan E; Edlinger, Guenter; Guger, Christoph

2017-11-01

Conventional therapies do not provide paralyzed patients with closed-loop sensorimotor integration for motor rehabilitation. This work presents the recoveriX system, a hardware and software platform that combines a motor imagery (MI)-based brain-computer interface (BCI), functional electrical stimulation (FES), and visual feedback technologies for a complete sensorimotor closed-loop therapy system for poststroke rehabilitation. The proposed system was tested on two chronic stroke patients in a clinical environment. The patients were instructed to imagine the movement of either the left or right hand in random order. During these two MI tasks, two types of feedback were provided: a bar extending to the left or right side of a monitor as visual feedback and passive hand opening stimulated from FES as proprioceptive feedback. Both types of feedback relied on the BCI classification result achieved using common spatial patterns and a linear discriminant analysis classifier. After 10 sessions of recoveriX training, one patient partially regained control of wrist extension in her paretic wrist and the other patient increased the range of middle finger movement by 1 cm. A controlled group study is planned with a new version of the recoveriX system, which will have several improvements. © 2017 International Center for Artificial Organs and Transplantation and Wiley Periodicals, Inc.

Man-systems evaluation of moving base vehicle simulation motion cues. [human acceleration perception involving visual feedback

NASA Technical Reports Server (NTRS)

Kirkpatrick, M.; Brye, R. G.

1974-01-01

A motion cue investigation program is reported that deals with human factor aspects of high fidelity vehicle simulation. General data on non-visual motion thresholds and specific threshold values are established for use as washout parameters in vehicle simulation. A general purpose similator is used to test the contradictory cue hypothesis that acceleration sensitivity is reduced during a vehicle control task involving visual feedback. The simulator provides varying acceleration levels. The method of forced choice is based on the theory of signal detect ability.

Speed but not amplitude of visual feedback exacerbates force variability in older adults.

PubMed

Kim, Changki; Yacoubi, Basma; Christou, Evangelos A

2018-06-23

Magnification of visual feedback (VF) impairs force control in older adults. In this study, we aimed to determine whether the age-associated increase in force variability with magnification of visual feedback is a consequence of increased amplitude or speed of visual feedback. Seventeen young and 18 older adults performed a constant isometric force task with the index finger at 5% of MVC. We manipulated the vertical (force gain) and horizontal (time gain) aspect of the visual feedback so participants performed the task with the following VF conditions: (1) high amplitude-fast speed; (2) low amplitude-slow speed; (3) high amplitude-slow speed. Changing the visual feedback from low amplitude-slow speed to high amplitude-fast speed increased force variability in older adults but decreased it in young adults (P < 0.01). Changing the visual feedback from low amplitude-slow speed to high amplitude-slow speed did not alter force variability in older adults (P > 0.2), but decreased it in young adults (P < 0.01). Changing the visual feedback from high amplitude-slow speed to high amplitude-fast speed increased force variability in older adults (P < 0.01) but did not alter force variability in young adults (P > 0.2). In summary, increased force variability in older adults with magnification of visual feedback was evident only when the speed of visual feedback increased. Thus, we conclude that in older adults deficits in the rate of processing visual information and not deficits in the processing of more visual information impair force control.

Design and test of a Microsoft Kinect-based system for delivering adaptive visual feedback to stroke patients during training of upper limb movement.

PubMed

Simonsen, Daniel; Popovic, Mirjana B; Spaich, Erika G; Andersen, Ole Kæseler

2017-11-01

The present paper describes the design and test of a low-cost Microsoft Kinect-based system for delivering adaptive visual feedback to stroke patients during the execution of an upper limb exercise. Eleven sub-acute stroke patients with varying degrees of upper limb function were recruited. Each subject participated in a control session (repeated twice) and a feedback session (repeated twice). In each session, the subjects were presented with a rectangular pattern displayed on a vertical mounted monitor embedded in the table in front of the patient. The subjects were asked to move a marker inside the rectangular pattern by using their most affected hand. During the feedback session, the thickness of the rectangular pattern was changed according to the performance of the subject, and the color of the marker changed according to its position, thereby guiding the subject's movements. In the control session, the thickness of the rectangular pattern and the color of the marker did not change. The results showed that the movement similarity and smoothness was higher in the feedback session than in the control session while the duration of the movement was longer. The present study showed that adaptive visual feedback delivered by use of the Kinect sensor can increase the similarity and smoothness of upper limb movement in stroke patients.

Assisting the visually impaired: obstacle detection and warning system by acoustic feedback.

PubMed

Rodríguez, Alberto; Yebes, J Javier; Alcantarilla, Pablo F; Bergasa, Luis M; Almazán, Javier; Cela, Andrés

2012-12-17

The aim of this article is focused on the design of an obstacle detection system for assisting visually impaired people. A dense disparity map is computed from the images of a stereo camera carried by the user. By using the dense disparity map, potential obstacles can be detected in 3D in indoor and outdoor scenarios. A ground plane estimation algorithm based on RANSAC plus filtering techniques allows the robust detection of the ground in every frame. A polar grid representation is proposed to account for the potential obstacles in the scene. The design is completed with acoustic feedback to assist visually impaired users while approaching obstacles. Beep sounds with different frequencies and repetitions inform the user about the presence of obstacles. Audio bone conducting technology is employed to play these sounds without interrupting the visually impaired user from hearing other important sounds from its local environment. A user study participated by four visually impaired volunteers supports the proposed system.

Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback

PubMed Central

Rodríguez, Alberto; Yebes, J. Javier; Alcantarilla, Pablo F.; Bergasa, Luis M.; Almazán, Javier; Cela, Andrés

2012-01-01

The aim of this article is focused on the design of an obstacle detection system for assisting visually impaired people. A dense disparity map is computed from the images of a stereo camera carried by the user. By using the dense disparity map, potential obstacles can be detected in 3D in indoor and outdoor scenarios. A ground plane estimation algorithm based on RANSAC plus filtering techniques allows the robust detection of the ground in every frame. A polar grid representation is proposed to account for the potential obstacles in the scene. The design is completed with acoustic feedback to assist visually impaired users while approaching obstacles. Beep sounds with different frequencies and repetitions inform the user about the presence of obstacles. Audio bone conducting technology is employed to play these sounds without interrupting the visually impaired user from hearing other important sounds from its local environment. A user study participated by four visually impaired volunteers supports the proposed system. PMID:23247413

Effect of visual feedback on brain activation during motor tasks: an FMRI study.

PubMed

Noble, Jeremy W; Eng, Janice J; Boyd, Lara A

2013-07-01

This study examined the effect of visual feedback and force level on the neural mechanisms responsible for the performance of a motor task. We used a voxel-wise fMRI approach to determine the effect of visual feedback (with and without) during a grip force task at 35% and 70% of maximum voluntary contraction. Two areas (contralateral rostral premotor cortex and putamen) displayed an interaction between force and feedback conditions. When the main effect of feedback condition was analyzed, higher activation when visual feedback was available was found in 22 of the 24 active brain areas, while the two other regions (contralateral lingual gyrus and ipsilateral precuneus) showed greater levels of activity when no visual feedback was available. The results suggest that there is a potentially confounding influence of visual feedback on brain activation during a motor task, and for some regions, this is dependent on the level of force applied.

Behavioral and neural effects of congruency of visual feedback during short-term motor learning.

PubMed

Ossmy, Ori; Mukamel, Roy

2018-05-15

Visual feedback can facilitate or interfere with movement execution. Here, we describe behavioral and neural mechanisms by which the congruency of visual feedback during physical practice of a motor skill modulates subsequent performance gains. 18 healthy subjects learned to execute rapid sequences of right hand finger movements during fMRI scans either with or without visual feedback. Feedback consisted of a real-time, movement-based display of virtual hands that was either congruent (right virtual hand movement), or incongruent (left virtual hand movement yoked to the executing right hand). At the group level, right hand performance gains following training with congruent visual feedback were significantly higher relative to training without visual feedback. Conversely, performance gains following training with incongruent visual feedback were significantly lower. Interestingly, across individual subjects these opposite effects correlated. Activation in the Supplementary Motor Area (SMA) during training corresponded to individual differences in subsequent performance gains. Furthermore, functional coupling of SMA with visual cortices predicted individual differences in behavior. Our results demonstrate that some individuals are more sensitive than others to congruency of visual feedback during short-term motor learning and that neural activation in SMA correlates with such inter-individual differences. Copyright © 2017 Elsevier Inc. All rights reserved.

Visualizing Motion Patterns in Acupuncture Manipulation.

PubMed

Lee, Ye-Seul; Jung, Won-Mo; Lee, In-Seon; Lee, Hyangsook; Park, Hi-Joon; Chae, Younbyoung

2016-07-16

Acupuncture manipulation varies widely among practitioners in clinical settings, and it is difficult to teach novice students how to perform acupuncture manipulation techniques skillfully. The Acupuncture Manipulation Education System (AMES) is an open source software system designed to enhance acupuncture manipulation skills using visual feedback. Using a phantom acupoint and motion sensor, our method for acupuncture manipulation training provides visual feedback regarding the actual movement of the student's acupuncture manipulation in addition to the optimal or intended movement, regardless of whether the manipulation skill is lifting, thrusting, or rotating. Our results show that students could enhance their manipulation skills by training using this method. This video shows the process of manufacturing phantom acupoints and discusses several issues that may require the attention of individuals interested in creating phantom acupoints or operating this system.

Stereoscopic visualization and haptic technology used to create a virtual environment for remote surgery - biomed 2011.

PubMed

Bornhoft, J M; Strabala, K W; Wortman, T D; Lehman, A C; Oleynikov, D; Farritor, S M

2011-01-01

The objective of this research is to study the effectiveness of using a stereoscopic visualization system for performing remote surgery. The use of stereoscopic vision has become common with the advent of the da Vinci® system (Intuitive, Sunnyvale CA). This system creates a virtual environment that consists of a 3-D display for visual feedback and haptic tactile feedback, together providing an intuitive environment for remote surgical applications. This study will use simple in vivo robotic surgical devices and compare the performance of surgeons using the stereoscopic interfacing system to the performance of surgeons using one dimensional monitors. The stereoscopic viewing system consists of two cameras, two monitors, and four mirrors. The cameras are mounted to a multi-functional miniature in vivo robot; and mimic the depth perception of the actual human eyes. This is done by placing the cameras at a calculated angle and distance apart. Live video streams from the left and right cameras are displayed on the left and right monitors, respectively. A system of angled mirrors allows the left and right eyes to see the video stream from the left and right monitor, respectively, creating the illusion of depth. The haptic interface consists of two PHANTOM Omni® (SensAble, Woburn Ma) controllers. These controllers measure the position and orientation of a pen-like end effector with three degrees of freedom. As the surgeon uses this interface, they see a 3-D image and feel force feedback for collision and workspace limits. The stereoscopic viewing system has been used in several surgical training tests and shows a potential improvement in depth perception and 3-D vision. The haptic system accurately gives force feedback that aids in surgery. Both have been used in non-survival animal surgeries, and have successfully been used in suturing and gallbladder removal. Bench top experiments using the interfacing system have also been conducted. A group of participants completed two different surgical training tasks using both a two dimensional visual system and the stereoscopic visual system. Results suggest that the stereoscopic visual system decreased the amount of time taken to complete the tasks. All participants also reported that the stereoscopic system was easier to utilize than the two dimensional system. Haptic controllers combined with stereoscopic vision provides for a more intuitive virtual environment. This system provides the surgeon with 3-D vision, depth perception, and the ability to receive feedback through forces applied in the haptic controller while performing surgery. These capabilities potentially enable the performance of more complex surgeries with a higher level of precision.

Assessment of feedback modalities for wearable visual aids in blind mobility

PubMed Central

Sorrentino, Paige; Bohlool, Shadi; Zhang, Carey; Arditti, Mort; Goodrich, Gregory; Weiland, James D.

2017-01-01

Sensory substitution devices engage sensory modalities other than vision to communicate information typically obtained through the sense of sight. In this paper, we examine the ability of subjects who are blind to follow simple verbal and vibrotactile commands that allow them to navigate a complex path. A total of eleven visually impaired subjects were enrolled in the study. Prototype systems were developed to deliver verbal and vibrotactile commands to allow an investigator to guide a subject through a course. Using this mode, subjects could follow commands easily and navigate significantly faster than with their cane alone (p <0.05). The feedback modes were similar with respect to the increased speed for course completion. Subjects rated usability of the feedback systems as “above average” with scores of 76.3 and 90.9 on the system usability scale. PMID:28182731

Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study.

PubMed

Gonzalez, Jose; Soma, Hirokazu; Sekine, Masashi; Yu, Wenwei

2012-06-09

Prosthetic hand users have to rely extensively on visual feedback, which seems to lead to a high conscious burden for the users, in order to manipulate their prosthetic devices. Indirect methods (electro-cutaneous, vibrotactile, auditory cues) have been used to convey information from the artificial limb to the amputee, but the usability and advantages of these feedback methods were explored mainly by looking at the performance results, not taking into account measurements of the user's mental effort, attention, and emotions. The main objective of this study was to explore the feasibility of using psycho-physiological measurements to assess cognitive effort when manipulating a robot hand with and without the usage of a sensory substitution system based on auditory feedback, and how these psycho-physiological recordings relate to temporal and grasping performance in a static setting. 10 male subjects (26+/-years old), participated in this study and were asked to come for 2 consecutive days. On the first day the experiment objective, tasks, and experiment setting was explained. Then, they completed a 30 minutes guided training. On the second day each subject was tested in 3 different modalities: Auditory Feedback only control (AF), Visual Feedback only control (VF), and Audiovisual Feedback control (AVF). For each modality they were asked to perform 10 trials. At the end of each test, the subject had to answer the NASA TLX questionnaire. Also, during the test the subject's EEG, ECG, electro-dermal activity (EDA), and respiration rate were measured. The results show that a higher mental effort is needed when the subjects rely only on their vision, and that this effort seems to be reduced when auditory feedback is added to the human-machine interaction (multimodal feedback). Furthermore, better temporal performance and better grasping performance was obtained in the audiovisual modality. The performance improvements when using auditory cues, along with vision (multimodal feedback), can be attributed to a reduced attentional demand during the task, which can be attributed to a visual "pop-out" or enhance effect. Also, the NASA TLX, the EEG's Alpha and Beta band, and the Heart Rate could be used to further evaluate sensory feedback systems in prosthetic applications.

A real-time plantar pressure feedback device for foot unloading.

PubMed

Femery, Virginie G; Moretto, Pierre G; Hespel, Jean-Michel G; Thévenon, André; Lensel, Ghislaine

2004-10-01

To develop and test a plantar pressure control device that provides both visual and auditory feedback and is suitable for correcting plantar pressure distribution patterns in persons susceptible to neuropathic foot ulceration. Pilot test. Sports medicine laboratory in a university in France. One healthy man in his mid thirties. Not applicable. Main outcome measures A device was developed based on real-time feedback, incorporating an acoustic alarm and visual signals, adjusted to a specific pressure load. Plantar pressure measured during walking, at 6 sensor locations over 27 steps under 2 different conditions: (1) natural and (2) unloaded in response to device feedback. The subject was able to modify his gait in response to the auditory and visual signals. He did not compensate for the decrease of peak pressure under the first metarsal by increasing the duration of the load shift under this area. Gait pattern modification centered on a mediolateral load shift. The auditory signal provided a warning system alerting the user to potentially harmful plantar pressures. The visual signal warned of the degree of pressure. People who have lost nociceptive perception, as in cases of diabetic neuropathy, may be able to change their walking pattern in response to the feedback provided by this device. The visual may have diagnostic value in determining plantar pressures in such patients. This pilot test indicates that further studies are warranted.

A virtual reality-based method of decreasing transmission time of visual feedback for a tele-operative robotic catheter operating system.

PubMed

Guo, Jin; Guo, Shuxiang; Tamiya, Takashi; Hirata, Hideyuki; Ishihara, Hidenori

2016-03-01

An Internet-based tele-operative robotic catheter operating system was designed for vascular interventional surgery, to afford unskilled surgeons the opportunity to learn basic catheter/guidewire skills, while allowing experienced physicians to perform surgeries cooperatively. Remote surgical procedures, limited by variable transmission times for visual feedback, have been associated with deterioration in operability and vascular wall damage during surgery. At the patient's location, the catheter shape/position was detected in real time and converted into three-dimensional coordinates in a world coordinate system. At the operation location, the catheter shape was reconstructed in a virtual-reality environment, based on the coordinates received. The data volume reduction significantly reduced visual feedback transmission times. Remote transmission experiments, conducted over inter-country distances, demonstrated the improved performance of the proposed prototype. The maximum error for the catheter shape reconstruction was 0.93 mm and the transmission time was reduced considerably. The results were positive and demonstrate the feasibility of remote surgery using conventional network infrastructures. Copyright © 2015 John Wiley & Sons, Ltd.

Novel virtual reality system integrating online self-face viewing and mirror visual feedback for stroke rehabilitation: rationale and feasibility.

PubMed

Shiri, Shimon; Feintuch, Uri; Lorber-Haddad, Adi; Moreh, Elior; Twito, Dvora; Tuchner-Arieli, Maya; Meiner, Zeev

2012-01-01

To introduce the rationale of a novel virtual reality system based on self-face viewing and mirror visual feedback, and to examine its feasibility as a rehabilitation tool for poststroke patients. A novel motion capture virtual reality system integrating online self-face viewing and mirror visual feedback has been developed for stroke rehabilitation.The system allows the replacement of the impaired arm by a virtual arm. Upon making small movements of the paretic arm, patients view themselves virtually performing healthy full-range movements. A sample of 6 patients in the acute poststroke phase received the virtual reality treatment concomitantly with conservative rehabilitation treatment. Feasibility was assessed during 10 sessions for each participant. All participants succeeded in operating the system, demonstrating its feasibility in terms of adherence and improvement in task performance. Patients' performance within the virtual environment and a set of clinical-functional measures recorded before the virtual reality treatment, at 1 week, and after 3 months indicated neurological status and general functioning improvement. These preliminary results indicate that this newly developed virtual reality system is safe and feasible. Future randomized controlled studies are required to assess whether this system has beneficial effects in terms of enhancing upper limb function and quality of life in poststroke patients.

Dual-learning systems during speech category learning

PubMed Central

Chandrasekaran, Bharath; Yi, Han-Gyol; Maddox, W. Todd

2013-01-01

Dual-systems models of visual category learning posit the existence of an explicit, hypothesis-testing ‘reflective’ system, as well as an implicit, procedural-based ‘reflexive’ system. The reflective and reflexive learning systems are competitive and neurally dissociable. Relatively little is known about the role of these domain-general learning systems in speech category learning. Given the multidimensional, redundant, and variable nature of acoustic cues in speech categories, our working hypothesis is that speech categories are learned reflexively. To this end, we examined the relative contribution of these learning systems to speech learning in adults. Native English speakers learned to categorize Mandarin tone categories over 480 trials. The training protocol involved trial-by-trial feedback and multiple talkers. Experiment 1 and 2 examined the effect of manipulating the timing (immediate vs. delayed) and information content (full vs. minimal) of feedback. Dual-systems models of visual category learning predict that delayed feedback and providing rich, informational feedback enhance reflective learning, while immediate and minimally informative feedback enhance reflexive learning. Across the two experiments, our results show feedback manipulations that targeted reflexive learning enhanced category learning success. In Experiment 3, we examined the role of trial-to-trial talker information (mixed vs. blocked presentation) on speech category learning success. We hypothesized that the mixed condition would enhance reflexive learning by not allowing an association between talker-related acoustic cues and speech categories. Our results show that the mixed talker condition led to relatively greater accuracies. Our experiments demonstrate that speech categories are optimally learned by training methods that target the reflexive learning system. PMID:24002965

Attainment and retention of force moderation following laparoscopic resection training with visual force feedback.

PubMed

Hernandez, Rafael; Onar-Thomas, Arzu; Travascio, Francesco; Asfour, Shihab

2017-11-01

Laparoscopic training with visual force feedback can lead to immediate improvements in force moderation. However, the long-term retention of this kind of learning and its potential decay are yet unclear. A laparoscopic resection task and force sensing apparatus were designed to assess the benefits of visual force feedback training. Twenty-two male university students with no previous experience in laparoscopy underwent relevant FLS proficiency training. Participants were randomly assigned to either a control or treatment group. Both groups trained on the task for 2 weeks as follows: initial baseline, sixteen training trials, and post-test immediately after. The treatment group had visual force feedback during training, whereas the control group did not. Participants then performed four weekly test trials to assess long-term retention of training. Outcomes recorded were maximum pulling and pushing forces, completion time, and rated task difficulty. Extreme maximum pulling force values were tapered throughout both the training and retention periods. Average maximum pushing forces were significantly lowered towards the end of training and during retention period. No significant decay of applied force learning was found during the 4-week retention period. Completion time and rated task difficulty were higher during training, but results indicate that the difference eventually fades during the retention period. Significant differences in aptitude across participants were found. Visual force feedback training improves on certain aspects of force moderation in a laparoscopic resection task. Results suggest that with enough training there is no significant decay of learning within the first month of the retention period. It is essential to account for differences in aptitude between individuals in this type of longitudinal research. This study shows how an inexpensive force measuring system can be used with an FLS Trainer System after some retrofitting. Surgical instructors can develop their own tasks and adjust force feedback levels accordingly.

The effect of multimodal and enriched feedback on SMR-BCI performance.

PubMed

Sollfrank, T; Ramsay, A; Perdikis, S; Williamson, J; Murray-Smith, R; Leeb, R; Millán, J D R; Kübler, A

2016-01-01

This study investigated the effect of multimodal (visual and auditory) continuous feedback with information about the uncertainty of the input signal on motor imagery based BCI performance. A liquid floating through a visualization of a funnel (funnel feedback) provided enriched visual or enriched multimodal feedback. In a between subject design 30 healthy SMR-BCI naive participants were provided with either conventional bar feedback (CB), or visual funnel feedback (UF), or multimodal (visual and auditory) funnel feedback (MF). Subjects were required to imagine left and right hand movement and were trained to control the SMR based BCI for five sessions on separate days. Feedback accuracy varied largely between participants. The MF feedback lead to a significantly better performance in session 1 as compared to the CB feedback and could significantly enhance motivation and minimize frustration in BCI use across the five training sessions. The present study demonstrates that the BCI funnel feedback allows participants to modulate sensorimotor EEG rhythms. Participants were able to control the BCI with the funnel feedback with better performance during the initial session and less frustration compared to the CB feedback. The multimodal funnel feedback provides an alternative to the conventional cursorbar feedback for training subjects to modulate their sensorimotor rhythms. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Does visual feedback during walking result in similar improvements in trunk control for young and older healthy adults?

PubMed

Anson, Eric; Rosenberg, Russell; Agada, Peter; Kiemel, Tim; Jeka, John

2013-11-26

Most current applications of visual feedback to improve postural control are limited to a fixed base of support and produce mixed results regarding improved postural control and transfer to functional tasks. Currently there are few options available to provide visual feedback regarding trunk motion while walking. We have developed a low cost platform to provide visual feedback of trunk motion during walking. Here we investigated whether augmented visual position feedback would reduce trunk movement variability in both young and older healthy adults. The subjects who participated were 10 young and 10 older adults. Subjects walked on a treadmill under conditions of visual position feedback and no feedback. The visual feedback consisted of anterior-posterior (AP) and medial-lateral (ML) position of the subject's trunk during treadmill walking. Fourier transforms of the AP and ML trunk kinematics were used to calculate power spectral densities which were integrated as frequency bins "below the gait cycle" and "gait cycle and above" for analysis purposes. Visual feedback reduced movement power at very low frequencies for lumbar and neck translation but not trunk angle in both age groups. At very low frequencies of body movement, older adults had equivalent levels of movement variability with feedback as young adults without feedback. Lower variability was specific to translational (not angular) trunk movement. Visual feedback did not affect any of the measured lower extremity gait pattern characteristics of either group, suggesting that changes were not invoked by a different gait pattern. Reduced translational variability while walking on the treadmill reflects more precise control maintaining a central position on the treadmill. Such feedback may provide an important technique to augment rehabilitation to minimize body translation while walking. Individuals with poor balance during walking may benefit from this type of training to enhance path consistency during over-ground locomotion.

Learning receptive fields using predictive feedback.

PubMed

Jehee, Janneke F M; Rothkopf, Constantin; Beck, Jeffrey M; Ballard, Dana H

2006-01-01

Previously, it was suggested that feedback connections from higher- to lower-level areas carry predictions of lower-level neural activities, whereas feedforward connections carry the residual error between the predictions and the actual lower-level activities [Rao, R.P.N., Ballard, D.H., 1999. Nature Neuroscience 2, 79-87.]. A computational model implementing the hypothesis learned simple cell receptive fields when exposed to natural images. Here, we use predictive feedback to explain tuning properties in medial superior temporal area (MST). We implement the hypothesis using a new, biologically plausible, algorithm based on matching pursuit, which retains all the features of the previous implementation, including its ability to efficiently encode input. When presented with natural images, the model developed receptive field properties as found in primary visual cortex. In addition, when exposed to visual motion input resulting from movements through space, the model learned receptive field properties resembling those in MST. These results corroborate the idea that predictive feedback is a general principle used by the visual system to efficiently encode natural input.

Computerized visual feedback: an adjunct to robotic-assisted gait training.

PubMed

Banz, Raphael; Bolliger, Marc; Colombo, Gery; Dietz, Volker; Lünenburger, Lars

2008-10-01

Robotic devices for walking rehabilitation allow new possibilities for providing performance-related information to patients during gait training. Based on motor learning principles, augmented feedback during robotic-assisted gait training might improve the rehabilitation process used to regain walking function. This report presents a method to provide visual feedback implemented in a driven gait orthosis (DGO). The purpose of the study was to compare the immediate effect on motor output in subjects during robotic-assisted gait training when they used computerized visual feedback and when they followed verbal instructions of a physical therapist. Twelve people with neurological gait disorders due to incomplete spinal cord injury participated. Subjects were instructed to walk within the DGO in 2 different conditions. They were asked to increase their motor output by following the instructions of a therapist and by observing visual feedback. In addition, the subjects' opinions about using visual feedback were investigated by a questionnaire. Computerized visual feedback and verbal instructions by the therapist were observed to result in a similar change in motor output in subjects when walking within the DGO. Subjects reported that they were more motivated and concentrated on their movements when using computerized visual feedback compared with when no form of feedback was provided. Computerized visual feedback is a valuable adjunct to robotic-assisted gait training. It represents a relevant tool to increase patients' motor output, involvement, and motivation during gait training, similar to verbal instructions by a therapist.

A Robot Hand Testbed Designed for Enhancing Embodiment and Functional Neurorehabilitation of Body Schema in Subjects with Upper Limb Impairment or Loss

PubMed Central

Hellman, Randall B.; Chang, Eric; Tanner, Justin; Helms Tillery, Stephen I.; Santos, Veronica J.

2015-01-01

Many upper limb amputees experience an incessant, post-amputation “phantom limb pain” and report that their missing limbs feel paralyzed in an uncomfortable posture. One hypothesis is that efferent commands no longer generate expected afferent signals, such as proprioceptive feedback from changes in limb configuration, and that the mismatch of motor commands and visual feedback is interpreted as pain. Non-invasive therapeutic techniques for treating phantom limb pain, such as mirror visual feedback (MVF), rely on visualizations of postural changes. Advances in neural interfaces for artificial sensory feedback now make it possible to combine MVF with a high-tech “rubber hand” illusion, in which subjects develop a sense of embodiment with a fake hand when subjected to congruent visual and somatosensory feedback. We discuss clinical benefits that could arise from the confluence of known concepts such as MVF and the rubber hand illusion, and new technologies such as neural interfaces for sensory feedback and highly sensorized robot hand testbeds, such as the “BairClaw” presented here. Our multi-articulating, anthropomorphic robot testbed can be used to study proprioceptive and tactile sensory stimuli during physical finger–object interactions. Conceived for artificial grasp, manipulation, and haptic exploration, the BairClaw could also be used for future studies on the neurorehabilitation of somatosensory disorders due to upper limb impairment or loss. A remote actuation system enables the modular control of tendon-driven hands. The artificial proprioception system enables direct measurement of joint angles and tendon tensions while temperature, vibration, and skin deformation are provided by a multimodal tactile sensor. The provision of multimodal sensory feedback that is spatiotemporally consistent with commanded actions could lead to benefits such as reduced phantom limb pain, and increased prosthesis use due to improved functionality and reduced cognitive burden. PMID:25745391

A robot hand testbed designed for enhancing embodiment and functional neurorehabilitation of body schema in subjects with upper limb impairment or loss.

PubMed

Hellman, Randall B; Chang, Eric; Tanner, Justin; Helms Tillery, Stephen I; Santos, Veronica J

2015-01-01

Many upper limb amputees experience an incessant, post-amputation "phantom limb pain" and report that their missing limbs feel paralyzed in an uncomfortable posture. One hypothesis is that efferent commands no longer generate expected afferent signals, such as proprioceptive feedback from changes in limb configuration, and that the mismatch of motor commands and visual feedback is interpreted as pain. Non-invasive therapeutic techniques for treating phantom limb pain, such as mirror visual feedback (MVF), rely on visualizations of postural changes. Advances in neural interfaces for artificial sensory feedback now make it possible to combine MVF with a high-tech "rubber hand" illusion, in which subjects develop a sense of embodiment with a fake hand when subjected to congruent visual and somatosensory feedback. We discuss clinical benefits that could arise from the confluence of known concepts such as MVF and the rubber hand illusion, and new technologies such as neural interfaces for sensory feedback and highly sensorized robot hand testbeds, such as the "BairClaw" presented here. Our multi-articulating, anthropomorphic robot testbed can be used to study proprioceptive and tactile sensory stimuli during physical finger-object interactions. Conceived for artificial grasp, manipulation, and haptic exploration, the BairClaw could also be used for future studies on the neurorehabilitation of somatosensory disorders due to upper limb impairment or loss. A remote actuation system enables the modular control of tendon-driven hands. The artificial proprioception system enables direct measurement of joint angles and tendon tensions while temperature, vibration, and skin deformation are provided by a multimodal tactile sensor. The provision of multimodal sensory feedback that is spatiotemporally consistent with commanded actions could lead to benefits such as reduced phantom limb pain, and increased prosthesis use due to improved functionality and reduced cognitive burden.

Altered figure-ground perception in monkeys with an extra-striate lesion.

PubMed

Supèr, Hans; Lamme, Victor A F

2007-11-05

The visual system binds and segments the elements of an image into coherent objects and their surroundings. Recent findings demonstrate that primary visual cortex is involved in this process of figure-ground organization. In the primary visual cortex the late part of a neural response to a stimulus correlates with figure-ground segregation and perception. Such a late onset indicates an involvement of feedback projections from higher visual areas. To investigate the possible role of feedback in figure-ground perception we removed dorsal extra-striate areas of the monkey visual cortex. The findings show that figure-ground perception is reduced when the figure is presented in the lesioned hemifield and perception is normal when the figure appeared in the intact hemifield. In conclusion, our observations show the importance for recurrent processing in visual perception.

Mirror reversal and visual rotation are learned and consolidated via separate mechanisms: recalibrating or learning de novo?

PubMed

Telgen, Sebastian; Parvin, Darius; Diedrichsen, Jörn

2014-10-08

Motor learning tasks are often classified into adaptation tasks, which involve the recalibration of an existing control policy (the mapping that determines both feedforward and feedback commands), and skill-learning tasks, requiring the acquisition of new control policies. We show here that this distinction also applies to two different visuomotor transformations during reaching in humans: Mirror-reversal (left-right reversal over a mid-sagittal axis) of visual feedback versus rotation of visual feedback around the movement origin. During mirror-reversal learning, correct movement initiation (feedforward commands) and online corrections (feedback responses) were only generated at longer latencies. The earliest responses were directed into a nonmirrored direction, even after two training sessions. In contrast, for visual rotation learning, no dependency of directional error on reaction time emerged, and fast feedback responses to visual displacements of the cursor were immediately adapted. These results suggest that the motor system acquires a new control policy for mirror reversal, which initially requires extra processing time, while it recalibrates an existing control policy for visual rotations, exploiting established fast computational processes. Importantly, memory for visual rotation decayed between sessions, whereas memory for mirror reversals showed offline gains, leading to better performance at the beginning of the second session than in the end of the first. With shifts in time-accuracy tradeoff and offline gains, mirror-reversal learning shares common features with other skill-learning tasks. We suggest that different neuronal mechanisms underlie the recalibration of an existing versus acquisition of a new control policy and that offline gains between sessions are a characteristic of latter. Copyright © 2014 the authors 0270-6474/14/3413768-12$15.00/0.

Visual display aid for orbital maneuvering - Design considerations

NASA Technical Reports Server (NTRS)

Grunwald, Arthur J.; Ellis, Stephen R.

1993-01-01

This paper describes the development of an interactive proximity operations planning system that allows on-site planning of fuel-efficient multiburn maneuvers in a potential multispacecraft environment. Although this display system most directly assists planning by providing visual feedback to aid visualization of the trajectories and constraints, its most significant features include: (1) the use of an 'inverse dynamics' algorithm that removes control nonlinearities facing the operator, and (2) a trajectory planning technique that separates, through a 'geometric spreadsheet', the normally coupled complex problems of planning orbital maneuvers and allows solution by an iterative sequence of simple independent actions. The visual feedback of trajectory shapes and operational constraints, provided by user-transparent and continuously active background computations, allows the operator to make fast, iterative design changes that rapidly converge to fuel-efficient solutions. The planning tool provides an example of operator-assisted optimization of nonlinear cost functions.

Automated Steering Control Design by Visual Feedback Approach —System Identification and Control Experiments with a Radio-Controlled Car—

NASA Astrophysics Data System (ADS)

Fujiwara, Yukihiro; Yoshii, Masakazu; Arai, Yasuhito; Adachi, Shuichi

Advanced safety vehicle(ASV)assists drivers’ manipulation to avoid trafic accidents. A variety of researches on automatic driving systems are necessary as an element of ASV. Among them, we focus on visual feedback approach in which the automatic driving system is realized by recognizing road trajectory using image information. The purpose of this paper is to examine the validity of this approach by experiments using a radio-controlled car. First, a practical image processing algorithm to recognize white lines on the road is proposed. Second, a model of the radio-controlled car is built by system identication experiments. Third, an automatic steering control system is designed based on H∞ control theory. Finally, the effectiveness of the designed control system is examined via traveling experiments.

Visual Feedback of Tongue Movement for Novel Speech Sound Learning

PubMed Central

Katz, William F.; Mehta, Sonya

2015-01-01

Pronunciation training studies have yielded important information concerning the processing of audiovisual (AV) information. Second language (L2) learners show increased reliance on bottom-up, multimodal input for speech perception (compared to monolingual individuals). However, little is known about the role of viewing one's own speech articulation processes during speech training. The current study investigated whether real-time, visual feedback for tongue movement can improve a speaker's learning of non-native speech sounds. An interactive 3D tongue visualization system based on electromagnetic articulography (EMA) was used in a speech training experiment. Native speakers of American English produced a novel speech sound (/ɖ/; a voiced, coronal, palatal stop) before, during, and after trials in which they viewed their own speech movements using the 3D model. Talkers' productions were evaluated using kinematic (tongue-tip spatial positioning) and acoustic (burst spectra) measures. The results indicated a rapid gain in accuracy associated with visual feedback training. The findings are discussed with respect to neural models for multimodal speech processing. PMID:26635571

Cortical excitability correlates with the event-related desynchronization during brain-computer interface control

NASA Astrophysics Data System (ADS)

Daly, Ian; Blanchard, Caroline; Holmes, Nicholas P.

2018-04-01

Objective. Brain-computer interfaces (BCIs) based on motor control have been suggested as tools for stroke rehabilitation. Some initial successes have been achieved with this approach, however the mechanism by which they work is not yet fully understood. One possible part of this mechanism is a, previously suggested, relationship between the strength of the event-related desynchronization (ERD), a neural correlate of motor imagination and execution, and corticospinal excitability. Additionally, a key component of BCIs used in neurorehabilitation is the provision of visual feedback to positively reinforce attempts at motor control. However, the ability of visual feedback of the ERD to modulate the activity in the motor system has not been fully explored. Approach. We investigate these relationships via transcranial magnetic stimulation delivered at different moments in the ongoing ERD related to hand contraction and relaxation during BCI control of a visual feedback bar. Main results. We identify a significant relationship between ERD strength and corticospinal excitability, and find that our visual feedback does not affect corticospinal excitability. Significance. Our results imply that efforts to promote functional recovery in stroke by targeting increases in corticospinal excitability may be aided by accounting for the time course of the ERD.

A hierarchy of timescales explains distinct effects of local inhibition of primary visual cortex and frontal eye fields

PubMed Central

Cocchi, Luca; Sale, Martin V; L Gollo, Leonardo; Bell, Peter T; Nguyen, Vinh T; Zalesky, Andrew; Breakspear, Michael; Mattingley, Jason B

2016-01-01

Within the primate visual system, areas at lower levels of the cortical hierarchy process basic visual features, whereas those at higher levels, such as the frontal eye fields (FEF), are thought to modulate sensory processes via feedback connections. Despite these functional exchanges during perception, there is little shared activity between early and late visual regions at rest. How interactions emerge between regions encompassing distinct levels of the visual hierarchy remains unknown. Here we combined neuroimaging, non-invasive cortical stimulation and computational modelling to characterize changes in functional interactions across widespread neural networks before and after local inhibition of primary visual cortex or FEF. We found that stimulation of early visual cortex selectively increased feedforward interactions with FEF and extrastriate visual areas, whereas identical stimulation of the FEF decreased feedback interactions with early visual areas. Computational modelling suggests that these opposing effects reflect a fast-slow timescale hierarchy from sensory to association areas. DOI: http://dx.doi.org/10.7554/eLife.15252.001 PMID:27596931

A hierarchy of timescales explains distinct effects of local inhibition of primary visual cortex and frontal eye fields.

PubMed

Cocchi, Luca; Sale, Martin V; L Gollo, Leonardo; Bell, Peter T; Nguyen, Vinh T; Zalesky, Andrew; Breakspear, Michael; Mattingley, Jason B

2016-09-06

Within the primate visual system, areas at lower levels of the cortical hierarchy process basic visual features, whereas those at higher levels, such as the frontal eye fields (FEF), are thought to modulate sensory processes via feedback connections. Despite these functional exchanges during perception, there is little shared activity between early and late visual regions at rest. How interactions emerge between regions encompassing distinct levels of the visual hierarchy remains unknown. Here we combined neuroimaging, non-invasive cortical stimulation and computational modelling to characterize changes in functional interactions across widespread neural networks before and after local inhibition of primary visual cortex or FEF. We found that stimulation of early visual cortex selectively increased feedforward interactions with FEF and extrastriate visual areas, whereas identical stimulation of the FEF decreased feedback interactions with early visual areas. Computational modelling suggests that these opposing effects reflect a fast-slow timescale hierarchy from sensory to association areas.

The Effects of Self-Generated Synchronous and Asynchronous Visual Speech Feedback on Overt Stuttering Frequency

ERIC Educational Resources Information Center

Snyder, Gregory J.; Hough, Monica Strauss; Blanchet, Paul; Ivy, Lennette J.; Waddell, Dwight

2009-01-01

Purpose: Relatively recent research documents that visual choral speech, which represents an externally generated form of synchronous visual speech feedback, significantly enhanced fluency in those who stutter. As a consequence, it was hypothesized that self-generated synchronous and asynchronous visual speech feedback would likewise enhance…

Role of Visual Feedback Treatment for Defective /s/ Sounds in Patients with Cleft Palate.

ERIC Educational Resources Information Center

Michi, Ken-ichi; And Others

1993-01-01

Six patients with cleft palate were provided treatment using either visual feedback for tongue placement and frication or no visual feedback. Results indicated the feedback was especially useful in the treatment of defective /s/ sounds in the patients who exhibited abnormal posterior tongue posturing during dental or alveolar sounds. (Author/DB)

Effects of Continuous Kinaesthetic Feedback Based on Tendon Vibration on Motor Imagery BCI Performance.

PubMed

Barsotti, Michele; Leonardis, Daniele; Vanello, Nicola; Bergamasco, Massimo; Frisoli, Antonio

2018-01-01

Feedback plays a crucial role for using brain computer interface systems. This paper proposes the use of vibration-evoked kinaesthetic illusions as part of a novel multisensory feedback for a motor imagery (MI)-based BCI and investigates its contributions in terms of BCI performance and electroencephalographic (EEG) correlates. sixteen subjects performed two different right arm MI-BCI sessions: with the visual feedback only and with both visual and vibration-evoked kinaesthetic feedback, conveyed by the stimulation of the biceps brachi tendon. In both conditions, the sensory feedback was driven by the MI-BCI. The rich and more natural multisensory feedback was expected to facilitate the execution of MI, and thus to improve the performance of the BCI. The EEG correlates of the proposed feedback were also investigated with and without the performing of MI. the contribution of vibration-evoked kinaesthetic feedback led to statistically higher BCI performance (Anova, F (1,14) = 18.1, p < .01) and more stable EEG event-related-desynchronization. Obtained results suggest promising application of the proposed method in neuro-rehabilitation scenarios: the advantage of an improved usability could make the MI-BCIs more applicable for those patients having difficulties in performing kinaesthetic imagery.

Develop feedback system for intelligent dynamic resource allocation to improve application performance.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gentile, Ann C.; Brandt, James M.; Tucker, Thomas

2011-09-01

This report provides documentation for the completion of the Sandia Level II milestone 'Develop feedback system for intelligent dynamic resource allocation to improve application performance'. This milestone demonstrates the use of a scalable data collection analysis and feedback system that enables insight into how an application is utilizing the hardware resources of a high performance computing (HPC) platform in a lightweight fashion. Further we demonstrate utilizing the same mechanisms used for transporting data for remote analysis and visualization to provide low latency run-time feedback to applications. The ultimate goal of this body of work is performance optimization in the facemore » of the ever increasing size and complexity of HPC systems.« less

Stimulus-dependent modulation of visual neglect in a touch-screen cancellation task.

PubMed

Keller, Ingo; Volkening, Katharina; Garbacenkaite, Ruta

2015-05-01

Patients with left-sided neglect frequently show omissions and repetitive behavior on cancellation tests. Using a touch-screen-based cancellation task, we tested how visual feedback and distracters influence the number of omissions and perseverations. Eighteen patients with left-sided visual neglect and 18 healthy controls performed four different cancellation tasks on an iPad touch screen: no feedback (the display did not change during the task), visual feedback (touched targets changed their color from black to green), visual feedback with distracters (20 distracters were evenly embedded in the display; detected targets changed their color from black to green), vanishing targets (touched targets disappeared from the screen). Except for the condition with vanishing targets, neglect patients had significantly more omissions and perseverations than healthy controls in the remaining three subtests. Both conditions providing feedback by changing the target color showed the highest number of omissions. Erasure of targets nearly diminished omissions completely. The highest rate of perseverations was observed in the no-feedback condition. The implementation of distracters led to a moderate number of perseverations. Visual feedback without distracters and vanishing targets abolished perseverations nearly completely. Visual feedback and the presence of distracters aggravated hemispatial neglect. This finding is compatible with impaired disengagement from the ipsilesional side as an important factor of visual neglect. Improvement of cancellation behavior with vanishing targets could have therapeutic implications. (c) 2015 APA, all rights reserved).

System identification and sensorimotor determinants of flight maneuvers in an insect

NASA Astrophysics Data System (ADS)

Sponberg, Simon; Hall, Robert; Roth, Eatai

Locomotor maneuvers are inherently closed-loop processes. They are generally characterized by the integration of multiple sensory inputs and adaptation or learning over time. To probe sensorimotor processing we take a system identification approach treating the underlying physiological systems as dynamic processes and altering the feedback topology in experiment and analysis. As a model system, we use agile hawk moths (Manduca sexta), which feed from real and robotic flowers while hovering in mid air. Moths rely on vision and mechanosensation to track floral targets and can do so at exceptionally low luminance levels despite hovering being a mechanically unstable behavior that requires neural feedback to stabilize. By altering the sensory environment and placing mechanical and visual signals in conflict we show a surprisingly simple linear summation of visual and mechanosensation produces a generative prediction of behavior to novel stimuli. Tracking performance is also limited more by the mechanics of flight than the magnitude of the sensory cue. A feedback systems approach to locomotor control results in new insights into how behavior emerges from the interaction of nonlinear physiological systems.

Visual-perceptual mismatch in robotic surgery.

PubMed

Abiri, Ahmad; Tao, Anna; LaRocca, Meg; Guan, Xingmin; Askari, Syed J; Bisley, James W; Dutson, Erik P; Grundfest, Warren S

2017-08-01

The principal objective of the experiment was to analyze the effects of the clutch operation of robotic surgical systems on the performance of the operator. The relative coordinate system introduced by the clutch operation can introduce a visual-perceptual mismatch which can potentially have negative impact on a surgeon's performance. We also assess the impact of the introduction of additional tactile sensory information on reducing the impact of visual-perceptual mismatch on the performance of the operator. We asked 45 novice subjects to complete peg transfers using the da Vinci IS 1200 system with grasper-mounted, normal force sensors. The task involves picking up a peg with one of the robotic arms, passing it to the other arm, and then placing it on the opposite side of the view. Subjects were divided into three groups: aligned group (no mismatch), the misaligned group (10 cm z axis mismatch), and the haptics-misaligned group (haptic feedback and z axis mismatch). Each subject performed the task five times, during which the grip force, time of completion, and number of faults were recorded. Compared to the subjects that performed the tasks using a properly aligned controller/arm configuration, subjects with a single-axis misalignment showed significantly more peg drops (p = 0.011) and longer time to completion (p < 0.001). Additionally, it was observed that addition of tactile feedback helps reduce the negative effects of visual-perceptual mismatch in some cases. Grip force data recorded from grasper-mounted sensors showed no difference between the different groups. The visual-perceptual mismatch created by the misalignment of the robotic controls relative to the robotic arms has a negative impact on the operator of a robotic surgical system. Introduction of other sensory information and haptic feedback systems can help in potentially reducing this effect.

Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study

PubMed Central

2012-01-01

Background Prosthetic hand users have to rely extensively on visual feedback, which seems to lead to a high conscious burden for the users, in order to manipulate their prosthetic devices. Indirect methods (electro-cutaneous, vibrotactile, auditory cues) have been used to convey information from the artificial limb to the amputee, but the usability and advantages of these feedback methods were explored mainly by looking at the performance results, not taking into account measurements of the user’s mental effort, attention, and emotions. The main objective of this study was to explore the feasibility of using psycho-physiological measurements to assess cognitive effort when manipulating a robot hand with and without the usage of a sensory substitution system based on auditory feedback, and how these psycho-physiological recordings relate to temporal and grasping performance in a static setting. Methods 10 male subjects (26+/-years old), participated in this study and were asked to come for 2 consecutive days. On the first day the experiment objective, tasks, and experiment setting was explained. Then, they completed a 30 minutes guided training. On the second day each subject was tested in 3 different modalities: Auditory Feedback only control (AF), Visual Feedback only control (VF), and Audiovisual Feedback control (AVF). For each modality they were asked to perform 10 trials. At the end of each test, the subject had to answer the NASA TLX questionnaire. Also, during the test the subject’s EEG, ECG, electro-dermal activity (EDA), and respiration rate were measured. Results The results show that a higher mental effort is needed when the subjects rely only on their vision, and that this effort seems to be reduced when auditory feedback is added to the human-machine interaction (multimodal feedback). Furthermore, better temporal performance and better grasping performance was obtained in the audiovisual modality. Conclusions The performance improvements when using auditory cues, along with vision (multimodal feedback), can be attributed to a reduced attentional demand during the task, which can be attributed to a visual “pop-out” or enhance effect. Also, the NASA TLX, the EEG’s Alpha and Beta band, and the Heart Rate could be used to further evaluate sensory feedback systems in prosthetic applications. PMID:22682425

Combined mirror visual and auditory feedback therapy for upper limb phantom pain: a case report

PubMed Central

2011-01-01

Introduction Phantom limb sensation and phantom limb pain is a very common issue after amputations. In recent years there has been accumulating data implicating 'mirror visual feedback' or 'mirror therapy' as helpful in the treatment of phantom limb sensation and phantom limb pain. Case presentation We present the case of a 24-year-old Caucasian man, a left upper limb amputee, treated with mirror visual feedback combined with auditory feedback with improved pain relief. Conclusion This case may suggest that auditory feedback might enhance the effectiveness of mirror visual feedback and serve as a valuable addition to the complex multi-sensory processing of body perception in patients who are amputees. PMID:21272334

Unsteady steady-states: Central causes of unintentional force drift

PubMed Central

Ambike, Satyajit; Mattos, Daniela; Zatsiorsky, Vladimir M.; Latash, Mark L.

2016-01-01

We applied the theory of synergies to analyze the processes that lead to unintentional decline in isometric fingertip force when visual feedback of the produced force is removed. We tracked the changes in hypothetical control variables involved in single fingertip force production based on the equilibrium-point hypothesis, namely, the fingertip referent coordinate (RFT) and its apparent stiffness (CFT). The system's state is defined by a point in the {RFT; CFT} space. We tested the hypothesis that, after visual feedback removal, this point (1) moves along directions leading to drop in the output fingertip force, and (2) has even greater motion along directions that leaves the force unchanged. Subjects produced a prescribed fingertip force using visual feedback, and attempted to maintain this force for 15 s after the feedback was removed. We used the “inverse piano” apparatus to apply small and smooth positional perturbations to fingers at various times after visual feedback removal. The time courses of RFT and CFT showed that force drop was mostly due to a drift in RFT towards the actual fingertip position. Three analysis techniques, namely, hyperbolic regression, surrogate data analysis, and computation of motor-equivalent and non-motor-equivalent motions, suggested strong co-variation in RFT and CFT stabilizing the force magnitude. Finally, the changes in the two hypothetical control variables {RFT; CFT} relative to their average trends also displayed covariation. On the whole the findings suggest that unintentional force drop is associated with (a) a slow drift of the referent coordinate that pulls the system towards a low-energy state, and (b) a faster synergic motion of RFT and CFT that tends to stabilize the output fingertip force about the slowly-drifting equilibrium point. PMID:27540726

Unsteady steady-states: central causes of unintentional force drift.

PubMed

Ambike, Satyajit; Mattos, Daniela; Zatsiorsky, Vladimir M; Latash, Mark L

2016-12-01

We applied the theory of synergies to analyze the processes that lead to unintentional decline in isometric fingertip force when visual feedback of the produced force is removed. We tracked the changes in hypothetical control variables involved in single fingertip force production based on the equilibrium-point hypothesis, namely the fingertip referent coordinate (R FT ) and its apparent stiffness (C FT ). The system's state is defined by a point in the {R FT ; C FT } space. We tested the hypothesis that, after visual feedback removal, this point (1) moves along directions leading to drop in the output fingertip force, and (2) has even greater motion along directions that leaves the force unchanged. Subjects produced a prescribed fingertip force using visual feedback and attempted to maintain this force for 15 s after the feedback was removed. We used the "inverse piano" apparatus to apply small and smooth positional perturbations to fingers at various times after visual feedback removal. The time courses of R FT and C FT showed that force drop was mostly due to a drift in R FT toward the actual fingertip position. Three analysis techniques, namely hyperbolic regression, surrogate data analysis, and computation of motor-equivalent and non-motor-equivalent motions, suggested strong covariation in R FT and C FT stabilizing the force magnitude. Finally, the changes in the two hypothetical control variables {R FT ; C FT } relative to their average trends also displayed covariation. On the whole, the findings suggest that unintentional force drop is associated with (a) a slow drift of the referent coordinate that pulls the system toward a low-energy state and (b) a faster synergic motion of R FT and C FT that tends to stabilize the output fingertip force about the slowly drifting equilibrium point.

Variable force and visual feedback effects on teleoperator man/machine performance

NASA Technical Reports Server (NTRS)

Massimino, Michael J.; Sheridan, Thomas B.

1989-01-01

An experimental study was conducted to determine the effects of various forms of visual and force feedback on human performance for several telemanipulation tasks. Experiments were conducted with varying frame rates and subtended visual angles, with and without force feedback.

Adaptive strategies of remote systems operators exposed to perturbed camera-viewing conditions

NASA Technical Reports Server (NTRS)

Stuart, Mark A.; Manahan, Meera K.; Bierschwale, John M.; Sampaio, Carlos E.; Legendre, A. J.

1991-01-01

This report describes a preliminary investigation of the use of perturbed visual feedback during the performance of simulated space-based remote manipulation tasks. The primary objective of this NASA evaluation was to determine to what extent operators exhibit adaptive strategies which allow them to perform these specific types of remote manipulation tasks more efficiently while exposed to perturbed visual feedback. A secondary objective of this evaluation was to establish a set of preliminary guidelines for enhancing remote manipulation performance and reducing the adverse effects. These objectives were accomplished by studying the remote manipulator performance of test subjects exposed to various perturbed camera-viewing conditions while performing a simulated space-based remote manipulation task. Statistical analysis of performance and subjective data revealed that remote manipulation performance was adversely affected by the use of perturbed visual feedback and performance tended to improve with successive trials in most perturbed viewing conditions.

Teleoperation of steerable flexible needles by combining kinesthetic and vibratory feedback.

PubMed

Pacchierotti, Claudio; Abayazid, Momen; Misra, Sarthak; Prattichizzo, Domenico

2014-01-01

Needle insertion in soft-tissue is a minimally invasive surgical procedure that demands high accuracy. In this respect, robotic systems with autonomous control algorithms have been exploited as the main tool to achieve high accuracy and reliability. However, for reasons of safety and responsibility, autonomous robotic control is often not desirable. Therefore, it is necessary to focus also on techniques enabling clinicians to directly control the motion of the surgical tools. In this work, we address that challenge and present a novel teleoperated robotic system able to steer flexible needles. The proposed system tracks the position of the needle using an ultrasound imaging system and computes needle's ideal position and orientation to reach a given target. The master haptic interface then provides the clinician with mixed kinesthetic-vibratory navigation cues to guide the needle toward the computed ideal position and orientation. Twenty participants carried out an experiment of teleoperated needle insertion into a soft-tissue phantom, considering four different experimental conditions. Participants were provided with either mixed kinesthetic-vibratory feedback or mixed kinesthetic-visual feedback. Moreover, we considered two different ways of computing ideal position and orientation of the needle: with or without set-points. Vibratory feedback was found more effective than visual feedback in conveying navigation cues, with a mean targeting error of 0.72 mm when using set-points, and of 1.10 mm without set-points.

Evaluation of stiffness feedback for hard nodule identification on a phantom silicone model

PubMed Central

Konstantinova, Jelizaveta; Xu, Guanghua; He, Bo; Aminzadeh, Vahid; Xie, Jun; Wurdemann, Helge; Althoefer, Kaspar

2017-01-01

Haptic information in robotic surgery can significantly improve clinical outcomes and help detect hard soft-tissue inclusions that indicate potential abnormalities. Visual representation of tissue stiffness information is a cost-effective technique. Meanwhile, direct force feedback, although considerably more expensive than visual representation, is an intuitive method of conveying information regarding tissue stiffness to surgeons. In this study, real-time visual stiffness feedback by sliding indentation palpation is proposed, validated, and compared with force feedback involving human subjects. In an experimental tele-manipulation environment, a dynamically updated color map depicting the stiffness of probed soft tissue is presented via a graphical interface. The force feedback is provided, aided by a master haptic device. The haptic device uses data acquired from an F/T sensor attached to the end-effector of a tele-manipulated robot. Hard nodule detection performance is evaluated for 2 modes (force feedback and visual stiffness feedback) of stiffness feedback on an artificial organ containing buried stiff nodules. From this artificial organ, a virtual-environment tissue model is generated based on sliding indentation measurements. Employing this virtual-environment tissue model, we compare the performance of human participants in distinguishing differently sized hard nodules by force feedback and visual stiffness feedback. Results indicate that the proposed distributed visual representation of tissue stiffness can be used effectively for hard nodule identification. The representation can also be used as a sufficient substitute for force feedback in tissue palpation. PMID:28248996

Evaluation of stiffness feedback for hard nodule identification on a phantom silicone model.

PubMed

Li, Min; Konstantinova, Jelizaveta; Xu, Guanghua; He, Bo; Aminzadeh, Vahid; Xie, Jun; Wurdemann, Helge; Althoefer, Kaspar

2017-01-01

Haptic information in robotic surgery can significantly improve clinical outcomes and help detect hard soft-tissue inclusions that indicate potential abnormalities. Visual representation of tissue stiffness information is a cost-effective technique. Meanwhile, direct force feedback, although considerably more expensive than visual representation, is an intuitive method of conveying information regarding tissue stiffness to surgeons. In this study, real-time visual stiffness feedback by sliding indentation palpation is proposed, validated, and compared with force feedback involving human subjects. In an experimental tele-manipulation environment, a dynamically updated color map depicting the stiffness of probed soft tissue is presented via a graphical interface. The force feedback is provided, aided by a master haptic device. The haptic device uses data acquired from an F/T sensor attached to the end-effector of a tele-manipulated robot. Hard nodule detection performance is evaluated for 2 modes (force feedback and visual stiffness feedback) of stiffness feedback on an artificial organ containing buried stiff nodules. From this artificial organ, a virtual-environment tissue model is generated based on sliding indentation measurements. Employing this virtual-environment tissue model, we compare the performance of human participants in distinguishing differently sized hard nodules by force feedback and visual stiffness feedback. Results indicate that the proposed distributed visual representation of tissue stiffness can be used effectively for hard nodule identification. The representation can also be used as a sufficient substitute for force feedback in tissue palpation.

Interaction between postural asymmetry and visual feedback effects in undisturbed upright stance control in healthy adults.

PubMed

Rougier, Patrice R; Boudrahem, Samir

2017-09-01

The technique of additional visual feedback has been shown to significantly decrease the center of pressure (CP) displacements of a standing subject. Body-weight asymmetry is known to increase postural instability due to difficulties in coordinating the reaction forces exerted under each foot and is often a cardinal feature of various neurological and traumatic diseases. To examine the possible interactions between additional visual feedback and body-weight asymmetry effects, healthy adults were recruited in a protocol with and without additional visual feedback, with different levels of body-weight asymmetry. CP displacements under each foot were recorded and used to compute the resultant CP displacements (CP Res ) and to estimate vertically projected center of gravity (CG v ) and CP Res -CG v displacements. Overall, six conditions were randomly proposed combining two factors: asymmetry with three BW percentage distributions (50/50, 35/65 and 20/80; left/right leg) and feedback (with or without additional VFB). The additional visual feedback technique principally reduces CG v displacements, whereas asymmetry increases CP Res -CG v displacements along the mediolateral axis. Some effects on plantar CP displacements were also observed, but only under the unloaded foot. Interestingly, no interaction between additional visual feedback and body-weight asymmetry was reported. These results suggest that the various postural effects that ensue from manipulating additional visual feedback parameters, shown previously in healthy subjects in various studies, could also apply independently of the level of asymmetry. Visual feedback effects could be observed in patients presenting weight-bearing asymmetries. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Effects of body lean and visual information on the equilibrium maintenance during stance.

PubMed

Duarte, Marcos; Zatsiorsky, Vladimir M

2002-09-01

Maintenance of equilibrium was tested in conditions when humans assume different leaning postures during upright standing. Subjects ( n=11) stood in 13 different body postures specified by visual center of pressure (COP) targets within their base of support (BOS). Different types of visual information were tested: continuous presentation of visual target, no vision after target presentation, and with simultaneous visual feedback of the COP. The following variables were used to describe the equilibrium maintenance: the mean of the COP position, the area of the ellipse covering the COP sway, and the resultant median frequency of the power spectral density of the COP displacement. The variability of the COP displacement, quantified by the COP area variable, increased when subjects occupied leaning postures, irrespective of the kind of visual information provided. This variability also increased when vision was removed in relation to when vision was present. Without vision, drifts in the COP data were observed which were larger for COP targets farther away from the neutral position. When COP feedback was given in addition to the visual target, the postural control system did not control stance better than in the condition with only visual information. These results indicate that the visual information is used by the postural control system at both short and long time scales.

Error correcting mechanisms during antisaccades: contribution of online control during primary saccades and offline control via secondary saccades.

PubMed

Bedi, Harleen; Goltz, Herbert C; Wong, Agnes M F; Chandrakumar, Manokaraananthan; Niechwiej-Szwedo, Ewa

2013-01-01

Errors in eye movements can be corrected during the ongoing saccade through in-flight modifications (i.e., online control), or by programming a secondary eye movement (i.e., offline control). In a reflexive saccade task, the oculomotor system can use extraretinal information (i.e., efference copy) online to correct errors in the primary saccade, and offline retinal information to generate a secondary corrective saccade. The purpose of this study was to examine the error correction mechanisms in the antisaccade task. The roles of extraretinal and retinal feedback in maintaining eye movement accuracy were investigated by presenting visual feedback at the spatial goal of the antisaccade. We found that online control for antisaccade is not affected by the presence of visual feedback; that is whether visual feedback is present or not, the duration of the deceleration interval was extended and significantly correlated with reduced antisaccade endpoint error. We postulate that the extended duration of deceleration is a feature of online control during volitional saccades to improve their endpoint accuracy. We found that secondary saccades were generated more frequently in the antisaccade task compared to the reflexive saccade task. Furthermore, we found evidence for a greater contribution from extraretinal sources of feedback in programming the secondary "corrective" saccades in the antisaccade task. Nonetheless, secondary saccades were more corrective for the remaining antisaccade amplitude error in the presence of visual feedback of the target. Taken together, our results reveal a distinctive online error control strategy through an extension of the deceleration interval in the antisaccade task. Target feedback does not improve online control, rather it improves the accuracy of secondary saccades in the antisaccade task.

Error Correcting Mechanisms during Antisaccades: Contribution of Online Control during Primary Saccades and Offline Control via Secondary Saccades

PubMed Central

Bedi, Harleen; Goltz, Herbert C.; Wong, Agnes M. F.; Chandrakumar, Manokaraananthan; Niechwiej-Szwedo, Ewa

2013-01-01

Errors in eye movements can be corrected during the ongoing saccade through in-flight modifications (i.e., online control), or by programming a secondary eye movement (i.e., offline control). In a reflexive saccade task, the oculomotor system can use extraretinal information (i.e., efference copy) online to correct errors in the primary saccade, and offline retinal information to generate a secondary corrective saccade. The purpose of this study was to examine the error correction mechanisms in the antisaccade task. The roles of extraretinal and retinal feedback in maintaining eye movement accuracy were investigated by presenting visual feedback at the spatial goal of the antisaccade. We found that online control for antisaccade is not affected by the presence of visual feedback; that is whether visual feedback is present or not, the duration of the deceleration interval was extended and significantly correlated with reduced antisaccade endpoint error. We postulate that the extended duration of deceleration is a feature of online control during volitional saccades to improve their endpoint accuracy. We found that secondary saccades were generated more frequently in the antisaccade task compared to the reflexive saccade task. Furthermore, we found evidence for a greater contribution from extraretinal sources of feedback in programming the secondary “corrective” saccades in the antisaccade task. Nonetheless, secondary saccades were more corrective for the remaining antisaccade amplitude error in the presence of visual feedback of the target. Taken together, our results reveal a distinctive online error control strategy through an extension of the deceleration interval in the antisaccade task. Target feedback does not improve online control, rather it improves the accuracy of secondary saccades in the antisaccade task. PMID:23936308

Feedback Visualization in a Grammar-Based E-Learning System for German: A Preliminary User Evaluation with the COMPASS System

ERIC Educational Resources Information Center

Harbusch, Karin; Hausdörfer, Annette

2016-01-01

COMPASS is an e-learning system that can visualize grammar errors during sentence production in German as a first or second language. Via drag-and-drop dialogues, it allows users to freely select word forms from a lexicon and to combine them into phrases and sentences. The system's core component is a natural-language generator that, for every new…

Force sensor attachable to thin fiberscopes/endoscopes utilizing high elasticity fabric.

PubMed

Watanabe, Tetsuyou; Iwai, Takanobu; Fujihira, Yoshinori; Wakako, Lina; Kagawa, Hiroyuki; Yoneyama, Takeshi

2014-03-12

An endoscope/fiberscope is a minimally invasive tool used for directly observing tissues in areas deep inside the human body where access is limited. However, this tool only yields visual information. If force feedback information were also available, endoscope/fiberscope operators would be able to detect indurated areas that are visually hard to recognize. Furthermore, obtaining such feedback information from tissues in areas where collecting visual information is a challenge would be highly useful. The major obstacle is that such force information is difficult to acquire. This paper presents a novel force sensing system that can be attached to a very thin fiberscope/endoscope. To ensure a small size, high resolution, easy sterilization, and low cost, the proposed force visualization-based system uses a highly elastic material-panty stocking fabric. The paper also presents the methodology for deriving the force value from the captured image. The system has a resolution of less than 0.01 N and sensitivity of greater than 600 pixels/N within the force range of 0-0.2 N.

The Influence of Restricted Visual Feedback on Dribbling Performance in Youth Soccer Players.

PubMed

Fransen, Job; Lovell, Thomas W J; Bennett, Kyle J M; Deprez, Dieter; Deconinck, Frederik J A; Lenoir, Matthieu; Coutts, Aaron J

2017-04-01

The aim of the current study was to examine the influence of restricted visual feedback using stroboscopic eyewear on the dribbling performance of youth soccer players. Three dribble test conditions were used in a within-subjects design to measure the effect of restricted visual feedback on soccer dribbling performance in 189 youth soccer players (age: 10-18 y) classified as fast, average or slow dribblers. The results showed that limiting visual feedback increased dribble test times across all abilities. Furthermore, the largest performance decrement between stroboscopic and full vision conditions was in fast dribblers, showing that fast dribblers were most affected by reduced visual information. This may be due to a greater dependency on visual feedback at increased speeds, which may limit the ability to maintain continuous control of the ball. These findings may have important implications for the development of soccer dribbling ability.

Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation.

PubMed

Miura, Satoshi; Matsumoto, Yuya; Kobayashi, Yo; Kawamura, Kazuya; Nakashima, Yasutaka; Fujie, Masakatsu G

2015-01-01

This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p<;0.05) when compared with moving with closed eyes or only gazing among all participants. In conclusion, the brain can activate according to visual and somatic sensory feedback agreement.

A cognitive neuroprosthetic that uses cortical stimulation for somatosensory feedback.

PubMed

Klaes, Christian; Shi, Ying; Kellis, Spencer; Minxha, Juri; Revechkis, Boris; Andersen, Richard A

2014-10-01

Present day cortical brain-machine interfaces (BMIs) have made impressive advances using decoded brain signals to control extracorporeal devices. Although BMIs are used in a closed-loop fashion, sensory feedback typically is visual only. However medical case studies have shown that the loss of somesthesis in a limb greatly reduces the agility of the limb even when visual feedback is available. To overcome this limitation, this study tested a closed-loop BMI that utilizes intracortical microstimulation to provide 'tactile' sensation to a non-human primate. Using stimulation electrodes in Brodmann area 1 of somatosensory cortex (BA1) and recording electrodes in the anterior intraparietal area, the parietal reach region and dorsal area 5 (area 5d), it was found that this form of feedback can be used in BMI tasks. Providing somatosensory feedback has the poyential to greatly improve the performance of cognitive neuroprostheses especially for fine control and object manipulation. Adding stimulation to a BMI system could therefore improve the quality of life for severely paralyzed patients.

The mechanisms of feature inheritance as predicted by a systems-level model of visual attention and decision making.

PubMed

Hamker, Fred H

2008-07-15

Feature inheritance provides evidence that properties of an invisible target stimulus can be attached to a following mask. We apply a systemslevel model of attention and decision making to explore the influence of memory and feedback connections in feature inheritance. We find that the presence of feedback loops alone is sufficient to account for feature inheritance. Although our simulations do not cover all experimental variations and focus only on the general principle, our result appears of specific interest since the model was designed for a completely different purpose than to explain feature inheritance. We suggest that feedback is an important property in visual perception and provide a description of its mechanism and its role in perception.

The Integrated Virtual Environment Rehabilitation Treadmill System

PubMed Central

Feasel, Jeff; Whitton, Mary C.; Kassler, Laura; Brooks, Frederick P.; Lewek, Michael D.

2015-01-01

Slow gait speed and interlimb asymmetry are prevalent in a variety of disorders. Current approaches to locomotor retraining emphasize the need for appropriate feedback during intensive, task-specific practice. This paper describes the design and feasibility testing of the integrated virtual environment rehabilitation treadmill (IVERT) system intended to provide real-time, intuitive feedback regarding gait speed and asymmetry during training. The IVERT system integrates an instrumented, split-belt treadmill with a front-projection, immersive virtual environment. The novel adaptive control system uses only ground reaction force data from the treadmill to continuously update the speeds of the two treadmill belts independently, as well as to control the speed and heading in the virtual environment in real time. Feedback regarding gait asymmetry is presented 1) visually as walking a curved trajectory through the virtual environment and 2) proprioceptively in the form of different belt speeds on the split-belt treadmill. A feasibility study involving five individuals with asymmetric gait found that these individuals could effectively control the speed of locomotion and perceive gait asymmetry during the training session. Although minimal changes in overground gait symmetry were observed immediately following a single training session, further studies should be done to determine the IVERT’s potential as a tool for rehabilitation of asymmetric gait by providing patients with congruent visual and proprioceptive feedback. PMID:21652279

Using visuo-kinetic virtual reality to induce illusory spinal movement: the MoOVi Illusion

PubMed Central

Smith, Ross T.; Hunter, Estin V.; Davis, Miles G.; Sterling, Michele; Moseley, G. Lorimer

2017-01-01

Background Illusions that alter perception of the body provide novel opportunities to target brain-based contributions to problems such as persistent pain. One example of this, mirror therapy, uses vision to augment perceived movement of a painful limb to treat pain. Since mirrors can’t be used to induce augmented neck or other spinal movement, we aimed to test whether such an illusion could be achieved using virtual reality, in advance of testing its potential therapeutic benefit. We hypothesised that perceived head rotation would depend on visually suggested movement. Method In a within-subjects repeated measures experiment, 24 healthy volunteers performed neck movements to 50o of rotation, while a virtual reality system delivered corresponding visual feedback that was offset by a factor of 50%–200%—the Motor Offset Visual Illusion (MoOVi)—thus simulating more or less movement than that actually occurring. At 50o of real-world head rotation, participants pointed in the direction that they perceived they were facing. The discrepancy between actual and perceived direction was measured and compared between conditions. The impact of including multisensory (auditory and visual) feedback, the presence of a virtual body reference, and the use of 360o immersive virtual reality with and without three-dimensional properties, was also investigated. Results Perception of head movement was dependent on visual-kinaesthetic feedback (p = 0.001, partial eta squared = 0.17). That is, altered visual feedback caused a kinaesthetic drift in the direction of the visually suggested movement. The magnitude of the drift was not moderated by secondary variables such as the addition of illusory auditory feedback, the presence of a virtual body reference, or three-dimensionality of the scene. Discussion Virtual reality can be used to augment perceived movement and body position, such that one can perform a small movement, yet perceive a large one. The MoOVi technique tested here has clear potential for assessment and therapy of people with spinal pain. PMID:28243537

Using visuo-kinetic virtual reality to induce illusory spinal movement: the MoOVi Illusion.

PubMed

Harvie, Daniel S; Smith, Ross T; Hunter, Estin V; Davis, Miles G; Sterling, Michele; Moseley, G Lorimer

2017-01-01

Illusions that alter perception of the body provide novel opportunities to target brain-based contributions to problems such as persistent pain. One example of this, mirror therapy, uses vision to augment perceived movement of a painful limb to treat pain. Since mirrors can't be used to induce augmented neck or other spinal movement, we aimed to test whether such an illusion could be achieved using virtual reality, in advance of testing its potential therapeutic benefit. We hypothesised that perceived head rotation would depend on visually suggested movement. In a within-subjects repeated measures experiment, 24 healthy volunteers performed neck movements to 50 o of rotation, while a virtual reality system delivered corresponding visual feedback that was offset by a factor of 50%-200%-the Motor Offset Visual Illusion (MoOVi)-thus simulating more or less movement than that actually occurring. At 50 o of real-world head rotation, participants pointed in the direction that they perceived they were facing. The discrepancy between actual and perceived direction was measured and compared between conditions. The impact of including multisensory (auditory and visual) feedback, the presence of a virtual body reference, and the use of 360 o immersive virtual reality with and without three-dimensional properties, was also investigated. Perception of head movement was dependent on visual-kinaesthetic feedback ( p  = 0.001, partial eta squared = 0.17). That is, altered visual feedback caused a kinaesthetic drift in the direction of the visually suggested movement. The magnitude of the drift was not moderated by secondary variables such as the addition of illusory auditory feedback, the presence of a virtual body reference, or three-dimensionality of the scene. Virtual reality can be used to augment perceived movement and body position, such that one can perform a small movement, yet perceive a large one. The MoOVi technique tested here has clear potential for assessment and therapy of people with spinal pain.

Adaptation of handwriting size under distorted visual feedback in patients with Parkinson's disease and elderly and young controls

PubMed Central

Teulings, H; Contreras-Vidal, J; Stelmach, G; Adler, C

2002-01-01

Objective: The ability to use visual feedback to control handwriting size was compared in patients with Parkinson's disease (PD), elderly people, and young adults to better understand factors playing a part in parkinsonian micrographia. Methods: The participants wrote sequences of eight cursive l loops with visual target sizes of 0.5 and 2 cm on a flat panel display digitiser which both recorded and displayed the pen movements. In the pre-exposure and postexposure conditions, the display digitiser showed the actual pen trace in real time and real size. In the distortion exposure conditions, the gain of the vertical dimension of the visual feedback was either reduced to 70% or enlarged to 140%. Results: The young controls showed a gradual visuomotor adaptation that compensated for the visual feedback distortions during the exposure conditions. They also showed significant after effects during the postexposure conditions. The elderly controls marginally corrected for the size distortions and showed small after effects. The patients with PD, however, showed no trial by trial adaptations or after effects but instead, a progressive amplification of the distortion effect in each individual trial. Conclusion: The young controls used visual feedback to update their visuomotor map. The elderly controls seemed to make little use of visual feedback. The patients with Parkinson's disease rely on the visual feedback of previous or of ongoing strokes to programme subsequent strokes. This recursive feedback may play a part in the progressive reductions in handwriting size found in parkinsonian micrographia. PMID:11861687

Effects of interactive visual feedback training on post-stroke pusher syndrome: a pilot randomized controlled study.

PubMed

Yang, Yea-Ru; Chen, Yi-Hua; Chang, Heng-Chih; Chan, Rai-Chi; Wei, Shun-Hwa; Wang, Ray-Yau

2015-10-01

We investigated the effects of a computer-generated interactive visual feedback training program on the recovery from pusher syndrome in stroke patients. Assessor-blinded, pilot randomized controlled study. A total of 12 stroke patients with pusher syndrome were randomly assigned to either the experimental group (N = 7, computer-generated interactive visual feedback training) or control group (N = 5, mirror visual feedback training). The scale for contraversive pushing for severity of pusher syndrome, the Berg Balance Scale for balance performance, and the Fugl-Meyer assessment scale for motor control were the outcome measures. Patients were assessed pre- and posttraining. A comparison of pre- and posttraining assessment results revealed that both training programs led to the following significant changes: decreased severity of pusher syndrome scores (decreases of 4.0 ± 1.1 and 1.4 ± 1.0 in the experimental and control groups, respectively); improved balance scores (increases of 14.7 ± 4.3 and 7.2 ± 1.6 in the experimental and control groups, respectively); and higher scores for lower extremity motor control (increases of 8.4 ± 2.2 and 5.6 ± 3.3 in the experimental and control groups, respectively). Furthermore, the computer-generated interactive visual feedback training program produced significantly better outcomes in the improvement of pusher syndrome (p < 0.01) and balance (p < 0.05) compared with the mirror visual feedback training program. Although both training programs were beneficial, the computer-generated interactive visual feedback training program more effectively aided recovery from pusher syndrome compared with mirror visual feedback training. © The Author(s) 2014.

Seeing the Errors You Feel Enhances Locomotor Performance but Not Learning.

PubMed

Roemmich, Ryan T; Long, Andrew W; Bastian, Amy J

2016-10-24

In human motor learning, it is thought that the more information we have about our errors, the faster we learn. Here, we show that additional error information can lead to improved motor performance without any concomitant improvement in learning. We studied split-belt treadmill walking that drives people to learn a new gait pattern using sensory prediction errors detected by proprioceptive feedback. When we also provided visual error feedback, participants acquired the new walking pattern far more rapidly and showed accelerated restoration of the normal walking pattern during washout. However, when the visual error feedback was removed during either learning or washout, errors reappeared with performance immediately returning to the level expected based on proprioceptive learning alone. These findings support a model with two mechanisms: a dual-rate adaptation process that learns invariantly from sensory prediction error detected by proprioception and a visual-feedback-dependent process that monitors learning and corrects residual errors but shows no learning itself. We show that our voluntary correction model accurately predicted behavior in multiple situations where visual feedback was used to change acquisition of new walking patterns while the underlying learning was unaffected. The computational and behavioral framework proposed here suggests that parallel learning and error correction systems allow us to rapidly satisfy task demands without necessarily committing to learning, as the relative permanence of learning may be inappropriate or inefficient when facing environments that are liable to change. Copyright © 2016 Elsevier Ltd. All rights reserved.

Effect of Animated Graphic Annotations and Immediate Visual Feedback in Aiding Japanese Pronunciation Learning: A Comparative Study

ERIC Educational Resources Information Center

Hew, Soon-Hin; Ohki, Mitsuru

2004-01-01

This study examines the effectiveness of imagery and electronic visual feedback in facilitating students' acquisition of Japanese pronunciation skills. The independent variables, animated graphic annotation (AGA) and immediate visual feedback (IVF) were integrated into a Japanese computer-assisted language learning (JCALL) program focused on the…

Improvements in force variability and structure from vision- to memory-guided submaximal isometric knee extension in subacute stroke.

PubMed

Chow, John W; Stokic, Dobrivoje S

2018-03-01

We examined changes in variability, accuracy, frequency composition, and temporal regularity of force signal from vision-guided to memory-guided force-matching tasks in 17 subacute stroke and 17 age-matched healthy subjects. Subjects performed a unilateral isometric knee extension at 10, 30, and 50% of peak torque [maximum voluntary contraction (MVC)] for 10 s (3 trials each). Visual feedback was removed at the 5-s mark in the first two trials (feedback withdrawal), and 30 s after the second trial the subjects were asked to produce the target force without visual feedback (force recall). The coefficient of variation and constant error were used to quantify force variability and accuracy. Force structure was assessed by the median frequency, relative spectral power in the 0-3-Hz band, and sample entropy of the force signal. At 10% MVC, the force signal in subacute stroke subjects became steadier, more broadband, and temporally more irregular after the withdrawal of visual feedback, with progressively larger error at higher contraction levels. Also, the lack of modulation in the spectral frequency at higher force levels with visual feedback persisted in both the withdrawal and recall conditions. In terms of changes from the visual feedback condition, the feedback withdrawal produced a greater difference between the paretic, nonparetic, and control legs than the force recall. The overall results suggest improvements in force variability and structure from vision- to memory-guided force control in subacute stroke despite decreased accuracy. Different sensory-motor memory retrieval mechanisms seem to be involved in the feedback withdrawal and force recall conditions, which deserves further study. NEW & NOTEWORTHY We demonstrate that in the subacute phase of stroke, force signals during a low-level isometric knee extension become steadier, more broadband in spectral power, and more complex after removal of visual feedback. Larger force errors are produced when recalling target forces than immediately after withdrawing visual feedback. Although visual feedback offers better accuracy, it worsens force variability and structure in subacute stroke. The feedback withdrawal and force recall conditions seem to involve different memory retrieval mechanisms.

Selective effects of 5-HT2C receptor modulation on performance of a novel valence-probe visual discrimination task and probabilistic reversal learning in mice.

PubMed

Phillips, Benjamin U; Dewan, Sigma; Nilsson, Simon R O; Robbins, Trevor W; Heath, Christopher J; Saksida, Lisa M; Bussey, Timothy J; Alsiö, Johan

2018-04-22

Dysregulation of the serotonin (5-HT) system is a pathophysiological component in major depressive disorder (MDD), a condition closely associated with abnormal emotional responsivity to positive and negative feedback. However, the precise mechanism through which 5-HT tone biases feedback responsivity remains unclear. 5-HT2C receptors (5-HT2CRs) are closely linked with aspects of depressive symptomatology, including abnormalities in reinforcement processes and response to stress. Thus, we aimed to determine the impact of 5-HT2CR function on response to feedback in biased reinforcement learning. We used two touchscreen assays designed to assess the impact of positive and negative feedback on probabilistic reinforcement in mice, including a novel valence-probe visual discrimination (VPVD) and a probabilistic reversal learning procedure (PRL). Systemic administration of a 5-HT2CR agonist and antagonist resulted in selective changes in the balance of feedback sensitivity bias on these tasks. Specifically, on VPVD, SB 242084, the 5-HT2CR antagonist, impaired acquisition of a discrimination dependent on appropriate integration of positive and negative feedback. On PRL, SB 242084 at 1 mg/kg resulted in changes in behaviour consistent with reduced sensitivity to positive feedback. In contrast, WAY 163909, the 5-HT2CR agonist, resulted in changes associated with increased sensitivity to positive feedback and decreased sensitivity to negative feedback. These results suggest that 5-HT2CRs tightly regulate feedback sensitivity bias in mice with consequent effects on learning and cognitive flexibility and specify a framework for the influence of 5-HT2CRs on sensitivity to reinforcement.

The Role of Audio-Visual Feedback in a Thought-Based Control of a Humanoid Robot: A BCI Study in Healthy and Spinal Cord Injured People.

PubMed

Tidoni, Emmanuele; Gergondet, Pierre; Fusco, Gabriele; Kheddar, Abderrahmane; Aglioti, Salvatore M

2017-06-01

The efficient control of our body and successful interaction with the environment are possible through the integration of multisensory information. Brain-computer interface (BCI) may allow people with sensorimotor disorders to actively interact in the world. In this study, visual information was paired with auditory feedback to improve the BCI control of a humanoid surrogate. Healthy and spinal cord injured (SCI) people were asked to embody a humanoid robot and complete a pick-and-place task by means of a visual evoked potentials BCI system. Participants observed the remote environment from the robot's perspective through a head mounted display. Human-footsteps and computer-beep sounds were used as synchronous/asynchronous auditory feedback. Healthy participants achieved better placing accuracy when listening to human footstep sounds relative to a computer-generated sound. SCI people demonstrated more difficulty in steering the robot during asynchronous auditory feedback conditions. Importantly, subjective reports highlighted that the BCI mask overlaying the display did not limit the observation of the scenario and the feeling of being in control of the robot. Overall, the data seem to suggest that sensorimotor-related information may improve the control of external devices. Further studies are required to understand how the contribution of residual sensory channels could improve the reliability of BCI systems.

Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning.

PubMed

Sigrist, Roland; Rauter, Georg; Marchal-Crespo, Laura; Riener, Robert; Wolf, Peter

2015-03-01

Concurrent augmented feedback has been shown to be less effective for learning simple motor tasks than for complex tasks. However, as mostly artificial tasks have been investigated, transfer of results to tasks in sports and rehabilitation remains unknown. Therefore, in this study, the effect of different concurrent feedback was evaluated in trunk-arm rowing. It was then investigated whether multimodal audiovisual and visuohaptic feedback are more effective for learning than visual feedback only. Naïve subjects (N = 24) trained in three groups on a highly realistic virtual reality-based rowing simulator. In the visual feedback group, the subject's oar was superimposed to the target oar, which continuously became more transparent when the deviation between the oars decreased. Moreover, a trace of the subject's trajectory emerged if deviations exceeded a threshold. The audiovisual feedback group trained with oar movement sonification in addition to visual feedback to facilitate learning of the velocity profile. In the visuohaptic group, the oar movement was inhibited by path deviation-dependent braking forces to enhance learning of spatial aspects. All groups significantly decreased the spatial error (tendency in visual group) and velocity error from baseline to the retention tests. Audiovisual feedback fostered learning of the velocity profile significantly more than visuohaptic feedback. The study revealed that well-designed concurrent feedback fosters complex task learning, especially if the advantages of different modalities are exploited. Further studies should analyze the impact of within-feedback design parameters and the transferability of the results to other tasks in sports and rehabilitation.

Surgical evaluation of a novel tethered robotic capsule endoscope using micro-patterned treads.

PubMed

Sliker, Levin J; Kern, Madalyn D; Schoen, Jonathan A; Rentschler, Mark E

2012-10-01

The state-of-the-art technology for gastrointestinal (GI) tract exploration is a capsule endoscope (CE). Capsule endoscopes are pill-sized devices that provide visual feedback of the GI tract as they move passively through the patient. These passive devices could benefit from a mobility system enabling maneuverability and controllability. Potential benefits of a tethered robotic capsule endoscope (tRCE) include faster travel speeds, reaction force generation for biopsy, and decreased capsule retention. In this work, a tethered CE is developed with an active locomotion system for mobility within a collapsed lumen. Micro-patterned polydimethylsiloxane (PDMS) treads are implemented onto a custom capsule housing as a mobility method. The tRCE housing contains a direct current (DC) motor and gear train to drive the treads, a video camera for visual feedback, and two light sources (infrared and visible) for illumination. The device was placed within the insufflated abdomen of a live anesthetized pig to evaluate mobility performance on a planar tissue surface, as well as within the cecum to evaluate mobility performance in a collapsed lumen. The tRCE was capable of forward and reverse mobility for both planar and collapsed lumen tissue environments. Also, using an onboard visual system, the tRCE was capable of demonstrating visual feedback within an insufflated, anesthetized porcine abdomen. Proof-of-concept in vivo tRCE mobility using micro-patterned PDMS treads was shown. This suggests that a similar method could be implemented in future smaller, faster, and untethered RCEs.

Virtual reality training and assessment in laparoscopic rectum surgery.

PubMed

Pan, Jun J; Chang, Jian; Yang, Xiaosong; Liang, Hui; Zhang, Jian J; Qureshi, Tahseen; Howell, Robert; Hickish, Tamas

2015-06-01

Virtual-reality (VR) based simulation techniques offer an efficient and low cost alternative to conventional surgery training. This article describes a VR training and assessment system in laparoscopic rectum surgery. To give a realistic visual performance of interaction between membrane tissue and surgery tools, a generalized cylinder based collision detection and a multi-layer mass-spring model are presented. A dynamic assessment model is also designed for hierarchy training evaluation. With this simulator, trainees can operate on the virtual rectum with both visual and haptic sensation feedback simultaneously. The system also offers surgeons instructions in real time when improper manipulation happens. The simulator has been tested and evaluated by ten subjects. This prototype system has been verified by colorectal surgeons through a pilot study. They believe the visual performance and the tactile feedback are realistic. It exhibits the potential to effectively improve the surgical skills of trainee surgeons and significantly shorten their learning curve. Copyright © 2014 John Wiley & Sons, Ltd.

Haptically facilitated bimanual training combined with augmented visual feedback in moderate to severe hemiplegia.

PubMed

Boos, Amy; Qiu, Qinyin; Fluet, Gerard G; Adamovich, Sergei V

2011-01-01

This study describes the design and feasibility testing of a hand rehabilitation system that provides haptic assistance for hand opening in moderate to severe hemiplegia while subjects attempt to perform bilateral hand movements. A cable-actuated exoskeleton robot assists the subjects in performing impaired finger movements but is controlled by movement of the unimpaired hand. In an attempt to combine the neurophysiological stimuli of bilateral movement and action observation during training, visual feedback of the impaired hand is replaced by feedback of the unimpaired hand, either by using a sagittaly oriented mirror or a virtual reality setup with a pair of virtual hands presented on a flat screen controlled with movement of the unimpaired hand, providing a visual image of their paretic hand moving normally. Joint angles for both hands are measured using data gloves. The system is programmed to maintain a symmetrical relationship between the two hands as they respond to commands to open and close simultaneously. Three persons with moderate to severe hemiplegia secondary to stroke trained with the system for eight, 30 to 60 minute sessions without adverse events. Each demonstrated positive motor adaptations to training. The system was well tolerated by persons with moderate to severe upper extremity hemiplegia. Further testing of its effects on motor ability with a broader range of clinical presentations is indicated.

Adaptive Feedback in Local Coordinates for Real-time Vision-Based Motion Control Over Long Distances

NASA Astrophysics Data System (ADS)

Aref, M. M.; Astola, P.; Vihonen, J.; Tabus, I.; Ghabcheloo, R.; Mattila, J.

2018-03-01

We studied the differences in noise-effects, depth-correlated behavior of sensors, and errors caused by mapping between coordinate systems in robotic applications of machine vision. In particular, the highly range-dependent noise densities for semi-unknown object detection were considered. An equation is proposed to adapt estimation rules to dramatic changes of noise over longer distances. This algorithm also benefits the smooth feedback of wheels to overcome variable latencies of visual perception feedback. Experimental evaluation of the integrated system is presented with/without the algorithm to highlight its effectiveness.

Effects of Visual Feedback and Memory on Unintentional Drifts in Performance During Finger Pressing Tasks

PubMed Central

Solnik, Stanislaw; Qiao, Mu; Latash, Mark L.

2017-01-01

This study tested two hypotheses on the nature of unintentional force drifts elicited by removing visual feedback during accurate force production tasks. The role of working memory (memory hypothesis) was explored in tasks with continuous force production, intermittent force production, and rest intervals over the same time interval. The assumption of unintentional drifts in referent coordinate for the fingertips was tested using manipulations of visual feedback: Young healthy subjects performed accurate steady-state force production tasks by pressing with the two index fingers on individual force sensors with visual feedback on the total force, sharing ratio, both, or none. Predictions based on the memory hypothesis have been falsified. In particular, we observed consistent force drifts to lower force values during continuous force production trials only. No force drift or drifts to higher forces were observed during intermittent force production trials and following rest intervals. The hypotheses based on the idea of drifts in referent finger coordinates have been confirmed. In particular, we observed superposition of two drift processes: A drift of total force to lower magnitudes and a drift of the sharing ratio to 50:50. When visual feedback on total force only was provided, the two finger forces showed drifts in opposite directions. We interpret the findings as evidence for the control of motor actions with changes in referent coordinates for participating effectors. Unintentional drifts in performance are viewed as natural relaxation processes in the involved systems; their typical time reflects stability in the direction of the drift. The magnitude of the drift was higher in the right (dominant) hand, which is consistent with the dynamic dominance hypothesis. PMID:28168396

Optical sensor feedback assistive technology to enable patients to play an active role in the management of their body dynamics during radiotherapy treatment

NASA Astrophysics Data System (ADS)

Parkhurst, J. M.; Price, G. J.; Sharrock, P. J.; Stratford, J.; Moore, C. J.

2013-04-01

Patient motion during treatment is well understood as a prime factor limiting radiotherapy success, with the risks most pronounced in modern safety critical therapies promising the greatest benefit. In this paper we describe a real-time visual feedback device designed to help patients to actively manage their body position, pose and motion. In addition to technical device details, we present preliminary trial results showing that its use enables volunteers to successfully manage their respiratory motion. The device enables patients to view their live body surface measurements relative to a prior reference, operating on the concept that co-operative engagement with patients will both improve geometric conformance and remove their perception of isolation, in turn easing stress related motion. The device is driven by a real-time wide field optical sensor system developed at The Christie. Feedback is delivered through three intuitive visualization modes of hierarchically increasing display complexity. The device can be used with any suitable display technology; in the presented study we use both personal video glasses and a standard LCD projector. The performance characteristics of the system were measured, with the frame rate, throughput and latency of the feedback device being 22.4 fps, 47.0 Mbps, 109.8 ms, and 13.7 fps, 86.4 Mbps, 119.1 ms for single and three-channel modes respectively. The pilot study, using ten healthy volunteers over three sessions, shows that the use of visual feedback resulted in both a reduction in the participants' respiratory amplitude, and a decrease in their overall body motion variability.

Effects of Real-Time Visual Feedback on Pre-Service Teachers' Singing

ERIC Educational Resources Information Center

Leong, S.; Cheng, L.

2014-01-01

This pilot study focuses on the use real-time visual feedback technology (VFT) in vocal training. The empirical research has two aims: to ascertain the effectiveness of the real-time visual feedback software "Sing & See" in the vocal training of pre-service music teachers and the teachers' perspective on their experience with…

Use of visual CO2 feedback as a retrofit solution for improving classroom air quality.

PubMed

Wargocki, P; Da Silva, N A F

2015-02-01

Carbon dioxide (CO2 ) sensors that provide a visual indication were installed in classrooms during normal school operation. During 2-week periods, teachers and students were instructed to open the windows in response to the visual CO2 feedback in 1 week and open them, as they would normally do, without visual feedback, in the other week. In the heating season, two pairs of classrooms were monitored, one pair naturally and the other pair mechanically ventilated. In the cooling season, two pairs of naturally ventilated classrooms were monitored, one pair with split cooling in operation and the other pair with no cooling. Classrooms were matched by grade. Providing visual CO2 feedback reduced CO2 levels, as more windows were opened in this condition. This increased energy use for heating and reduced the cooling requirement in summertime. Split cooling reduced the frequency of window opening only when no visual CO2 feedback was present. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Augmented reality and haptic interfaces for robot-assisted surgery.

PubMed

Yamamoto, Tomonori; Abolhassani, Niki; Jung, Sung; Okamura, Allison M; Judkins, Timothy N

2012-03-01

Current teleoperated robot-assisted minimally invasive surgical systems do not take full advantage of the potential performance enhancements offered by various forms of haptic feedback to the surgeon. Direct and graphical haptic feedback systems can be integrated with vision and robot control systems in order to provide haptic feedback to improve safety and tissue mechanical property identification. An interoperable interface for teleoperated robot-assisted minimally invasive surgery was developed to provide haptic feedback and augmented visual feedback using three-dimensional (3D) graphical overlays. The software framework consists of control and command software, robot plug-ins, image processing plug-ins and 3D surface reconstructions. The feasibility of the interface was demonstrated in two tasks performed with artificial tissue: palpation to detect hard lumps and surface tracing, using vision-based forbidden-region virtual fixtures to prevent the patient-side manipulator from entering unwanted regions of the workspace. The interoperable interface enables fast development and successful implementation of effective haptic feedback methods in teleoperation. Copyright © 2011 John Wiley & Sons, Ltd.

Design and implementation of visual-haptic assistive control system for virtual rehabilitation exercise and teleoperation manipulation.

PubMed

Veras, Eduardo J; De Laurentis, Kathryn J; Dubey, Rajiv

2008-01-01

This paper describes the design and implementation of a control system that integrates visual and haptic information to give assistive force feedback through a haptic controller (Omni Phantom) to the user. A sensor-based assistive function and velocity scaling program provides force feedback that helps the user complete trajectory following exercises for rehabilitation purposes. This system also incorporates a PUMA robot for teleoperation, which implements a camera and a laser range finder, controlled in real time by a PC, were implemented into the system to help the user to define the intended path to the selected target. The real-time force feedback from the remote robot to the haptic controller is made possible by using effective multithreading programming strategies in the control system design and by novel sensor integration. The sensor-based assistant function concept applied to teleoperation as well as shared control enhances the motion range and manipulation capabilities of the users executing rehabilitation exercises such as trajectory following along a sensor-based defined path. The system is modularly designed to allow for integration of different master devices and sensors. Furthermore, because this real-time system is versatile the haptic component can be used separately from the telerobotic component; in other words, one can use the haptic device for rehabilitation purposes for cases in which assistance is needed to perform tasks (e.g., stroke rehab) and also for teleoperation with force feedback and sensor assistance in either supervisory or automatic modes.

Neural Substrates of Visual Spatial Coding and Visual Feedback Control for Hand Movements in Allocentric and Target-Directed Tasks

PubMed Central

Thaler, Lore; Goodale, Melvyn A.

2011-01-01

Neuropsychological evidence suggests that different brain areas may be involved in movements that are directed at visual targets (e.g., pointing or reaching), and movements that are based on allocentric visual information (e.g., drawing or copying). Here we used fMRI to investigate the neural correlates of these two types of movements in healthy volunteers. Subjects (n = 14) performed right hand movements in either a target-directed task (moving a cursor to a target dot) or an allocentric task (moving a cursor to reproduce the distance and direction between two distal target dots) with or without visual feedback about their hand movement. Movements were monitored with an MR compatible touch panel. A whole brain analysis revealed that movements in allocentric conditions led to an increase in activity in the fundus of the left intra-parietal sulcus (IPS), in posterior IPS, in bilateral dorsal premotor cortex (PMd), and in the lateral occipital complex (LOC). Visual feedback in both target-directed and allocentric conditions led to an increase in activity in area MT+, superior parietal–occipital cortex (SPOC), and posterior IPS (all bilateral). In addition, we found that visual feedback affected brain activity differently in target-directed as compared to allocentric conditions, particularly in the pre-supplementary motor area, PMd, IPS, and parieto-occipital cortex. Our results, in combination with previous findings, suggest that the LOC is essential for allocentric visual coding and that SPOC is involved in visual feedback control. The differences in brain activity between target-directed and allocentric visual feedback conditions may be related to behavioral differences in visual feedback control. Our results advance the understanding of the visual coordinate frame used by the LOC. In addition, because of the nature of the allocentric task, our results have relevance for the understanding of neural substrates of magnitude estimation and vector coding of movements. PMID:21941474

Prototype tactile feedback system for examination by skin touch.

PubMed

Lee, O; Lee, K; Oh, C; Kim, K; Kim, M

2014-08-01

Diagnosis of conditions such as psoriasis and atopic dermatitis, in the case of induration, involves palpating the infected area via hands and then selecting a ratings score. However, the score is determined based on the tester's experience and standards, making it subjective. To provide tactile feedback on the skin, we developed a prototype tactile feedback system to simulate skin wrinkles with PHANToM OMNI. To provide the user with tactile feedback on skin wrinkles, a visual and haptic Augmented Reality system was developed. First, a pair of stereo skin images obtained by a stereo camera generates a disparity map of skin wrinkles. Second, the generated disparity map is sent to an implemented tactile rendering algorithm that computes a reaction force according to the user's interaction with the skin image. We first obtained a stereo image of skin wrinkles from the in vivo stereo imaging system, which has a baseline of 50.8 μm, and obtained the disparity map with a graph cuts algorithm. The left image is displayed on the monitor to enable the user to recognize the location visually. The disparity map of the skin wrinkle image sends skin wrinkle information as a tactile response to the user through a haptic device. We successfully developed a tactile feedback system for virtual skin wrinkle simulation by means of a commercialized haptic device that provides the user with a single point of contact to feel the surface roughness of a virtual skin sample. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

OCT-based angiography in real time with hand-held probe

NASA Astrophysics Data System (ADS)

Gelikonov, Grigory V.; Moiseev, Alexander A.; Ksenofontov, Sergey Y.; Terpelov, Dmitry A.; Gelikonov, Valentine M.

2018-03-01

This work is dedicated to development of the OCT system capable to visualize blood vessel network for everyday clinical use. Following problems were solved during the development: compensation of specific natural tissue displacements, induced by contact scanning mode and physiological motion of patients (e.g. respiratory and cardiac motions) and on-line visualization of vessel net to provide the feedback for system operator.

A study on haptic collaborative game in shared virtual environment

NASA Astrophysics Data System (ADS)

Lu, Keke; Liu, Guanyang; Liu, Lingzhi

2013-03-01

A study on collaborative game in shared virtual environment with haptic feedback over computer networks is introduced in this paper. A collaborative task was used where the players located at remote sites and played the game together. The player can feel visual and haptic feedback in virtual environment compared to traditional networked multiplayer games. The experiment was desired in two conditions: visual feedback only and visual-haptic feedback. The goal of the experiment is to assess the impact of force feedback on collaborative task performance. Results indicate that haptic feedback is beneficial for performance enhancement for collaborative game in shared virtual environment. The outcomes of this research can have a powerful impact on the networked computer games.

Review of surgical robotics user interface: what is the best way to control robotic surgery?

PubMed

Simorov, Anton; Otte, R Stephen; Kopietz, Courtni M; Oleynikov, Dmitry

2012-08-01

As surgical robots begin to occupy a larger place in operating rooms around the world, continued innovation is necessary to improve our outcomes. A comprehensive review of current surgical robotic user interfaces was performed to describe the modern surgical platforms, identify the benefits, and address the issues of feedback and limitations of visualization. Most robots currently used in surgery employ a master/slave relationship, with the surgeon seated at a work-console, manipulating the master system and visualizing the operation on a video screen. Although enormous strides have been made to advance current technology to the point of clinical use, limitations still exist. A lack of haptic feedback to the surgeon and the inability of the surgeon to be stationed at the operating table are the most notable examples. The future of robotic surgery sees a marked increase in the visualization technologies used in the operating room, as well as in the robots' abilities to convey haptic feedback to the surgeon. This will allow unparalleled sensation for the surgeon and almost eliminate inadvertent tissue contact and injury. A novel design for a user interface will allow the surgeon to have access to the patient bedside, remaining sterile throughout the procedure, employ a head-mounted three-dimensional visualization system, and allow the most intuitive master manipulation of the slave robot to date.

Mark Tracking: Position/orientation measurements using 4-circle mark and its tracking experiments

NASA Technical Reports Server (NTRS)

Kanda, Shinji; Okabayashi, Keijyu; Maruyama, Tsugito; Uchiyama, Takashi

1994-01-01

Future space robots require position and orientation tracking with visual feedback control to track and capture floating objects and satellites. We developed a four-circle mark that is useful for this purpose. With this mark, four geometric center positions as feature points can be extracted from the mark by simple image processing. We also developed a position and orientation measurement method that uses the four feature points in our mark. The mark gave good enough image measurement accuracy to let space robots approach and contact objects. A visual feedback control system using this mark enabled a robot arm to track a target object accurately. The control system was able to tolerate a time delay of 2 seconds.

Weighted feature selection criteria for visual servoing of a telerobot

NASA Technical Reports Server (NTRS)

Feddema, John T.; Lee, C. S. G.; Mitchell, O. R.

1989-01-01

Because of the continually changing environment of a space station, visual feedback is a vital element of a telerobotic system. A real time visual servoing system would allow a telerobot to track and manipulate randomly moving objects. Methodologies for the automatic selection of image features to be used to visually control the relative position between an eye-in-hand telerobot and a known object are devised. A weighted criteria function with both image recognition and control components is used to select the combination of image features which provides the best control. Simulation and experimental results of a PUMA robot arm visually tracking a randomly moving carburetor gasket with a visual update time of 70 milliseconds are discussed.

Effects of Varied Enhancement Strategies (Chunking, Feedback, Gaming) in Complementing Animated Instruction in Facilitating Different Types of Learning Objectives

ERIC Educational Resources Information Center

Munyofu, Mine

2008-01-01

The purpose of this study was to examine the instructional effectiveness of different levels of chunking (simple visual/text and complex visual/text), different forms of feedback (item-by-item feedback, end-of-test feedback and no feedback), and use of instructional gaming (game and no game) in complementing animated programmed instruction on a…

Firing-rate based network modeling of the dLGN circuit: Effects of cortical feedback on spatiotemporal response properties of relay cells.

PubMed

Mobarhan, Milad Hobbi; Halnes, Geir; Martínez-Cañada, Pablo; Hafting, Torkel; Fyhn, Marianne; Einevoll, Gaute T

2018-05-01

Visually evoked signals in the retina pass through the dorsal geniculate nucleus (dLGN) on the way to the visual cortex. This is however not a simple feedforward flow of information: there is a significant feedback from cortical cells back to both relay cells and interneurons in the dLGN. Despite four decades of experimental and theoretical studies, the functional role of this feedback is still debated. Here we use a firing-rate model, the extended difference-of-Gaussians (eDOG) model, to explore cortical feedback effects on visual responses of dLGN relay cells. For this model the responses are found by direct evaluation of two- or three-dimensional integrals allowing for fast and comprehensive studies of putative effects of different candidate organizations of the cortical feedback. Our analysis identifies a special mixed configuration of excitatory and inhibitory cortical feedback which seems to best account for available experimental data. This configuration consists of (i) a slow (long-delay) and spatially widespread inhibitory feedback, combined with (ii) a fast (short-delayed) and spatially narrow excitatory feedback, where (iii) the excitatory/inhibitory ON-ON connections are accompanied respectively by inhibitory/excitatory OFF-ON connections, i.e. following a phase-reversed arrangement. The recent development of optogenetic and pharmacogenetic methods has provided new tools for more precise manipulation and investigation of the thalamocortical circuit, in particular for mice. Such data will expectedly allow the eDOG model to be better constrained by data from specific animal model systems than has been possible until now for cat. We have therefore made the Python tool pyLGN which allows for easy adaptation of the eDOG model to new situations.

Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind.

PubMed

Kim, Donghun; Kim, Kwangtaek; Lee, Sangyoun

2014-06-13

In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.

Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind

PubMed Central

Kim, Donghun; Kim, Kwangtaek; Lee, Sangyoun

2014-01-01

In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind. PMID:24932864

Virtual reality and exercise: behavioral and psychological effects of visual feedback.

PubMed

Mestre, Daniel R; Ewald, Marine; Maiano, Christophe

2011-01-01

We herein report an experimental study examining the potential positive effects of Virtual Reality (VR) feedback during an indoor bicycling exercise. Using a regular bike coupled to a VR system, we compared conditions of no VR feedback, VR feedback and VR feedback with the presence of a virtual coach, acting as a pacer. In VR feedback conditions, we observed a decreased level of perceived exertion and an increased level of enjoyment of physical activity, when compared to a regular exercise situation (no VR feedback). We also observed a shift in the subjects' attentional focus, from association (in the absence of VR feedback) to dissociation (in VR feedback conditions). Moreover, the presence of a virtual coach in the VR environment triggered a systematic regulation of the (virtual) displacement speed, whose relationship with perceived enjoyment and exertion require further work.

Coding the presence of visual objects in a recurrent neural network of visual cortex.

PubMed

Zwickel, Timm; Wachtler, Thomas; Eckhorn, Reinhard

2007-01-01

Before we can recognize a visual object, our visual system has to segregate it from its background. This requires a fast mechanism for establishing the presence and location of objects independently of their identity. Recently, border-ownership neurons were recorded in monkey visual cortex which might be involved in this task [Zhou, H., Friedmann, H., von der Heydt, R., 2000. Coding of border ownership in monkey visual cortex. J. Neurosci. 20 (17), 6594-6611]. In order to explain the basic mechanisms required for fast coding of object presence, we have developed a neural network model of visual cortex consisting of three stages. Feed-forward and lateral connections support coding of Gestalt properties, including similarity, good continuation, and convexity. Neurons of the highest area respond to the presence of an object and encode its position, invariant of its form. Feedback connections to the lowest area facilitate orientation detectors activated by contours belonging to potential objects, and thus generate the experimentally observed border-ownership property. This feedback control acts fast and significantly improves the figure-ground segregation required for the consecutive task of object recognition.

The Effects of Mirror Feedback during Target Directed Movements on Ipsilateral Corticospinal Excitability

PubMed Central

Yarossi, Mathew; Manuweera, Thushini; Adamovich, Sergei V.; Tunik, Eugene

2017-01-01

Mirror visual feedback (MVF) training is a promising technique to promote activation in the lesioned hemisphere following stroke, and aid recovery. However, current outcomes of MVF training are mixed, in part, due to variability in the task undertaken during MVF. The present study investigated the hypothesis that movements directed toward visual targets may enhance MVF modulation of motor cortex (M1) excitability ipsilateral to the trained hand compared to movements without visual targets. Ten healthy subjects participated in a 2 × 2 factorial design in which feedback (veridical, mirror) and presence of a visual target (target present, target absent) for a right index-finger flexion task were systematically manipulated in a virtual environment. To measure M1 excitability, transcranial magnetic stimulation (TMS) was applied to the hemisphere ipsilateral to the trained hand to elicit motor evoked potentials (MEPs) in the untrained first dorsal interosseous (FDI) and abductor digiti minimi (ADM) muscles at rest prior to and following each of four 2-min blocks of 30 movements (B1–B4). Targeted movement kinematics without visual feedback was measured before and after training to assess learning and transfer. FDI MEPs were decreased in B1 and B2 when movements were made with veridical feedback and visual targets were absent. FDI MEPs were decreased in B2 and B3 when movements were made with mirror feedback and visual targets were absent. FDI MEPs were increased in B3 when movements were made with mirror feedback and visual targets were present. Significant MEP changes were not present for the uninvolved ADM, suggesting a task-specific effect. Analysis of kinematics revealed learning occurred in visual target-directed conditions, but transfer was not sensitive to mirror feedback. Results are discussed with respect to current theoretical mechanisms underlying MVF-induced changes in ipsilateral excitability. PMID:28553218

Effect of visuomotor-map uncertainty on visuomotor adaptation.

PubMed

Saijo, Naoki; Gomi, Hiroaki

2012-03-01

Vision and proprioception contribute to generating hand movement. If a conflict between the visual and proprioceptive feedback of hand position is given, reaching movement is disturbed initially but recovers after training. Although previous studies have predominantly investigated the adaptive change in the motor output, it is unclear whether the contributions of visual and proprioceptive feedback controls to the reaching movement are modified by visuomotor adaptation. To investigate this, we focused on the change in proprioceptive feedback control associated with visuomotor adaptation. After the adaptation to gradually introduce visuomotor rotation, the hand reached the shifted position of the visual target to move the cursor to the visual target correctly. When the cursor feedback was occasionally eliminated (probe trial), the end point of the hand movement was biased in the visual-target direction, while the movement was initiated in the adapted direction, suggesting the incomplete adaptation of proprioceptive feedback control. Moreover, after the learning of uncertain visuomotor rotation, in which the rotation angle was randomly fluctuated on a trial-by-trial basis, the end-point bias in the probe trial increased, but the initial movement direction was not affected, suggesting a reduction in the adaptation level of proprioceptive feedback control. These results suggest that the change in the relative contribution of visual and proprioceptive feedback controls to the reaching movement in response to the visuomotor-map uncertainty is involved in visuomotor adaptation, whereas feedforward control might adapt in a manner different from that of the feedback control.

Error amplification to promote motor learning and motivation in therapy robotics.

PubMed

Shirzad, Navid; Van der Loos, H F Machiel

2012-01-01

To study the effects of different feedback error amplification methods on a subject's upper-limb motor learning and affect during a point-to-point reaching exercise, we developed a real-time controller for a robotic manipulandum. The reaching environment was visually distorted by implementing a thirty degrees rotation between the coordinate systems of the robot's end-effector and the visual display. Feedback error amplification was provided to subjects as they trained to learn reaching within the visually rotated environment. Error amplification was provided either visually or through both haptic and visual means, each method with two different amplification gains. Subjects' performance (i.e., trajectory error) and self-reports to a questionnaire were used to study the speed and amount of adaptation promoted by each error amplification method and subjects' emotional changes. We found that providing haptic and visual feedback promotes faster adaptation to the distortion and increases subjects' satisfaction with the task, leading to a higher level of attentiveness during the exercise. This finding can be used to design a novel exercise regimen, where alternating between error amplification methods is used to both increase a subject's motor learning and maintain a minimum level of motivational engagement in the exercise. In future experiments, we will test whether such exercise methods will lead to a faster learning time and greater motivation to pursue a therapy exercise regimen.

Effect of visual and tactile feedback on kinematic synergies in the grasping hand.

PubMed

Patel, Vrajeshri; Burns, Martin; Vinjamuri, Ramana

2016-08-01

The human hand uses a combination of feedforward and feedback mechanisms to accomplish high degree of freedom in grasp control efficiently. In this study, we used a synergy-based control model to determine the effect of sensory feedback on kinematic synergies in the grasping hand. Ten subjects performed two types of grasps: one that included feedback (real) and one without feedback (memory-guided), at two different speeds (rapid and natural). Kinematic synergies were extracted from rapid real and rapid memory-guided grasps using principal component analysis. Synergies extracted from memory-guided grasps revealed greater preservation of natural inter-finger relationships than those found in corresponding synergies extracted from real grasps. Reconstruction of natural real and natural memory-guided grasps was used to test performance and generalizability of synergies. A temporal analysis of reconstruction patterns revealed the differing contribution of individual synergies in real grasps versus memory-guided grasps. Finally, the results showed that memory-guided synergies could not reconstruct real grasps as accurately as real synergies could reconstruct memory-guided grasps. These results demonstrate how visual and tactile feedback affects a closed-loop synergy-based motor control system.

Corticocortical feedback increases the spatial extent of normalization.

PubMed

Nassi, Jonathan J; Gómez-Laberge, Camille; Kreiman, Gabriel; Born, Richard T

2014-01-01

Normalization has been proposed as a canonical computation operating across different brain regions, sensory modalities, and species. It provides a good phenomenological description of non-linear response properties in primary visual cortex (V1), including the contrast response function and surround suppression. Despite its widespread application throughout the visual system, the underlying neural mechanisms remain largely unknown. We recently observed that corticocortical feedback contributes to surround suppression in V1, raising the possibility that feedback acts through normalization. To test this idea, we characterized area summation and contrast response properties in V1 with and without feedback from V2 and V3 in alert macaques and applied a standard normalization model to the data. Area summation properties were well explained by a form of divisive normalization, which computes the ratio between a neuron's driving input and the spatially integrated activity of a "normalization pool." Feedback inactivation reduced surround suppression by shrinking the spatial extent of the normalization pool. This effect was independent of the gain modulation thought to mediate the influence of contrast on area summation, which remained intact during feedback inactivation. Contrast sensitivity within the receptive field center was also unaffected by feedback inactivation, providing further evidence that feedback participates in normalization independent of the circuit mechanisms involved in modulating contrast gain and saturation. These results suggest that corticocortical feedback contributes to surround suppression by increasing the visuotopic extent of normalization and, via this mechanism, feedback can play a critical role in contextual information processing.

Corticocortical feedback increases the spatial extent of normalization

PubMed Central

Nassi, Jonathan J.; Gómez-Laberge, Camille; Kreiman, Gabriel; Born, Richard T.

2014-01-01

Normalization has been proposed as a canonical computation operating across different brain regions, sensory modalities, and species. It provides a good phenomenological description of non-linear response properties in primary visual cortex (V1), including the contrast response function and surround suppression. Despite its widespread application throughout the visual system, the underlying neural mechanisms remain largely unknown. We recently observed that corticocortical feedback contributes to surround suppression in V1, raising the possibility that feedback acts through normalization. To test this idea, we characterized area summation and contrast response properties in V1 with and without feedback from V2 and V3 in alert macaques and applied a standard normalization model to the data. Area summation properties were well explained by a form of divisive normalization, which computes the ratio between a neuron's driving input and the spatially integrated activity of a “normalization pool.” Feedback inactivation reduced surround suppression by shrinking the spatial extent of the normalization pool. This effect was independent of the gain modulation thought to mediate the influence of contrast on area summation, which remained intact during feedback inactivation. Contrast sensitivity within the receptive field center was also unaffected by feedback inactivation, providing further evidence that feedback participates in normalization independent of the circuit mechanisms involved in modulating contrast gain and saturation. These results suggest that corticocortical feedback contributes to surround suppression by increasing the visuotopic extent of normalization and, via this mechanism, feedback can play a critical role in contextual information processing. PMID:24910596

Adaptation effects in static postural control by providing simultaneous visual feedback of center of pressure and center of gravity.

PubMed

Takeda, Kenta; Mani, Hiroki; Hasegawa, Naoya; Sato, Yuki; Tanaka, Shintaro; Maejima, Hiroshi; Asaka, Tadayoshi

2017-07-19

The benefit of visual feedback of the center of pressure (COP) on quiet standing is still debatable. This study aimed to investigate the adaptation effects of visual feedback training using both the COP and center of gravity (COG) during quiet standing. Thirty-four healthy young adults were divided into three groups randomly (COP + COG, COP, and control groups). A force plate was used to calculate the coordinates of the COP in the anteroposterior (COP AP ) and mediolateral (COP ML ) directions. A motion analysis system was used to calculate the coordinates of the center of mass (COM) in both directions (COM AP and COM ML ). The coordinates of the COG in the AP direction (COG AP ) were obtained from the force plate signals. Augmented visual feedback was presented on a screen in the form of fluctuation circles in the vertical direction that moved upward as the COP AP and/or COG AP moved forward and vice versa. The COP + COG group received the real-time COP AP and COG AP feedback simultaneously, whereas the COP group received the real-time COP AP feedback only. The control group received no visual feedback. In the training session, the COP + COG group was required to maintain an even distance between the COP AP and COG AP and reduce the COG AP fluctuation, whereas the COP group was required to reduce the COP AP fluctuation while standing on a foam pad. In test sessions, participants were instructed to keep their standing posture as quiet as possible on the foam pad before (pre-session) and after (post-session) the training sessions. In the post-session, the velocity and root mean square of COM AP in the COP + COG group were lower than those in the control group. In addition, the absolute value of the sum of the COP - COM distances in the COP + COG group was lower than that in the COP group. Furthermore, positive correlations were found between the COM AP velocity and COP - COM parameters. The results suggest that the novel visual feedback training that incorporates the COP AP -COG AP interaction reduces postural sway better than the training using the COP AP alone during quiet standing. That is, even COP AP fluctuation around the COG AP would be effective in reducing the COM AP velocity.

A CAI System for Visually Impaired Children to Improve Abilities of Orientation and Mobility

NASA Astrophysics Data System (ADS)

Yoneda, Takahiro; Kudo, Hiroaki; Minagawa, Hiroki; Ohnishi, Noboru; Matsubara, Shizuya

Some visually impaired children have difficulty in simple locomotion, and need orientation and mobility training. We developed a computer assisted instruction system which assists this training. A user realizes a task given by a tactile map and synthesized speech. The user walks around a room according to the task. The system gives the gap of walk path from its target path via both auditory and tactile feedback after the end of a task. Then the user can understand how well the user walked. We describe the detail of the proposed system and task, and the experimental result with three visually impaired children.

Patient DF's visual brain in action: Visual feedforward control in visual form agnosia.

PubMed

Whitwell, Robert L; Milner, A David; Cavina-Pratesi, Cristiana; Barat, Masihullah; Goodale, Melvyn A

2015-05-01

Patient DF, who developed visual form agnosia following ventral-stream damage, is unable to discriminate the width of objects, performing at chance, for example, when asked to open her thumb and forefinger a matching amount. Remarkably, however, DF adjusts her hand aperture to accommodate the width of objects when reaching out to pick them up (grip scaling). While this spared ability to grasp objects is presumed to be mediated by visuomotor modules in her relatively intact dorsal stream, it is possible that it may rely abnormally on online visual or haptic feedback. We report here that DF's grip scaling remained intact when her vision was completely suppressed during grasp movements, and it still dissociated sharply from her poor perceptual estimates of target size. We then tested whether providing trial-by-trial haptic feedback after making such perceptual estimates might improve DF's performance, but found that they remained significantly impaired. In a final experiment, we re-examined whether DF's grip scaling depends on receiving veridical haptic feedback during grasping. In one condition, the haptic feedback was identical to the visual targets. In a second condition, the haptic feedback was of a constant intermediate width while the visual target varied trial by trial. Despite this incongruent feedback, DF still scaled her grip aperture to the visual widths of the target blocks, showing only normal adaptation to the false haptically-experienced width. Taken together, these results strengthen the view that DF's spared grasping relies on a normal mode of dorsal-stream functioning, based chiefly on visual feedforward processing. Copyright © 2014 Elsevier B.V. All rights reserved.

Unipedal balance in healthy adults: effect of visual environments yielding decreased lateral velocity feedback.

PubMed

Deyer, T W; Ashton-Miller, J A

1999-09-01

To test the (null) hypotheses that the reliability of unipedal balance is unaffected by the attenuation of visual velocity feedback and that, relative to baseline performance, deterioration of balance success rates from attenuated visual velocity feedback will not differ between groups of young men and older women, and the presence (or absence) of a vertical foreground object will not affect balance success rates. Single blind, single case study. University research laboratory. Two volunteer samples: 26 healthy young men (mean age, 20.0yrs; SD, 1.6); 23 healthy older women (mean age, 64.9 yrs; SD, 7.8). Normalized success rates in unipedal balance task. Subjects were asked to transfer to and maintain unipedal stance for 5 seconds in a task near the limit of their balance capabilities. Subjects completed 64 trials: 54 trials of three experimental visual scenes in blocked randomized sequences of 18 trials and 10 trials in a normal visual environment. The experimental scenes included two that provided strong velocity/weak position feedback, one of which had a vertical foreground object (SVWP+) and one without (SVWP-), and one scene providing weak velocity/strong position (WVSP) feedback. Subjects' success rates in the experimental environments were normalized by the success rate in the normal environment in order to allow comparisons between subjects using a mixed model repeated measures analysis of variance. The normalized success rate was significantly greater in SVWP+ than in WVSP (p = .0001) and SVWP- (p = .013). Visual feedback significantly affected the normalized unipedal balance success rates (p = .001); neither the group effect nor the group X visual environment interaction was significant (p = .9362 and p = .5634, respectively). Normalized success rates did not differ significantly between the young men and older women in any visual environment. Near the limit of the young men's or older women's balance capability, the reliability of transfer to unipedal balance was adversely affected by visual environments offering attenuated visual velocity feedback cues and those devoid of vertical foreground objects.

Closed-Loop Hybrid Gaze Brain-Machine Interface Based Robotic Arm Control with Augmented Reality Feedback

PubMed Central

Zeng, Hong; Wang, Yanxin; Wu, Changcheng; Song, Aiguo; Liu, Jia; Ji, Peng; Xu, Baoguo; Zhu, Lifeng; Li, Huijun; Wen, Pengcheng

2017-01-01

Brain-machine interface (BMI) can be used to control the robotic arm to assist paralysis people for performing activities of daily living. However, it is still a complex task for the BMI users to control the process of objects grasping and lifting with the robotic arm. It is hard to achieve high efficiency and accuracy even after extensive trainings. One important reason is lacking of sufficient feedback information for the user to perform the closed-loop control. In this study, we proposed a method of augmented reality (AR) guiding assistance to provide the enhanced visual feedback to the user for a closed-loop control with a hybrid Gaze-BMI, which combines the electroencephalography (EEG) signals based BMI and the eye tracking for an intuitive and effective control of the robotic arm. Experiments for the objects manipulation tasks while avoiding the obstacle in the workspace are designed to evaluate the performance of our method for controlling the robotic arm. According to the experimental results obtained from eight subjects, the advantages of the proposed closed-loop system (with AR feedback) over the open-loop system (with visual inspection only) have been verified. The number of trigger commands used for controlling the robotic arm to grasp and lift the objects with AR feedback has reduced significantly and the height gaps of the gripper in the lifting process have decreased more than 50% compared to those trials with normal visual inspection only. The results reveal that the hybrid Gaze-BMI user can benefit from the information provided by the AR interface, improving the efficiency and reducing the cognitive load during the grasping and lifting processes. PMID:29163123

Visual Feedback of the Non-Moving Limb Improves Active Joint-Position Sense of the Impaired Limb in Spastic Hemiparetic Cerebral Palsy

ERIC Educational Resources Information Center

Smorenburg, Ana R. P.; Ledebt, Annick; Deconinck, Frederik J. A.; Savelsbergh, Geert J. P.

2011-01-01

This study examined the active joint-position sense in children with Spastic Hemiparetic Cerebral Palsy (SHCP) and the effect of static visual feedback and static mirror visual feedback, of the non-moving limb, on the joint-position sense. Participants were asked to match the position of one upper limb with that of the contralateral limb. The task…

Watch what you type: the role of visual feedback from the screen and hands in skilled typewriting.

PubMed

Snyder, Kristy M; Logan, Gordon D; Yamaguchi, Motonori

2015-01-01

Skilled typing is controlled by two hierarchically structured processing loops (Logan & Crump, 2011): The outer loop, which produces words, commands the inner loop, which produces keystrokes. Here, we assessed the interplay between the two loops by investigating how visual feedback from the screen (responses either were or were not echoed on the screen) and the hands (the hands either were or were not covered with a box) influences the control of skilled typing. Our results indicated, first, that the reaction time of the first keystroke was longer when responses were not echoed than when they were. Also, the interkeystroke interval (IKSI) was longer when the hands were covered than when they were visible, and the IKSI for responses that were not echoed was longer when explicit error monitoring was required (Exp. 2) than when it was not required (Exp. 1). Finally, explicit error monitoring was more accurate when response echoes were present than when they were absent, and implicit error monitoring (i.e., posterror slowing) was not influenced by visual feedback from the screen or the hands. These findings suggest that the outer loop adjusts the inner-loop timing parameters to compensate for reductions in visual feedback. We suggest that these adjustments are preemptive control strategies designed to execute keystrokes more cautiously when visual feedback from the hands is absent, to generate more cautious motor programs when visual feedback from the screen is absent, and to enable enough time for the outer loop to monitor keystrokes when visual feedback from the screen is absent and explicit error reports are required.

Adaptation to Laterally Displacing Prisms in Anisometropic Amblyopia.

PubMed

Sklar, Jaime C; Goltz, Herbert C; Gane, Luke; Wong, Agnes M F

2015-06-01

Using visual feedback to modify sensorimotor output in response to changes in the external environment is essential for daily function. Prism adaptation is a well-established experimental paradigm to quantify sensorimotor adaptation; that is, how the sensorimotor system adapts to an optically-altered visuospatial environment. Amblyopia is a neurodevelopmental disorder characterized by spatiotemporal deficits in vision that impacts manual and oculomotor function. This study explored the effects of anisometropic amblyopia on prism adaptation. Eight participants with anisometropic amblyopia and 11 visually-normal adults, all right-handed, were tested. Participants pointed to visual targets and were presented with feedback of hand position near the terminus of limb movement in three blocks: baseline, adaptation, and deadaptation. Adaptation was induced by viewing with binocular 11.4° (20 prism diopter [PD]) left-shifting prisms. All tasks were performed during binocular viewing. Participants with anisometropic amblyopia required significantly more trials (i.e., increased time constant) to adapt to prismatic optical displacement than visually-normal controls. During the rapid error correction phase of adaptation, people with anisometropic amblyopia also exhibited greater variance in motor output than visually-normal controls. Amblyopia impacts on the ability to adapt the sensorimotor system to an optically-displaced visual environment. The increased time constant and greater variance in motor output during the rapid error correction phase of adaptation may indicate deficits in processing of visual information as a result of degraded spatiotemporal vision in amblyopia.

Visual feedback-related changes in ipsilateral cortical excitability during unimanual movement: Implications for mirror therapy.

PubMed

Reissig, Paola; Garry, Michael I; Summers, Jeffery J; Hinder, Mark R

2014-01-01

Provision of a mirror image of a hand undertaking a motor task (i.e., mirror therapy) elicits behavioural improvements in the inactive hand. A greater understanding of the neural mechanisms underpinning this phenomenon is required to maximise its potential for rehabilitation across the lifespan, e.g., following hemiparesis or unilateral weakness. Young and older participants performed unilateral finger abductions with no visual feedback, with feedback of the active or passive hands, or with a mirror image of the active hand. Transcranial magnetic stimulation was used to assess feedback-related changes in two neurophysiological measures thought to be involved in inter-manual transfer of skill, namely corticospinal excitability (CSE) and intracortical inhibition (SICI) in the passive hemisphere. Task performance led to CSE increases, accompanied by decreases of SICI, in all visual feedback conditions relative to rest. However, the changes due to mirror feedback were not significantly different to those observed in the other (more standard) visual conditions. Accordingly, the unimanual motor action itself, rather than modifications in visual feedback, appears more instrumental in driving changes in CSE and SICI. Therefore, changes in CSE and SICI are unlikely to underpin the behavioural benefits of mirror therapy. We discuss implications for rehabilitation and directions of future research.

Mastoidectomy simulation with combined visual and haptic feedback.

PubMed

Agus, Marco; Giachetti, Andrea; Gobbetti, Enrico; Zanetti, Gianluigi; Zorcolo, Antonio; John, Nigel W; Stone, Robert J

2002-01-01

Mastoidectomy is one of the most common surgical procedures relating to the petrous bone. In this paper we describe our preliminary results in the realization of a virtual reality mastoidectomy simulator. Our system is designed to work on patient-specific volumetric object models directly derived from 3D CT and MRI images. The paper summarizes the detailed task analysis performed in order to define the system requirements, introduces the architecture of the prototype simulator, and discusses the initial feedback received from selected end users.

Improving Vision-Based Motor Rehabilitation Interactive Systems for Users with Disabilities Using Mirror Feedback

PubMed Central

Martínez-Bueso, Pau; Moyà-Alcover, Biel

2014-01-01

Observation is recommended in motor rehabilitation. For this reason, the aim of this study was to experimentally test the feasibility and benefit of including mirror feedback in vision-based rehabilitation systems: we projected the user on the screen. We conducted a user study by using a previously evaluated system that improved the balance and postural control of adults with cerebral palsy. We used a within-subjects design with the two defined feedback conditions (mirror and no-mirror) with two different groups of users (8 with disabilities and 32 without disabilities) using usability measures (time-to-start (T s) and time-to-complete (T c)). A two-tailed paired samples t-test confirmed that in case of disabilities the mirror feedback facilitated the interaction in vision-based systems for rehabilitation. The measured times were significantly worse in the absence of the user's own visual feedback (T s = 7.09 (P < 0.001) and T c = 4.48 (P < 0.005)). In vision-based interaction systems, the input device is the user's own body; therefore, it makes sense that feedback should be related to the body of the user. In case of disabilities the mirror feedback mechanisms facilitated the interaction in vision-based systems for rehabilitation. Results recommends developers and researchers use this improvement in vision-based motor rehabilitation interactive systems. PMID:25295310

Acoustic-tactile rendering of visual information

NASA Astrophysics Data System (ADS)

Silva, Pubudu Madhawa; Pappas, Thrasyvoulos N.; Atkins, Joshua; West, James E.; Hartmann, William M.

2012-03-01

In previous work, we have proposed a dynamic, interactive system for conveying visual information via hearing and touch. The system is implemented with a touch screen that allows the user to interrogate a two-dimensional (2-D) object layout by active finger scanning while listening to spatialized auditory feedback. Sound is used as the primary source of information for object localization and identification, while touch is used both for pointing and for kinesthetic feedback. Our previous work considered shape and size perception of simple objects via hearing and touch. The focus of this paper is on the perception of a 2-D layout of simple objects with identical size and shape. We consider the selection and rendition of sounds for object identification and localization. We rely on the head-related transfer function for rendering sound directionality, and consider variations of sound intensity and tempo as two alternative approaches for rendering proximity. Subjective experiments with visually-blocked subjects are used to evaluate the effectiveness of the proposed approaches. Our results indicate that intensity outperforms tempo as a proximity cue, and that the overall system for conveying a 2-D layout is quite promising.

Variations in Static Force Control and Motor Unit Behavior with Error Amplification Feedback in the Elderly.

PubMed

Chen, Yi-Ching; Lin, Linda L; Lin, Yen-Ting; Hu, Chia-Ling; Hwang, Ing-Shiou

2017-01-01

Error amplification (EA) feedback is a promising approach to advance visuomotor skill. As error detection and visuomotor processing at short time scales decline with age, this study examined whether older adults could benefit from EA feedback that included higher-frequency information to guide a force-tracking task. Fourteen young and 14 older adults performed low-level static isometric force-tracking with visual guidance of typical visual feedback and EA feedback containing augmented high-frequency errors. Stabilogram diffusion analysis was used to characterize force fluctuation dynamics. Also, the discharge behaviors of motor units and pooled motor unit coherence were assessed following the decomposition of multi-channel surface electromyography (EMG). EA produced different behavioral and neurophysiological impacts on young and older adults. Older adults exhibited inferior task accuracy with EA feedback than with typical visual feedback, but not young adults. Although stabilogram diffusion analysis revealed that EA led to a significant decrease in critical time points for both groups, EA potentiated the critical point of force fluctuations [Formula: see text], short-term effective diffusion coefficients (Ds), and short-term exponent scaling only for the older adults. Moreover, in older adults, EA added to the size of discharge variability of motor units and discharge regularity of cumulative discharge rate, but suppressed the pooled motor unit coherence in the 13-35 Hz band. Virtual EA alters the strategic balance between open-loop and closed-loop controls for force-tracking. Contrary to expectations, the prevailing use of closed-loop control with EA that contained high-frequency error information enhanced the motor unit discharge variability and undermined the force steadiness in the older group, concerning declines in physiological complexity in the neurobehavioral system and the common drive to the motoneuronal pool against force destabilization.

Variations in Static Force Control and Motor Unit Behavior with Error Amplification Feedback in the Elderly

PubMed Central

Chen, Yi-Ching; Lin, Linda L.; Lin, Yen-Ting; Hu, Chia-Ling; Hwang, Ing-Shiou

2017-01-01

Error amplification (EA) feedback is a promising approach to advance visuomotor skill. As error detection and visuomotor processing at short time scales decline with age, this study examined whether older adults could benefit from EA feedback that included higher-frequency information to guide a force-tracking task. Fourteen young and 14 older adults performed low-level static isometric force-tracking with visual guidance of typical visual feedback and EA feedback containing augmented high-frequency errors. Stabilogram diffusion analysis was used to characterize force fluctuation dynamics. Also, the discharge behaviors of motor units and pooled motor unit coherence were assessed following the decomposition of multi-channel surface electromyography (EMG). EA produced different behavioral and neurophysiological impacts on young and older adults. Older adults exhibited inferior task accuracy with EA feedback than with typical visual feedback, but not young adults. Although stabilogram diffusion analysis revealed that EA led to a significant decrease in critical time points for both groups, EA potentiated the critical point of force fluctuations <ΔFc2>, short-term effective diffusion coefficients (Ds), and short-term exponent scaling only for the older adults. Moreover, in older adults, EA added to the size of discharge variability of motor units and discharge regularity of cumulative discharge rate, but suppressed the pooled motor unit coherence in the 13–35 Hz band. Virtual EA alters the strategic balance between open-loop and closed-loop controls for force-tracking. Contrary to expectations, the prevailing use of closed-loop control with EA that contained high-frequency error information enhanced the motor unit discharge variability and undermined the force steadiness in the older group, concerning declines in physiological complexity in the neurobehavioral system and the common drive to the motoneuronal pool against force destabilization. PMID:29167637

Audio-Visual Situational Awareness for General Aviation Pilots

NASA Technical Reports Server (NTRS)

Spirkovska, Lilly; Lodha, Suresh K.; Clancy, Daniel (Technical Monitor)

2001-01-01

Weather is one of the major causes of general aviation accidents. Researchers are addressing this problem from various perspectives including improving meteorological forecasting techniques, collecting additional weather data automatically via on-board sensors and "flight" modems, and improving weather data dissemination and presentation. We approach the problem from the improved presentation perspective and propose weather visualization and interaction methods tailored for general aviation pilots. Our system, Aviation Weather Data Visualization Environment (AWE), utilizes information visualization techniques, a direct manipulation graphical interface, and a speech-based interface to improve a pilot's situational awareness of relevant weather data. The system design is based on a user study and feedback from pilots.

Cortical feedback signals generalise across different spatial frequencies of feedforward inputs.

PubMed

Revina, Yulia; Petro, Lucy S; Muckli, Lars

2017-09-22

Visual processing in cortex relies on feedback projections contextualising feedforward information flow. Primary visual cortex (V1) has small receptive fields and processes feedforward information at a fine-grained spatial scale, whereas higher visual areas have larger, spatially invariant receptive fields. Therefore, feedback could provide coarse information about the global scene structure or alternatively recover fine-grained structure by targeting small receptive fields in V1. We tested if feedback signals generalise across different spatial frequencies of feedforward inputs, or if they are tuned to the spatial scale of the visual scene. Using a partial occlusion paradigm, functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA) we investigated whether feedback to V1 contains coarse or fine-grained information by manipulating the spatial frequency of the scene surround outside an occluded image portion. We show that feedback transmits both coarse and fine-grained information as it carries information about both low (LSF) and high spatial frequencies (HSF). Further, feedback signals containing LSF information are similar to feedback signals containing HSF information, even without a large overlap in spatial frequency bands of the HSF and LSF scenes. Lastly, we found that feedback carries similar information about the spatial frequency band across different scenes. We conclude that cortical feedback signals contain information which generalises across different spatial frequencies of feedforward inputs. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Automatic medical image annotation and keyword-based image retrieval using relevance feedback.

PubMed

Ko, Byoung Chul; Lee, JiHyeon; Nam, Jae-Yeal

2012-08-01

This paper presents novel multiple keywords annotation for medical images, keyword-based medical image retrieval, and relevance feedback method for image retrieval for enhancing image retrieval performance. For semantic keyword annotation, this study proposes a novel medical image classification method combining local wavelet-based center symmetric-local binary patterns with random forests. For keyword-based image retrieval, our retrieval system use the confidence score that is assigned to each annotated keyword by combining probabilities of random forests with predefined body relation graph. To overcome the limitation of keyword-based image retrieval, we combine our image retrieval system with relevance feedback mechanism based on visual feature and pattern classifier. Compared with other annotation and relevance feedback algorithms, the proposed method shows both improved annotation performance and accurate retrieval results.

Foot placement relies on state estimation during visually guided walking.

PubMed

Maeda, Rodrigo S; O'Connor, Shawn M; Donelan, J Maxwell; Marigold, Daniel S

2017-02-01

As we walk, we must accurately place our feet to stabilize our motion and to navigate our environment. We must also achieve this accuracy despite imperfect sensory feedback and unexpected disturbances. In this study we tested whether the nervous system uses state estimation to beneficially combine sensory feedback with forward model predictions to compensate for these challenges. Specifically, subjects wore prism lenses during a visually guided walking task, and we used trial-by-trial variation in prism lenses to add uncertainty to visual feedback and induce a reweighting of this input. To expose altered weighting, we added a consistent prism shift that required subjects to adapt their estimate of the visuomotor mapping relationship between a perceived target location and the motor command necessary to step to that position. With added prism noise, subjects responded to the consistent prism shift with smaller initial foot placement error but took longer to adapt, compatible with our mathematical model of the walking task that leverages state estimation to compensate for noise. Much like when we perform voluntary and discrete movements with our arms, it appears our nervous systems uses state estimation during walking to accurately reach our foot to the ground. Accurate foot placement is essential for safe walking. We used computational models and human walking experiments to test how our nervous system achieves this accuracy. We find that our control of foot placement beneficially combines sensory feedback with internal forward model predictions to accurately estimate the body's state. Our results match recent computational neuroscience findings for reaching movements, suggesting that state estimation is a general mechanism of human motor control. Copyright © 2017 the American Physiological Society.

Saliency affects feedforward more than feedback processing in early visual cortex.

PubMed

Emmanouil, Tatiana Aloi; Avigan, Philip; Persuh, Marjan; Ro, Tony

2013-07-01

Early visual cortex activity is influenced by both bottom-up and top-down factors. To investigate the influences of bottom-up (saliency) and top-down (task) factors on different stages of visual processing, we used transcranial magnetic stimulation (TMS) of areas V1/V2 to induce visual suppression at varying temporal intervals. Subjects were asked to detect and discriminate the color or the orientation of briefly-presented small lines that varied on color saliency based on color contrast with the surround. Regardless of task, color saliency modulated the magnitude of TMS-induced visual suppression, especially at earlier temporal processing intervals that reflect the feedforward stage of visual processing in V1/V2. In a second experiment we found that our color saliency effects were also influenced by an inherent advantage of the color red relative to other hues and that color discrimination difficulty did not affect visual suppression. These results support the notion that early visual processing is stimulus driven and that feedforward and feedback processing encode different types of information about visual scenes. They further suggest that certain hues can be prioritized over others within our visual systems by being more robustly represented during early temporal processing intervals. Copyright © 2013 Elsevier Ltd. All rights reserved.

Integrative advances for OCT-guided ophthalmic surgery and intraoperative OCT: microscope integration, surgical instrumentation, and heads-up display surgeon feedback.

PubMed

Ehlers, Justis P; Srivastava, Sunil K; Feiler, Daniel; Noonan, Amanda I; Rollins, Andrew M; Tao, Yuankai K

2014-01-01

To demonstrate key integrative advances in microscope-integrated intraoperative optical coherence tomography (iOCT) technology that will facilitate adoption and utilization during ophthalmic surgery. We developed a second-generation prototype microscope-integrated iOCT system that interfaces directly with a standard ophthalmic surgical microscope. Novel features for improved design and functionality included improved profile and ergonomics, as well as a tunable lens system for optimized image quality and heads-up display (HUD) system for surgeon feedback. Novel material testing was performed for potential suitability for OCT-compatible instrumentation based on light scattering and transmission characteristics. Prototype surgical instruments were developed based on material testing and tested using the microscope-integrated iOCT system. Several surgical maneuvers were performed and imaged, and surgical motion visualization was evaluated with a unique scanning and image processing protocol. High-resolution images were successfully obtained with the microscope-integrated iOCT system with HUD feedback. Six semi-transparent materials were characterized to determine their attenuation coefficients and scatter density with an 830 nm OCT light source. Based on these optical properties, polycarbonate was selected as a material substrate for prototype instrument construction. A surgical pick, retinal forceps, and corneal needle were constructed with semi-transparent materials. Excellent visualization of both the underlying tissues and surgical instrument were achieved on OCT cross-section. Using model eyes, various surgical maneuvers were visualized, including membrane peeling, vessel manipulation, cannulation of the subretinal space, subretinal intraocular foreign body removal, and corneal penetration. Significant iterative improvements in integrative technology related to iOCT and ophthalmic surgery are demonstrated.

Effects of visual feedback with a mirror on balance ability in patients with stroke.

PubMed

In, Tae-Sung; Cha, Yu-Ri; Jung, Jin-Hwa; Jung, Kyoung-Sim

2016-01-01

[Purpose] This study aimed to examine the effects of a visual feedback obtained from a mirror on balance ability during quiet standing in patients with stroke. [Subjects] Fifteen patients with stroke (9 males, 6 females) enrolled in the study. [Methods] Experimental trials (duration, 20s) included three visual conditions (eyes closed, eyes open, and mirror feedback) and two support surface conditions (stable, and unstable). Center of pressure (COP) displacements in the mediolateral and anteroposterior directions were recorded using a force platform. [Results] No effect of condition was observed along all directions on the stable surface. An effect of condition was observed on the unstable surface, with a smaller mediolateral COP distance in the mirror feedback as compared to the other two conditions. Similar results were observed for the COP speed. [Conclusion] Visual feedback from a mirror is beneficial for improving balance ability during quiet standing on an unstable surface in patients with stroke.

Predictive Coding in Area V4: Dynamic Shape Discrimination under Partial Occlusion

PubMed Central

Choi, Hannah; Pasupathy, Anitha; Shea-Brown, Eric

2018-01-01

The primate visual system has an exquisite ability to discriminate partially occluded shapes. Recent electrophysiological recordings suggest that response dynamics in intermediate visual cortical area V4, shaped by feedback from prefrontal cortex (PFC), may play a key role. To probe the algorithms that may underlie these findings, we build and test a model of V4 and PFC interactions based on a hierarchical predictive coding framework. We propose that probabilistic inference occurs in two steps. Initially, V4 responses are driven solely by bottom-up sensory input and are thus strongly influenced by the level of occlusion. After a delay, V4 responses combine both feedforward input and feedback signals from the PFC; the latter reflect predictions made by PFC about the visual stimulus underlying V4 activity. We find that this model captures key features of V4 and PFC dynamics observed in experiments. Specifically, PFC responses are strongest for occluded stimuli and delayed responses in V4 are less sensitive to occlusion, supporting our hypothesis that the feedback signals from PFC underlie robust discrimination of occluded shapes. Thus, our study proposes that area V4 and PFC participate in hierarchical inference, with feedback signals encoding top-down predictions about occluded shapes. PMID:29566355

Upper extremity rehabilitation of stroke: facilitation of corticospinal excitability using virtual mirror paradigm.

PubMed

Kang, Youn Joo; Park, Hae Kyung; Kim, Hyun Jung; Lim, Taeo; Ku, Jeonghun; Cho, Sangwoo; Kim, Sun I; Park, Eun Sook

2012-10-04

Several experimental studies in stroke patients suggest that mirror therapy and various virtual reality programs facilitate motor rehabilitation. However, the underlying mechanisms for these therapeutic effects have not been previously described. We attempted to delineate the changes in corticospinal excitability when individuals were asked to exercise their upper extremity using a real mirror and virtual mirror. Moreover, we attempted to delineate the role of visual modulation within the virtual environment that affected corticospinal excitability in healthy subjects and stroke patients. A total of 18 healthy subjects and 18 hemiplegic patients were enrolled into the study. Motor evoked potential (MEP)s from transcranial magnetic stimulation were recorded in the flexor carpi radialis of the non-dominant or affected upper extremity using three different conditions: (A) relaxation; (B) real mirror; and (C) virtual mirror. Moreover, we compared the MEPs from the virtual mirror paradigm using continuous visual feedback or intermittent visual feedback. The rates of amplitude increment and latency decrement of MEPs in both groups were higher during the virtual mirror task than during the real mirror. In healthy subjects and stroke patients, the virtual mirror task with intermittent visual feedback significantly facilitated corticospinal excitability of MEPs compared with continuous visual feedback. Corticospinal excitability was facilitated to a greater extent in the virtual mirror paradigm than in the real mirror and in intermittent visual feedback than in the continuous visual feedback, in both groups. This provides neurophysiological evidence supporting the application of the virtual mirror paradigm using various visual modulation technologies to upper extremity rehabilitation in stroke patients.

Upper extremity rehabilitation of stroke: Facilitation of corticospinal excitability using virtual mirror paradigm

PubMed Central

2012-01-01

Background Several experimental studies in stroke patients suggest that mirror therapy and various virtual reality programs facilitate motor rehabilitation. However, the underlying mechanisms for these therapeutic effects have not been previously described. Objectives We attempted to delineate the changes in corticospinal excitability when individuals were asked to exercise their upper extremity using a real mirror and virtual mirror. Moreover, we attempted to delineate the role of visual modulation within the virtual environment that affected corticospinal excitability in healthy subjects and stroke patients. Methods A total of 18 healthy subjects and 18 hemiplegic patients were enrolled into the study. Motor evoked potential (MEP)s from transcranial magnetic stimulation were recorded in the flexor carpi radialis of the non-dominant or affected upper extremity using three different conditions: (A) relaxation; (B) real mirror; and (C) virtual mirror. Moreover, we compared the MEPs from the virtual mirror paradigm using continuous visual feedback or intermittent visual feedback. Results The rates of amplitude increment and latency decrement of MEPs in both groups were higher during the virtual mirror task than during the real mirror. In healthy subjects and stroke patients, the virtual mirror task with intermittent visual feedback significantly facilitated corticospinal excitability of MEPs compared with continuous visual feedback. Conclusion Corticospinal excitability was facilitated to a greater extent in the virtual mirror paradigm than in the real mirror and in intermittent visual feedback than in the continuous visual feedback, in both groups. This provides neurophysiological evidence supporting the application of the virtual mirror paradigm using various visual modulation technologies to upper extremity rehabilitation in stroke patients. PMID:23035951

Multimodal representation of limb endpoint position in the posterior parietal cortex.

PubMed

Shi, Ying; Apker, Gregory; Buneo, Christopher A

2013-04-01

Understanding the neural representation of limb position is important for comprehending the control of limb movements and the maintenance of body schema, as well as for the development of neuroprosthetic systems designed to replace lost limb function. Multiple subcortical and cortical areas contribute to this representation, but its multimodal basis has largely been ignored. Regarding the parietal cortex, previous results suggest that visual information about arm position is not strongly represented in area 5, although these results were obtained under conditions in which animals were not using their arms to interact with objects in their environment, which could have affected the relative weighting of relevant sensory signals. Here we examined the multimodal basis of limb position in the superior parietal lobule (SPL) as monkeys reached to and actively maintained their arm position at multiple locations in a frontal plane. On half of the trials both visual and nonvisual feedback of the endpoint of the arm were available, while on the other trials visual feedback was withheld. Many neurons were tuned to arm position, while a smaller number were modulated by the presence/absence of visual feedback. Visual modulation generally took the form of a decrease in both firing rate and variability with limb vision and was associated with more accurate decoding of position at the population level under these conditions. These findings support a multimodal representation of limb endpoint position in the SPL but suggest that visual signals are relatively weakly represented in this area, and only at the population level.

A low cost, adaptive mixed reality system for home-based stroke rehabilitation.

PubMed

Chen, Yinpeng; Baran, Michael; Sundaram, Hari; Rikakis, Thanassis

2011-01-01

This paper presents a novel, low-cost, real-time adaptive multimedia environment for home-based upper extremity rehabilitation of stroke survivors. The primary goal of this system is to provide an interactive tool with which the stroke survivor can sustain gains achieved within the clinical phase of therapy and increase the opportunity for functional recovery. This home-based mediated system has low cost sensing, off the shelf components for the auditory and visual feedback, and remote monitoring capability. The system is designed to continue active learning by reducing dependency on real-time feedback and focusing on summary feedback after a single task and sequences of tasks. To increase system effectiveness through customization, we use data from the training strategy developed by the therapist at the clinic for each stroke survivor to drive automated system adaptation at the home. The adaptation includes changing training focus, selecting proper feedback coupling both in real-time and in summary, and constructing appropriate dialogues with the stroke survivor to promote more efficient use of the system. This system also allows the therapist to review participant's progress and adjust the training strategy weekly.

A Portable Sensory Augmentation Device for Balance Rehabilitation Using Fingertip Skin Stretch Feedback.

PubMed

Pan, Yi-Tsen; Yoon, Han U; Hur, P

2017-01-01

Neurological disorders are the leading causes of poor balance. Previous studies have shown that biofeedback can compensate for weak or missing sensory information in people with sensory deficits. These biofeedback inputs can be easily recognized and converted into proper information by the central nervous system (CNS), which integrates the appropriate sensorimotor information and stabilizes the human posture. In this study, we proposed a form of cutaneous feedback which stretches the fingertip pad with a rotational contactor, so-called skin stretch. Skin stretch at a fingertip pad can be simply perceived and its small contact area makes it favored for small wearable devices. Taking advantage of skin stretch feedback, we developed a portable sensory augmentation device (SAD) for rehabilitation of balance. SAD was designed to provide postural sway information through additional skin stretch feedback. To demonstrate the feasibility of the SAD, quiet standing on a force plate was evaluated while sensory deficits were simulated. Fifteen healthy young adults were asked to stand quietly under six sensory conditions: three levels of sensory deficits (normal, visual deficit, and visual + vestibular deficits) combined with and without augmented sensation provided by SAD. The results showed that augmented sensation via skin stretch feedback helped subjects correct their posture and balance, especially as the deficit level of sensory feedback increased. These findings demonstrate the potential use of skin stretch feedback in balance rehabilitation.

Stability of hand force production. I. Hand level control variables and multifinger synergies.

PubMed

Reschechtko, Sasha; Latash, Mark L

2017-12-01

We combined the theory of neural control of movement with referent coordinates and the uncontrolled manifold hypothesis to explore synergies stabilizing the hand action in accurate four-finger pressing tasks. In particular, we tested a hypothesis on two classes of synergies, those among the four fingers and those within a pair of control variables, stabilizing hand action under visual feedback and disappearing without visual feedback. Subjects performed four-finger total force and moment production tasks under visual feedback; the feedback was later partially or completely removed. The "inverse piano" device was used to lift and lower the fingers smoothly at the beginning and at the end of each trial. These data were used to compute pairs of hypothetical control variables. Intertrial analysis of variance within the finger force space was used to quantify multifinger synergies stabilizing both force and moment. A data permutation method was used to quantify synergies among control variables. Under visual feedback, synergies in the spaces of finger forces and hypothetical control variables were found to stabilize total force. Without visual feedback, the subjects showed a force drift to lower magnitudes and a moment drift toward pronation. This was accompanied by disappearance of the four-finger synergies and strong attenuation of the control variable synergies. The indexes of the two types of synergies correlated with each other. The findings are interpreted within the scheme with multiple levels of abundant variables. NEW & NOTEWORTHY We extended the idea of hierarchical control with referent spatial coordinates for the effectors and explored two types of synergies stabilizing multifinger force production tasks. We observed synergies among finger forces and synergies between hypothetical control variables that stabilized performance under visual feedback but failed to stabilize it after visual feedback had been removed. Indexes of two types of synergies correlated with each other. The data suggest the existence of multiple mechanisms stabilizing motor actions. Copyright © 2017 the American Physiological Society.

Public health nurse perceptions of Omaha System data visualization.

PubMed

Lee, Seonah; Kim, Era; Monsen, Karen A

2015-10-01

Electronic health records (EHRs) provide many benefits related to the storage, deployment, and retrieval of large amounts of patient data. However, EHRs have not fully met the need to reuse data for decision making on follow-up care plans. Visualization offers new ways to present health data, especially in EHRs. Well-designed data visualization allows clinicians to communicate information efficiently and effectively, contributing to improved interpretation of clinical data and better patient care monitoring and decision making. Public health nurse (PHN) perceptions of Omaha System data visualization prototypes for use in EHRs have not been evaluated. To visualize PHN-generated Omaha System data and assess PHN perceptions regarding the visual validity, helpfulness, usefulness, and importance of the visualizations, including interactive functionality. Time-oriented visualization for problems and outcomes and Matrix visualization for problems and interventions were developed using PHN-generated Omaha System data to help PHNs consume data and plan care at the point of care. Eleven PHNs evaluated prototype visualizations. Overall PHNs response to visualizations was positive, and feedback for improvement was provided. This study demonstrated the potential for using visualization techniques within EHRs to summarize Omaha System patient data for clinicians. Further research is needed to improve and refine these visualizations and assess the potential to incorporate visualizations within clinical EHRs. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

External self-representations improve self-awareness in a child with autism.

PubMed

Root, Nicholas B; Case, Laura K; Burrus, Caley J; Ramachandran, V S

2015-01-01

We have previously suggested that the social symptoms of autism spectrum disorder (ASD) could be caused in part by a dysfunctional mirror neuron system (MNS). Since the recursive activity of a functioning MNS might enable the brain to integrate visual and motor sensations into a coherent body schema, the deficits in self-awareness often seen in ASD might be caused by the same mirror neuron dysfunction. CL is an autistic adolescent who is profoundly fascinated with his reflection, looking in mirrors at every opportunity. We demonstrate that CL's abnormal gait improves significantly when using a mirror for visual feedback. We also show that both the fascination and the happiness that CL derives from looking at a computer-generated reflection diminish when a delay is introduced between the camera input and screen output. We believe that immediate, real-time visual feedback allows CL to integrate motor sensations with external visual ones into a coherent body schema that he cannot internally generate, perhaps due to a dysfunctional MNS.

Probing feedforward and feedback contributions to awareness with visual masking and transcranial magnetic stimulation.

PubMed

Tapia, Evelina; Beck, Diane M

2014-01-01

A number of influential theories posit that visual awareness relies not only on the initial, stimulus-driven (i.e., feedforward) sweep of activation but also on recurrent feedback activity within and between brain regions. These theories of awareness draw heavily on data from masking paradigms in which visibility of one stimulus is reduced due to the presence of another stimulus. More recently transcranial magnetic stimulation (TMS) has been used to study the temporal dynamics of visual awareness. TMS over occipital cortex affects performance on visual tasks at distinct time points and in a manner that is comparable to visual masking. We draw parallels between these two methods and examine evidence for the neural mechanisms by which visual masking and TMS suppress stimulus visibility. Specifically, both methods have been proposed to affect feedforward as well as feedback signals when applied at distinct time windows relative to stimulus onset and as a result modify visual awareness. Most recent empirical evidence, moreover, suggests that while visual masking and TMS impact stimulus visibility comparably, the processes these methods affect may not be as similar as previously thought. In addition to reviewing both masking and TMS studies that examine feedforward and feedback processes in vision, we raise questions to guide future studies and further probe the necessary conditions for visual awareness.

Integrative Advances for OCT-Guided Ophthalmic Surgery and Intraoperative OCT: Microscope Integration, Surgical Instrumentation, and Heads-Up Display Surgeon Feedback

PubMed Central

Ehlers, Justis P.; Srivastava, Sunil K.; Feiler, Daniel; Noonan, Amanda I.; Rollins, Andrew M.; Tao, Yuankai K.

2014-01-01

Purpose To demonstrate key integrative advances in microscope-integrated intraoperative optical coherence tomography (iOCT) technology that will facilitate adoption and utilization during ophthalmic surgery. Methods We developed a second-generation prototype microscope-integrated iOCT system that interfaces directly with a standard ophthalmic surgical microscope. Novel features for improved design and functionality included improved profile and ergonomics, as well as a tunable lens system for optimized image quality and heads-up display (HUD) system for surgeon feedback. Novel material testing was performed for potential suitability for OCT-compatible instrumentation based on light scattering and transmission characteristics. Prototype surgical instruments were developed based on material testing and tested using the microscope-integrated iOCT system. Several surgical maneuvers were performed and imaged, and surgical motion visualization was evaluated with a unique scanning and image processing protocol. Results High-resolution images were successfully obtained with the microscope-integrated iOCT system with HUD feedback. Six semi-transparent materials were characterized to determine their attenuation coefficients and scatter density with an 830 nm OCT light source. Based on these optical properties, polycarbonate was selected as a material substrate for prototype instrument construction. A surgical pick, retinal forceps, and corneal needle were constructed with semi-transparent materials. Excellent visualization of both the underlying tissues and surgical instrument were achieved on OCT cross-section. Using model eyes, various surgical maneuvers were visualized, including membrane peeling, vessel manipulation, cannulation of the subretinal space, subretinal intraocular foreign body removal, and corneal penetration. Conclusions Significant iterative improvements in integrative technology related to iOCT and ophthalmic surgery are demonstrated. PMID:25141340

Interactive Games with an Assistive Robotic System for Hearing-Impaired Children.

PubMed

Uluer, Pinar; Akalin, Neziha; Gurpinar, Cemal; Kose, Hatice

2017-01-01

This paper presents an assistive robotic system, which can recognize and express sign language words from a predefined set, within interactive games to communicate with and teach hearing-impaired children sign language. The robotic system uses audio, visual and tactile feedback for interaction with the children and the teacher/researcher.

Differential sensory cortical involvement in auditory and visual sensorimotor temporal recalibration: Evidence from transcranial direct current stimulation (tDCS).

PubMed

Aytemür, Ali; Almeida, Nathalia; Lee, Kwang-Hyuk

2017-02-01

Adaptation to delayed sensory feedback following an action produces a subjective time compression between the action and the feedback (temporal recalibration effect, TRE). TRE is important for sensory delay compensation to maintain a relationship between causally related events. It is unclear whether TRE is a sensory modality-specific phenomenon. In 3 experiments employing a sensorimotor synchronization task, we investigated this question using cathodal transcranial direct-current stimulation (tDCS). We found that cathodal tDCS over the visual cortex, and to a lesser extent over the auditory cortex, produced decreased visual TRE. However, both auditory and visual cortex tDCS did not produce any measurable effects on auditory TRE. Our study revealed different nature of TRE in auditory and visual domains. Visual-motor TRE, which is more variable than auditory TRE, is a sensory modality-specific phenomenon, modulated by the auditory cortex. The robustness of auditory-motor TRE, unaffected by tDCS, suggests the dominance of the auditory system in temporal processing, by providing a frame of reference in the realignment of sensorimotor timing signals. Copyright © 2017 Elsevier Ltd. All rights reserved.

Optimality and stability of intentional and unintentional actions: I. Origins of drifts in performance.

PubMed

Parsa, Behnoosh; Terekhov, Alexander; Zatsiorsky, Vladimir M; Latash, Mark L

2017-02-01

We address the nature of unintentional changes in performance in two papers. This first paper tested a hypothesis that unintentional changes in performance variables during continuous tasks without visual feedback are due to two processes. First, there is a drift of the referent coordinate for the salient performance variable toward the actual coordinate of the effector. Second, there is a drift toward minimum of a cost function. We tested this hypothesis in four-finger isometric pressing tasks that required the accurate production of a combination of total moment and total force with natural and modified finger involvement. Subjects performed accurate force-moment production tasks under visual feedback, and then visual feedback was removed for some or all of the salient variables. Analytical inverse optimization was used to compute a cost function. Without visual feedback, both force and moment drifted slowly toward lower absolute magnitudes. Over 15 s, the force drop could reach 20% of its initial magnitude while moment drop could reach 30% of its initial magnitude. Individual finger forces could show drifts toward both higher and lower forces. The cost function estimated using the analytical inverse optimization reduced its value as a consequence of the drift. We interpret the results within the framework of hierarchical control with referent spatial coordinates for salient variables at each level of the hierarchy combined with synergic control of salient variables. The force drift is discussed as a natural relaxation process toward states with lower potential energy in the physical (physiological) system involved in the task.

Optimality and stability of intentional and unintentional actions: I. Origins of drifts in performance

PubMed Central

Parsa, Behnoosh; Terekhov, Alexander; Zatsiorsky, Vladimir M.; Latash, Mark L.

2016-01-01

We address the nature of unintentional changes in performance in two papers. This first paper tested a hypothesis that unintentional changes in performance variables during continuous tasks without visual feedback are due to two processes. First, there is a drift of the referent coordinate for the salient performance variable toward the actual coordinate of the effector. Second, there is a drift toward minimum of a cost function. We tested this hypothesis in four-finger isometric pressing tasks that required the accurate production of a combination of total moment and total force with natural and modified finger involvement. Subjects performed accurate force/moment production tasks under visual feedback, and then visual feedback was removed for some or all of the salient variables. Analytical inverse optimization was used to compute a cost function. Without visual feedback, both force and moment drifted slowly toward lower absolute magnitudes. Over 15 s, the force drop could reach 20% of its initial magnitude while moment drop could reach 30% of its initial magnitude. Individual finger forces could show drifts toward both higher and lower forces. The cost function estimated using the analytical inverse optimization reduced its value as a consequence of the drift. We interpret the results within the framework of hierarchical control with referent spatial coordinates for salient variables at each level of the hierarchy combined with synergic control of salient variables. The force drift is discussed as a natural relaxation process toward states with lower potential energy in the physical (physiological) system involved in the task. PMID:27785549

Visual Feedback Dominates the Sense of Agency for Brain-Machine Actions

PubMed Central

Evans, Nathan; Gale, Steven; Schurger, Aaron; Blanke, Olaf

2015-01-01

Recent advances in neuroscience and engineering have led to the development of technologies that permit the control of external devices through real-time decoding of brain activity (brain-machine interfaces; BMI). Though the feeling of controlling bodily movements (sense of agency; SOA) has been well studied and a number of well-defined sensorimotor and cognitive mechanisms have been put forth, very little is known about the SOA for BMI-actions. Using an on-line BMI, and verifying that our subjects achieved a reasonable level of control, we sought to describe the SOA for BMI-mediated actions. Our results demonstrate that discrepancies between decoded neural activity and its resultant real-time sensory feedback are associated with a decrease in the SOA, similar to SOA mechanisms proposed for bodily actions. However, if the feedback discrepancy serves to correct a poorly controlled BMI-action, then the SOA can be high and can increase with increasing discrepancy, demonstrating the dominance of visual feedback on the SOA. Taken together, our results suggest that bodily and BMI-actions rely on common mechanisms of sensorimotor integration for agency judgments, but that visual feedback dominates the SOA in the absence of overt bodily movements or proprioceptive feedback, however erroneous the visual feedback may be. PMID:26066840

Visuomotor adaptation needs a validation of prediction error by feedback error

PubMed Central

Gaveau, Valérie; Prablanc, Claude; Laurent, Damien; Rossetti, Yves; Priot, Anne-Emmanuelle

2014-01-01

The processes underlying short-term plasticity induced by visuomotor adaptation to a shifted visual field are still debated. Two main sources of error can induce motor adaptation: reaching feedback errors, which correspond to visually perceived discrepancies between hand and target positions, and errors between predicted and actual visual reafferences of the moving hand. These two sources of error are closely intertwined and difficult to disentangle, as both the target and the reaching limb are simultaneously visible. Accordingly, the goal of the present study was to clarify the relative contributions of these two types of errors during a pointing task under prism-displaced vision. In “terminal feedback error” condition, viewing of their hand by subjects was allowed only at movement end, simultaneously with viewing of the target. In “movement prediction error” condition, viewing of the hand was limited to movement duration, in the absence of any visual target, and error signals arose solely from comparisons between predicted and actual reafferences of the hand. In order to prevent intentional corrections of errors, a subthreshold, progressive stepwise increase in prism deviation was used, so that subjects remained unaware of the visual deviation applied in both conditions. An adaptive aftereffect was observed in the “terminal feedback error” condition only. As far as subjects remained unaware of the optical deviation and self-assigned pointing errors, prediction error alone was insufficient to induce adaptation. These results indicate a critical role of hand-to-target feedback error signals in visuomotor adaptation; consistent with recent neurophysiological findings, they suggest that a combination of feedback and prediction error signals is necessary for eliciting aftereffects. They also suggest that feedback error updates the prediction of reafferences when a visual perturbation is introduced gradually and cognitive factors are eliminated or strongly attenuated. PMID:25408644

Dissociating error-based and reinforcement-based loss functions during sensorimotor learning

PubMed Central

McGregor, Heather R.; Mohatarem, Ayman

2017-01-01

It has been proposed that the sensorimotor system uses a loss (cost) function to evaluate potential movements in the presence of random noise. Here we test this idea in the context of both error-based and reinforcement-based learning. In a reaching task, we laterally shifted a cursor relative to true hand position using a skewed probability distribution. This skewed probability distribution had its mean and mode separated, allowing us to dissociate the optimal predictions of an error-based loss function (corresponding to the mean of the lateral shifts) and a reinforcement-based loss function (corresponding to the mode). We then examined how the sensorimotor system uses error feedback and reinforcement feedback, in isolation and combination, when deciding where to aim the hand during a reach. We found that participants compensated differently to the same skewed lateral shift distribution depending on the form of feedback they received. When provided with error feedback, participants compensated based on the mean of the skewed noise. When provided with reinforcement feedback, participants compensated based on the mode. Participants receiving both error and reinforcement feedback continued to compensate based on the mean while repeatedly missing the target, despite receiving auditory, visual and monetary reinforcement feedback that rewarded hitting the target. Our work shows that reinforcement-based and error-based learning are separable and can occur independently. Further, when error and reinforcement feedback are in conflict, the sensorimotor system heavily weights error feedback over reinforcement feedback. PMID:28753634

Dissociating error-based and reinforcement-based loss functions during sensorimotor learning.

PubMed

Cashaback, Joshua G A; McGregor, Heather R; Mohatarem, Ayman; Gribble, Paul L

2017-07-01

It has been proposed that the sensorimotor system uses a loss (cost) function to evaluate potential movements in the presence of random noise. Here we test this idea in the context of both error-based and reinforcement-based learning. In a reaching task, we laterally shifted a cursor relative to true hand position using a skewed probability distribution. This skewed probability distribution had its mean and mode separated, allowing us to dissociate the optimal predictions of an error-based loss function (corresponding to the mean of the lateral shifts) and a reinforcement-based loss function (corresponding to the mode). We then examined how the sensorimotor system uses error feedback and reinforcement feedback, in isolation and combination, when deciding where to aim the hand during a reach. We found that participants compensated differently to the same skewed lateral shift distribution depending on the form of feedback they received. When provided with error feedback, participants compensated based on the mean of the skewed noise. When provided with reinforcement feedback, participants compensated based on the mode. Participants receiving both error and reinforcement feedback continued to compensate based on the mean while repeatedly missing the target, despite receiving auditory, visual and monetary reinforcement feedback that rewarded hitting the target. Our work shows that reinforcement-based and error-based learning are separable and can occur independently. Further, when error and reinforcement feedback are in conflict, the sensorimotor system heavily weights error feedback over reinforcement feedback.

Modeling trial by trial and block feedback in perceptual learning

PubMed Central

Liu, Jiajuan; Dosher, Barbara; Lu, Zhong-Lin

2014-01-01

Feedback has been shown to play a complex role in visual perceptual learning. It is necessary for performance improvement in some conditions while not others. Different forms of feedback, such as trial-by-trial feedback or block feedback, may both facilitate learning, but with different mechanisms. False feedback can abolish learning. We account for all these results with the Augmented Hebbian Reweight Model (AHRM). Specifically, three major factors in the model advance performance improvement: the external trial-by-trial feedback when available, the self-generated output as an internal feedback when no external feedback is available, and the adaptive criterion control based on the block feedback. Through simulating a comprehensive feedback study (Herzog & Fahle 1997, Vision Research, 37 (15), 2133–2141), we show that the model predictions account for the pattern of learning in seven major feedback conditions. The AHRM can fully explain the complex empirical results on the role of feedback in visual perceptual learning. PMID:24423783

Shaping with Visual Feedback and Token Reinforcement: Effects on Voice Volume Changes in Mentally Retarded Adults.

ERIC Educational Resources Information Center

Bieber, Carrie; Gurski, John C.

In an attempt to confirm earlier results with a group of mentally retarded females, 12 mentally retarded institutionalized adults (8 male, 4 female) were trained to either reduce (Loud group) or increase (Soft group) their voice volumes with a combination of visual feedback and token reinforcement. The feedback unit provided a binary light on-off…

Effect of Training Japanese L1 Speakers in the Production of American English /r/ Using Spectrographic Visual Feedback

ERIC Educational Resources Information Center

Patten, Iomi; Edmonds, Lisa A.

2015-01-01

The present study examines the effects of training native Japanese speakers in the production of American /r/ using spectrographic visual feedback. Within a modified single-subject design, two native Japanese participants produced single words containing /r/ in a variety of positions while viewing live spectrographic feedback with the aim of…

Augmented Feedback System to Support Physical Therapy of Non-specific Low Back Pain

NASA Astrophysics Data System (ADS)

Brodbeck, Dominique; Degen, Markus; Stanimirov, Michael; Kool, Jan; Scheermesser, Mandy; Oesch, Peter; Neuhaus, Cornelia

Low back pain is an important problem in industrialized countries. Two key factors limit the effectiveness of physiotherapy: low compliance of patients with repetitive movement exercises, and inadequate awareness of patients of their own posture. The Backtrainer system addresses these problems by real-time monitoring of the spine position, by providing a framework for most common physiotherapy exercises for the low back, and by providing feedback to patients in a motivating way. A minimal sensor configuration was identified as two inertial sensors that measure the orientation of the lower back at two points with three degrees of freedom. The software was designed as a flexible platform to experiment with different hardware, and with various feedback modalities. Basic exercises for two types of movements are provided: mobilizing and stabilizing. We developed visual feedback - abstract as well as in the form of a virtual reality game - and complemented the on-screen graphics with an ambient feedback device. The system was evaluated during five weeks in a rehabilitation clinic with 26 patients and 15 physiotherapists. Subjective satisfaction of subjects was good, and we interpret the results as encouraging indication for the adoption of such a therapy support system by both patients and therapists.

fMRI characterisation of widespread brain networks relevant for behavioural variability in fine hand motor control with and without visual feedback.

PubMed

Mayhew, Stephen D; Porcaro, Camillo; Tecchio, Franca; Bagshaw, Andrew P

2017-03-01

A bilateral visuo-parietal-motor network is responsible for fine control of hand movements. However, the sub-regions which are devoted to maintenance of contraction stability and how these processes fluctuate with trial-quality of task execution and in the presence/absence of visual feedback remains unclear. We addressed this by integrating behavioural and fMRI measurements during right-hand isometric compression of a compliant rubber bulb, at 10% and 30% of maximum voluntary contraction, both with and without visual feedback of the applied force. We quantified single-trial behavioural performance during 1) the whole task period and 2) stable contraction maintenance, and regressed these metrics against the fMRI data to identify the brain activity most relevant to trial-by-trial fluctuations in performance during specific task phases. fMRI-behaviour correlations in a bilateral network of visual, premotor, primary motor, parietal and inferior frontal cortical regions emerged during performance of the entire feedback task, but only in premotor, parietal cortex and thalamus during the stable contraction period. The trials with the best task performance showed increased bilaterality and amplitude of fMRI responses. With feedback, stronger BOLD-behaviour coupling was found during 10% compared to 30% contractions. Only a small subset of regions in this network were weakly correlated with behaviour without feedback, despite wider network activated during this task than in the presence of feedback. These findings reflect a more focused network strongly coupled to behavioural fluctuations when providing visual feedback, whereas without it the task recruited widespread brain activity almost uncoupled from behavioural performance. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Mirror Visual Feedback Induces Lower Neuromuscular Activity in Children with Spastic Hemiparetic Cerebral Palsy

ERIC Educational Resources Information Center

Feltham, Max G.; Ledebt, Annick; Deconinck, Frederik J. A.; Savelsbergh, Geert J. P.

2010-01-01

The study examined the effects of mirror feedback information on neuromuscular activation during bimanual coordination in eight children with spastic hemiparetic cerebral palsy (SHCP) and a matched control group. The "mirror box" creates a visual illusion, which gives rise to a visual perception of a zero lag, symmetric movement between the two…

Probing feedforward and feedback contributions to awareness with visual masking and transcranial magnetic stimulation

PubMed Central

Tapia, Evelina; Beck, Diane M.

2014-01-01

A number of influential theories posit that visual awareness relies not only on the initial, stimulus-driven (i.e., feedforward) sweep of activation but also on recurrent feedback activity within and between brain regions. These theories of awareness draw heavily on data from masking paradigms in which visibility of one stimulus is reduced due to the presence of another stimulus. More recently transcranial magnetic stimulation (TMS) has been used to study the temporal dynamics of visual awareness. TMS over occipital cortex affects performance on visual tasks at distinct time points and in a manner that is comparable to visual masking. We draw parallels between these two methods and examine evidence for the neural mechanisms by which visual masking and TMS suppress stimulus visibility. Specifically, both methods have been proposed to affect feedforward as well as feedback signals when applied at distinct time windows relative to stimulus onset and as a result modify visual awareness. Most recent empirical evidence, moreover, suggests that while visual masking and TMS impact stimulus visibility comparably, the processes these methods affect may not be as similar as previously thought. In addition to reviewing both masking and TMS studies that examine feedforward and feedback processes in vision, we raise questions to guide future studies and further probe the necessary conditions for visual awareness. PMID:25374548

Eye-Hand Coordination during Visuomotor Adaptation with Different Rotation Angles: Effects of Terminal Visual Feedback

PubMed Central

Rand, Miya K.; Rentsch, Sebastian

2016-01-01

This study examined adaptive changes of eye-hand coordination during a visuomotor rotation task under the use of terminal visual feedback. Young adults made reaching movements to targets on a digitizer while looking at targets on a monitor where the rotated feedback (a cursor) of hand movements appeared after each movement. Three rotation angles (30°, 75° and 150°) were examined in three groups in order to vary the task difficulty. The results showed that the 30° group gradually reduced direction errors of reaching with practice and adapted well to the visuomotor rotation. The 75° group made large direction errors of reaching, and the 150° group applied a 180° reversal shift from early practice. The 75°and 150° groups, however, overcompensated the respective rotations at the end of practice. Despite these group differences in adaptive changes of reaching, all groups gradually adapted gaze directions prior to reaching from the target area to the areas related to the final positions of reaching during the course of practice. The adaptive changes of both hand and eye movements in all groups mainly reflected adjustments of movement directions based on explicit knowledge of the applied rotation acquired through practice. Only the 30° group showed small implicit adaptation in both effectors. The results suggest that by adapting gaze directions from the target to the final position of reaching based on explicit knowledge of the visuomotor rotation, the oculomotor system supports the limb-motor system to make precise preplanned adjustments of reaching directions during learning of visuomotor rotation under terminal visual feedback. PMID:27812093

A real-time articulatory visual feedback approach with target presentation for second language pronunciation learning.

PubMed

Suemitsu, Atsuo; Dang, Jianwu; Ito, Takayuki; Tiede, Mark

2015-10-01

Articulatory information can support learning or remediating pronunciation of a second language (L2). This paper describes an electromagnetic articulometer-based visual-feedback approach using an articulatory target presented in real-time to facilitate L2 pronunciation learning. This approach trains learners to adjust articulatory positions to match targets for a L2 vowel estimated from productions of vowels that overlap in both L1 and L2. Training of Japanese learners for the American English vowel /æ/ that included visual training improved its pronunciation regardless of whether audio training was also included. Articulatory visual feedback is shown to be an effective method for facilitating L2 pronunciation learning.

Kinect4FOG: monitoring and improving mobility in people with Parkinson's using a novel system incorporating the Microsoft Kinect v2.

PubMed

Amini, Amin; Banitsas, Konstantinos; Young, William R

2018-05-23

Parkinson's is a neurodegenerative condition associated with several motor symptoms including tremors and slowness of movement. Freezing of gait (FOG); the sensation of one's feet being "glued" to the floor, is one of the most debilitating symptoms associated with advanced Parkinson's. FOG not only contributes to falls and related injuries, but also compromises quality of life as people often avoid engaging in functional daily activities both inside and outside the home. In the current study, we describe a novel system designed to detect FOG and falling in people with Parkinson's (PwP) as well as monitoring and improving their mobility using laser-based visual cues cast by an automated laser system. The system utilizes a RGB-D sensor based on Microsoft Kinect v2 and a laser casting system consisting of two servo motors and an Arduino microcontroller. This system was evaluated by 15 PwP with FOG. Here, we present details of the system along with a summary of feedback provided by PwP. Despite limitations regarding its outdoor use, feedback was very positive in terms of domestic usability and convenience, where 12/15 PwP showed interest in installing and using the system at their homes. Implications for Rehabilitation Providing an automatic and remotely manageable monitoring system for PwP gait analysis and fall detection. Providing an automatic, unobtrusive and dynamic visual cue system for PwP based on laser line projection. Gathering feedback from PwP about the practical usage of the implemented system through focus group events.

Effect of Real-Time Feedback on Screw Placement Into Synthetic Cancellous Bone.

PubMed

Gustafson, Peter A; Geeslin, Andrew G; Prior, David M; Chess, Joseph L

2016-08-01

The objective of this study is to evaluate whether real-time torque feedback may reduce the occurrence of stripping when inserting nonlocking screws through fracture plates into synthetic cancellous bone. Five attending orthopaedic surgeons and 5 senior level orthopaedic residents inserted 8 screws in each phase. In phase I, screws were inserted without feedback simulating conventional techniques. In phase II, screws were driven with visual torque feedback. In phase III, screws were again inserted with conventional techniques. Comparison of these 3 phases with respect to screw insertion torque, surgeon rank, and perception of stripping was used to establish the effects of feedback. Seventy-three of 239 screws resulted in stripping. During the first phase, no feedback was provided and the overall strip rate was 41.8%; this decreased to 15% with visual feedback (P < 0.001) and returned to 35% when repeated without feedback. With feedback, a lower average torque was applied over a narrower torque distribution. Residents stripped 40.8% of screws compared with 20.2% for attending surgeons. Surgeons were poor at perceiving whether they stripped. Prevention and identification of stripping is influenced by surgeon perception of tactile sensation. This is significantly improved with utilization of real-time visual feedback of a torque versus roll curve. This concept of real-time feedback seems beneficial toward performance in synthetic cancellous bone and may lead to improved fixation in cancellous bone in a surgical setting.

Bedside assistance in freehand ultrasonic diagnosis by real-time visual feedback of 3D scatter diagram of pulsatile tissue-motion

NASA Astrophysics Data System (ADS)

Fukuzawa, M.; Kawata, K.; Nakamori, N.; Kitsunezuka, Y.

2011-03-01

By real-time visual feedback of 3D scatter diagram of pulsatile tissue-motion, freehand ultrasonic diagnosis of neonatal ischemic diseases has been assisted at the bedside. The 2D ultrasonic movie was taken with a conventional ultrasonic apparatus (ATL HDI5000) and ultrasonic probes of 5-7 MHz with the compact tilt-sensor to measure the probe orientation. The real-time 3D visualization was realized by developing an extended version of the PC-based visualization system. The software was originally developed on the DirectX platform and optimized with the streaming SIMD extensions. The 3D scatter diagram of the latest pulsatile tissues has been continuously generated and visualized as projection image with the ultrasonic movie in the current section more than 15 fps. It revealed the 3D structure of pulsatile tissues such as middle and posterior cerebral arteries, Willis ring and cerebellar arteries, in which pediatricians have great interests in the blood flow because asphyxiated and/or low-birth-weight neonates have a high risk of ischemic diseases such as hypoxic-ischemic encephalopathy and periventricular leukomalacia. Since the pulsatile tissue-motion is due to local blood flow, it can be concluded that the system developed in this work is very useful to assist freehand ultrasonic diagnosis of ischemic diseases in the neonatal cranium.

The ventral visual pathway: an expanded neural framework for the processing of object quality.

PubMed

Kravitz, Dwight J; Saleem, Kadharbatcha S; Baker, Chris I; Ungerleider, Leslie G; Mishkin, Mortimer

2013-01-01

Since the original characterization of the ventral visual pathway, our knowledge of its neuroanatomy, functional properties, and extrinsic targets has grown considerably. Here we synthesize this recent evidence and propose that the ventral pathway is best understood as a recurrent occipitotemporal network containing neural representations of object quality both utilized and constrained by at least six distinct cortical and subcortical systems. Each system serves its own specialized behavioral, cognitive, or affective function, collectively providing the raison d'être for the ventral visual pathway. This expanded framework contrasts with the depiction of the ventral visual pathway as a largely serial staged hierarchy culminating in singular object representations and more parsimoniously incorporates attentional, contextual, and feedback effects. Published by Elsevier Ltd.

An Automated Mouse Tail Vascular Access System by Vision and Pressure Feedback.

PubMed

Chang, Yen-Chi; Berry-Pusey, Brittany; Yasin, Rashid; Vu, Nam; Maraglia, Brandon; Chatziioannou, Arion X; Tsao, Tsu-Chin

2015-08-01

This paper develops an automated vascular access system (A-VAS) with novel vision-based vein and needle detection methods and real-time pressure feedback for murine drug delivery. Mouse tail vein injection is a routine but critical step for preclinical imaging applications. Due to the small vein diameter and external disturbances such as tail hair, pigmentation, and scales, identifying vein location is difficult and manual injections usually result in poor repeatability. To improve the injection accuracy, consistency, safety, and processing time, A-VAS was developed to overcome difficulties in vein detection noise rejection, robustness in needle tracking, and visual servoing integration with the mechatronics system.

Influence of Vibrotactile Feedback on Controlling Tilt Motion After Spaceflight

NASA Technical Reports Server (NTRS)

Wood, S. J.; Rupert, A. H.; Vanya, R. D.; Esteves, J. T.; Clement, G.

2011-01-01

We hypothesize that adaptive changes in how inertial cues from the vestibular system are integrated with other sensory information leads to perceptual disturbances and impaired manual control following transitions between gravity environments. The primary goals of this ongoing post-flight investigation are to quantify decrements in manual control of tilt motion following short-duration spaceflight and to evaluate vibrotactile feedback of tilt as a sensorimotor countermeasure. METHODS. Data is currently being collected on 9 astronaut subjects during 3 preflight sessions and during the first 8 days after Shuttle landings. Variable radius centrifugation (216 deg/s, <20 cm radius) in a darkened room is utilized to elicit otolith reflexes in the lateral plane without concordant canal or visual cues. A Tilt-Translation Sled (TTS) is capable of synchronizing pitch tilt with fore-aft translation to align the resultant gravitoinertial vector with the longitudinal body axis, thereby eliciting canal reflexes without concordant otolith or visual cues. A simple 4 tactor system was implemented to provide feedback when tilt position exceeded predetermined levels in either device. Closed-loop nulling tasks are performed during random tilt steps or sum-of-sines (TTS only) with and without vibrotactile feedback of chair position. RESULTS. On landing day the manual control performance without vibrotactile feedback was reduced by >30% based on the gain or the amount of tilt disturbance successfully nulled. Manual control performance tended to return to baseline levels within 1-2 days following landing. Root-mean-square position error and tilt velocity were significantly reduced with vibrotactile feedback. CONCLUSIONS. These preliminary results are consistent with our hypothesis that adaptive changes in vestibular processing corresponds to reduced manual control performance following G-transitions. A simple vibrotactile prosthesis improves the ability to null out tilt motion within a limited range of motion disturbances.

Memory-guided force control in healthy younger and older adults.

PubMed

Neely, Kristina A; Samimy, Shaadee; Blouch, Samantha L; Wang, Peiyuan; Chennavasin, Amanda; Diaz, Michele T; Dennis, Nancy A

2017-08-01

Successful performance of a memory-guided motor task requires participants to store and then recall an accurate representation of the motor goal. Further, participants must monitor motor output to make adjustments in the absence of visual feedback. The goal of this study was to examine memory-guided grip force in healthy younger and older adults and compare it to performance on behavioral tasks of working memory. Previous work demonstrates that healthy adults decrease force output as a function of time when visual feedback is not available. We hypothesized that older adults would decrease force output at a faster rate than younger adults, due to age-related deficits in working memory. Two groups of participants, younger adults (YA: N = 32, mean age 21.5 years) and older adults (OA: N = 33, mean age 69.3 years), completed four 20-s trials of isometric force with their index finger and thumb, equal to 25% of their maximum voluntary contraction. In the full-vision condition, visual feedback was available for the duration of the trial. In the no vision condition, visual feedback was removed for the last 12 s of each trial. Participants were asked to maintain constant force output in the absence of visual feedback. Participants also completed tasks of word recall and recognition and visuospatial working memory. Counter to our predictions, when visual feedback was removed, younger adults decreased force at a faster rate compared to older adults and the rate of decay was not associated with behavioral performance on tests of working memory.

Effect of feedback techniques for lower back pain on gluteus maximus and oblique abdominal muscle activity and angle of pelvic rotation during the clam exercise.

PubMed

Koh, Eun-Kyung; Park, Kyue-Nam; Jung, Do-Young

2016-11-01

This study was conducted in order to determine the effect of feedback tools on activities of the gluteus maximus (Gmax) and oblique abdominal muscles and the angle of pelvic rotation during clam exercise (CE). Comparative study using repeated measures. University laboratory. Sixteen subjects with lower back pain. Each subject performed the CE without feedback, the CE using a pressure biofeedback unit (CE-PBU), and the CE with palpation and visual feedback (CE-PVF). Electromyographic (EMG) activity and the angles of pelvic rotation were measured using surface EMG and a three-dimensional motion-analysis system, respectively. One-way repeated-measures ANOVA followed by the Bonferroni post hoc test were used to compare the EMG activity in each muscle as well as the angle of pelvic rotation during the CE, CE-PBU, and CE-PVF. The results of post-hoc testing showed a significantly reduced angle of pelvic rotation and significantly more Gmax EMG activity during the CE-PVF compared with during the CE and CE-PBU. These findings suggest that palpation and visual feedback is effective for activating the Gmax and controlling pelvic rotation during the CE in subjects with lower back pain. Copyright © 2016 Elsevier Ltd. All rights reserved.

Design of a haptic device with grasp and push-pull force feedback for a master-slave surgical robot.

PubMed

Hu, Zhenkai; Yoon, Chae-Hyun; Park, Samuel Byeongjun; Jo, Yung-Ho

2016-07-01

We propose a portable haptic device providing grasp (kinesthetic) and push-pull (cutaneous) sensations for optical-motion-capture master interfaces. Although optical-motion-capture master interfaces for surgical robot systems can overcome the stiffness, friction, and coupling problems of mechanical master interfaces, it is difficult to add haptic feedback to an optical-motion-capture master interface without constraining the free motion of the operator's hands. Therefore, we utilized a Bowden cable-driven mechanism to provide the grasp and push-pull sensation while retaining the free hand motion of the optical-motion capture master interface. To evaluate the haptic device, we construct a 2-DOF force sensing/force feedback system. We compare the sensed force and the reproduced force of the haptic device. Finally, a needle insertion test was done to evaluate the performance of the haptic interface in the master-slave system. The results demonstrate that both the grasp force feedback and the push-pull force feedback provided by the haptic interface closely matched with the sensed forces of the slave robot. We successfully apply our haptic interface in the optical-motion-capture master-slave system. The results of the needle insertion test showed that our haptic feedback can provide more safety than merely visual observation. We develop a suitable haptic device to produce both kinesthetic grasp force feedback and cutaneous push-pull force feedback. Our future research will include further objective performance evaluations of the optical-motion-capture master-slave robot system with our haptic interface in surgical scenarios.

Stimulus change as a factor in response maintenance with free food available.

PubMed Central

Osborne, S R; Shelby, M

1975-01-01

Rats bar pressed for food on a reinforcement schedule in which every response was reinforced, even though a dish of pellets was present. Initially, auditory and visual stimuli accompanied response-produced food presentation. With stimulus feedback as an added consequence of bar pressing, responding was maintained in the presence of free food; without stimulus feedback, responding decreased to a low level. Auditory feedback maintained slightly more responding than did visual feedback, and both together maintained more responding than did either separately. Almost no responding occurred when the only consequence of bar pressing was stimulus feedback. The data indicated conditioned and sensory reinforcement effects of response-produced stimulus feedback. PMID:1202121

Data-Driven User Feedback: An Improved Neurofeedback Strategy considering the Interindividual Variability of EEG Features.

PubMed

Han, Chang-Hee; Lim, Jeong-Hwan; Lee, Jun-Hak; Kim, Kangsan; Im, Chang-Hwan

2016-01-01

It has frequently been reported that some users of conventional neurofeedback systems can experience only a small portion of the total feedback range due to the large interindividual variability of EEG features. In this study, we proposed a data-driven neurofeedback strategy considering the individual variability of electroencephalography (EEG) features to permit users of the neurofeedback system to experience a wider range of auditory or visual feedback without a customization process. The main idea of the proposed strategy is to adjust the ranges of each feedback level using the density in the offline EEG database acquired from a group of individuals. Twenty-two healthy subjects participated in offline experiments to construct an EEG database, and five subjects participated in online experiments to validate the performance of the proposed data-driven user feedback strategy. Using the optimized bin sizes, the number of feedback levels that each individual experienced was significantly increased to 139% and 144% of the original results with uniform bin sizes in the offline and online experiments, respectively. Our results demonstrated that the use of our data-driven neurofeedback strategy could effectively increase the overall range of feedback levels that each individual experienced during neurofeedback training.

Data-Driven User Feedback: An Improved Neurofeedback Strategy considering the Interindividual Variability of EEG Features

PubMed Central

Lim, Jeong-Hwan; Lee, Jun-Hak; Kim, Kangsan

2016-01-01

It has frequently been reported that some users of conventional neurofeedback systems can experience only a small portion of the total feedback range due to the large interindividual variability of EEG features. In this study, we proposed a data-driven neurofeedback strategy considering the individual variability of electroencephalography (EEG) features to permit users of the neurofeedback system to experience a wider range of auditory or visual feedback without a customization process. The main idea of the proposed strategy is to adjust the ranges of each feedback level using the density in the offline EEG database acquired from a group of individuals. Twenty-two healthy subjects participated in offline experiments to construct an EEG database, and five subjects participated in online experiments to validate the performance of the proposed data-driven user feedback strategy. Using the optimized bin sizes, the number of feedback levels that each individual experienced was significantly increased to 139% and 144% of the original results with uniform bin sizes in the offline and online experiments, respectively. Our results demonstrated that the use of our data-driven neurofeedback strategy could effectively increase the overall range of feedback levels that each individual experienced during neurofeedback training. PMID:27631005

Patient training in respiratory-gated radiotherapy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kini, Vijay R.; Vedam, Subrahmanya S.; Keall, Paul J.

2003-03-31

Respiratory gating is used to counter the effects of organ motion during radiotherapy for chest tumors. The effects of variations in patient breathing patterns during a single treatment and from day to day are unknown. We evaluated the feasibility of using patient training tools and their effect on the breathing cycle regularity and reproducibility during respiratory-gated radiotherapy. To monitor respiratory patterns, we used a component of a commercially available respiratory-gated radiotherapy system (Real Time Position Management (RPM) System, Varian Oncology Systems, Palo Alto, CA 94304). This passive marker video tracking system consists of reflective markers placed on the patient's chestmore » or abdomen, which are detected by a wall-mounted video camera. Software installed on a PC interfaced to this camera detects the marker motion digitally and records it. The marker position as a function of time serves as the motion signal that may be used to trigger imaging or treatment. The training tools used were audio prompting and visual feedback, with free breathing as a control. The audio prompting method used instructions to 'breathe in' or 'breathe out' at periodic intervals deduced from patients' own breathing patterns. In the visual feedback method, patients were shown a real-time trace of their abdominal wall motion due to breathing. Using this, they were asked to maintain a constant amplitude of motion. Motion traces of the abdominal wall were recorded for each patient for various maneuvers. Free breathing showed a variable amplitude and frequency. Audio prompting resulted in a reproducible frequency; however, the variability and the magnitude of amplitude increased. Visual feedback gave a better control over the amplitude but showed minor variations in frequency. We concluded that training improves the reproducibility of amplitude and frequency of patient breathing cycles. This may increase the accuracy of respiratory-gated radiation therapy.« less

Selective Activation of the Deep Layers of the Human Primary Visual Cortex by Top-Down Feedback.

PubMed

Kok, Peter; Bains, Lauren J; van Mourik, Tim; Norris, David G; de Lange, Floris P

2016-02-08

In addition to bottom-up input, the visual cortex receives large amounts of feedback from other cortical areas [1-3]. One compelling example of feedback activation of early visual neurons in the absence of bottom-up input occurs during the famous Kanizsa illusion, where a triangular shape is perceived, even in regions of the image where there is no bottom-up visual evidence for it. This illusion increases the firing activity of neurons in the primary visual cortex with a receptive field on the illusory contour [4]. Feedback signals are largely segregated from feedforward signals within each cortical area, with feedforward signals arriving in the middle layer, while top-down feedback avoids the middle layers and predominantly targets deep and superficial layers [1, 2, 5, 6]. Therefore, the feedback-mediated activity increase in V1 during the perception of illusory shapes should lead to a specific laminar activity profile that is distinct from the activity elicited by bottom-up stimulation. Here, we used fMRI at high field (7 T) to empirically test this hypothesis, by probing the cortical response to illusory figures in human V1 at different cortical depths [7-14]. We found that, whereas bottom-up stimulation activated all cortical layers, feedback activity induced by illusory figures led to a selective activation of the deep layers of V1. These results demonstrate the potential for non-invasive recordings of neural activity with laminar specificity in humans and elucidate the role of top-down signals during perceptual processing. Copyright © 2016 Elsevier Ltd. All rights reserved.

Game-Based Augmented Visual Feedback for Enlarging Speech Movements in Parkinson's Disease.

PubMed

Yunusova, Yana; Kearney, Elaine; Kulkarni, Madhura; Haworth, Brandon; Baljko, Melanie; Faloutsos, Petros

2017-06-22

The purpose of this pilot study was to demonstrate the effect of augmented visual feedback on acquisition and short-term retention of a relatively simple instruction to increase movement amplitude during speaking tasks in patients with dysarthria due to Parkinson's disease (PD). Nine patients diagnosed with PD, hypokinetic dysarthria, and impaired speech intelligibility participated in a training program aimed at increasing the size of their articulatory (tongue) movements during sentences. Two sessions were conducted: a baseline and training session, followed by a retention session 48 hr later. At baseline, sentences were produced at normal, loud, and clear speaking conditions. Game-based visual feedback regarding the size of the articulatory working space (AWS) was presented during training. Eight of nine participants benefited from training, increasing their sentence AWS to a greater degree following feedback as compared with the baseline loud and clear conditions. The majority of participants were able to demonstrate the learned skill at the retention session. This study demonstrated the feasibility of augmented visual feedback via articulatory kinematics for training movement enlargement in patients with hypokinesia due to PD. https://doi.org/10.23641/asha.5116840.

A neural model of the temporal dynamics of figure-ground segregation in motion perception.

PubMed

Raudies, Florian; Neumann, Heiko

2010-03-01

How does the visual system manage to segment a visual scene into surfaces and objects and manage to attend to a target object? Based on psychological and physiological investigations, it has been proposed that the perceptual organization and segmentation of a scene is achieved by the processing at different levels of the visual cortical hierarchy. According to this, motion onset detection, motion-defined shape segregation, and target selection are accomplished by processes which bind together simple features into fragments of increasingly complex configurations at different levels in the processing hierarchy. As an alternative to this hierarchical processing hypothesis, it has been proposed that the processing stages for feature detection and segregation are reflected in different temporal episodes in the response patterns of individual neurons. Such temporal epochs have been observed in the activation pattern of neurons as low as in area V1. Here, we present a neural network model of motion detection, figure-ground segregation and attentive selection which explains these response patterns in an unifying framework. Based on known principles of functional architecture of the visual cortex, we propose that initial motion and motion boundaries are detected at different and hierarchically organized stages in the dorsal pathway. Visual shapes that are defined by boundaries, which were generated from juxtaposed opponent motions, are represented at different stages in the ventral pathway. Model areas in the different pathways interact through feedforward and modulating feedback, while mutual interactions enable the communication between motion and form representations. Selective attention is devoted to shape representations by sending modulating feedback signals from higher levels (working memory) to intermediate levels to enhance their responses. Areas in the motion and form pathway are coupled through top-down feedback with V1 cells at the bottom end of the hierarchy. We propose that the different temporal episodes in the response pattern of V1 cells, as recorded in recent experiments, reflect the strength of modulating feedback signals. This feedback results from the consolidated shape representations from coherent motion patterns and the attentive modulation of responses along the cortical hierarchy. The model makes testable predictions concerning the duration and delay of the temporal episodes of V1 cell responses as well as their response variations that were caused by modulating feedback signals. Copyright 2009 Elsevier Ltd. All rights reserved.

Real-time vision, tactile cues, and visual form agnosia: removing haptic feedback from a “natural” grasping task induces pantomime-like grasps

PubMed Central

Whitwell, Robert L.; Ganel, Tzvi; Byrne, Caitlin M.; Goodale, Melvyn A.

2015-01-01

Investigators study the kinematics of grasping movements (prehension) under a variety of conditions to probe visuomotor function in normal and brain-damaged individuals. “Natural” prehensile acts are directed at the goal object and are executed using real-time vision. Typically, they also entail the use of tactile, proprioceptive, and kinesthetic sources of haptic feedback about the object (“haptics-based object information”) once contact with the object has been made. Natural and simulated (pantomimed) forms of prehension are thought to recruit different cortical structures: patient DF, who has visual form agnosia following bilateral damage to her temporal-occipital cortex, loses her ability to scale her grasp aperture to the size of targets (“grip scaling”) when her prehensile movements are based on a memory of a target previewed 2 s before the cue to respond or when her grasps are directed towards a visible virtual target but she is denied haptics-based information about the target. In the first of two experiments, we show that when DF performs real-time pantomimed grasps towards a 7.5 cm displaced imagined copy of a visible object such that her fingers make contact with the surface of the table, her grip scaling is in fact quite normal. This finding suggests that real-time vision and terminal tactile feedback are sufficient to preserve DF’s grip scaling slopes. In the second experiment, we examined an “unnatural” grasping task variant in which a tangible target (along with any proxy such as the surface of the table) is denied (i.e., no terminal tactile feedback). To do this, we used a mirror-apparatus to present virtual targets with and without a spatially coincident copy for the participants to grasp. We compared the grasp kinematics from trials with and without terminal tactile feedback to a real-time-pantomimed grasping task (one without tactile feedback) in which participants visualized a copy of the visible target as instructed in our laboratory in the past. Compared to natural grasps, removing tactile feedback increased RT, slowed the velocity of the reach, reduced in-flight grip aperture, increased the slopes relating grip aperture to target width, and reduced the final grip aperture (FGA). All of these effects were also observed in the real time-pantomime grasping task. These effects seem to be independent of those that arise from using the mirror in general as we also compared grasps directed towards virtual targets to those directed at real ones viewed directly through a pane of glass. These comparisons showed that the grasps directed at virtual targets increased grip aperture, slowed the velocity of the reach, and reduced the slopes relating grip aperture to the widths of the target. Thus, using the mirror has real consequences on grasp kinematics, reflecting the importance of task-relevant sources of online visual information for the programming and updating of natural prehensile movements. Taken together, these results provide compelling support for the view that removing terminal tactile feedback, even when the grasps are target-directed, induces a switch from real-time visual control towards one that depends more on visual perception and cognitive supervision. Providing terminal tactile feedback and real-time visual information can evidently keep the dorsal visuomotor system operating normally for prehensile acts. PMID:25999834

Real-time vision, tactile cues, and visual form agnosia: removing haptic feedback from a "natural" grasping task induces pantomime-like grasps.

PubMed

Whitwell, Robert L; Ganel, Tzvi; Byrne, Caitlin M; Goodale, Melvyn A

2015-01-01

Investigators study the kinematics of grasping movements (prehension) under a variety of conditions to probe visuomotor function in normal and brain-damaged individuals. "Natural" prehensile acts are directed at the goal object and are executed using real-time vision. Typically, they also entail the use of tactile, proprioceptive, and kinesthetic sources of haptic feedback about the object ("haptics-based object information") once contact with the object has been made. Natural and simulated (pantomimed) forms of prehension are thought to recruit different cortical structures: patient DF, who has visual form agnosia following bilateral damage to her temporal-occipital cortex, loses her ability to scale her grasp aperture to the size of targets ("grip scaling") when her prehensile movements are based on a memory of a target previewed 2 s before the cue to respond or when her grasps are directed towards a visible virtual target but she is denied haptics-based information about the target. In the first of two experiments, we show that when DF performs real-time pantomimed grasps towards a 7.5 cm displaced imagined copy of a visible object such that her fingers make contact with the surface of the table, her grip scaling is in fact quite normal. This finding suggests that real-time vision and terminal tactile feedback are sufficient to preserve DF's grip scaling slopes. In the second experiment, we examined an "unnatural" grasping task variant in which a tangible target (along with any proxy such as the surface of the table) is denied (i.e., no terminal tactile feedback). To do this, we used a mirror-apparatus to present virtual targets with and without a spatially coincident copy for the participants to grasp. We compared the grasp kinematics from trials with and without terminal tactile feedback to a real-time-pantomimed grasping task (one without tactile feedback) in which participants visualized a copy of the visible target as instructed in our laboratory in the past. Compared to natural grasps, removing tactile feedback increased RT, slowed the velocity of the reach, reduced in-flight grip aperture, increased the slopes relating grip aperture to target width, and reduced the final grip aperture (FGA). All of these effects were also observed in the real time-pantomime grasping task. These effects seem to be independent of those that arise from using the mirror in general as we also compared grasps directed towards virtual targets to those directed at real ones viewed directly through a pane of glass. These comparisons showed that the grasps directed at virtual targets increased grip aperture, slowed the velocity of the reach, and reduced the slopes relating grip aperture to the widths of the target. Thus, using the mirror has real consequences on grasp kinematics, reflecting the importance of task-relevant sources of online visual information for the programming and updating of natural prehensile movements. Taken together, these results provide compelling support for the view that removing terminal tactile feedback, even when the grasps are target-directed, induces a switch from real-time visual control towards one that depends more on visual perception and cognitive supervision. Providing terminal tactile feedback and real-time visual information can evidently keep the dorsal visuomotor system operating normally for prehensile acts.

Review of the Visiting Teachers Service for Children with Hearing and Visual Impairment in Supporting Inclusive Educational Practice in Ireland: Examining Stakeholder Feedback through an Ecological Systems Theory

ERIC Educational Resources Information Center

McLinden, Mike; McCracken, Wendy

2016-01-01

In line with recent developments in inclusive practice in Ireland, children with sensory needs are increasingly educated in mainstream rather than specialist provision. Educational supports are provided by a range of practitioners and include input from the visiting teachers service for children with hearing and visual impairment. This paper…

Effect of Concurrent Visual Feedback Frequency on Postural Control Learning in Adolescents.

PubMed

Marco-Ahulló, Adrià; Sánchez-Tormo, Alexis; García-Pérez, José A; Villarrasa-Sapiña, Israel; González, Luis M; García-Massó, Xavier

2018-04-13

The purpose was to find better augmented visual feedback frequency (100% or 67%) for learning a balance task in adolescents. Thirty subjects were divided randomly into a control group, and 100% and 67% feedback groups. The three groups performed pretest (3 trials), practice (12 trials), posttest (3 trials) and retention (3 trials, 24 hours later). The reduced feedback group showed lower RMS in the posttest than in the pretest (p = 0.04). The control and reduced feedback groups showed significant lower median frequency in the posttest than in the pretest (p < 0.05). Both feedback groups showed lower values in retention than in the pretest (p < 0.05). Even when the effect of feedback frequency could not be detected in motor learning, 67% of the feedback was recommended for motor adaptation.

How Do Batters Use Visual, Auditory, and Tactile Information about the Success of a Baseball Swing?

ERIC Educational Resources Information Center

Gray, Rob

2009-01-01

Bat/ball contact produces visual (the ball leaving the bat), auditory (the "crack" of the bat), and tactile (bat vibration) feedback about the success of the swing. We used a batting simulation to investigate how college baseball players use visual, tactile, and auditory feedback. In Experiment 1, swing accuracy (i.e., the lateral separation…

Microstimulation of area V4 has little effect on spatial attention and on perception of phosphenes evoked in area V1

PubMed Central

Dagnino, Bruno; Gariel-Mathis, Marie-Alice

2014-01-01

Previous transcranial magnetic stimulation (TMS) studies suggested that feedback from higher to lower areas of the visual cortex is important for the access of visual information to awareness. However, the influence of cortico-cortical feedback on awareness and the nature of the feedback effects are not yet completely understood. In the present study, we used electrical microstimulation in the visual cortex of monkeys to test the hypothesis that cortico-cortical feedback plays a role in visual awareness. We investigated the interactions between the primary visual cortex (V1) and area V4 by applying microstimulation in both cortical areas at various delays. We report that the monkeys detected the phosphenes produced by V1 microstimulation but subthreshold V4 microstimulation did not influence V1 phosphene detection thresholds. A second experiment examined the influence of V4 microstimulation on the monkeys' ability to detect the dimming of one of three peripheral visual stimuli. Again, microstimulation of a group of V4 neurons failed to modulate the monkeys' perception of a stimulus in their receptive field. We conclude that conditions exist where microstimulation of area V4 has only a limited influence on visual perception. PMID:25392172

Microstimulation of area V4 has little effect on spatial attention and on perception of phosphenes evoked in area V1.

PubMed

Dagnino, Bruno; Gariel-Mathis, Marie-Alice; Roelfsema, Pieter R

2015-02-01

Previous transcranial magnetic stimulation (TMS) studies suggested that feedback from higher to lower areas of the visual cortex is important for the access of visual information to awareness. However, the influence of cortico-cortical feedback on awareness and the nature of the feedback effects are not yet completely understood. In the present study, we used electrical microstimulation in the visual cortex of monkeys to test the hypothesis that cortico-cortical feedback plays a role in visual awareness. We investigated the interactions between the primary visual cortex (V1) and area V4 by applying microstimulation in both cortical areas at various delays. We report that the monkeys detected the phosphenes produced by V1 microstimulation but subthreshold V4 microstimulation did not influence V1 phosphene detection thresholds. A second experiment examined the influence of V4 microstimulation on the monkeys' ability to detect the dimming of one of three peripheral visual stimuli. Again, microstimulation of a group of V4 neurons failed to modulate the monkeys' perception of a stimulus in their receptive field. We conclude that conditions exist where microstimulation of area V4 has only a limited influence on visual perception. Copyright © 2015 the American Physiological Society.

Consistency of handwriting movements in dementia of the Alzheimer's type: a comparison with Huntington's and Parkinson's diseases.

PubMed

Slavin, M J; Phillips, J G; Bradshaw, J L; Hall, K A; Presnell, I

1999-01-01

Patients with dementia of the Alzheimer's type (DAT) and their matched controls wrote, on a computer graphics tablet, 4 consecutive, cursive letter 'l's, with varying levels of visual feedback: noninking pen and blank paper so that only the hand movements could be seen, noninking pen and lined paper to constrain their writing, goggles to occlude the lower visual field and eliminate all relevant visual feedback, and inking pen with full vision. The kinematic measures of stroke length, duration, and peak velocity were expressed in terms of consistency via a signal-to-noise ratio (M value of each parameter divided by its SD). Irrespective of medication or severity, DAT patients had writing strokes of significantly less consistent lengths than controls', and were disproportionately impaired by reduced visual feedback. Again irrespective of medication or severity, patients' strokes were of significantly less consistent duration, and significantly less consistent peak velocity than controls', independent of feedback conditions. Patients, unlike controls, frequently perseverated, producing more than 4 'l's, or multiple sets of responses, which was not differentially affected by level of visual feedback. The more variable performance of patients supports a degradation of the base motor program, and resembles that of Huntington's rather than Parkinson's disease patients. It may indeed reflect frontal rather than basal ganglia dysfunction.

The Use of Visual Feedback During Signing: Evidence From Signers With Impaired Vision

PubMed Central

Korpics, Franco; Petronio, Karen

2009-01-01

The role of visual feedback during the production of American Sign Language was investigated by comparing the size of signing space during conversations and narrative monologues for normally sighted signers, signers with tunnel vision due to Usher syndrome, and functionally blind signers. The interlocutor for all groups was a normally sighted deaf person. Signers with tunnel vision produced a greater proportion of signs near the face than blind and normally sighted signers, who did not differ from each other. Both groups of visually impaired signers produced signs within a smaller signing space for conversations than for monologues, but we hypothesize that they did so for different reasons. Signers with tunnel vision may align their signing space with that of their interlocutor. In contrast, blind signers may enhance proprioceptive feedback by producing signs within an enlarged signing space for monologues, which do not require switching between tactile and visual signing. Overall, we hypothesize that signers use visual feedback to phonetically calibrate the dimensions of signing space, rather than to monitor language output. PMID:18495656

The use of visual feedback during signing: evidence from signers with impaired vision.

PubMed

Emmorey, Karen; Korpics, Franco; Petronio, Karen

2009-01-01

The role of visual feedback during the production of American Sign Language was investigated by comparing the size of signing space during conversations and narrative monologues for normally sighted signers, signers with tunnel vision due to Usher syndrome, and functionally blind signers. The interlocutor for all groups was a normally sighted deaf person. Signers with tunnel vision produced a greater proportion of signs near the face than blind and normally sighted signers, who did not differ from each other. Both groups of visually impaired signers produced signs within a smaller signing space for conversations than for monologues, but we hypothesize that they did so for different reasons. Signers with tunnel vision may align their signing space with that of their interlocutor. In contrast, blind signers may enhance proprioceptive feedback by producing signs within an enlarged signing space for monologues, which do not require switching between tactile and visual signing. Overall, we hypothesize that signers use visual feedback to phonetically calibrate the dimensions of signing space, rather than to monitor language output.

The Sander parallelogram illusion dissociates action and perception despite control for the litany of past confounds.

PubMed

Whitwell, Robert L; Goodale, Melvyn A; Merritt, Kate E; Enns, James T

2018-01-01

The two visual systems hypothesis proposes that human vision is supported by an occipito-temporal network for the conscious visual perception of the world and a fronto-parietal network for visually-guided, object-directed actions. Two specific claims about the fronto-parietal network's role in sensorimotor control have generated much data and controversy: (1) the network relies primarily on the absolute metrics of target objects, which it rapidly transforms into effector-specific frames of reference to guide the fingers, hands, and limbs, and (2) the network is largely unaffected by scene-based information extracted by the occipito-temporal network for those same targets. These two claims lead to the counter-intuitive prediction that in-flight anticipatory configuration of the fingers during object-directed grasping will resist the influence of pictorial illusions. The research confirming this prediction has been criticized for confounding the difference between grasping and explicit estimates of object size with differences in attention, sensory feedback, obstacle avoidance, metric sensitivity, and priming. Here, we address and eliminate each of these confounds. We asked participants to reach out and pick up 3D target bars resting on a picture of the Sander Parallelogram illusion and to make explicit estimates of the length of those bars. Participants performed their grasps without visual feedback, and were permitted to grasp the targets after making their size-estimates to afford them an opportunity to reduce illusory error with haptic feedback. The results show unequivocally that the effect of the illusion is stronger on perceptual judgments than on grasping. Our findings from the normally-sighted population provide strong support for the proposal that human vision is comprised of functionally and anatomically dissociable systems. Copyright © 2017 Elsevier Ltd. All rights reserved.

Effects of Visual Force Feedback on Robot-Assisted Surgical Task Performance

PubMed Central

Reiley, Carol E.; Akinbiyi, Takintope; Burschka, Darius; Chang, David C.; Okamura, Allison M.; Yuh, David D.

2009-01-01

Background Direct haptic (force or tactile) feedback is negligible in current surgical robotic systems. The relevance of haptic feedback in robot-assisted performances of surgical tasks is controversial. We studied the effects of visual force feedback (VFF), a haptic feedback surrogate, on tying surgical knots with fine sutures similar to those used in cardiovascular surgery. Methods Using a modified da Vinci robotic system (Intuitive Surgical, Inc.) equipped with force-sensing instrument tips and real-time VFF overlays in the console image, ten surgeons each tied 10 knots with and 10 knots without VFF. Four surgeons had significant prior da Vinci experience while the remaining six surgeons did not. Performance parameters, including suture breakage and secure knots, peak and standard deviation of applied forces, and completion times using 5-0 silk sutures were recorded. Chi-square and Student’s t-test analyses determined differences between groups. Results Among surgeon subjects with robotic experience, no differences in measured performance parameters were found between robot-assisted knot ties executed with and without VFF. Among surgeons without robotic experience, however, VFF was associated with lower suture breakage rates, peak applied forces, and standard deviations of applied forces. VFF did not impart differences in knot completion times or loose knots for either surgeon group. Conclusions VFF resulted in reduced suture breakage, lower forces, and decreased force inconsistencies among novice robotic surgeons, although elapsed time and knot quality were unaffected. In contrast, VFF did not affect these metrics among experienced da Vinci surgeons. These results suggest that VFF primarily benefits novice robot-assisted surgeons, with diminishing benefits among experienced surgeons. PMID:18179942

Children with Heavy Prenatal Alcohol Exposure Experience Reduced Control of Isotonic Force

PubMed Central

Nguyen, Tanya T.; Levy, Susan S.; Riley, Edward P.; Thomas, Jennifer D.; Simmons, Roger W.

2013-01-01

Background Heavy prenatal alcohol exposure can result in diverse and extensive damage to the central nervous system, including the cerebellum, basal ganglia, and cerebral cortex. Given that these brain regions are involved in the generation and maintenance of motor force, we predicted that prenatal alcohol exposure would adversely affect this parameter of motor control. We previously reported that children with gestational alcohol exposure experience significant deficits in regulating isometric (i.e., constant) force. The purpose of the present study was to determine if these children exhibit similar deficits when producing isotonic (i.e., graded) force. Methods Children with heavy prenatal alcohol exposure and typically developing children completed a series of isotonic force contractions by exerting force on a load cell to match a criterion target force displayed on a computer monitor. Two levels of target force (5% or 20% of maximum voluntary force) were investigated in combination with varying levels of visual feedback. Results Compared to controls, children with heavy prenatal alcohol exposure generated isotonic force signals that were less accurate, more variable, and less complex in the time domain compared to control children. Specifically, interactions were found between group and visual feedback for response accuracy and signal complexity, suggesting that these children have greater difficulty altering their motor output when visual feedback is low. Conclusions These data suggest that prenatal alcohol exposure produces deficits in regulating isotonic force, which presumably result from alcohol-related damage to developing brain regions involved in motor control. These children will most likely experience difficulty performing basic motor skills and daily functional skills that require coordination of finely graded force. Therapeutic strategies designed to increase feedback and, consequently, facilitate visual-motor integration could improve isotonic force production in these children. PMID:22834891

Proprioceptive feedback determines visuomotor gain in Drosophila

PubMed Central

Bartussek, Jan; Lehmann, Fritz-Olaf

2016-01-01

Multisensory integration is a prerequisite for effective locomotor control in most animals. Especially, the impressive aerial performance of insects relies on rapid and precise integration of multiple sensory modalities that provide feedback on different time scales. In flies, continuous visual signalling from the compound eyes is fused with phasic proprioceptive feedback to ensure precise neural activation of wing steering muscles (WSM) within narrow temporal phase bands of the stroke cycle. This phase-locked activation relies on mechanoreceptors distributed over wings and gyroscopic halteres. Here we investigate visual steering performance of tethered flying fruit flies with reduced haltere and wing feedback signalling. Using a flight simulator, we evaluated visual object fixation behaviour, optomotor altitude control and saccadic escape reflexes. The behavioural assays show an antagonistic effect of wing and haltere signalling on visuomotor gain during flight. Compared with controls, suppression of haltere feedback attenuates while suppression of wing feedback enhances the animal’s wing steering range. Our results suggest that the generation of motor commands owing to visual perception is dynamically controlled by proprioception. We outline a potential physiological mechanism based on the biomechanical properties of WSM and sensory integration processes at the level of motoneurons. Collectively, the findings contribute to our general understanding how moving animals integrate sensory information with dynamically changing temporal structure. PMID:26909184

Open Touch/Sound Maps: A system to convey street data through haptic and auditory feedback

NASA Astrophysics Data System (ADS)

Kaklanis, Nikolaos; Votis, Konstantinos; Tzovaras, Dimitrios

2013-08-01

The use of spatial (geographic) information is becoming ever more central and pervasive in today's internet society but the most of it is currently inaccessible to visually impaired users. However, access in visual maps is severely restricted to visually impaired and people with blindness, due to their inability to interpret graphical information. Thus, alternative ways of a map's presentation have to be explored, in order to enforce the accessibility of maps. Multiple types of sensory perception like touch and hearing may work as a substitute of vision for the exploration of maps. The use of multimodal virtual environments seems to be a promising alternative for people with visual impairments. The present paper introduces a tool for automatic multimodal map generation having haptic and audio feedback using OpenStreetMap data. For a desired map area, an elevation map is being automatically generated and can be explored by touch, using a haptic device. A sonification and a text-to-speech (TTS) mechanism provide also audio navigation information during the haptic exploration of the map.

Sensorimotor adaptation of speech in Parkinson's disease.

PubMed

Mollaei, Fatemeh; Shiller, Douglas M; Gracco, Vincent L

2013-10-01

The basal ganglia are involved in establishing motor plans for a wide range of behaviors. Parkinson's disease (PD) is a manifestation of basal ganglia dysfunction associated with a deficit in sensorimotor integration and difficulty in acquiring new motor sequences, thereby affecting motor learning. Previous studies of sensorimotor integration and sensorimotor adaptation in PD have focused on limb movements using visual and force-field alterations. Here, we report the results from a sensorimotor adaptation experiment investigating the ability of PD patients to make speech motor adjustments to a constant and predictable auditory feedback manipulation. Participants produced speech while their auditory feedback was altered and maintained in a manner consistent with a change in tongue position. The degree of adaptation was associated with the severity of motor symptoms. The patients with PD exhibited adaptation to the induced sensory error; however, the degree of adaptation was reduced compared with healthy, age-matched control participants. The reduced capacity to adapt to a change in auditory feedback is consistent with reduced gain in the sensorimotor system for speech and with previous studies demonstrating limitations in the adaptation of limb movements after changes in visual feedback among patients with PD. © 2013 Movement Disorder Society.

Spatiotemporal dynamics of brain activity during the transition from visually guided to memory-guided force control

PubMed Central

Poon, Cynthia; Chin-Cottongim, Lisa G.; Coombes, Stephen A.; Corcos, Daniel M.

2012-01-01

It is well established that the prefrontal cortex is involved during memory-guided tasks whereas visually guided tasks are controlled in part by a frontal-parietal network. However, the nature of the transition from visually guided to memory-guided force control is not as well established. As such, this study examines the spatiotemporal pattern of brain activity that occurs during the transition from visually guided to memory-guided force control. We measured 128-channel scalp electroencephalography (EEG) in healthy individuals while they performed a grip force task. After visual feedback was removed, the first significant change in event-related activity occurred in the left central region by 300 ms, followed by changes in prefrontal cortex by 400 ms. Low-resolution electromagnetic tomography (LORETA) was used to localize the strongest activity to the left ventral premotor cortex and ventral prefrontal cortex. A second experiment altered visual feedback gain but did not require memory. In contrast to memory-guided force control, altering visual feedback gain did not lead to early changes in the left central and midline prefrontal regions. Decreasing the spatial amplitude of visual feedback did lead to changes in the midline central region by 300 ms, followed by changes in occipital activity by 400 ms. The findings show that subjects rely on sensorimotor memory processes involving left ventral premotor cortex and ventral prefrontal cortex after the immediate transition from visually guided to memory-guided force control. PMID:22696535

The quality of visual information about the lower extremities influences visuomotor coordination during virtual obstacle negotiation.

PubMed

Kim, Aram; Kretch, Kari S; Zhou, Zixuan; Finley, James M

2018-05-09

Successful negotiation of obstacles during walking relies on the integration of visual information about the environment with ongoing locomotor commands. When information about the body and environment are removed through occlusion of the lower visual field, individuals increase downward head pitch angle, reduce foot placement precision, and increase safety margins during crossing. However, whether these effects are mediated by loss of visual information about the lower extremities, the obstacle, or both remains to be seen. Here, we used a fully immersive, virtual obstacle negotiation task to investigate how visual information about the lower extremities is integrated with information about the environment to facilitate skillful obstacle negotiation. Participants stepped over virtual obstacles while walking on a treadmill with one of three types of visual feedback about the lower extremities: no feedback, end-point feedback, or a link-segment model. We found that absence of visual information about the lower extremities led to an increase in the variability of leading foot placement after crossing. The presence of a visual representation of the lower extremities promoted greater downward head pitch angle during the approach to and subsequent crossing of an obstacle. In addition, having greater downward head pitch was associated with closer placement of the trailing foot to the obstacle, further placement of the leading foot after the obstacle, and higher trailing foot clearance. These results demonstrate that the fidelity of visual information about the lower extremities influences both feed-forward and feedback aspects of visuomotor coordination during obstacle negotiation.

Auditory biofeedback substitutes for loss of sensory information in maintaining stance.

PubMed

Dozza, Marco; Horak, Fay B; Chiari, Lorenzo

2007-03-01

The importance of sensory feedback for postural control in stance is evident from the balance improvements occurring when sensory information from the vestibular, somatosensory, and visual systems is available. However, the extent to which also audio-biofeedback (ABF) information can improve balance has not been determined. It is also unknown why additional artificial sensory feedback is more effective for some subjects than others and in some environmental contexts than others. The aim of this study was to determine the relative effectiveness of an ABF system to reduce postural sway in stance in healthy control subjects and in subjects with bilateral vestibular loss, under conditions of reduced vestibular, visual, and somatosensory inputs. This ABF system used a threshold region and non-linear scaling parameters customized for each individual, to provide subjects with pitch and volume coding of their body sway. ABF had the largest effect on reducing the body sway of the subjects with bilateral vestibular loss when the environment provided limited visual and somatosensory information; it had the smallest effect on reducing the sway of subjects with bilateral vestibular loss, when the environment provided full somatosensory information. The extent that all subjects substituted ABF information for their loss of sensory information was related to the extent that each subject was visually dependent or somatosensory-dependent for their postural control. Comparison of postural sway under a variety of sensory conditions suggests that patients with profound bilateral loss of vestibular function show larger than normal information redundancy among the remaining senses and ABF of trunk sway. The results support the hypothesis that the nervous system uses augmented sensory information differently depending both on the environment and on individual proclivities to rely on vestibular, somatosensory or visual information to control sway.

[Real-time feedback systems for improvement of resuscitation quality].

PubMed

Lukas, R P; Van Aken, H; Engel, P; Bohn, A

2011-07-01

The quality of chest compression is a determinant of survival after cardiac arrest. Therefore, the European Resuscitation Council (ERC) 2010 guidelines on resuscitation strongly focus on compression quality. Despite its impact on survival, observational studies have shown that chest compression quality is not reached by professional rescue teams. Real-time feedback devices for resuscitation are able to measure chest compression during an ongoing resuscitation attempt through a sternal sensor equipped with a motion and pressure detection system. In addition to the electrocardiograph (ECG) ventilation can be detected by transthoracic impedance monitoring. In cases of quality deviation, such as shallow chest compression depth or hyperventilation, feedback systems produce visual or acoustic alarms. Rescuers can thereby be supported and guided to the requested quality in chest compression and ventilation. Feedback technology is currently available both as a so-called stand-alone device and as an integrated feature in a monitor/defibrillator unit. Multiple studies have demonstrated sustainable enhancement in the education of resuscitation due to the use of real-time feedback technology. There is evidence that real-time feedback for resuscitation combined with training and debriefing strategies can improve both resuscitation quality and patient survival. Chest compression quality is an independent predictor for survival in resuscitation and should therefore be measured and documented in further clinical multicenter trials.

Program Helps Generate And Manage Graphics

NASA Technical Reports Server (NTRS)

Truong, L. V.

1994-01-01

Living Color Frame Maker (LCFM) computer program generates computer-graphics frames. Graphical frames saved as text files, in readable and disclosed format, easily retrieved and manipulated by user programs for wide range of real-time visual information applications. LCFM implemented in frame-based expert system for visual aids in management of systems. Monitoring, diagnosis, and/or control, diagrams of circuits or systems brought to "life" by use of designated video colors and intensities to symbolize status of hardware components (via real-time feedback from sensors). Status of systems can be displayed. Written in C++ using Borland C++ 2.0 compiler for IBM PC-series computers and compatible computers running MS-DOS.

Alterations in Neural Control of Constant Isometric Contraction with the Size of Error Feedback

PubMed Central

Hwang, Ing-Shiou; Lin, Yen-Ting; Huang, Wei-Min; Yang, Zong-Ru; Hu, Chia-Ling; Chen, Yi-Ching

2017-01-01

Discharge patterns from a population of motor units (MUs) were estimated with multi-channel surface electromyogram and signal processing techniques to investigate parametric differences in low-frequency force fluctuations, MU discharges, and force-discharge relation during static force-tracking with varying sizes of execution error presented via visual feedback. Fourteen healthy adults produced isometric force at 10% of maximal voluntary contraction through index abduction under three visual conditions that scaled execution errors with different amplification factors. Error-augmentation feedback that used a high amplification factor (HAF) to potentiate visualized error size resulted in higher sample entropy, mean frequency, ratio of high-frequency components, and spectral dispersion of force fluctuations than those of error-reducing feedback using a low amplification factor (LAF). In the HAF condition, MUs with relatively high recruitment thresholds in the dorsal interosseous muscle exhibited a larger coefficient of variation for inter-spike intervals and a greater spectral peak of the pooled MU coherence at 13–35 Hz than did those in the LAF condition. Manipulation of the size of error feedback altered the force-discharge relation, which was characterized with non-linear approaches such as mutual information and cross sample entropy. The association of force fluctuations and global discharge trace decreased with increasing error amplification factor. Our findings provide direct neurophysiological evidence that favors motor training using error-augmentation feedback. Amplification of the visualized error size of visual feedback could enrich force gradation strategies during static force-tracking, pertaining to selective increases in the discharge variability of higher-threshold MUs that receive greater common oscillatory inputs in the β-band. PMID:28125658

Equicontrollability and the model following problem

NASA Technical Reports Server (NTRS)

Curran, R. T.

1971-01-01

Equicontrollability and its application to the linear time-invariant model-following problem are discussed. The problem is presented in the form of two systems, the plant and the model. The requirement is to find a controller to apply to the plant so that the resultant compensated plant behaves, in an input-output sense, the same as the model. All systems are assumed to be linear and time-invariant. The basic approach is to find suitable equicontrollable realizations of the plant and model and to utilize feedback so as to produce a controller of minimal state dimension. The concept of equicontrollability is a generalization of control canonical (phase variable) form applied to multivariable systems. It allows one to visualize clearly the effects of feedback and to pinpoint the parameters of a multivariable system which are invariant under feedback. The basic contributions are the development of equicontrollable form; solution of the model-following problem in an entirely algorithmic way, suitable for computer programming; and resolution of questions on system decoupling.

The effect of haptic guidance and visual feedback on learning a complex tennis task.

PubMed

Marchal-Crespo, Laura; van Raai, Mark; Rauter, Georg; Wolf, Peter; Riener, Robert

2013-11-01

While haptic guidance can improve ongoing performance of a motor task, several studies have found that it ultimately impairs motor learning. However, some recent studies suggest that the haptic demonstration of optimal timing, rather than movement magnitude, enhances learning in subjects trained with haptic guidance. Timing of an action plays a crucial role in the proper accomplishment of many motor skills, such as hitting a moving object (discrete timing task) or learning a velocity profile (time-critical tracking task). The aim of the present study is to evaluate which feedback conditions-visual or haptic guidance-optimize learning of the discrete and continuous elements of a timing task. The experiment consisted in performing a fast tennis forehand stroke in a virtual environment. A tendon-based parallel robot connected to the end of a racket was used to apply haptic guidance during training. In two different experiments, we evaluated which feedback condition was more adequate for learning: (1) a time-dependent discrete task-learning to start a tennis stroke and (2) a tracking task-learning to follow a velocity profile. The effect that the task difficulty and subject's initial skill level have on the selection of the optimal training condition was further evaluated. Results showed that the training condition that maximizes learning of the discrete time-dependent motor task depends on the subjects' initial skill level. Haptic guidance was especially suitable for less-skilled subjects and in especially difficult discrete tasks, while visual feedback seems to benefit more skilled subjects. Additionally, haptic guidance seemed to promote learning in a time-critical tracking task, while visual feedback tended to deteriorate the performance independently of the task difficulty and subjects' initial skill level. Haptic guidance outperformed visual feedback, although additional studies are needed to further analyze the effect of other types of feedback visualization on motor learning of time-critical tasks.

Bimanual Coordination Learning with Different Augmented Feedback Modalities and Information Types

PubMed Central

Chiou, Shiau-Chuen; Chang, Erik Chihhung

2016-01-01

Previous studies have shown that bimanual coordination learning is more resistant to the removal of augmented feedback when acquired with auditory than with visual channel. However, it is unclear whether this differential “guidance effect” between feedback modalities is due to enhanced sensorimotor integration via the non-dominant auditory channel or strengthened linkage to kinesthetic information under rhythmic input. The current study aimed to examine how modalities (visual vs. auditory) and information types (continuous visuospatial vs. discrete rhythmic) of concurrent augmented feedback influence bimanual coordination learning. Participants either learned a 90°-out-of-phase pattern for three consecutive days with Lissajous feedback indicating the integrated position of both arms, or with visual or auditory rhythmic feedback reflecting the relative timing of the movement. The results showed diverse performance change after practice when the feedback was removed between Lissajous and the other two rhythmic groups, indicating that the guidance effect may be modulated by the type of information provided during practice. Moreover, significant performance improvement in the dual-task condition where the irregular rhythm counting task was applied as a secondary task also suggested that lower involvement of conscious control may result in better performance in bimanual coordination. PMID:26895286

Bimanual Coordination Learning with Different Augmented Feedback Modalities and Information Types.

PubMed

Chiou, Shiau-Chuen; Chang, Erik Chihhung

2016-01-01

Previous studies have shown that bimanual coordination learning is more resistant to the removal of augmented feedback when acquired with auditory than with visual channel. However, it is unclear whether this differential "guidance effect" between feedback modalities is due to enhanced sensorimotor integration via the non-dominant auditory channel or strengthened linkage to kinesthetic information under rhythmic input. The current study aimed to examine how modalities (visual vs. auditory) and information types (continuous visuospatial vs. discrete rhythmic) of concurrent augmented feedback influence bimanual coordination learning. Participants either learned a 90°-out-of-phase pattern for three consecutive days with Lissajous feedback indicating the integrated position of both arms, or with visual or auditory rhythmic feedback reflecting the relative timing of the movement. The results showed diverse performance change after practice when the feedback was removed between Lissajous and the other two rhythmic groups, indicating that the guidance effect may be modulated by the type of information provided during practice. Moreover, significant performance improvement in the dual-task condition where the irregular rhythm counting task was applied as a secondary task also suggested that lower involvement of conscious control may result in better performance in bimanual coordination.

Task-dependent vestibular feedback responses in reaching.

PubMed

Keyser, Johannes; Medendorp, W Pieter; Selen, Luc P J

2017-07-01

When reaching for an earth-fixed object during self-rotation, the motor system should appropriately integrate vestibular signals and sensory predictions to compensate for the intervening motion and its induced inertial forces. While it is well established that this integration occurs rapidly, it is unknown whether vestibular feedback is specifically processed dependent on the behavioral goal. Here, we studied whether vestibular signals evoke fixed responses with the aim to preserve the hand trajectory in space or are processed more flexibly, correcting trajectories only in task-relevant spatial dimensions. We used galvanic vestibular stimulation to perturb reaching movements toward a narrow or a wide target. Results show that the same vestibular stimulation led to smaller trajectory corrections to the wide than the narrow target. We interpret this reduced compensation as a task-dependent modulation of vestibular feedback responses, tuned to minimally intervene with the task-irrelevant dimension of the reach. These task-dependent vestibular feedback corrections are in accordance with a central prediction of optimal feedback control theory and mirror the sophistication seen in feedback responses to mechanical and visual perturbations of the upper limb. NEW & NOTEWORTHY Correcting limb movements for external perturbations is a hallmark of flexible sensorimotor behavior. While visual and mechanical perturbations are corrected in a task-dependent manner, it is unclear whether a vestibular perturbation, naturally arising when the body moves, is selectively processed in reach control. We show, using galvanic vestibular stimulation, that reach corrections to vestibular perturbations are task dependent, consistent with a prediction of optimal feedback control theory. Copyright © 2017 the American Physiological Society.

The ventral visual pathway: An expanded neural framework for the processing of object quality

PubMed Central

Kravitz, Dwight J.; Saleem, Kadharbatcha S.; Baker, Chris I.; Ungerleider, Leslie G.; Mishkin, Mortimer

2012-01-01

Since the original characterization of the ventral visual pathway our knowledge of its neuroanatomy, functional properties, and extrinsic targets has grown considerably. Here we synthesize this recent evidence and propose that the ventral pathway is best understood as a recurrent occipitotemporal network containing neural representations of object quality both utilized and constrained by at least six distinct cortical and subcortical systems. Each system serves its own specialized behavioral, cognitive, or affective function, collectively providing the raison d’etre for the ventral visual pathway. This expanded framework contrasts with the depiction of the ventral visual pathway as a largely serial staged hierarchy that culminates in singular object representations for utilization mainly by ventrolateral prefrontal cortex and, more parsimoniously than this account, incorporates attentional, contextual, and feedback effects. PMID:23265839

The persistence of a visual dominance effect in a telemanipulator task: A comparison between visual and electrotactile feedback

NASA Technical Reports Server (NTRS)

Gaillard, J. P.

1981-01-01

The possibility to use an electrotactile stimulation in teleoperation and to observe the interpretation of such information as a feedback to the operator was investigated. It is proposed that visual feedback is more informative than an electrotactile one; and that complex electrotactile feedback slows down both the motor decision and motor response processes, is processed as an all or nothing signal, and bypasses the receptive structure and accesses directly in a working memory where information is sequentially processed and where memory is limited in treatment capacity. The electrotactile stimulation is used as an alerting signal. It is suggested that the visual dominance effect is the result of the advantage of both a transfer function and a sensory memory register where information is pretreated and memorized for a short time. It is found that dividing attention has an effect on the acquisition of the information but not on the subsequent decision processes.

Closed-loop control of grasping with a myoelectric hand prosthesis: which are the relevant feedback variables for force control?

PubMed

Ninu, Andrei; Dosen, Strahinja; Muceli, Silvia; Rattay, Frank; Dietl, Hans; Farina, Dario

2014-09-01

In closed-loop control of grasping by hand prostheses, the feedback information sent to the user is usually the actual controlled variable, i.e., the grasp force. Although this choice is intuitive and logical, the force production is only the last step in the process of grasping. Therefore, this study evaluated the performance in controlling grasp strength using a hand prosthesis operated through a complete grasping sequence while varying the feedback variables (e.g., closing velocity, grasping force), which were provided to the user visually or through vibrotactile stimulation. The experiments were conducted on 13 volunteers who controlled the Otto Bock Sensor Hand Speed prosthesis. Results showed that vibrotactile patterns were able to replace the visual feedback. Interestingly, the experiments demonstrated that direct force feedback was not essential for the control of grasping force. The subjects were indeed able to control the grip strength, predictively, by estimating the grasping force from the prosthesis velocity of closing. Therefore, grasping without explicit force feedback is not completely blind, contrary to what is usually assumed. In our study we analyzed grasping with a specific prosthetic device, but the outcomes are also applicable for other devices, with one or more degrees-of-freedom. The necessary condition is that the electromyography (EMG) signal directly and proportionally controls the velocity/grasp force of the hand, which is a common approach among EMG controlled prosthetic devices. The results provide important indications on the design of closed-loop EMG controlled prosthetic systems.

A direct comparison of short-term audiomotor and visuomotor memory.

PubMed

Ward, Amanda M; Loucks, Torrey M; Ofori, Edward; Sosnoff, Jacob J

2014-04-01

Audiomotor and visuomotor short-term memory are required for an important variety of skilled movements but have not been compared in a direct manner previously. Audiomotor memory capacity might be greater to accommodate auditory goals that are less directly related to movement outcome than for visually guided tasks. Subjects produced continuous isometric force with the right index finger under auditory and visual feedback. During the first 10 s of each trial, subjects received continuous auditory or visual feedback. For the following 15 s, feedback was removed but the force had to be maintained accurately. An internal effort condition was included to test memory capacity in the same manner but without external feedback. Similar decay times of ~5-6 s were found for vision and audition but the decay time for internal effort was ~4 s. External feedback thus provides an advantage in maintaining a force level after feedback removal, but may not exclude some contribution from a sense of effort. Short-term memory capacity appears longer than certain previous reports but there may not be strong distinctions in capacity across different sensory modalities, at least for isometric force.

Effects of continuous visual feedback during sitting balance training in chronic stroke survivors.

PubMed

Pellegrino, Laura; Giannoni, Psiche; Marinelli, Lucio; Casadio, Maura

2017-10-16

Postural control deficits are common in stroke survivors and often the rehabilitation programs include balance training based on visual feedback to improve the control of body position or of the voluntary shift of body weight in space. In the present work, a group of chronic stroke survivors, while sitting on a force plate, exercised the ability to control their Center of Pressure with a training based on continuous visual feedback. The goal of this study was to test if and to what extent chronic stroke survivors were able to learn the task and transfer the learned ability to a condition without visual feedback and to directions and displacement amplitudes different from those experienced during training. Eleven chronic stroke survivors (5 Male - 6 Female, age: 59.72 ± 12.84 years) participated in this study. Subjects were seated on a stool positioned on top of a custom-built force platform. Their Center of Pressure positions were mapped to the coordinate of a cursor on a computer monitor. During training, the cursor position was always displayed and the subjects were to reach targets by shifting their Center of Pressure by moving their trunk. Pre and post-training subjects were required to reach without visual feedback of the cursor the training targets as well as other targets positioned in different directions and displacement amplitudes. During training, most stroke survivors were able to perform the required task and to improve their performance in terms of duration, smoothness, and movement extent, although not in terms of movement direction. However, when we removed the visual feedback, most of them had no improvement with respect to their pre-training performance. This study suggests that postural training based exclusively on continuous visual feedback can provide limited benefits for stroke survivors, if administered alone. However, the positive gains observed during training justify the integration of this technology-based protocol in a well-structured and personalized physiotherapy training, where the combination of the two approaches may lead to functional recovery.

Fitts' Law in the Control of Isometric Grip Force With Naturalistic Targets.

PubMed

Thumser, Zachary C; Slifkin, Andrew B; Beckler, Dylan T; Marasco, Paul D

2018-01-01

Fitts' law models the relationship between amplitude, precision, and speed of rapid movements. It is widely used to quantify performance in pointing tasks, study human-computer interaction, and generally to understand perceptual-motor information processes, including research to model performance in isometric force production tasks. Applying Fitts' law to an isometric grip force task would allow for quantifying grasp performance in rehabilitative medicine and may aid research on prosthetic control and design. We examined whether Fitts' law would hold when participants attempted to accurately produce their intended force output while grasping a manipulandum when presented with images of various everyday objects (we termed this the implicit task). Although our main interest was the implicit task, to benchmark it and establish validity, we examined performance against a more standard visual feedback condition via a digital force-feedback meter on a video monitor (explicit task). Next, we progressed from visual force feedback with force meter targets to the same targets without visual force feedback (operating largely on feedforward control with tactile feedback). This provided an opportunity to see if Fitts' law would hold without vision, and allowed us to progress toward the more naturalistic implicit task (which does not include visual feedback). Finally, we changed the nature of the targets from requiring explicit force values presented as arrows on a force-feedback meter (explicit targets) to the more naturalistic and intuitive target forces implied by images of objects (implicit targets). With visual force feedback the relation between task difficulty and the time to produce the target grip force was predicted by Fitts' law (average r 2 = 0.82). Without vision, average grip force scaled accurately although force variability was insensitive to the target presented. In contrast, images of everyday objects generated more reliable grip forces without the visualized force meter. In sum, population means were well-described by Fitts' law for explicit targets with vision ( r 2 = 0.96) and implicit targets ( r 2 = 0.89), but not as well-described for explicit targets without vision ( r 2 = 0.54). Implicit targets should provide a realistic see-object-squeeze-object test using Fitts' law to quantify the relative speed-accuracy relationship of any given grasper.

Similar brain networks for detecting visuo-motor and visuo-proprioceptive synchrony.

PubMed

Balslev, Daniela; Nielsen, Finn A; Lund, Torben E; Law, Ian; Paulson, Olaf B

2006-05-15

The ability to recognize feedback from own movement as opposed to the movement of someone else is important for motor control and social interaction. The neural processes involved in feedback recognition are incompletely understood. Two competing hypotheses have been proposed: the stimulus is compared with either (a) the proprioceptive feedback or with (b) the motor command and if they match, then the external stimulus is identified as feedback. Hypothesis (a) predicts that the neural mechanisms or brain areas involved in distinguishing self from other during passive and active movement are similar, whereas hypothesis (b) predicts that they are different. In this fMRI study, healthy subjects saw visual cursor movement that was either synchronous or asynchronous with their active or passive finger movements. The aim was to identify the brain areas where the neural activity depended on whether the visual stimulus was feedback from own movement and to contrast the functional activation maps for active and passive movement. We found activity increases in the right temporoparietal cortex in the condition with asynchronous relative to synchronous visual feedback from both active and passive movements. However, no statistically significant difference was found between these sets of activated areas when the active and passive movement conditions were compared. With a posterior probability of 0.95, no brain voxel had a contrast effect above 0.11% of the whole-brain mean signal. These results do not support the hypothesis that recognition of visual feedback during active and passive movement relies on different brain areas.

A unified framework for image retrieval using keyword and visual features.

PubMed

Jing, Feng; Li, Mingling; Zhang, Hong-Jiang; Zhang, Bo

2005-07-01

In this paper, a unified image retrieval framework based on both keyword annotations and visual features is proposed. In this framework, a set of statistical models are built based on visual features of a small set of manually labeled images to represent semantic concepts and used to propagate keywords to other unlabeled images. These models are updated periodically when more images implicitly labeled by users become available through relevance feedback. In this sense, the keyword models serve the function of accumulation and memorization of knowledge learned from user-provided relevance feedback. Furthermore, two sets of effective and efficient similarity measures and relevance feedback schemes are proposed for query by keyword scenario and query by image example scenario, respectively. Keyword models are combined with visual features in these schemes. In particular, a new, entropy-based active learning strategy is introduced to improve the efficiency of relevance feedback for query by keyword. Furthermore, a new algorithm is proposed to estimate the keyword features of the search concept for query by image example. It is shown to be more appropriate than two existing relevance feedback algorithms. Experimental results demonstrate the effectiveness of the proposed framework.

Visual feedback in stuttering therapy

NASA Astrophysics Data System (ADS)

Smolka, Elzbieta

1997-02-01

The aim of this paper is to present the results concerning the influence of visual echo and reverberation on the speech process of stutterers. Visual stimuli along with the influence of acoustic and visual-acoustic stimuli have been compared. Following this the methods of implementing visual feedback with the aid of electroluminescent diodes directed by speech signals have been presented. The concept of a computerized visual echo based on the acoustic recognition of Polish syllabic vowels has been also presented. All the research nd trials carried out at our center, aside from cognitive aims, generally aim at the development of new speech correctors to be utilized in stuttering therapy.

Ultra-Rapid serial visual presentation reveals dynamics of feedforward and feedback processes in the ventral visual pathway.

PubMed

Mohsenzadeh, Yalda; Qin, Sheng; Cichy, Radoslaw M; Pantazis, Dimitrios

2018-06-21

Human visual recognition activates a dense network of overlapping feedforward and recurrent neuronal processes, making it hard to disentangle processing in the feedforward from the feedback direction. Here, we used ultra-rapid serial visual presentation to suppress sustained activity that blurs the boundaries of processing steps, enabling us to resolve two distinct stages of processing with MEG multivariate pattern classification. The first processing stage was the rapid activation cascade of the bottom-up sweep, which terminated early as visual stimuli were presented at progressively faster rates. The second stage was the emergence of categorical information with peak latency that shifted later in time with progressively faster stimulus presentations, indexing time-consuming recurrent processing. Using MEG-fMRI fusion with representational similarity, we localized recurrent signals in early visual cortex. Together, our findings segregated an initial bottom-up sweep from subsequent feedback processing, and revealed the neural signature of increased recurrent processing demands for challenging viewing conditions. © 2018, Mohsenzadeh et al.

Biophysical network modeling of the dLGN circuit: Effects of cortical feedback on spatial response properties of relay cells

PubMed Central

Martínez-Cañada, Pablo; Halnes, Geir; Fyhn, Marianne

2018-01-01

Despite half-a-century of research since the seminal work of Hubel and Wiesel, the role of the dorsal lateral geniculate nucleus (dLGN) in shaping the visual signals is not properly understood. Placed on route from retina to primary visual cortex in the early visual pathway, a striking feature of the dLGN circuit is that both the relay cells (RCs) and interneurons (INs) not only receive feedforward input from retinal ganglion cells, but also a prominent feedback from cells in layer 6 of visual cortex. This feedback has been proposed to affect synchronicity and other temporal properties of the RC firing. It has also been seen to affect spatial properties such as the center-surround antagonism of thalamic receptive fields, i.e., the suppression of the response to very large stimuli compared to smaller, more optimal stimuli. Here we explore the spatial effects of cortical feedback on the RC response by means of a a comprehensive network model with biophysically detailed, single-compartment and multicompartment neuron models of RCs, INs and a population of orientation-selective layer 6 simple cells, consisting of pyramidal cells (PY). We have considered two different arrangements of synaptic feedback from the ON and OFF zones in the visual cortex to the dLGN: phase-reversed (‘push-pull’) and phase-matched (‘push-push’), as well as different spatial extents of the corticothalamic projection pattern. Our simulation results support that a phase-reversed arrangement provides a more effective way for cortical feedback to provide the increased center-surround antagonism seen in experiments both for flashing spots and, even more prominently, for patch gratings. This implies that ON-center RCs receive direct excitation from OFF-dominated cortical cells and indirect inhibitory feedback from ON-dominated cortical cells. The increased center-surround antagonism in the model is accompanied by spatial focusing, i.e., the maximum RC response occurs for smaller stimuli when feedback is present. PMID:29377888

Visualizing Syllables: Real-Time Computerized Feedback within a Speech-Language Intervention

ERIC Educational Resources Information Center

DeThorne, Laura; Aparicio Betancourt, Mariana; Karahalios, Karrie; Halle, Jim; Bogue, Ellen

2015-01-01

Computerized technologies now offer unprecedented opportunities to provide real-time visual feedback to facilitate children's speech-language development. We employed a mixed-method design to examine the effectiveness of two speech-language interventions aimed at facilitating children's multisyllabic productions: one incorporated a novel…

Low Cost Embedded Stereo System for Underwater Surveys

NASA Astrophysics Data System (ADS)

Nawaf, M. M.; Boï, J.-M.; Merad, D.; Royer, J.-P.; Drap, P.

2017-11-01

This paper provides details of both hardware and software conception and realization of a hand-held stereo embedded system for underwater imaging. The designed system can run most image processing techniques smoothly in real-time. The developed functions provide direct visual feedback on the quality of the taken images which helps taking appropriate actions accordingly in terms of movement speed and lighting conditions. The proposed functionalities can be easily customized or upgraded whereas new functions can be easily added thanks to the available supported libraries. Furthermore, by connecting the designed system to a more powerful computer, a real-time visual odometry can run on the captured images to have live navigation and site coverage map. We use a visual odometry method adapted to low computational resources systems and long autonomy. The system is tested in a real context and showed its robustness and promising further perspectives.

Learning to See: Enhancing Student Learning through Videotaped Feedback

ERIC Educational Resources Information Center

Yakura, Elaine K.

2009-01-01

Feedback is crucial to developing skills, but meaningful feedback is difficult to provide. Classroom videotaping can provide effective feedback on student performance, but for video feedback to be most helpful, students must develop a type of "visual intelligence"--analytical skills that increase critical thinking and self-awareness. The author…

A wearable skin stretch haptic feedback device: Towards improving balance control in lower limb amputees.

PubMed

Husman, M A B; Maqbool, H F; Awad, M I; Abouhossein, A; Dehghani-Sanij, A A

2016-08-01

Haptic feedback to lower limb amputees is essential to maximize the functionality of a prosthetic device by providing information to the user about the interaction with the environment and the position of the prostheses in space. Severed sensory pathway and the absence of connection between the prosthesis and the Central Nervous System (CNS) after lower limb amputation reduces balance control, increases visual dependency and increases risk of falls among amputees. This work describes the design of a wearable haptic feedback device for lower limb amputees using lateral skin-stretch modality intended to serve as a feedback cue during ambulation. A feedback scheme was proposed based on gait event detection for possible real-time postural adjustment. Preliminary perceptual test with healthy subjects in static condition was carried out and the results indicated over 98% accuracy in determining stimuli location around the upper leg region, suggesting good perceptibility of the delivered stimuli.

Explicit knowledge about the availability of visual feedback affects grasping with the left but not the right hand.

PubMed

Tang, Rixin; Whitwell, Robert L; Goodale, Melvyn A

2014-01-01

Previous research (Whitwell et al. in Exp Brain Res 188:603-611, 2008; Whitwell and Goodale in Exp Brain Res 194:619-629, 2009) has shown that trial history, but not anticipatory knowledge about the presence or absence of visual feedback on an upcoming trial, plays a vital role in determining how that feedback is exploited when grasping with the right hand. Nothing is known about how the non-dominant left hand behaves under the same feedback regimens. In present study, therefore, we compared peak grip aperture (PGA) for left- and right-hand grasps executed with and without visual feedback (i.e., closed- vs. open-loop conditions) in right-handed individuals under three different trial schedules: the feedback conditions were blocked separately, they were randomly interleaved, or they were alternated. When feedback conditions were blocked, the PGA was much larger for open-loop trials as compared to closed-loop trials, although this difference was more pronounced for right-hand grasps than left-hand grasps. Like Whitwell et al., we found that mixing open- and closed-loop trials together, compared to blocking them separately, homogenized the PGA for open- and closed-loop grasping in the right hand (i.e., the PGAs became smaller on open-loop trials and larger on closed-loop trials). In addition, the PGAs for right-hand grasps were entirely determined by trial history and not by knowledge of whether or not visual feedback would be available on an upcoming trial. In contrast to grasps made with the right hand, grasps made by the left hand were affected both by trial history and by anticipatory knowledge of the upcoming visual feedback condition. But these effects were observed only on closed-loop trials, i.e., the PGAs of grasps made with the left hand on closed-loop trials were smaller when participants could anticipate the availability of feedback on an upcoming trial (alternating trials) than when they could not (randomized trials). In contrast, grasps made with the left hand on open-loop trials exhibited the same large PGAs under all feedback schedules: blocked, random, or alternating. In other words, there was no evidence for homogenization. Taken together, these results suggest that in addition to the real-time demands of the task, such as the target's size and position and the availability of visual feedback, the initial (i.e., pre-movement) programming of right-hand grasping relies on what happened on the previous trial, whereas the programming of left-hand grasping is more cognitively supervised and exploits explicit information about trial order to prepare for an upcoming trial.

A new visual feedback-based magnetorheological haptic master for robot-assisted minimally invasive surgery

NASA Astrophysics Data System (ADS)

Choi, Seung-Hyun; Kim, Soomin; Kim, Pyunghwa; Park, Jinhyuk; Choi, Seung-Bok

2015-06-01

In this study, we developed a novel four-degrees-of-freedom haptic master using controllable magnetorheological (MR) fluid. We also integrated the haptic master with a vision device with image processing for robot-assisted minimally invasive surgery (RMIS). The proposed master can be used in RMIS as a haptic interface to provide the surgeon with a sense of touch by using both kinetic and kinesthetic information. The slave robot, which is manipulated with a proportional-integrative-derivative controller, uses a force sensor to obtain the desired forces from tissue contact, and these desired repulsive forces are then embodied through the MR haptic master. To verify the effectiveness of the haptic master, the desired force and actual force are compared in the time domain. In addition, a visual feedback system is implemented in the RMIS experiment to distinguish between the tumor and organ more clearly and provide better visibility to the operator. The hue-saturation-value color space is adopted for the image processing since it is often more intuitive than other color spaces. The image processing and haptic feedback are realized on surgery performance. In this work, tumor-cutting experiments are conducted under four different operating conditions: haptic feedback on, haptic feedback off, image processing on, and image processing off. The experimental realization shows that the performance index, which is a function of pixels, is different in the four operating conditions.

Adaptive Locomotor Behavior in Larval Zebrafish

PubMed Central

Portugues, Ruben; Engert, Florian

2011-01-01

In this study we report that larval zebrafish display adaptive locomotor output that can be driven by unexpected visual feedback. We develop a new assay that addresses visuomotor integration in restrained larval zebrafish. The assay involves a closed-loop environment in which the visual feedback a larva receives depends on its own motor output in a way that resembles freely swimming conditions. The experimenter can control the gain of this closed feedback loop, so that following a given motor output the larva experiences more or less visual feedback depending on whether the gain is high or low. We show that increases and decreases in this gain setting result in adaptive changes in behavior that lead to a generalized decrease or increase of motor output, respectively. Our behavioral analysis shows that both the duration and tail beat frequency of individual swim bouts can be modified, as well as the frequency with which bouts are elicited. These changes can be implemented rapidly, following an exposure to a new gain of just 175 ms. In addition, modifications in some behavioral parameters accumulate over tens of seconds and effects last for at least 30 s from trial to trial. These results suggest that larvae establish an internal representation of the visual feedback expected from a given motor output and that the behavioral modifications are driven by an error signal that arises from the discrepancy between this expectation and the actual visual feedback. The assay we develop presents a unique possibility for studying visuomotor integration using imaging techniques available in the larval zebrafish. PMID:21909325

Adaptive locomotor behavior in larval zebrafish.

PubMed

Portugues, Ruben; Engert, Florian

2011-01-01

In this study we report that larval zebrafish display adaptive locomotor output that can be driven by unexpected visual feedback. We develop a new assay that addresses visuomotor integration in restrained larval zebrafish. The assay involves a closed-loop environment in which the visual feedback a larva receives depends on its own motor output in a way that resembles freely swimming conditions. The experimenter can control the gain of this closed feedback loop, so that following a given motor output the larva experiences more or less visual feedback depending on whether the gain is high or low. We show that increases and decreases in this gain setting result in adaptive changes in behavior that lead to a generalized decrease or increase of motor output, respectively. Our behavioral analysis shows that both the duration and tail beat frequency of individual swim bouts can be modified, as well as the frequency with which bouts are elicited. These changes can be implemented rapidly, following an exposure to a new gain of just 175 ms. In addition, modifications in some behavioral parameters accumulate over tens of seconds and effects last for at least 30 s from trial to trial. These results suggest that larvae establish an internal representation of the visual feedback expected from a given motor output and that the behavioral modifications are driven by an error signal that arises from the discrepancy between this expectation and the actual visual feedback. The assay we develop presents a unique possibility for studying visuomotor integration using imaging techniques available in the larval zebrafish.

A mobile phone system to find crosswalks for visually impaired pedestrians

PubMed Central

Shen, Huiying; Chan, Kee-Yip; Coughlan, James; Brabyn, John

2010-01-01

Urban intersections are the most dangerous parts of a blind or visually impaired pedestrian’s travel. A prerequisite for safely crossing an intersection is entering the crosswalk in the right direction and avoiding the danger of straying outside the crosswalk. This paper presents a proof of concept system that seeks to provide such alignment information. The system consists of a standard mobile phone with built-in camera that uses computer vision algorithms to detect any crosswalk visible in the camera’s field of view; audio feedback from the phone then helps the user align him/herself to it. Our prototype implementation on a Nokia mobile phone runs in about one second per image, and is intended for eventual use in a mobile phone system that will aid blind and visually impaired pedestrians in navigating traffic intersections. PMID:20411035

Self-Management of Patient Body Position, Pose, and Motion Using Wide-Field, Real-Time Optical Measurement Feedback: Results of a Volunteer Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Parkhurst, James M.; Price, Gareth J., E-mail: gareth.price@christie.nhs.uk; Faculty of Medical and Human Sciences, Manchester Academic Health Sciences Centre, University of Manchester, Manchester

2013-12-01

Purpose: We present the results of a clinical feasibility study, performed in 10 healthy volunteers undergoing a simulated treatment over 3 sessions, to investigate the use of a wide-field visual feedback technique intended to help patients control their pose while reducing motion during radiation therapy treatment. Methods and Materials: An optical surface sensor is used to capture wide-area measurements of a subject's body surface with visualizations of these data displayed back to them in real time. In this study we hypothesize that this active feedback mechanism will enable patients to control their motion and help them maintain their setup posemore » and position. A capability hierarchy of 3 different level-of-detail abstractions of the measured surface data is systematically compared. Results: Use of the device enabled volunteers to increase their conformance to a reference surface, as measured by decreased variability across their body surfaces. The use of visual feedback also enabled volunteers to reduce their respiratory motion amplitude to 1.7 ± 0.6 mm compared with 2.7 ± 1.4 mm without visual feedback. Conclusions: The use of live feedback of their optically measured body surfaces enabled a set of volunteers to better manage their pose and motion when compared with free breathing. The method is suitable to be taken forward to patient studies.« less

Effects of acoustic feedback training in elite-standard Para-Rowing.

PubMed

Schaffert, Nina; Mattes, Klaus

2015-01-01

Assessment and feedback devices have been regularly used in technique training in high-performance sports. Biomechanical analysis is mainly visually based and so can exclude athletes with visual impairments. The aim of this study was to examine the effects of auditory feedback on mean boat speed during on-water training of visually impaired athletes. The German National Para-Rowing team (six athletes, mean ± s, age 34.8 ± 10.6 years, body mass 76.5 ± 13.5 kg, stature 179.3 ± 8.6 cm) participated in the study. Kinematics included boat acceleration and distance travelled, collected with Sofirow at two intensities of training. The boat acceleration-time traces were converted online into acoustic feedback and presented via speakers during rowing (sections with and without alternately). Repeated-measures within-participant factorial ANOVA showed greater boat speed with acoustic feedback than baseline (0.08 ± 0.01 m·s(-1)). The time structure of rowing cycles was improved (extended time of positive acceleration). Questioning of athletes showed acoustic feedback to be a supportive training aid as it provided important functional information about the boat motion independent of vision. It gave access for visually impaired athletes to biomechanical analysis via auditory information. The concept for adaptive athletes has been successfully integrated into the preparation for the Para-Rowing World Championships and Paralympics.

Feedforward and Feedback Motor Control Abnormalities Implicate Cerebellar Dysfunctions in Autism Spectrum Disorder

PubMed Central

Mohanty, Suman; Greene, Rachel K.; Cook, Edwin H.; Vaillancourt, David E.; Sweeney, John A.

2015-01-01

Sensorimotor abnormalities are common in autism spectrum disorder (ASD) and among the earliest manifestations of the disorder. They have been studied far less than the social-communication and cognitive deficits that define ASD, but a mechanistic understanding of sensorimotor abnormalities in ASD may provide key insights into the neural underpinnings of the disorder. In this human study, we examined rapid, precision grip force contractions to determine whether feedforward mechanisms supporting initial motor output before sensory feedback can be processed are disrupted in ASD. Sustained force contractions also were examined to determine whether reactive adjustments to ongoing motor behavior based on visual feedback are altered. Sustained force was studied across multiple force levels and visual gains to assess motor and visuomotor mechanisms, respectively. Primary force contractions of individuals with ASD showed greater peak rate of force increases and large transient overshoots. Individuals with ASD also showed increased sustained force variability that scaled with force level and was more severe when visual gain was highly amplified or highly degraded. When sustaining a constant force level, their reactive adjustments were more periodic than controls, and they showed increased reliance on slower feedback mechanisms. Feedforward and feedback mechanism alterations each were associated with more severe social-communication impairments in ASD. These findings implicate anterior cerebellar circuits involved in feedforward motor control and posterior cerebellar circuits involved in transforming visual feedback into precise motor adjustments in ASD. PMID:25653359

Social feedback processing from early to late adolescence: influence of sex, age, and attachment style

PubMed Central

Vrtička, Pascal; Sander, David; Anderson, Brittany; Badoud, Deborah; Eliez, Stephan; Debbané, Martin

2014-01-01

Objective The establishment of an accurate understanding of one's social context is a central developmental task during adolescence. A critical component of such development is to learn how to integrate the objective evaluation of one's behavior with the social response to the latter—here referred to as social feedback processing. Case report We measured brain activity by means of fMRI in 33 healthy adolescents (12–19 years old, 14 females). Participants played a difficult perceptual game with integrated verbal and visual feedback. Verbal feedback provided the participants with objective performance evaluation (won vs. lost). Visual feedback consisted of either smiling or angry faces, representing positive or negative social evaluations. Together, the combination of verbal and visual feedback gave rise to congruent versus incongruent social feedback combinations. In addition to assessing sex differences, we further tested for the effects of age and attachment style on social feedback processing. Results revealed that brain activity during social feedback processing was significantly modulated by sex, age, and attachment style in prefrontal cortical areas, ventral anterior cingulate cortex, anterior insula, caudate, and amygdala/hippocampus. We found indication for heightened activity during incongruent social feedback processing in females, older participants, and individuals with an anxious attachment style. Conversely, we observed stronger activity during processing of congruent social feedback in males and participants with an avoidant attachment style. Conclusion Our findings not only extend knowledge on the typical development of socio-emotional brain function during adolescence, but also provide first clues on how attachment insecurities, and particularly attachment avoidance, could interfere with the latter mechanisms. PMID:25328847

Mobile in vivo camera robots provide sole visual feedback for abdominal exploration and cholecystectomy.

PubMed

Rentschler, M E; Dumpert, J; Platt, S R; Ahmed, S I; Farritor, S M; Oleynikov, D

2006-01-01

The use of small incisions in laparoscopy reduces patient trauma, but also limits the surgeon's ability to view and touch the surgical environment directly. These limitations generally restrict the application of laparoscopy to procedures less complex than those performed during open surgery. Although current robot-assisted laparoscopy improves the surgeon's ability to manipulate and visualize the target organs, the instruments and cameras remain fundamentally constrained by the entry incisions. This limits tool tip orientation and optimal camera placement. The current work focuses on developing a new miniature mobile in vivo adjustable-focus camera robot to provide sole visual feedback to surgeons during laparoscopic surgery. A miniature mobile camera robot was inserted through a trocar into the insufflated abdominal cavity of an anesthetized pig. The mobile robot allowed the surgeon to explore the abdominal cavity remotely and view trocar and tool insertion and placement without entry incision constraints. The surgeon then performed a cholecystectomy using the robot camera alone for visual feedback. This successful trial has demonstrated that miniature in vivo mobile robots can provide surgeons with sufficient visual feedback to perform common procedures while reducing patient trauma.

Improving Student Performance Using Nudge Analytics

ERIC Educational Resources Information Center

Feild, Jacqueline

2015-01-01

Providing students with continuous and personalized feedback on their performance is an important part of encouraging self regulated learning. As part of our higher education platform, we built a set of data visualizations to provide feedback to students on their assignment performance. These visualizations give students information about how they…

Efficacy of a pressure-sensing mattress cover system for reducing interface pressure: study protocol for a randomized controlled trial.

PubMed

Wong, Holly; Kaufman, Jaime; Baylis, Barry; Conly, John M; Hogan, David B; Stelfox, Henry T; Southern, Danielle A; Ghali, William A; Ho, Chester H

2015-09-29

Interface pressure is a key risk factor in the development of pressure ulcers. Visual feedback of continuous interface pressure between the body and support surface could inform clinicians on repositioning strategies and play a key role in an overall strategy for the prevention and management of pressure ulcers. A parallel two-group randomized controlled clinical trial will be conducted to study the effect of continuous pressure imaging on reducing interface pressure and on the incidence of pressure ulcers in vulnerable hospital patients. A total of 678 eligible consenting inpatients at risk of pressure ulcer development in a tertiary acute care institution will be randomly allocated to either having the ForeSite PT™ system with the liquid-crystal display monitor turned on to provide visual feedback to the clinicians while also collecting continuous interface pressure data (intervention group) or to having the ForeSite PT™ system with monitor turned off (that is, not providing visual feedback) but still collecting continuous interface pressure data (control group), in a ratio of 1:1. Continuous interface pressure data will be collected in both groups for 3 days (72 h). Data collection will continue until discharge for a subset of approximately 60 patients. The primary outcome will be the differences in the two groups' interface pressure analysis. Interface pressure readings will be collected through hourly samplings of continuous interface pressure recordings. Secondary outcomes will be the differences between the two groups in pressure-related skin and soft tissue changes in areas at risk of pressure ulcer (obtained at baseline within 24 h of admission) and on the third day of the trial or at discharge and perceptions of the intervention by patients and clinicians (obtained on the third day or at discharge). This will be the first randomized controlled trial to investigate the effect of visual feedback with continuous interface pressure of vulnerable hospital patients across different care settings, and the association between interface pressure and development of pressure-related skin and soft tissue changes. The results could provide important information to guide clinical practice in the prevention and management of pressure ulcers. ClinicalTrials.gov NCT02325388 (date of registration: 24 December 2014).

Brain-actuated gait trainer with visual and proprioceptive feedback

NASA Astrophysics Data System (ADS)

Liu, Dong; Chen, Weihai; Lee, Kyuhwa; Chavarriaga, Ricardo; Bouri, Mohamed; Pei, Zhongcai; Millán, José del R.

2017-10-01

Objective. Brain-machine interfaces (BMIs) have been proposed in closed-loop applications for neuromodulation and neurorehabilitation. This study describes the impact of different feedback modalities on the performance of an EEG-based BMI that decodes motor imagery (MI) of leg flexion and extension. Approach. We executed experiments in a lower-limb gait trainer (the legoPress) where nine able-bodied subjects participated in three consecutive sessions based on a crossover design. A random forest classifier was trained from the offline session and tested online with visual and proprioceptive feedback, respectively. Post-hoc classification was conducted to assess the impact of feedback modalities and learning effect (an improvement over time) on the simulated trial-based performance. Finally, we performed feature analysis to investigate the discriminant power and brain pattern modulations across the subjects. Main results. (i) For real-time classification, the average accuracy was 62.33 +/- 4.95 % and 63.89 +/- 6.41 % for the two online sessions. The results were significantly higher than chance level, demonstrating the feasibility to distinguish between MI of leg extension and flexion. (ii) For post-hoc classification, the performance with proprioceptive feedback (69.45 +/- 9.95 %) was significantly better than with visual feedback (62.89 +/- 9.20 %), while there was no significant learning effect. (iii) We reported individual discriminate features and brain patterns associated to each feedback modality, which exhibited differences between the two modalities although no general conclusion can be drawn. Significance. The study reported a closed-loop brain-controlled gait trainer, as a proof of concept for neurorehabilitation devices. We reported the feasibility of decoding lower-limb movement in an intuitive and natural way. As far as we know, this is the first online study discussing the role of feedback modalities in lower-limb MI decoding. Our results suggest that proprioceptive feedback has an advantage over visual feedback, which could be used to improve robot-assisted strategies for motor training and functional recovery.

Brain-actuated gait trainer with visual and proprioceptive feedback.

PubMed

Liu, Dong; Chen, Weihai; Lee, Kyuhwa; Chavarriaga, Ricardo; Bouri, Mohamed; Pei, Zhongcai; Del R Millán, José

2017-10-01

Brain-machine interfaces (BMIs) have been proposed in closed-loop applications for neuromodulation and neurorehabilitation. This study describes the impact of different feedback modalities on the performance of an EEG-based BMI that decodes motor imagery (MI) of leg flexion and extension. We executed experiments in a lower-limb gait trainer (the legoPress) where nine able-bodied subjects participated in three consecutive sessions based on a crossover design. A random forest classifier was trained from the offline session and tested online with visual and proprioceptive feedback, respectively. Post-hoc classification was conducted to assess the impact of feedback modalities and learning effect (an improvement over time) on the simulated trial-based performance. Finally, we performed feature analysis to investigate the discriminant power and brain pattern modulations across the subjects. (i) For real-time classification, the average accuracy was [Formula: see text]% and [Formula: see text]% for the two online sessions. The results were significantly higher than chance level, demonstrating the feasibility to distinguish between MI of leg extension and flexion. (ii) For post-hoc classification, the performance with proprioceptive feedback ([Formula: see text]%) was significantly better than with visual feedback ([Formula: see text]%), while there was no significant learning effect. (iii) We reported individual discriminate features and brain patterns associated to each feedback modality, which exhibited differences between the two modalities although no general conclusion can be drawn. The study reported a closed-loop brain-controlled gait trainer, as a proof of concept for neurorehabilitation devices. We reported the feasibility of decoding lower-limb movement in an intuitive and natural way. As far as we know, this is the first online study discussing the role of feedback modalities in lower-limb MI decoding. Our results suggest that proprioceptive feedback has an advantage over visual feedback, which could be used to improve robot-assisted strategies for motor training and functional recovery.

A multi-mode manipulator display system for controlling remote robotic systems

NASA Technical Reports Server (NTRS)

Massimino, Michael J.; Meschler, Michael F.; Rodriguez, Alberto A.

1994-01-01

The objective and contribution of the research presented in this paper is to provide a Multi-Mode Manipulator Display System (MMDS) to assist a human operator with the control of remote manipulator systems. Such systems include space based manipulators such as the space shuttle remote manipulator system (SRMS) and future ground controlled teleoperated and telescience space systems. The MMDS contains a number of display modes and submodes which display position control cues position data in graphical formats, based primarily on manipulator position and joint angle data. Therefore the MMDS is not dependent on visual information for input and can assist the operator especially when visual feedback is inadequate. This paper provides descriptions of the new modes and experiment results to date.

Marginally perceptible outcome feedback, motor learning and implicit processes.

PubMed

Masters, Rich S W; Maxwell, Jon P; Eves, Frank F

2009-09-01

Participants struck 500 golf balls to a concealed target. Outcome feedback was presented at the subjective or objective threshold of awareness of each participant or at a supraliminal threshold. Participants who received fully perceptible (supraliminal) feedback learned to strike the ball onto the target, as did participants who received feedback that was only marginally perceptible (subjective threshold). Participants who received feedback that was not perceptible (objective threshold) showed no learning. Upon transfer to a condition in which the target was unconcealed, performance increased in both the subjective and the objective threshold condition, but decreased in the supraliminal condition. In all three conditions, participants reported minimal declarative knowledge of their movements, suggesting that deliberate hypothesis testing about how best to move in order to perform the motor task successfully was disrupted by the impoverished disposition of the visual outcome feedback. It was concluded that sub-optimally perceptible visual feedback evokes implicit processes.

Feasibility Study of a Vision-Based Landing System for Unmanned Fixed-Wing Aircraft

DTIC Science & Technology

2017-06-01

International Journal of Computer Science and Network Security 7 no. 3: 112–117. Accessed April 7, 2017. http://www.sciencedirect.com/science/ article /pii...the feasibility of applying computer vision techniques and visual feedback in the control loop for an autonomous system. This thesis examines the...integration into an autonomous aircraft control system. 14. SUBJECT TERMS autonomous systems, auto-land, computer vision, image processing

Using Screencasts to Enhance Assessment Feedback: Students' Perceptions and Preferences

ERIC Educational Resources Information Center

Marriott, Pru; Teoh, Lim Keong

2012-01-01

In the UK, assessment and feedback have been regularly highlighted by the National Student Survey as critical aspects that require improvement. An innovative approach to delivering feedback that has proved successful in non-business-related disciplines is the delivery of audio and visual feedback using screencast technology. The feedback on…

Spontaneous eye movements in goldfish: oculomotor integrator performance, plasticity, and dependence on visual feedback.

PubMed

Mensh, B D; Aksay, E; Lee, D D; Seung, H S; Tank, D W

2004-03-01

To quantify performance of the goldfish oculomotor neural integrator and determine its dependence on visual feedback, we measured the relationship between eye drift-velocity and position during spontaneous gaze fixations in the light and in the dark. In the light, drift-velocities were typically less than 1 deg/s, similar to those observed in humans. During brief periods in darkness, drift-velocities were only slightly larger, but showed greater variance. One hour in darkness degraded fixation-holding performance. These findings suggest that while visual feedback is not essential for online fixation stability, it may be used to tune the mechanism of persistent neural activity in the oculomotor integrator.

Visuomotor adaptability in older adults with mild cognitive decline.

PubMed

Schaffert, Jeffrey; Lee, Chi-Mei; Neill, Rebecca; Bo, Jin

2017-02-01

The current study examined the augmentation of error feedback on visuomotor adaptability in older adults with varying degrees of cognitive decline (assessed by the Montreal Cognitive Assessment; MoCA). Twenty-three participants performed a center-out computerized visuomotor adaptation task when the visual feedback of their hand movement error was presented in a regular (ratio=1:1) or enhanced (ratio=1:2) error feedback schedule. Results showed that older adults with lower scores on the MoCA had less adaptability than those with higher MoCA scores during the regular feedback schedule. However, participants demonstrated similar adaptability during the enhanced feedback schedule, regardless of their cognitive ability. Furthermore, individuals with lower MoCA scores showed larger after-effects in spatial control during the enhanced schedule compared to the regular schedule, whereas individuals with higher MoCA scores displayed the opposite pattern. Additional neuro-cognitive assessments revealed that spatial working memory and processing speed were positively related to motor adaptability during the regular scheduled but negatively related to adaptability during the enhanced schedule. We argue that individuals with mild cognitive decline employed different adaptation strategies when encountering enhanced visual feedback, suggesting older adults with mild cognitive impairment (MCI) may benefit from enhanced visual error feedback during sensorimotor adaptation. Copyright © 2016 Elsevier B.V. All rights reserved.

Improving training of laparoscopic tissue manipulation skills using various visual force feedback types.

PubMed

Smit, Daan; Spruit, Edward; Dankelman, Jenny; Tuijthof, Gabrielle; Hamming, Jaap; Horeman, Tim

2017-01-01

Visual force feedback allows trainees to learn laparoscopic tissue manipulation skills. The aim of this experimental study was to find the most efficient visual force feedback method to acquire these skills. Retention and transfer validity to an untrained task were assessed. Medical students without prior experience in laparoscopy were randomized in three groups: Constant Force Feedback (CFF) (N = 17), Bandwidth Force Feedback (BFF) (N = 16) and Fade-in Force Feedback (N = 18). All participants performed a pretest, training, post-test and follow-up test. The study involved two dissimilar tissue manipulation tasks, one for training and one to assess transferability. Participants performed six trials of the training task. A force platform was used to record several force parameters. A paired-sample t test showed overall lower force parameter outcomes in the post-test compared to the pretest (p < .001). A week later, the force parameter outcomes were still significantly lower than found in the pretest (p < .005). Participants also performed the transfer task in the post-test (p < .02) and follow-up (p < .05) test with lower force parameter outcomes compared to the pretest. A one-way MANOVA indicated that in the post-test the CFF group applied 50 % less Mean Absolute Nonzero Force (p = .005) than the BFF group. All visual force feedback methods showed to be effective in decreasing tissue manipulation force as no major differences were found between groups in the post and follow-up trials. The BFF method is preferred for it respects individual progress and minimizes distraction.

Scene segmentation by spike synchronization in reciprocally connected visual areas. I. Local effects of cortical feedback.

PubMed

Knoblauch, Andreas; Palm, Günther

2002-09-01

To investigate scene segmentation in the visual system we present a model of two reciprocally connected visual areas using spiking neurons. Area P corresponds to the orientation-selective subsystem of the primary visual cortex, while the central visual area C is modeled as associative memory representing stimulus objects according to Hebbian learning. Without feedback from area C, a single stimulus results in relatively slow and irregular activity, synchronized only for neighboring patches (slow state), while in the complete model activity is faster with an enlarged synchronization range (fast state). When presenting a superposition of several stimulus objects, scene segmentation happens on a time scale of hundreds of milliseconds by alternating epochs of the slow and fast states, where neurons representing the same object are simultaneously in the fast state. Correlation analysis reveals synchronization on different time scales as found in experiments (designated as tower, castle, and hill peaks). On the fast time scale (tower peaks, gamma frequency range), recordings from two sites coding either different or the same object lead to correlograms that are either flat or exhibit oscillatory modulations with a central peak. This is in agreement with experimental findings, whereas standard phase-coding models would predict shifted peaks in the case of different objects.

Directional errors of movements and their correction in a discrete tracking task. [pilot reaction time and sensorimotor performance

NASA Technical Reports Server (NTRS)

Jaeger, R. J.; Agarwal, G. C.; Gottlieb, G. L.

1978-01-01

Subjects can correct their own errors of movement more quickly than they can react to external stimuli by using three general categories of feedback: (1) knowledge of results, primarily visually mediated; (2) proprioceptive or kinaesthetic such as from muscle spindles and joint receptors, and (3) corollary discharge or efference copy within the central nervous system. The effects of these feedbacks on simple reaction time, choice reaction time, and error correction time were studied in four normal human subjects. The movement used was plantarflexion and dorsiflexion of the ankle joint. The feedback loops were modified, by changing the sign of the visual display to alter the subject's perception of results, and by applying vibration at 100 Hz simultaneously to both the agonist and antagonist muscles of the ankle joint. The central processing was interfered with when the subjects were given moderate doses of alcohol (blood alcohol concentration levels of up to 0.07%). Vibration and alcohol increase both the simple and choice reaction times but not the error correction time.

Changes in glance behaviour when using a visual eco-driving system - A field study.

PubMed

Ahlstrom, Christer; Kircher, Katja

2017-01-01

While in-vehicle eco-driving support systems have the potential to reduce greenhouse gas emissions and save fuel, they may also distract drivers, especially if the system makes use of a visual interface. The objective of this study is to investigate the visual behaviour of drivers interacting with such a system, implemented on a five-inch screen mounted above the middle console. Ten drivers participated in a real-world, on-road driving study where they drove a route nine times (2 pre-baseline drives, 5 treatment drives, 2 post-baseline drives). The route was 96 km long and consisted of rural roads, urban roads and a dual-lane motorway. The results show that drivers look at the system for 5-8% of the time, depending on road type, with a glance duration of about 0.6 s, and with 0.05% long glances (>2s) per kilometre. These figures are comparable to what was found for glances to the speedometer in this study. Glance behaviour away from the windscreen is slightly increased in treatment as compared to pre- and post-baseline, mirror glances decreased in treatment and post-baseline compared to pre-baseline, and speedometer glances increased compared to pre-baseline. The eco-driving support system provided continuous information interspersed with additional advice pop-ups (announced by a beep) and feedback pop-ups (no auditory cue). About 20% of sound initiated advice pop-ups were disregarded, and the remaining cases were usually looked at within the first two seconds. About 40% of the feedback pop-ups were disregarded. The amount of glances to the system immediately before the onset of a pop-up was clearly higher for feedback than for advice. All in all, the eco-driving support system under investigation is not likely to have a strong negative impact on glance behaviour. However, there is room for improvements. We recommend that eco-driving information is integrated with the speedometer, that optional activation of sound alerts for intermittent information is made available, and that the pop-up duration should be extended to facilitate self-regulation of information intake. Copyright © 2016 Elsevier Ltd. All rights reserved.

Designing between Pedagogies and Cultures: Audio-Visual Chinese Language Resources for Australian Schools

ERIC Educational Resources Information Center

Yuan, Yifeng; Shen, Huizhong

2016-01-01

This design-based study examines the creation and development of audio-visual Chinese language teaching and learning materials for Australian schools by incorporating users' feedback and content writers' input that emerged in the designing process. Data were collected from workshop feedback of two groups of Chinese-language teachers from primary…

Using Real-Time Visual Feedback to Improve Posture at Computer Workstations

ERIC Educational Resources Information Center

Sigurdsson, Sigurdur O.; Austin, John

2008-01-01

The purpose of the current study was to examine the effects of a multicomponent intervention that included discrimination training, real-time visual feedback, and self-monitoring on postural behavior at a computer workstation in a simulated office environment. Using a nonconcurrent multiple baseline design across 8 participants, the study assessed…

Facilitating Learning from Animated Instruction: Effectiveness of Questions and Feedback as Attention-Directing Strategies

ERIC Educational Resources Information Center

Lin, Huifen

2011-01-01

The purpose of this study was to investigate the relative effectiveness of different types of visuals (static and animated) and instructional strategies (no strategy, questions, and questions plus feedback) used to complement visualized materials on students' learning of different educational objectives in a computer-based instructional (CBI)…

Effects of visual feedback balance training on the balance and ankle instability in adult men with functional ankle instability.

PubMed

Nam, Seung-Min; Kim, Kyoung; Lee, Do Youn

2018-01-01

[Purpose] This study examined the effects of visual feedback balance training on the balance and ankle instability in adult men with functional ankle instability. [Subjects and Methods] Twenty eight adults with functional ankle instability, divided randomly into an experimental group, which performed visual feedback balance training for 20 minutes and ankle joint exercises for 10 minutes, and a control group, which performed ankle joint exercise for 30 minutes. Exercises were completed three times a week for 8 weeks. Bio rescue was used for balance ability. It measured limit of stability at one minute. For ankle instability was measured using Cumberland ankle instability tool (CAIT). This measure was performed before and after the experiments in each group. [Results] The experimental group had significant increase in the Limit of Stability and CAIT score. The control group had significant increase in CAIT score. While the Limit of Stability increased without significance. [Conclusion] In conclusion, visual feedback balance training can be recommended as a treatment method for patients with functional ankle instability.

Incidental Auditory Category Learning

PubMed Central

Gabay, Yafit; Dick, Frederic K.; Zevin, Jason D.; Holt, Lori L.

2015-01-01

Very little is known about how auditory categories are learned incidentally, without instructions to search for category-diagnostic dimensions, overt category decisions, or experimenter-provided feedback. This is an important gap because learning in the natural environment does not arise from explicit feedback and there is evidence that the learning systems engaged by traditional tasks are distinct from those recruited by incidental category learning. We examined incidental auditory category learning with a novel paradigm, the Systematic Multimodal Associations Reaction Time (SMART) task, in which participants rapidly detect and report the appearance of a visual target in one of four possible screen locations. Although the overt task is rapid visual detection, a brief sequence of sounds precedes each visual target. These sounds are drawn from one of four distinct sound categories that predict the location of the upcoming visual target. These many-to-one auditory-to-visuomotor correspondences support incidental auditory category learning. Participants incidentally learn categories of complex acoustic exemplars and generalize this learning to novel exemplars and tasks. Further, learning is facilitated when category exemplar variability is more tightly coupled to the visuomotor associations than when the same stimulus variability is experienced across trials. We relate these findings to phonetic category learning. PMID:26010588

Perception of CPR quality: Influence of CPR feedback, Just-in-Time CPR training and provider role.

PubMed

Cheng, Adam; Overly, Frank; Kessler, David; Nadkarni, Vinay M; Lin, Yiqun; Doan, Quynh; Duff, Jonathan P; Tofil, Nancy M; Bhanji, Farhan; Adler, Mark; Charnovich, Alex; Hunt, Elizabeth A; Brown, Linda L

2015-02-01

Many healthcare providers rely on visual perception to guide cardiopulmonary resuscitation (CPR), but little is known about the accuracy of provider perceptions of CPR quality. We aimed to describe the difference between perceived versus measured CPR quality, and to determine the impact of provider role, real-time visual CPR feedback and Just-in-Time (JIT) CPR training on provider perceptions. We conducted secondary analyses of data collected from a prospective, multicenter, randomized trial of 324 healthcare providers who participated in a simulated cardiac arrest scenario between July 2012 and April 2014. Participants were randomized to one of four permutations of: JIT CPR training and real-time visual CPR feedback. We calculated the difference between perceived and measured quality of CPR and reported the proportion of subjects accurately estimating the quality of CPR within each study arm. Participants overestimated achieving adequate chest compression depth (mean difference range: 16.1-60.6%) and rate (range: 0.2-51%), and underestimated chest compression fraction (0.2-2.9%) across all arms. Compared to no intervention, the use of real-time feedback and JIT CPR training (alone or in combination) improved perception of depth (p<0.001). Accurate estimation of CPR quality was poor for chest compression depth (0-13%), rate (5-46%) and chest compression fraction (60-63%). Perception of depth is more accurate in CPR providers versus team leaders (27.8% vs. 7.4%; p=0.043) when using real-time feedback. Healthcare providers' visual perception of CPR quality is poor. Perceptions of CPR depth are improved by using real-time visual feedback and with prior JIT CPR training. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Impact of online visual feedback on motor acquisition and retention when learning to reach in a force field.

PubMed

Batcho, C S; Gagné, M; Bouyer, L J; Roy, J S; Mercier, C

2016-11-19

When subjects learn a novel motor task, several sources of feedback (proprioceptive, visual or auditory) contribute to the performance. Over the past few years, several studies have investigated the role of visual feedback in motor learning, yet evidence remains conflicting. The aim of this study was therefore to investigate the role of online visual feedback (VFb) on the acquisition and retention stages of motor learning associated with training in a reaching task. Thirty healthy subjects made ballistic reaching movements with their dominant arm toward two targets, on 2 consecutive days using a robotized exoskeleton (KINARM). They were randomly assigned to a group with (VFb) or without (NoVFb) VFb of index position during movement. On day 1, the task was performed before (baseline) and during the application of a velocity-dependent resistive force field (adaptation). To assess retention, participants repeated the task with the force field on day 2. Motor learning was characterized by: (1) the final endpoint error (movement accuracy) and (2) the initial angle (iANG) of deviation (motor planning). Even though both groups showed motor adaptation, the NoVFb-group exhibited slower learning and higher final endpoint error than the VFb-group. In some condition, subjects trained without visual feedback used more curved initial trajectories to anticipate for the perturbation. This observation suggests that learning to reach targets in a velocity-dependent resistive force field is possible even when feedback is limited. However, the absence of VFb leads to different strategies that were only apparent when reaching toward the most challenging target. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Viewing geometry determines the contribution of binocular vision to the online control of grasping.

PubMed

Keefe, Bruce D; Watt, Simon J

2017-12-01

Binocular vision is often assumed to make a specific, critical contribution to online visual control of grasping by providing precise information about the separation between digits and object. This account overlooks the 'viewing geometry' typically encountered in grasping, however. Separation of hand and object is rarely aligned precisely with the line of sight (the visual depth dimension), and analysis of the raw signals suggests that, for most other viewing angles, binocular feedback is less precise than monocular feedback. Thus, online grasp control relying selectively on binocular feedback would not be robust to natural changes in viewing geometry. Alternatively, sensory integration theory suggests that different signals contribute according to their relative precision, in which case the role of binocular feedback should depend on viewing geometry, rather than being 'hard-wired'. We manipulated viewing geometry, and assessed the role of binocular feedback by measuring the effects on grasping of occluding one eye at movement onset. Loss of binocular feedback resulted in a significantly less extended final slow-movement phase when hand and object were separated primarily in the frontoparallel plane (where binocular information is relatively imprecise), compared to when they were separated primarily along the line of sight (where binocular information is relatively precise). Consistent with sensory integration theory, this suggests the role of binocular (and monocular) vision in online grasp control is not a fixed, 'architectural' property of the visuo-motor system, but arises instead from the interaction of viewer and situation, allowing robust online control across natural variations in viewing geometry.

3D visualization of movements can amplify motor cortex activation during subsequent motor imagery

PubMed Central

Sollfrank, Teresa; Hart, Daniel; Goodsell, Rachel; Foster, Jonathan; Tan, Tele

2015-01-01

A repetitive movement practice by motor imagery (MI) can influence motor cortical excitability in the electroencephalogram (EEG). This study investigated if a realistic visualization in 3D of upper and lower limb movements can amplify motor related potentials during subsequent MI. We hypothesized that a richer sensory visualization might be more effective during instrumental conditioning, resulting in a more pronounced event related desynchronization (ERD) of the upper alpha band (10–12 Hz) over the sensorimotor cortices thereby potentially improving MI based brain-computer interface (BCI) protocols for motor rehabilitation. The results show a strong increase of the characteristic patterns of ERD of the upper alpha band components for left and right limb MI present over the sensorimotor areas in both visualization conditions. Overall, significant differences were observed as a function of visualization modality (VM; 2D vs. 3D). The largest upper alpha band power decrease was obtained during MI after a 3-dimensional visualization. In total in 12 out of 20 tasks the end-user of the 3D visualization group showed an enhanced upper alpha ERD relative to 2D VM group, with statistical significance in nine tasks.With a realistic visualization of the limb movements, we tried to increase motor cortex activation during subsequent MI. The feedback and the feedback environment should be inherently motivating and relevant for the learner and should have an appeal of novelty, real-world relevance or aesthetic value (Ryan and Deci, 2000; Merrill, 2007). Realistic visual feedback, consistent with the participant’s MI, might be helpful for accomplishing successful MI and the use of such feedback may assist in making BCI a more natural interface for MI based BCI rehabilitation. PMID:26347642

3D visualization of movements can amplify motor cortex activation during subsequent motor imagery.

PubMed

Sollfrank, Teresa; Hart, Daniel; Goodsell, Rachel; Foster, Jonathan; Tan, Tele

2015-01-01

A repetitive movement practice by motor imagery (MI) can influence motor cortical excitability in the electroencephalogram (EEG). This study investigated if a realistic visualization in 3D of upper and lower limb movements can amplify motor related potentials during subsequent MI. We hypothesized that a richer sensory visualization might be more effective during instrumental conditioning, resulting in a more pronounced event related desynchronization (ERD) of the upper alpha band (10-12 Hz) over the sensorimotor cortices thereby potentially improving MI based brain-computer interface (BCI) protocols for motor rehabilitation. The results show a strong increase of the characteristic patterns of ERD of the upper alpha band components for left and right limb MI present over the sensorimotor areas in both visualization conditions. Overall, significant differences were observed as a function of visualization modality (VM; 2D vs. 3D). The largest upper alpha band power decrease was obtained during MI after a 3-dimensional visualization. In total in 12 out of 20 tasks the end-user of the 3D visualization group showed an enhanced upper alpha ERD relative to 2D VM group, with statistical significance in nine tasks.With a realistic visualization of the limb movements, we tried to increase motor cortex activation during subsequent MI. The feedback and the feedback environment should be inherently motivating and relevant for the learner and should have an appeal of novelty, real-world relevance or aesthetic value (Ryan and Deci, 2000; Merrill, 2007). Realistic visual feedback, consistent with the participant's MI, might be helpful for accomplishing successful MI and the use of such feedback may assist in making BCI a more natural interface for MI based BCI rehabilitation.

The integration of temporally shifted visual feedback in a synchronization task: The role of perceptual stability in a visuo-proprioceptive conflict situation.

PubMed

Ceux, Tanja; Montagne, Gilles; Buekers, Martinus J

2010-12-01

The present study examined whether the beneficial role of coherently grouped visual motion structures for performing complex (interlimb) coordination patterns can be generalized to synchronization behavior in a visuo-proprioceptive conflict situation. To achieve this goal, 17 participants had to synchronize a self-moved circle, representing the arm movement, with a visual target signal corresponding to five temporally shifted visual feedback conditions (0%, 25%, 50%, 75%, and 100% of the target cycle duration) in three synchronization modes (in-phase, anti-phase, and intermediate). The results showed that the perception of a newly generated perceptual Gestalt between the visual feedback of the arm and the target signal facilitated the synchronization performance in the preferred in-phase synchronization mode in contrast to the less stable anti-phase and intermediate mode. Our findings suggest that the complexity of the synchronization mode defines to what extent the visual and/or proprioceptive information source affects the synchronization performance in the present unimanual synchronization task. Copyright © 2010 Elsevier B.V. All rights reserved.

The interaction of respiration and visual feedback on the control of force and neural activation of the agonist muscle

PubMed Central

Baweja, Harsimran S.; Patel, Bhavini K.; Neto, Osmar P.; Christou, Evangelos A.

2011-01-01

The purpose of this study was to compare force variability and the neural activation of the agonist muscle during constant isometric contractions at different force levels when the amplitude of respiration and visual feedback were varied. Twenty young adults (20–32 years, 10 men and 10 women) were instructed to accurately match a target force at 15 and 50% of their maximal voluntary contraction (MVC) with abduction of the index finger while controlling their respiration at different amplitudes (85, 100 and 125% normal) in the presence and absence of visual feedback. Each trial lasted 22 s and visual feedback was removed from 8–12 to 16–20 s. Each subject performed 3 trials with each respiratory condition at each force level. Force variability was quantified as the standard deviation of the detrended force data. The neural activation of the first dorsal interosseus (FDI) was measured with bipolar surface electrodes placed distal to the innervation zone. Relative to normal respiration, force variability increased significantly only during high-amplitude respiration (~63%). The increase in force variability from normal- to high-amplitude respiration was strongly associated with amplified force oscillations from 0–3 Hz (R2 ranged from .68 – .84; p < .001). Furthermore, the increase in force variability was exacerbated in the presence of visual feedback at 50% MVC (vision vs. no-vision: .97 vs. .87 N) and was strongly associated with amplified force oscillations from 0–1 Hz (R2 = .82) and weakly associated with greater power from 12–30 Hz (R2 = .24) in the EMG of the agonist muscle. Our findings demonstrate that high-amplitude respiration and visual feedback of force interact and amplify force variability in young adults during moderate levels of effort. PMID:21546109

Prior history of FDI muscle contraction: different effect on MEP amplitude and muscle activity.

PubMed

Talis, V L; Kazennikov, O V; Castellote, J M; Grishin, A A; Ioffe, M E

2014-03-01

Motor evoked potentials (MEPs) in the right first dorsal interosseous (FDI) muscle elicited by transcranial magnetic stimulation of left motor cortex were assessed in ten healthy subjects during maintenance of a fixed FDI contraction level. Subjects maintained an integrated EMG (IEMG) level with visual feedback and reproduced this level by memory afterwards in the following tasks: stationary FDI muscle contraction at the level of 40 ± 5 % of its maximum voluntary contraction (MVC; 40 % task), at the level of 20 ± 5 % MVC (20 % task), and also when 20 % MVC was preceded by either no contraction (0-20 task), by stronger muscle contraction (40-20 task) or by no contraction with a previous strong contraction (40-0-20 task). The results show that the IEMG level was within the prescribed limits when 20 and 40 % stationary tasks were executed with and without visual feedback. In 0-20, 40-20, and 40-0-20 tasks, 20 % IEMG level was precisely controlled in the presence of visual feedback, but without visual feedback the IEMG and force during 20 % IEMG maintenance were significantly higher in the 40-0-20 task than those in 0-20 and 40-20 tasks. That is, without visual feedback, there were significant variations in muscle activity due to different prehistory of contraction. In stationary tasks, MEP amplitudes in 40 % task were higher than in 20 % task. MEPs did not differ significantly during maintenance of the 20 % level in tasks with different prehistory of muscle contraction with and without visual feedback. Thus, in spite of variations in muscle background activity due to different prehistory of contraction MEPs did not vary significantly. This dissociation suggests that the voluntary maintenance of IEMG level is determined not only by cortical mechanisms, as reflected by corticospinal excitability, but also by lower levels of CNS, where afferent signals and influences from other brain structures and spinal cord are convergent.

A system verification platform for high-density epiretinal prostheses.

PubMed

Chen, Kuanfu; Lo, Yi-Kai; Yang, Zhi; Weiland, James D; Humayun, Mark S; Liu, Wentai

2013-06-01

Retinal prostheses have restored light perception to people worldwide who have poor or no vision as a consequence of retinal degeneration. To advance the quality of visual stimulation for retinal implant recipients, a higher number of stimulation channels is expected in the next generation retinal prostheses, which poses a great challenge to system design and verification. This paper presents a system verification platform dedicated to the development of retinal prostheses. The system includes primary processing, dual-band power and data telemetry, a high-density stimulator array, and two methods for output verification. End-to-end system validation and individual functional block characterization can be achieved with this platform through visual inspection and software analysis. Custom-built software running on the computers also provides a good way for testing new features before they are realized by the ICs. Real-time visual feedbacks through the video displays make it easy to monitor and debug the system. The characterization of the wireless telemetry and the demonstration of the visual display are reported in this paper using a 256-channel retinal prosthetic IC as an example.

Haptics-based immersive telerobotic system for improvised explosive device disposal: Are two hands better than one?

NASA Astrophysics Data System (ADS)

Erickson, David; Lacheray, Hervé; Lambert, Jason Michel; Mantegh, Iraj; Crymble, Derry; Daly, John; Zhao, Yan

2012-06-01

State-of-the-art robotic explosive ordnance disposal robotics have not, in general, adopted recent advances in control technology and man-machine interfaces and lag many years behind academia. This paper describes the Haptics-based Immersive Telerobotic System project investigating an immersive telepresence envrionment incorporating advanced vehicle control systems, Augmented immersive sensory feedback, dynamic 3D visual information, and haptic feedback for explosive ordnance disposal operators. The project aim is to provide operatiors a more sophisticated interface and expand sensory input to perform complex tasks to defeat improvised explosive devices successfully. The introduction of haptics and immersive teleprescence has the potential to shift the way teleprescence systems work for explosive ordnance disposal tasks or more widely for first responders scenarios involving remote unmanned ground vehicles.

Fitts’ Law in the Control of Isometric Grip Force With Naturalistic Targets

PubMed Central

Thumser, Zachary C.; Slifkin, Andrew B.; Beckler, Dylan T.; Marasco, Paul D.

2018-01-01

Fitts’ law models the relationship between amplitude, precision, and speed of rapid movements. It is widely used to quantify performance in pointing tasks, study human-computer interaction, and generally to understand perceptual-motor information processes, including research to model performance in isometric force production tasks. Applying Fitts’ law to an isometric grip force task would allow for quantifying grasp performance in rehabilitative medicine and may aid research on prosthetic control and design. We examined whether Fitts’ law would hold when participants attempted to accurately produce their intended force output while grasping a manipulandum when presented with images of various everyday objects (we termed this the implicit task). Although our main interest was the implicit task, to benchmark it and establish validity, we examined performance against a more standard visual feedback condition via a digital force-feedback meter on a video monitor (explicit task). Next, we progressed from visual force feedback with force meter targets to the same targets without visual force feedback (operating largely on feedforward control with tactile feedback). This provided an opportunity to see if Fitts’ law would hold without vision, and allowed us to progress toward the more naturalistic implicit task (which does not include visual feedback). Finally, we changed the nature of the targets from requiring explicit force values presented as arrows on a force-feedback meter (explicit targets) to the more naturalistic and intuitive target forces implied by images of objects (implicit targets). With visual force feedback the relation between task difficulty and the time to produce the target grip force was predicted by Fitts’ law (average r2 = 0.82). Without vision, average grip force scaled accurately although force variability was insensitive to the target presented. In contrast, images of everyday objects generated more reliable grip forces without the visualized force meter. In sum, population means were well-described by Fitts’ law for explicit targets with vision (r2 = 0.96) and implicit targets (r2 = 0.89), but not as well-described for explicit targets without vision (r2 = 0.54). Implicit targets should provide a realistic see-object-squeeze-object test using Fitts’ law to quantify the relative speed-accuracy relationship of any given grasper. PMID:29773999

Feedforward and feedback motor control abnormalities implicate cerebellar dysfunctions in autism spectrum disorder.

PubMed

Mosconi, Matthew W; Mohanty, Suman; Greene, Rachel K; Cook, Edwin H; Vaillancourt, David E; Sweeney, John A

2015-02-04

Sensorimotor abnormalities are common in autism spectrum disorder (ASD) and among the earliest manifestations of the disorder. They have been studied far less than the social-communication and cognitive deficits that define ASD, but a mechanistic understanding of sensorimotor abnormalities in ASD may provide key insights into the neural underpinnings of the disorder. In this human study, we examined rapid, precision grip force contractions to determine whether feedforward mechanisms supporting initial motor output before sensory feedback can be processed are disrupted in ASD. Sustained force contractions also were examined to determine whether reactive adjustments to ongoing motor behavior based on visual feedback are altered. Sustained force was studied across multiple force levels and visual gains to assess motor and visuomotor mechanisms, respectively. Primary force contractions of individuals with ASD showed greater peak rate of force increases and large transient overshoots. Individuals with ASD also showed increased sustained force variability that scaled with force level and was more severe when visual gain was highly amplified or highly degraded. When sustaining a constant force level, their reactive adjustments were more periodic than controls, and they showed increased reliance on slower feedback mechanisms. Feedforward and feedback mechanism alterations each were associated with more severe social-communication impairments in ASD. These findings implicate anterior cerebellar circuits involved in feedforward motor control and posterior cerebellar circuits involved in transforming visual feedback into precise motor adjustments in ASD. Copyright © 2015 the authors 0270-6474/15/352015-11$15.00/0.

Dynamic reweighting of three modalities for sensor fusion.

PubMed

Hwang, Sungjae; Agada, Peter; Kiemel, Tim; Jeka, John J

2014-01-01

We simultaneously perturbed visual, vestibular and proprioceptive modalities to understand how sensory feedback is re-weighted so that overall feedback remains suited to stabilizing upright stance. Ten healthy young subjects received an 80 Hz vibratory stimulus to their bilateral Achilles tendons (stimulus turns on-off at 0.28 Hz), a ± 1 mA binaural monopolar galvanic vestibular stimulus at 0.36 Hz, and a visual stimulus at 0.2 Hz during standing. The visual stimulus was presented at different amplitudes (0.2, 0.8 deg rotation about ankle axis) to measure: the change in gain (weighting) to vision, an intramodal effect; and a change in gain to vibration and galvanic vestibular stimulation, both intermodal effects. The results showed a clear intramodal visual effect, indicating a de-emphasis on vision when the amplitude of visual stimulus increased. At the same time, an intermodal visual-proprioceptive reweighting effect was observed with the addition of vibration, which is thought to change proprioceptive inputs at the ankles, forcing the nervous system to rely more on vision and vestibular modalities. Similar intermodal effects for visual-vestibular reweighting were observed, suggesting that vestibular information is not a "fixed" reference, but is dynamically adjusted in the sensor fusion process. This is the first time, to our knowledge, that the interplay between the three primary modalities for postural control has been clearly delineated, illustrating a central process that fuses these modalities for accurate estimates of self-motion.

Impact of visual and somatosensory deprivation on dynamic balance in adolescent idiopathic scoliosis.

PubMed

Kuo, Fang-Chuan; Wang, Nai-Hwei; Hong, Chang-Zern

2010-11-01

A cross-sectional study of balance control in adolescents with idiopathic scoliosis (AIS). To investigate the impact of visual and somatosensory deprivation on the dynamic balance in AIS patients and to discuss electromyographic (EMG) and posture sway findings. Most studies focus on posture sway in quiet standing controls with little effort on examining muscle-activated patterns in dynamic standing controls. Twenty-two AIS patients and 22 age-matched normal subjects were studied. To understand how visual and somatosensory information could modulate standing balance, balance tests with the Biodex stability system were performed on a moving platform under 3 conditions: visual feedback provided (VF), eyes closed (EC), and standing on a sponge pad with visual feedback provided (SV). Muscular activities of bilateral lumbar multifidi, gluteus medii, and gastrocnemii muscles were recorded with a telemetry EMG system. AIS patients had normal balance index and amplitude and duration of EMG similar to those of normal subjects in the balance test. However, the onset latency of right gastrocnemius was earlier in AIS patients than in normal subjects. In addition, body-side asymmetry was noted on muscle strength and onset latency in AIS subjects. Under EC condition, lumbar multifidi, and gluteus medii activities were higher than those under SV and VF conditions (P < 0.05). Under SV condition, the medial-lateral tilting angle was less than that under VF and EC conditions. In addition, the active duration of right gluteus medius was shorter under SV condition (P < 0.05). The dynamic balance control is particularly disruptive under visual deprivation with increasing lumbar multifidi and gluteus medii activities for compensation. Sponge pad can cause decrease in frontal plane tilting and gluteus medii effort. The asymmetric muscle strength and onset timing are attributed to anatomic deformation as opposed to neurologic etiological factors.

An architecture for rapid prototyping of control schemes for artificial ventricles.

PubMed

Ficola, Antonio; Pagnottelli, Stefano; Valigi, Paolo; Zoppitelli, Maurizio

2004-01-01

This paper presents an experimental system aimed at rapid prototyping of feedback control schemes for ventricular assist devices, and artificial ventricles in general. The system comprises a classical mock circulatory system, an actuated bellow-based ventricle chamber, and a software architecture for control schemes implementation and experimental data acquisition, visualization and storing. Several experiments have been carried out, showing good performance of ventricular pressure tracking control schemes.

Teaching Road Signs and Traffic Laws to Learning Disabled Students.

ERIC Educational Resources Information Center

Test, David W.; Heward, William L.

1983-01-01

Eight learning disabled males (16 to 17 years old) participated in a driver education unit via a visual response system, allowing students greater response and feedback. After the conclusion of the unit, all Ss scored above the criterion established by the Digest of Ohio Motor Vehicle Laws. (CL)

Selective and divided attention modulates auditory-vocal integration in the processing of pitch feedback errors.

PubMed

Liu, Ying; Hu, Huijing; Jones, Jeffery A; Guo, Zhiqiang; Li, Weifeng; Chen, Xi; Liu, Peng; Liu, Hanjun

2015-08-01

Speakers rapidly adjust their ongoing vocal productions to compensate for errors they hear in their auditory feedback. It is currently unclear what role attention plays in these vocal compensations. This event-related potential (ERP) study examined the influence of selective and divided attention on the vocal and cortical responses to pitch errors heard in auditory feedback regarding ongoing vocalisations. During the production of a sustained vowel, participants briefly heard their vocal pitch shifted up two semitones while they actively attended to auditory or visual events (selective attention), or both auditory and visual events (divided attention), or were not told to attend to either modality (control condition). The behavioral results showed that attending to the pitch perturbations elicited larger vocal compensations than attending to the visual stimuli. Moreover, ERPs were likewise sensitive to the attentional manipulations: P2 responses to pitch perturbations were larger when participants attended to the auditory stimuli compared to when they attended to the visual stimuli, and compared to when they were not explicitly told to attend to either the visual or auditory stimuli. By contrast, dividing attention between the auditory and visual modalities caused suppressed P2 responses relative to all the other conditions and caused enhanced N1 responses relative to the control condition. These findings provide strong evidence for the influence of attention on the mechanisms underlying the auditory-vocal integration in the processing of pitch feedback errors. In addition, selective attention and divided attention appear to modulate the neurobehavioral processing of pitch feedback errors in different ways. © 2015 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Timing variation in an analytically solvable chaotic system

NASA Astrophysics Data System (ADS)

Blakely, J. N.; Milosavljevic, M. S.; Corron, N. J.

2017-02-01

We present analytic solutions for a chaotic dynamical system that do not have the regular timing characteristic of recently reported solvable chaotic systems. The dynamical system can be viewed as a first order filter with binary feedback. The feedback state may be switched only at instants defined by an external clock signal. Generalizing from a period one clock, we show analytic solutions for period two and higher period clocks. We show that even when the clock 'ticks' randomly the chaotic system has an analytic solution. These solutions can be visualized in a stroboscopic map whose complexity increases with the complexity of the clock. We provide both analytic results as well as experimental data from an electronic circuit implementation of the system. Our findings bridge the gap between the irregular timing of well known chaotic systems such as Lorenz and Rossler and the well regulated oscillations of recently reported solvable chaotic systems.

Visual information transfer. 1: Assessment of specific information needs. 2: The effects of degraded motion feedback. 3: Parameters of appropriate instrument scanning behavior

NASA Technical Reports Server (NTRS)

Comstock, J. R., Jr.; Kirby, R. H.; Coates, G. D.

1984-01-01

Pilot and flight crew assessment of visually displayed information is examined as well as the effects of degraded and uncorrected motion feedback, and instrument scanning efficiency by the pilot. Computerized flight simulation and appropriate physiological measurements are used to collect data for standardization.

The Use of Visual Feedback during Signing: Evidence from Signers with Impaired Vision

ERIC Educational Resources Information Center

Emmorey, Karen; Korpics, Franco; Petronio, Karen

2009-01-01

The role of visual feedback during the production of American Sign Language was investigated by comparing the size of signing space during conversations and narrative monologues for normally sighted signers, signers with tunnel vision due to Usher syndrome, and functionally blind signers. The interlocutor for all groups was a normally sighted deaf…

The Effects of Task Clarification, Visual Prompts, and Graphic Feedback on Customer Greeting and Up-Selling in a Restaurant

ERIC Educational Resources Information Center

Squires, James; Wilder, David A.; Fixsen, Amanda; Hess, Erica; Rost, Kristen; Curran, Ryan; Zonneveld, Kimberly

2007-01-01

An intervention consisting of task clarification, visual prompts, and graphic feedback was evaluated to increase customer greeting and up-selling in a restaurant. A combination multiple baseline and reversal design was used to evaluate intervention effects. Although all interventions improved performance over baseline, the delivery of graphic…

Ultrasound as Visual Feedback in Speech Habilitation: Exploring Consultative Use in Rural British Columbia, Canada

ERIC Educational Resources Information Center

Bernhardt, B. May; Bacsfalvi, Penelope; Adler-Bock, Marcy; Shimizu, Reiko; Cheney, Audrey; Giesbrecht, Nathan; O'Connell, Maureen; Sirianni, Jason; Radanov, Bosko

2008-01-01

Ultrasound has shown promise as a visual feedback tool in speech therapy. Rural clients, however, often have minimal access to new technologies. The purpose of the current study was to evaluate consultative treatment using ultrasound in rural communities. Two speech-language pathologists (SLPs) trained in ultrasound use provided consultation with…

Funny money: the attentional role of monetary feedback detached from expected value.

PubMed

Roper, Zachary J J; Vecera, Shaun P

2016-10-01

Stimuli associated with monetary reward can become powerful cues that effectively capture visual attention. We examined whether such value-driven attentional capture can be induced with monetary feedback in the absence of an expected cash payout. To this end, we implemented images of U.S. dollar bills as reward feedback. Participants knew in advance that they would not receive any money based on their performance. Our reward stimuli-$5 and $20 bill images-were thus dissociated from any practical utility. Strikingly, we observed a reliable attentional capture effect for the mere images of bills. Moreover, this finding generalized to Monopoly money. In two control experiments, we found no evidence in favor of nominal or symbolic monetary value. Hence, we claim that bill images are special monetary representations, such that there are strong associations between the defining visual features of bills and reward, probably due to a lifelong learning history. Together, we show that the motivation to earn cash plays a minor role when it comes to monetary rewards, while bill-defining visual features seem to be sufficient. These findings have the potential to influence human factor applications, such as gamification, and can be extended to novel value systems, such as the electronic cash Bitcoin being developed for use in mobile banking. Finally, our procedure represents a proof of concept on how images of money can be used to conserve expenditures in the experimental context.

Proline and COMT Status Affect Visual Connectivity in Children with 22q11.2 Deletion Syndrome

PubMed Central

Magnée, Maurice J. C. M.; Lamme, Victor A. F.; de Sain-van der Velden, Monique G. M.; Vorstman, Jacob A. S.; Kemner, Chantal

2011-01-01

Background Individuals with the 22q11.2 deletion syndrome (22q11DS) are at increased risk for schizophrenia and Autism Spectrum Disorders (ASDs). Given the prevalence of visual processing deficits in these three disorders, a causal relationship between genes in the deleted region of chromosome 22 and visual processing is likely. Therefore, 22q11DS may represent a unique model to understand the neurobiology of visual processing deficits related with ASD and psychosis. Methodology We measured Event-Related Potentials (ERPs) during a texture segregation task in 58 children with 22q11DS and 100 age-matched controls. The C1 component was used to index afferent activity of visual cortex area V1; the texture negativity wave provided a measure for the integrity of recurrent connections in the visual cortical system. COMT genotype and plasma proline levels were assessed in 22q11DS individuals. Principal Findings Children with 22q11DS showed enhanced feedforward activity starting from 70 ms after visual presentation. ERP activity related to visual feedback activity was reduced in the 22q11DS group, which was seen as less texture negativity around 150 ms post presentation. Within the 22q11DS group we further demonstrated an association between high plasma proline levels and aberrant feedback/feedforward ratios, which was moderated by the COMT 158 genotype. Conclusions These findings confirm the presence of early visual processing deficits in 22q11DS. We discuss these in terms of dysfunctional synaptic plasticity in early visual processing areas, possibly associated with deviant dopaminergic and glutamatergic transmission. As such, our findings may serve as a promising biomarker related to the development of schizophrenia among 22q11DS individuals. PMID:21998713

Visual feedback attenuates mean concentric barbell velocity loss, and improves motivation, competitiveness, and perceived workload in male adolescent athletes.

PubMed

Weakley, Jonathon Js; Wilson, Kyle M; Till, Kevin; Read, Dale B; Darrall-Jones, Joshua; Roe, Gregory; Phibbs, Padraic J; Jones, Ben

2017-07-12

It is unknown whether instantaneous visual feedback of resistance training outcomes can enhance barbell velocity in younger athletes. Therefore, the purpose of this study was to quantify the effects of visual feedback on mean concentric barbell velocity in the back squat, and to identify changes in motivation, competitiveness, and perceived workload. In a randomised-crossover design (Feedback vs. Control) feedback of mean concentric barbell velocity was or was not provided throughout a set of 10 repetitions in the barbell back squat. Magnitude-based inferences were used to assess changes between conditions, with almost certainly greater differences in mean concentric velocity between the Feedback (0.70 ±0.04 m·s) and Control (0.65 ±0.05 m·s) observed. Additionally, individual repetition mean concentric velocity ranged from possibly (repetition number two: 0.79 ±0.04 vs. 0.78 ±0.04 m·s) to almost certainly (repetition number 10: 0.58 ±0.05 vs. 0.49 ±0.05 m·s) greater when provided feedback, while almost certain differences were observed in motivation, competitiveness, and perceived workload, respectively. Providing adolescent male athletes with visual kinematic information while completing resistance training is beneficial for the maintenance of barbell velocity during a training set, potentially enhancing physical performance. Moreover, these improvements were observed alongside increases in motivation, competitiveness and perceived workload providing insight into the underlying mechanisms responsible for the performance gains observed. Given the observed maintenance of barbell velocity during a training set, practitioners can use this technique to manipulate training outcomes during resistance training.

A novel shape-changing haptic table-top display

NASA Astrophysics Data System (ADS)

Wang, Jiabin; Zhao, Lu; Liu, Yue; Wang, Yongtian; Cai, Yi

2018-01-01

A shape-changing table-top display with haptic feedback allows its users to perceive 3D visual and texture displays interactively. Since few existing devices are developed as accurate displays with regulatory haptic feedback, a novel attentive and immersive shape changing mechanical interface (SCMI) consisting of image processing unit and transformation unit was proposed in this paper. In order to support a precise 3D table-top display with an offset of less than 2 mm, a custommade mechanism was developed to form precise surface and regulate the feedback force. The proposed image processing unit was capable of extracting texture data from 2D picture for rendering shape-changing surface and realizing 3D modeling. The preliminary evaluation result proved the feasibility of the proposed system.

Saccadic adaptation to a systematically varying disturbance.

PubMed

Cassanello, Carlos R; Ohl, Sven; Rolfs, Martin

2016-08-01

Saccadic adaptation maintains the correct mapping between eye movements and their targets, yet the dynamics of saccadic gain changes in the presence of systematically varying disturbances has not been extensively studied. Here we assessed changes in the gain of saccade amplitudes induced by continuous and periodic postsaccadic visual feedback. Observers made saccades following a sequence of target steps either along the horizontal meridian (Two-way adaptation) or with unconstrained saccade directions (Global adaptation). An intrasaccadic step-following a sinusoidal variation as a function of the trial number (with 3 different frequencies tested in separate blocks)-consistently displaced the target along its vector. The oculomotor system responded to the resulting feedback error by modifying saccade amplitudes in a periodic fashion with similar frequency of variation but lagging the disturbance by a few tens of trials. This periodic response was superimposed on a drift toward stronger hypometria with similar asymptotes and decay rates across stimulus conditions. The magnitude of the periodic response decreased with increasing frequency and was smaller and more delayed for Global than Two-way adaptation. These results suggest that-in addition to the well-characterized return-to-baseline response observed in protocols using constant visual feedback-the oculomotor system attempts to minimize the feedback error by integrating its variation across trials. This process resembles a convolution with an internal response function, whose structure would be determined by coefficients of the learning model. Our protocol reveals this fast learning process in single short experimental sessions, qualifying it for the study of sensorimotor learning in health and disease. Copyright © 2016 the American Physiological Society.

A survey of telerobotic surface finishing

NASA Astrophysics Data System (ADS)

Höglund, Thomas; Alander, Jarmo; Mantere, Timo

2018-05-01

This is a survey of research published on the subjects of telerobotics, haptic feedback, and mixed reality applied to surface finishing. The survey especially focuses on how visuo-haptic feedback can be used to improve a grinding process using a remote manipulator or robot. The benefits of teleoperation and reasons for using haptic feedback are presented. The use of genetic algorithms for optimizing haptic sensing is briefly discussed. Ways of augmenting the operator's vision are described. Visual feedback can be used to find defects and analyze the quality of the surface resulting from the surface finishing process. Visual cues can also be used to aid a human operator in manipulating a robot precisely and avoiding collisions.

Real-Time Performance Feedback for the Manual Control of Spacecraft

NASA Astrophysics Data System (ADS)

Karasinski, John Austin

Real-time performance metrics were developed to quantify workload, situational awareness, and manual task performance for use as visual feedback to pilots of aerospace vehicles. Results from prior lunar lander experiments with variable levels of automation were replicated and extended to provide insights for the development of real-time metrics. Increased levels of automation resulted in increased flight performance, lower workload, and increased situational awareness. Automated Speech Recognition (ASR) was employed to detect verbal callouts as a limited measure of subjects' situational awareness. A one-dimensional manual tracking task and simple instructor-model visual feedback scheme was developed. This feedback was indicated to the operator by changing the color of a guidance element on the primary flight display, similar to how a flight instructor points out elements of a display to a student pilot. Experiments showed that for this low-complexity task, visual feedback did not change subject performance, but did increase the subjects' measured workload. Insights gained from these experiments were applied to a Simplified Aid for EVA Rescue (SAFER) inspection task. The effects of variations of an instructor-model performance-feedback strategy on human performance in a novel SAFER inspection task were investigated. Real-time feedback was found to have a statistically significant effect of improving subject performance and decreasing workload in this complicated four degree of freedom manual control task with two secondary tasks.

The Understanding and Interpretation of Innovative Technology-Enabled Multidimensional Physical Activity Feedback in Patients at Risk of Future Chronic Disease

PubMed Central

Western, Max J.; Peacock, Oliver J.; Stathi, Afroditi; Thompson, Dylan

2015-01-01

Background Innovative physical activity monitoring technology can be used to depict rich visual feedback that encompasses the various aspects of physical activity known to be important for health. However, it is unknown whether patients who are at risk of chronic disease would understand such sophisticated personalised feedback or whether they would find it useful and motivating. The purpose of the present study was to determine whether technology-enabled multidimensional physical activity graphics and visualisations are comprehensible and usable for patients at risk of chronic disease. Method We developed several iterations of graphics depicting minute-by-minute activity patterns and integrated physical activity health targets. Subsequently, patients at moderate/high risk of chronic disease (n=29) and healthcare practitioners (n=15) from South West England underwent full 7-days activity monitoring followed by individual semi-structured interviews in which they were asked to comment on their own personalised visual feedback Framework analysis was used to gauge their interpretation and of personalised feedback, graphics and visualisations. Results We identified two main components focussing on (a) the interpretation of feedback designs and data and (b) the impact of personalised visual physical activity feedback on facilitation of health behaviour change. Participants demonstrated a clear ability to understand the sophisticated personal information plus an enhanced physical activity knowledge. They reported that receiving multidimensional feedback was motivating and could be usefully applied to facilitate their efforts in becoming more physically active. Conclusion Multidimensional physical activity feedback can be made comprehensible, informative and motivational by using appropriate graphics and visualisations. There is an opportunity to exploit the full potential created by technological innovation and provide sophisticated personalised physical activity feedback as an adjunct to support behaviour change. PMID:25938455

A haptics-assisted cranio-maxillofacial surgery planning system for restoring skeletal anatomy in complex trauma cases.

PubMed

Olsson, Pontus; Nysjö, Fredrik; Hirsch, Jan-Michaél; Carlbom, Ingrid B

2013-11-01

   Cranio-maxillofacial (CMF) surgery to restore normal skeletal anatomy in patients with serious trauma to the face can be both complex and time-consuming. But it is generally accepted that careful pre-operative planning leads to a better outcome with a higher degree of function and reduced morbidity in addition to reduced time in the operating room. However, today's surgery planning systems are primitive, relying mostly on the user's ability to plan complex tasks with a two-dimensional graphical interface.    A system for planning the restoration of skeletal anatomy in facial trauma patients using a virtual model derived from patient-specific CT data. The system combines stereo visualization with six degrees-of-freedom, high-fidelity haptic feedback that enables analysis, planning, and preoperative testing of alternative solutions for restoring bone fragments to their proper positions. The stereo display provides accurate visual spatial perception, and the haptics system provides intuitive haptic feedback when bone fragments are in contact as well as six degrees-of-freedom attraction forces for precise bone fragment alignment.    A senior surgeon without prior experience of the system received 45 min of system training. Following the training session, he completed a virtual reconstruction in 22 min of a complex mandibular fracture with an adequately reduced result.    Preliminary testing with one surgeon indicates that our surgery planning system, which combines stereo visualization with sophisticated haptics, has the potential to become a powerful tool for CMF surgery planning. With little training, it allows a surgeon to complete a complex plan in a short amount of time.

Implementation of a six-degree-of-freedom manual controller with passive force feedback

NASA Astrophysics Data System (ADS)

Will, Carol C.; Crane, Carl D., III; Adsit, Phillip

1995-12-01

Force reflective controllers can be divided into two classes; active and passive with the most common being active. Active force-feedback controllers are prone to self-actuation which can generate unintended commands and may injure the user. A six-degree-of-freedom positional input device was designed and constructed that was capable of providing force-feedback passively through the use of six magnetic hysteresis brakes. Special hardware and control strategies were developed to account for some of the limitations of a passive system and the characteristics of hysteresis brakes. The force-feedback input device has been interfaced to a six-degree-of-freedom robot to perform a variety of tasks. Initial research was conducted with a peg-in-hole task. Future research is to include contour following and bead-on-wire tests. Initial results indicated that force-feedback may only be an improvement in situations where visual cues are not clear, and may actually be a hindrance when a clear line of sight exists.

Caudate nucleus reactivity predicts perceptual learning rate for visual feature conjunctions.

PubMed

Reavis, Eric A; Frank, Sebastian M; Tse, Peter U

2015-04-15

Useful information in the visual environment is often contained in specific conjunctions of visual features (e.g., color and shape). The ability to quickly and accurately process such conjunctions can be learned. However, the neural mechanisms responsible for such learning remain largely unknown. It has been suggested that some forms of visual learning might involve the dopaminergic neuromodulatory system (Roelfsema et al., 2010; Seitz and Watanabe, 2005), but this hypothesis has not yet been directly tested. Here we test the hypothesis that learning visual feature conjunctions involves the dopaminergic system, using functional neuroimaging, genetic assays, and behavioral testing techniques. We use a correlative approach to evaluate potential associations between individual differences in visual feature conjunction learning rate and individual differences in dopaminergic function as indexed by neuroimaging and genetic markers. We find a significant correlation between activity in the caudate nucleus (a component of the dopaminergic system connected to visual areas of the brain) and visual feature conjunction learning rate. Specifically, individuals who showed a larger difference in activity between positive and negative feedback on an unrelated cognitive task, indicative of a more reactive dopaminergic system, learned visual feature conjunctions more quickly than those who showed a smaller activity difference. This finding supports the hypothesis that the dopaminergic system is involved in visual learning, and suggests that visual feature conjunction learning could be closely related to associative learning. However, no significant, reliable correlations were found between feature conjunction learning and genotype or dopaminergic activity in any other regions of interest. Copyright © 2015 Elsevier Inc. All rights reserved.

Motion detection technology as a tool for cardiopulmonary resuscitation (CPR) quality training: a randomised crossover mannequin pilot study.

PubMed

Semeraro, Federico; Frisoli, Antonio; Loconsole, Claudio; Bannò, Filippo; Tammaro, Gaetano; Imbriaco, Guglielmo; Marchetti, Luca; Cerchiari, Erga L

2013-04-01

Outcome after cardiac arrest is dependent on the quality of chest compressions (CC). A great number of devices have been developed to provide guidance during CPR. The present study evaluates a new CPR feedback system (Mini-VREM: Mini-Virtual Reality Enhanced Mannequin) designed to improve CC during training. Mini-VREM system consists of a Kinect(®) (Microsoft, Redmond, WA, USA) motion sensing device and specifically developed software to provide audio-visual feedback. Mini-VREM was connected to a commercially available mannequin (Laerdal Medical, Stavanger, Norway). Eighty trainees (healthcare professionals and lay people) volunteered in this randomised crossover pilot study. All subjects performed a 2 min CC trial, 1h pause and a second 2 min CC trial. The first group (FB/NFB, n=40) performed CC with Mini-VREM feedback (FB) followed by CC without feedback (NFB). The second group (NFB/FB, n=40) performed vice versa. Primary endpoints: adequate compression (compression rate between 100 and 120 min(-1) and compression depth between 50 and 60mm); compressions rate within 100-120 min(-1); compressions depth within 50-60mm. When compared to the performance without feedback, with Mini-VREM feedback compressions were more adequate (FB 35.78% vs. NFB 7.27%, p<0.001) and more compressions achieved target rate (FB 72.04% vs. 31.42%, p<0.001) and target depth (FB 47.34% vs. 24.87%, p=0.002). The participants perceived the system to be easy to use with effective feedback. The Mini-VREM system was able to improve significantly the CC performance by healthcare professionals and by lay people in a simulated CA scenario, in terms of compression rate and depth. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

An Algorithm Enabling Blind Users to Find and Read Barcodes

PubMed Central

Tekin, Ender; Coughlan, James M.

2010-01-01

Most camera-based systems for finding and reading barcodes are designed to be used by sighted users (e.g. the Red Laser iPhone app), and assume the user carefully centers the barcode in the image before the barcode is read. Blind individuals could benefit greatly from such systems to identify packaged goods (such as canned goods in a supermarket), but unfortunately in their current form these systems are completely inaccessible because of their reliance on visual feedback from the user. To remedy this problem, we propose a computer vision algorithm that processes several frames of video per second to detect barcodes from a distance of several inches; the algorithm issues directional information with audio feedback (e.g. “left,” “right”) and thereby guides a blind user holding a webcam or other portable camera to locate and home in on a barcode. Once the barcode is detected at sufficiently close range, a barcode reading algorithm previously developed by the authors scans and reads aloud the barcode and the corresponding product information. We demonstrate encouraging experimental results of our proposed system implemented on a desktop computer with a webcam held by a blindfolded user; ultimately the system will be ported to a camera phone for use by visually impaired users. PMID:20617114

The Classroom Check-up: A Classwide Teacher Consultation Model for Increasing Praise and Decreasing Disruptive Behavior

PubMed Central

Reinke, Wendy M.; Lewis-Palmer, Teri; Merrell, Kenneth

2008-01-01

School-based consultation typically focuses on individual student problems and on a small number of students rather than on changing the classroom system. The Classroom Check-up (CCU) was developed as a classwide consultation model to address the need for classroom level support while minimizing treatment integrity problems common to school-based consultation. The purpose of the study was to evaluate the effects of the CCU and Visual Performance Feedback on teacher and student behavior. Results indicated that implementation of the CCU plus Visual Performance Feedback increased teacher implementation of classroom management strategies, including increased use of praise, use of behavior specific praise, and decreased use of reprimands. Further, these changes in teacher behavior contributed to decreases in classroom disruptive behavior. The results are encouraging because they suggest that consultation at the classroom level can create meaningful teacher and student behavior change. PMID:19122805

Wrist Camera Orientation for Effective Telerobotic Orbital Replaceable Unit (ORU) Changeout

NASA Technical Reports Server (NTRS)

Jones, Sharon Monica; Aldridge, Hal A.; Vazquez, Sixto L.

1997-01-01

The Hydraulic Manipulator Testbed (HMTB) is the kinematic replica of the Flight Telerobotic Servicer (FTS). One use of the HMTB is to evaluate advanced control techniques for accomplishing robotic maintenance tasks on board the Space Station. Most maintenance tasks involve the direct manipulation of the robot by a human operator when high-quality visual feedback is important for precise control. An experiment was conducted in the Systems Integration Branch at the Langley Research Center to compare several configurations of the manipulator wrist camera for providing visual feedback during an Orbital Replaceable Unit changeout task. Several variables were considered such as wrist camera angle, camera focal length, target location, lighting. Each study participant performed the maintenance task by using eight combinations of the variables based on a Latin square design. The results of this experiment and conclusions based on data collected are presented.

Anatomy and physiology of the afferent visual system.

PubMed

Prasad, Sashank; Galetta, Steven L

2011-01-01

The efficient organization of the human afferent visual system meets enormous computational challenges. Once visual information is received by the eye, the signal is relayed by the retina, optic nerve, chiasm, tracts, lateral geniculate nucleus, and optic radiations to the striate cortex and extrastriate association cortices for final visual processing. At each stage, the functional organization of these circuits is derived from their anatomical and structural relationships. In the retina, photoreceptors convert photons of light to an electrochemical signal that is relayed to retinal ganglion cells. Ganglion cell axons course through the optic nerve, and their partial decussation in the chiasm brings together corresponding inputs from each eye. Some inputs follow pathways to mediate pupil light reflexes and circadian rhythms. However, the majority of inputs arrive at the lateral geniculate nucleus, which relays visual information via second-order neurons that course through the optic radiations to arrive in striate cortex. Feedback mechanisms from higher cortical areas shape the neuronal responses in early visual areas, supporting coherent visual perception. Detailed knowledge of the anatomy of the afferent visual system, in combination with skilled examination, allows precise localization of neuropathological processes and guides effective diagnosis and management of neuro-ophthalmic disorders. Copyright © 2011 Elsevier B.V. All rights reserved.

The effects of augmented visual feedback during balance training in Parkinson's disease: study design of a randomized clinical trial.

PubMed

van den Heuvel, Maarten R C; van Wegen, Erwin E H; de Goede, Cees J T; Burgers-Bots, Ingrid A L; Beek, Peter J; Daffertshofer, Andreas; Kwakkel, Gert

2013-10-04

Patients with Parkinson's disease often suffer from reduced mobility due to impaired postural control. Balance exercises form an integral part of rehabilitative therapy but the effectiveness of existing interventions is limited. Recent technological advances allow for providing enhanced visual feedback in the context of computer games, which provide an attractive alternative to conventional therapy. The objective of this randomized clinical trial is to investigate whether a training program capitalizing on virtual-reality-based visual feedback is more effective than an equally-dosed conventional training in improving standing balance performance in patients with Parkinson's disease. Patients with idiopathic Parkinson's disease will participate in a five-week balance training program comprising ten treatment sessions of 60 minutes each. Participants will be randomly allocated to (1) an experimental group that will receive balance training using augmented visual feedback, or (2) a control group that will receive balance training in accordance with current physical therapy guidelines for Parkinson's disease patients. Training sessions consist of task-specific exercises that are organized as a series of workstations. Assessments will take place before training, at six weeks, and at twelve weeks follow-up. The functional reach test will serve as the primary outcome measure supplemented by comprehensive assessments of functional balance, posturography, and electroencephalography. We hypothesize that balance training based on visual feedback will show greater improvements on standing balance performance than conventional balance training. In addition, we expect that learning new control strategies will be visible in the co-registered posturographic recordings but also through changes in functional connectivity.

Evaluation of Pseudo-Haptic Interactions with Soft Objects in Virtual Environments.

PubMed

Li, Min; Sareh, Sina; Xu, Guanghua; Ridzuan, Maisarah Binti; Luo, Shan; Xie, Jun; Wurdemann, Helge; Althoefer, Kaspar

2016-01-01

This paper proposes a pseudo-haptic feedback method conveying simulated soft surface stiffness information through a visual interface. The method exploits a combination of two feedback techniques, namely visual feedback of soft surface deformation and control of the indenter avatar speed, to convey stiffness information of a simulated surface of a soft object in virtual environments. The proposed method was effective in distinguishing different sizes of virtual hard nodules integrated into the simulated soft bodies. To further improve the interactive experience, the approach was extended creating a multi-point pseudo-haptic feedback system. A comparison with regards to (a) nodule detection sensitivity and (b) elapsed time as performance indicators in hard nodule detection experiments to a tablet computer incorporating vibration feedback was conducted. The multi-point pseudo-haptic interaction is shown to be more time-efficient than the single-point pseudo-haptic interaction. It is noted that multi-point pseudo-haptic feedback performs similarly well when compared to a vibration-based feedback method based on both performance measures elapsed time and nodule detection sensitivity. This proves that the proposed method can be used to convey detailed haptic information for virtual environmental tasks, even subtle ones, using either a computer mouse or a pressure sensitive device as an input device. This pseudo-haptic feedback method provides an opportunity for low-cost simulation of objects with soft surfaces and hard inclusions, as, for example, occurring in ever more realistic video games with increasing emphasis on interaction with the physical environment and minimally invasive surgery in the form of soft tissue organs with embedded cancer nodules. Hence, the method can be used in many low-budget applications where haptic sensation is required, such as surgeon training or video games, either using desktop computers or portable devices, showing reasonably high fidelity in conveying stiffness perception to the user.

Problem solving in great apes (Pan paniscus, Pan troglodytes, Gorilla gorilla, and Pongo abelii): the effect of visual feedback.

PubMed

Völter, Christoph J; Call, Josep

2012-09-01

What kind of information animals use when solving problems is a controversial topic. Previous research suggests that, in some situations, great apes prefer to use causally relevant cues over arbitrary ones. To further examine to what extent great apes are able to use information about causal relations, we presented three different puzzle box problems to the four nonhuman great ape species. Of primary interest here was a comparison between one group of apes that received visual access to the functional mechanisms of the puzzle boxes and one group that did not. Apes' performance in the first two, less complex puzzle boxes revealed that they are able to solve such problems by means of trial-and-error learning, requiring no information about the causal structure of the problem. However, visual inspection of the functional mechanisms of the puzzle boxes reduced the amount of time needed to solve the problems. In the case of the most complex problem, which required the use of a crank, visual feedback about what happened when the handle of the crank was turned was necessary for the apes to solve the task. Once the solution was acquired, however, visual feedback was no longer required. We conclude that visual feedback about the consequences of their actions helps great apes to solve complex problems. As the crank task matches the basic requirements of vertical string pulling in birds, the present results are discussed in light of recent findings with corvids.

Electrocardiographic anxiety profiles improve speech anxiety.

PubMed

Kim, Pyoung Won; Kim, Seung Ae; Jung, Keun-Hwa

2012-12-01

The present study was to set out in efforts to determine the effect of electrocardiographic (ECG) feedback on the performance in speech anxiety. Forty-six high school students participated in a speech performance educational program. They were randomly divided into two groups, an experimental group with ECG feedback (N = 21) and a control group (N = 25). Feedback was given with video recording in the control, whereas in the experimental group, an additional ECG feedback was provided. Speech performance was evaluated by the Korean Broadcasting System (KBS) speech ability test, which determines the 10 different speaking categories. ECG was recorded during rest and speech, together with a video recording of the speech performance. Changes in R-R intervals were used to reflect anxiety profiles. Three trials were performed for 3-week program. Results showed that the subjects with ECG feedback revealed a significant improvement in speech performance and anxiety states, which compared to those in the control group. These findings suggest that visualization of the anxiety profile feedback with ECG can be a better cognitive therapeutic strategy in speech anxiety.

Color Processing in the Early Visual System of Drosophila.

PubMed

Schnaitmann, Christopher; Haikala, Väinö; Abraham, Eva; Oberhauser, Vitus; Thestrup, Thomas; Griesbeck, Oliver; Reiff, Dierk F

2018-01-11

Color vision extracts spectral information by comparing signals from photoreceptors with different visual pigments. Such comparisons are encoded by color-opponent neurons that are excited at one wavelength and inhibited at another. Here, we examine the circuit implementation of color-opponent processing in the Drosophila visual system by combining two-photon calcium imaging with genetic dissection of visual circuits. We report that color-opponent processing of UV short /blue and UV long /green is already implemented in R7/R8 inner photoreceptor terminals of "pale" and "yellow" ommatidia, respectively. R7 and R8 photoreceptors of the same type of ommatidia mutually inhibit each other directly via HisCl1 histamine receptors and receive additional feedback inhibition that requires the second histamine receptor Ort. Color-opponent processing at the first visual synapse represents an unexpected commonality between Drosophila and vertebrates; however, the differences in the molecular and cellular implementation suggest that the same principles evolved independently. Copyright © 2017 Elsevier Inc. All rights reserved.

Three timescales in prism adaptation.

PubMed

Inoue, Masato; Uchimura, Motoaki; Karibe, Ayaka; O'Shea, Jacinta; Rossetti, Yves; Kitazawa, Shigeru

2015-01-01

It has been proposed that motor adaptation depends on at least two learning systems, one that learns fast but with poor retention and another that learns slowly but with better retention (Smith MA, Ghazizadeh A, Shadmehr R. PLoS Biol 4: e179, 2006). This two-state model has been shown to account for a range of behavior in the force field adaptation task. In the present study, we examined whether such a two-state model could also account for behavior arising from adaptation to a prismatic displacement of the visual field. We first confirmed that an "adaptation rebound," a critical prediction of the two-state model, occurred when visual feedback was deprived after an adaptation-extinction episode. We then examined the speed of decay of the prism aftereffect (without any visual feedback) after repetitions of 30, 150, and 500 trials of prism exposure. The speed of decay decreased with the number of exposure trials, a phenomenon that was best explained by assuming an "ultraslow" system, in addition to the fast and slow systems. Finally, we compared retention of aftereffects 24 h after 150 or 500 trials of exposure: retention was significantly greater after 500 than 150 trials. This difference in retention could not be explained by the two-state model but was well explained by the three-state model as arising from the difference in the amount of adaptation of the "ultraslow process." These results suggest that there are not only fast and slow systems but also an ultraslow learning system in prism adaptation that is activated by prolonged prism exposure of 150-500 trials. Copyright © 2015 the American Physiological Society.

Updating Target Location at the End of an Orienting Saccade Affects the Characteristics of Simple Point-to-Point Movements

ERIC Educational Resources Information Center

Desmurget, Michel; Turner, Robert S.; Prablanc, Claude; Russo, Gary S.; Alexander, Garret E.; Grafton, Scott T.

2005-01-01

Six results are reported. (a) Reaching accuracy increases when visual capture of the target is allowed (e.g., target on vs. target off at saccade onset). (b) Whatever the visual condition, trajectories diverge only after peak acceleration, suggesting that accuracy is improved through feedback mechanisms. (c) Feedback corrections are smoothly…

Encouraging Electricity Savings in a University Residential Hall through a Combination of Feedback, Visual Prompts, and Incentives

ERIC Educational Resources Information Center

Bekker, Marthinus J.; Cumming, Tania D.; Osborne, Nikola K. P.; Bruining, Angela M.; McClean, Julia I.; Leland, Louis S., Jr.

2010-01-01

This experiment investigated the combined use of visual prompts, daily feedback, and rewards to reduce electricity consumption in a university residential hall. After a 17-day baseline period, the experimental intervention was introduced in the intervention hall, and no change was made in the control hall. Energy usage decreased in the…

THE EFFECT OF VISUAL FEEDBACK ON PRONUNCIATION IN FOREIGN LANGUAGE LEARNING. TERMINATION OF RESEARCH REPORT.

ERIC Educational Resources Information Center

JENSON, PAUL G.; WESTERMEIER, FRANZ X.

A RESEARCH PROJECT USING THE OSCILLOSCOPE TO DETERMINE VISUAL FEEDBACK IN THE TEACHING OF FOREIGN LANGUAGE PRONUNCIATION WAS TERMINATED BECAUSE OF TECHNICAL DIFFICULTIES THAT COULD NOT BE RESOLVED WITH THE EQUIPMENT AVAILABLE. FAILURE IS ATTRIBUTED TO SUCH FACTORS AS (1) THE SPEECH SOUND WAVES SOUND THE SAME THOUGH THEIR WAVE SHAPES DIFFER, (2)…

The Impact of Feedback on Self-Rated Driving Ability and Driving Self-Regulation among Older Adults

ERIC Educational Resources Information Center

Ackerman, Michelle L.; Crowe, Michael; Vance, David E.; Wadley, Virginia G.; Owsley, Cynthia; Ball, Karlene K.

2011-01-01

In 129 community-dwelling older adults, feedback regarding qualification for an insurance discount (based on a visual speed of processing test; Useful Field of View) was examined as a prospective predictor of change in self-reported driving ability, driving avoidance, and driving exposure over 3 months, along with physical, visual, health, and…

Ultrasound visual feedback treatment and practice variability for residual speech sound errors

PubMed Central

Preston, Jonathan L.; McCabe, Patricia; Rivera-Campos, Ahmed; Whittle, Jessica L.; Landry, Erik; Maas, Edwin

2014-01-01

Purpose The goals were to (1) test the efficacy of a motor-learning based treatment that includes ultrasound visual feedback for individuals with residual speech sound errors, and (2) explore whether the addition of prosodic cueing facilitates speech sound learning. Method A multiple baseline single subject design was used, replicated across 8 participants. For each participant, one sound context was treated with ultrasound plus prosodic cueing for 7 sessions, and another sound context was treated with ultrasound but without prosodic cueing for 7 sessions. Sessions included ultrasound visual feedback as well as non-ultrasound treatment. Word-level probes assessing untreated words were used to evaluate retention and generalization. Results For most participants, increases in accuracy of target sound contexts at the word level were observed with the treatment program regardless of whether prosodic cueing was included. Generalization between onset singletons and clusters was observed, as well as generalization to sentence-level accuracy. There was evidence of retention during post-treatment probes, including at a two-month follow-up. Conclusions A motor-based treatment program that includes ultrasound visual feedback can facilitate learning of speech sounds in individuals with residual speech sound errors. PMID:25087938

Prism adaptation in virtual and natural contexts: Evidence for a flexible adaptive process.

PubMed

Veilleux, Louis-Nicolas; Proteau, Luc

2015-01-01

Prism exposure when aiming at a visual target in a virtual condition (e.g., when the hand is represented by a video representation) produces no or only small adaptations (after-effects), whereas prism exposure in a natural condition produces large after-effects. Some researchers suggested that this difference may arise from distinct adaptive processes, but other studies suggested a unique process. The present study reconciled these conflicting interpretations. Forty participants were divided into two groups: One group used visual feedback of their hand (natural context), and the other group used computer-generated representational feedback (virtual context). Visual feedback during adaptation was concurrent or terminal. All participants underwent laterally displacing prism perturbation. The results showed that the after-effects were twice as large in the "natural context" than in the "virtual context". No significant differences were observed between the concurrent and terminal feedback conditions. The after-effects generalized to untested targets and workspace. These results suggest that prism adaptation in virtual and natural contexts involves the same process. The smaller after-effects in the virtual context suggest that the depth of adaptation is a function of the degree of convergence between the proprioceptive and visual information that arises from the hand.

Use of Visual and Proprioceptive Feedback to Improve Gait Speed and Spatiotemporal Symmetry Following Chronic Stroke: A Case Series

PubMed Central

Feasel, Jeff; Wentz, Erin; Brooks, Frederick P.; Whitton, Mary C.

2012-01-01

Background and Purpose Persistent deficits in gait speed and spatiotemporal symmetry are prevalent following stroke and can limit the achievement of community mobility goals. Rehabilitation can improve gait speed, but has shown limited ability to improve spatiotemporal symmetry. The incorporation of combined visual and proprioceptive feedback regarding spatiotemporal symmetry has the potential to be effective at improving gait. Case Description A 60-year-old man (18 months poststroke) and a 53-year-old woman (21 months poststroke) each participated in gait training to improve gait speed and spatiotemporal symmetry. Each patient performed 18 sessions (6 weeks) of combined treadmill-based gait training followed by overground practice. To assist with relearning spatiotemporal symmetry, treadmill-based training for both patients was augmented with continuous, real-time visual and proprioceptive feedback from an immersive virtual environment and a dual belt treadmill, respectively. Outcomes Both patients improved gait speed (patient 1: 0.35 m/s improvement; patient 2: 0.26 m/s improvement) and spatiotemporal symmetry. Patient 1, who trained with step-length symmetry feedback, improved his step-length symmetry ratio, but not his stance-time symmetry ratio. Patient 2, who trained with stance-time symmetry feedback, improved her stance-time symmetry ratio. She had no step-length asymmetry before training. Discussion Both patients made improvements in gait speed and spatiotemporal symmetry that exceeded those reported in the literature. Further work is needed to ascertain the role of combined visual and proprioceptive feedback for improving gait speed and spatiotemporal symmetry after chronic stroke. PMID:22228605

Direction of Magnetoencephalography Sources Associated with Feedback and Feedforward Contributions in a Visual Object Recognition Task

PubMed Central

Ahlfors, Seppo P.; Jones, Stephanie R.; Ahveninen, Jyrki; Hämäläinen, Matti S.; Belliveau, John W.; Bar, Moshe

2014-01-01

Identifying inter-area communication in terms of the hierarchical organization of functional brain areas is of considerable interest in human neuroimaging. Previous studies have suggested that the direction of magneto- and electroencephalography (MEG, EEG) source currents depends on the layer-specific input patterns into a cortical area. We examined the direction in MEG source currents in a visual object recognition experiment in which there were specific expectations of activation in the fusiform region being driven by either feedforward or feedback inputs. The source for the early non-specific visual evoked response, presumably corresponding to feedforward driven activity, pointed outward, i.e., away from the white matter. In contrast, the source for the later, object-recognition related signals, expected to be driven by feedback inputs, pointed inward, toward the white matter. Associating specific features of the MEG/EEG source waveforms to feedforward and feedback inputs could provide unique information about the activation patterns within hierarchically organized cortical areas. PMID:25445356

Independent voluntary correction and savings in locomotor learning.

PubMed

Leech, Kristan A; Roemmich, Ryan T

2018-06-14

People can acquire new walking patterns in many different ways. For example, we can change our gait voluntarily in response to instruction or adapt by sensing our movement errors. Here we investigated how acquisition of a new walking pattern through simultaneous voluntary correction and adaptive learning affected the resulting motor memory of the learned pattern. We studied adaptation to split-belt treadmill walking with and without visual feedback of stepping patterns. As expected, visual feedback enabled faster acquisition of the new walking pattern. However, upon later re-exposure to the same split-belt perturbation, participants exhibited similar motor memories whether they had learned with or without visual feedback. Participants who received feedback did not re-engage the mechanism used to accelerate initial acquisition of the new walking pattern to similarly accelerate subsequent relearning. These findings reveal that voluntary correction neither benefits nor interferes with the ability to save a new walking pattern over time. © 2018. Published by The Company of Biologists Ltd.

Distinct Feedforward and Feedback Effects of Microstimulation in Visual Cortex Reveal Neural Mechanisms of Texture Segregation.

PubMed

Klink, P Christiaan; Dagnino, Bruno; Gariel-Mathis, Marie-Alice; Roelfsema, Pieter R

2017-07-05

The visual cortex is hierarchically organized, with low-level areas coding for simple features and higher areas for complex ones. Feedforward and feedback connections propagate information between areas in opposite directions, but their functional roles are only partially understood. We used electrical microstimulation to perturb the propagation of neuronal activity between areas V1 and V4 in monkeys performing a texture-segregation task. In both areas, microstimulation locally caused a brief phase of excitation, followed by inhibition. Both these effects propagated faithfully in the feedforward direction from V1 to V4. Stimulation of V4, however, caused little V1 excitation, but it did yield a delayed suppression during the late phase of visually driven activity. This suppression was pronounced for the V1 figure representation and weaker for background representations. Our results reveal functional differences between feedforward and feedback processing in texture segregation and suggest a specific modulating role for feedback connections in perceptual organization. Copyright © 2017 Elsevier Inc. All rights reserved.

Differential expression of vesicular glutamate transporters 1 and 2 may identify distinct modes of glutamatergic transmission in the macaque visual system

PubMed Central

Balaram, Pooja; Hackett, Troy A.; Kaas, Jon H.

2013-01-01

Glutamate is the primary neurotransmitter utilized by the mammalian visual system for excitatory neurotransmission. The sequestration of glutamate into synaptic vesicles, and the subsequent transport of filled vesicles to the presynaptic terminal membrane, is regulated by a family of proteins known as vesicular glutamate transporters (VGLUTs). Two VGLUT proteins, VGLUT1 and VGLUT2, characterize distinct sets of glutamatergic projections between visual structures in rodents and prosimian primates, yet little is known about their distributions in the visual system of anthropoid primates. We have examined the mRNA and protein expression patterns of VGLUT1 and VGLUT2 in the visual system of macaque monkeys, an Old World anthropoid primate, in order to determine their relative distributions in the superior colliculus, lateral geniculate nucleus, pulvinar complex, V1 and V2. Distinct expression patterns for both VGLUT1 and VGLUT2 identified architectonic boundaries in all structures, as well as anatomical subdivisions of the superior colliculus, pulvinar complex, and V1. These results suggest that VGLUT1 and VGLUT2 clearly identify regions of glutamatergic input in visual structures, and may identify common architectonic features of visual areas and nuclei across the primate radiation. Additionally, we find that VGLUT1 and VGLUT2 characterize distinct subsets of glutamatergic projections in the macaque visual system; VGLUT2 predominates in driving or feedforward projections from lower order to higher order visual structures while VGLUT1 predominates in modulatory or feedback projections from higher order to lower order visual structures. The distribution of these two proteins suggests that VGLUT1 and VGLUT2 may identify class 1 and class 2 type glutamatergic projections within the primate visual system (Sherman and Guillery, 2006). PMID:23524295

Differential expression of vesicular glutamate transporters 1 and 2 may identify distinct modes of glutamatergic transmission in the macaque visual system.

PubMed

Balaram, Pooja; Hackett, Troy A; Kaas, Jon H

2013-05-01

Glutamate is the primary neurotransmitter utilized by the mammalian visual system for excitatory neurotransmission. The sequestration of glutamate into synaptic vesicles, and the subsequent transport of filled vesicles to the presynaptic terminal membrane, is regulated by a family of proteins known as vesicular glutamate transporters (VGLUTs). Two VGLUT proteins, VGLUT1 and VGLUT2, characterize distinct sets of glutamatergic projections between visual structures in rodents and prosimian primates, yet little is known about their distributions in the visual system of anthropoid primates. We have examined the mRNA and protein expression patterns of VGLUT1 and VGLUT2 in the visual system of macaque monkeys, an Old World anthropoid primate, in order to determine their relative distributions in the superior colliculus, lateral geniculate nucleus, pulvinar complex, V1 and V2. Distinct expression patterns for both VGLUT1 and VGLUT2 identified architectonic boundaries in all structures, as well as anatomical subdivisions of the superior colliculus, pulvinar complex, and V1. These results suggest that VGLUT1 and VGLUT2 clearly identify regions of glutamatergic input in visual structures, and may identify common architectonic features of visual areas and nuclei across the primate radiation. Additionally, we find that VGLUT1 and VGLUT2 characterize distinct subsets of glutamatergic projections in the macaque visual system; VGLUT2 predominates in driving or feedforward projections from lower order to higher order visual structures while VGLUT1 predominates in modulatory or feedback projections from higher order to lower order visual structures. The distribution of these two proteins suggests that VGLUT1 and VGLUT2 may identify class 1 and class 2 type glutamatergic projections within the primate visual system (Sherman and Guillery, 2006). Copyright © 2013 Elsevier B.V. All rights reserved.

Visual-perceptual-kinesthetic inputs on influencing writing performances in children with handwriting difficulties.

PubMed

Tse, Linda F L; Thanapalan, Kannan C; Chan, Chetwyn C H

2014-02-01

This study investigated the role of visual-perceptual input in writing Chinese characters among senior school-aged children who had handwriting difficulties (CHD). The participants were 27 CHD (9-11 years old) and 61 normally developed control. There were three writing conditions: copying, and dictations with or without visual feedback. The motor-free subtests of the Developmental Test of Visual Perception (DTVP-2) were conducted. The CHD group showed significantly slower mean speeds of character production and less legibility of produced characters than the control group in all writing conditions (ps<0.001). There were significant deteriorations in legibility from copying to dictation without visual feedback. Nevertheless, the Group by Condition interaction effect was not statistically significant. Only position in space of DTVP-2 was significantly correlated with the legibility among CHD (r=-0.62, p=0.001). Poor legibility seems to be related to the less-intact spatial representation of the characters in working memory, which can be rectified by viewing the characters during writing. Visual feedback regarding one's own actions in writing can also improve legibility of characters among these children. Copyright © 2013 Elsevier Ltd. All rights reserved.

Reliability of Visual and Somatosensory Feedback in Skilled Movement: The Role of the Cerebellum.

PubMed

Mizelle, J C; Oparah, Alexis; Wheaton, Lewis A

2016-01-01

The integration of vision and somatosensation is required to allow for accurate motor behavior. While both sensory systems contribute to an understanding of the state of the body through continuous updating and estimation, how the brain processes unreliable sensory information remains to be fully understood in the context of complex action. Using functional brain imaging, we sought to understand the role of the cerebellum in weighting visual and somatosensory feedback by selectively reducing the reliability of each sense individually during a tool use task. We broadly hypothesized upregulated activation of the sensorimotor and cerebellar areas during movement with reduced visual reliability, and upregulated activation of occipital brain areas during movement with reduced somatosensory reliability. As specifically compared to reduced somatosensory reliability, we expected greater activations of ipsilateral sensorimotor cerebellum for intact visual and somatosensory reliability. Further, we expected that ipsilateral posterior cognitive cerebellum would be affected with reduced visual reliability. We observed that reduced visual reliability results in a trend towards the relative consolidation of sensorimotor activation and an expansion of cerebellar activation. In contrast, reduced somatosensory reliability was characterized by the absence of cerebellar activations and a trend towards the increase of right frontal, left parietofrontal activation, and temporo-occipital areas. Our findings highlight the role of the cerebellum for specific aspects of skillful motor performance. This has relevance to understanding basic aspects of brain functions underlying sensorimotor integration, and provides a greater understanding of cerebellar function in tool use motor control.

Visuomotor adaptation to a visual rotation is gravity dependent.

PubMed

Toma, Simone; Sciutti, Alessandra; Papaxanthis, Charalambos; Pozzo, Thierry

2015-03-15

Humans perform vertical and horizontal arm motions with different temporal patterns. The specific velocity profiles are chosen by the central nervous system by integrating the gravitational force field to minimize energy expenditure. However, what happens when a visuomotor rotation is applied, so that a motion performed in the horizontal plane is perceived as vertical? We investigated the dynamic of the adaptation of the spatial and temporal properties of a pointing motion during prolonged exposure to a 90° visuomotor rotation, where a horizontal movement was associated with a vertical visual feedback. We found that participants immediately adapted the spatial parameters of motion to the conflicting visual scene in order to keep their arm trajectory straight. In contrast, the initial symmetric velocity profiles specific for a horizontal motion were progressively modified during the conflict exposure, becoming more asymmetric and similar to those appropriate for a vertical motion. Importantly, this visual effect that increased with repetitions was not followed by a consistent aftereffect when the conflicting visual feedback was absent (catch and washout trials). In a control experiment we demonstrated that an intrinsic representation of the temporal structure of perceived vertical motions could provide the error signal allowing for this progressive adaptation of motion timing. These findings suggest that gravity strongly constrains motor learning and the reweighting process between visual and proprioceptive sensory inputs, leading to the selection of a motor plan that is suboptimal in terms of energy expenditure. Copyright © 2015 the American Physiological Society.

Solar and Wind Forecasting | Grid Modernization | NREL

Science.gov Websites

and Wind Forecasting Solar and Wind Forecasting As solar and wind power become more common system operators. An aerial photo of the National Wind Technology Center's PV arrays. Capabilities value of accurate forecasting Wind power visualization to direct questions and feedback during industry

Interactive Videodisc as a Component in a Multi-Method Approach to Anatomy and Physiology.

ERIC Educational Resources Information Center

Wheeler, Donald A.; Wheeler, Mary Jane

At Cuyahoga Community College (Ohio), computer-controlled interactive videodisc technology is being used as one of several instructional methods to teach anatomy and physiology. The system has the following features: audio-visual instruction, interaction with immediate feedback, self-pacing, fill-in-the-blank quizzes for testing total recall,…

Measuring and Visualizing Students' Behavioral Engagement in Writing Activities

ERIC Educational Resources Information Center

Liu, Ming; Calvo, Rafael A.; Pardo, Abelardo; Martin, Andrew

2015-01-01

Engagement is critical to the success of learning activities such as writing, and can be promoted with appropriate feedback. Current engagement measures rely mostly on data collected by observers or self-reported by the participants. In this paper, we describe a learning analytic system called Tracer, which derives behavioral engagement measures…

Perceptual learning increases the strength of the earliest signals in visual cortex.

PubMed

Bao, Min; Yang, Lin; Rios, Cristina; He, Bin; Engel, Stephen A

2010-11-10

Training improves performance on most visual tasks. Such perceptual learning can modify how information is read out from, and represented in, later visual areas, but effects on early visual cortex are controversial. In particular, it remains unknown whether learning can reshape neural response properties in early visual areas independent from feedback arising in later cortical areas. Here, we tested whether learning can modify feedforward signals in early visual cortex as measured by the human electroencephalogram. Fourteen subjects were trained for >24 d to detect a diagonal grating pattern in one quadrant of the visual field. Training improved performance, reducing the contrast needed for reliable detection, and also reliably increased the amplitude of the earliest component of the visual evoked potential, the C1. Control orientations and locations showed smaller effects of training. Because the C1 arises rapidly and has a source in early visual cortex, our results suggest that learning can increase early visual area response through local receptive field changes without feedback from later areas.

SILVA tree viewer: interactive web browsing of the SILVA phylogenetic guide trees.

PubMed

Beccati, Alan; Gerken, Jan; Quast, Christian; Yilmaz, Pelin; Glöckner, Frank Oliver

2017-09-30

Phylogenetic trees are an important tool to study the evolutionary relationships among organisms. The huge amount of available taxa poses difficulties in their interactive visualization. This hampers the interaction with the users to provide feedback for the further improvement of the taxonomic framework. The SILVA Tree Viewer is a web application designed for visualizing large phylogenetic trees without requiring the download of any software tool or data files. The SILVA Tree Viewer is based on Web Geographic Information Systems (Web-GIS) technology with a PostgreSQL backend. It enables zoom and pan functionalities similar to Google Maps. The SILVA Tree Viewer enables access to two phylogenetic (guide) trees provided by the SILVA database: the SSU Ref NR99 inferred from high-quality, full-length small subunit sequences, clustered at 99% sequence identity and the LSU Ref inferred from high-quality, full-length large subunit sequences. The Tree Viewer provides tree navigation, search and browse tools as well as an interactive feedback system to collect any kinds of requests ranging from taxonomy to data curation and improving the tool itself.

Aspects of body self-calibration

NASA Technical Reports Server (NTRS)

Lackner, J. R.; DiZio, P. A.

2000-01-01

The representation of body orientation and configuration is dependent on multiple sources of afferent and efferent information about ongoing and intended patterns of movement and posture. Under normal terrestrial conditions, we feel virtually weightless and we do not perceive the actual forces associated with movement and support of our body. It is during exposure to unusual forces and patterns of sensory feedback during locomotion that computations and mechanisms underlying the ongoing calibration of our body dimensions and movements are revealed. This review discusses the normal mechanisms of our position sense and calibration of our kinaesthetic, visual and auditory sensory systems, and then explores the adaptations that take place to transient Coriolis forces generated during passive body rotation. The latter are very rapid adaptations that allow body movements to become accurate again, even in the absence of visual feedback. Muscle spindle activity interpreted in relation to motor commands and internally modeled reafference is an important component in permitting this adaptation. During voluntary rotary movements of the body, the central nervous system automatically compensates for the Coriolis forces generated by limb movements. This allows accurate control to be maintained without our perceiving the forces generated.

Altered visual strategies and attention are related to increased force fluctuations during a pinch grip task in older adults.

PubMed

Keenan, Kevin G; Huddleston, Wendy E; Ernest, Bradley E

2017-11-01

The purpose of the study was to determine the visual strategies used by older adults during a pinch grip task and to assess the relations between visual strategy, deficits in attention, and increased force fluctuations in older adults. Eye movements of 23 older adults (>65 yr) were monitored during a low-force pinch grip task while subjects viewed three common visual feedback displays. Performance on the Grooved Pegboard test and an attention task (which required no concurrent hand movements) was also measured. Visual strategies varied across subjects and depended on the type of visual feedback provided to the subjects. First, while viewing a high-gain compensatory feedback display (horizontal bar moving up and down with force), 9 of 23 older subjects adopted a strategy of performing saccades during the task, which resulted in 2.5 times greater force fluctuations in those that exhibited saccades compared with those who maintained fixation near the target line. Second, during pursuit feedback displays (force trace moving left to right across screen and up and down with force), all subjects exhibited multiple saccades, and increased force fluctuations were associated ( r s = 0.6; P = 0.002) with fewer saccades during the pursuit task. Also, decreased low-frequency (<4 Hz) force fluctuations and Grooved Pegboard times were significantly related ( P = 0.033 and P = 0.005, respectively) with higher (i.e., better) attention z scores. Comparison of these results with our previously published results in young subjects indicates that saccadic eye movements and attention are related to force control in older adults. NEW & NOTEWORTHY The significant contributions of the study are the addition of eye movement data and an attention task to explain differences in hand motor control across different visual displays in older adults. Older participants used different visual strategies across varying feedback displays, and saccadic eye movements were related with motor performance. In addition, those older individuals with deficits in attention had impaired motor performance on two different hand motor control tasks, including the Grooved Pegboard test. Copyright © 2017 the American Physiological Society.

Manipulating the fidelity of lower extremity visual feedback to identify obstacle negotiation strategies in immersive virtual reality.

PubMed

Kim, Aram; Zhou, Zixuan; Kretch, Kari S; Finley, James M

2017-07-01

The ability to successfully navigate obstacles in our environment requires integration of visual information about the environment with estimates of our body's state. Previous studies have used partial occlusion of the visual field to explore how information about the body and impending obstacles are integrated to mediate a successful clearance strategy. However, because these manipulations often remove information about both the body and obstacle, it remains to be seen how information about the lower extremities alone is utilized during obstacle crossing. Here, we used an immersive virtual reality (VR) interface to explore how visual feedback of the lower extremities influences obstacle crossing performance. Participants wore a head-mounted display while walking on treadmill and were instructed to step over obstacles in a virtual corridor in four different feedback trials. The trials involved: (1) No visual feedback of the lower extremities, (2) an endpoint-only model, (3) a link-segment model, and (4) a volumetric multi-segment model. We found that the volumetric model improved success rate, placed their trailing foot before crossing and leading foot after crossing more consistently, and placed their leading foot closer to the obstacle after crossing compared to no model. This knowledge is critical for the design of obstacle negotiation tasks in immersive virtual environments as it may provide information about the fidelity necessary to reproduce ecologically valid practice environments.

Promoting Increased Pitch Variation in Oral Presentations with Transient Visual Feedback

ERIC Educational Resources Information Center

Hincks, Rebecca; Edlund, Jens

2009-01-01

This paper investigates learner response to a novel kind of intonation feedback generated from speech analysis. Instead of displays of pitch curves, our feedback is flashing lights that show how much pitch variation the speaker has produced. The variable used to generate the feedback is the standard deviation of fundamental frequency as measured…

Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users.

PubMed

Witteveen, Heidi J B; Rietman, Hans S; Veltink, Peter H

2015-06-01

User feedback about grasping force and hand aperture is very important in object handling with myoelectric forearm prostheses but is lacking in current prostheses. Vibrotactile feedback increases the performance of healthy subjects in virtual grasping tasks, but no extensive validation on potential users has been performed. Investigate the performance of upper-limb loss subjects in grasping tasks with vibrotactile stimulation, providing hand aperture, and grasping force feedback. Cross-over trial. A total of 10 subjects with upper-limb loss performed virtual grasping tasks while perceiving vibrotactile feedback. Hand aperture feedback was provided through an array of coin motors and grasping force feedback through a single miniature stimulator or an array of coin motors. Objects with varying sizes and weights had to be grasped by a virtual hand. Percentages correctly applied hand apertures and correct grasping force levels were all higher for the vibrotactile feedback condition compared to the no-feedback condition. With visual feedback, the results were always better compared to the vibrotactile feedback condition. Task durations were comparable for all feedback conditions. Vibrotactile grasping force and hand aperture feedback improves grasping performance of subjects with upper-limb loss. However, it should be investigated whether this is of additional value in daily-life tasks. This study is a first step toward the implementation of sensory vibrotactile feedback for users of myoelectric forearm prostheses. Grasping force feedback is crucial for optimal object handling, and hand aperture feedback is essential for reduction of required visual attention. Grasping performance with feedback is evaluated for the potential users. © The International Society for Prosthetics and Orthotics 2014.

Reduced pressure for fewer pressure ulcers: can real-time feedback of interface pressure optimise repositioning in bed?

PubMed

Gunningberg, Lena; Carli, Cheryl

2016-10-01

The aim of this study was to (i) describe registered nurses' and assistant nurses' repositioning skills with regard to their existing attitudes to and theoretical knowledge of pressure ulcer (PU) prevention, and (ii) evaluate if the continuous bedside pressure mapping (CBPM) system provides staff with a pedagogic tool to optimise repositioning. A quantitative study was performed using a descriptive, comparative design. Registered nurses (n = 19) and assistant nurses (n = 33) worked in pairs, and were instructed to place two volunteers (aged over 70 years) in the best pressure-reducing position (lateral and supine), first without viewing the CBPM monitor and then again after feedback. In total, 240 positionings were conducted. The results show that for the same person with the same available pressure-reducing equipment, the peak pressure varied considerably between nursing pairs. Reducing pressure in the lateral position appeared to be the most challenging. Peak pressures were significantly reduced, based on visual feedback from the CBPM monitor. The number of preventive interventions also increased, as well as patients' comfort. For the nurses as a group, the knowledge score was 59·7% and the attitude score was 88·8%. Real-time visual feedback of pressure points appears to provide another dimension to complement decision making with respect to PU prevention. © 2014 The Authors. International Wound Journal © 2014 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

A systematic review: the influence of real time feedback on wheelchair propulsion biomechanics.

PubMed

Symonds, Andrew; Barbareschi, Giulia; Taylor, Stephen; Holloway, Catherine

2018-01-01

Clinical guidelines recommend that, in order to minimize upper limb injury risk, wheelchair users adopt a semi-circular pattern with a slow cadence and a large push arc. To examine whether real time feedback can be used to influence manual wheelchair propulsion biomechanics. Clinical trials and case series comparing the use of real time feedback against no feedback were included. A general review was performed and methodological quality assessed by two independent practitioners using the Downs and Black checklist. The review was completed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines. Six papers met the inclusion criteria. Selected studies involved 123 participants and analysed the effect of visual and, in one case, haptic feedback. Across the studies it was shown that participants were able to achieve significant changes in propulsion biomechanics, when provided with real time feedback. However, the effect of targeting a single propulsion variable might lead to unwanted alterations in other parameters. Methodological assessment identified weaknesses in external validity. Visual feedback could be used to consistently increase push arc and decrease push rate, and may be the best focus for feedback training. Further investigation is required to assess such intervention during outdoor propulsion. Implications for Rehabilitation Upper limb pain and injuries are common secondary disorders that negatively affect wheelchair users' physical activity and quality of life. Clinical guidelines suggest that manual wheelchair users should aim to propel with a semi-circular pattern with low a push rate and large push arc in the range in order to minimise upper limbs' loading. Real time visual and haptic feedback are effective tools for improving propulsion biomechanics in both complete novices and experienced manual wheelchair users.

Randomised crossover trial of rate feedback and force during chest compressions for paediatric cardiopulmonary resuscitation.

PubMed

Gregson, Rachael Kathleen; Cole, Tim James; Skellett, Sophie; Bagkeris, Emmanouil; Welsby, Denise; Peters, Mark John

2017-05-01

To determine the effect of visual feedback on rate of chest compressions, secondarily relating the forces used. Randomised crossover trial. Tertiary teaching hospital. Fifty trained hospital staff. A thin sensor-mat placed over the manikin's chest measured rate and force. Rescuers applied compressions to the same paediatric manikin for two sessions. During one session they received visual feedback comparing their real-time rate with published guidelines. Primary: compression rate. Secondary: compression and residual forces. Rate of chest compressions (compressions per minute (compressions per minute; cpm)) varied widely (mean (SD) 111 (13), range 89-168), with a fourfold difference in variation during session 1 between those receiving and not receiving feedback (108 (5) vs 120 (20)). The interaction of session by feedback order was highly significant, indicating that this difference in mean rate between sessions was 14 cpm less (95% CI -22 to -5, p=0.002) in those given feedback first compared with those given it second. Compression force (N) varied widely (mean (SD) 306 (94); range 142-769). Those receiving feedback second (as opposed to first) used significantly lower force (adjusted mean difference -80 (95% CI -128 to -32), p=0.002). Mean residual force (18 N, SD 12, range 0-49) was unaffected by the intervention. While visual feedback restricted excessive compression rates to within the prescribed range, applied force remained widely variable. The forces required may differ with growth, but such variation treating one manikin is alarming. Feedback technologies additionally measuring force (effort) could help to standardise and define effective treatments throughout childhood. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Prototyping a Hybrid Cooperative and Tele-robotic Surgical System for Retinal Microsurgery.

PubMed

Balicki, Marcin; Xia, Tian; Jung, Min Yang; Deguet, Anton; Vagvolgyi, Balazs; Kazanzides, Peter; Taylor, Russell

2011-06-01

This paper presents the design of a tele-robotic microsurgical platform designed for development of cooperative and tele-operative control schemes, sensor based smart instruments, user interfaces and new surgical techniques with eye surgery as the driving application. The system is built using the distributed component-based cisst libraries and the Surgical Assistant Workstation framework. It includes a cooperatively controlled EyeRobot2, a da Vinci Master manipulator, and a remote stereo visualization system. We use constrained optimization based virtual fixture control to provide Virtual Remote-Center-of-Motion (vRCM) and haptic feedback. Such system can be used in a hybrid setup, combining local cooperative control with remote tele-operation, where an experienced surgeon can provide hand-over-hand tutoring to a novice user. In another scheme, the system can provide haptic feedback based on virtual fixtures constructed from real-time force and proximity sensor information.

Prototyping a Hybrid Cooperative and Tele-robotic Surgical System for Retinal Microsurgery

PubMed Central

Balicki, Marcin; Xia, Tian; Jung, Min Yang; Deguet, Anton; Vagvolgyi, Balazs; Kazanzides, Peter; Taylor, Russell

2013-01-01

This paper presents the design of a tele-robotic microsurgical platform designed for development of cooperative and tele-operative control schemes, sensor based smart instruments, user interfaces and new surgical techniques with eye surgery as the driving application. The system is built using the distributed component-based cisst libraries and the Surgical Assistant Workstation framework. It includes a cooperatively controlled EyeRobot2, a da Vinci Master manipulator, and a remote stereo visualization system. We use constrained optimization based virtual fixture control to provide Virtual Remote-Center-of-Motion (vRCM) and haptic feedback. Such system can be used in a hybrid setup, combining local cooperative control with remote tele-operation, where an experienced surgeon can provide hand-over-hand tutoring to a novice user. In another scheme, the system can provide haptic feedback based on virtual fixtures constructed from real-time force and proximity sensor information. PMID:24398557

Computational motor control: feedback and accuracy.

PubMed

Guigon, Emmanuel; Baraduc, Pierre; Desmurget, Michel

2008-02-01

Speed/accuracy trade-off is a ubiquitous phenomenon in motor behaviour, which has been ascribed to the presence of signal-dependent noise (SDN) in motor commands. Although this explanation can provide a quantitative account of many aspects of motor variability, including Fitts' law, the fact that this law is frequently violated, e.g. during the acquisition of new motor skills, remains unexplained. Here, we describe a principled approach to the influence of noise on motor behaviour, in which motor variability results from the interplay between sensory and motor execution noises in an optimal feedback-controlled system. In this framework, we first show that Fitts' law arises due to signal-dependent motor noise (SDN(m)) when sensory (proprioceptive) noise is low, e.g. under visual feedback. Then we show that the terminal variability of non-visually guided movement can be explained by the presence of signal-dependent proprioceptive noise. Finally, we show that movement accuracy can be controlled by opposite changes in signal-dependent sensory (SDN(s)) and SDN(m), a phenomenon that could be ascribed to muscular co-contraction. As the model also explains kinematics, kinetics, muscular and neural characteristics of reaching movements, it provides a unified framework to address motor variability.

Integration of soft tissue model and open haptic device for medical training simulator

NASA Astrophysics Data System (ADS)

Akasum, G. F.; Ramdhania, L. N.; Suprijanto; Widyotriatmo, A.

2016-03-01

Minimally Invasive Surgery (MIS) has been widely used to perform any surgical procedures nowadays. Currently, MIS has been applied in some cases in Indonesia. Needle insertion is one of simple MIS procedure that can be used for some purposes. Before the needle insertion technique used in the real situation, it essential to train this type of medical student skills. The research has developed an open platform of needle insertion simulator with haptic feedback that providing the medical student a realistic feel encountered during the actual procedures. There are three main steps in build the training simulator, which are configure hardware system, develop a program to create soft tissue model and the integration of hardware and software. For evaluating its performance, haptic simulator was tested by 24 volunteers on a scenario of soft tissue model. Each volunteer must insert the needle on simulator until rearch the target point with visual feedback that visualized on the monitor. From the result it can concluded that the soft tissue model can bring the sensation of touch through the perceived force feedback on haptic actuator by looking at the different force in accordance with different stiffness in each layer.

The influence of visual feedback and register changes on sign language production: A kinematic study with deaf signers

PubMed Central

EMMOREY, KAREN; GERTSBERG, NELLY; KORPICS, FRANCO; WRIGHT, CHARLES E.

2009-01-01

Speakers monitor their speech output by listening to their own voice. However, signers do not look directly at their hands and cannot see their own face. We investigated the importance of a visual perceptual loop for sign language monitoring by examining whether changes in visual input alter sign production. Deaf signers produced American Sign Language (ASL) signs within a carrier phrase under five conditions: blindfolded, wearing tunnel-vision goggles, normal (citation) signing, shouting, and informal signing. Three-dimensional movement trajectories were obtained using an Optotrak Certus system. Informally produced signs were shorter with less vertical movement. Shouted signs were displaced forward and to the right and were produced within a larger volume of signing space, with greater velocity, greater distance traveled, and a longer duration. Tunnel vision caused signers to produce less movement within the vertical dimension of signing space, but blind and citation signing did not differ significantly on any measure, except duration. Thus, signers do not “sign louder” when they cannot see themselves, but they do alter their sign production when vision is restricted. We hypothesize that visual feedback serves primarily to fine-tune the size of signing space rather than as input to a comprehension-based monitor. PMID:20046943

The influence of visual feedback and register changes on sign language production: A kinematic study with deaf signers.

PubMed

Emmorey, Karen; Gertsberg, Nelly; Korpics, Franco; Wright, Charles E

2009-01-01

Speakers monitor their speech output by listening to their own voice. However, signers do not look directly at their hands and cannot see their own face. We investigated the importance of a visual perceptual loop for sign language monitoring by examining whether changes in visual input alter sign production. Deaf signers produced American Sign Language (ASL) signs within a carrier phrase under five conditions: blindfolded, wearing tunnel-vision goggles, normal (citation) signing, shouting, and informal signing. Three-dimensional movement trajectories were obtained using an Optotrak Certus system. Informally produced signs were shorter with less vertical movement. Shouted signs were displaced forward and to the right and were produced within a larger volume of signing space, with greater velocity, greater distance traveled, and a longer duration. Tunnel vision caused signers to produce less movement within the vertical dimension of signing space, but blind and citation signing did not differ significantly on any measure, except duration. Thus, signers do not "sign louder" when they cannot see themselves, but they do alter their sign production when vision is restricted. We hypothesize that visual feedback serves primarily to fine-tune the size of signing space rather than as input to a comprehension-based monitor.

A Randomized Control Trial of Cardiopulmonary Feedback Devices and Their Impact on Infant Chest Compression Quality: A Simulation Study.

PubMed

Austin, Andrea L; Spalding, Carmen N; Landa, Katrina N; Myer, Brian R; Donald, Cure; Smith, Jason E; Platt, Gerald; King, Heather C

2017-10-27

In effort to improve chest compression quality among health care providers, numerous feedback devices have been developed. Few studies, however, have focused on the use of cardiopulmonary resuscitation feedback devices for infants and children. This study evaluated the quality of chest compressions with standard team-leader coaching, a metronome (MetroTimer by ONYX Apps), and visual feedback (SkillGuide Cardiopulmonary Feedback Device) during simulated infant cardiopulmonary resuscitation. Seventy voluntary health care providers who had recently completed Pediatric Advanced Life Support or Basic Life Support courses were randomized to perform simulated infant cardiopulmonary resuscitation into 1 of 3 groups: team-leader coaching alone (control), coaching plus metronome, or coaching plus SkillGuide for 2 minutes continuously. Rate, depth, and frequency of complete recoil during cardiopulmonary resuscitation were recorded by the Laerdal SimPad device for each participant. American Heart Association-approved compression techniques were randomized to either 2-finger or encircling thumbs. The metronome was associated with more ideal compression rate than visual feedback or coaching alone (104/min vs 112/min and 113/min; P = 0.003, 0.019). Visual feedback was associated with more ideal depth than auditory (41 mm vs 38.9; P = 0.03). There were no significant differences in complete recoil between groups. Secondary outcomes of compression technique revealed a difference of 1 mm. Subgroup analysis of male versus female showed no difference in mean number of compressions (221.76 vs 219.79; P = 0.72), mean compression depth (40.47 vs 39.25; P = 0.09), or rate of complete release (70.27% vs 64.96%; P = 0.54). In the adult literature, feedback devices often show an increase in quality of chest compressions. Although more studies are needed, this study did not demonstrate a clinically significant improvement in chest compressions with the addition of a metronome or visual feedback device, no clinically significant difference in Pediatric Advanced Life Support-approved compression technique, and no difference between compression quality between genders.

Objective Assessment of Laparoscopic Force and Psychomotor Skills in a Novel Virtual Reality-Based Haptic Simulator.

PubMed

Prasad, M S Raghu; Manivannan, Muniyandi; Manoharan, Govindan; Chandramohan, S M

2016-01-01

Most of the commercially available virtual reality-based laparoscopic simulators do not effectively evaluate combined psychomotor and force-based laparoscopic skills. Consequently, the lack of training on these critical skills leads to intraoperative errors. To assess the effectiveness of the novel virtual reality-based simulator, this study analyzed the combined psychomotor (i.e., motion or movement) and force skills of residents and expert surgeons. The study also examined the effectiveness of real-time visual force feedback and tool motion during training. Bimanual fundamental (i.e., probing, pulling, sweeping, grasping, and twisting) and complex tasks (i.e., tissue dissection) were evaluated. In both tasks, visual feedback on applied force and tool motion were provided. The skills of the participants while performing the early tasks were assessed with and without visual feedback. Participants performed 5 repetitions of fundamental and complex tasks. Reaction force and instrument acceleration were used as metrics. Surgical Gastroenterology, Government Stanley Medical College and Hospital; Institute of Surgical Gastroenterology, Madras Medical College and Rajiv Gandhi Government General Hospital. Residents (N = 25; postgraduates and surgeons with <2 years of laparoscopic surgery) and expert surgeons (N = 25; surgeons with >4 and ≤10 years of laparoscopic surgery). Residents applied large forces compared with expert surgeons and performed abrupt tool movements (p < 0.001). However, visual + haptic feedback improved the performance of residents (p < 0.001). In complex tasks, visual + haptic feedback did not influence the applied force of expert surgeons, but influenced their tool motion (p < 0.001). Furthermore, in complex tissue sweeping task, expert surgeons applied more force, but were within the tissue damage limits. In both groups, exertion of large forces and abrupt tool motion were observed during grasping, probing or pulling, and tissue sweeping maneuvers (p < 0.001). Modern day curriculum-based training should evaluate the skills of residents with robust force and psychomotor-based exercises for proficient laparoscopy. Visual feedback on force and motion during training has the potential to enhance the learning curve of residents. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Effects of visual feedback-induced variability on motor learning of handrim wheelchair propulsion.

PubMed

Leving, Marika T; Vegter, Riemer J K; Hartog, Johanneke; Lamoth, Claudine J C; de Groot, Sonja; van der Woude, Lucas H V

2015-01-01

It has been suggested that a higher intra-individual variability benefits the motor learning of wheelchair propulsion. The present study evaluated whether feedback-induced variability on wheelchair propulsion technique variables would also enhance the motor learning process. Learning was operationalized as an improvement in mechanical efficiency and propulsion technique, which are thought to be closely related during the learning process. 17 Participants received visual feedback-based practice (feedback group) and 15 participants received regular practice (natural learning group). Both groups received equal practice dose of 80 min, over 3 weeks, at 0.24 W/kg at a treadmill speed of 1.11 m/s. To compare both groups the pre- and post-test were performed without feedback. The feedback group received real-time visual feedback on seven propulsion variables with instruction to manipulate the presented variable to achieve the highest possible variability (1st 4-min block) and optimize it in the prescribed direction (2nd 4-min block). To increase motor exploration the participants were unaware of the exact variable they received feedback on. Energy consumption and the propulsion technique variables with their respective coefficient of variation were calculated to evaluate the amount of intra-individual variability. The feedback group, which practiced with higher intra-individual variability, improved the propulsion technique between pre- and post-test to the same extent as the natural learning group. Mechanical efficiency improved between pre- and post-test in the natural learning group but remained unchanged in the feedback group. These results suggest that feedback-induced variability inhibited the improvement in mechanical efficiency. Moreover, since both groups improved propulsion technique but only the natural learning group improved mechanical efficiency, it can be concluded that the improvement in mechanical efficiency and propulsion technique do not always appear simultaneously during the motor learning process. Their relationship is most likely modified by other factors such as the amount of the intra-individual variability.

Effects of Visual Feedback-Induced Variability on Motor Learning of Handrim Wheelchair Propulsion

PubMed Central

Leving, Marika T.; Vegter, Riemer J. K.; Hartog, Johanneke; Lamoth, Claudine J. C.; de Groot, Sonja; van der Woude, Lucas H. V.

2015-01-01

Background It has been suggested that a higher intra-individual variability benefits the motor learning of wheelchair propulsion. The present study evaluated whether feedback-induced variability on wheelchair propulsion technique variables would also enhance the motor learning process. Learning was operationalized as an improvement in mechanical efficiency and propulsion technique, which are thought to be closely related during the learning process. Methods 17 Participants received visual feedback-based practice (feedback group) and 15 participants received regular practice (natural learning group). Both groups received equal practice dose of 80 min, over 3 weeks, at 0.24 W/kg at a treadmill speed of 1.11 m/s. To compare both groups the pre- and post-test were performed without feedback. The feedback group received real-time visual feedback on seven propulsion variables with instruction to manipulate the presented variable to achieve the highest possible variability (1st 4-min block) and optimize it in the prescribed direction (2nd 4-min block). To increase motor exploration the participants were unaware of the exact variable they received feedback on. Energy consumption and the propulsion technique variables with their respective coefficient of variation were calculated to evaluate the amount of intra-individual variability. Results The feedback group, which practiced with higher intra-individual variability, improved the propulsion technique between pre- and post-test to the same extent as the natural learning group. Mechanical efficiency improved between pre- and post-test in the natural learning group but remained unchanged in the feedback group. Conclusion These results suggest that feedback-induced variability inhibited the improvement in mechanical efficiency. Moreover, since both groups improved propulsion technique but only the natural learning group improved mechanical efficiency, it can be concluded that the improvement in mechanical efficiency and propulsion technique do not always appear simultaneously during the motor learning process. Their relationship is most likely modified by other factors such as the amount of the intra-individual variability. PMID:25992626

Combined contributions of feedforward and feedback inputs to bottom-up attention

PubMed Central

Khorsand, Peyman; Moore, Tirin; Soltani, Alireza

2015-01-01

In order to deal with a large amount of information carried by visual inputs entering the brain at any given point in time, the brain swiftly uses the same inputs to enhance processing in one part of visual field at the expense of the others. These processes, collectively called bottom-up attentional selection, are assumed to solely rely on feedforward processing of the external inputs, as it is implied by the nomenclature. Nevertheless, evidence from recent experimental and modeling studies points to the role of feedback in bottom-up attention. Here, we review behavioral and neural evidence that feedback inputs are important for the formation of signals that could guide attentional selection based on exogenous inputs. Moreover, we review results from a modeling study elucidating mechanisms underlying the emergence of these signals in successive layers of neural populations and how they depend on feedback from higher visual areas. We use these results to interpret and discuss more recent findings that can further unravel feedforward and feedback neural mechanisms underlying bottom-up attention. We argue that while it is descriptively useful to separate feedforward and feedback processes underlying bottom-up attention, these processes cannot be mechanistically separated into two successive stages as they occur at almost the same time and affect neural activity within the same brain areas using similar neural mechanisms. Therefore, understanding the interaction and integration of feedforward and feedback inputs is crucial for better understanding of bottom-up attention. PMID:25784883

Selective visual scaling of time-scale processes facilitates broadband learning of isometric force frequency tracking.

PubMed

King, Adam C; Newell, Karl M

2015-10-01

The experiment investigated the effect of selectively augmenting faster time scales of visual feedback information on the learning and transfer of continuous isometric force tracking tasks to test the generality of the self-organization of 1/f properties of force output. Three experimental groups tracked an irregular target pattern either under a standard fixed gain condition or with selectively enhancement in the visual feedback display of intermediate (4-8 Hz) or high (8-12 Hz) frequency components of the force output. All groups reduced tracking error over practice, with the error lowest in the intermediate scaling condition followed by the high scaling and fixed gain conditions, respectively. Selective visual scaling induced persistent changes across the frequency spectrum, with the strongest effect in the intermediate scaling condition and positive transfer to novel feedback displays. The findings reveal an interdependence of the timescales in the learning and transfer of isometric force output frequency structures consistent with 1/f process models of the time scales of motor output variability.

Neuromorphic audio-visual sensor fusion on a sound-localizing robot.

PubMed

Chan, Vincent Yue-Sek; Jin, Craig T; van Schaik, André

2012-01-01

This paper presents the first robotic system featuring audio-visual (AV) sensor fusion with neuromorphic sensors. We combine a pair of silicon cochleae and a silicon retina on a robotic platform to allow the robot to learn sound localization through self motion and visual feedback, using an adaptive ITD-based sound localization algorithm. After training, the robot can localize sound sources (white or pink noise) in a reverberant environment with an RMS error of 4-5° in azimuth. We also investigate the AV source binding problem and an experiment is conducted to test the effectiveness of matching an audio event with a corresponding visual event based on their onset time. Despite the simplicity of this method and a large number of false visual events in the background, a correct match can be made 75% of the time during the experiment.

Pyff - a pythonic framework for feedback applications and stimulus presentation in neuroscience.

PubMed

Venthur, Bastian; Scholler, Simon; Williamson, John; Dähne, Sven; Treder, Matthias S; Kramarek, Maria T; Müller, Klaus-Robert; Blankertz, Benjamin

2010-01-01

This paper introduces Pyff, the Pythonic feedback framework for feedback applications and stimulus presentation. Pyff provides a platform-independent framework that allows users to develop and run neuroscientific experiments in the programming language Python. Existing solutions have mostly been implemented in C++, which makes for a rather tedious programming task for non-computer-scientists, or in Matlab, which is not well suited for more advanced visual or auditory applications. Pyff was designed to make experimental paradigms (i.e., feedback and stimulus applications) easily programmable. It includes base classes for various types of common feedbacks and stimuli as well as useful libraries for external hardware such as eyetrackers. Pyff is also equipped with a steadily growing set of ready-to-use feedbacks and stimuli. It can be used as a standalone application, for instance providing stimulus presentation in psychophysics experiments, or within a closed loop such as in biofeedback or brain-computer interfacing experiments. Pyff communicates with other systems via a standardized communication protocol and is therefore suitable to be used with any system that may be adapted to send its data in the specified format. Having such a general, open-source framework will help foster a fruitful exchange of experimental paradigms between research groups. In particular, it will decrease the need of reprogramming standard paradigms, ease the reproducibility of published results, and naturally entail some standardization of stimulus presentation.

Pyff – A Pythonic Framework for Feedback Applications and Stimulus Presentation in Neuroscience

PubMed Central

Venthur, Bastian; Scholler, Simon; Williamson, John; Dähne, Sven; Treder, Matthias S.; Kramarek, Maria T.; Müller, Klaus-Robert; Blankertz, Benjamin

2010-01-01

This paper introduces Pyff, the Pythonic feedback framework for feedback applications and stimulus presentation. Pyff provides a platform-independent framework that allows users to develop and run neuroscientific experiments in the programming language Python. Existing solutions have mostly been implemented in C++, which makes for a rather tedious programming task for non-computer-scientists, or in Matlab, which is not well suited for more advanced visual or auditory applications. Pyff was designed to make experimental paradigms (i.e., feedback and stimulus applications) easily programmable. It includes base classes for various types of common feedbacks and stimuli as well as useful libraries for external hardware such as eyetrackers. Pyff is also equipped with a steadily growing set of ready-to-use feedbacks and stimuli. It can be used as a standalone application, for instance providing stimulus presentation in psychophysics experiments, or within a closed loop such as in biofeedback or brain–computer interfacing experiments. Pyff communicates with other systems via a standardized communication protocol and is therefore suitable to be used with any system that may be adapted to send its data in the specified format. Having such a general, open-source framework will help foster a fruitful exchange of experimental paradigms between research groups. In particular, it will decrease the need of reprogramming standard paradigms, ease the reproducibility of published results, and naturally entail some standardization of stimulus presentation. PMID:21160550

Hebbian learning in a model with dynamic rate-coded neurons: an alternative to the generative model approach for learning receptive fields from natural scenes.

PubMed

Hamker, Fred H; Wiltschut, Jan

2007-09-01

Most computational models of coding are based on a generative model according to which the feedback signal aims to reconstruct the visual scene as close as possible. We here explore an alternative model of feedback. It is derived from studies of attention and thus, probably more flexible with respect to attentive processing in higher brain areas. According to this model, feedback implements a gain increase of the feedforward signal. We use a dynamic model with presynaptic inhibition and Hebbian learning to simultaneously learn feedforward and feedback weights. The weights converge to localized, oriented, and bandpass filters similar as the ones found in V1. Due to presynaptic inhibition the model predicts the organization of receptive fields within the feedforward pathway, whereas feedback primarily serves to tune early visual processing according to the needs of the task.

Eye-Hand Synergy and Intermittent Behaviors during Target-Directed Tracking with Visual and Non-visual Information

PubMed Central

Huang, Chien-Ting; Hwang, Ing-Shiou

2012-01-01

Visual feedback and non-visual information play different roles in tracking of an external target. This study explored the respective roles of the visual and non-visual information in eleven healthy volunteers who coupled the manual cursor to a rhythmically moving target of 0.5 Hz under three sensorimotor conditions: eye-alone tracking (EA), eye-hand tracking with visual feedback of manual outputs (EH tracking), and the same tracking without such feedback (EHM tracking). Tracking error, kinematic variables, and movement intermittency (saccade and speed pulse) were contrasted among tracking conditions. The results showed that EHM tracking exhibited larger pursuit gain, less tracking error, and less movement intermittency for the ocular plant than EA tracking. With the vision of manual cursor, EH tracking achieved superior tracking congruency of the ocular and manual effectors with smaller movement intermittency than EHM tracking, except that the rate precision of manual action was similar for both types of tracking. The present study demonstrated that visibility of manual consequences altered mutual relationships between movement intermittency and tracking error. The speed pulse metrics of manual output were linked to ocular tracking error, and saccade events were time-locked to the positional error of manual tracking during EH tracking. In conclusion, peripheral non-visual information is critical to smooth pursuit characteristics and rate control of rhythmic manual tracking. Visual information adds to eye-hand synchrony, underlying improved amplitude control and elaborate error interpretation during oculo-manual tracking. PMID:23236498

Visually driven chaining of elementary swim patterns into a goal-directed motor sequence: a virtual reality study of zebrafish prey capture.

PubMed

Trivedi, Chintan A; Bollmann, Johann H

2013-01-01

Prey capture behavior critically depends on rapid processing of sensory input in order to track, approach, and catch the target. When using vision, the nervous system faces the problem of extracting relevant information from a continuous stream of input in order to detect and categorize visible objects as potential prey and to select appropriate motor patterns for approach. For prey capture, many vertebrates exhibit intermittent locomotion, in which discrete motor patterns are chained into a sequence, interrupted by short periods of rest. Here, using high-speed recordings of full-length prey capture sequences performed by freely swimming zebrafish larvae in the presence of a single paramecium, we provide a detailed kinematic analysis of first and subsequent swim bouts during prey capture. Using Fourier analysis, we show that individual swim bouts represent an elementary motor pattern. Changes in orientation are directed toward the target on a graded scale and are implemented by an asymmetric tail bend component superimposed on this basic motor pattern. To further investigate the role of visual feedback on the efficiency and speed of this complex behavior, we developed a closed-loop virtual reality setup in which minimally restrained larvae recapitulated interconnected swim patterns closely resembling those observed during prey capture in freely moving fish. Systematic variation of stimulus properties showed that prey capture is initiated within a narrow range of stimulus size and velocity. Furthermore, variations in the delay and location of swim triggered visual feedback showed that the reaction time of secondary and later swims is shorter for stimuli that appear within a narrow spatio-temporal window following a swim. This suggests that the larva may generate an expectation of stimulus position, which enables accelerated motor sequencing if the expectation is met by appropriate visual feedback.

Image-guided feedback for ophthalmic microsurgery using multimodal intraoperative swept-source spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography

NASA Astrophysics Data System (ADS)

Li, Jianwei D.; Malone, Joseph D.; El-Haddad, Mohamed T.; Arquitola, Amber M.; Joos, Karen M.; Patel, Shriji N.; Tao, Yuankai K.

2017-02-01

Surgical interventions for ocular diseases involve manipulations of semi-transparent structures in the eye, but limited visualization of these tissue layers remains a critical barrier to developing novel surgical techniques and improving clinical outcomes. We addressed limitations in image-guided ophthalmic microsurgery by using microscope-integrated multimodal intraoperative swept-source spectrally encoded scanning laser ophthalmoscopy and optical coherence tomography (iSS-SESLO-OCT). We previously demonstrated in vivo human ophthalmic imaging using SS-SESLO-OCT, which enabled simultaneous acquisition of en face SESLO images with every OCT cross-section. Here, we integrated our new 400 kHz iSS-SESLO-OCT, which used a buffered Axsun 1060 nm swept-source, with a surgical microscope and TrueVision stereoscopic viewing system to provide image-based feedback. In vivo human imaging performance was demonstrated on a healthy volunteer, and simulated surgical maneuvers were performed in ex vivo porcine eyes. Denselysampled static volumes and volumes subsampled at 10 volumes-per-second were used to visualize tissue deformations and surgical dynamics during corneal sweeps, compressions, and dissections, and retinal sweeps, compressions, and elevations. En face SESLO images enabled orientation and co-registration with the widefield surgical microscope view while OCT imaging enabled depth-resolved visualization of surgical instrument positions relative to anatomic structures-of-interest. TrueVision heads-up display allowed for side-by-side viewing of the surgical field with SESLO and OCT previews for real-time feedback, and we demonstrated novel integrated segmentation overlays for augmented-reality surgical guidance. Integration of these complementary imaging modalities may benefit surgical outcomes by enabling real-time intraoperative visualization of surgical plans, instrument positions, tissue deformations, and image-based surrogate biomarkers correlated with completion of surgical goals.

Illusory Reversal of Causality between Touch and Vision has No Effect on Prism Adaptation Rate.

PubMed

Tanaka, Hirokazu; Homma, Kazuhiro; Imamizu, Hiroshi

2012-01-01

Learning, according to Oxford Dictionary, is "to gain knowledge or skill by studying, from experience, from being taught, etc." In order to learn from experience, the central nervous system has to decide what action leads to what consequence, and temporal perception plays a critical role in determining the causality between actions and consequences. In motor adaptation, causality between action and consequence is implicitly assumed so that a subject adapts to a new environment based on the consequence caused by her action. Adaptation to visual displacement induced by prisms is a prime example; the visual error signal associated with the motor output contributes to the recovery of accurate reaching, and a delayed feedback of visual error can decrease the adaptation rate. Subjective feeling of temporal order of action and consequence, however, can be modified or even reversed when her sense of simultaneity is manipulated with an artificially delayed feedback. Our previous study (Tanaka et al., 2011; Exp. Brain Res.) demonstrated that the rate of prism adaptation was unaffected when the subjective delay of visual feedback was shortened. This study asked whether subjects could adapt to prism adaptation and whether the rate of prism adaptation was affected when the subjective temporal order was illusory reversed. Adapting to additional 100 ms delay and its sudden removal caused a positive shift of point of simultaneity in a temporal order judgment experiment, indicating an illusory reversal of action and consequence. We found that, even in this case, the subjects were able to adapt to prism displacement with the learning rate that was statistically indistinguishable to that without temporal adaptation. This result provides further evidence to the dissociation between conscious temporal perception and motor adaptation.

Performance drifts in two-finger cyclical force production tasks performed by one and two actors.

PubMed

Hasanbarani, Fariba; Reschechtko, Sasha; Latash, Mark L

2018-03-01

We explored changes in the cyclical two-finger force performance task caused by turning visual feedback off performed either by the index and middle fingers of the dominant hand or by two index fingers of two persons. Based on an earlier study, we expected drifts in finger force amplitude and midpoint without a drift in relative phase. The subjects performed two rhythmical tasks at 1 Hz while paced by an auditory metronome. One of the tasks required cyclical changes in total force magnitude without changes in the sharing of the force between the two fingers. The other task required cyclical changes in the force sharing without changing total force magnitude. Subjects were provided with visual feedback, which showed total force magnitude and force sharing via cursor motion along the vertical and horizontal axes, respectively. Further, visual feedback was turned off, first on the variable that was not required to change and then on both variables. Turning visual feedback off led to a mean force drift toward lower magnitudes while force amplitude increased. There was a consistent drift in the relative phase in the one-hand task with the index finger leading the middle finger. No consistent relative phase drift was seen in the two-person tasks. The shape of the force cycle changed without visual feedback reflected in the lower similarity to a perfect cosine shape and in the higher time spent at lower force magnitudes. The data confirm findings of earlier studies regarding force amplitude and midpoint changes, but falsify predictions of an earlier proposed model with respect to the relative phase changes. We discuss factors that could contribute to the observed relative phase drift in the one-hand tasks including the leader-follower pattern generalized for two-effector tasks performed by one person.

The effect of step stool use and provider height on CPR quality during pediatric cardiac arrest: A simulation-based multicentre study.

PubMed

Cheng, Adam; Lin, Yiqun; Nadkarni, Vinay; Wan, Brandi; Duff, Jonathan; Brown, Linda; Bhanji, Farhan; Kessler, David; Tofil, Nancy; Hecker, Kent; Hunt, Elizabeth A

2018-01-01

We aimed to explore whether a) step stool use is associated with improved cardiopulmonary resuscitation (CPR) quality; b) provider adjusted height is associated with improved CPR quality; and if associations exist, c) determine whether just-in-time (JIT) CPR training and/or CPR visual feedback attenuates the effect of height and/or step stool use on CPR quality. We analysed data from a trial of simulated cardiac arrests with three study arms: No intervention; CPR visual feedback; and JIT CPR training. Step stool use was voluntary. We explored the association between 1) step stool use and CPR quality, and 2) provider adjusted height and CPR quality. Adjusted height was defined as provider height + 23 cm (if step stool was used). Below-average height participants were ≤ gender-specific average height; the remainder were above average height. We assessed for interaction between study arm and both adjusted height and step stool use. One hundred twenty-four subjects participated; 1,230 30-second epochs of CPR were analysed. Step stool use was associated with improved compression depth in below-average (female, p=0.007; male, p<0.001) and above-average (female, p=0.001; male, p<0.001) height providers. There is an association between adjusted height and compression depth (p<0.001). Visual feedback attenuated the effect of height (p=0.025) on compression depth; JIT training did not (p=0.918). Visual feedback and JIT training attenuated the effect of step stool use (p<0.001) on compression depth. Step stool use is associated with improved compression depth regardless of height. Increased provider height is associated with improved compression depth, with visual feedback attenuating the effects of height and step stool use.

Simulation and animation of sensor-driven robots.

PubMed

Chen, C; Trivedi, M M; Bidlack, C R

1994-10-01

Most simulation and animation systems utilized in robotics are concerned with simulation of the robot and its environment without simulation of sensors. These systems have difficulty in handling robots that utilize sensory feedback in their operation. In this paper, a new design of an environment for simulation, animation, and visualization of sensor-driven robots is presented. As sensor technology advances, increasing numbers of robots are equipped with various types of sophisticated sensors. The main goal of creating the visualization environment is to aid the automatic robot programming and off-line programming capabilities of sensor-driven robots. The software system will help the users visualize the motion and reaction of the sensor-driven robot under their control program. Therefore, the efficiency of the software development is increased, the reliability of the software and the operation safety of the robot are ensured, and the cost of new software development is reduced. Conventional computer-graphics-based robot simulation and animation software packages lack of capabilities for robot sensing simulation. This paper describes a system designed to overcome this deficiency.

[Nursing Experience of Using Mirror Visual Feedback for a Schizophrenia Patient With Visual Hallucinations].

PubMed

Lan, Shu-Ling; Chen, Yu-Chi; Chang, Hsiu-Ju

2018-06-01

The aim of this paper was to describe the nursing application of mirror visual feedback in a patient suffering from long-term visual hallucinations. The intervention period was from May 15th to October 19th, 2015. Using the five facets of psychiatric nursing assessment, several health problems were observed, including disturbed sensory perceptions (prominent visual hallucinations) and poor self-care (e.g. limited abilities to self-bathe and put on clothing). Furthermore, "caregiver role strain" due to the related intense care burden was noted. After building up a therapeutic interpersonal relationship, the technique of brain plasticity and mirror visual feedback were performed using multiple nursing care methods in order to help the patient suppress her visual hallucinations by enhancing a different visual stimulus. We also taught her how to cope with visual hallucinations in a proper manner. The frequency and content of visual hallucinations were recorded to evaluate the effects of management. The therapeutic plan was formulated together with the patient in order to boost her self-confidence, and a behavior contract was implemented in order to improve her personal hygiene. In addition, psychoeducation on disease-related topics was provided to the patient's family, and they were encouraged to attend relevant therapeutic activities. As a result, her family became less passive and negative and more engaged in and positive about her future. The crisis of "caregiver role strain" was successfully resolved. The current experience is hoped to serve as a model for enhancing communication and cooperation between family and staff in similar medical settings.

EMG-Torque Dynamics Change With Contraction Bandwidth.

PubMed

Golkar, Mahsa A; Jalaleddini, Kian; Kearney, Robert E

2018-04-01

An accurate model for ElectroMyoGram (EMG)-torque dynamics has many uses. One of its applications which has gained high attention among researchers is its use, in estimating the muscle contraction level for the efficient control of prosthesis. In this paper, the dynamic relationship between the surface EMG and torque during isometric contractions at the human ankle was studied using system identification techniques. Subjects voluntarily modulated their ankle torque in dorsiflexion direction, by activating their tibialis anterior muscle, while tracking a pseudo-random binary sequence in a torque matching task. The effects of contraction bandwidth, described by torque spectrum, on EMG-torque dynamics were evaluated by varying the visual command switching time. Nonparametric impulse response functions (IRF) were estimated between the processed surface EMG and torque. It was demonstrated that: 1) at low contraction bandwidths, the identified IRFs had unphysiological anticipatory (i.e., non-causal) components, whose amplitude decreased as the contraction bandwidth increased. We hypothesized that this non-causal behavior arose, because the EMG input contained a component due to feedback from the output torque, i.e., it was recorded from within a closed-loop. Vision was not the feedback source since the non-causal behavior persisted when visual feedback was removed. Repeating the identification using a nonparametric closed-loop identification algorithm yielded causal IRFs at all bandwidths, supporting this hypothesis. 2) EMG-torque dynamics became faster and the bandwidth of system increased as contraction modulation rate increased. Thus, accurate prediction of torque from EMG signals must take into account the contraction bandwidth sensitivity of this system.

Ultrasound visual feedback in articulation therapy following partial glossectomy.

PubMed

Blyth, Katrina M; Mccabe, Patricia; Madill, Catherine; Ballard, Kirrie J

2016-01-01

Disordered speech is common following treatment for tongue cancer, however there is insufficient high quality evidence to guide clinical decision making about treatment. This study investigated use of ultrasound tongue imaging as a visual feedback tool to guide tongue placement during articulation therapy with two participants following partial glossectomy. A Phase I multiple baseline design across behaviors was used to investigate therapeutic effect of ultrasound visual feedback during speech rehabilitation. Percent consonants correct and speech intelligibility at sentence level were used to measure acquisition, generalization and maintenance of speech skills for treated and untreated related phonemes, while unrelated phonemes were tested to demonstrate experimental control. Swallowing and oromotor measures were also taken to monitor change. Sentence intelligibility was not a sensitive measure of speech change, but both participants demonstrated significant change in percent consonants correct for treated phonemes. One participant also demonstrated generalization to non-treated phonemes. Control phonemes along with swallow and oromotor measures remained stable throughout the study. This study establishes therapeutic benefit of ultrasound visual feedback in speech rehabilitation following partial glossectomy. Readers will be able to explain why and how tongue cancer surgery impacts on articulation precision. Readers will also be able to explain the acquisition, generalization and maintenance effects in the study. Copyright © 2016. Published by Elsevier Inc.

A recurrent neural model for proto-object based contour integration and figure-ground segregation.

PubMed

Hu, Brian; Niebur, Ernst

2017-12-01

Visual processing of objects makes use of both feedforward and feedback streams of information. However, the nature of feedback signals is largely unknown, as is the identity of the neuronal populations in lower visual areas that receive them. Here, we develop a recurrent neural model to address these questions in the context of contour integration and figure-ground segregation. A key feature of our model is the use of grouping neurons whose activity represents tentative objects ("proto-objects") based on the integration of local feature information. Grouping neurons receive input from an organized set of local feature neurons, and project modulatory feedback to those same neurons. Additionally, inhibition at both the local feature level and the object representation level biases the interpretation of the visual scene in agreement with principles from Gestalt psychology. Our model explains several sets of neurophysiological results (Zhou et al. Journal of Neuroscience, 20(17), 6594-6611 2000; Qiu et al. Nature Neuroscience, 10(11), 1492-1499 2007; Chen et al. Neuron, 82(3), 682-694 2014), and makes testable predictions about the influence of neuronal feedback and attentional selection on neural responses across different visual areas. Our model also provides a framework for understanding how object-based attention is able to select both objects and the features associated with them.

Short Term Motor-Skill Acquisition Improves with Size of Self-Controlled Virtual Hands

PubMed Central

Ossmy, Ori; Mukamel, Roy

2017-01-01

Visual feedback in general, and from the body in particular, is known to influence the performance of motor skills in humans. However, it is unclear how the acquisition of motor skills depends on specific visual feedback parameters such as the size of performing effector. Here, 21 healthy subjects physically trained to perform sequences of finger movements with their right hand. Through the use of 3D Virtual Reality devices, visual feedback during training consisted of virtual hands presented on the screen, tracking subject’s hand movements in real time. Importantly, the setup allowed us to manipulate the size of the displayed virtual hands across experimental conditions. We found that performance gains increase with the size of virtual hands. In contrast, when subjects trained by mere observation (i.e., in the absence of physical movement), manipulating the size of the virtual hand did not significantly affect subsequent performance gains. These results demonstrate that when it comes to short-term motor skill learning, the size of visual feedback matters. Furthermore, these results suggest that highest performance gains in individual subjects are achieved when the size of the virtual hand matches their real hand size. These results may have implications for optimizing motor training schemes. PMID:28056023

Invariant visual object recognition: a model, with lighting invariance.

PubMed

Rolls, Edmund T; Stringer, Simon M

2006-01-01

How are invariant representations of objects formed in the visual cortex? We describe a neurophysiological and computational approach which focusses on a feature hierarchy model in which invariant representations can be built by self-organizing learning based on the statistics of the visual input. The model can use temporal continuity in an associative synaptic learning rule with a short term memory trace, and/or it can use spatial continuity in Continuous Transformation learning. The model of visual processing in the ventral cortical stream can build representations of objects that are invariant with respect to translation, view, size, and in this paper we show also lighting. The model has been extended to provide an account of invariant representations in the dorsal visual system of the global motion produced by objects such as looming, rotation, and object-based movement. The model has been extended to incorporate top-down feedback connections to model the control of attention by biased competition in for example spatial and object search tasks. The model has also been extended to account for how the visual system can select single objects in complex visual scenes, and how multiple objects can be represented in a scene.

Using Computational Simulations to Confront Students' Mental Models

ERIC Educational Resources Information Center

Rodrigues, R.; Carvalho, P. Simeão

2014-01-01

In this paper we show an example of how to use a computational simulation to obtain visual feedback for students' mental models, and compare their predictions with the simulated system's behaviour. Additionally, we use the computational simulation to incrementally modify the students' mental models in order to accommodate new data,…

Control system of hexacopter using color histogram footprint and convolutional neural network

NASA Astrophysics Data System (ADS)

Ruliputra, R. N.; Darma, S.

2017-07-01

The development of unmanned aerial vehicles (UAV) has been growing rapidly in recent years. The use of logic thinking which is implemented into the program algorithms is needed to make a smart system. By using visual input from a camera, UAV is able to fly autonomously by detecting a target. However, some weaknesses arose as usage in the outdoor environment might change the target's color intensity. Color histogram footprint overcomes the problem because it divides color intensity into separate bins that make the detection tolerant to the slight change of color intensity. Template matching compare its detection result with a template of the reference image to determine the target position and use it to position the vehicle in the middle of the target with visual feedback control based on Proportional-Integral-Derivative (PID) controller. Color histogram footprint method localizes the target by calculating the back projection of its histogram. It has an average success rate of 77 % from a distance of 1 meter. It can position itself in the middle of the target by using visual feedback control with an average positioning time of 73 seconds. After the hexacopter is in the middle of the target, Convolutional Neural Networks (CNN) classifies a number contained in the target image to determine a task depending on the classified number, either landing, yawing, or return to launch. The recognition result shows an optimum success rate of 99.2 %.

Technology-Based Feedback and Its Efficacy in Improving Gait Parameters in Patients with Abnormal Gait: A Systematic Review

PubMed Central

Chamorro-Moriana, Gema; Moreno, Antonio José

2018-01-01

This systematic review synthesized and analyzed clinical findings related to the effectiveness of innovative technological feedback for tackling functional gait recovery. An electronic search of PUBMED, PEDro, WOS, CINAHL, and DIALNET was conducted from January 2011 to December 2016. The main inclusion criteria were: patients with modified or abnormal gait; application of technology-based feedback to deal with functional recovery of gait; any comparison between different kinds of feedback applied by means of technology, or any comparison between technological and non-technological feedback; and randomized controlled trials. Twenty papers were included. The populations were neurological patients (75%), orthopedic and healthy subjects. All participants were adults, bar one. Four studies used exoskeletons, 6 load platforms and 5 pressure sensors. The breakdown of the type of feedback used was as follows: 60% visual, 40% acoustic and 15% haptic. 55% used terminal feedback versus 65% simultaneous feedback. Prescriptive feedback was used in 60% of cases, while 50% used descriptive feedback. 62.5% and 58.33% of the trials showed a significant effect in improving step length and speed, respectively. Efficacy in improving other gait parameters such as balance or range of movement is observed in more than 75% of the studies with significant outcomes. Conclusion: Treatments based on feedback using innovative technology in patients with abnormal gait are mostly effective in improving gait parameters and therefore useful for the functional recovery of patients. The most frequently highlighted types of feedback were immediate visual feedback followed by terminal and immediate acoustic feedback. PMID:29316645

Technology-Based Feedback and Its Efficacy in Improving Gait Parameters in Patients with Abnormal Gait: A Systematic Review.

PubMed

Chamorro-Moriana, Gema; Moreno, Antonio José; Sevillano, José Luis

2018-01-06

This systematic review synthesized and analyzed clinical findings related to the effectiveness of innovative technological feedback for tackling functional gait recovery. An electronic search of PUBMED, PEDro, WOS, CINAHL, and DIALNET was conducted from January 2011 to December 2016. The main inclusion criteria were: patients with modified or abnormal gait; application of technology-based feedback to deal with functional recovery of gait; any comparison between different kinds of feedback applied by means of technology, or any comparison between technological and non-technological feedback; and randomized controlled trials. Twenty papers were included. The populations were neurological patients (75%), orthopedic and healthy subjects. All participants were adults, bar one. Four studies used exoskeletons, 6 load platforms and 5 pressure sensors. The breakdown of the type of feedback used was as follows: 60% visual, 40% acoustic and 15% haptic. 55% used terminal feedback versus 65% simultaneous feedback. Prescriptive feedback was used in 60% of cases, while 50% used descriptive feedback. 62.5% and 58.33% of the trials showed a significant effect in improving step length and speed, respectively. Efficacy in improving other gait parameters such as balance or range of movement is observed in more than 75% of the studies with significant outcomes. Treatments based on feedback using innovative technology in patients with abnormal gait are mostly effective in improving gait parameters and therefore useful for the functional recovery of patients. The most frequently highlighted types of feedback were immediate visual feedback followed by terminal and immediate acoustic feedback.

Investigations of the pathogenesis of acquired pendular nystagmus

NASA Technical Reports Server (NTRS)

Averbuch-Heller, L.; Zivotofsky, A. Z.; Das, V. E.; DiScenna, A. O.; Leigh, R. J.

1995-01-01

We investigated the pathogenesis of acquired pendular nystagmus (APN) in six patients, three of whom had multiple sclerosis. First, we tested the hypothesis that the oscillations of APN are due to a delay in visual feedback secondary, for example, to demyelination of the optic nerves. We manipulated the latency to onset of visually guided eye movements using an electronic technique that induces sinusoidal oscillations in normal subjects. This manipulation did not change the characteristics of the APN, but did superimpose lower-frequency oscillations similar to those induced in normal subjects. These results are consistent with current models for smooth (non-saccadic) eye movements, which predict that prolongation of visual feedback could not account for the high-frequency oscillations that often characterize APN. Secondly, we attempted to determine whether an increase in the gain of the visually-enhanced vestibulo-ocular reflex (VOR), produced by viewing a near target, was accompanied by a commensurate increase in the amplitude of APN. Increases in horizontal or vertical VOR gain during near viewing occurred in four patients, but only two of them showed a parallel increase in APN amplitude. On the other hand, APN amplitude decreased during viewing of the near target in the two patients who showed no change in VOR gain. Taken together, these data suggest that neither delayed visual feedback nor a disorder of central vestibular mechanisms is primarily responsible for APN. More likely, these ocular oscillations are produced by abnormalities of internal feedback circuits, such as the reciprocal connections between brainstem nuclei and cerebellum.

Binocular and Monocular Depth Cues in Online Feedback Control of 3-D Pointing Movement

PubMed Central

Hu, Bo; Knill, David C.

2012-01-01

Previous work has shown that humans continuously use visual feedback of the hand to control goal-directed movements online. In most studies, visual error signals were predominantly in the image plane and thus were available in an observer’s retinal image. We investigate how humans use visual feedback about finger depth provided by binocular and monocular depth cues to control pointing movements. When binocularly viewing a scene in which the hand movement was made in free space, subjects were about 60 ms slower in responding to perturbations in depth than in the image plane. When monocularly viewing a scene designed to maximize the available monocular cues to finger depth (motion, changing size and cast shadows), subjects showed no response to perturbations in depth. Thus, binocular cues from the finger are critical to effective online control of hand movements in depth. An optimal feedback controller that takes into account of the low peripheral stereoacuity and inherent ambiguity in cast shadows can explain the difference in response time in the binocular conditions and lack of response in monocular conditions. PMID:21724567

Integrating sentiment analysis and term associations with geo-temporal visualizations on customer feedback streams

NASA Astrophysics Data System (ADS)

Hao, Ming; Rohrdantz, Christian; Janetzko, Halldór; Keim, Daniel; Dayal, Umeshwar; Haug, Lars-Erik; Hsu, Mei-Chun

2012-01-01

Twitter currently receives over 190 million tweets (small text-based Web posts) and manufacturing companies receive over 10 thousand web product surveys a day, in which people share their thoughts regarding a wide range of products and their features. A large number of tweets and customer surveys include opinions about products and services. However, with Twitter being a relatively new phenomenon, these tweets are underutilized as a source for determining customer sentiments. To explore high-volume customer feedback streams, we integrate three time series-based visual analysis techniques: (1) feature-based sentiment analysis that extracts, measures, and maps customer feedback; (2) a novel idea of term associations that identify attributes, verbs, and adjectives frequently occurring together; and (3) new pixel cell-based sentiment calendars, geo-temporal map visualizations and self-organizing maps to identify co-occurring and influential opinions. We have combined these techniques into a well-fitted solution for an effective analysis of large customer feedback streams such as for movie reviews (e.g., Kung-Fu Panda) or web surveys (buyers).

Evolution of attention mechanisms for early visual processing

NASA Astrophysics Data System (ADS)

Müller, Thomas; Knoll, Alois

2011-03-01

Early visual processing as a method to speed up computations on visual input data has long been discussed in the computer vision community. The general target of a such approaches is to filter nonrelevant information from the costly higher-level visual processing algorithms. By insertion of this additional filter layer the overall approach can be speeded up without actually changing the visual processing methodology. Being inspired by the layered architecture of the human visual processing apparatus, several approaches for early visual processing have been recently proposed. Most promising in this field is the extraction of a saliency map to determine regions of current attention in the visual field. Such saliency can be computed in a bottom-up manner, i.e. the theory claims that static regions of attention emerge from a certain color footprint, and dynamic regions of attention emerge from connected blobs of textures moving in a uniform way in the visual field. Top-down saliency effects are either unconscious through inherent mechanisms like inhibition-of-return, i.e. within a period of time the attention level paid to a certain region automatically decreases if the properties of that region do not change, or volitional through cognitive feedback, e.g. if an object moves consistently in the visual field. These bottom-up and top-down saliency effects have been implemented and evaluated in a previous computer vision system for the project JAST. In this paper an extension applying evolutionary processes is proposed. The prior vision system utilized multiple threads to analyze the regions of attention delivered from the early processing mechanism. Here, in addition, multiple saliency units are used to produce these regions of attention. All of these saliency units have different parameter-sets. The idea is to let the population of saliency units create regions of attention, then evaluate the results with cognitive feedback and finally apply the genetic mechanism: mutation and cloning of the best performers and extinction of the worst performers considering computation of regions of attention. A fitness function can be derived by evaluating, whether relevant objects are found in the regions created. It can be seen from various experiments, that the approach significantly speeds up visual processing, especially regarding robust ealtime object recognition, compared to an approach not using saliency based preprocessing. Furthermore, the evolutionary algorithm improves the overall performance of the preprocessing system in terms of quality, as the system automatically and autonomously tunes the saliency parameters. The computational overhead produced by periodical clone/delete/mutation operations can be handled well within the realtime constraints of the experimental computer vision system. Nevertheless, limitations apply whenever the visual field does not contain any significant saliency information for some time, but the population still tries to tune the parameters - overfitting avoids generalization in this case and the evolutionary process may be reset by manual intervention.

Evaluation of Augmented Reality Feedback in Surgical Training Environment.

PubMed

Zahiri, Mohsen; Nelson, Carl A; Oleynikov, Dmitry; Siu, Ka-Chun

2018-02-01

Providing computer-based laparoscopic surgical training has several advantages that enhance the training process. Self-evaluation and real-time performance feedback are 2 of these advantages, which avoid dependency of trainees on expert feedback. The goal of this study was to investigate the use of a visual time indicator as real-time feedback correlated with the laparoscopic surgical training. Twenty novices participated in this study working with (and without) different presentations of time indicators. They performed a standard peg transfer task, and their completion times and muscle activity were recorded and compared. Also of interest was whether the use of this type of feedback induced any side effect in terms of motivation or muscle fatigue. Of the 20 participants, 15 (75%) preferred using a time indicator in the training process rather than having no feedback. However, time to task completion showed no significant difference in performance with the time indicator; furthermore, no significant differences in muscle activity or muscle fatigue were detected with/without time feedback. The absence of significant difference between task performance with/without time feedback shows that using visual real-time feedback can be included in surgical training based on user preference. Trainees may benefit from this type of feedback in the form of increased motivation. The extent to which this can influence training frequency leading to performance improvement is a question for further study.

Visual servoing in medical robotics: a survey. Part I: endoscopic and direct vision imaging - techniques and applications.

PubMed

Azizian, Mahdi; Khoshnam, Mahta; Najmaei, Nima; Patel, Rajni V

2014-09-01

Intra-operative imaging is widely used to provide visual feedback to a clinician when he/she performs a procedure. In visual servoing, surgical instruments and parts of tissue/body are tracked by processing the acquired images. This information is then used within a control loop to manoeuvre a robotic manipulator during a procedure. A comprehensive search of electronic databases was completed for the period 2000-2013 to provide a survey of the visual servoing applications in medical robotics. The focus is on medical applications where image-based tracking is used for closed-loop control of a robotic system. Detailed classification and comparative study of various contributions in visual servoing using endoscopic or direct visual images are presented and summarized in tables and diagrams. The main challenges in using visual servoing for medical robotic applications are identified and potential future directions are suggested. 'Supervised automation of medical robotics' is found to be a major trend in this field. Copyright © 2013 John Wiley & Sons, Ltd.

Task clarification, performance feedback, and social praise: Procedures for improving the customer service of bank tellers

PubMed Central

Crowell, Charles R.; Anderson, D. Chris; Abel, Dawn M.; Sergio, Joseph P.

1988-01-01

Customer service for bank tellers was defined in terms of 11 verbal behavior categories. An audio-recording system was used to track the occurrence of behaviors in these categories for six retail banking tellers. Three behavior management interventions (task clarification, performance feedback, and social praise), applied in sequence, were designed to improve overall teller performance with regard to the behavioral categories targeted. Clarification was accomplished by providing clear delineation of the various target categories, with specific examples of the behaviors in each. Feedback entailed presentation of ongoing verbal and visual information regarding teller performance. Praise consisted of verbal recognition of teller performance by branch managers. Results showed that clarification effects emerged quickly, producing an overall increase in desired behaviors of 12% over baseline. Feedback and praise effects occurred more gradually, resulting in overall increases of 6% and 7%, respectively. A suspension of all procedures led to a decline in overall performance, whereas reinstatement of feedback and praise was again accompanied by performance improvement. These findings extend the generality of behavior management applications and help to distinguish between possible antecedent and consequent effects of performance feedback. PMID:16795713

Multisensory Self-Motion Compensation During Object Trajectory Judgments

PubMed Central

Dokka, Kalpana; MacNeilage, Paul R.; DeAngelis, Gregory C.; Angelaki, Dora E.

2015-01-01

Judging object trajectory during self-motion is a fundamental ability for mobile organisms interacting with their environment. This fundamental ability requires the nervous system to compensate for the visual consequences of self-motion in order to make accurate judgments, but the mechanisms of this compensation are poorly understood. We comprehensively examined both the accuracy and precision of observers' ability to judge object trajectory in the world when self-motion was defined by vestibular, visual, or combined visual–vestibular cues. Without decision feedback, subjects demonstrated no compensation for self-motion that was defined solely by vestibular cues, partial compensation (47%) for visually defined self-motion, and significantly greater compensation (58%) during combined visual–vestibular self-motion. With decision feedback, subjects learned to accurately judge object trajectory in the world, and this generalized to novel self-motion speeds. Across conditions, greater compensation for self-motion was associated with decreased precision of object trajectory judgments, indicating that self-motion compensation comes at the cost of reduced discriminability. Our findings suggest that the brain can flexibly represent object trajectory relative to either the observer or the world, but a world-centered representation comes at the cost of decreased precision due to the inclusion of noisy self-motion signals. PMID:24062317

A systematic review of phacoemulsification cataract surgery in virtual reality simulators.

PubMed

Lam, Chee Kiang; Sundaraj, Kenneth; Sulaiman, Mohd Nazri

2013-01-01

The aim of this study was to review the capability of virtual reality simulators in the application of phacoemulsification cataract surgery training. Our review included the scientific publications on cataract surgery simulators that had been developed by different groups of researchers along with commercialized surgical training products, such as EYESI® and PhacoVision®. The review covers the simulation of the main cataract surgery procedures, i.e., corneal incision, capsulorrhexis, phacosculpting, and intraocular lens implantation in various virtual reality surgery simulators. Haptics realism and visual realism of the procedures are the main elements in imitating the actual surgical environment. The involvement of ophthalmology in research on virtual reality since the early 1990s has made a great impact on the development of surgical simulators. Most of the latest cataract surgery training systems are able to offer high fidelity in visual feedback and haptics feedback, but visual realism, such as the rotational movements of an eyeball with response to the force applied by surgical instruments, is still lacking in some of them. The assessment of the surgical tasks carried out on the simulators showed a significant difference in the performance before and after the training.

Feedback of personal retinal images appears to have a motivational impact in people with non-proliferative diabetic retinopathy and suboptimal HbA1c: findings of a pilot study.

PubMed

Rees, G; Lamoureux, E L; Nicolaou, T E; Hodgson, L A B; Weinman, J; Speight, J

2013-09-01

To conduct a pilot study to explore the potential impact of visual feedback of personal retinal images on diabetes outcomes. Twenty-five participants with non-proliferative diabetic retinopathy and suboptimal HbA(1c) (> 53 mmol/mol; > 7%) were randomized to receive visual feedback of their own retinal images or to a control group. At baseline and 3-month follow-up, HbA(1c), standard measures of beliefs, diabetes-related distress and self-care activities were assessed. In unadjusted models, relative to controls, the intervention group showed significantly greater improvement in HbA(1c) at 3-month follow-up (-0.6% vs. +0.3%, P < 0.01), as well as enhanced motivation to improve blood glucose management (P < 0.05). This small pilot study provides preliminary evidence that visual feedback of personal retinal images may offer a practical educational strategy for clinicians in eye care services to improve diabetes outcomes in non-target compliant patients. A fully powered randomized controlled trial is required to confirm these findings and determine the optimal use of feedback to produce sustained effects. © 2013 The Authors. Diabetic Medicine © 2013 Diabetes UK.

Experimental Evaluation of Performance Feedback Using the Dismounted Infantry Virtual After Action Review System. Long Range Navy and Marine Corps Science and Technology Program

DTIC Science & Technology

2007-11-14

Artificial intelligence and 4 23 education , Volume 1: Learning environments and tutoring systems. Hillsdale, NJ: Erlbaum. Wickens, C.D. (1984). Processing...and how to use it to best optimize the learning process. Some researchers (see Loftin & Savely, 1991) have proposed adding intelligent systems to the...is experienced as the cognitive centers in an individual’s brain process visual, tactile, kinesthetic , olfactory, proprioceptive, and auditory

A neural theory of visual attention and short-term memory (NTVA).

PubMed

Bundesen, Claus; Habekost, Thomas; Kyllingsbæk, Søren

2011-05-01

The neural theory of visual attention and short-term memory (NTVA) proposed by Bundesen, Habekost, and Kyllingsbæk (2005) is reviewed. In NTVA, filtering (selection of objects) changes the number of cortical neurons in which an object is represented so that this number increases with the behavioural importance of the object. Another mechanism of selection, pigeonholing (selection of features), scales the level of activation in neurons coding for a particular feature. By these mechanisms, behaviourally important objects and features are likely to win the competition to become encoded into visual short-term memory (VSTM). The VSTM system is conceived as a feedback mechanism that sustains activity in the neurons that have won the attentional competition. NTVA accounts both for a wide range of attentional effects in human performance (reaction times and error rates) and a wide range of effects observed in firing rates of single cells in the primate visual system. Copyright © 2010 Elsevier Ltd. All rights reserved.

Confocal laser feedback tomography for skin cancer detection

PubMed Central

Mowla, Alireza; Du, Benjamin Wensheng; Taimre, Thomas; Bertling, Karl; Wilson, Stephen; Soyer, H. Peter; Rakić, Aleksandar D.

2017-01-01

Tomographic imaging of soft tissue such as skin has a potential role in cancer detection. The penetration of infrared wavelengths makes a confocal approach based on laser feedback interferometry feasible. We present a compact system using a semiconductor laser as both transmitter and receiver. Numerical and physical models based on the known optical properties of keratinocyte cancers were developed. We validated the technique on three phantoms containing macro-structural changes in optical properties. Experimental results were in agreement with numerical simulations and structural changes were evident which would permit discrimination of healthy tissue and tumour. Furthermore, cancer type discrimination was also able to be visualized using this imaging technique. PMID:28966845

Confocal laser feedback tomography for skin cancer detection.

PubMed

Mowla, Alireza; Du, Benjamin Wensheng; Taimre, Thomas; Bertling, Karl; Wilson, Stephen; Soyer, H Peter; Rakić, Aleksandar D

2017-09-01

Tomographic imaging of soft tissue such as skin has a potential role in cancer detection. The penetration of infrared wavelengths makes a confocal approach based on laser feedback interferometry feasible. We present a compact system using a semiconductor laser as both transmitter and receiver. Numerical and physical models based on the known optical properties of keratinocyte cancers were developed. We validated the technique on three phantoms containing macro-structural changes in optical properties. Experimental results were in agreement with numerical simulations and structural changes were evident which would permit discrimination of healthy tissue and tumour. Furthermore, cancer type discrimination was also able to be visualized using this imaging technique.

Skill learning from kinesthetic feedback.

PubMed

Pinzon, David; Vega, Roberto; Sanchez, Yerly Paola; Zheng, Bin

2017-10-01

It is important for a surgeon to perform surgical tasks under appropriate guidance from visual and kinesthetic feedback. However, our knowledge on kinesthetic (muscle) memory and its role in learning motor skills remains elementary. To discover the effect of exclusive kinesthetic training on kinesthetic memory in both performance and learning. In Phase 1, a total of twenty participants duplicated five 2 dimensional movements of increasing complexity via passive kinesthetic guidance, without visual or auditory stimuli. Five participants were asked to repeat the task in the Phase 2 over a period of three weeks, for a total of nine sessions. Subjects accurately recalled movement direction using kinesthetic memory, but recalling movement length was less precise. Over the nine training sessions, error occurrence dropped after the sixth session. Muscle memory constructs the foundation for kinesthetic training. Knowledge gained helps surgeons learn skills from kinesthetic information in the condition where visual feedback is limited. Copyright © 2016 Elsevier Inc. All rights reserved.

Visual feedback training using WII Fit improves balance in Parkinson's disease.

PubMed

Zalecki, Tomasz; Gorecka-Mazur, Agnieszka; Pietraszko, Wojciech; Surowka, Artur D; Novak, Pawel; Moskala, Marek; Krygowska-Wajs, Anna

2013-01-01

Postural instability including imbalance is the most disabling long term problem in Parkinson's disease (PD) that does not respond to pharmacotherapy. This study aimed at investigating the effectiveness of a novel visual-feedback training method, using Wii Fit balance board in improving balance in patients with PD. Twenty four patients with moderate PD were included in the study which comprised of a 6-week home-based balance training program using Nintendo Wii Fit and balance board. The PD patients significantly improved their results in Berg Balance Scale, Tinnet's Performance-Oriented Mobility Assessment, Timed Up-and-Go, Sit-to-stand test, 10-Meter Walk test and Activities-specific Balance Confidence scale at the end of the programme. This study suggests that visual feedback training using Wii-Fit with balance board could improve dynamic and functional balance as well as motor disability in PD patients.

Prosody production networks are modulated by sensory cues and social context.

PubMed

Klasen, Martin; von Marschall, Clara; Isman, Güldehen; Zvyagintsev, Mikhail; Gur, Ruben C; Mathiak, Klaus

2018-03-05

The neurobiology of emotional prosody production is not well investigated. In particular, the effects of cues and social context are not known. The present study sought to differentiate cued from free emotion generation and the effect of social feedback from a human listener. Online speech filtering enabled fMRI during prosodic communication in 30 participants. Emotional vocalizations were a) free, b) auditorily cued, c) visually cued, or d) with interactive feedback. In addition to distributed language networks, cued emotions increased activity in auditory and - in case of visual stimuli - visual cortex. Responses were larger in pSTG at the right hemisphere and the ventral striatum when participants were listened to and received feedback from the experimenter. Sensory, language, and reward networks contributed to prosody production and were modulated by cues and social context. The right pSTG is a central hub for communication in social interactions - in particular for interpersonal evaluation of vocal emotions.

Effectiveness of glucose monitoring systems modified for the visually impaired.

PubMed

Bernbaum, M; Albert, S G; Brusca, S; McGinnis, J; Miller, D; Hoffmann, J W; Mooradian, A D

1993-10-01

To compare three glucose meters modified for use by individuals with diabetes and visual impairment regarding accuracy, precision, and clinical reliability. Ten subjects with diabetes and visual impairment performed self-monitoring of blood glucose using each of the three commercially available blood glucose meters modified for visually impaired users (the AccuChek Freedom [Boehringer Mannheim, Indianapolis, IN], the Diascan SVM [Home Diagnostics, Eatontown, NJ], and the One Touch [Lifescan, Milpitas, CA]). The meters were independently evaluated by a laboratory technologist for precision and accuracy determinations. Only two meters were acceptable with regard to laboratory precision (coefficient of variation < 10%)--the Accuchek and the One Touch. The Accuchek and the One Touch did not differ significantly with regard to laboratory estimates of accuracy. A great discrepancy of the clinical reliability results was observed between these two meters. The Accuchek maintained a high degree of reliability (y = 0.99X + 0.44, r = 0.97, P = 0.001). The visually impaired subjects were unable to perform reliable testing using the One Touch system because of a lack of appropriate tactile landmarks and auditory signals. In addition to laboratory assessments of glucose meters, monitoring systems designed for the visually impaired must include adequate tactile and audible feedback features to allow for the acquisition and placement of appropriate blood samples.

A low cost real-time motion tracking approach using webcam technology.

PubMed

Krishnan, Chandramouli; Washabaugh, Edward P; Seetharaman, Yogesh

2015-02-05

Physical therapy is an important component of gait recovery for individuals with locomotor dysfunction. There is a growing body of evidence that suggests that incorporating a motor learning task through visual feedback of movement trajectory is a useful approach to facilitate therapeutic outcomes. Visual feedback is typically provided by recording the subject's limb movement patterns using a three-dimensional motion capture system and displaying it in real-time using customized software. However, this approach can seldom be used in the clinic because of the technical expertise required to operate this device and the cost involved in procuring a three-dimensional motion capture system. In this paper, we describe a low cost two-dimensional real-time motion tracking approach using a simple webcam and an image processing algorithm in LabVIEW Vision Assistant. We also evaluated the accuracy of this approach using a high precision robotic device (Lokomat) across various walking speeds. Further, the reliability and feasibility of real-time motion-tracking were evaluated in healthy human participants. The results indicated that the measurements from the webcam tracking approach were reliable and accurate. Experiments on human subjects also showed that participants could utilize the real-time kinematic feedback generated from this device to successfully perform a motor learning task while walking on a treadmill. These findings suggest that the webcam motion tracking approach is a feasible low cost solution to perform real-time movement analysis and training. Copyright © 2014 Elsevier Ltd. All rights reserved.

A low cost real-time motion tracking approach using webcam technology

PubMed Central

Krishnan, Chandramouli; Washabaugh, Edward P.; Seetharaman, Yogesh

2014-01-01

Physical therapy is an important component of gait recovery for individuals with locomotor dysfunction. There is a growing body of evidence that suggests that incorporating a motor learning task through visual feedback of movement trajectory is a useful approach to facilitate therapeutic outcomes. Visual feedback is typically provided by recording the subject’s limb movement patterns using a three-dimensional motion capture system and displaying it in real-time using customized software. However, this approach can seldom be used in the clinic because of the technical expertise required to operate this device and the cost involved in procuring a three-dimensional motion capture system. In this paper, we describe a low cost two-dimensional real-time motion tracking approach using a simple webcam and an image processing algorithm in LabVIEW Vision Assistant. We also evaluated the accuracy of this approach using a high precision robotic device (Lokomat) across various walking speeds. Further, the reliability and feasibility of real-time motion-tracking were evaluated in healthy human participants. The results indicated that the measurements from the webcam tracking approach were reliable and accurate. Experiments on human subjects also showed that participants could utilize the real-time kinematic feedback generated from this device to successfully perform a motor learning task while walking on a treadmill. These findings suggest that the webcam motion tracking approach is a feasible low cost solution to perform real-time movement analysis and training. PMID:25555306

On the Adaptation of Pelvic Motion by Applying 3-dimensional Guidance Forces Using TPAD.

PubMed

Kang, Jiyeon; Vashista, Vineet; Agrawal, Sunil K

2017-09-01

Pelvic movement is important to human locomotion as the center of mass is located near the center of pelvis. Lateral pelvic motion plays a crucial role to shift the center of mass on the stance leg, while swinging the other leg and keeping the body balanced. In addition, vertical pelvic movement helps to reduce metabolic energy expenditure by exchanging potential and kinetic energy during the gait cycle. However, patient groups with cerebral palsy or stroke have excessive pelvic motion that leads to high energy expenditure. In addition, they have higher chances of falls as the center ofmass could deviate outside the base of support. In this paper, a novel control method is suggested using tethered pelvic assist device (TPAD) to teach subjects to walk with a specified target pelvic trajectory while walking on a treadmill. In this method, a force field is applied to the pelvis to guide it to move on a target trajectory and correctional forces are applied, if the pelvis motion has excessive deviations from the target trajectory. Three different experimentswith healthy subjects were conducted to teach them to walk on a new target pelvic trajectory with the presented control method. For all three experiments, the baseline trajectory of the pelvis was experimentally determined for each participating subject. To design a target pelvic trajectory which is different from the baseline, Experiment I scaled up the lateral component of the baseline pelvic trajectory, while Experiment II scaled down the lateral component of the baseline trajectory. For both Experiments I and II, the controller generated a 2-D force field in the transverse plane to provide the guidance force. In this paper, seven subjects were recruited for each experiment who walked on the treadmill with suggested control methods and visual feedback of their pelvic trajectory. The results show that the subjects were able to learn the target pelvic trajectory in each experiment and also retained the training effects after the completion of the experiment. In Experiment III, both lateral and vertical components of the pelvic trajectory were scaled down from the baseline trajectory. The force field was extended to three dimensions in order to correct the vertical pelvic movement as well. Three subgroups (force feedback alone, visual feedback alone, and both force and visual feedback) were recruited to understand the effects of force feedback and visual feedback alone to distinguish the results from Experiments I and II. The results showthat a trainingmethod that combines visual and force feedback is superior to the training methods with visual or force feedback alone. We believe that the present control strategy holds potential in training and correcting abnormal pelvic movements in different patient populations.

Removing own-limb visual input using mixed reality (MR) produces a "telescoping" illusion in healthy individuals.

PubMed

Thøgersen, Mikkel; Hansen, John; Arendt-Nielsen, Lars; Flor, Herta; Petrini, Laura

2018-07-16

The purpose of the present study was to assess changes in body perception when visual feedback was removed from the hand and arm with the purpose of resembling the visual deprivation arising from amputation. The illusion was created by removing the visual feedback from the participants' own left forearm using a mixed reality (MR) and green screen environment. Thirty healthy persons (15 female) participated in the study. Each subject experienced two MR conditions, one with and one without visual feedback from the left hand, and a baseline condition with normal vision of the limb (no MR). Body perception was assessed using proprioceptive drift, questionnaires on body perception, and thermal sensitivity measures (cold, warm, heat pain and cold pain detection thresholds). The proprioceptive drift showed a significant shift of the tip of the index finger (p<0.001) towards the elbow in the illusion condition (mean drift: -3.71 cm). Self-report showed a significant decrease in ownership (p<0.001), shift in perceptual distortions, (e.g. "It feels as if my lower arm has become shorter") (p=0.025), and changes in sensations of the hand (tingling, tickling) (p=0.025). A significant decrease was also observed in cold detection threshold (p<0.001), i.e. the detection threshold was cooler than for the control conditions. The proprioceptive drift together with the self-reported questionnaire showed that the participants felt a proximal retraction of their limb, resembling the telescoping experienced by phantom limb patients. The study highlights the influence of missing visual feedback and its possible contribution to phantom limb phenomena. Copyright © 2018 Elsevier B.V. All rights reserved.

Dormitory Residents Reduce Electricity Consumption when Exposed to Real-Time Visual Feedback and Incentives

ERIC Educational Resources Information Center

Petersen, John E.; Shunturov, Vladislav; Janda, Kathryn; Platt, Gavin; Weinberger, Kate

2007-01-01

Purpose: In residential buildings, personal choices influence electricity and water consumption. Prior studies indicate that information feedback can stimulate resource conservation. College dormitories provide an excellent venue for controlled study of the effects of feedback. The goal of this study is to assess how different resolutions of…

Smart Rehabilitation Garment for posture monitoring.

PubMed

Wang, Q; Chen, W; Timmermans, A A A; Karachristos, C; Martens, J B; Markopoulos, P

2015-08-01

Posture monitoring and correction technologies can support prevention and treatment of spinal pain or can help detect and avoid compensatory movements during the neurological rehabilitation of upper extremities, which can be very important to ensure their effectiveness. We describe the design and development of Smart Rehabilitation Garment (SRG) a wearable system designed to support posture correction. The SRG combines a number of inertial measurement units (IMUs), controlled by an Arduino processor. It provides feedback with vibration on the garment, audible alarm signals and visual instruction through a Bluetooth connected smartphone. We discuss the placement of sensing modules, the garment design, the feedback design and the integration of smart textiles and wearable electronics which aimed at achieving wearability and ease of use. We report on the system's accuracy as compared to optical tracker method.

Altered perception of distorted visual feedback occurs soon after whiplash injury: an experimental study of central nervous system processing.

PubMed

Daenen, Liesbeth; Nijs, Jo; Roussel, Nathalie; Wouters, Kristien; Cras, Patrick

2012-01-01

Sensory and motor system dysfunctions have been documented in a proportion of patients with acute whiplash associated disorders (WAD). Sensorimotor incongruence may occur and hence, may explain pain and other sensations in the acute stage after the trauma. The present study aimed at (1) evaluating whether a visually mediated incongruence between sensory feedback and motor output increases symptoms and triggers additional sensations in patients with acute WAD, (2) investigating whether the pattern of sensations in response to sensorimotor incongruence differs among patients suffering from acute and chronic WAD, and healthy controls. Experimental study. Patients with acute WAD were recruited within one month after whiplash injury via the emergency department of a local Red Cross medical care unit, the Antwerp University Hospital, and through primary care practices. Patients with chronic WAD were recruited through an advertisement on the World Wide Web and from the medical database of a local Red Cross medical care unit. Healthy controls were recruited from among the university college staff, family members, and acquaintances of the researchers. Thirty patients with acute WAD, 35 patients with chronic WAD, and 31 healthy persons were subjected to a coordination test. They performed congruent and incongruent arm movements while viewing a whiteboard or mirror. RESULTS. Twenty-eight patients with acute WAD reported sensations such as pain, tightness, feeling of peculiarity, and tiredness at some stage of the test protocol. No significant differences in frequencies and intensities of sensations were found between the various test stages (P > .05). Significantly more sensations were reported during the incongruent mirror stage compared to the incongruent control stage (P < .05). The pattern in intensity of sensations across the congruent and incongruent stages was significantly different between the WAD groups and the control group. The course and prognostic value of susceptibility to sensorimotor incongruence after an acute whiplash trauma are not yet clear from these results. A prospective longitudinal study with an expanded study population is needed to investigate if those with a lowered threshold to visually mediated sensorimotor incongruence in the acute stage are at risk to develop persistent pain and disability. Patients with acute WAD present an exacerbation of symptoms and additional sensations in response to visually mediated changes during action. These results indicate an altered perception of distorted visual feedback and suggest altered central sensorimotor nervous system processing in patients with acute WAD.

Evidence for the activation of sensorimotor information during visual word recognition: the body-object interaction effect.

PubMed

Siakaluk, Paul D; Pexman, Penny M; Aguilera, Laura; Owen, William J; Sears, Christopher R

2008-01-01

We examined the effects of sensorimotor experience in two visual word recognition tasks. Body-object interaction (BOI) ratings were collected for a large set of words. These ratings assess perceptions of the ease with which a human body can physically interact with a word's referent. A set of high BOI words (e.g., mask) and a set of low BOI words (e.g., ship) were created, matched on imageability and concreteness. Facilitatory BOI effects were observed in lexical decision and phonological lexical decision tasks: responses were faster for high BOI words than for low BOI words. We discuss how our findings may be accounted for by (a) semantic feedback within the visual word recognition system, and (b) an embodied view of cognition (e.g., Barsalou's perceptual symbol systems theory), which proposes that semantic knowledge is grounded in sensorimotor interactions with the environment.

VisIRR: A Visual Analytics System for Information Retrieval and Recommendation for Large-Scale Document Data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Choo, Jaegul; Kim, Hannah; Clarkson, Edward

In this paper, we present an interactive visual information retrieval and recommendation system, called VisIRR, for large-scale document discovery. VisIRR effectively combines the paradigms of (1) a passive pull through query processes for retrieval and (2) an active push that recommends items of potential interest to users based on their preferences. Equipped with an efficient dynamic query interface against a large-scale corpus, VisIRR organizes the retrieved documents into high-level topics and visualizes them in a 2D space, representing the relationships among the topics along with their keyword summary. In addition, based on interactive personalized preference feedback with regard to documents,more » VisIRR provides document recommendations from the entire corpus, which are beyond the retrieved sets. Such recommended documents are visualized in the same space as the retrieved documents, so that users can seamlessly analyze both existing and newly recommended ones. This article presents novel computational methods, which make these integrated representations and fast interactions possible for a large-scale document corpus. We illustrate how the system works by providing detailed usage scenarios. Finally, we present preliminary user study results for evaluating the effectiveness of the system.« less

VisIRR: A Visual Analytics System for Information Retrieval and Recommendation for Large-Scale Document Data

DOE PAGES

Choo, Jaegul; Kim, Hannah; Clarkson, Edward; ...

2018-01-31

In this paper, we present an interactive visual information retrieval and recommendation system, called VisIRR, for large-scale document discovery. VisIRR effectively combines the paradigms of (1) a passive pull through query processes for retrieval and (2) an active push that recommends items of potential interest to users based on their preferences. Equipped with an efficient dynamic query interface against a large-scale corpus, VisIRR organizes the retrieved documents into high-level topics and visualizes them in a 2D space, representing the relationships among the topics along with their keyword summary. In addition, based on interactive personalized preference feedback with regard to documents,more » VisIRR provides document recommendations from the entire corpus, which are beyond the retrieved sets. Such recommended documents are visualized in the same space as the retrieved documents, so that users can seamlessly analyze both existing and newly recommended ones. This article presents novel computational methods, which make these integrated representations and fast interactions possible for a large-scale document corpus. We illustrate how the system works by providing detailed usage scenarios. Finally, we present preliminary user study results for evaluating the effectiveness of the system.« less

Network interactions underlying mirror feedback in stroke: A dynamic causal modeling study.

PubMed

Saleh, Soha; Yarossi, Mathew; Manuweera, Thushini; Adamovich, Sergei; Tunik, Eugene

2017-01-01

Mirror visual feedback (MVF) is potentially a powerful tool to facilitate recovery of disordered movement and stimulate activation of under-active brain areas due to stroke. The neural mechanisms underlying MVF have therefore been a focus of recent inquiry. Although it is known that sensorimotor areas can be activated via mirror feedback, the network interactions driving this effect remain unknown. The aim of the current study was to fill this gap by using dynamic causal modeling to test the interactions between regions in the frontal and parietal lobes that may be important for modulating the activation of the ipsilesional motor cortex during mirror visual feedback of unaffected hand movement in stroke patients. Our intent was to distinguish between two theoretical neural mechanisms that might mediate ipsilateral activation in response to mirror-feedback: transfer of information between bilateral motor cortices versus recruitment of regions comprising an action observation network which in turn modulate the motor cortex. In an event-related fMRI design, fourteen chronic stroke subjects performed goal-directed finger flexion movements with their unaffected hand while observing real-time visual feedback of the corresponding (veridical) or opposite (mirror) hand in virtual reality. Among 30 plausible network models that were tested, the winning model revealed significant mirror feedback-based modulation of the ipsilesional motor cortex arising from the contralesional parietal cortex, in a region along the rostral extent of the intraparietal sulcus. No winning model was identified for the veridical feedback condition. We discuss our findings in the context of supporting the latter hypothesis, that mirror feedback-based activation of motor cortex may be attributed to engagement of a contralateral (contralesional) action observation network. These findings may have important implications for identifying putative cortical areas, which may be targeted with non-invasive brain stimulation as a means of potentiating the effects of mirror training.

The effect of force feedback on student reasoning about gravity, mass, force and motion

NASA Astrophysics Data System (ADS)

Bussell, Linda

The purpose of this study was to examine whether force feedback within a computer simulation had an effect on reasoning by fifth grade students about gravity, mass, force, and motion, concepts which can be difficult for learners to grasp. Few studies have been done on cognitive learning and haptic feedback, particularly with young learners, but there is an extensive base of literature on children's conceptions of science and a number of studies focus specifically on children's conceptions of force and motion. This case study used a computer-based paddleball simulation with guided inquiry as the primary stimulus. Within the simulation, the learner could adjust the mass of the ball and the gravitational force. The experimental group used the simulation with visual and force feedback; the control group used the simulation with visual feedback but without force feedback. The proposition was that there would be differences in reasoning between the experimental and control groups, with force feedback being helpful with concepts that are more obvious when felt. Participants were 34 fifth-grade students from three schools. Students completed a modal (visual, auditory, and haptic) learning preference assessment and a pretest. The sessions, including participant experimentation and interviews, were audio recorded and observed. The interviews were followed by a written posttest. These data were analyzed to determine whether there were differences based on treatment, learning style, demographics, prior gaming experience, force feedback experience, or prior knowledge. Work with the simulation, regardless of group, was found to increase students' understanding of key concepts. The experimental group appeared to benefit from the supplementary help that force feedback provided. Those in the experimental group scored higher on the posttest than those in the control group. The greatest difference between mean group scores was on a question concerning the effects of increased gravitational force.

Towards a Teleoperated Needle Driver Robot with Haptic Feedback for RFA of Breast Tumors under Continuous MRI1

PubMed Central

Kokes, Rebecca; Lister, Kevin; Gullapalli, Rao; Zhang, Bao; MacMillan, Alan; Richard, Howard; Desai, Jaydev P.

2009-01-01

Objective The purpose of this paper is to explore the feasibility of developing a MRI-compatible needle driver system for radiofrequency ablation (RFA) of breast tumors under continuous MRI imaging while being teleoperated by a haptic feedback device from outside the scanning room. The developed needle driver prototype was designed and tested for both tumor targeting capability as well as RFA. Methods The single degree-of-freedom (DOF) prototype was interfaced with a PHANToM haptic device controlled from outside the scanning room. Experiments were performed to demonstrate MRI-compatibility and position control accuracy with hydraulic actuation, along with an experiment to determine the PHANToM’s ability to guide the RFA tool to a tumor nodule within a phantom breast tissue model while continuously imaging within the MRI and receiving force feedback from the RFA tool. Results Hydraulic actuation is shown to be a feasible actuation technique for operation in an MRI environment. The design is MRI-compatible in all aspects except for force sensing in the directions perpendicular to the direction of motion. Experiments confirm that the user is able to detect healthy vs. cancerous tissue in a phantom model when provided with both visual (imaging) feedback and haptic feedback. Conclusion The teleoperated 1-DOF needle driver system presented in this paper demonstrates the feasibility of implementing a MRI-compatible robot for RFA of breast tumors with haptic feedback capability. PMID:19303805

Can You Hear That Peak? Utilization of Auditory and Visual Feedback at Peak Limb Velocity

ERIC Educational Resources Information Center

Loria, Tristan; de Grosbois, John; Tremblay, Luc

2016-01-01

Purpose: At rest, the central nervous system combines and integrates multisensory cues to yield an optimal percept. When engaging in action, the relative weighing of sensory modalities has been shown to be altered. Because the timing of peak velocity is the critical moment in some goal-directed movements (e.g., overarm throwing), the current study…

Virtual Environments for People Who Are Visually Impaired Integrated into an Orientation and Mobility Program

ERIC Educational Resources Information Center

Lahav, Orly; Schloerb, David W.; Srinivasan, Mandayam A.

2015-01-01

Introduction: The BlindAid, a virtual system developed for orientation and mobility (O&M) training of people who are blind or have low vision, allows interaction with different virtual components (structures and objects) via auditory and haptic feedback. This research examined if and how the BlindAid that was integrated within an O&M…

Development of internal models and predictive abilities for visual tracking during childhood

PubMed Central

Ego, Caroline; Yüksel, Demet

2015-01-01

The prediction of the consequences of our own actions through internal models is an essential component of motor control. Previous studies showed improvement of anticipatory behaviors with age for grasping, drawing, and postural control. Since these actions require visual and proprioceptive feedback, these improvements might reflect both the development of internal models and the feedback control. In contrast, visual tracking of a temporarily invisible target gives specific markers of prediction and internal models for eye movements. Therefore, we recorded eye movements in 50 children (aged 5–19 yr) and in 10 adults, who were asked to pursue a visual target that is temporarily blanked. Results show that the youngest children (5–7 yr) have a general oculomotor behavior in this task, qualitatively similar to the one observed in adults. However, the overall performance of older subjects in terms of accuracy at target reappearance and variability in their behavior was much better than the youngest children. This late maturation of predictive mechanisms with age was reflected into the development of the accuracy of the internal models governing the synergy between the saccadic and pursuit systems with age. Altogether, we hypothesize that the maturation of the interaction between smooth pursuit and saccades that relies on internal models of the eye and target displacement is related to the continuous maturation of the cerebellum. PMID:26510757

Development of internal models and predictive abilities for visual tracking during childhood.

PubMed

Ego, Caroline; Yüksel, Demet; Orban de Xivry, Jean-Jacques; Lefèvre, Philippe

2016-01-01

The prediction of the consequences of our own actions through internal models is an essential component of motor control. Previous studies showed improvement of anticipatory behaviors with age for grasping, drawing, and postural control. Since these actions require visual and proprioceptive feedback, these improvements might reflect both the development of internal models and the feedback control. In contrast, visual tracking of a temporarily invisible target gives specific markers of prediction and internal models for eye movements. Therefore, we recorded eye movements in 50 children (aged 5-19 yr) and in 10 adults, who were asked to pursue a visual target that is temporarily blanked. Results show that the youngest children (5-7 yr) have a general oculomotor behavior in this task, qualitatively similar to the one observed in adults. However, the overall performance of older subjects in terms of accuracy at target reappearance and variability in their behavior was much better than the youngest children. This late maturation of predictive mechanisms with age was reflected into the development of the accuracy of the internal models governing the synergy between the saccadic and pursuit systems with age. Altogether, we hypothesize that the maturation of the interaction between smooth pursuit and saccades that relies on internal models of the eye and target displacement is related to the continuous maturation of the cerebellum. Copyright © 2016 the American Physiological Society.

Multimodal Speech Capture System for Speech Rehabilitation and Learning.

PubMed

Sebkhi, Nordine; Desai, Dhyey; Islam, Mohammad; Lu, Jun; Wilson, Kimberly; Ghovanloo, Maysam

2017-11-01

Speech-language pathologists (SLPs) are trained to correct articulation of people diagnosed with motor speech disorders by analyzing articulators' motion and assessing speech outcome while patients speak. To assist SLPs in this task, we are presenting the multimodal speech capture system (MSCS) that records and displays kinematics of key speech articulators, the tongue and lips, along with voice, using unobtrusive methods. Collected speech modalities, tongue motion, lips gestures, and voice are visualized not only in real-time to provide patients with instant feedback but also offline to allow SLPs to perform post-analysis of articulators' motion, particularly the tongue, with its prominent but hardly visible role in articulation. We describe the MSCS hardware and software components, and demonstrate its basic visualization capabilities by a healthy individual repeating the words "Hello World." A proof-of-concept prototype has been successfully developed for this purpose, and will be used in future clinical studies to evaluate its potential impact on accelerating speech rehabilitation by enabling patients to speak naturally. Pattern matching algorithms to be applied to the collected data can provide patients with quantitative and objective feedback on their speech performance, unlike current methods that are mostly subjective, and may vary from one SLP to another.

Programming of left hand exploits task set but that of right hand depends on recent history.

PubMed

Tang, Rixin; Zhu, Hong

2017-07-01

There are many differences between the left hand and the right hand. But it is not clear if there is a difference in programming between left hand and right hand when the hands perform the same movement. In current study, we carried out two experiments to investigate whether the programming of two hands was equivalent or they exploited different strategies. In the first experiment, participants were required to use one hand to grasp an object with visual feedback or to point to the center of one object without visual feedback on alternate trials, or to grasp an object without visual feedback and to point the center of one object with visual feedback on alternating trials. They then performed the tasks with the other hand. The result was that previous pointing task affected current grasping when it was performed by the left hand, but not the right hand. In experiment 2, we studied if the programming of the left (or right) hand would be affected by the pointing task performed on the previous trial not only by the same hand, but also by the right (or left) hand. Participants pointed and grasped the objects alternately with two hands. The result was similar with Experiment 1, i.e., left-hand grasping was affected by right-hand pointing, whereas right-hand grasping was immune from the interference from left hand. Taken together, the results suggest that when open- and closed-loop trials are interleaved, motor programming of grasping with the right hand was affected by the nature of the online feedback on the previous trial only if it was a grasping trial, suggesting that the trial-to-trial transfer depends on sensorimotor memory and not on task set. In contrast, motor programming of grasping with the left hand can use information about the nature of the online feedback on the previous trial to specify the parameters of the movement, even when the type of movement that occurred was quite different (i.e., pointing) and was performed with the right hand. This suggests that trial-to-trial transfer with the left hand depends on some sort of carry-over of task set for dealing with the availability of visual feedback.

Evaluating Effectiveness of Modeling Motion System Feedback in the Enhanced Hess Structural Model of the Human Operator

NASA Technical Reports Server (NTRS)

Zaychik, Kirill; Cardullo, Frank; George, Gary; Kelly, Lon C.

2009-01-01

In order to use the Hess Structural Model to predict the need for certain cueing systems, George and Cardullo significantly expanded it by adding motion feedback to the model and incorporating models of the motion system dynamics, motion cueing algorithm and a vestibular system. This paper proposes a methodology to evaluate effectiveness of these innovations by performing a comparison analysis of the model performance with and without the expanded motion feedback. The proposed methodology is composed of two stages. The first stage involves fine-tuning parameters of the original Hess structural model in order to match the actual control behavior recorded during the experiments at NASA Visual Motion Simulator (VMS) facility. The parameter tuning procedure utilizes a new automated parameter identification technique, which was developed at the Man-Machine Systems Lab at SUNY Binghamton. In the second stage of the proposed methodology, an expanded motion feedback is added to the structural model. The resulting performance of the model is then compared to that of the original one. As proposed by Hess, metrics to evaluate the performance of the models include comparison against the crossover models standards imposed on the crossover frequency and phase margin of the overall man-machine system. Preliminary results indicate the advantage of having the model of the motion system and motion cueing incorporated into the model of the human operator. It is also demonstrated that the crossover frequency and the phase margin of the expanded model are well within the limits imposed by the crossover model.

`Let your data tell a story:' climate change experts and students navigating disciplinary argumentation in the classroom

NASA Astrophysics Data System (ADS)

Walsh, Elizabeth Mary; McGowan, Veronica Cassone

2017-01-01

Science education trends promote student engagement in authentic knowledge in practice to tackle personally consequential problems. This study explored how partnering scientists and students on a social media platform supported students' development of disciplinary practice knowledge through practice-based learning with experts during two pilot enactments of a project-based curriculum focusing on the ecological impacts of climate change. Through the online platform, scientists provided feedback on students' infographics, visual argumentation artifacts that use data to communicate about climate change science. We conceptualize the infographics and professional data sets as boundary objects that supported authentic argumentation practices across classroom and professional contexts, but found that student generated data was not robust enough to cross these boundaries. Analysis of the structure and content of the scientists' feedback revealed that when critiquing argumentation, scientists initiated engagement in multiple scientific practices, supporting a holistic rather than discrete model of practice-based learning. While traditional classroom inquiry has emphasized student experimentation, we found that engagement with existing professional data sets provided students with a platform for developing expertise in systemic scientific practices during argument construction. We further found that many students increased the complexity and improved the visual presentation of their arguments after feedback.

A new method for text detection and recognition in indoor scene for assisting blind people

NASA Astrophysics Data System (ADS)

Jabnoun, Hanen; Benzarti, Faouzi; Amiri, Hamid

2017-03-01

Developing assisting system of handicapped persons become a challenging ask in research projects. Recently, a variety of tools are designed to help visually impaired or blind people object as a visual substitution system. The majority of these tools are based on the conversion of input information into auditory or tactile sensory information. Furthermore, object recognition and text retrieval are exploited in the visual substitution systems. Text detection and recognition provides the description of the surrounding environments, so that the blind person can readily recognize the scene. In this work, we aim to introduce a method for detecting and recognizing text in indoor scene. The process consists on the detection of the regions of interest that should contain the text using the connected component. Then, the text detection is provided by employing the images correlation. This component of an assistive blind person should be simple, so that the users are able to obtain the most informative feedback within the shortest time.

In Flight Evaluation of Active Inceptor Force-Feel Characteristics and Handling Qualities

DTIC Science & Technology

2012-05-01

DEGRADED ACCEPTABLE Mitchell Aponso (1995) Watson Schroeder (1990) 0.75 lb/in 2.3 lb/in2.9 lb/in5.9 lb/in Side Stk - lon Side Stk - lat Center Stk Figure...vestibular feedback ( and respectively), and the visual error compensation ( ). A key feature of this approach is the modeling of proprioceptive...and vestibular feedback, and is the proportional component of the visual compensation strategy. At its core the fundamental concept of the HQSF

Perception-based 3D tactile rendering from a single image for human skin examinations by dynamic touch.

PubMed

Kim, K; Lee, S

2015-05-01

Diagnosis of skin conditions is dependent on the assessment of skin surface properties that are represented by more tactile properties such as stiffness, roughness, and friction than visual information. Due to this reason, adding tactile feedback to existing vision based diagnosis systems can help dermatologists diagnose skin diseases or disorders more accurately. The goal of our research was therefore to develop a tactile rendering system for skin examinations by dynamic touch. Our development consists of two stages: converting a single image to a 3D haptic surface and rendering the generated haptic surface in real-time. Converting to 3D surfaces from 2D single images was implemented with concerning human perception data collected by a psychophysical experiment that measured human visual and haptic sensibility to 3D skin surface changes. For the second stage, we utilized real skin biomechanical properties found by prior studies. Our tactile rendering system is a standalone system that can be used with any single cameras and haptic feedback devices. We evaluated the performance of our system by conducting an identification experiment with three different skin images with five subjects. The participants had to identify one of the three skin surfaces by using a haptic device (Falcon) only. No visual cue was provided for the experiment. The results indicate that our system provides sufficient performance to render discernable tactile rendering with different skin surfaces. Our system uses only a single skin image and automatically generates a 3D haptic surface based on human haptic perception. Realistic skin interactions can be provided in real-time for the purpose of skin diagnosis, simulations, or training. Our system can also be used for other applications like virtual reality and cosmetic applications. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Memory-guided force output is associated with self-reported ADHD symptoms in young adults.

PubMed

Neely, Kristina A; Chennavasin, Amanda P; Yoder, Arie; Williams, Genevieve K R; Loken, Eric; Huang-Pollock, Cynthia L

2016-11-01

Attention-deficit/hyperactivity disorder (ADHD) is the most commonly diagnosed mental health disorder in childhood and persists into adulthood in up to 65 % of cases. ADHD is associated with adverse outcomes such as the ability to gain and maintain employment and is associated with an increased risk for substance abuse obesity workplace injuries and traffic accidents A majority of diagnosed children have motor deficits; however, few studies have examined motor deficits in young adults. This study provides a novel examination of visuomotor control of grip force in young adults with and without ADHD. Participants were instructed to maintain force production over a 20-second trial with and without real-time visual feedback about their performance. The results demonstrated that when visual feedback was available, adults with ADHD produced slightly higher grip force than controls. However, when visual feedback was removed, adults with ADHD had a faster rate of decay of force, which was associated with ADHD symptom severity and trait impulsivity. These findings suggest that there may be important differences in the way that adults with ADHD integrate visual feedback during continuous motor tasks. These may account for some of the motor impairments reported in children with ADHD. These deficits could result from (1) dysfunctional sensory motor integration and/or (2) deficits in short-term visuomotor memory.

Processing speed in recurrent visual networks correlates with general intelligence.

PubMed

Jolij, Jacob; Huisman, Danielle; Scholte, Steven; Hamel, Ronald; Kemner, Chantal; Lamme, Victor A F

2007-01-08

Studies on the neural basis of general fluid intelligence strongly suggest that a smarter brain processes information faster. Different brain areas, however, are interconnected by both feedforward and feedback projections. Whether both types of connections or only one of the two types are faster in smarter brains remains unclear. Here we show, by measuring visual evoked potentials during a texture discrimination task, that general fluid intelligence shows a strong correlation with processing speed in recurrent visual networks, while there is no correlation with speed of feedforward connections. The hypothesis that a smarter brain runs faster may need to be refined: a smarter brain's feedback connections run faster.

A computerized tablet with visual feedback of hand position for functional magnetic resonance imaging

PubMed Central

Karimpoor, Mahta; Tam, Fred; Strother, Stephen C.; Fischer, Corinne E.; Schweizer, Tom A.; Graham, Simon J.

2015-01-01

Neuropsychological tests behavioral tasks that very commonly involve handwriting and drawing are widely used in the clinic to detect abnormal brain function. Functional magnetic resonance imaging (fMRI) may be useful in increasing the specificity of such tests. However, performing complex pen-and-paper tests during fMRI involves engineering challenges. Previously, we developed an fMRI-compatible, computerized tablet system to address this issue. However, the tablet did not include visual feedback of hand position (VFHP), a human factors component that may be important for fMRI of certain patient populations. A real-time system was thus developed to provide VFHP and integrated with the tablet in an augmented reality display. The effectiveness of the system was initially tested in young healthy adults who performed various handwriting tasks in front of a computer display with and without VFHP. Pilot fMRI of writing tasks were performed by two representative individuals with and without VFHP. Quantitative analysis of the behavioral results indicated improved writing performance with VFHP. The pilot fMRI results suggest that writing with VFHP requires less neural resources compared to the without VFHP condition, to maintain similar behavior. Thus, the tablet system with VFHP is recommended for future fMRI studies involving patients with impaired brain function and where ecologically valid behavior is important. PMID:25859201

On the nature of unintentional action: a study of force/moment drifts during multifinger tasks.

PubMed

Parsa, Behnoosh; O'Shea, Daniel J; Zatsiorsky, Vladimir M; Latash, Mark L

2016-08-01

We explored the origins of unintentional changes in performance during accurate force production in isometric conditions seen after turning visual feedback off. The idea of control with referent spatial coordinates suggests that these phenomena could result from drifts of the referent coordinate for the effector. Subjects performed accurate force/moment production tasks by pressing with the fingers of a hand on force sensors. Turning the visual feedback off resulted in slow drifts of both total force and total moment to lower magnitudes of these variables; these drifts were more pronounced in the right hand of the right-handed subjects. Drifts in individual finger forces could be in different direction; in particular, fingers that produced moments of force against the required total moment showed an increase in their forces. The force/moment drift was associated with a drop in the index of synergy stabilizing performance under visual feedback. The drifts in directions that changed performance (non-motor equivalent) and in directions that did not (motor equivalent) were of about the same magnitude. The results suggest that control with referent coordinates is associated with drifts of those referent coordinates toward the corresponding actual coordinates of the hand, a reflection of the natural tendency of physical systems to move toward a minimum of potential energy. The interaction between drifts of the hand referent coordinate and referent orientation leads to counterdirectional drifts in individual finger forces. The results also demonstrate that the sensory information used to create multifinger synergies is necessary for their presence over the task duration. Copyright © 2016 the American Physiological Society.

Delayed action does not always require the ventral stream: a study on a patient with visual form agnosia.

PubMed

Hesse, Constanze; Schenk, Thomas

2014-05-01

It has been suggested that while movements directed at visible targets are processed within the dorsal stream, movements executed after delay rely on the visual representations of the ventral stream (Milner & Goodale, 2006). This interpretation is supported by the observation that a patient with ventral stream damage (D.F.) has trouble performing accurate movements after a delay, but performs normally when the target is visible during movement programming. We tested D.F.'s visuomotor performance in a letter-posting task whilst varying the amount of visual feedback available. Additionally, we also varied whether D.F. received tactile feedback at the end of each trial (posting through a letter box vs posting on a screen) and whether environmental cues were available during the delay period (removing the target only vs suppressing vision completely with shutter glasses). We found that in the absence of environmental cues patient D.F. was unaffected by the introduction of delay and performed as accurately as healthy controls. However, when environmental cues and vision of the moving hand were available during and after the delay period, D.F.'s visuomotor performance was impaired. Thus, while healthy controls benefit from the availability of environmental landmarks and/or visual feedback of the moving hand, such cues seem less beneficial to D.F. Taken together our findings suggest that ventral stream damage does not always impact the ability to make delayed movements but compromises the ability to use environmental landmarks and visual feedback efficiently. Copyright © 2014 Elsevier Ltd. All rights reserved.

Reliability and relative weighting of visual and nonvisual information for perceiving direction of self-motion during walking

PubMed Central

Saunders, Jeffrey A.

2014-01-01

Direction of self-motion during walking is indicated by multiple cues, including optic flow, nonvisual sensory cues, and motor prediction. I measured the reliability of perceived heading from visual and nonvisual cues during walking, and whether cues are weighted in an optimal manner. I used a heading alignment task to measure perceived heading during walking. Observers walked toward a target in a virtual environment with and without global optic flow. The target was simulated to be infinitely far away, so that it did not provide direct feedback about direction of self-motion. Variability in heading direction was low even without optic flow, with average RMS error of 2.4°. Global optic flow reduced variability to 1.9°–2.1°, depending on the structure of the environment. The small amount of variance reduction was consistent with optimal use of visual information. The relative contribution of visual and nonvisual information was also measured using cue conflict conditions. Optic flow specified a conflicting heading direction (±5°), and bias in walking direction was used to infer relative weighting. Visual feedback influenced heading direction by 16%–34% depending on scene structure, with more effect with dense motion parallax. The weighting of visual feedback was close to the predictions of an optimal integration model given the observed variability measures. PMID:24648194

Image and information management system

NASA Technical Reports Server (NTRS)

Robertson, Tina L. (Inventor); Raney, Michael C. (Inventor); Dougherty, Dennis M. (Inventor); Kent, Peter C. (Inventor); Brucker, Russell X. (Inventor); Lampert, Daryl A. (Inventor)

2009-01-01

A system and methods through which pictorial views of an object's configuration, arranged in a hierarchical fashion, are navigated by a person to establish a visual context within the configuration. The visual context is automatically translated by the system into a set of search parameters driving retrieval of structured data and content (images, documents, multimedia, etc.) associated with the specific context. The system places ''hot spots'', or actionable regions, on various portions of the pictorials representing the object. When a user interacts with an actionable region, a more detailed pictorial from the hierarchy is presented representing that portion of the object, along with real-time feedback in the form of a popup pane containing information about that region, and counts-by-type reflecting the number of items that are available within the system associated with the specific context and search filters established at that point in time.

Image and information management system

NASA Technical Reports Server (NTRS)

Robertson, Tina L. (Inventor); Kent, Peter C. (Inventor); Raney, Michael C. (Inventor); Dougherty, Dennis M. (Inventor); Brucker, Russell X. (Inventor); Lampert, Daryl A. (Inventor)

2007-01-01

A system and methods through which pictorial views of an object's configuration, arranged in a hierarchical fashion, are navigated by a person to establish a visual context within the configuration. The visual context is automatically translated by the system into a set of search parameters driving retrieval of structured data and content (images, documents, multimedia, etc.) associated with the specific context. The system places hot spots, or actionable regions, on various portions of the pictorials representing the object. When a user interacts with an actionable region, a more detailed pictorial from the hierarchy is presented representing that portion of the object, along with real-time feedback in the form of a popup pane containing information about that region, and counts-by-type reflecting the number of items that are available within the system associated with the specific context and search filters established at that point in time.

Development of a Kinect-based exergaming system for motor rehabilitation in neurological disorders

NASA Astrophysics Data System (ADS)

Estepa, A.; Sponton Piriz, S.; Albornoz, E.; Martínez, C.

2016-04-01

The development of videogames for physical therapy, known as exergames, has gained much interest in the last years. In this work, a sytem for rehabilitation and clinical evaluation of neurological patients is presented. The Microsoft Kinect device is used to track the full body of patients, and three games were developed to exercise and assess different aspects of balance and gait rehabilitation. The system provides visual feedback by means of an avatar that follows the movements of the patients, and sound and visual stimuli for giving orders during the experience. Also, the system includes a database and management tools for further analysis and monitoring of therapies. The results obtained show, on the one side, a great reception and interest of patients to use the system. On the other side, the specialists considered very useful the data collected and the quantitative analysis provided by the system, which was then adopted for the clinical routine.

Assisting Movement Training and Execution With Visual and Haptic Feedback.

PubMed

Ewerton, Marco; Rother, David; Weimar, Jakob; Kollegger, Gerrit; Wiemeyer, Josef; Peters, Jan; Maeda, Guilherme

2018-01-01

In the practice of motor skills in general, errors in the execution of movements may go unnoticed when a human instructor is not available. In this case, a computer system or robotic device able to detect movement errors and propose corrections would be of great help. This paper addresses the problem of how to detect such execution errors and how to provide feedback to the human to correct his/her motor skill using a general, principled methodology based on imitation learning. The core idea is to compare the observed skill with a probabilistic model learned from expert demonstrations. The intensity of the feedback is regulated by the likelihood of the model given the observed skill. Based on demonstrations, our system can, for example, detect errors in the writing of characters with multiple strokes. Moreover, by using a haptic device, the Haption Virtuose 6D, we demonstrate a method to generate haptic feedback based on a distribution over trajectories, which could be used as an auxiliary means of communication between an instructor and an apprentice. Additionally, given a performance measurement, the haptic device can help the human discover and perform better movements to solve a given task. In this case, the human first tries a few times to solve the task without assistance. Our framework, in turn, uses a reinforcement learning algorithm to compute haptic feedback, which guides the human toward better solutions.

The Sense of Agency Is More Sensitive to Manipulations of Outcome than Movement-Related Feedback Irrespective of Sensory Modality

PubMed Central

David, Nicole; Skoruppa, Stefan; Gulberti, Alessandro

2016-01-01

The sense of agency describes the ability to experience oneself as the agent of one's own actions. Previous studies of the sense of agency manipulated the predicted sensory feedback related either to movement execution or to the movement’s outcome, for example by delaying the movement of a virtual hand or the onset of a tone that resulted from a button press. Such temporal sensorimotor discrepancies reduce the sense of agency. It remains unclear whether movement-related feedback is processed differently than outcome-related feedback in terms of agency experience, especially if these types of feedback differ with respect to sensory modality. We employed a mixed-reality setup, in which participants tracked their finger movements by means of a virtual hand. They performed a single tap, which elicited a sound. The temporal contingency between the participants’ finger movements and (i) the movement of the virtual hand or (ii) the expected auditory outcome was systematically varied. In a visual control experiment, the tap elicited a visual outcome. For each feedback type and participant, changes in the sense of agency were quantified using a forced-choice paradigm and the Method of Constant Stimuli. Participants were more sensitive to delays of outcome than to delays of movement execution. This effect was very similar for visual or auditory outcome delays. Our results indicate different contributions of movement- versus outcome-related sensory feedback to the sense of agency, irrespective of the modality of the outcome. We propose that this differential sensitivity reflects the behavioral importance of assessing authorship of the outcome of an action. PMID:27536948

Effectiveness of basic display augmentation in vehicular control by visual field cues

NASA Technical Reports Server (NTRS)

Grunwald, A. J.; Merhav, S. J.

1978-01-01

The paper investigates the effectiveness of different basic display augmentation concepts - fixed reticle, velocity vector, and predicted future vehicle path - for RPVs controlled by a vehicle-mounted TV camera. The task is lateral manual control of a low flying RPV along a straight reference line in the presence of random side gusts. The man-machine system and the visual interface are modeled as a linear time-invariant system. Minimization of a quadratic performance criterion is assumed to underlie the control strategy of a well-trained human operator. The solution for the optimal feedback matrix enables the explicit computation of the variances of lateral deviation and directional error of the vehicle and of the control force that are used as performance measures.

The Impact of Different Visual Feedbacks in User Training on Motor Imagery Control in BCI.

PubMed

Zapała, Dariusz; Francuz, Piotr; Zapała, Ewelina; Kopiś, Natalia; Wierzgała, Piotr; Augustynowicz, Paweł; Majkowski, Andrzej; Kołodziej, Marcin

2018-03-01

The challenges of research into brain-computer interfaces (BCI) include significant individual differences in learning pace and in the effective operation of BCI devices. The use of neurofeedback training is a popular method of improving the effectiveness BCI operation. The purpose of the present study was to determine to what extent it is possible to improve the effectiveness of operation of sensorimotor rhythm-based brain-computer interfaces (SMR-BCI) by supplementing user training with elements modifying the characteristics of visual feedback. Four experimental groups had training designed to reinforce BCI control by: visual feedback in the form of dummy faces expressing emotions (Group 1); flashing the principal elements of visual feedback (Group 2) and giving both visual feedbacks in one condition (Group 3). The fourth group participated in training with no modifications (Group 4). Training consisted of a series of trials where the subjects directed a ball into a basket located to the right or left side of the screen. In Group 1 a schematic image a face, placed on the controlled object, showed various emotions, depending on the accuracy of control. In Group 2, the cue and targets were flashed with different frequency (4 Hz) than the remaining elements visible on the monitor. Both modifications were also used simultaneously in Group 3. SMR activity during the task was recorded before and after the training. In Group 3 there was a significant improvement in SMR control, compared to subjects in Group 2 and 4 (control). Differences between subjects in Groups 1, 2 and 4 (control) were insignificant. This means that relatively small changes in the training procedure may significantly impact the effectiveness of BCI control. Analysis of behavioural data acquired from all participants at training showed greater effectiveness in directing the object towards the right side of the screen. Subjects with the greatest improvement in SMR control showed a significantly lower difference in the accuracy of rightward and leftward movement than others.

Age-Specific Effects of Mirror-Muscle Activity on Cross-Limb Adaptations Under Mirror and Non-Mirror Visual Feedback Conditions.

PubMed

Reissig, Paola; Stöckel, Tino; Garry, Michael I; Summers, Jeffery J; Hinder, Mark R

2015-01-01

Cross-limb transfer (CLT) describes the observation of bilateral performance gains due to unilateral motor practice. Previous research has suggested that CLT may be reduced, or absent, in older adults, possibly due to age-related structural and functional brain changes. Based on research showing increases in CLT due to the provision of mirror visual feedback (MVF) during task execution in young adults, our study aimed to investigate whether MVF can facilitate CLT in older adults, who are known to be more reliant on visual feedback for accurate motor performance. Participants (N = 53) engaged in a short-term training regime (300 movements) involving a ballistic finger task using their dominant hand, while being provided with either visual feedback of their active limb, or a mirror reflection of their active limb (superimposed over the quiescent limb). Performance in both limbs was examined before, during and following the unilateral training. Furthermore, we measured corticospinal excitability (using TMS) at these time points, and assessed muscle activity bilaterally during the task via EMG; these parameters were used to investigate the mechanisms mediating and predicting CLT. Training resulted in significant bilateral performance gains that did not differ as a result of age or visual feedback (both p > 0.1). Training also elicited bilateral increases in corticospinal excitability (p < 0.05). For younger adults, CLT was significantly predicted by performance gains in the trained hand (β = 0.47), whereas for older adults it was significantly predicted by mirror activity in the untrained hand during training (β = 0.60). The present study suggests that older adults are capable of exhibiting CLT to a similar degree to younger adults. The prominent role of mirror activity in the untrained hand for CLT in older adults indicates that bilateral cortical activity during unilateral motor tasks is a compensatory mechanism. In this particular task, MVF did not facilitate the extent of CLT.

Exploratory behavior during stance persists with visual feedback.

PubMed

Murnaghan, C D; Horslen, B C; Inglis, J T; Carpenter, M G

2011-11-10

Recent evidence showing center of pressure (COP) displacements increase following an external stabilization of the center of mass (COM) supports the theory that postural sway may be exploratory and serve as a means of acquiring sensory information. The aim of the current study was to further test this theory and rule out potential confounding effects of sensory illusions or motor drift on prior observations. Participants stood as still as possible in an apparatus which allowed movements of the COM to be stabilized ("locked") without subject awareness, and they were provided real-time visual feedback of their COM or COP throughout the trial. If there was an influence of sensory illusions or motor drift, we hypothesized that the change in COP displacement with locking would be reduced when participants were provided visual confirmation of COM stabilization (COM feedback), or when they were aware of the position of the COP throughout the trial (COP feedback). Confirming our previous results, increases in COP displacement were observed when movements of the COM were stabilized. In addition, our results showed that increases in COP displacement could not be explained by the presence of sensory illusions or motor drift, since increases in COP were observed despite being provided convincing evidence that the COM had been stabilized, and when participants were aware of their COP position throughout the trial. These results provide further support for an exploratory role of postural sway. The theoretical basis of current clinical practices designed to deal with balance control deficits due to age or disease is typically based on the opinion that increases in sway are a consequence of a failing balance control system. Our results suggest that this may not be the case, and if sway is in fact exploratory, a serious re-evaluation of current clinical practices may be warranted. Copyright © 2011 IBRO. Published by Elsevier Ltd. All rights reserved.

Cortical potentials evoked by confirming and disconfirming feedback following an auditory discrimination.

NASA Technical Reports Server (NTRS)

Squires, K. C.; Hillyard, S. A.; Lindsay, P. H.

1973-01-01

Vertex potentials elicited by visual feedback signals following an auditory intensity discrimination have been studied with eight subjects. Feedback signals which confirmed the prior sensory decision elicited small P3s, while disconfirming feedback elicited P3s that were larger. On the average, the latency of P3 was also found to increase with increasing disparity between the judgment and the feedback information. These effects were part of an overall dichotomy in wave shape following confirming vs disconfirming feedback. These findings are incorporated in a general model of the role of P3 in perceptual decision making.

An evaluation of end-point trajectory planning during skilled kicking.

PubMed

Ford, Paul; Hodges, Nicola J; Mark Williams, A

2009-01-01

There is evidence that actions are planned by anticipation of their external effects, with the strength of this effect being dependent on the amount of prior practice. In Experiment 1, skilled soccer players performed a kicking task under four conditions: planning in terms of an external action effect (i.e., ball trajectory) or in terms of body movements, either with or without visual error feedback. When feedback was withheld, a ball focus resulted in more accurate outcomes than a body focus. When visual feedback was allowed, there was no difference between these two conditions. In Experiment 2, both skilled and novice soccer players were tested with the addition of a control condition and in the absence of visual feedback. For both groups there was evidence that a ball focus was more beneficial for performance than a body focus, particularly in terms of movement kinematics where correlations across the joints were generally higher for body rather than ball planning. Most skilled participants reported that ball planning felt more normal than body planning. These experiments provide some evidence that actions are planned in terms of their external action effects, supporting the common-coding hypothesis of action planning.

A cognitive neuroprosthetic that uses cortical stimulation for somatosensory feedback

PubMed Central

Klaes, Christian; Shi, Ying; Kellis, Spencer; Minxha, Juri; Revechkis, Boris; Andersen, Richard A.

2015-01-01

Present day cortical brain machine interfaces (BMI) have made impressive advances using decoded brain signals to control extracorporeal devices. Although BMIs are used in a closed-loop fashion, sensory feedback typically is visual only. However medical case studies have shown that the loss of somesthesis in a limb greatly reduces the agility of the limb even when visual feedback is available (for review see Robles-De-La-Torre, 2006). To overcome this limitation, this study tested a closed-loop BMI that utilizes intracortical microstimulation (ICMS) to provide ‘tactile’ sensation to a non-human primate (NHP). Using stimulation electrodes in Brodmann area 1 of somatosensory cortex (BA1) and recording electrodes in the anterior intraparietal area (AIP), the parietal reach region (PRR) and dorsal area 5 (area 5d), it was found that this form of feedback can be used in BMI tasks. PMID:25242377

Real-time evaluation and visualization of learner performance in a mixed-reality environment for clinical breast examination.

PubMed

Kotranza, Aaron; Lind, D Scott; Lok, Benjamin

2012-07-01

We investigate the efficacy of incorporating real-time feedback of user performance within mixed-reality environments (MREs) for training real-world tasks with tightly coupled cognitive and psychomotor components. This paper presents an approach to providing real-time evaluation and visual feedback of learner performance in an MRE for training clinical breast examination (CBE). In a user study of experienced and novice CBE practitioners (n = 69), novices receiving real-time feedback performed equivalently or better than more experienced practitioners in the completeness and correctness of the exam. A second user study (n = 8) followed novices through repeated practice of CBE in the MRE. Results indicate that skills improvement in the MRE transfers to the real-world task of CBE of human patients. This initial case study demonstrates the efficacy of MREs incorporating real-time feedback for training real-world cognitive-psychomotor tasks.

Leveraging M and S in Soft Skills Training for the DoD

NASA Technical Reports Server (NTRS)

Cimino, James D.

2011-01-01

Soft skills, also called "people skills," are typically hard to observe, quantify and measure. These skills have to do with how we relate to each other; communicating, listening, engaging in dialogue, giving feedback, cooperating as a team member, solving problems and resolving conflicts. Most of the soft skills training is scenario based, utilizing written or video-based scenarios. with limited or no branching, as well as quantitative feedback. This paper will outline a game-based approach to configurable, scenario-based, soft skills training. The paper will discuss the application of realistic visual behavior cues (e.g. body language, vocal inflection, facial expressions) and how these can benefit the learner. Using the concept of a "virtual vignette" this paper will discuss a prototype system intended to leach suicide prevention and provide qualitative feedback to the learner. The paper will also explore other soft skills training applications for this technology

Alpha-beta and gamma rhythms subserve feedback and feedforward influences among human visual cortical areas

PubMed Central

Michalareas, Georgios; Vezoli, Julien; van Pelt, Stan; Schoffelen, Jan-Mathijs; Kennedy, Henry; Fries, Pascal

2016-01-01

Primate visual cortex is hierarchically organized. Bottom-up and top-down influences are exerted through distinct frequency channels, as was recently revealed in macaques by correlating inter-areal influences with laminar anatomical projection patterns. Because this anatomical data cannot be obtained in human subjects, we selected seven homologous macaque and human visual areas, and correlated the macaque laminar projection patterns to human inter-areal directed influences as measured with magnetoencephalography. We show that influences along feedforward projections predominate in the gamma band, whereas influences along feedback projections predominate in the alpha-beta band. Rhythmic inter-areal influences constrain a functional hierarchy of the seven homologous human visual areas that is in close agreement with the respective macaque anatomical hierarchy. Rhythmic influences allow an extension of the hierarchy to 26 human visual areas including uniquely human brain areas. Hierarchical levels of ventral and dorsal stream visual areas are differentially affected by inter-areal influences in the alpha-beta band. PMID:26777277

The combined impact of virtual reality neurorehabilitation and its interfaces on upper extremity functional recovery in patients with chronic stroke.

PubMed

Cameirão, Mónica S; Badia, Sergi Bermúdez i; Duarte, Esther; Frisoli, Antonio; Verschure, Paul F M J

2012-10-01

Although there is strong evidence on the beneficial effects of virtual reality (VR)-based rehabilitation, it is not yet well understood how the different aspects of these systems affect recovery. Consequently, we do not exactly know what features of VR neurorehabilitation systems are decisive in conveying their beneficial effects. To specifically address this issue, we developed 3 different configurations of the same VR-based rehabilitation system, the Rehabilitation Gaming System, using 3 different interface technologies: vision-based tracking, haptics, and a passive exoskeleton. Forty-four patients with chronic stroke were randomly allocated to one of the configurations and used the system for 35 minutes a day for 5 days a week during 4 weeks. Our results revealed significant within-subject improvements at most of the standard clinical evaluation scales for all groups. Specifically we observe that the beneficial effects of VR-based training are modulated by the use/nonuse of compensatory movement strategies and the specific sensorimotor contingencies presented to the user, that is, visual feedback versus combined visual haptic feedback. Our findings suggest that the beneficial effects of VR-based neurorehabilitation systems such as the Rehabilitation Gaming System for the treatment of chronic stroke depend on the specific interface systems used. These results have strong implications for the design of future VR rehabilitation strategies that aim at maximizing functional outcomes and their retention. Clinical Trial Registration- This trial was not registered because it is a small clinical study that evaluates the feasibility of prototype devices.

The influence of visual feedback from the recent past on the programming of grip aperture is grasp-specific, shared between hands, and mediated by sensorimotor memory not task set.

PubMed

Tang, Rixin; Whitwell, Robert L; Goodale, Melvyn A

2015-05-01

Goal-directed movements, such as reaching out to grasp an object, are necessarily constrained by the spatial properties of the target such as its size, shape, and position. For example, during a reach-to-grasp movement, the peak width of the aperture formed by the thumb and fingers in flight (peak grip aperture, PGA) is linearly related to the target's size. Suppressing vision throughout the movement (visual open loop) has a small though significant effect on this relationship. Visual open loop conditions also produce a large increase in the PGA compared to when vision is available throughout the movement (visual closed loop). Curiously, this differential effect of the availability of visual feedback is influenced by the presentation order: the difference in PGA between closed- and open-loop trials is smaller when these trials are intermixed (an effect we have called 'homogenization'). Thus, grasping movements are affected not only by the availability of visual feedback (closed loop or open loop) but also by what happened on the previous trial. It is not clear, however, whether this carry-over effect is mediated through motor (or sensorimotor) memory or through the interference of different task sets for closed-loop and open-loop feedback that determine when the movements are fully specified. We reasoned that sensorimotor memory, but not a task set for closed and open loop feedback, would be specific to the type of response. We tested this prediction in a condition in which pointing to targets was alternated with grasping those same targets. Critically, in this condition, when pointing was performed in open loop, grasping was always performed in closed loop (and vice versa). Despite the fact that closed- and open-loop trials were alternating in this condition, we found no evidence for homogenization of the PGA. Homogenization did occur, however, in a follow-up experiment in which grasping movements and visual feedback were alternated between the left and the right hand, indicating that sensorimotor (or motor) memory can operate both within and between hands when the response type is kept the same. In a final experiment, we ruled out the possibility that simply alternating the hand used to perform the grasp interferes with motor or sensorimotor memory. We did this by showing that when the hand was alternated within a block of exclusively closed- or open-loop trials, homogenization of the PGA did not occur. Taken together, the results suggest that (1) interference from simply switching between task sets for closed or open-loop feedback or from switching between the hands cannot account homogenization in the PGA and that (2) the programming and execution of grasps can borrow not only from grasping movements executed in the past by the same hand, but also from grasping movements executed with the other hand. Copyright © 2015 Elsevier B.V. All rights reserved.

Coupling Visualization, Simulation, and Deep Learning for Ensemble Steering of Complex Energy Models: Preprint

DOE Office of Scientific and Technical Information (OSTI.GOV)

Potter, Kristin C; Brunhart-Lupo, Nicholas J; Bush, Brian W

We have developed a framework for the exploration, design, and planning of energy systems that combines interactive visualization with machine-learning based approximations of simulations through a general purpose dataflow API. Our system provides a visual inter- face allowing users to explore an ensemble of energy simulations representing a subset of the complex input parameter space, and spawn new simulations to 'fill in' input regions corresponding to new enegery system scenarios. Unfortunately, many energy simula- tions are far too slow to provide interactive responses. To support interactive feedback, we are developing reduced-form models via machine learning techniques, which provide statistically soundmore » esti- mates of the full simulations at a fraction of the computational cost and which are used as proxies for the full-form models. Fast com- putation and an agile dataflow enhance the engagement with energy simulations, and allow researchers to better allocate computational resources to capture informative relationships within the system and provide a low-cost method for validating and quality-checking large-scale modeling efforts.« less

Simulation and animation of sensor-driven robots

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, C.; Trivedi, M.M.; Bidlack, C.R.

1994-10-01

Most simulation and animation systems utilized in robotics are concerned with simulation of the robot and its environment without simulation of sensors. These systems have difficulty in handling robots that utilize sensory feedback in their operation. In this paper, a new design of an environment for simulation, animation, and visualization of sensor-driven robots is presented. As sensor technology advances, increasing numbers of robots are equipped with various types of sophisticated sensors. The main goal of creating the visualization environment is to aide the automatic robot programming and off-line programming capabilities of sensor-driven robots. The software system will help the usersmore » visualize the motion and reaction of the sensor-driven robot under their control program. Therefore, the efficiency of the software development is increased, the reliability of the software and the operation safety of the robot are ensured, and the cost of new software development is reduced. Conventional computer-graphics-based robot simulation and animation software packages lack of capabilities for robot sensing simulation. This paper describes a system designed to overcome this deficiency.« less

Time to CUSUM: simplified reporting of outcomes in colorectal surgery.

PubMed

Bowles, Thomas A; Watters, David A

2007-07-01

Surgical audit has added value when outcomes can be compared and individual surgeons receive feedback. It is expected that surgeons compare their results with others in similar local practice, the published work, or peers from a craft group audit. Although feedback and comparison are worthy aims, for many surgeons the standards have not been agreed nor is there a craft group audit. The aim of this paper was to develop a reporting format for surgeons carrying out colorectal surgery in a regional hospital. The performance of 13 individual surgeons was analysed using a comprehensive colorectal audit with more than 600 cases. Feedback included caseload and type. Risk stratification of outcomes included; operation urgency, age and Physiological and Operative Severity Score for enUmeration of Mortality and Morbidity. Outcome measures were anastomotic leaks, end stoma rates, unplanned reoperations and mortality. Visual feedback included cumulative summation graphs for elective leaks, mortality and unplanned reoperations. A single A4 page of an individuals performance could be prepared that allowed comparison to the groups data overall. Alerts were set at 2-5% elective leaks, 4-7.5% mortality and 4-11% unplanned return to theatre. Cumulative summation graphs added to this allowed a visual guide to the key performance indicators. Surgeons need to determine how they will review their individual and collective results. These are equally important to the reported work. Detailed analysis of risk-stratified data should occur. Binary outcomes such as leak, mortality and unplanned reoperations may be followed by cumulative summation graphs. This provides a continually updated method of feedback, enabling immediate visual feedback of a surgeon's performance.

The Edison Responsive Environment Learning System, or the Talking Typewriter Developed by Thomas A. Edison Laboratory, a Subsidiary of McGraw Edison Company.

ERIC Educational Resources Information Center

Sanderson, Barbara A.; Kratochvil, Daniel W.

The "Talking Typewriter" is a computerized electric typewriter with visual and audio capabilities. It was designed to create an environment where learning to read would be a successful, enjoyable experience for the student by allowing him to explore, discover relationships, to progress at his own speed, and to receive feedback. This…

Replacing Voice Input with Technology that Provided Immediate Visual and Audio Feedback to Reduce Employee Errors

ERIC Educational Resources Information Center

Goomas, David T.

2010-01-01

In this report from the field at two auto parts distribution centers, order selectors picked auto accessories (e.g., fuses, oil caps, tool kits) into industrial plastic totes as part of store orders. Accurately identifying all store order totes via the license plate number was a prerequisite for the warehouse management system (WMS) to track each…

Evaluation of Physiological and Psychological Impairment of Human Performance in Cold Stressed Subjects

DTIC Science & Technology

1990-03-23

defined (personal communciation between R. Pozos and Simon, 1985). In summary, there have been studies dealing with shivering which indicate that the...microcomputer (IBM PS/2, Model 30/286). The Firearms Training System combines features of several technologies, notably: interactive video-disc/ computer ...technology and laser designator/camera/ computer /target-hit generation, which provides for immediate visual performance feedback. The subject is

Performance of cardiopulmonary resuscitation feedback systems in a long-distance train with distributed traction.

PubMed

González-Otero, Digna M; de Gauna, Sofía Ruiz; Ruiz, Jesus; Rivero, Raquel; Gutierrez, J J; Saiz, Purificación; Russell, James K

2018-04-20

Out-of-hospital cardiac arrest is common in public locations, including public transportation sites. Feedback devices are increasingly being used to improve chest-compression quality. However, their performance during public transportation has not been studied yet. To test two CPR feedback devices representative of the current technologies (accelerometer and electromag- netic-field) in a long-distance train. Volunteers applied compressions on a manikin during the train route using both feedback devices. Depth and rate measurements computed by the devices were compared to the gold-standard values. Sixty-four 4-min records were acquired. The accelerometer-based device provided visual help in all experiments. Median absolute errors in depth and rate were 2.4 mm and 1.3 compressions per minute (cpm) during conventional speed, and 2.5 mm and 1.2 cpm during high speed. The electromagnetic-field-based device never provided CPR feedback; alert messages were shown instead. However, measurements were stored in its internal memory. Absolute errors for depth and rate were 2.6 mm and 0.7 cpm during conventional speed, and 2.6 mm and 0.7 cpm during high speed. Both devices were accurate despite the accelerations and the electromagnetic interferences induced by the train. However, the electromagnetic-field-based device would require modifications to avoid excessive alerts impeding feedback.

Evidence flowers: An innovative, visual method of presenting "best evidence" summaries to health professional and lay audiences.

PubMed

Babatunde, O O; Tan, V; Jordan, J L; Dziedzic, K; Chew-Graham, C A; Jinks, C; Protheroe, J; van der Windt, D A

2018-06-01

Barriers to dissemination and engagement with evidence pose a threat to implementing evidence-based medicine. Understanding, retention, and recall can be enhanced by visual presentation of information. The aim of this exploratory research was to develop and evaluate the accessibility and acceptability of visual summaries for presenting evidence syntheses with multiple exposures or outcomes to professional and lay audiences. "Evidence flowers" were developed as a visual method of presenting data from 4 case scenarios: 2 complex evidence syntheses with multiple outcomes, Cochrane reviews, and clinical guidelines. Petals of evidence flowers were coloured according to the GRADE evidence rating system to display key findings and recommendations from the evidence summaries. Application of evidence flowers was observed during stakeholder workshops. Evaluation and feedback were conducted via questionnaires and informal interviews. Feedback from stakeholders on the evidence flowers collected from workshops, questionnaires, and interviews was encouraging and helpful for refining the design of the flowers. Comments were made on the content and design of the flowers, as well as the usability and potential for displaying different types of evidence. Evidence flowers are a novel and visually stimulating method for presenting research evidence from evidence syntheses with multiple exposures or outcomes, Cochrane reviews, and clinical guidelines. To promote access and engagement with research evidence, evidence flowers may be used in conjunction with other evidence synthesis products, such as (lay) summaries, evidence inventories, rapid reviews, and clinical guidelines. Additional research on potential adaptations and applications of the evidence flowers may further bridge the gap between research evidence and clinical practice. Copyright © 2018 John Wiley & Sons, Ltd.

Investigating the Effects of Multimodal Feedback through Tracking State in Pen-Based Interfaces

ERIC Educational Resources Information Center

Sun, Minghui; Ren, Xiangshi

2011-01-01

A tracking state increases the bandwidth of pen-based interfaces. However, this state is difficult to detect with default visual feedback. This paper reports on two experiments that are designed to evaluate multimodal feedback for pointing tasks (both 1D and 2D) in tracking state. In 1D pointing experiments, results show that there is a…

Exploring Formative Feedback on Textual Assignments with the Help of Automatically Created Visual Representations

ERIC Educational Resources Information Center

Berlanga, A. J.; van Rosmalen, P.; Boshuizen, H. P. A.; Sloep, P. B.

2012-01-01

Learners, particularly lifelong learners, often find it difficult to determine the scope of their expertise. Formative feedback could help them do so. To use this feedback productively, it is essential to then suggest to them the remedial actions they need to overcome the gaps in their knowledge. This paper presents the design considerations of a…

Feedback Regulation of Intracellular Hydrostatic Pressure in Surface Cells of the Lens

PubMed Central

Gao, Junyuan; Sun, Xiurong; White, Thomas W.; Delamere, Nicholas A.; Mathias, Richard T.

2015-01-01

In wild-type lenses from various species, an intracellular hydrostatic pressure gradient goes from ∼340 mmHg in central fiber cells to 0 mmHg in surface cells. This gradient drives a center-to-surface flow of intracellular fluid. In lenses in which gap-junction coupling is increased, the central pressure is lower, whereas if gap-junction coupling is reduced, the central pressure is higher but surface pressure is always zero. Recently, we found that surface cell pressure was elevated in PTEN null lenses. This suggested disruption of a feedback control system that normally maintained zero surface cell pressure. Our purpose in this study was to investigate and characterize this feedback control system. We measured intracellular hydrostatic pressures in mouse lenses using a microelectrode/manometer-based system. We found that all feedback went through transport by the Na/K ATPase, which adjusted surface cell osmolarity such that pressure was maintained at zero. We traced the regulation of Na/K ATPase activity back to either TRPV4, which sensed positive pressure and stimulated activity, or TRPV1, which sensed negative pressure and inhibited activity. The inhibitory effect of TRPV1 on Na/K pumps was shown to signal through activation of the PI3K/AKT axis. The stimulatory effect of TRPV4 was shown in previous studies to go through a different signal transduction path. Thus, there is a local two-legged feedback control system for pressure in lens surface cells. The surface pressure provides a pedestal on which the pressure gradient sits, so surface pressure determines the absolute value of pressure at each radial location. We speculate that the absolute value of intracellular pressure may set the radial gradient in the refractive index, which is essential for visual acuity. PMID:26536260

Saccadic adaptation to a systematically varying disturbance

PubMed Central

Ohl, Sven; Rolfs, Martin

2016-01-01

Saccadic adaptation maintains the correct mapping between eye movements and their targets, yet the dynamics of saccadic gain changes in the presence of systematically varying disturbances has not been extensively studied. Here we assessed changes in the gain of saccade amplitudes induced by continuous and periodic postsaccadic visual feedback. Observers made saccades following a sequence of target steps either along the horizontal meridian (Two-way adaptation) or with unconstrained saccade directions (Global adaptation). An intrasaccadic step—following a sinusoidal variation as a function of the trial number (with 3 different frequencies tested in separate blocks)—consistently displaced the target along its vector. The oculomotor system responded to the resulting feedback error by modifying saccade amplitudes in a periodic fashion with similar frequency of variation but lagging the disturbance by a few tens of trials. This periodic response was superimposed on a drift toward stronger hypometria with similar asymptotes and decay rates across stimulus conditions. The magnitude of the periodic response decreased with increasing frequency and was smaller and more delayed for Global than Two-way adaptation. These results suggest that—in addition to the well-characterized return-to-baseline response observed in protocols using constant visual feedback—the oculomotor system attempts to minimize the feedback error by integrating its variation across trials. This process resembles a convolution with an internal response function, whose structure would be determined by coefficients of the learning model. Our protocol reveals this fast learning process in single short experimental sessions, qualifying it for the study of sensorimotor learning in health and disease. PMID:27098027

Advanced Maintenance Simulation by Means of Hand-Based Haptic Interfaces

NASA Astrophysics Data System (ADS)

Nappi, Michele; Paolino, Luca; Ricciardi, Stefano; Sebillo, Monica; Vitiello, Giuliana

Aerospace industry has been involved in virtual simulation for design and testing since the birth of virtual reality. Today this industry is showing a growing interest in the development of haptic-based maintenance training applications, which represent the most advanced way to simulate maintenance and repair tasks within a virtual environment by means of a visual-haptic approach. The goal is to allow the trainee to experiment the service procedures not only as a workflow reproduced at a visual level but also in terms of the kinaesthetic feedback involved with the manipulation of tools and components. This study, conducted in collaboration with aerospace industry specialists, is aimed to the development of an immersive virtual capable of immerging the trainees into a virtual environment where mechanics and technicians can perform maintenance simulation or training tasks by directly manipulating 3D virtual models of aircraft parts while perceiving force feedback through the haptic interface. The proposed system is based on ViRstperson, a virtual reality engine under development at the Italian Center for Aerospace Research (CIRA) to support engineering and technical activities such as design-time maintenance procedure validation, and maintenance training. This engine has been extended to support haptic-based interaction, enabling a more complete level of interaction, also in terms of impedance control, and thus fostering the development of haptic knowledge in the user. The user’s “sense of touch” within the immersive virtual environment is simulated through an Immersion CyberForce® hand-based force-feedback device. Preliminary testing of the proposed system seems encouraging.

Contextual cuing contributes to the independent modification of multiple internal models for vocal control

PubMed Central

Keough, Dwayne

2011-01-01

Research on the control of visually guided limb movements indicates that the brain learns and continuously updates an internal model that maps the relationship between motor commands and sensory feedback. A growing body of work suggests that an internal model that relates motor commands to sensory feedback also supports vocal control. There is evidence from arm-reaching studies that shows that when provided with a contextual cue, the motor system can acquire multiple internal models, which allows an animal to adapt to different perturbations in diverse contexts. In this study we show that trained singers can rapidly acquire multiple internal models regarding voice fundamental frequency (F0). These models accommodate different perturbations to ongoing auditory feedback. Participants heard three musical notes and reproduced each one in succession. The musical targets could serve as a contextual cue to indicate which direction (up or down) feedback would be altered on each trial; however, participants were not explicitly instructed to use this strategy. When participants were gradually exposed to altered feedback adaptation was observed immediately following vocal onset. Aftereffects were target specific and did not influence vocal productions on subsequent trials. When target notes were no longer a contextual cue, adaptation occurred during altered feedback trials and evidence for trial-by-trial adaptation was found. These findings indicate that the brain is exceptionally sensitive to the deviations between auditory feedback and the predicted consequence of a motor command during vocalization. Moreover, these results indicate that, with contextual cues, the vocal control system may maintain multiple internal models that are capable of independent modification during different tasks or environments. PMID:21346208

Preserved reward outcome processing in ASD as revealed by event-related potentials.

PubMed

McPartland, James C; Crowley, Michael J; Perszyk, Danielle R; Mukerji, Cora E; Naples, Adam J; Wu, Jia; Mayes, Linda C

2012-05-31

Problems with reward system function have been posited as a primary difficulty in autism spectrum disorders. The current study examined an electrophysiological marker of feedback monitoring, the feedback-related negativity (FRN), during a monetary reward task. The study advanced prior understanding by focusing exclusively on a developmental sample, applying rigorous diagnostic characterization and introducing an experimental paradigm providing more subtly different feedback valence (reward versus non-reward instead of reward versus loss). Twenty-six children with autism spectrum disorder and 28 typically developing peers matched on age and full-scale IQ played a guessing game resulting in monetary gain ("win") or neutral outcome ("draw"). ERP components marking early visual processing (N1, P2) and feedback appraisal (FRN) were contrasted between groups in each condition, and their relationships to behavioral measures of social function and dysfunction, social anxiety, and autism symptomatology were explored. FRN was observed on draw trials relative to win trials. Consistent with prior research, children with ASD exhibited a FRN to suboptimal outcomes that was comparable to typical peers. ERP parameters were unrelated to behavioral measures. Results of the current study indicate typical patterns of feedback monitoring in the context of monetary reward in ASD. The study extends prior findings of normative feedback monitoring to a sample composed exclusively of children and demonstrates that, as in typical development, individuals with autism exhibit a FRN to suboptimal outcomes, irrespective of neutral or negative valence. Results do not support a pervasive problem with reward system function in ASD, instead suggesting any dysfunction lies in more specific domains, such as social perception, or in response to particular feedback-monitoring contexts, such as self-evaluation of one's errors.

To develop behavioral tests of vestibular functioning in the Wistar rat

NASA Technical Reports Server (NTRS)

Nielson, H. C.

1980-01-01

Two tests of vestibular functioning in the rat were developed. The first test was the water maze. In the water maze the rat does not have the normal proprioceptive feedback from its limbs to help it maintain its orientation, and must rely primarily on the sensory input from its visual and vestibular systems. By altering lighting conditions and visual cues the vestibular functioning without visual cues was assessed. Whether there was visual compensation for some vestibular dysfunction was determined. The second test measured vestibular functioning of the rat's behavior on a parallel swing. In this test the rat's postural adjustments while swinging on the swing with the otoliths being stimulated were assessed. Less success was achieved in developing the parallel swing as a test of vestibular functioning than with the water maze. The major problem was incorrect initial assumptions of what the rat's probable behavior on the parallel swing would be.

A hybrid system for upper limb movement restoration in quadriplegics.

PubMed

Varoto, Renato; Barbarini, Elisa Signoreto; Cliquet, Alberto

2008-09-01

Generally, quadriplegic individuals have difficulties performing object manipulation. Toward satisfactory manipulation, reach and grasp movements must be performed with voluntary control, and for that, grasp force feedback is essential. A hybrid system aiming at partial upper limb sensory-motor restoration for quadriplegics was built. Such device is composed of an elbow dynamic orthosis that provides elbow flexion/extension (range was approximately from 20 degrees to 120 degrees , and average angular speed was approximately 15 degrees /s) with forearm support, a wrist static orthosis and neuromuscular electrical stimulation for grasping generation, and a glove with force sensors that allows grasping force feedback. The glove presents two user interface modes: visual by light emitting diodes or audio emitted by buzzer. Voice control of the entire system (elbow dynamic orthosis and electrical stimulator) is performed by the patient. The movements provided by the hybrid system, combined with the scapular and shoulder movements performed by the patient, can aid quadriplegic individuals in tasks that involve reach and grasp movements.

Unintentional Interpersonal Synchronization Represented as a Reciprocal Visuo-Postural Feedback System: A Multivariate Autoregressive Modeling Approach.

PubMed

Okazaki, Shuntaro; Hirotani, Masako; Koike, Takahiko; Bosch-Bayard, Jorge; Takahashi, Haruka K; Hashiguchi, Maho; Sadato, Norihiro

2015-01-01

People's behaviors synchronize. It is difficult, however, to determine whether synchronized behaviors occur in a mutual direction--two individuals influencing one another--or in one direction--one individual leading the other, and what the underlying mechanism for synchronization is. To answer these questions, we hypothesized a non-leader-follower postural sway synchronization, caused by a reciprocal visuo-postural feedback system operating on pairs of individuals, and tested that hypothesis both experimentally and via simulation. In the behavioral experiment, 22 participant pairs stood face to face either 20 or 70 cm away from each other wearing glasses with or without vision blocking lenses. The existence and direction of visual information exchanged between pairs of participants were systematically manipulated. The time series data for the postural sway of these pairs were recorded and analyzed with cross correlation and causality. Results of cross correlation showed that postural sway of paired participants was synchronized, with a shorter time lag when participant pairs could see one another's head motion than when one of the participants was blindfolded. In addition, there was less of a time lag in the observed synchronization when the distance between participant pairs was smaller. As for the causality analysis, noise contribution ratio (NCR), the measure of influence using a multivariate autoregressive model, was also computed to identify the degree to which one's postural sway is explained by that of the other's and how visual information (sighted vs. blindfolded) interacts with paired participants' postural sway. It was found that for synchronization to take place, it is crucial that paired participants be sighted and exert equal influence on one another by simultaneously exchanging visual information. Furthermore, a simulation for the proposed system with a wider range of visual input showed a pattern of results similar to the behavioral results.

Unintentional Interpersonal Synchronization Represented as a Reciprocal Visuo-Postural Feedback System: A Multivariate Autoregressive Modeling Approach

PubMed Central

Okazaki, Shuntaro; Hirotani, Masako; Koike, Takahiko; Bosch-Bayard, Jorge; Takahashi, Haruka K.; Hashiguchi, Maho; Sadato, Norihiro

2015-01-01

People’s behaviors synchronize. It is difficult, however, to determine whether synchronized behaviors occur in a mutual direction—two individuals influencing one another—or in one direction—one individual leading the other, and what the underlying mechanism for synchronization is. To answer these questions, we hypothesized a non-leader-follower postural sway synchronization, caused by a reciprocal visuo-postural feedback system operating on pairs of individuals, and tested that hypothesis both experimentally and via simulation. In the behavioral experiment, 22 participant pairs stood face to face either 20 or 70 cm away from each other wearing glasses with or without vision blocking lenses. The existence and direction of visual information exchanged between pairs of participants were systematically manipulated. The time series data for the postural sway of these pairs were recorded and analyzed with cross correlation and causality. Results of cross correlation showed that postural sway of paired participants was synchronized, with a shorter time lag when participant pairs could see one another’s head motion than when one of the participants was blindfolded. In addition, there was less of a time lag in the observed synchronization when the distance between participant pairs was smaller. As for the causality analysis, noise contribution ratio (NCR), the measure of influence using a multivariate autoregressive model, was also computed to identify the degree to which one’s postural sway is explained by that of the other’s and how visual information (sighted vs. blindfolded) interacts with paired participants’ postural sway. It was found that for synchronization to take place, it is crucial that paired participants be sighted and exert equal influence on one another by simultaneously exchanging visual information. Furthermore, a simulation for the proposed system with a wider range of visual input showed a pattern of results similar to the behavioral results. PMID:26398768

Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System

PubMed Central

Abdul-Kreem, Luma Issa; Neumann, Heiko

2015-01-01

The visual cortex analyzes motion information along hierarchically arranged visual areas that interact through bidirectional interconnections. This work suggests a bio-inspired visual model focusing on the interactions of the cortical areas in which a new mechanism of feedforward and feedback processing are introduced. The model uses a neuromorphic vision sensor (silicon retina) that simulates the spike-generation functionality of the biological retina. Our model takes into account two main model visual areas, namely V1 and MT, with different feature selectivities. The initial motion is estimated in model area V1 using spatiotemporal filters to locally detect the direction of motion. Here, we adapt the filtering scheme originally suggested by Adelson and Bergen to make it consistent with the spike representation of the DVS. The responses of area V1 are weighted and pooled by area MT cells which are selective to different velocities, i.e. direction and speed. Such feature selectivity is here derived from compositions of activities in the spatio-temporal domain and integrating over larger space-time regions (receptive fields). In order to account for the bidirectional coupling of cortical areas we match properties of the feature selectivity in both areas for feedback processing. For such linkage we integrate the responses over different speeds along a particular preferred direction. Normalization of activities is carried out over the spatial as well as the feature domains to balance the activities of individual neurons in model areas V1 and MT. Our model was tested using different stimuli that moved in different directions. The results reveal that the error margin between the estimated motion and synthetic ground truth is decreased in area MT comparing with the initial estimation of area V1. In addition, the modulated V1 cell activations shows an enhancement of the initial motion estimation that is steered by feedback signals from MT cells. PMID:26554589

Visually driven chaining of elementary swim patterns into a goal-directed motor sequence: a virtual reality study of zebrafish prey capture

PubMed Central

Trivedi, Chintan A.; Bollmann, Johann H.

2013-01-01

Prey capture behavior critically depends on rapid processing of sensory input in order to track, approach, and catch the target. When using vision, the nervous system faces the problem of extracting relevant information from a continuous stream of input in order to detect and categorize visible objects as potential prey and to select appropriate motor patterns for approach. For prey capture, many vertebrates exhibit intermittent locomotion, in which discrete motor patterns are chained into a sequence, interrupted by short periods of rest. Here, using high-speed recordings of full-length prey capture sequences performed by freely swimming zebrafish larvae in the presence of a single paramecium, we provide a detailed kinematic analysis of first and subsequent swim bouts during prey capture. Using Fourier analysis, we show that individual swim bouts represent an elementary motor pattern. Changes in orientation are directed toward the target on a graded scale and are implemented by an asymmetric tail bend component superimposed on this basic motor pattern. To further investigate the role of visual feedback on the efficiency and speed of this complex behavior, we developed a closed-loop virtual reality setup in which minimally restrained larvae recapitulated interconnected swim patterns closely resembling those observed during prey capture in freely moving fish. Systematic variation of stimulus properties showed that prey capture is initiated within a narrow range of stimulus size and velocity. Furthermore, variations in the delay and location of swim triggered visual feedback showed that the reaction time of secondary and later swims is shorter for stimuli that appear within a narrow spatio-temporal window following a swim. This suggests that the larva may generate an expectation of stimulus position, which enables accelerated motor sequencing if the expectation is met by appropriate visual feedback. PMID:23675322

Audio-visual feedback improves the BCI performance in the navigational control of a humanoid robot

PubMed Central

Tidoni, Emmanuele; Gergondet, Pierre; Kheddar, Abderrahmane; Aglioti, Salvatore M.

2014-01-01

Advancement in brain computer interfaces (BCI) technology allows people to actively interact in the world through surrogates. Controlling real humanoid robots using BCI as intuitively as we control our body represents a challenge for current research in robotics and neuroscience. In order to successfully interact with the environment the brain integrates multiple sensory cues to form a coherent representation of the world. Cognitive neuroscience studies demonstrate that multisensory integration may imply a gain with respect to a single modality and ultimately improve the overall sensorimotor performance. For example, reactivity to simultaneous visual and auditory stimuli may be higher than to the sum of the same stimuli delivered in isolation or in temporal sequence. Yet, knowledge about whether audio-visual integration may improve the control of a surrogate is meager. To explore this issue, we provided human footstep sounds as audio feedback to BCI users while controlling a humanoid robot. Participants were asked to steer their robot surrogate and perform a pick-and-place task through BCI-SSVEPs. We found that audio-visual synchrony between footsteps sound and actual humanoid's walk reduces the time required for steering the robot. Thus, auditory feedback congruent with the humanoid actions may improve motor decisions of the BCI's user and help in the feeling of control over it. Our results shed light on the possibility to increase robot's control through the combination of multisensory feedback to a BCI user. PMID:24987350

The effects of aging on the asymmetry of inter-limb transfer in a visuomotor task.

PubMed

Pan, Zhujun; Van Gemmert, Arend W A

2013-09-01

The direction of the asymmetry of inter-limb transfer has been suggested to identify the specialization of each hemisphere when performing a motor task. In an earlier study, we showed that trajectory information is only transferred from the right to the left hand, while final movement outcome-associated parameters transferred in both directions when right-hand-dominant individuals perform a motor task with visual distorted feedback. In the current study, we try to replicate this finding in young adults and test whether the asymmetry of inter-limb transfer in visuomotor task reduces in older adults, suggesting that hemispheric lateralization reduces with age. Young and older adults (all right-hand-dominant) performed a multidirectional point-to-point drawing task in which the visual feedback was rotated and the gain was increased. Half of the participants in each age group trained with the right hand and the other half trained with the left hand. Performances of both hands with non-distorted and distorted visual feedback were collected from all participants before and after the training session. The results showed that the pattern of inter-limb transfer was similar between young and older adults, i.e., inter-limb transfer is asymmetric for initial direction and symmetric for movement time and trajectory length. The results suggest that older adults retain the specialized functions of the non-dominant (right) hemisphere allowing them to program movement direction of a graphic aiming task when visual feedback is distorted.

Adaptive learning in a compartmental model of visual cortex—how feedback enables stable category learning and refinement

PubMed Central

Layher, Georg; Schrodt, Fabian; Butz, Martin V.; Neumann, Heiko

2014-01-01

The categorization of real world objects is often reflected in the similarity of their visual appearances. Such categories of objects do not necessarily form disjunct sets of objects, neither semantically nor visually. The relationship between categories can often be described in terms of a hierarchical structure. For instance, tigers and leopards build two separate mammalian categories, both of which are subcategories of the category Felidae. In the last decades, the unsupervised learning of categories of visual input stimuli has been addressed by numerous approaches in machine learning as well as in computational neuroscience. However, the question of what kind of mechanisms might be involved in the process of subcategory learning, or category refinement, remains a topic of active investigation. We propose a recurrent computational network architecture for the unsupervised learning of categorial and subcategorial visual input representations. During learning, the connection strengths of bottom-up weights from input to higher-level category representations are adapted according to the input activity distribution. In a similar manner, top-down weights learn to encode the characteristics of a specific stimulus category. Feedforward and feedback learning in combination realize an associative memory mechanism, enabling the selective top-down propagation of a category's feedback weight distribution. We suggest that the difference between the expected input encoded in the projective field of a category node and the current input pattern controls the amplification of feedforward-driven representations. Large enough differences trigger the recruitment of new representational resources and the establishment of additional (sub-) category representations. We demonstrate the temporal evolution of such learning and show how the proposed combination of an associative memory with a modulatory feedback integration successfully establishes category and subcategory representations. PMID:25538637

Differential effects of absent visual feedback control on gait variability during different locomotion speeds.

PubMed

Wuehr, M; Schniepp, R; Pradhan, C; Ilmberger, J; Strupp, M; Brandt, T; Jahn, K

2013-01-01

Healthy persons exhibit relatively small temporal and spatial gait variability when walking unimpeded. In contrast, patients with a sensory deficit (e.g., polyneuropathy) show an increased gait variability that depends on speed and is associated with an increased fall risk. The purpose of this study was to investigate the role of vision in gait stabilization by determining the effects of withdrawing visual information (eyes closed) on gait variability at different locomotion speeds. Ten healthy subjects (32.2 ± 7.9 years, 5 women) walked on a treadmill for 5-min periods at their preferred walking speed and at 20, 40, 70, and 80 % of maximal walking speed during the conditions of walking with eyes open (EO) and with eyes closed (EC). The coefficient of variation (CV) and fractal dimension (α) of the fluctuations in stride time, stride length, and base width were computed and analyzed. Withdrawing visual information increased the base width CV for all walking velocities (p < 0.001). The effects of absent visual information on CV and α of stride time and stride length were most pronounced during slow locomotion (p < 0.001) and declined during fast walking speeds. The results indicate that visual feedback control is used to stabilize the medio-lateral (i.e., base width) gait parameters at all speed sections. In contrast, sensory feedback control in the fore-aft direction (i.e., stride time and stride length) depends on speed. Sensory feedback contributes most to fore-aft gait stabilization during slow locomotion, whereas passive biomechanical mechanisms and an automated central pattern generation appear to control fast locomotion.

Detecting delay in visual feedback of an action as a monitor of self recognition.

PubMed

Hoover, Adria E N; Harris, Laurence R

2012-10-01

How do we distinguish "self" from "other"? The correlation between willing an action and seeing it occur is an important cue. We exploited the fact that this correlation needs to occur within a restricted temporal window in order to obtain a quantitative assessment of when a body part is identified as "self". We measured the threshold and sensitivity (d') for detecting a delay between movements of the finger (of both the dominant and non-dominant hands) and visual feedback as seen from four visual perspectives (the natural view, and mirror-reversed and/or inverted views). Each trial consisted of one presentation with minimum delay and another with a delay of between 33 and 150 ms. Participants indicated which presentation contained the delayed view. We varied the amount of efference copy available for this task by comparing performances for discrete movements and continuous movements. Discrete movements are associated with a stronger efference copy. Sensitivity to detect asynchrony between visual and proprioceptive information was significantly higher when movements were viewed from a "plausible" self perspective compared with when the view was reversed or inverted. Further, we found differences in performance between dominant and non-dominant hand finger movements across the continuous and single movements. Performance varied with the viewpoint from which the visual feedback was presented and on the efferent component such that optimal performance was obtained when the presentation was in the normal natural orientation and clear efferent information was available. Variations in sensitivity to visual/non-visual temporal incongruence with the viewpoint in which a movement is seen may help determine the arrangement of the underlying visual representation of the body.

Analysis of User Interaction with a Brain-Computer Interface Based on Steady-State Visually Evoked Potentials: Case Study of a Game

PubMed Central

de Carvalho, Sarah Negreiros; Costa, Thiago Bulhões da Silva; Attux, Romis; Hornung, Heiko Horst; Arantes, Dalton Soares

2018-01-01

This paper presents a systematic analysis of a game controlled by a Brain-Computer Interface (BCI) based on Steady-State Visually Evoked Potentials (SSVEP). The objective is to understand BCI systems from the Human-Computer Interface (HCI) point of view, by observing how the users interact with the game and evaluating how the interface elements influence the system performance. The interactions of 30 volunteers with our computer game, named “Get Coins,” through a BCI based on SSVEP, have generated a database of brain signals and the corresponding responses to a questionnaire about various perceptual parameters, such as visual stimulation, acoustic feedback, background music, visual contrast, and visual fatigue. Each one of the volunteers played one match using the keyboard and four matches using the BCI, for comparison. In all matches using the BCI, the volunteers achieved the goals of the game. Eight of them achieved a perfect score in at least one of the four matches, showing the feasibility of the direct communication between the brain and the computer. Despite this successful experiment, adaptations and improvements should be implemented to make this innovative technology accessible to the end user. PMID:29849549

Trifocal Tensor-Based Adaptive Visual Trajectory Tracking Control of Mobile Robots.

PubMed

Chen, Jian; Jia, Bingxi; Zhang, Kaixiang

2017-11-01

In this paper, a trifocal tensor-based approach is proposed for the visual trajectory tracking task of a nonholonomic mobile robot equipped with a roughly installed monocular camera. The desired trajectory is expressed by a set of prerecorded images, and the robot is regulated to track the desired trajectory using visual feedback. Trifocal tensor is exploited to obtain the orientation and scaled position information used in the control system, and it works for general scenes owing to the generality of trifocal tensor. In the previous works, the start, current, and final images are required to share enough visual information to estimate the trifocal tensor. However, this requirement can be easily violated for perspective cameras with limited field of view. In this paper, key frame strategy is proposed to loosen this requirement, extending the workspace of the visual servo system. Considering the unknown depth and extrinsic parameters (installing position of the camera), an adaptive controller is developed based on Lyapunov methods. The proposed control strategy works for almost all practical circumstances, including both trajectory tracking and pose regulation tasks. Simulations are made based on the virtual experimentation platform (V-REP) to evaluate the effectiveness of the proposed approach.

Analysis of User Interaction with a Brain-Computer Interface Based on Steady-State Visually Evoked Potentials: Case Study of a Game.

PubMed

Leite, Harlei Miguel de Arruda; de Carvalho, Sarah Negreiros; Costa, Thiago Bulhões da Silva; Attux, Romis; Hornung, Heiko Horst; Arantes, Dalton Soares

2018-01-01

This paper presents a systematic analysis of a game controlled by a Brain-Computer Interface (BCI) based on Steady-State Visually Evoked Potentials (SSVEP). The objective is to understand BCI systems from the Human-Computer Interface (HCI) point of view, by observing how the users interact with the game and evaluating how the interface elements influence the system performance. The interactions of 30 volunteers with our computer game, named "Get Coins," through a BCI based on SSVEP, have generated a database of brain signals and the corresponding responses to a questionnaire about various perceptual parameters, such as visual stimulation, acoustic feedback, background music, visual contrast, and visual fatigue. Each one of the volunteers played one match using the keyboard and four matches using the BCI, for comparison. In all matches using the BCI, the volunteers achieved the goals of the game. Eight of them achieved a perfect score in at least one of the four matches, showing the feasibility of the direct communication between the brain and the computer. Despite this successful experiment, adaptations and improvements should be implemented to make this innovative technology accessible to the end user.

Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components

NASA Astrophysics Data System (ADS)

Müller-Putz, Gernot R.; Scherer, Reinhold; Brauneis, Christian; Pfurtscheller, Gert

2005-12-01

Brain-computer interfaces (BCIs) can be realized on the basis of steady-state evoked potentials (SSEPs). These types of brain signals resulting from repetitive stimulation have the same fundamental frequency as the stimulation but also include higher harmonics. This study investigated how the classification accuracy of a 4-class BCI system can be improved by incorporating visually evoked harmonic oscillations. The current study revealed that the use of three SSVEP harmonics yielded a significantly higher classification accuracy than was the case for one or two harmonics. During feedback experiments, the five subjects investigated reached a classification accuracy between 42.5% and 94.4%.

Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components.

PubMed

Müller-Putz, Gernot R; Scherer, Reinhold; Brauneis, Christian; Pfurtscheller, Gert

2005-12-01

Brain-computer interfaces (BCIs) can be realized on the basis of steady-state evoked potentials (SSEPs). These types of brain signals resulting from repetitive stimulation have the same fundamental frequency as the stimulation but also include higher harmonics. This study investigated how the classification accuracy of a 4-class BCI system can be improved by incorporating visually evoked harmonic oscillations. The current study revealed that the use of three SSVEP harmonics yielded a significantly higher classification accuracy than was the case for one or two harmonics. During feedback experiments, the five subjects investigated reached a classification accuracy between 42.5% and 94.4%.

Sensorimotor integration in human postural control

NASA Technical Reports Server (NTRS)

Peterka, R. J.

2002-01-01

It is generally accepted that human bipedal upright stance is achieved by feedback mechanisms that generate an appropriate corrective torque based on body-sway motion detected primarily by visual, vestibular, and proprioceptive sensory systems. Because orientation information from the various senses is not always available (eyes closed) or accurate (compliant support surface), the postural control system must somehow adjust to maintain stance in a wide variety of environmental conditions. This is the sensorimotor integration problem that we investigated by evoking anterior-posterior (AP) body sway using pseudorandom rotation of the visual surround and/or support surface (amplitudes 0.5-8 degrees ) in both normal subjects and subjects with severe bilateral vestibular loss (VL). AP rotation of body center-of-mass (COM) was measured in response to six conditions offering different combinations of available sensory information. Stimulus-response data were analyzed using spectral analysis to compute transfer functions and coherence functions over a frequency range from 0.017 to 2.23 Hz. Stimulus-response data were quite linear for any given condition and amplitude. However, overall behavior in normal subjects was nonlinear because gain decreased and phase functions sometimes changed with increasing stimulus amplitude. "Sensory channel reweighting" could account for this nonlinear behavior with subjects showing increasing reliance on vestibular cues as stimulus amplitudes increased. VL subjects could not perform this reweighting, and their stimulus-response behavior remained quite linear. Transfer function curve fits based on a simple feedback control model provided estimates of postural stiffness, damping, and feedback time delay. There were only small changes in these parameters with increasing visual stimulus amplitude. However, stiffness increased as much as 60% with increasing support surface amplitude. To maintain postural stability and avoid resonant behavior, an increase in stiffness should be accompanied by a corresponding increase in damping. Increased damping was achieved primarily by decreasing the apparent time delay of feedback control rather than by changing the damping coefficient (i.e., corrective torque related to body-sway velocity). In normal subjects, stiffness and damping were highly correlated with body mass and moment of inertia, with stiffness always about 1/3 larger than necessary to resist the destabilizing torque due to gravity. The stiffness parameter in some VL subjects was larger compared with normal subjects, suggesting that they may use increased stiffness to help compensate for their loss. Overall results show that the simple act of standing quietly depends on a remarkably complex sensorimotor control system.

Designing feedback to mitigate teen distracted driving: A social norms approach.

PubMed

Merrikhpour, Maryam; Donmez, Birsen

2017-07-01

The purpose of this research is to investigate teens' perceived social norms and whether providing normative information can reduce distracted driving behaviors among them. Parents are among the most important social referents for teens; they have significant influences on teens' driving behaviors, including distracted driving which significantly contributes to teens' crash risks. Social norms interventions have been successfully applied in various domains including driving; however, this approach is yet to be explored for mitigating driver distraction among teens. Forty teens completed a driving simulator experiment while performing a self-paced visual-manual secondary task in four between-subject conditions: a) social norms feedback that provided a report at the end of each drive on teens' distracted driving behavior, comparing their distraction engagement to their parent's, b) post-drive feedback that provided just the report on teens' distracted driving behavior without information on their parents, c) real-time feedback in the form of auditory warnings based on eyes of road-time, and d) no feedback as control. Questionnaires were administered to collect data on these teens' and their parents' self-reported engagement in driver distractions and the associated social norms. Social norms and real-time feedback conditions resulted in significantly smaller average off-road glance duration, rate of long (>2s) off-road glances, and standard deviation of lane position compared to no feedback. Further, social norms feedback decreased brake response time and percentage of time not looking at the road compared to no feedback. No major effect was observed for post-drive feedback. Questionnaire results suggest that teens appeared to overestimate parental norms, but no effect of feedback was found on their perceptions. Feedback systems that leverage social norms can help mitigate driver distraction among teens. Overall, both social norms and real-time feedback induced positive driving behaviors, with social norms feedback outperforming real-time feedback. Copyright © 2017 Elsevier Ltd. All rights reserved.

Effect of an auditory feedback substitution, tactilo-kinesthetic, or visual feedback on kinematics of pouring water from kettle into cup.

PubMed

Portnoy, Sigal; Halaby, Orli; Dekel-Chen, Dotan; Dierick, Frédéric

2015-11-01

Pouring hot water from a kettle into a cup may prove a hazardous task, especially for the elderly or the visually-impaired. Individuals with deteriorating eyesight may endanger their hands by performing this task with both hands, relaying on tactilo-kinesthetic feedback (TKF). Auditory feedback (AF) may allow them to perform the task singlehandedly, thereby reducing the risk for injury. However since relying on an AF is not intuitive and requires practice, we aimed to determine if AF supplied during the task of pouring water can be used naturally as visual feedback (VF) following practice. For this purpose, we quantified, in young healthy sighted subjects (n = 20), the performance and kinematics of pouring water in the presence of three isolated feedbacks: visual, tactilo-kinesthetic, or auditory. There were no significant differences between the weights of spilled water in the AF condition compared to the TKF condition in the first, fifth or thirteenth trials. The subjectively-reported difficulty levels of using the TKF and the AF were significantly reduced between the first and thirteenth trials for both TKF (p = 0.01) and AF (p = 0.001). Trunk rotation during the first trial using the TKF was significantly lower than the trunk rotation while using VF. Also, shoulder adduction during the first trial using the TKF was significantly higher than the shoulder adduction while using the VF. During the AF trials, the median travel distance of the tip of the kettle was significantly reduced in the first trials so that in the thirtieth trial it did not differ significantly from the median travel distance during the thirtieth trial using TKF and VF. The maximal velocity of the tip of the kettle was constant for each of the feedback conditions but was higher in 10 cm s(-1) using VF than TKF, which was higher in 10 cm s(-1) from using AF. The smoothness of movement of the TKF and AF conditions, expressed by the normalized jerk score (NJSM), was one and two orders of magnitude higher from the VF, respectively. The median NJSM then decreased significantly by the fifth trial. Monitoring in-house activity via motion capture and classification of movements, i.e. liquid pouring, can assist with daily activities via AF. As a built-in feature in a smart home, this task-specific AF may prevent burn injuries of the visually-impaired. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis.

PubMed

Schiefer, Matthew; Tan, Daniel; Sidek, Steven M; Tyler, Dustin J

2016-02-01

Tactile feedback is critical to grip and object manipulation. Its absence results in reliance on visual and auditory cues. Our objective was to assess the effect of sensory feedback on task performance in individuals with limb loss. Stimulation of the peripheral nerves using implanted cuff electrodes provided two subjects with sensory feedback with intensity proportional to forces on the thumb, index, and middle fingers of their prosthetic hand during object manipulation. Both subjects perceived the sensation on their phantom hand at locations corresponding to the locations of the forces on the prosthetic hand. A bend sensor measured prosthetic hand span. Hand span modulated the intensity of sensory feedback perceived on the thenar eminence for subject 1 and the middle finger for subject 2. We performed three functional tests with the blindfolded subjects. First, the subject tried to determine whether or not a wooden block had been placed in his prosthetic hand. Second, the subject had to locate and remove magnetic blocks from a metal table. Third, the subject performed the Southampton Hand Assessment Procedure (SHAP). We also measured the subject's sense of embodiment with a survey and his self-confidence. Blindfolded performance with sensory feedback was similar to sighted performance in the wooden block and magnetic block tasks. Performance on the SHAP, a measure of hand mechanical function and control, was similar with and without sensory feedback. An embodiment survey showed an improved sense of integration of the prosthesis in self body image with sensory feedback. Sensory feedback by peripheral nerve stimulation improved object discrimination and manipulation, embodiment, and confidence. With both forms of feedback, the blindfolded subjects tended toward results obtained with visual feedback.

Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons.

PubMed

Panzeri, S; Rolls, E T; Battaglia, F; Lavis, R

2001-11-01

The speed of processing in the visual cortical areas can be fast, with for example the latency of neuronal responses increasing by only approximately 10 ms per area in the ventral visual system sequence V1 to V2 to V4 to inferior temporal visual cortex. This has led to the suggestion that rapid visual processing can only be based on the feedforward connections between cortical areas. To test this idea, we investigated the dynamics of information retrieval in multiple layer networks using a four-stage feedforward network modelled with continuous dynamics with integrate-and-fire neurons, and associative synaptic connections between stages with a synaptic time constant of 10 ms. Through the implementation of continuous dynamics, we found latency differences in information retrieval of only 5 ms per layer when local excitation was absent and processing was purely feedforward. However, information latency differences increased significantly when non-associative local excitation was included. We also found that local recurrent excitation through associatively modified synapses can contribute significantly to processing in as little as 15 ms per layer, including the feedforward and local feedback processing. Moreover, and in contrast to purely feed-forward processing, the contribution of local recurrent feedback was useful and approximately this rapid even when retrieval was made difficult by noise. These findings suggest that cortical information processing can benefit from recurrent circuits when the allowed processing time per cortical area is at least 15 ms long.

Effects of Anisometropic Amblyopia on Visuomotor Behavior, Part 2: Visually Guided Reaching

PubMed Central

Niechwiej-Szwedo, Ewa; Goltz, Herbert C.; Chandrakumar, Manokaraananthan; Hirji, Zahra; Crawford, J. Douglas; Wong, Agnes M. F.

2016-01-01

Purpose The effects of impaired spatiotemporal vision in amblyopia on visuomotor skills have rarely been explored in detail. The goal of this study was to examine the influences of amblyopia on visually guided reaching. Methods Fourteen patients with anisometropic amblyopia and 14 control subjects were recruited. Participants executed reach-to-touch movements toward targets presented randomly 5° or 10° to the left or right of central fixation in three viewing conditions: binocular, monocular amblyopic eye, and monocular fellow eye viewing (left and right monocular viewing for control subjects). Visual feedback of the target was removed on 50% of the trials at the initiation of reaching. Results Reaching accuracy was comparable between patients and control subjects during all three viewing conditions. Patients’ reaching responses were slightly less precise during amblyopic eye viewing, but their precision was normal during binocular or fellow eye viewing. Reaching reaction time was not affected by amblyopia. The duration of the acceleration phase was longer in patients than in control subjects under all viewing conditions, whereas the duration of the deceleration phase was unaffected. Peak acceleration and peak velocity were also reduced in patients. Conclusions Amblyopia affects both the programming and the execution of visually guided reaching. The increased duration of the acceleration phase, as well as the reduced peak acceleration and peak velocity, might reflect a strategy or adaptation of feedforward/feedback control of the visuomotor system to compensate for degraded spatiotemporal vision in amblyopia, allowing patients to optimize their reaching performance. PMID:21051723

Target recognition and scene interpretation in image/video understanding systems based on network-symbolic models

NASA Astrophysics Data System (ADS)

Kuvich, Gary

2004-08-01

Vision is only a part of a system that converts visual information into knowledge structures. These structures drive the vision process, resolving ambiguity and uncertainty via feedback, and provide image understanding, which is an interpretation of visual information in terms of these knowledge models. These mechanisms provide a reliable recognition if the object is occluded or cannot be recognized as a whole. It is hard to split the entire system apart, and reliable solutions to the target recognition problems are possible only within the solution of a more generic Image Understanding Problem. Brain reduces informational and computational complexities, using implicit symbolic coding of features, hierarchical compression, and selective processing of visual information. Biologically inspired Network-Symbolic representation, where both systematic structural/logical methods and neural/statistical methods are parts of a single mechanism, is the most feasible for such models. It converts visual information into relational Network-Symbolic structures, avoiding artificial precise computations of 3-dimensional models. Network-Symbolic Transformations derive abstract structures, which allows for invariant recognition of an object as exemplar of a class. Active vision helps creating consistent models. Attention, separation of figure from ground and perceptual grouping are special kinds of network-symbolic transformations. Such Image/Video Understanding Systems will be reliably recognizing targets.

Visualizing Without Vision at the Microscale: Students With Visual Impairments Explore Cells With Touch

NASA Astrophysics Data System (ADS)

Jones, M. Gail; Minogue, James; Oppewal, Tom; Cook, Michelle P.; Broadwell, Bethany

2006-12-01

Science instruction is typically highly dependent on visual representations of scientific concepts that are communicated through textbooks, teacher presentations, and computer-based multimedia materials. Little is known about how students with visual impairments access and interpret these types of visually-dependent instructional materials. This study explored the efficacy of new haptic (simulated tactile feedback and kinesthetics) instructional technology for teaching cell morphology and function to middle and high school students with visual impairments. The study examined students' prior experiences learning about the cell and cell functions in classroom instruction, as well as how haptic feedback technology impacted students' awareness of the 3-D nature of an animal cell, the morphology and function of cell organelles, and students' interest in the haptic technology as an instructional tool. Twenty-one students with visual impairment participated in the study. Students explored a tactile model of the cell with a haptic point probe that allowed them to feel the cell and its organelles. Results showed that students made significant gains in their ability to identify cell organelles and found the technology to be highly interesting as an instructional tool. The need for additional adaptive technology for students with visual impairments is discussed.

Design considerations for parallel graphics libraries

NASA Technical Reports Server (NTRS)

Crockett, Thomas W.

1994-01-01

Applications which run on parallel supercomputers are often characterized by massive datasets. Converting these vast collections of numbers to visual form has proven to be a powerful aid to comprehension. For a variety of reasons, it may be desirable to provide this visual feedback at runtime. One way to accomplish this is to exploit the available parallelism to perform graphics operations in place. In order to do this, we need appropriate parallel rendering algorithms and library interfaces. This paper provides a tutorial introduction to some of the issues which arise in designing parallel graphics libraries and their underlying rendering algorithms. The focus is on polygon rendering for distributed memory message-passing systems. We illustrate our discussion with examples from PGL, a parallel graphics library which has been developed on the Intel family of parallel systems.

A Feedback Model of Attention Explains the Diverse Effects of Attention on Neural Firing Rates and Receptive Field Structure.

PubMed

Miconi, Thomas; VanRullen, Rufin

2016-02-01

Visual attention has many effects on neural responses, producing complex changes in firing rates, as well as modifying the structure and size of receptive fields, both in topological and feature space. Several existing models of attention suggest that these effects arise from selective modulation of neural inputs. However, anatomical and physiological observations suggest that attentional modulation targets higher levels of the visual system (such as V4 or MT) rather than input areas (such as V1). Here we propose a simple mechanism that explains how a top-down attentional modulation, falling on higher visual areas, can produce the observed effects of attention on neural responses. Our model requires only the existence of modulatory feedback connections between areas, and short-range lateral inhibition within each area. Feedback connections redistribute the top-down modulation to lower areas, which in turn alters the inputs of other higher-area cells, including those that did not receive the initial modulation. This produces firing rate modulations and receptive field shifts. Simultaneously, short-range lateral inhibition between neighboring cells produce competitive effects that are automatically scaled to receptive field size in any given area. Our model reproduces the observed attentional effects on response rates (response gain, input gain, biased competition automatically scaled to receptive field size) and receptive field structure (shifts and resizing of receptive fields both spatially and in complex feature space), without modifying model parameters. Our model also makes the novel prediction that attentional effects on response curves should shift from response gain to contrast gain as the spatial focus of attention drifts away from the studied cell.

DESIGN AND CONSTRUCTION OF A FORCE-REFLECTING TELEOPERATION SYSTEM

DOE Office of Scientific and Technical Information (OSTI.GOV)

M.A. Ebadian, Ph.D.

1999-01-01

For certain applications, such as space servicing, undersea operations, and hazardous material handling tasks in nuclear reactors, the environments can be uncertain, complex, and hazardous. Lives may be in danger if humans were to work under these conditions. As a result, a man-machine system--a teleoperator system--has been developed to work in these types of environments. In a typical teleoperator system, the actual system operates at a remote site; the operator located away from this system usually receives visual information from a video image and/or graphical animation on the computer screen. Additional feedback, such as aural and force information, can significantlymore » enhance performance of the system. Force reflection is a type of feedback in which forces experienced by the remote manipulator are fed back to the manual controller. Various control methods have been proposed for implementation on a teleoperator system. In order to examine different control schemes, a one Degree-Of-Freedom (DOF) Force-Reflecting Manual Controller (FRMC) is constructed and integrated into a PC. The system parameters are identified and constructed as a mathematical model. The Proportional-Integral-Derivative (PID) and fuzzy logic controllers are developed and tested experimentally. Numerical simulation results obtained from the mathematical model are compared with those of experimental data for both types of controllers. In addition, the concept of a telesensation system is introduced. A telesensation system is an advanced teleoperator system that attempts to provide the operator with sensory feedback. In this context, a telesensation system integrates the use of a Virtual Reality (VR) unit, FRMC, and Graphical User Interface (GUI). The VR unit is used to provide the operator with a 3-D visual effect. Various commercial VR units are reviewed and features compared for use in a telesensation system. As for the FRMC, the conceptual design of a 3-DOF FRMC is developed in an effort to make the system portable, compact, and lightweight. A variety of design alternatives are presented and evaluated. Finally, a GUI software package is developed to interface with several teleoperation unit components. These components include an industrial robot, electric motor, encoder, force/torque sensor, and CCD camera. The software includes features such as position scaling, force scaling, and rereferencing and is intended to provide a sound basis for the development of a multi-DOF FRMC system in the future.« less