Using visuo-kinetic virtual reality to induce illusory spinal movement: the MoOVi Illusion.

PubMed

Harvie, Daniel S; Smith, Ross T; Hunter, Estin V; Davis, Miles G; Sterling, Michele; Moseley, G Lorimer

2017-01-01

Illusions that alter perception of the body provide novel opportunities to target brain-based contributions to problems such as persistent pain. One example of this, mirror therapy, uses vision to augment perceived movement of a painful limb to treat pain. Since mirrors can't be used to induce augmented neck or other spinal movement, we aimed to test whether such an illusion could be achieved using virtual reality, in advance of testing its potential therapeutic benefit. We hypothesised that perceived head rotation would depend on visually suggested movement. In a within-subjects repeated measures experiment, 24 healthy volunteers performed neck movements to 50 o of rotation, while a virtual reality system delivered corresponding visual feedback that was offset by a factor of 50%-200%-the Motor Offset Visual Illusion (MoOVi)-thus simulating more or less movement than that actually occurring. At 50 o of real-world head rotation, participants pointed in the direction that they perceived they were facing. The discrepancy between actual and perceived direction was measured and compared between conditions. The impact of including multisensory (auditory and visual) feedback, the presence of a virtual body reference, and the use of 360 o immersive virtual reality with and without three-dimensional properties, was also investigated. Perception of head movement was dependent on visual-kinaesthetic feedback ( p  = 0.001, partial eta squared = 0.17). That is, altered visual feedback caused a kinaesthetic drift in the direction of the visually suggested movement. The magnitude of the drift was not moderated by secondary variables such as the addition of illusory auditory feedback, the presence of a virtual body reference, or three-dimensionality of the scene. Virtual reality can be used to augment perceived movement and body position, such that one can perform a small movement, yet perceive a large one. The MoOVi technique tested here has clear potential for assessment and therapy of people with spinal pain.

Real-time vision, tactile cues, and visual form agnosia: removing haptic feedback from a “natural” grasping task induces pantomime-like grasps

PubMed Central

Whitwell, Robert L.; Ganel, Tzvi; Byrne, Caitlin M.; Goodale, Melvyn A.

2015-01-01

Investigators study the kinematics of grasping movements (prehension) under a variety of conditions to probe visuomotor function in normal and brain-damaged individuals. “Natural” prehensile acts are directed at the goal object and are executed using real-time vision. Typically, they also entail the use of tactile, proprioceptive, and kinesthetic sources of haptic feedback about the object (“haptics-based object information”) once contact with the object has been made. Natural and simulated (pantomimed) forms of prehension are thought to recruit different cortical structures: patient DF, who has visual form agnosia following bilateral damage to her temporal-occipital cortex, loses her ability to scale her grasp aperture to the size of targets (“grip scaling”) when her prehensile movements are based on a memory of a target previewed 2 s before the cue to respond or when her grasps are directed towards a visible virtual target but she is denied haptics-based information about the target. In the first of two experiments, we show that when DF performs real-time pantomimed grasps towards a 7.5 cm displaced imagined copy of a visible object such that her fingers make contact with the surface of the table, her grip scaling is in fact quite normal. This finding suggests that real-time vision and terminal tactile feedback are sufficient to preserve DF’s grip scaling slopes. In the second experiment, we examined an “unnatural” grasping task variant in which a tangible target (along with any proxy such as the surface of the table) is denied (i.e., no terminal tactile feedback). To do this, we used a mirror-apparatus to present virtual targets with and without a spatially coincident copy for the participants to grasp. We compared the grasp kinematics from trials with and without terminal tactile feedback to a real-time-pantomimed grasping task (one without tactile feedback) in which participants visualized a copy of the visible target as instructed in our laboratory in the past. Compared to natural grasps, removing tactile feedback increased RT, slowed the velocity of the reach, reduced in-flight grip aperture, increased the slopes relating grip aperture to target width, and reduced the final grip aperture (FGA). All of these effects were also observed in the real time-pantomime grasping task. These effects seem to be independent of those that arise from using the mirror in general as we also compared grasps directed towards virtual targets to those directed at real ones viewed directly through a pane of glass. These comparisons showed that the grasps directed at virtual targets increased grip aperture, slowed the velocity of the reach, and reduced the slopes relating grip aperture to the widths of the target. Thus, using the mirror has real consequences on grasp kinematics, reflecting the importance of task-relevant sources of online visual information for the programming and updating of natural prehensile movements. Taken together, these results provide compelling support for the view that removing terminal tactile feedback, even when the grasps are target-directed, induces a switch from real-time visual control towards one that depends more on visual perception and cognitive supervision. Providing terminal tactile feedback and real-time visual information can evidently keep the dorsal visuomotor system operating normally for prehensile acts. PMID:25999834

Real-time vision, tactile cues, and visual form agnosia: removing haptic feedback from a "natural" grasping task induces pantomime-like grasps.

PubMed

Whitwell, Robert L; Ganel, Tzvi; Byrne, Caitlin M; Goodale, Melvyn A

2015-01-01

Investigators study the kinematics of grasping movements (prehension) under a variety of conditions to probe visuomotor function in normal and brain-damaged individuals. "Natural" prehensile acts are directed at the goal object and are executed using real-time vision. Typically, they also entail the use of tactile, proprioceptive, and kinesthetic sources of haptic feedback about the object ("haptics-based object information") once contact with the object has been made. Natural and simulated (pantomimed) forms of prehension are thought to recruit different cortical structures: patient DF, who has visual form agnosia following bilateral damage to her temporal-occipital cortex, loses her ability to scale her grasp aperture to the size of targets ("grip scaling") when her prehensile movements are based on a memory of a target previewed 2 s before the cue to respond or when her grasps are directed towards a visible virtual target but she is denied haptics-based information about the target. In the first of two experiments, we show that when DF performs real-time pantomimed grasps towards a 7.5 cm displaced imagined copy of a visible object such that her fingers make contact with the surface of the table, her grip scaling is in fact quite normal. This finding suggests that real-time vision and terminal tactile feedback are sufficient to preserve DF's grip scaling slopes. In the second experiment, we examined an "unnatural" grasping task variant in which a tangible target (along with any proxy such as the surface of the table) is denied (i.e., no terminal tactile feedback). To do this, we used a mirror-apparatus to present virtual targets with and without a spatially coincident copy for the participants to grasp. We compared the grasp kinematics from trials with and without terminal tactile feedback to a real-time-pantomimed grasping task (one without tactile feedback) in which participants visualized a copy of the visible target as instructed in our laboratory in the past. Compared to natural grasps, removing tactile feedback increased RT, slowed the velocity of the reach, reduced in-flight grip aperture, increased the slopes relating grip aperture to target width, and reduced the final grip aperture (FGA). All of these effects were also observed in the real time-pantomime grasping task. These effects seem to be independent of those that arise from using the mirror in general as we also compared grasps directed towards virtual targets to those directed at real ones viewed directly through a pane of glass. These comparisons showed that the grasps directed at virtual targets increased grip aperture, slowed the velocity of the reach, and reduced the slopes relating grip aperture to the widths of the target. Thus, using the mirror has real consequences on grasp kinematics, reflecting the importance of task-relevant sources of online visual information for the programming and updating of natural prehensile movements. Taken together, these results provide compelling support for the view that removing terminal tactile feedback, even when the grasps are target-directed, induces a switch from real-time visual control towards one that depends more on visual perception and cognitive supervision. Providing terminal tactile feedback and real-time visual information can evidently keep the dorsal visuomotor system operating normally for prehensile acts.

Adaptation effects in static postural control by providing simultaneous visual feedback of center of pressure and center of gravity.

PubMed

Takeda, Kenta; Mani, Hiroki; Hasegawa, Naoya; Sato, Yuki; Tanaka, Shintaro; Maejima, Hiroshi; Asaka, Tadayoshi

2017-07-19

The benefit of visual feedback of the center of pressure (COP) on quiet standing is still debatable. This study aimed to investigate the adaptation effects of visual feedback training using both the COP and center of gravity (COG) during quiet standing. Thirty-four healthy young adults were divided into three groups randomly (COP + COG, COP, and control groups). A force plate was used to calculate the coordinates of the COP in the anteroposterior (COP AP ) and mediolateral (COP ML ) directions. A motion analysis system was used to calculate the coordinates of the center of mass (COM) in both directions (COM AP and COM ML ). The coordinates of the COG in the AP direction (COG AP ) were obtained from the force plate signals. Augmented visual feedback was presented on a screen in the form of fluctuation circles in the vertical direction that moved upward as the COP AP and/or COG AP moved forward and vice versa. The COP + COG group received the real-time COP AP and COG AP feedback simultaneously, whereas the COP group received the real-time COP AP feedback only. The control group received no visual feedback. In the training session, the COP + COG group was required to maintain an even distance between the COP AP and COG AP and reduce the COG AP fluctuation, whereas the COP group was required to reduce the COP AP fluctuation while standing on a foam pad. In test sessions, participants were instructed to keep their standing posture as quiet as possible on the foam pad before (pre-session) and after (post-session) the training sessions. In the post-session, the velocity and root mean square of COM AP in the COP + COG group were lower than those in the control group. In addition, the absolute value of the sum of the COP - COM distances in the COP + COG group was lower than that in the COP group. Furthermore, positive correlations were found between the COM AP velocity and COP - COM parameters. The results suggest that the novel visual feedback training that incorporates the COP AP -COG AP interaction reduces postural sway better than the training using the COP AP alone during quiet standing. That is, even COP AP fluctuation around the COG AP would be effective in reducing the COM AP velocity.

The effects of aging on the asymmetry of inter-limb transfer in a visuomotor task.

PubMed

Pan, Zhujun; Van Gemmert, Arend W A

2013-09-01

The direction of the asymmetry of inter-limb transfer has been suggested to identify the specialization of each hemisphere when performing a motor task. In an earlier study, we showed that trajectory information is only transferred from the right to the left hand, while final movement outcome-associated parameters transferred in both directions when right-hand-dominant individuals perform a motor task with visual distorted feedback. In the current study, we try to replicate this finding in young adults and test whether the asymmetry of inter-limb transfer in visuomotor task reduces in older adults, suggesting that hemispheric lateralization reduces with age. Young and older adults (all right-hand-dominant) performed a multidirectional point-to-point drawing task in which the visual feedback was rotated and the gain was increased. Half of the participants in each age group trained with the right hand and the other half trained with the left hand. Performances of both hands with non-distorted and distorted visual feedback were collected from all participants before and after the training session. The results showed that the pattern of inter-limb transfer was similar between young and older adults, i.e., inter-limb transfer is asymmetric for initial direction and symmetric for movement time and trajectory length. The results suggest that older adults retain the specialized functions of the non-dominant (right) hemisphere allowing them to program movement direction of a graphic aiming task when visual feedback is distorted.

Visual feedback-related changes in ipsilateral cortical excitability during unimanual movement: Implications for mirror therapy.

PubMed

Reissig, Paola; Garry, Michael I; Summers, Jeffery J; Hinder, Mark R

2014-01-01

Provision of a mirror image of a hand undertaking a motor task (i.e., mirror therapy) elicits behavioural improvements in the inactive hand. A greater understanding of the neural mechanisms underpinning this phenomenon is required to maximise its potential for rehabilitation across the lifespan, e.g., following hemiparesis or unilateral weakness. Young and older participants performed unilateral finger abductions with no visual feedback, with feedback of the active or passive hands, or with a mirror image of the active hand. Transcranial magnetic stimulation was used to assess feedback-related changes in two neurophysiological measures thought to be involved in inter-manual transfer of skill, namely corticospinal excitability (CSE) and intracortical inhibition (SICI) in the passive hemisphere. Task performance led to CSE increases, accompanied by decreases of SICI, in all visual feedback conditions relative to rest. However, the changes due to mirror feedback were not significantly different to those observed in the other (more standard) visual conditions. Accordingly, the unimanual motor action itself, rather than modifications in visual feedback, appears more instrumental in driving changes in CSE and SICI. Therefore, changes in CSE and SICI are unlikely to underpin the behavioural benefits of mirror therapy. We discuss implications for rehabilitation and directions of future research.

Visual feedback in stuttering therapy

NASA Astrophysics Data System (ADS)

Smolka, Elzbieta

1997-02-01

The aim of this paper is to present the results concerning the influence of visual echo and reverberation on the speech process of stutterers. Visual stimuli along with the influence of acoustic and visual-acoustic stimuli have been compared. Following this the methods of implementing visual feedback with the aid of electroluminescent diodes directed by speech signals have been presented. The concept of a computerized visual echo based on the acoustic recognition of Polish syllabic vowels has been also presented. All the research nd trials carried out at our center, aside from cognitive aims, generally aim at the development of new speech correctors to be utilized in stuttering therapy.

Neural mechanisms of limb position estimation in the primate brain.

PubMed

Shi, Ying; Buneo, Christopher A

2011-01-01

Understanding the neural mechanisms of limb position estimation is important both for comprehending the neural control of goal directed arm movements and for developing neuroprosthetic systems designed to replace lost limb function. Here we examined the role of area 5 of the posterior parietal cortex in estimating limb position based on visual and somatic (proprioceptive, efference copy) signals. Single unit recordings were obtained as monkeys reached to visual targets presented in a semi-immersive virtual reality environment. On half of the trials animals were required to maintain their limb position at these targets while receiving both visual and non-visual feedback of their arm position, while on the other trials visual feedback was withheld. When examined individually, many area 5 neurons were tuned to the position of the limb in the workspace but very few neurons modulated their firing rates based on the presence/absence of visual feedback. At the population level however decoding of limb position was somewhat more accurate when visual feedback was provided. These findings support a role for area 5 in limb position estimation but also suggest that visual signals regarding limb position are only weakly represented in this area, and only at the population level.

Eye movements in interception with delayed visual feedback.

PubMed

Cámara, Clara; de la Malla, Cristina; López-Moliner, Joan; Brenner, Eli

2018-07-01

The increased reliance on electronic devices such as smartphones in our everyday life exposes us to various delays between our actions and their consequences. Whereas it is known that people can adapt to such delays, the mechanisms underlying such adaptation remain unclear. To better understand these mechanisms, the current study explored the role of eye movements in interception with delayed visual feedback. In two experiments, eye movements were recorded as participants tried to intercept a moving target with their unseen finger while receiving delayed visual feedback about their own movement. In Experiment 1, the target randomly moved in one of two different directions at one of two different velocities. The delay between the participant's finger movement and movement of the cursor that provided feedback about the finger movements was gradually increased. Despite the delay, participants followed the target with their gaze. They were quite successful at hitting the target with the cursor. Thus, they moved their finger to a position that was ahead of where they were looking. Removing the feedback showed that participants had adapted to the delay. In Experiment 2, the target always moved in the same direction and at the same velocity, while the cursor's delay varied across trials. Participants still always directed their gaze at the target. They adjusted their movement to the delay on each trial, often succeeding to intercept the target with the cursor. Since their gaze was always directed at the target, and they could not know the delay until the cursor started moving, participants must have been using peripheral vision of the delayed cursor to guide it to the target. Thus, people deal with delays by directing their gaze at the target and using both experience from previous trials (Experiment 1) and peripheral visual information (Experiment 2) to guide their finger in a way that will make the cursor hit the target.

Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex

PubMed Central

van Kerkoerle, Timo; Self, Matthew W.; Dagnino, Bruno; Gariel-Mathis, Marie-Alice; Poort, Jasper; van der Togt, Chris; Roelfsema, Pieter R.

2014-01-01

Cognitive functions rely on the coordinated activity of neurons in many brain regions, but the interactions between cortical areas are not yet well understood. Here we investigated whether low-frequency (α) and high-frequency (γ) oscillations characterize different directions of information flow in monkey visual cortex. We recorded from all layers of the primary visual cortex (V1) and found that γ-waves are initiated in input layer 4 and propagate to the deep and superficial layers of cortex, whereas α-waves propagate in the opposite direction. Simultaneous recordings from V1 and downstream area V4 confirmed that γ- and α-waves propagate in the feedforward and feedback direction, respectively. Microstimulation in V1 elicited γ-oscillations in V4, whereas microstimulation in V4 elicited α-oscillations in V1, thus providing causal evidence for the opposite propagation of these rhythms. Furthermore, blocking NMDA receptors, thought to be involved in feedback processing, suppressed α while boosting γ. These results provide new insights into the relation between brain rhythms and cognition. PMID:25205811

Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex.

PubMed

van Kerkoerle, Timo; Self, Matthew W; Dagnino, Bruno; Gariel-Mathis, Marie-Alice; Poort, Jasper; van der Togt, Chris; Roelfsema, Pieter R

2014-10-07

Cognitive functions rely on the coordinated activity of neurons in many brain regions, but the interactions between cortical areas are not yet well understood. Here we investigated whether low-frequency (α) and high-frequency (γ) oscillations characterize different directions of information flow in monkey visual cortex. We recorded from all layers of the primary visual cortex (V1) and found that γ-waves are initiated in input layer 4 and propagate to the deep and superficial layers of cortex, whereas α-waves propagate in the opposite direction. Simultaneous recordings from V1 and downstream area V4 confirmed that γ- and α-waves propagate in the feedforward and feedback direction, respectively. Microstimulation in V1 elicited γ-oscillations in V4, whereas microstimulation in V4 elicited α-oscillations in V1, thus providing causal evidence for the opposite propagation of these rhythms. Furthermore, blocking NMDA receptors, thought to be involved in feedback processing, suppressed α while boosting γ. These results provide new insights into the relation between brain rhythms and cognition.

Curriculum-Based Measurement Performance Indicators: A Tool for Undergraduate Calculus Students to Inform and Direct Their Learning Behavior

ERIC Educational Resources Information Center

Sturges, Linda W.

2010-01-01

The present study investigated the extent to which providing students with individualized performance feedback informed and directed their learning behavior. Individualized performance feedback was delivered to students using curriculum-based measurement progress indicators, either as a visual representation of ongoing performance in the form of a…

Learning feedback and feedforward control in a mirror-reversed visual environment.

PubMed

Kasuga, Shoko; Telgen, Sebastian; Ushiba, Junichi; Nozaki, Daichi; Diedrichsen, Jörn

2015-10-01

When we learn a novel task, the motor system needs to acquire both feedforward and feedback control. Currently, little is known about how the learning of these two mechanisms relate to each other. In the present study, we tested whether feedforward and feedback control need to be learned separately, or whether they are learned as common mechanism when a new control policy is acquired. Participants were trained to reach to two lateral and one central target in an environment with mirror (left-right)-reversed visual feedback. One group was allowed to make online movement corrections, whereas the other group only received visual information after the end of the movement. Learning of feedforward control was assessed by measuring the accuracy of the initial movement direction to lateral targets. Feedback control was measured in the responses to sudden visual perturbations of the cursor when reaching to the central target. Although feedforward control improved in both groups, it was significantly better when online corrections were not allowed. In contrast, feedback control only adaptively changed in participants who received online feedback and remained unchanged in the group without online corrections. Our findings suggest that when a new control policy is acquired, feedforward and feedback control are learned separately, and that there may be a trade-off in learning between feedback and feedforward controllers. Copyright © 2015 the American Physiological Society.

Learning feedback and feedforward control in a mirror-reversed visual environment

PubMed Central

Kasuga, Shoko; Telgen, Sebastian; Ushiba, Junichi; Nozaki, Daichi

2015-01-01

When we learn a novel task, the motor system needs to acquire both feedforward and feedback control. Currently, little is known about how the learning of these two mechanisms relate to each other. In the present study, we tested whether feedforward and feedback control need to be learned separately, or whether they are learned as common mechanism when a new control policy is acquired. Participants were trained to reach to two lateral and one central target in an environment with mirror (left-right)-reversed visual feedback. One group was allowed to make online movement corrections, whereas the other group only received visual information after the end of the movement. Learning of feedforward control was assessed by measuring the accuracy of the initial movement direction to lateral targets. Feedback control was measured in the responses to sudden visual perturbations of the cursor when reaching to the central target. Although feedforward control improved in both groups, it was significantly better when online corrections were not allowed. In contrast, feedback control only adaptively changed in participants who received online feedback and remained unchanged in the group without online corrections. Our findings suggest that when a new control policy is acquired, feedforward and feedback control are learned separately, and that there may be a trade-off in learning between feedback and feedforward controllers. PMID:26245313

Visual force feedback in laparoscopic training.

PubMed

Horeman, Tim; Rodrigues, Sharon P; van den Dobbelsteen, John J; Jansen, Frank-Willem; Dankelman, Jenny

2012-01-01

To improve endoscopic surgical skills, an increasing number of surgical residents practice on box or virtual reality (VR) trainers. Current training is focused mainly on hand-eye coordination. Training methods that focus on applying the right amount of force are not yet available. The aim of this project is to develop a low-cost training system that measures the interaction force between tissue and instruments and displays a visual representation of the applied forces inside the camera image. This visual representation continuously informs the subject about the magnitude and the direction of applied forces. To show the potential of the developed training system, a pilot study was conducted in which six novices performed a needle-driving task in a box trainer with visual feedback of the force, and six novices performed the same task without visual feedback of the force. All subjects performed the training task five times and were subsequently tested in a post-test without visual feedback. The subjects who received visual feedback during training exerted on average 1.3 N (STD 0.6 N) to drive the needle through the tissue during the post-test. This value was considerably higher for the group that received no feedback (2.6 N, STD 0.9 N). The maximum interaction force during the post-test was noticeably lower for the feedback group (4.1 N, STD 1.1 N) compared with that of the control group (8.0 N, STD 3.3 N). The force-sensing training system provides us with the unique possibility to objectively assess tissue-handling skills in a laboratory setting. The real-time visualization of applied forces during training may facilitate acquisition of tissue-handling skills in complex laparoscopic tasks and could stimulate proficiency gain curves of trainees. However, larger randomized trials that also include other tasks are necessary to determine whether training with visual feedback about forces reduces the interaction force during laparoscopic surgery.

The persistence of a visual dominance effect in a telemanipulator task: A comparison between visual and electrotactile feedback

NASA Technical Reports Server (NTRS)

Gaillard, J. P.

1981-01-01

The possibility to use an electrotactile stimulation in teleoperation and to observe the interpretation of such information as a feedback to the operator was investigated. It is proposed that visual feedback is more informative than an electrotactile one; and that complex electrotactile feedback slows down both the motor decision and motor response processes, is processed as an all or nothing signal, and bypasses the receptive structure and accesses directly in a working memory where information is sequentially processed and where memory is limited in treatment capacity. The electrotactile stimulation is used as an alerting signal. It is suggested that the visual dominance effect is the result of the advantage of both a transfer function and a sensory memory register where information is pretreated and memorized for a short time. It is found that dividing attention has an effect on the acquisition of the information but not on the subsequent decision processes.

Ultra-Rapid serial visual presentation reveals dynamics of feedforward and feedback processes in the ventral visual pathway.

PubMed

Mohsenzadeh, Yalda; Qin, Sheng; Cichy, Radoslaw M; Pantazis, Dimitrios

2018-06-21

Human visual recognition activates a dense network of overlapping feedforward and recurrent neuronal processes, making it hard to disentangle processing in the feedforward from the feedback direction. Here, we used ultra-rapid serial visual presentation to suppress sustained activity that blurs the boundaries of processing steps, enabling us to resolve two distinct stages of processing with MEG multivariate pattern classification. The first processing stage was the rapid activation cascade of the bottom-up sweep, which terminated early as visual stimuli were presented at progressively faster rates. The second stage was the emergence of categorical information with peak latency that shifted later in time with progressively faster stimulus presentations, indexing time-consuming recurrent processing. Using MEG-fMRI fusion with representational similarity, we localized recurrent signals in early visual cortex. Together, our findings segregated an initial bottom-up sweep from subsequent feedback processing, and revealed the neural signature of increased recurrent processing demands for challenging viewing conditions. © 2018, Mohsenzadeh et al.

Eye-Hand Coordination during Visuomotor Adaptation with Different Rotation Angles: Effects of Terminal Visual Feedback

PubMed Central

Rand, Miya K.; Rentsch, Sebastian

2016-01-01

This study examined adaptive changes of eye-hand coordination during a visuomotor rotation task under the use of terminal visual feedback. Young adults made reaching movements to targets on a digitizer while looking at targets on a monitor where the rotated feedback (a cursor) of hand movements appeared after each movement. Three rotation angles (30°, 75° and 150°) were examined in three groups in order to vary the task difficulty. The results showed that the 30° group gradually reduced direction errors of reaching with practice and adapted well to the visuomotor rotation. The 75° group made large direction errors of reaching, and the 150° group applied a 180° reversal shift from early practice. The 75°and 150° groups, however, overcompensated the respective rotations at the end of practice. Despite these group differences in adaptive changes of reaching, all groups gradually adapted gaze directions prior to reaching from the target area to the areas related to the final positions of reaching during the course of practice. The adaptive changes of both hand and eye movements in all groups mainly reflected adjustments of movement directions based on explicit knowledge of the applied rotation acquired through practice. Only the 30° group showed small implicit adaptation in both effectors. The results suggest that by adapting gaze directions from the target to the final position of reaching based on explicit knowledge of the visuomotor rotation, the oculomotor system supports the limb-motor system to make precise preplanned adjustments of reaching directions during learning of visuomotor rotation under terminal visual feedback. PMID:27812093

Effects of Visual Feedback and Memory on Unintentional Drifts in Performance During Finger Pressing Tasks

PubMed Central

Solnik, Stanislaw; Qiao, Mu; Latash, Mark L.

2017-01-01

This study tested two hypotheses on the nature of unintentional force drifts elicited by removing visual feedback during accurate force production tasks. The role of working memory (memory hypothesis) was explored in tasks with continuous force production, intermittent force production, and rest intervals over the same time interval. The assumption of unintentional drifts in referent coordinate for the fingertips was tested using manipulations of visual feedback: Young healthy subjects performed accurate steady-state force production tasks by pressing with the two index fingers on individual force sensors with visual feedback on the total force, sharing ratio, both, or none. Predictions based on the memory hypothesis have been falsified. In particular, we observed consistent force drifts to lower force values during continuous force production trials only. No force drift or drifts to higher forces were observed during intermittent force production trials and following rest intervals. The hypotheses based on the idea of drifts in referent finger coordinates have been confirmed. In particular, we observed superposition of two drift processes: A drift of total force to lower magnitudes and a drift of the sharing ratio to 50:50. When visual feedback on total force only was provided, the two finger forces showed drifts in opposite directions. We interpret the findings as evidence for the control of motor actions with changes in referent coordinates for participating effectors. Unintentional drifts in performance are viewed as natural relaxation processes in the involved systems; their typical time reflects stability in the direction of the drift. The magnitude of the drift was higher in the right (dominant) hand, which is consistent with the dynamic dominance hypothesis. PMID:28168396

Mobile in vivo camera robots provide sole visual feedback for abdominal exploration and cholecystectomy.

PubMed

Rentschler, M E; Dumpert, J; Platt, S R; Ahmed, S I; Farritor, S M; Oleynikov, D

2006-01-01

The use of small incisions in laparoscopy reduces patient trauma, but also limits the surgeon's ability to view and touch the surgical environment directly. These limitations generally restrict the application of laparoscopy to procedures less complex than those performed during open surgery. Although current robot-assisted laparoscopy improves the surgeon's ability to manipulate and visualize the target organs, the instruments and cameras remain fundamentally constrained by the entry incisions. This limits tool tip orientation and optimal camera placement. The current work focuses on developing a new miniature mobile in vivo adjustable-focus camera robot to provide sole visual feedback to surgeons during laparoscopic surgery. A miniature mobile camera robot was inserted through a trocar into the insufflated abdominal cavity of an anesthetized pig. The mobile robot allowed the surgeon to explore the abdominal cavity remotely and view trocar and tool insertion and placement without entry incision constraints. The surgeon then performed a cholecystectomy using the robot camera alone for visual feedback. This successful trial has demonstrated that miniature in vivo mobile robots can provide surgeons with sufficient visual feedback to perform common procedures while reducing patient trauma.

Visual feedback system to reduce errors while operating roof bolting machines

PubMed Central

Steiner, Lisa J.; Burgess-Limerick, Robin; Eiter, Brianna; Porter, William; Matty, Tim

2015-01-01

Problem Operators of roof bolting machines in underground coal mines do so in confined spaces and in very close proximity to the moving equipment. Errors in the operation of these machines can have serious consequences, and the design of the equipment interface has a critical role in reducing the probability of such errors. Methods An experiment was conducted to explore coding and directional compatibility on actual roof bolting equipment and to determine the feasibility of a visual feedback system to alert operators of critical movements and to also alert other workers in close proximity to the equipment to the pending movement of the machine. The quantitative results of the study confirmed the potential for both selection errors and direction errors to be made, particularly during training. Results Subjective data confirmed a potential benefit of providing visual feedback of the intended operations and movements of the equipment. Impact This research may influence the design of these and other similar control systems to provide evidence for the use of warning systems to improve operator situational awareness. PMID:23398703

Can You Hear That Peak? Utilization of Auditory and Visual Feedback at Peak Limb Velocity.

PubMed

Loria, Tristan; de Grosbois, John; Tremblay, Luc

2016-09-01

At rest, the central nervous system combines and integrates multisensory cues to yield an optimal percept. When engaging in action, the relative weighing of sensory modalities has been shown to be altered. Because the timing of peak velocity is the critical moment in some goal-directed movements (e.g., overarm throwing), the current study sought to test whether visual and auditory cues are optimally integrated at that specific kinematic marker when it is the critical part of the trajectory. Participants performed an upper-limb movement in which they were required to reach their peak limb velocity when the right index finger intersected a virtual target (i.e., a flinging movement). Brief auditory, visual, or audiovisual feedback (i.e., 20 ms in duration) was provided to participants at peak limb velocity. Performance was assessed primarily through the resultant position of peak limb velocity and the variability of that position. Relative to when no feedback was provided, auditory feedback significantly reduced the resultant endpoint variability of the finger position at peak limb velocity. However, no such reductions were found for the visual or audiovisual feedback conditions. Further, providing both auditory and visual cues concurrently also failed to yield the theoretically predicted improvements in endpoint variability. Overall, the central nervous system can make significant use of an auditory cue but may not optimally integrate a visual and auditory cue at peak limb velocity, when peak velocity is the critical part of the trajectory.

Unsteady steady-states: Central causes of unintentional force drift

PubMed Central

Ambike, Satyajit; Mattos, Daniela; Zatsiorsky, Vladimir M.; Latash, Mark L.

2016-01-01

We applied the theory of synergies to analyze the processes that lead to unintentional decline in isometric fingertip force when visual feedback of the produced force is removed. We tracked the changes in hypothetical control variables involved in single fingertip force production based on the equilibrium-point hypothesis, namely, the fingertip referent coordinate (RFT) and its apparent stiffness (CFT). The system's state is defined by a point in the {RFT; CFT} space. We tested the hypothesis that, after visual feedback removal, this point (1) moves along directions leading to drop in the output fingertip force, and (2) has even greater motion along directions that leaves the force unchanged. Subjects produced a prescribed fingertip force using visual feedback, and attempted to maintain this force for 15 s after the feedback was removed. We used the “inverse piano” apparatus to apply small and smooth positional perturbations to fingers at various times after visual feedback removal. The time courses of RFT and CFT showed that force drop was mostly due to a drift in RFT towards the actual fingertip position. Three analysis techniques, namely, hyperbolic regression, surrogate data analysis, and computation of motor-equivalent and non-motor-equivalent motions, suggested strong co-variation in RFT and CFT stabilizing the force magnitude. Finally, the changes in the two hypothetical control variables {RFT; CFT} relative to their average trends also displayed covariation. On the whole the findings suggest that unintentional force drop is associated with (a) a slow drift of the referent coordinate that pulls the system towards a low-energy state, and (b) a faster synergic motion of RFT and CFT that tends to stabilize the output fingertip force about the slowly-drifting equilibrium point. PMID:27540726

Unsteady steady-states: central causes of unintentional force drift.

PubMed

Ambike, Satyajit; Mattos, Daniela; Zatsiorsky, Vladimir M; Latash, Mark L

2016-12-01

We applied the theory of synergies to analyze the processes that lead to unintentional decline in isometric fingertip force when visual feedback of the produced force is removed. We tracked the changes in hypothetical control variables involved in single fingertip force production based on the equilibrium-point hypothesis, namely the fingertip referent coordinate (R FT ) and its apparent stiffness (C FT ). The system's state is defined by a point in the {R FT ; C FT } space. We tested the hypothesis that, after visual feedback removal, this point (1) moves along directions leading to drop in the output fingertip force, and (2) has even greater motion along directions that leaves the force unchanged. Subjects produced a prescribed fingertip force using visual feedback and attempted to maintain this force for 15 s after the feedback was removed. We used the "inverse piano" apparatus to apply small and smooth positional perturbations to fingers at various times after visual feedback removal. The time courses of R FT and C FT showed that force drop was mostly due to a drift in R FT toward the actual fingertip position. Three analysis techniques, namely hyperbolic regression, surrogate data analysis, and computation of motor-equivalent and non-motor-equivalent motions, suggested strong covariation in R FT and C FT stabilizing the force magnitude. Finally, the changes in the two hypothetical control variables {R FT ; C FT } relative to their average trends also displayed covariation. On the whole, the findings suggest that unintentional force drop is associated with (a) a slow drift of the referent coordinate that pulls the system toward a low-energy state and (b) a faster synergic motion of R FT and C FT that tends to stabilize the output fingertip force about the slowly drifting equilibrium point.

Alterations in Neural Control of Constant Isometric Contraction with the Size of Error Feedback

PubMed Central

Hwang, Ing-Shiou; Lin, Yen-Ting; Huang, Wei-Min; Yang, Zong-Ru; Hu, Chia-Ling; Chen, Yi-Ching

2017-01-01

Discharge patterns from a population of motor units (MUs) were estimated with multi-channel surface electromyogram and signal processing techniques to investigate parametric differences in low-frequency force fluctuations, MU discharges, and force-discharge relation during static force-tracking with varying sizes of execution error presented via visual feedback. Fourteen healthy adults produced isometric force at 10% of maximal voluntary contraction through index abduction under three visual conditions that scaled execution errors with different amplification factors. Error-augmentation feedback that used a high amplification factor (HAF) to potentiate visualized error size resulted in higher sample entropy, mean frequency, ratio of high-frequency components, and spectral dispersion of force fluctuations than those of error-reducing feedback using a low amplification factor (LAF). In the HAF condition, MUs with relatively high recruitment thresholds in the dorsal interosseous muscle exhibited a larger coefficient of variation for inter-spike intervals and a greater spectral peak of the pooled MU coherence at 13–35 Hz than did those in the LAF condition. Manipulation of the size of error feedback altered the force-discharge relation, which was characterized with non-linear approaches such as mutual information and cross sample entropy. The association of force fluctuations and global discharge trace decreased with increasing error amplification factor. Our findings provide direct neurophysiological evidence that favors motor training using error-augmentation feedback. Amplification of the visualized error size of visual feedback could enrich force gradation strategies during static force-tracking, pertaining to selective increases in the discharge variability of higher-threshold MUs that receive greater common oscillatory inputs in the β-band. PMID:28125658

The effects of spatially displaced visual feedback on remote manipulator performance

NASA Technical Reports Server (NTRS)

Smith, Randy L.; Stuart, Mark A.

1989-01-01

The effects of spatially displaced visual feedback on the operation of a camera viewed remote manipulation task are analyzed. A remote manipulation task is performed by operators exposed to the following different viewing conditions: direct view of the work site; normal camera view; reversed camera view; inverted/reversed camera view; and inverted camera view. The task completion performance times are statistically analyzed with a repeated measures analysis of variance, and a Newman-Keuls pairwise comparison test is administered to the data. The reversed camera view is ranked third out of four camera viewing conditions, while the normal viewing condition is found significantly slower than the direct viewing condition. It is shown that generalization to remote manipulation applications based upon the results of direct manipulation studies are quite useful, but they should be made cautiously.

The Impact of Different Visual Feedbacks in User Training on Motor Imagery Control in BCI.

PubMed

Zapała, Dariusz; Francuz, Piotr; Zapała, Ewelina; Kopiś, Natalia; Wierzgała, Piotr; Augustynowicz, Paweł; Majkowski, Andrzej; Kołodziej, Marcin

2018-03-01

The challenges of research into brain-computer interfaces (BCI) include significant individual differences in learning pace and in the effective operation of BCI devices. The use of neurofeedback training is a popular method of improving the effectiveness BCI operation. The purpose of the present study was to determine to what extent it is possible to improve the effectiveness of operation of sensorimotor rhythm-based brain-computer interfaces (SMR-BCI) by supplementing user training with elements modifying the characteristics of visual feedback. Four experimental groups had training designed to reinforce BCI control by: visual feedback in the form of dummy faces expressing emotions (Group 1); flashing the principal elements of visual feedback (Group 2) and giving both visual feedbacks in one condition (Group 3). The fourth group participated in training with no modifications (Group 4). Training consisted of a series of trials where the subjects directed a ball into a basket located to the right or left side of the screen. In Group 1 a schematic image a face, placed on the controlled object, showed various emotions, depending on the accuracy of control. In Group 2, the cue and targets were flashed with different frequency (4 Hz) than the remaining elements visible on the monitor. Both modifications were also used simultaneously in Group 3. SMR activity during the task was recorded before and after the training. In Group 3 there was a significant improvement in SMR control, compared to subjects in Group 2 and 4 (control). Differences between subjects in Groups 1, 2 and 4 (control) were insignificant. This means that relatively small changes in the training procedure may significantly impact the effectiveness of BCI control. Analysis of behavioural data acquired from all participants at training showed greater effectiveness in directing the object towards the right side of the screen. Subjects with the greatest improvement in SMR control showed a significantly lower difference in the accuracy of rightward and leftward movement than others.

Differential sensory cortical involvement in auditory and visual sensorimotor temporal recalibration: Evidence from transcranial direct current stimulation (tDCS).

PubMed

Aytemür, Ali; Almeida, Nathalia; Lee, Kwang-Hyuk

2017-02-01

Adaptation to delayed sensory feedback following an action produces a subjective time compression between the action and the feedback (temporal recalibration effect, TRE). TRE is important for sensory delay compensation to maintain a relationship between causally related events. It is unclear whether TRE is a sensory modality-specific phenomenon. In 3 experiments employing a sensorimotor synchronization task, we investigated this question using cathodal transcranial direct-current stimulation (tDCS). We found that cathodal tDCS over the visual cortex, and to a lesser extent over the auditory cortex, produced decreased visual TRE. However, both auditory and visual cortex tDCS did not produce any measurable effects on auditory TRE. Our study revealed different nature of TRE in auditory and visual domains. Visual-motor TRE, which is more variable than auditory TRE, is a sensory modality-specific phenomenon, modulated by the auditory cortex. The robustness of auditory-motor TRE, unaffected by tDCS, suggests the dominance of the auditory system in temporal processing, by providing a frame of reference in the realignment of sensorimotor timing signals. Copyright © 2017 Elsevier Ltd. All rights reserved.

Voluntarily controlled but not merely observed visual feedback affects postural sway

PubMed Central

Asai, Tomohisa; Hiromitsu, Kentaro; Imamizu, Hiroshi

2018-01-01

Online stabilization of human standing posture utilizes multisensory afferences (e.g., vision). Whereas visual feedback of spontaneous postural sway can stabilize postural control especially when observers concentrate on their body and intend to minimize postural sway, the effect of intentional control of visual feedback on postural sway itself remains unclear. This study assessed quiet standing posture in healthy adults voluntarily controlling or merely observing visual feedback. The visual feedback (moving square) had either low or high gain and was either horizontally flipped or not. Participants in the voluntary-control group were instructed to minimize their postural sway while voluntarily controlling visual feedback, whereas those in the observation group were instructed to minimize their postural sway while merely observing visual feedback. As a result, magnified and flipped visual feedback increased postural sway only in the voluntary-control group. Furthermore, regardless of the instructions and feedback manipulations, the experienced sense of control over visual feedback positively correlated with the magnitude of postural sway. We suggest that voluntarily controlled, but not merely observed, visual feedback is incorporated into the feedback control system for posture and begins to affect postural sway. PMID:29682421

Skill learning from kinesthetic feedback.

PubMed

Pinzon, David; Vega, Roberto; Sanchez, Yerly Paola; Zheng, Bin

2017-10-01

It is important for a surgeon to perform surgical tasks under appropriate guidance from visual and kinesthetic feedback. However, our knowledge on kinesthetic (muscle) memory and its role in learning motor skills remains elementary. To discover the effect of exclusive kinesthetic training on kinesthetic memory in both performance and learning. In Phase 1, a total of twenty participants duplicated five 2 dimensional movements of increasing complexity via passive kinesthetic guidance, without visual or auditory stimuli. Five participants were asked to repeat the task in the Phase 2 over a period of three weeks, for a total of nine sessions. Subjects accurately recalled movement direction using kinesthetic memory, but recalling movement length was less precise. Over the nine training sessions, error occurrence dropped after the sixth session. Muscle memory constructs the foundation for kinesthetic training. Knowledge gained helps surgeons learn skills from kinesthetic information in the condition where visual feedback is limited. Copyright © 2016 Elsevier Inc. All rights reserved.

Biophysical network modeling of the dLGN circuit: Effects of cortical feedback on spatial response properties of relay cells

PubMed Central

Martínez-Cañada, Pablo; Halnes, Geir; Fyhn, Marianne

2018-01-01

Despite half-a-century of research since the seminal work of Hubel and Wiesel, the role of the dorsal lateral geniculate nucleus (dLGN) in shaping the visual signals is not properly understood. Placed on route from retina to primary visual cortex in the early visual pathway, a striking feature of the dLGN circuit is that both the relay cells (RCs) and interneurons (INs) not only receive feedforward input from retinal ganglion cells, but also a prominent feedback from cells in layer 6 of visual cortex. This feedback has been proposed to affect synchronicity and other temporal properties of the RC firing. It has also been seen to affect spatial properties such as the center-surround antagonism of thalamic receptive fields, i.e., the suppression of the response to very large stimuli compared to smaller, more optimal stimuli. Here we explore the spatial effects of cortical feedback on the RC response by means of a a comprehensive network model with biophysically detailed, single-compartment and multicompartment neuron models of RCs, INs and a population of orientation-selective layer 6 simple cells, consisting of pyramidal cells (PY). We have considered two different arrangements of synaptic feedback from the ON and OFF zones in the visual cortex to the dLGN: phase-reversed (‘push-pull’) and phase-matched (‘push-push’), as well as different spatial extents of the corticothalamic projection pattern. Our simulation results support that a phase-reversed arrangement provides a more effective way for cortical feedback to provide the increased center-surround antagonism seen in experiments both for flashing spots and, even more prominently, for patch gratings. This implies that ON-center RCs receive direct excitation from OFF-dominated cortical cells and indirect inhibitory feedback from ON-dominated cortical cells. The increased center-surround antagonism in the model is accompanied by spatial focusing, i.e., the maximum RC response occurs for smaller stimuli when feedback is present. PMID:29377888

The Influence of Visual Feedback and Register Changes on Sign Language Production: A Kinematic Study with Deaf Signers

ERIC Educational Resources Information Center

Emmorey, Karen; Gertsberg, Nelly; Korpics, Franco; Wright, Charles E.

2009-01-01

Speakers monitor their speech output by listening to their own voice. However, signers do not look directly at their hands and cannot see their own face. We investigated the importance of a visual perceptual loop for sign language monitoring by examining whether changes in visual input alter sign production. Deaf signers produced American Sign…

The effects of spatially displaced visual feedback on remote manipulator performance

NASA Technical Reports Server (NTRS)

Smith, Randy L.; Stuart, Mark A.

1993-01-01

The results of this evaluation have important implications for the arrangement of remote manipulation worksites and the design of workstations for telerobot operations. This study clearly illustrates the deleterious effects that can accompany the performance of remote manipulator tasks when viewing conditions are less than optimal. Future evaluations should emphasize telerobot camera locations and the use of image/graphical enhancement techniques in an attempt to lessen the adverse effects of displaced visual feedback. An important finding in this evaluation is the extent to which results from previously performed direct manipulation studies can be generalized to remote manipulation studies. Even though the results obtained were very similar to those of the direct manipulation evaluations, there were differences as well. This evaluation has demonstrated that generalizations to remote manipulation applications based upon the results of direct manipulation studies are quite useful, but they should be made cautiously.

Binocular and Monocular Depth Cues in Online Feedback Control of 3-D Pointing Movement

PubMed Central

Hu, Bo; Knill, David C.

2012-01-01

Previous work has shown that humans continuously use visual feedback of the hand to control goal-directed movements online. In most studies, visual error signals were predominantly in the image plane and thus were available in an observer’s retinal image. We investigate how humans use visual feedback about finger depth provided by binocular and monocular depth cues to control pointing movements. When binocularly viewing a scene in which the hand movement was made in free space, subjects were about 60 ms slower in responding to perturbations in depth than in the image plane. When monocularly viewing a scene designed to maximize the available monocular cues to finger depth (motion, changing size and cast shadows), subjects showed no response to perturbations in depth. Thus, binocular cues from the finger are critical to effective online control of hand movements in depth. An optimal feedback controller that takes into account of the low peripheral stereoacuity and inherent ambiguity in cast shadows can explain the difference in response time in the binocular conditions and lack of response in monocular conditions. PMID:21724567

Is sensorimotor BCI performance influenced differently by mono, stereo, or 3-D auditory feedback?

PubMed

McCreadie, Karl A; Coyle, Damien H; Prasad, Girijesh

2014-05-01

Imagination of movement can be used as a control method for a brain-computer interface (BCI) allowing communication for the physically impaired. Visual feedback within such a closed loop system excludes those with visual problems and hence there is a need for alternative sensory feedback pathways. In the context of substituting the visual channel for the auditory channel, this study aims to add to the limited evidence that it is possible to substitute visual feedback for its auditory equivalent and assess the impact this has on BCI performance. Secondly, the study aims to determine for the first time if the type of auditory feedback method influences motor imagery performance significantly. Auditory feedback is presented using a stepped approach of single (mono), double (stereo), and multiple (vector base amplitude panning as an audio game) loudspeaker arrangements. Visual feedback involves a ball-basket paradigm and a spaceship game. Each session consists of either auditory or visual feedback only with runs of each type of feedback presentation method applied in each session. Results from seven subjects across five sessions of each feedback type (visual, auditory) (10 sessions in total) show that auditory feedback is a suitable substitute for the visual equivalent and that there are no statistical differences in the type of auditory feedback presented across five sessions.

Alpha-beta and gamma rhythms subserve feedback and feedforward influences among human visual cortical areas

PubMed Central

Michalareas, Georgios; Vezoli, Julien; van Pelt, Stan; Schoffelen, Jan-Mathijs; Kennedy, Henry; Fries, Pascal

2016-01-01

Primate visual cortex is hierarchically organized. Bottom-up and top-down influences are exerted through distinct frequency channels, as was recently revealed in macaques by correlating inter-areal influences with laminar anatomical projection patterns. Because this anatomical data cannot be obtained in human subjects, we selected seven homologous macaque and human visual areas, and correlated the macaque laminar projection patterns to human inter-areal directed influences as measured with magnetoencephalography. We show that influences along feedforward projections predominate in the gamma band, whereas influences along feedback projections predominate in the alpha-beta band. Rhythmic inter-areal influences constrain a functional hierarchy of the seven homologous human visual areas that is in close agreement with the respective macaque anatomical hierarchy. Rhythmic influences allow an extension of the hierarchy to 26 human visual areas including uniquely human brain areas. Hierarchical levels of ventral and dorsal stream visual areas are differentially affected by inter-areal influences in the alpha-beta band. PMID:26777277

Vibrotactile Feedback for Brain-Computer Interface Operation

PubMed Central

Cincotti, Febo; Kauhanen, Laura; Aloise, Fabio; Palomäki, Tapio; Caporusso, Nicholas; Jylänki, Pasi; Mattia, Donatella; Babiloni, Fabio; Vanacker, Gerolf; Nuttin, Marnix; Marciani, Maria Grazia; Millán, José del R.

2007-01-01

To be correctly mastered, brain-computer interfaces (BCIs) need an uninterrupted flow of feedback to the user. This feedback is usually delivered through the visual channel. Our aim was to explore the benefits of vibrotactile feedback during users' training and control of EEG-based BCI applications. A protocol for delivering vibrotactile feedback, including specific hardware and software arrangements, was specified. In three studies with 33 subjects (including 3 with spinal cord injury), we compared vibrotactile and visual feedback, addressing: (I) the feasibility of subjects' training to master their EEG rhythms using tactile feedback; (II) the compatibility of this form of feedback in presence of a visual distracter; (III) the performance in presence of a complex visual task on the same (visual) or different (tactile) sensory channel. The stimulation protocol we developed supports a general usage of the tactors; preliminary experimentations. All studies indicated that the vibrotactile channel can function as a valuable feedback modality with reliability comparable to the classical visual feedback. Advantages of using a vibrotactile feedback emerged when the visual channel was highly loaded by a complex task. In all experiments, vibrotactile feedback felt, after some training, more natural for both controls and SCI users. PMID:18354734

Feature-Specific Organization of Feedback Pathways in Mouse Visual Cortex.

PubMed

Huh, Carey Y L; Peach, John P; Bennett, Corbett; Vega, Roxana M; Hestrin, Shaul

2018-01-08

Higher and lower cortical areas in the visual hierarchy are reciprocally connected [1]. Although much is known about how feedforward pathways shape receptive field properties of visual neurons, relatively little is known about the role of feedback pathways in visual processing. Feedback pathways are thought to carry top-down signals, including information about context (e.g., figure-ground segmentation and surround suppression) [2-5], and feedback has been demonstrated to sharpen orientation tuning of neurons in the primary visual cortex (V1) [6, 7]. However, the response characteristics of feedback neurons themselves and how feedback shapes V1 neurons' tuning for other features, such as spatial frequency (SF), remain largely unknown. Here, using a retrograde virus, targeted electrophysiological recordings, and optogenetic manipulations, we show that putatively feedback neurons in layer 5 (hereafter "L5 feedback") in higher visual areas, AL (anterolateral area) and PM (posteromedial area), display distinct visual properties in awake head-fixed mice. AL L5 feedback neurons prefer significantly lower SF (mean: 0.04 cycles per degree [cpd]) compared to PM L5 feedback neurons (0.15 cpd). Importantly, silencing AL L5 feedback reduced visual responses of V1 neurons preferring low SF (mean change in firing rate: -8.0%), whereas silencing PM L5 feedback suppressed responses of high-SF-preferring V1 neurons (-20.4%). These findings suggest that feedback connections from higher visual areas convey distinctly tuned visual inputs to V1 that serve to boost V1 neurons' responses to SF. Such like-to-like functional organization may represent an important feature of feedback pathways in sensory systems and in the nervous system in general. Copyright © 2017 Elsevier Ltd. All rights reserved.

Eye-Hand Synergy and Intermittent Behaviors during Target-Directed Tracking with Visual and Non-visual Information

PubMed Central

Huang, Chien-Ting; Hwang, Ing-Shiou

2012-01-01

Visual feedback and non-visual information play different roles in tracking of an external target. This study explored the respective roles of the visual and non-visual information in eleven healthy volunteers who coupled the manual cursor to a rhythmically moving target of 0.5 Hz under three sensorimotor conditions: eye-alone tracking (EA), eye-hand tracking with visual feedback of manual outputs (EH tracking), and the same tracking without such feedback (EHM tracking). Tracking error, kinematic variables, and movement intermittency (saccade and speed pulse) were contrasted among tracking conditions. The results showed that EHM tracking exhibited larger pursuit gain, less tracking error, and less movement intermittency for the ocular plant than EA tracking. With the vision of manual cursor, EH tracking achieved superior tracking congruency of the ocular and manual effectors with smaller movement intermittency than EHM tracking, except that the rate precision of manual action was similar for both types of tracking. The present study demonstrated that visibility of manual consequences altered mutual relationships between movement intermittency and tracking error. The speed pulse metrics of manual output were linked to ocular tracking error, and saccade events were time-locked to the positional error of manual tracking during EH tracking. In conclusion, peripheral non-visual information is critical to smooth pursuit characteristics and rate control of rhythmic manual tracking. Visual information adds to eye-hand synchrony, underlying improved amplitude control and elaborate error interpretation during oculo-manual tracking. PMID:23236498

Lateral interactions in the outer retina

PubMed Central

Thoreson, Wallace B.; Mangel, Stuart C.

2012-01-01

Lateral interactions in the outer retina, particularly negative feedback from horizontal cells to cones and direct feed-forward input from horizontal cells to bipolar cells, play a number of important roles in early visual processing, such as generating center-surround receptive fields that enhance spatial discrimination. These circuits may also contribute to post-receptoral light adaptation and the generation of color opponency. In this review, we examine the contributions of horizontal cell feedback and feed-forward pathways to early visual processing. We begin by reviewing the properties of bipolar cell receptive fields, especially with respect to modulation of the bipolar receptive field surround by the ambient light level and to the contribution of horizontal cells to the surround. We then review evidence for and against three proposed mechanisms for negative feedback from horizontal cells to cones: 1) GABA release by horizontal cells, 2) ephaptic modulation of the cone pedicle membrane potential generated by currents flowing through hemigap junctions in horizontal cell dendrites, and 3) modulation of cone calcium currents (ICa) by changes in synaptic cleft proton levels. We also consider evidence for the presence of direct horizontal cell feed-forward input to bipolar cells and discuss a possible role for GABA at this synapse. We summarize proposed functions of horizontal cell feedback and feed-forward pathways. Finally, we examine the mechanisms and functions of two other forms of lateral interaction in the outer retina: negative feedback from horizontal cells to rods and positive feedback from horizontal cells to cones. PMID:22580106

Closed-loop control of grasping with a myoelectric hand prosthesis: which are the relevant feedback variables for force control?

PubMed

Ninu, Andrei; Dosen, Strahinja; Muceli, Silvia; Rattay, Frank; Dietl, Hans; Farina, Dario

2014-09-01

In closed-loop control of grasping by hand prostheses, the feedback information sent to the user is usually the actual controlled variable, i.e., the grasp force. Although this choice is intuitive and logical, the force production is only the last step in the process of grasping. Therefore, this study evaluated the performance in controlling grasp strength using a hand prosthesis operated through a complete grasping sequence while varying the feedback variables (e.g., closing velocity, grasping force), which were provided to the user visually or through vibrotactile stimulation. The experiments were conducted on 13 volunteers who controlled the Otto Bock Sensor Hand Speed prosthesis. Results showed that vibrotactile patterns were able to replace the visual feedback. Interestingly, the experiments demonstrated that direct force feedback was not essential for the control of grasping force. The subjects were indeed able to control the grip strength, predictively, by estimating the grasping force from the prosthesis velocity of closing. Therefore, grasping without explicit force feedback is not completely blind, contrary to what is usually assumed. In our study we analyzed grasping with a specific prosthetic device, but the outcomes are also applicable for other devices, with one or more degrees-of-freedom. The necessary condition is that the electromyography (EMG) signal directly and proportionally controls the velocity/grasp force of the hand, which is a common approach among EMG controlled prosthetic devices. The results provide important indications on the design of closed-loop EMG controlled prosthetic systems.

Effects of aging on pointing movements under restricted visual feedback conditions.

PubMed

Zhang, Liancun; Yang, Jiajia; Inai, Yoshinobu; Huang, Qiang; Wu, Jinglong

2015-04-01

The goal of this study was to investigate the effects of aging on pointing movements under restricted visual feedback of hand movement and target location. Fifteen young subjects and fifteen elderly subjects performed pointing movements under four restricted visual feedback conditions that included full visual feedback of hand movement and target location (FV), no visual feedback of hand movement and target location condition (NV), no visual feedback of hand movement (NM) and no visual feedback of target location (NT). This study suggested that Fitts' law applied for pointing movements of the elderly adults under different visual restriction conditions. Moreover, significant main effect of aging on movement times has been found in all four tasks. The peripheral and central changes may be the key factors for these different characteristics. Furthermore, no significant main effects of age on the mean accuracy rate under condition of restricted visual feedback were found. The present study suggested that the elderly subjects made a very similar use of the available sensory information as young subjects under restricted visual feedback conditions. In addition, during the pointing movement, information about the hand's movement was more useful than information about the target location for young and elderly subjects. Copyright © 2014 Elsevier B.V. All rights reserved.

Effects of Visual Feedback Distortion on Gait Adaptation: Comparison of Implicit Visual Distortion Versus Conscious Modulation on Retention of Motor Learning.

PubMed

Kim, Seung-Jae; Ogilvie, Mitchell; Shimabukuro, Nathan; Stewart, Trevor; Shin, Joon-Ho

2015-09-01

Visual feedback can be used during gait rehabilitation to improve the efficacy of training. We presented a paradigm called visual feedback distortion; the visual representation of step length was manipulated during treadmill walking. Our prior work demonstrated that an implicit distortion of visual feedback of step length entails an unintentional adaptive process in the subjects' spatial gait pattern. Here, we investigated whether the implicit visual feedback distortion, versus conscious correction, promotes efficient locomotor adaptation that relates to greater retention of a task. Thirteen healthy subjects were studied under two conditions: (1) we implicitly distorted the visual representation of their gait symmetry over 14 min, and (2) with help of visual feedback, subjects were told to walk on the treadmill with the intent of attaining the gait asymmetry observed during the first implicit trial. After adaptation, the visual feedback was removed while subjects continued walking normally. Over this 6-min period, retention of preserved asymmetric pattern was assessed. We found that there was a greater retention rate during the implicit distortion trial than that of the visually guided conscious modulation trial. This study highlights the important role of implicit learning in the context of gait rehabilitation by demonstrating that training with implicit visual feedback distortion may produce longer lasting effects. This suggests that using visual feedback distortion could improve the effectiveness of treadmill rehabilitation processes by influencing the retention of motor skills.

EEG Theta Dynamics within Frontal and Parietal Cortices for Error Processing during Reaching Movements in a Prism Adaptation Study Altering Visuo-Motor Predictive Planning

PubMed Central

Bonfiglio, Luca; Minichilli, Fabrizio; Cantore, Nicoletta; Carboncini, Maria Chiara; Piccotti, Emily; Rossi, Bruno

2016-01-01

Modulation of frontal midline theta (fmθ) is observed during error commission, but little is known about the role of theta oscillations in correcting motor behaviours. We investigate EEG activity of healthy partipants executing a reaching task under variable degrees of prism-induced visuo-motor distortion and visual occlusion of the initial arm trajectory. This task introduces directional errors of different magnitudes. The discrepancy between predicted and actual movement directions (i.e. the error), at the time when visual feedback (hand appearance) became available, elicits a signal that triggers on-line movement correction. Analysis were performed on 25 EEG channels. For each participant, the median value of the angular error of all reaching trials was used to partition the EEG epochs into high- and low-error conditions. We computed event-related spectral perturbations (ERSP) time-locked either to visual feedback or to the onset of movement correction. ERSP time-locked to the onset of visual feedback showed that fmθ increased in the high- but not in the low-error condition with an approximate time lag of 200 ms. Moreover, when single epochs were sorted by the degree of motor error, fmθ started to increase when a certain level of error was exceeded and, then, scaled with error magnitude. When ERSP were time-locked to the onset of movement correction, the fmθ increase anticipated this event with an approximate time lead of 50 ms. During successive trials, an error reduction was observed which was associated with indices of adaptations (i.e., aftereffects) suggesting the need to explore if theta oscillations may facilitate learning. To our knowledge this is the first study where the EEG signal recorded during reaching movements was time-locked to the onset of the error visual feedback. This allowed us to conclude that theta oscillations putatively generated by anterior cingulate cortex activation are implicated in error processing in semi-naturalistic motor behaviours. PMID:26963919

EEG Theta Dynamics within Frontal and Parietal Cortices for Error Processing during Reaching Movements in a Prism Adaptation Study Altering Visuo-Motor Predictive Planning.

PubMed

Arrighi, Pieranna; Bonfiglio, Luca; Minichilli, Fabrizio; Cantore, Nicoletta; Carboncini, Maria Chiara; Piccotti, Emily; Rossi, Bruno; Andre, Paolo

2016-01-01

Modulation of frontal midline theta (fmθ) is observed during error commission, but little is known about the role of theta oscillations in correcting motor behaviours. We investigate EEG activity of healthy partipants executing a reaching task under variable degrees of prism-induced visuo-motor distortion and visual occlusion of the initial arm trajectory. This task introduces directional errors of different magnitudes. The discrepancy between predicted and actual movement directions (i.e. the error), at the time when visual feedback (hand appearance) became available, elicits a signal that triggers on-line movement correction. Analysis were performed on 25 EEG channels. For each participant, the median value of the angular error of all reaching trials was used to partition the EEG epochs into high- and low-error conditions. We computed event-related spectral perturbations (ERSP) time-locked either to visual feedback or to the onset of movement correction. ERSP time-locked to the onset of visual feedback showed that fmθ increased in the high- but not in the low-error condition with an approximate time lag of 200 ms. Moreover, when single epochs were sorted by the degree of motor error, fmθ started to increase when a certain level of error was exceeded and, then, scaled with error magnitude. When ERSP were time-locked to the onset of movement correction, the fmθ increase anticipated this event with an approximate time lead of 50 ms. During successive trials, an error reduction was observed which was associated with indices of adaptations (i.e., aftereffects) suggesting the need to explore if theta oscillations may facilitate learning. To our knowledge this is the first study where the EEG signal recorded during reaching movements was time-locked to the onset of the error visual feedback. This allowed us to conclude that theta oscillations putatively generated by anterior cingulate cortex activation are implicated in error processing in semi-naturalistic motor behaviours.

Speed but not amplitude of visual feedback exacerbates force variability in older adults.

PubMed

Kim, Changki; Yacoubi, Basma; Christou, Evangelos A

2018-06-23

Magnification of visual feedback (VF) impairs force control in older adults. In this study, we aimed to determine whether the age-associated increase in force variability with magnification of visual feedback is a consequence of increased amplitude or speed of visual feedback. Seventeen young and 18 older adults performed a constant isometric force task with the index finger at 5% of MVC. We manipulated the vertical (force gain) and horizontal (time gain) aspect of the visual feedback so participants performed the task with the following VF conditions: (1) high amplitude-fast speed; (2) low amplitude-slow speed; (3) high amplitude-slow speed. Changing the visual feedback from low amplitude-slow speed to high amplitude-fast speed increased force variability in older adults but decreased it in young adults (P < 0.01). Changing the visual feedback from low amplitude-slow speed to high amplitude-slow speed did not alter force variability in older adults (P > 0.2), but decreased it in young adults (P < 0.01). Changing the visual feedback from high amplitude-slow speed to high amplitude-fast speed increased force variability in older adults (P < 0.01) but did not alter force variability in young adults (P > 0.2). In summary, increased force variability in older adults with magnification of visual feedback was evident only when the speed of visual feedback increased. Thus, we conclude that in older adults deficits in the rate of processing visual information and not deficits in the processing of more visual information impair force control.

Visual servoing in medical robotics: a survey. Part I: endoscopic and direct vision imaging - techniques and applications.

PubMed

Azizian, Mahdi; Khoshnam, Mahta; Najmaei, Nima; Patel, Rajni V

2014-09-01

Intra-operative imaging is widely used to provide visual feedback to a clinician when he/she performs a procedure. In visual servoing, surgical instruments and parts of tissue/body are tracked by processing the acquired images. This information is then used within a control loop to manoeuvre a robotic manipulator during a procedure. A comprehensive search of electronic databases was completed for the period 2000-2013 to provide a survey of the visual servoing applications in medical robotics. The focus is on medical applications where image-based tracking is used for closed-loop control of a robotic system. Detailed classification and comparative study of various contributions in visual servoing using endoscopic or direct visual images are presented and summarized in tables and diagrams. The main challenges in using visual servoing for medical robotic applications are identified and potential future directions are suggested. 'Supervised automation of medical robotics' is found to be a major trend in this field. Copyright © 2013 John Wiley & Sons, Ltd.

Visual display aid for orbital maneuvering - Design considerations

NASA Technical Reports Server (NTRS)

Grunwald, Arthur J.; Ellis, Stephen R.

1993-01-01

This paper describes the development of an interactive proximity operations planning system that allows on-site planning of fuel-efficient multiburn maneuvers in a potential multispacecraft environment. Although this display system most directly assists planning by providing visual feedback to aid visualization of the trajectories and constraints, its most significant features include: (1) the use of an 'inverse dynamics' algorithm that removes control nonlinearities facing the operator, and (2) a trajectory planning technique that separates, through a 'geometric spreadsheet', the normally coupled complex problems of planning orbital maneuvers and allows solution by an iterative sequence of simple independent actions. The visual feedback of trajectory shapes and operational constraints, provided by user-transparent and continuously active background computations, allows the operator to make fast, iterative design changes that rapidly converge to fuel-efficient solutions. The planning tool provides an example of operator-assisted optimization of nonlinear cost functions.

Effect of visual feedback on brain activation during motor tasks: an FMRI study.

PubMed

Noble, Jeremy W; Eng, Janice J; Boyd, Lara A

2013-07-01

This study examined the effect of visual feedback and force level on the neural mechanisms responsible for the performance of a motor task. We used a voxel-wise fMRI approach to determine the effect of visual feedback (with and without) during a grip force task at 35% and 70% of maximum voluntary contraction. Two areas (contralateral rostral premotor cortex and putamen) displayed an interaction between force and feedback conditions. When the main effect of feedback condition was analyzed, higher activation when visual feedback was available was found in 22 of the 24 active brain areas, while the two other regions (contralateral lingual gyrus and ipsilateral precuneus) showed greater levels of activity when no visual feedback was available. The results suggest that there is a potentially confounding influence of visual feedback on brain activation during a motor task, and for some regions, this is dependent on the level of force applied.

Behavioral and neural effects of congruency of visual feedback during short-term motor learning.

PubMed

Ossmy, Ori; Mukamel, Roy

2018-05-15

Visual feedback can facilitate or interfere with movement execution. Here, we describe behavioral and neural mechanisms by which the congruency of visual feedback during physical practice of a motor skill modulates subsequent performance gains. 18 healthy subjects learned to execute rapid sequences of right hand finger movements during fMRI scans either with or without visual feedback. Feedback consisted of a real-time, movement-based display of virtual hands that was either congruent (right virtual hand movement), or incongruent (left virtual hand movement yoked to the executing right hand). At the group level, right hand performance gains following training with congruent visual feedback were significantly higher relative to training without visual feedback. Conversely, performance gains following training with incongruent visual feedback were significantly lower. Interestingly, across individual subjects these opposite effects correlated. Activation in the Supplementary Motor Area (SMA) during training corresponded to individual differences in subsequent performance gains. Furthermore, functional coupling of SMA with visual cortices predicted individual differences in behavior. Our results demonstrate that some individuals are more sensitive than others to congruency of visual feedback during short-term motor learning and that neural activation in SMA correlates with such inter-individual differences. Copyright © 2017 Elsevier Inc. All rights reserved.

Individual differences in learning correlate with modulation of brain activity induced by transcranial direct current stimulation

PubMed Central

Falcone, Brian; Wada, Atsushi; Parasuraman, Raja

2018-01-01

Transcranial direct current stimulation (tDCS) has been shown to enhance cognitive performance on a variety of tasks. It is hypothesized that tDCS enhances performance by affecting task related cortical excitability changes in networks underlying or connected to the site of stimulation facilitating long term potentiation. However, many recent studies have called into question the reliability and efficacy of tDCS to induce modulatory changes in brain activity. In this study, our goal is to investigate the individual differences in tDCS induced modulatory effects on brain activity related to the degree of enhancement in performance, providing insight into this lack of reliability. In accomplishing this goal, we used functional magnetic resonance imaging (fMRI) concurrently with tDCS stimulation (1 mA, 30 minutes duration) using a visual search task simulating real world conditions. The experiment consisted of three fMRI sessions: pre-training (no performance feedback), training (performance feedback which included response accuracy and target location and either real tDCS or sham stimulation given), and post-training (no performance feedback). The right posterior parietal cortex was selected as the site of anodal tDCS based on its known role in visual search and spatial attention processing. Our results identified a region in the right precentral gyrus, known to be involved with visual spatial attention and orienting, that showed tDCS induced task related changes in cortical excitability that were associated with individual differences in improved performance. This same region showed greater activity during the training session for target feedback of incorrect (target-error feedback) over correct trials for the tDCS stim over sham group indicating greater attention to target features during training feedback when trials were incorrect. These results give important insight into the nature of neural excitability induced by tDCS as it relates to variability in individual differences in improved performance shedding some light the apparent lack of reliability found in tDCS research. PMID:29782510

Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System

PubMed Central

Abdul-Kreem, Luma Issa; Neumann, Heiko

2015-01-01

The visual cortex analyzes motion information along hierarchically arranged visual areas that interact through bidirectional interconnections. This work suggests a bio-inspired visual model focusing on the interactions of the cortical areas in which a new mechanism of feedforward and feedback processing are introduced. The model uses a neuromorphic vision sensor (silicon retina) that simulates the spike-generation functionality of the biological retina. Our model takes into account two main model visual areas, namely V1 and MT, with different feature selectivities. The initial motion is estimated in model area V1 using spatiotemporal filters to locally detect the direction of motion. Here, we adapt the filtering scheme originally suggested by Adelson and Bergen to make it consistent with the spike representation of the DVS. The responses of area V1 are weighted and pooled by area MT cells which are selective to different velocities, i.e. direction and speed. Such feature selectivity is here derived from compositions of activities in the spatio-temporal domain and integrating over larger space-time regions (receptive fields). In order to account for the bidirectional coupling of cortical areas we match properties of the feature selectivity in both areas for feedback processing. For such linkage we integrate the responses over different speeds along a particular preferred direction. Normalization of activities is carried out over the spatial as well as the feature domains to balance the activities of individual neurons in model areas V1 and MT. Our model was tested using different stimuli that moved in different directions. The results reveal that the error margin between the estimated motion and synthetic ground truth is decreased in area MT comparing with the initial estimation of area V1. In addition, the modulated V1 cell activations shows an enhancement of the initial motion estimation that is steered by feedback signals from MT cells. PMID:26554589

Effects of visual feedback-induced variability on motor learning of handrim wheelchair propulsion.

PubMed

Leving, Marika T; Vegter, Riemer J K; Hartog, Johanneke; Lamoth, Claudine J C; de Groot, Sonja; van der Woude, Lucas H V

2015-01-01

It has been suggested that a higher intra-individual variability benefits the motor learning of wheelchair propulsion. The present study evaluated whether feedback-induced variability on wheelchair propulsion technique variables would also enhance the motor learning process. Learning was operationalized as an improvement in mechanical efficiency and propulsion technique, which are thought to be closely related during the learning process. 17 Participants received visual feedback-based practice (feedback group) and 15 participants received regular practice (natural learning group). Both groups received equal practice dose of 80 min, over 3 weeks, at 0.24 W/kg at a treadmill speed of 1.11 m/s. To compare both groups the pre- and post-test were performed without feedback. The feedback group received real-time visual feedback on seven propulsion variables with instruction to manipulate the presented variable to achieve the highest possible variability (1st 4-min block) and optimize it in the prescribed direction (2nd 4-min block). To increase motor exploration the participants were unaware of the exact variable they received feedback on. Energy consumption and the propulsion technique variables with their respective coefficient of variation were calculated to evaluate the amount of intra-individual variability. The feedback group, which practiced with higher intra-individual variability, improved the propulsion technique between pre- and post-test to the same extent as the natural learning group. Mechanical efficiency improved between pre- and post-test in the natural learning group but remained unchanged in the feedback group. These results suggest that feedback-induced variability inhibited the improvement in mechanical efficiency. Moreover, since both groups improved propulsion technique but only the natural learning group improved mechanical efficiency, it can be concluded that the improvement in mechanical efficiency and propulsion technique do not always appear simultaneously during the motor learning process. Their relationship is most likely modified by other factors such as the amount of the intra-individual variability.

Effects of Visual Feedback-Induced Variability on Motor Learning of Handrim Wheelchair Propulsion

PubMed Central

Leving, Marika T.; Vegter, Riemer J. K.; Hartog, Johanneke; Lamoth, Claudine J. C.; de Groot, Sonja; van der Woude, Lucas H. V.

2015-01-01

Background It has been suggested that a higher intra-individual variability benefits the motor learning of wheelchair propulsion. The present study evaluated whether feedback-induced variability on wheelchair propulsion technique variables would also enhance the motor learning process. Learning was operationalized as an improvement in mechanical efficiency and propulsion technique, which are thought to be closely related during the learning process. Methods 17 Participants received visual feedback-based practice (feedback group) and 15 participants received regular practice (natural learning group). Both groups received equal practice dose of 80 min, over 3 weeks, at 0.24 W/kg at a treadmill speed of 1.11 m/s. To compare both groups the pre- and post-test were performed without feedback. The feedback group received real-time visual feedback on seven propulsion variables with instruction to manipulate the presented variable to achieve the highest possible variability (1st 4-min block) and optimize it in the prescribed direction (2nd 4-min block). To increase motor exploration the participants were unaware of the exact variable they received feedback on. Energy consumption and the propulsion technique variables with their respective coefficient of variation were calculated to evaluate the amount of intra-individual variability. Results The feedback group, which practiced with higher intra-individual variability, improved the propulsion technique between pre- and post-test to the same extent as the natural learning group. Mechanical efficiency improved between pre- and post-test in the natural learning group but remained unchanged in the feedback group. Conclusion These results suggest that feedback-induced variability inhibited the improvement in mechanical efficiency. Moreover, since both groups improved propulsion technique but only the natural learning group improved mechanical efficiency, it can be concluded that the improvement in mechanical efficiency and propulsion technique do not always appear simultaneously during the motor learning process. Their relationship is most likely modified by other factors such as the amount of the intra-individual variability. PMID:25992626

Firing-rate based network modeling of the dLGN circuit: Effects of cortical feedback on spatiotemporal response properties of relay cells.

PubMed

Mobarhan, Milad Hobbi; Halnes, Geir; Martínez-Cañada, Pablo; Hafting, Torkel; Fyhn, Marianne; Einevoll, Gaute T

2018-05-01

Visually evoked signals in the retina pass through the dorsal geniculate nucleus (dLGN) on the way to the visual cortex. This is however not a simple feedforward flow of information: there is a significant feedback from cortical cells back to both relay cells and interneurons in the dLGN. Despite four decades of experimental and theoretical studies, the functional role of this feedback is still debated. Here we use a firing-rate model, the extended difference-of-Gaussians (eDOG) model, to explore cortical feedback effects on visual responses of dLGN relay cells. For this model the responses are found by direct evaluation of two- or three-dimensional integrals allowing for fast and comprehensive studies of putative effects of different candidate organizations of the cortical feedback. Our analysis identifies a special mixed configuration of excitatory and inhibitory cortical feedback which seems to best account for available experimental data. This configuration consists of (i) a slow (long-delay) and spatially widespread inhibitory feedback, combined with (ii) a fast (short-delayed) and spatially narrow excitatory feedback, where (iii) the excitatory/inhibitory ON-ON connections are accompanied respectively by inhibitory/excitatory OFF-ON connections, i.e. following a phase-reversed arrangement. The recent development of optogenetic and pharmacogenetic methods has provided new tools for more precise manipulation and investigation of the thalamocortical circuit, in particular for mice. Such data will expectedly allow the eDOG model to be better constrained by data from specific animal model systems than has been possible until now for cat. We have therefore made the Python tool pyLGN which allows for easy adaptation of the eDOG model to new situations.

The role of vision in odor-plume tracking by walking and flying insects.

PubMed

Willis, Mark A; Avondet, Jennifer L; Zheng, Elizabeth

2011-12-15

The walking paths of male cockroaches, Periplaneta americana, tracking point-source plumes of female pheromone often appear similar in structure to those observed from flying male moths. Flying moths use visual-flow-field feedback of their movements to control steering and speed over the ground and to detect the wind speed and direction while tracking plumes of odors. Walking insects are also known to use flow field cues to steer their trajectories. Can the upwind steering we observe in plume-tracking walking male cockroaches be explained by visual-flow-field feedback, as in flying moths? To answer this question, we experimentally occluded the compound eyes and ocelli of virgin P. americana males, separately and in combination, and challenged them with different wind and odor environments in our laboratory wind tunnel. They were observed responding to: (1) still air and no odor, (2) wind and no odor, (3) a wind-borne point-source pheromone plume and (4) a wide pheromone plume in wind. If walking cockroaches require visual cues to control their steering with respect to their environment, we would expect their tracks to be less directed and more variable if they cannot see. Instead, we found few statistically significant differences among behaviors exhibited by intact control cockroaches or those with their eyes occluded, under any of our environmental conditions. Working towards our goal of a comprehensive understanding of chemo-orientation in insects, we then challenged flying and walking male moths to track pheromone plumes with and without visual feedback. Neither walking nor flying moths performed as well as walking cockroaches when there was no visual information available.

The role of vision in odor-plume tracking by walking and flying insects

PubMed Central

Willis, Mark A.; Avondet, Jennifer L.; Zheng, Elizabeth

2011-01-01

SUMMARY The walking paths of male cockroaches, Periplaneta americana, tracking point-source plumes of female pheromone often appear similar in structure to those observed from flying male moths. Flying moths use visual-flow-field feedback of their movements to control steering and speed over the ground and to detect the wind speed and direction while tracking plumes of odors. Walking insects are also known to use flow field cues to steer their trajectories. Can the upwind steering we observe in plume-tracking walking male cockroaches be explained by visual-flow-field feedback, as in flying moths? To answer this question, we experimentally occluded the compound eyes and ocelli of virgin P. americana males, separately and in combination, and challenged them with different wind and odor environments in our laboratory wind tunnel. They were observed responding to: (1) still air and no odor, (2) wind and no odor, (3) a wind-borne point-source pheromone plume and (4) a wide pheromone plume in wind. If walking cockroaches require visual cues to control their steering with respect to their environment, we would expect their tracks to be less directed and more variable if they cannot see. Instead, we found few statistically significant differences among behaviors exhibited by intact control cockroaches or those with their eyes occluded, under any of our environmental conditions. Working towards our goal of a comprehensive understanding of chemo-orientation in insects, we then challenged flying and walking male moths to track pheromone plumes with and without visual feedback. Neither walking nor flying moths performed as well as walking cockroaches when there was no visual information available. PMID:22116754

Proprioceptive loss and the perception, control and learning of arm movements in humans: evidence from sensory neuronopathy.

PubMed

Miall, R Chris; Kitchen, Nick M; Nam, Se-Ho; Lefumat, Hannah; Renault, Alix G; Ørstavik, Kristin; Cole, Jonathan D; Sarlegna, Fabrice R

2018-05-19

It is uncertain how vision and proprioception contribute to adaptation of voluntary arm movements. In normal participants, adaptation to imposed forces is possible with or without vision, suggesting that proprioception is sufficient; in participants with proprioceptive loss (PL), adaptation is possible with visual feedback, suggesting that proprioception is unnecessary. In experiment 1 adaptation to, and retention of, perturbing forces were evaluated in three chronically deafferented participants. They made rapid reaching movements to move a cursor toward a visual target, and a planar robot arm applied orthogonal velocity-dependent forces. Trial-by-trial error correction was observed in all participants. Such adaptation has been characterized with a dual-rate model: a fast process that learns quickly, but retains poorly and a slow process that learns slowly and retains well. Experiment 2 showed that the PL participants had large individual differences in learning and retention rates compared to normal controls. Experiment 3 tested participants' perception of applied forces. With visual feedback, the PL participants could report the perturbation's direction as well as controls; without visual feedback, thresholds were elevated. Experiment 4 showed, in healthy participants, that force direction could be estimated from head motion, at levels close to the no-vision threshold for the PL participants. Our results show that proprioceptive loss influences perception, motor control and adaptation but that proprioception from the moving limb is not essential for adaptation to, or detection of, force fields. The differences in learning and retention seen between the three deafferented participants suggest that they achieve these tasks in idiosyncratic ways after proprioceptive loss, possibly integrating visual and vestibular information with individual cognitive strategies.

The effect of multimodal and enriched feedback on SMR-BCI performance.

PubMed

Sollfrank, T; Ramsay, A; Perdikis, S; Williamson, J; Murray-Smith, R; Leeb, R; Millán, J D R; Kübler, A

2016-01-01

This study investigated the effect of multimodal (visual and auditory) continuous feedback with information about the uncertainty of the input signal on motor imagery based BCI performance. A liquid floating through a visualization of a funnel (funnel feedback) provided enriched visual or enriched multimodal feedback. In a between subject design 30 healthy SMR-BCI naive participants were provided with either conventional bar feedback (CB), or visual funnel feedback (UF), or multimodal (visual and auditory) funnel feedback (MF). Subjects were required to imagine left and right hand movement and were trained to control the SMR based BCI for five sessions on separate days. Feedback accuracy varied largely between participants. The MF feedback lead to a significantly better performance in session 1 as compared to the CB feedback and could significantly enhance motivation and minimize frustration in BCI use across the five training sessions. The present study demonstrates that the BCI funnel feedback allows participants to modulate sensorimotor EEG rhythms. Participants were able to control the BCI with the funnel feedback with better performance during the initial session and less frustration compared to the CB feedback. The multimodal funnel feedback provides an alternative to the conventional cursorbar feedback for training subjects to modulate their sensorimotor rhythms. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Walking Speed Influences the Effects of Implicit Visual Feedback Distortion on Modulation of Gait Symmetry

PubMed Central

Maestas, Gabrielle; Hu, Jiyao; Trevino, Jessica; Chunduru, Pranathi; Kim, Seung-Jae; Lee, Hyunglae

2018-01-01

The use of visual feedback in gait rehabilitation has been suggested to promote recovery of locomotor function by incorporating interactive visual components. Our prior work demonstrated that visual feedback distortion of changes in step length symmetry entails an implicit or unconscious adaptive process in the subjects’ spatial gait patterns. We investigated whether the effect of the implicit visual feedback distortion would persist at three different walking speeds (slow, self-preferred and fast speeds) and how different walking speeds would affect the amount of adaption. In the visual feedback distortion paradigm, visual vertical bars portraying subjects’ step lengths were distorted so that subjects perceived their step lengths to be asymmetric during testing. Measuring the adjustments in step length during the experiment showed that healthy subjects made spontaneous modulations away from actual symmetry in response to the implicit visual distortion, no matter the walking speed. In all walking scenarios, the effects of implicit distortion became more significant at higher distortion levels. In addition, the amount of adaptation induced by the visual distortion was significantly greater during walking at preferred or slow speed than at the fast speed. These findings indicate that although a link exists between supraspinal function through visual system and human locomotion, sensory feedback control for locomotion is speed-dependent. Ultimately, our results support the concept that implicit visual feedback can act as a dominant form of feedback in gait modulation, regardless of speed. PMID:29632481

On the nature of unintentional action: a study of force/moment drifts during multifinger tasks.

PubMed

Parsa, Behnoosh; O'Shea, Daniel J; Zatsiorsky, Vladimir M; Latash, Mark L

2016-08-01

We explored the origins of unintentional changes in performance during accurate force production in isometric conditions seen after turning visual feedback off. The idea of control with referent spatial coordinates suggests that these phenomena could result from drifts of the referent coordinate for the effector. Subjects performed accurate force/moment production tasks by pressing with the fingers of a hand on force sensors. Turning the visual feedback off resulted in slow drifts of both total force and total moment to lower magnitudes of these variables; these drifts were more pronounced in the right hand of the right-handed subjects. Drifts in individual finger forces could be in different direction; in particular, fingers that produced moments of force against the required total moment showed an increase in their forces. The force/moment drift was associated with a drop in the index of synergy stabilizing performance under visual feedback. The drifts in directions that changed performance (non-motor equivalent) and in directions that did not (motor equivalent) were of about the same magnitude. The results suggest that control with referent coordinates is associated with drifts of those referent coordinates toward the corresponding actual coordinates of the hand, a reflection of the natural tendency of physical systems to move toward a minimum of potential energy. The interaction between drifts of the hand referent coordinate and referent orientation leads to counterdirectional drifts in individual finger forces. The results also demonstrate that the sensory information used to create multifinger synergies is necessary for their presence over the task duration. Copyright © 2016 the American Physiological Society.

A Robot Hand Testbed Designed for Enhancing Embodiment and Functional Neurorehabilitation of Body Schema in Subjects with Upper Limb Impairment or Loss

PubMed Central

Hellman, Randall B.; Chang, Eric; Tanner, Justin; Helms Tillery, Stephen I.; Santos, Veronica J.

2015-01-01

Many upper limb amputees experience an incessant, post-amputation “phantom limb pain” and report that their missing limbs feel paralyzed in an uncomfortable posture. One hypothesis is that efferent commands no longer generate expected afferent signals, such as proprioceptive feedback from changes in limb configuration, and that the mismatch of motor commands and visual feedback is interpreted as pain. Non-invasive therapeutic techniques for treating phantom limb pain, such as mirror visual feedback (MVF), rely on visualizations of postural changes. Advances in neural interfaces for artificial sensory feedback now make it possible to combine MVF with a high-tech “rubber hand” illusion, in which subjects develop a sense of embodiment with a fake hand when subjected to congruent visual and somatosensory feedback. We discuss clinical benefits that could arise from the confluence of known concepts such as MVF and the rubber hand illusion, and new technologies such as neural interfaces for sensory feedback and highly sensorized robot hand testbeds, such as the “BairClaw” presented here. Our multi-articulating, anthropomorphic robot testbed can be used to study proprioceptive and tactile sensory stimuli during physical finger–object interactions. Conceived for artificial grasp, manipulation, and haptic exploration, the BairClaw could also be used for future studies on the neurorehabilitation of somatosensory disorders due to upper limb impairment or loss. A remote actuation system enables the modular control of tendon-driven hands. The artificial proprioception system enables direct measurement of joint angles and tendon tensions while temperature, vibration, and skin deformation are provided by a multimodal tactile sensor. The provision of multimodal sensory feedback that is spatiotemporally consistent with commanded actions could lead to benefits such as reduced phantom limb pain, and increased prosthesis use due to improved functionality and reduced cognitive burden. PMID:25745391

A robot hand testbed designed for enhancing embodiment and functional neurorehabilitation of body schema in subjects with upper limb impairment or loss.

PubMed

Hellman, Randall B; Chang, Eric; Tanner, Justin; Helms Tillery, Stephen I; Santos, Veronica J

2015-01-01

Many upper limb amputees experience an incessant, post-amputation "phantom limb pain" and report that their missing limbs feel paralyzed in an uncomfortable posture. One hypothesis is that efferent commands no longer generate expected afferent signals, such as proprioceptive feedback from changes in limb configuration, and that the mismatch of motor commands and visual feedback is interpreted as pain. Non-invasive therapeutic techniques for treating phantom limb pain, such as mirror visual feedback (MVF), rely on visualizations of postural changes. Advances in neural interfaces for artificial sensory feedback now make it possible to combine MVF with a high-tech "rubber hand" illusion, in which subjects develop a sense of embodiment with a fake hand when subjected to congruent visual and somatosensory feedback. We discuss clinical benefits that could arise from the confluence of known concepts such as MVF and the rubber hand illusion, and new technologies such as neural interfaces for sensory feedback and highly sensorized robot hand testbeds, such as the "BairClaw" presented here. Our multi-articulating, anthropomorphic robot testbed can be used to study proprioceptive and tactile sensory stimuli during physical finger-object interactions. Conceived for artificial grasp, manipulation, and haptic exploration, the BairClaw could also be used for future studies on the neurorehabilitation of somatosensory disorders due to upper limb impairment or loss. A remote actuation system enables the modular control of tendon-driven hands. The artificial proprioception system enables direct measurement of joint angles and tendon tensions while temperature, vibration, and skin deformation are provided by a multimodal tactile sensor. The provision of multimodal sensory feedback that is spatiotemporally consistent with commanded actions could lead to benefits such as reduced phantom limb pain, and increased prosthesis use due to improved functionality and reduced cognitive burden.

Delayed action does not always require the ventral stream: a study on a patient with visual form agnosia.

PubMed

Hesse, Constanze; Schenk, Thomas

2014-05-01

It has been suggested that while movements directed at visible targets are processed within the dorsal stream, movements executed after delay rely on the visual representations of the ventral stream (Milner & Goodale, 2006). This interpretation is supported by the observation that a patient with ventral stream damage (D.F.) has trouble performing accurate movements after a delay, but performs normally when the target is visible during movement programming. We tested D.F.'s visuomotor performance in a letter-posting task whilst varying the amount of visual feedback available. Additionally, we also varied whether D.F. received tactile feedback at the end of each trial (posting through a letter box vs posting on a screen) and whether environmental cues were available during the delay period (removing the target only vs suppressing vision completely with shutter glasses). We found that in the absence of environmental cues patient D.F. was unaffected by the introduction of delay and performed as accurately as healthy controls. However, when environmental cues and vision of the moving hand were available during and after the delay period, D.F.'s visuomotor performance was impaired. Thus, while healthy controls benefit from the availability of environmental landmarks and/or visual feedback of the moving hand, such cues seem less beneficial to D.F. Taken together our findings suggest that ventral stream damage does not always impact the ability to make delayed movements but compromises the ability to use environmental landmarks and visual feedback efficiently. Copyright © 2014 Elsevier Ltd. All rights reserved.

Does visual feedback during walking result in similar improvements in trunk control for young and older healthy adults?

PubMed

Anson, Eric; Rosenberg, Russell; Agada, Peter; Kiemel, Tim; Jeka, John

2013-11-26

Most current applications of visual feedback to improve postural control are limited to a fixed base of support and produce mixed results regarding improved postural control and transfer to functional tasks. Currently there are few options available to provide visual feedback regarding trunk motion while walking. We have developed a low cost platform to provide visual feedback of trunk motion during walking. Here we investigated whether augmented visual position feedback would reduce trunk movement variability in both young and older healthy adults. The subjects who participated were 10 young and 10 older adults. Subjects walked on a treadmill under conditions of visual position feedback and no feedback. The visual feedback consisted of anterior-posterior (AP) and medial-lateral (ML) position of the subject's trunk during treadmill walking. Fourier transforms of the AP and ML trunk kinematics were used to calculate power spectral densities which were integrated as frequency bins "below the gait cycle" and "gait cycle and above" for analysis purposes. Visual feedback reduced movement power at very low frequencies for lumbar and neck translation but not trunk angle in both age groups. At very low frequencies of body movement, older adults had equivalent levels of movement variability with feedback as young adults without feedback. Lower variability was specific to translational (not angular) trunk movement. Visual feedback did not affect any of the measured lower extremity gait pattern characteristics of either group, suggesting that changes were not invoked by a different gait pattern. Reduced translational variability while walking on the treadmill reflects more precise control maintaining a central position on the treadmill. Such feedback may provide an important technique to augment rehabilitation to minimize body translation while walking. Individuals with poor balance during walking may benefit from this type of training to enhance path consistency during over-ground locomotion.

Computerized visual feedback: an adjunct to robotic-assisted gait training.

PubMed

Banz, Raphael; Bolliger, Marc; Colombo, Gery; Dietz, Volker; Lünenburger, Lars

2008-10-01

Robotic devices for walking rehabilitation allow new possibilities for providing performance-related information to patients during gait training. Based on motor learning principles, augmented feedback during robotic-assisted gait training might improve the rehabilitation process used to regain walking function. This report presents a method to provide visual feedback implemented in a driven gait orthosis (DGO). The purpose of the study was to compare the immediate effect on motor output in subjects during robotic-assisted gait training when they used computerized visual feedback and when they followed verbal instructions of a physical therapist. Twelve people with neurological gait disorders due to incomplete spinal cord injury participated. Subjects were instructed to walk within the DGO in 2 different conditions. They were asked to increase their motor output by following the instructions of a therapist and by observing visual feedback. In addition, the subjects' opinions about using visual feedback were investigated by a questionnaire. Computerized visual feedback and verbal instructions by the therapist were observed to result in a similar change in motor output in subjects when walking within the DGO. Subjects reported that they were more motivated and concentrated on their movements when using computerized visual feedback compared with when no form of feedback was provided. Computerized visual feedback is a valuable adjunct to robotic-assisted gait training. It represents a relevant tool to increase patients' motor output, involvement, and motivation during gait training, similar to verbal instructions by a therapist.

The effect of contextual cues on the encoding of motor memories.

PubMed

Howard, Ian S; Wolpert, Daniel M; Franklin, David W

2013-05-01

Several studies have shown that sensory contextual cues can reduce the interference observed during learning of opposing force fields. However, because each study examined a small set of cues, often in a unique paradigm, the relative efficacy of different sensory contextual cues is unclear. In the present study we quantify how seven contextual cues, some investigated previously and some novel, affect the formation and recall of motor memories. Subjects made movements in a velocity-dependent curl field, with direction varying randomly from trial to trial but always associated with a unique contextual cue. Linking field direction to the cursor or background color, or to peripheral visual motion cues, did not reduce interference. In contrast, the orientation of a visual object attached to the hand cursor significantly reduced interference, albeit by a small amount. When the fields were associated with movement in different locations in the workspace, a substantial reduction in interference was observed. We tested whether this reduction in interference was due to the different locations of the visual feedback (targets and cursor) or the movements (proprioceptive). When the fields were associated only with changes in visual display location (movements always made centrally) or only with changes in the movement location (visual feedback always displayed centrally), a substantial reduction in interference was observed. These results show that although some visual cues can lead to the formation and recall of distinct representations in motor memory, changes in spatial visual and proprioceptive states of the movement are far more effective than changes in simple visual contextual cues.

Sensory feedback add-on for upper-limb prostheses.

PubMed

Fallahian, Nader; Saeedi, Hassan; Mokhtarinia, Hamidreza; Tabatabai Ghomshe, Farhad

2017-06-01

Sensory feedback systems have been of great interest in upper-limb prosthetics. Despite tremendous research, there are no commercial modality-matched feedback systems. This article aims to introduce the first detachable and feedback add-on option that can be attached to in-use prostheses. A sensory feedback system was tested on a below-elbow myoelectric prosthesis. The aim was to have the amputee grasp fragile objects without crushing while other accidental feedback sources were blocked. A total of 8 successful trials (out of 10) showed that sensory feedback system decreased the amputee's visual dependency by improving awareness of his prosthesis. Sensory feedback system can be used either as post-fabrication (prosthetic add-on option) or para-fabrication (incorporated into prosthetic design). The use of these direct feedback systems can be explored with a current prosthesis before ordering new high-tech prosthesis. Clinical relevance This technical note introduces the first attach/detach-able sensory feedback system that can simply be added to in-use (myo)electric prosthesis, with no obligation to change prosthesis design or components.

Real-time feedback on nonverbal clinical communication. Theoretical framework and clinician acceptance of ambient visual design.

PubMed

Hartzler, A L; Patel, R A; Czerwinski, M; Pratt, W; Roseway, A; Chandrasekaran, N; Back, A

2014-01-01

This article is part of the focus theme of Methods of Information in Medicine on "Pervasive Intelligent Technologies for Health". Effective nonverbal communication between patients and clinicians fosters both the delivery of empathic patient-centered care and positive patient outcomes. Although nonverbal skill training is a recognized need, few efforts to enhance patient-clinician communication provide visual feedback on nonverbal aspects of the clinical encounter. We describe a novel approach that uses social signal processing technology (SSP) to capture nonverbal cues in real time and to display ambient visual feedback on control and affiliation--two primary, yet distinct dimensions of interpersonal nonverbal communication. To examine the design and clinician acceptance of ambient visual feedback on nonverbal communication, we 1) formulated a model of relational communication to ground SSP and 2) conducted a formative user study using mixed methods to explore the design of visual feedback. Based on a model of relational communication, we reviewed interpersonal communication research to map nonverbal cues to signals of affiliation and control evidenced in patient-clinician interaction. Corresponding with our formulation of this theoretical framework, we designed ambient real-time visualizations that reflect variations of affiliation and control. To explore clinicians' acceptance of this visual feedback, we conducted a lab study using the Wizard-of-Oz technique to simulate system use with 16 healthcare professionals. We followed up with seven of those participants through interviews to iterate on the design with a revised visualization that addressed emergent design considerations. Ambient visual feedback on non- verbal communication provides a theoretically grounded and acceptable way to provide clinicians with awareness of their nonverbal communication style. We provide implications for the design of such visual feedback that encourages empathic patient-centered communication and include considerations of metaphor, color, size, position, and timing of feedback. Ambient visual feedback from SSP holds promise as an acceptable means for facilitating empathic patient-centered nonverbal communication.

Network interactions underlying mirror feedback in stroke: A dynamic causal modeling study.

PubMed

Saleh, Soha; Yarossi, Mathew; Manuweera, Thushini; Adamovich, Sergei; Tunik, Eugene

2017-01-01

Mirror visual feedback (MVF) is potentially a powerful tool to facilitate recovery of disordered movement and stimulate activation of under-active brain areas due to stroke. The neural mechanisms underlying MVF have therefore been a focus of recent inquiry. Although it is known that sensorimotor areas can be activated via mirror feedback, the network interactions driving this effect remain unknown. The aim of the current study was to fill this gap by using dynamic causal modeling to test the interactions between regions in the frontal and parietal lobes that may be important for modulating the activation of the ipsilesional motor cortex during mirror visual feedback of unaffected hand movement in stroke patients. Our intent was to distinguish between two theoretical neural mechanisms that might mediate ipsilateral activation in response to mirror-feedback: transfer of information between bilateral motor cortices versus recruitment of regions comprising an action observation network which in turn modulate the motor cortex. In an event-related fMRI design, fourteen chronic stroke subjects performed goal-directed finger flexion movements with their unaffected hand while observing real-time visual feedback of the corresponding (veridical) or opposite (mirror) hand in virtual reality. Among 30 plausible network models that were tested, the winning model revealed significant mirror feedback-based modulation of the ipsilesional motor cortex arising from the contralesional parietal cortex, in a region along the rostral extent of the intraparietal sulcus. No winning model was identified for the veridical feedback condition. We discuss our findings in the context of supporting the latter hypothesis, that mirror feedback-based activation of motor cortex may be attributed to engagement of a contralateral (contralesional) action observation network. These findings may have important implications for identifying putative cortical areas, which may be targeted with non-invasive brain stimulation as a means of potentiating the effects of mirror training.

The Effects of Self-Generated Synchronous and Asynchronous Visual Speech Feedback on Overt Stuttering Frequency

ERIC Educational Resources Information Center

Snyder, Gregory J.; Hough, Monica Strauss; Blanchet, Paul; Ivy, Lennette J.; Waddell, Dwight

2009-01-01

Purpose: Relatively recent research documents that visual choral speech, which represents an externally generated form of synchronous visual speech feedback, significantly enhanced fluency in those who stutter. As a consequence, it was hypothesized that self-generated synchronous and asynchronous visual speech feedback would likewise enhance…

Role of Visual Feedback Treatment for Defective /s/ Sounds in Patients with Cleft Palate.

ERIC Educational Resources Information Center

Michi, Ken-ichi; And Others

1993-01-01

Six patients with cleft palate were provided treatment using either visual feedback for tongue placement and frication or no visual feedback. Results indicated the feedback was especially useful in the treatment of defective /s/ sounds in the patients who exhibited abnormal posterior tongue posturing during dental or alveolar sounds. (Author/DB)

Stimulus-dependent modulation of visual neglect in a touch-screen cancellation task.

PubMed

Keller, Ingo; Volkening, Katharina; Garbacenkaite, Ruta

2015-05-01

Patients with left-sided neglect frequently show omissions and repetitive behavior on cancellation tests. Using a touch-screen-based cancellation task, we tested how visual feedback and distracters influence the number of omissions and perseverations. Eighteen patients with left-sided visual neglect and 18 healthy controls performed four different cancellation tasks on an iPad touch screen: no feedback (the display did not change during the task), visual feedback (touched targets changed their color from black to green), visual feedback with distracters (20 distracters were evenly embedded in the display; detected targets changed their color from black to green), vanishing targets (touched targets disappeared from the screen). Except for the condition with vanishing targets, neglect patients had significantly more omissions and perseverations than healthy controls in the remaining three subtests. Both conditions providing feedback by changing the target color showed the highest number of omissions. Erasure of targets nearly diminished omissions completely. The highest rate of perseverations was observed in the no-feedback condition. The implementation of distracters led to a moderate number of perseverations. Visual feedback without distracters and vanishing targets abolished perseverations nearly completely. Visual feedback and the presence of distracters aggravated hemispatial neglect. This finding is compatible with impaired disengagement from the ipsilesional side as an important factor of visual neglect. Improvement of cancellation behavior with vanishing targets could have therapeutic implications. (c) 2015 APA, all rights reserved).

Combined mirror visual and auditory feedback therapy for upper limb phantom pain: a case report

PubMed Central

2011-01-01

Introduction Phantom limb sensation and phantom limb pain is a very common issue after amputations. In recent years there has been accumulating data implicating 'mirror visual feedback' or 'mirror therapy' as helpful in the treatment of phantom limb sensation and phantom limb pain. Case presentation We present the case of a 24-year-old Caucasian man, a left upper limb amputee, treated with mirror visual feedback combined with auditory feedback with improved pain relief. Conclusion This case may suggest that auditory feedback might enhance the effectiveness of mirror visual feedback and serve as a valuable addition to the complex multi-sensory processing of body perception in patients who are amputees. PMID:21272334

Developmental remodeling of corticocortical feedback circuits in ferret visual cortex

PubMed Central

Khalil, Reem; Levitt, Jonathan B.

2014-01-01

Visual cortical areas in the mammalian brain are linked through a system of interareal feedforward and feedback connections, which presumably underlie different visual functions. We characterized the refinement of feedback projections to primary visual cortex (V1) from multiple sources in juvenile ferrets ranging in age from four to ten weeks postnatal. We studied whether the refinement of different aspects of feedback circuitry from multiple visual cortical areas proceeds at a similar rate in all areas. We injected the neuronal tracer cholera toxin B (CTb) into V1, and mapped the areal and laminar distribution of retrogradely labeled cells in extrastriate cortex. Around the time of eye opening at four weeks postnatal, the retinotopic arrangement of feedback appears essentially adultlike; however, Suprasylvian cortex supplies the greatest proportion of feedback, whereas area 18 supplies the greatest proportion in the adult. The density of feedback cells and the ratio of supragranular/infragranular feedback contribution declined in this period at a similar rate in all cortical areas. We also find significant feedback to V1 from layer IV of all extrastriate areas. The regularity of cell spacing, the proportion of feedback arising from layer IV, and the tangential extent of feedback in each area all remained essentially unchanged during this period, except for the infragranular feedback source in area 18 which expanded. Thus, while much of the basic pattern of cortical feedback to V1 is present before eye opening, there is major synchronous reorganization after eye opening, suggesting a crucial role for visual experience in this remodeling process. PMID:24665018

Developmental remodeling of corticocortical feedback circuits in ferret visual cortex.

PubMed

Khalil, Reem; Levitt, Jonathan B

2014-10-01

Visual cortical areas in the mammalian brain are linked through a system of interareal feedforward and feedback connections, which presumably underlie different visual functions. We characterized the refinement of feedback projections to primary visual cortex (V1) from multiple sources in juvenile ferrets ranging in age from 4-10 weeks postnatal. We studied whether the refinement of different aspects of feedback circuitry from multiple visual cortical areas proceeds at a similar rate in all areas. We injected the neuronal tracer cholera toxin B (CTb) into V1 and mapped the areal and laminar distribution of retrogradely labeled cells in extrastriate cortex. Around the time of eye opening at 4 weeks postnatal, the retinotopic arrangement of feedback appears essentially adult-like; however, suprasylvian cortex supplies the greatest proportion of feedback, whereas area 18 supplies the greatest proportion in the adult. The density of feedback cells and the ratio of supragranular/infragranular feedback contribution declined in this period at a similar rate in all cortical areas. We also found significant feedback to V1 from layer IV of all extrastriate areas. The regularity of cell spacing, the proportion of feedback arising from layer IV, and the tangential extent of feedback in each area all remained essentially unchanged during this period, except for the infragranular feedback source in area 18, which expanded. Thus, while much of the basic pattern of cortical feedback to V1 is present before eye opening, there is major synchronous reorganization after eye opening, suggesting a crucial role for visual experience in this remodeling process. © 2014 Wiley Periodicals, Inc.

Variable force and visual feedback effects on teleoperator man/machine performance

NASA Technical Reports Server (NTRS)

Massimino, Michael J.; Sheridan, Thomas B.

1989-01-01

An experimental study was conducted to determine the effects of various forms of visual and force feedback on human performance for several telemanipulation tasks. Experiments were conducted with varying frame rates and subtended visual angles, with and without force feedback.

Differential effects of absent visual feedback control on gait variability during different locomotion speeds.

PubMed

Wuehr, M; Schniepp, R; Pradhan, C; Ilmberger, J; Strupp, M; Brandt, T; Jahn, K

2013-01-01

Healthy persons exhibit relatively small temporal and spatial gait variability when walking unimpeded. In contrast, patients with a sensory deficit (e.g., polyneuropathy) show an increased gait variability that depends on speed and is associated with an increased fall risk. The purpose of this study was to investigate the role of vision in gait stabilization by determining the effects of withdrawing visual information (eyes closed) on gait variability at different locomotion speeds. Ten healthy subjects (32.2 ± 7.9 years, 5 women) walked on a treadmill for 5-min periods at their preferred walking speed and at 20, 40, 70, and 80 % of maximal walking speed during the conditions of walking with eyes open (EO) and with eyes closed (EC). The coefficient of variation (CV) and fractal dimension (α) of the fluctuations in stride time, stride length, and base width were computed and analyzed. Withdrawing visual information increased the base width CV for all walking velocities (p < 0.001). The effects of absent visual information on CV and α of stride time and stride length were most pronounced during slow locomotion (p < 0.001) and declined during fast walking speeds. The results indicate that visual feedback control is used to stabilize the medio-lateral (i.e., base width) gait parameters at all speed sections. In contrast, sensory feedback control in the fore-aft direction (i.e., stride time and stride length) depends on speed. Sensory feedback contributes most to fore-aft gait stabilization during slow locomotion, whereas passive biomechanical mechanisms and an automated central pattern generation appear to control fast locomotion.

Interaction between postural asymmetry and visual feedback effects in undisturbed upright stance control in healthy adults.

PubMed

Rougier, Patrice R; Boudrahem, Samir

2017-09-01

The technique of additional visual feedback has been shown to significantly decrease the center of pressure (CP) displacements of a standing subject. Body-weight asymmetry is known to increase postural instability due to difficulties in coordinating the reaction forces exerted under each foot and is often a cardinal feature of various neurological and traumatic diseases. To examine the possible interactions between additional visual feedback and body-weight asymmetry effects, healthy adults were recruited in a protocol with and without additional visual feedback, with different levels of body-weight asymmetry. CP displacements under each foot were recorded and used to compute the resultant CP displacements (CP Res ) and to estimate vertically projected center of gravity (CG v ) and CP Res -CG v displacements. Overall, six conditions were randomly proposed combining two factors: asymmetry with three BW percentage distributions (50/50, 35/65 and 20/80; left/right leg) and feedback (with or without additional VFB). The additional visual feedback technique principally reduces CG v displacements, whereas asymmetry increases CP Res -CG v displacements along the mediolateral axis. Some effects on plantar CP displacements were also observed, but only under the unloaded foot. Interestingly, no interaction between additional visual feedback and body-weight asymmetry was reported. These results suggest that the various postural effects that ensue from manipulating additional visual feedback parameters, shown previously in healthy subjects in various studies, could also apply independently of the level of asymmetry. Visual feedback effects could be observed in patients presenting weight-bearing asymmetries. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Visually driven chaining of elementary swim patterns into a goal-directed motor sequence: a virtual reality study of zebrafish prey capture.

PubMed

Trivedi, Chintan A; Bollmann, Johann H

2013-01-01

Prey capture behavior critically depends on rapid processing of sensory input in order to track, approach, and catch the target. When using vision, the nervous system faces the problem of extracting relevant information from a continuous stream of input in order to detect and categorize visible objects as potential prey and to select appropriate motor patterns for approach. For prey capture, many vertebrates exhibit intermittent locomotion, in which discrete motor patterns are chained into a sequence, interrupted by short periods of rest. Here, using high-speed recordings of full-length prey capture sequences performed by freely swimming zebrafish larvae in the presence of a single paramecium, we provide a detailed kinematic analysis of first and subsequent swim bouts during prey capture. Using Fourier analysis, we show that individual swim bouts represent an elementary motor pattern. Changes in orientation are directed toward the target on a graded scale and are implemented by an asymmetric tail bend component superimposed on this basic motor pattern. To further investigate the role of visual feedback on the efficiency and speed of this complex behavior, we developed a closed-loop virtual reality setup in which minimally restrained larvae recapitulated interconnected swim patterns closely resembling those observed during prey capture in freely moving fish. Systematic variation of stimulus properties showed that prey capture is initiated within a narrow range of stimulus size and velocity. Furthermore, variations in the delay and location of swim triggered visual feedback showed that the reaction time of secondary and later swims is shorter for stimuli that appear within a narrow spatio-temporal window following a swim. This suggests that the larva may generate an expectation of stimulus position, which enables accelerated motor sequencing if the expectation is met by appropriate visual feedback.

The Sander parallelogram illusion dissociates action and perception despite control for the litany of past confounds.

PubMed

Whitwell, Robert L; Goodale, Melvyn A; Merritt, Kate E; Enns, James T

2018-01-01

The two visual systems hypothesis proposes that human vision is supported by an occipito-temporal network for the conscious visual perception of the world and a fronto-parietal network for visually-guided, object-directed actions. Two specific claims about the fronto-parietal network's role in sensorimotor control have generated much data and controversy: (1) the network relies primarily on the absolute metrics of target objects, which it rapidly transforms into effector-specific frames of reference to guide the fingers, hands, and limbs, and (2) the network is largely unaffected by scene-based information extracted by the occipito-temporal network for those same targets. These two claims lead to the counter-intuitive prediction that in-flight anticipatory configuration of the fingers during object-directed grasping will resist the influence of pictorial illusions. The research confirming this prediction has been criticized for confounding the difference between grasping and explicit estimates of object size with differences in attention, sensory feedback, obstacle avoidance, metric sensitivity, and priming. Here, we address and eliminate each of these confounds. We asked participants to reach out and pick up 3D target bars resting on a picture of the Sander Parallelogram illusion and to make explicit estimates of the length of those bars. Participants performed their grasps without visual feedback, and were permitted to grasp the targets after making their size-estimates to afford them an opportunity to reduce illusory error with haptic feedback. The results show unequivocally that the effect of the illusion is stronger on perceptual judgments than on grasping. Our findings from the normally-sighted population provide strong support for the proposal that human vision is comprised of functionally and anatomically dissociable systems. Copyright © 2017 Elsevier Ltd. All rights reserved.

Mastoidectomy simulation with combined visual and haptic feedback.

PubMed

Agus, Marco; Giachetti, Andrea; Gobbetti, Enrico; Zanetti, Gianluigi; Zorcolo, Antonio; John, Nigel W; Stone, Robert J

2002-01-01

Mastoidectomy is one of the most common surgical procedures relating to the petrous bone. In this paper we describe our preliminary results in the realization of a virtual reality mastoidectomy simulator. Our system is designed to work on patient-specific volumetric object models directly derived from 3D CT and MRI images. The paper summarizes the detailed task analysis performed in order to define the system requirements, introduces the architecture of the prototype simulator, and discusses the initial feedback received from selected end users.

A computer simulation experiment of supervisory control of remote manipulation. M.S. Thesis

NASA Technical Reports Server (NTRS)

Mccandlish, S. G.

1966-01-01

A computer simulation of a remote manipulation task and a rate-controlled manipulator is described. Some low-level automatic decision making ability which could be used at the operator's discretion to augment his direct continuous control was built into the manipulator. Experiments were made on the effect of transmission delay, dynamic lag, and intermittent vision on human manipulative ability. Delay does not make remote manipulation impossible. Intermittent visual feedback, and the absence of rate information in the display presented to the operator do not seem to impair the operator's performance. A small-capacity visual feedback channel may be sufficient for remote manipulation tasks, or one channel might be time-shared between several operators. In other experiments the operator called in sequence various on-site automatic control programs of the machine, and thereby acted as a supervisor. The supervisory mode of operation has some advantages when the task to be performed is difficult for a human controlling directly.

Implicit and Explicit Representations of Hand Position in Tool Use

PubMed Central

Rand, Miya K.; Heuer, Herbert

2013-01-01

Understanding the interactions of visual and proprioceptive information in tool use is important as it is the basis for learning of the tool's kinematic transformation and thus skilled performance. This study investigated how the CNS combines seen cursor positions and felt hand positions under a visuo-motor rotation paradigm. Young and older adult participants performed aiming movements on a digitizer while looking at rotated visual feedback on a monitor. After each movement, they judged either the proprioceptively sensed hand direction or the visually sensed cursor direction. We identified asymmetric mutual biases with a strong visual dominance. Furthermore, we found a number of differences between explicit and implicit judgments of hand directions. The explicit judgments had considerably larger variability than the implicit judgments. The bias toward the cursor direction for the explicit judgments was about twice as strong as for the implicit judgments. The individual biases of explicit and implicit judgments were uncorrelated. Biases of these judgments exhibited opposite sequential effects. Moreover, age-related changes were also different between these judgments. The judgment variability was decreased and the bias toward the cursor direction was increased with increasing age only for the explicit judgments. These results indicate distinct explicit and implicit neural representations of hand direction, similar to the notion of distinct visual systems. PMID:23894307

The Influence of Restricted Visual Feedback on Dribbling Performance in Youth Soccer Players.

PubMed

Fransen, Job; Lovell, Thomas W J; Bennett, Kyle J M; Deprez, Dieter; Deconinck, Frederik J A; Lenoir, Matthieu; Coutts, Aaron J

2017-04-01

The aim of the current study was to examine the influence of restricted visual feedback using stroboscopic eyewear on the dribbling performance of youth soccer players. Three dribble test conditions were used in a within-subjects design to measure the effect of restricted visual feedback on soccer dribbling performance in 189 youth soccer players (age: 10-18 y) classified as fast, average or slow dribblers. The results showed that limiting visual feedback increased dribble test times across all abilities. Furthermore, the largest performance decrement between stroboscopic and full vision conditions was in fast dribblers, showing that fast dribblers were most affected by reduced visual information. This may be due to a greater dependency on visual feedback at increased speeds, which may limit the ability to maintain continuous control of the ball. These findings may have important implications for the development of soccer dribbling ability.

Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation.

PubMed

Miura, Satoshi; Matsumoto, Yuya; Kobayashi, Yo; Kawamura, Kazuya; Nakashima, Yasutaka; Fujie, Masakatsu G

2015-01-01

This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p<;0.05) when compared with moving with closed eyes or only gazing among all participants. In conclusion, the brain can activate according to visual and somatic sensory feedback agreement.

Visuomotor Map Determines How Visually Guided Reaching Movements are Corrected Within and Across Trials123

PubMed Central

Hirashima, Masaya

2016-01-01

Abstract When a visually guided reaching movement is unexpectedly perturbed, it is implicitly corrected in two ways: immediately after the perturbation by feedback control (online correction) and in the next movement by adjusting feedforward motor commands (offline correction or motor adaptation). Although recent studies have revealed a close relationship between feedback and feedforward controls, the nature of this relationship is not yet fully understood. Here, we show that both implicit online and offline movement corrections utilize the same visuomotor map for feedforward movement control that transforms the spatial location of visual objects into appropriate motor commands. First, we artificially distorted the visuomotor map by applying opposite visual rotations to the cursor representing the hand position while human participants reached for two different targets. This procedure implicitly altered the visuomotor map so that changes in the movement direction to the target location were more insensitive or more sensitive. Then, we examined how such visuomotor map distortion influenced online movement correction by suddenly changing the target location. The magnitude of online movement correction was altered according to the shape of the visuomotor map. We also examined offline movement correction; the aftereffect induced by visual rotation in the previous trial was modulated according to the shape of the visuomotor map. These results highlighted the importance of the visuomotor map as a foundation for implicit motor control mechanisms and the intimate relationship between feedforward control, feedback control, and motor adaptation. PMID:27275006

Visuomotor Map Determines How Visually Guided Reaching Movements are Corrected Within and Across Trials.

PubMed

Hayashi, Takuji; Yokoi, Atsushi; Hirashima, Masaya; Nozaki, Daichi

2016-01-01

When a visually guided reaching movement is unexpectedly perturbed, it is implicitly corrected in two ways: immediately after the perturbation by feedback control (online correction) and in the next movement by adjusting feedforward motor commands (offline correction or motor adaptation). Although recent studies have revealed a close relationship between feedback and feedforward controls, the nature of this relationship is not yet fully understood. Here, we show that both implicit online and offline movement corrections utilize the same visuomotor map for feedforward movement control that transforms the spatial location of visual objects into appropriate motor commands. First, we artificially distorted the visuomotor map by applying opposite visual rotations to the cursor representing the hand position while human participants reached for two different targets. This procedure implicitly altered the visuomotor map so that changes in the movement direction to the target location were more insensitive or more sensitive. Then, we examined how such visuomotor map distortion influenced online movement correction by suddenly changing the target location. The magnitude of online movement correction was altered according to the shape of the visuomotor map. We also examined offline movement correction; the aftereffect induced by visual rotation in the previous trial was modulated according to the shape of the visuomotor map. These results highlighted the importance of the visuomotor map as a foundation for implicit motor control mechanisms and the intimate relationship between feedforward control, feedback control, and motor adaptation.

Smartphone-Based Escalator Recognition for the Visually Impaired

PubMed Central

Nakamura, Daiki; Takizawa, Hotaka; Aoyagi, Mayumi; Ezaki, Nobuo; Mizuno, Shinji

2017-01-01

It is difficult for visually impaired individuals to recognize escalators in everyday environments. If the individuals ride on escalators in the wrong direction, they will stumble on the steps. This paper proposes a novel method to assist visually impaired individuals in finding available escalators by the use of smartphone cameras. Escalators are recognized by analyzing optical flows in video frames captured by the cameras, and auditory feedback is provided to the individuals. The proposed method was implemented on an Android smartphone and applied to actual escalator scenes. The experimental results demonstrate that the proposed method is promising for helping visually impaired individuals use escalators. PMID:28481270

Audio-Visual Situational Awareness for General Aviation Pilots

NASA Technical Reports Server (NTRS)

Spirkovska, Lilly; Lodha, Suresh K.; Clancy, Daniel (Technical Monitor)

2001-01-01

Weather is one of the major causes of general aviation accidents. Researchers are addressing this problem from various perspectives including improving meteorological forecasting techniques, collecting additional weather data automatically via on-board sensors and "flight" modems, and improving weather data dissemination and presentation. We approach the problem from the improved presentation perspective and propose weather visualization and interaction methods tailored for general aviation pilots. Our system, Aviation Weather Data Visualization Environment (AWE), utilizes information visualization techniques, a direct manipulation graphical interface, and a speech-based interface to improve a pilot's situational awareness of relevant weather data. The system design is based on a user study and feedback from pilots.

Identification of Vibrotactile Patterns Encoding Obstacle Distance Information.

PubMed

Kim, Yeongmi; Harders, Matthias; Gassert, Roger

2015-01-01

Delivering distance information of nearby obstacles from sensors embedded in a white cane-in addition to the intrinsic mechanical feedback from the cane-can aid the visually impaired in ambulating independently. Haptics is a common modality for conveying such information to cane users, typically in the form of vibrotactile signals. In this context, we investigated the effect of tactile rendering methods, tactile feedback configurations and directions of tactile flow on the identification of obstacle distance. Three tactile rendering methods with temporal variation only, spatio-temporal variation and spatial/temporal/intensity variation were investigated for two vibration feedback configurations. Results showed a significant interaction between tactile rendering method and feedback configuration. Spatio-temporal variation generally resulted in high correct identification rates for both feedback configurations. In the case of the four-finger vibration, tactile rendering with spatial/temporal/intensity variation also resulted in high distance identification rate. Further, participants expressed their preference for the four-finger vibration over the single-finger vibration in a survey. Both preferred rendering methods with spatio-temporal variation and spatial/temporal/intensity variation for the four-finger vibration could convey obstacle distance information with low workload. Overall, the presented findings provide valuable insights and guidance for the design of haptic displays for electronic travel aids for the visually impaired.

Adaptation of handwriting size under distorted visual feedback in patients with Parkinson's disease and elderly and young controls

PubMed Central

Teulings, H; Contreras-Vidal, J; Stelmach, G; Adler, C

2002-01-01

Objective: The ability to use visual feedback to control handwriting size was compared in patients with Parkinson's disease (PD), elderly people, and young adults to better understand factors playing a part in parkinsonian micrographia. Methods: The participants wrote sequences of eight cursive l loops with visual target sizes of 0.5 and 2 cm on a flat panel display digitiser which both recorded and displayed the pen movements. In the pre-exposure and postexposure conditions, the display digitiser showed the actual pen trace in real time and real size. In the distortion exposure conditions, the gain of the vertical dimension of the visual feedback was either reduced to 70% or enlarged to 140%. Results: The young controls showed a gradual visuomotor adaptation that compensated for the visual feedback distortions during the exposure conditions. They also showed significant after effects during the postexposure conditions. The elderly controls marginally corrected for the size distortions and showed small after effects. The patients with PD, however, showed no trial by trial adaptations or after effects but instead, a progressive amplification of the distortion effect in each individual trial. Conclusion: The young controls used visual feedback to update their visuomotor map. The elderly controls seemed to make little use of visual feedback. The patients with Parkinson's disease rely on the visual feedback of previous or of ongoing strokes to programme subsequent strokes. This recursive feedback may play a part in the progressive reductions in handwriting size found in parkinsonian micrographia. PMID:11861687

Effects of interactive visual feedback training on post-stroke pusher syndrome: a pilot randomized controlled study.

PubMed

Yang, Yea-Ru; Chen, Yi-Hua; Chang, Heng-Chih; Chan, Rai-Chi; Wei, Shun-Hwa; Wang, Ray-Yau

2015-10-01

We investigated the effects of a computer-generated interactive visual feedback training program on the recovery from pusher syndrome in stroke patients. Assessor-blinded, pilot randomized controlled study. A total of 12 stroke patients with pusher syndrome were randomly assigned to either the experimental group (N = 7, computer-generated interactive visual feedback training) or control group (N = 5, mirror visual feedback training). The scale for contraversive pushing for severity of pusher syndrome, the Berg Balance Scale for balance performance, and the Fugl-Meyer assessment scale for motor control were the outcome measures. Patients were assessed pre- and posttraining. A comparison of pre- and posttraining assessment results revealed that both training programs led to the following significant changes: decreased severity of pusher syndrome scores (decreases of 4.0 ± 1.1 and 1.4 ± 1.0 in the experimental and control groups, respectively); improved balance scores (increases of 14.7 ± 4.3 and 7.2 ± 1.6 in the experimental and control groups, respectively); and higher scores for lower extremity motor control (increases of 8.4 ± 2.2 and 5.6 ± 3.3 in the experimental and control groups, respectively). Furthermore, the computer-generated interactive visual feedback training program produced significantly better outcomes in the improvement of pusher syndrome (p < 0.01) and balance (p < 0.05) compared with the mirror visual feedback training program. Although both training programs were beneficial, the computer-generated interactive visual feedback training program more effectively aided recovery from pusher syndrome compared with mirror visual feedback training. © The Author(s) 2014.

Effect of Animated Graphic Annotations and Immediate Visual Feedback in Aiding Japanese Pronunciation Learning: A Comparative Study

ERIC Educational Resources Information Center

Hew, Soon-Hin; Ohki, Mitsuru

2004-01-01

This study examines the effectiveness of imagery and electronic visual feedback in facilitating students' acquisition of Japanese pronunciation skills. The independent variables, animated graphic annotation (AGA) and immediate visual feedback (IVF) were integrated into a Japanese computer-assisted language learning (JCALL) program focused on the…

Improvements in force variability and structure from vision- to memory-guided submaximal isometric knee extension in subacute stroke.

PubMed

Chow, John W; Stokic, Dobrivoje S

2018-03-01

We examined changes in variability, accuracy, frequency composition, and temporal regularity of force signal from vision-guided to memory-guided force-matching tasks in 17 subacute stroke and 17 age-matched healthy subjects. Subjects performed a unilateral isometric knee extension at 10, 30, and 50% of peak torque [maximum voluntary contraction (MVC)] for 10 s (3 trials each). Visual feedback was removed at the 5-s mark in the first two trials (feedback withdrawal), and 30 s after the second trial the subjects were asked to produce the target force without visual feedback (force recall). The coefficient of variation and constant error were used to quantify force variability and accuracy. Force structure was assessed by the median frequency, relative spectral power in the 0-3-Hz band, and sample entropy of the force signal. At 10% MVC, the force signal in subacute stroke subjects became steadier, more broadband, and temporally more irregular after the withdrawal of visual feedback, with progressively larger error at higher contraction levels. Also, the lack of modulation in the spectral frequency at higher force levels with visual feedback persisted in both the withdrawal and recall conditions. In terms of changes from the visual feedback condition, the feedback withdrawal produced a greater difference between the paretic, nonparetic, and control legs than the force recall. The overall results suggest improvements in force variability and structure from vision- to memory-guided force control in subacute stroke despite decreased accuracy. Different sensory-motor memory retrieval mechanisms seem to be involved in the feedback withdrawal and force recall conditions, which deserves further study. NEW & NOTEWORTHY We demonstrate that in the subacute phase of stroke, force signals during a low-level isometric knee extension become steadier, more broadband in spectral power, and more complex after removal of visual feedback. Larger force errors are produced when recalling target forces than immediately after withdrawing visual feedback. Although visual feedback offers better accuracy, it worsens force variability and structure in subacute stroke. The feedback withdrawal and force recall conditions seem to involve different memory retrieval mechanisms.

Force sensor attachable to thin fiberscopes/endoscopes utilizing high elasticity fabric.

PubMed

Watanabe, Tetsuyou; Iwai, Takanobu; Fujihira, Yoshinori; Wakako, Lina; Kagawa, Hiroyuki; Yoneyama, Takeshi

2014-03-12

An endoscope/fiberscope is a minimally invasive tool used for directly observing tissues in areas deep inside the human body where access is limited. However, this tool only yields visual information. If force feedback information were also available, endoscope/fiberscope operators would be able to detect indurated areas that are visually hard to recognize. Furthermore, obtaining such feedback information from tissues in areas where collecting visual information is a challenge would be highly useful. The major obstacle is that such force information is difficult to acquire. This paper presents a novel force sensing system that can be attached to a very thin fiberscope/endoscope. To ensure a small size, high resolution, easy sterilization, and low cost, the proposed force visualization-based system uses a highly elastic material-panty stocking fabric. The paper also presents the methodology for deriving the force value from the captured image. The system has a resolution of less than 0.01 N and sensitivity of greater than 600 pixels/N within the force range of 0-0.2 N.

Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning.

PubMed

Sigrist, Roland; Rauter, Georg; Marchal-Crespo, Laura; Riener, Robert; Wolf, Peter

2015-03-01

Concurrent augmented feedback has been shown to be less effective for learning simple motor tasks than for complex tasks. However, as mostly artificial tasks have been investigated, transfer of results to tasks in sports and rehabilitation remains unknown. Therefore, in this study, the effect of different concurrent feedback was evaluated in trunk-arm rowing. It was then investigated whether multimodal audiovisual and visuohaptic feedback are more effective for learning than visual feedback only. Naïve subjects (N = 24) trained in three groups on a highly realistic virtual reality-based rowing simulator. In the visual feedback group, the subject's oar was superimposed to the target oar, which continuously became more transparent when the deviation between the oars decreased. Moreover, a trace of the subject's trajectory emerged if deviations exceeded a threshold. The audiovisual feedback group trained with oar movement sonification in addition to visual feedback to facilitate learning of the velocity profile. In the visuohaptic group, the oar movement was inhibited by path deviation-dependent braking forces to enhance learning of spatial aspects. All groups significantly decreased the spatial error (tendency in visual group) and velocity error from baseline to the retention tests. Audiovisual feedback fostered learning of the velocity profile significantly more than visuohaptic feedback. The study revealed that well-designed concurrent feedback fosters complex task learning, especially if the advantages of different modalities are exploited. Further studies should analyze the impact of within-feedback design parameters and the transferability of the results to other tasks in sports and rehabilitation.

Delayed visual feedback affects both manual tracking and grip force control when transporting a handheld object.

PubMed

Sarlegna, Fabrice R; Baud-Bovy, Gabriel; Danion, Frédéric

2010-08-01

When we manipulate an object, grip force is adjusted in anticipation of the mechanical consequences of hand motion (i.e., load force) to prevent the object from slipping. This predictive behavior is assumed to rely on an internal representation of the object dynamic properties, which would be elaborated via visual information before the object is grasped and via somatosensory feedback once the object is grasped. Here we examined this view by investigating the effect of delayed visual feedback during dextrous object manipulation. Adult participants manually tracked a sinusoidal target by oscillating a handheld object whose current position was displayed as a cursor on a screen along with the visual target. A delay was introduced between actual object displacement and cursor motion. This delay was linearly increased (from 0 to 300 ms) and decreased within 2-min trials. As previously reported, delayed visual feedback altered performance in manual tracking. Importantly, although the physical properties of the object remained unchanged, delayed visual feedback altered the timing of grip force relative to load force by about 50 ms. Additional experiments showed that this effect was not due to task complexity nor to manual tracking. A model inspired by the behavior of mass-spring systems suggests that delayed visual feedback may have biased the representation of object dynamics. Overall, our findings support the idea that visual feedback of object motion can influence the predictive control of grip force even when the object is grasped.

A software module for implementing auditory and visual feedback on a video-based eye tracking system

NASA Astrophysics Data System (ADS)

Rosanlall, Bharat; Gertner, Izidor; Geri, George A.; Arrington, Karl F.

2016-05-01

We describe here the design and implementation of a software module that provides both auditory and visual feedback of the eye position measured by a commercially available eye tracking system. The present audio-visual feedback module (AVFM) serves as an extension to the Arrington Research ViewPoint EyeTracker, but it can be easily modified for use with other similar systems. Two modes of audio feedback and one mode of visual feedback are provided in reference to a circular area-of-interest (AOI). Auditory feedback can be either a click tone emitted when the user's gaze point enters or leaves the AOI, or a sinusoidal waveform with frequency inversely proportional to the distance from the gaze point to the center of the AOI. Visual feedback is in the form of a small circular light patch that is presented whenever the gaze-point is within the AOI. The AVFM processes data that are sent to a dynamic-link library by the EyeTracker. The AVFM's multithreaded implementation also allows real-time data collection (1 kHz sampling rate) and graphics processing that allow display of the current/past gaze-points as well as the AOI. The feedback provided by the AVFM described here has applications in military target acquisition and personnel training, as well as in visual experimentation, clinical research, marketing research, and sports training.

Effects of Real-Time Visual Feedback on Pre-Service Teachers' Singing

ERIC Educational Resources Information Center

Leong, S.; Cheng, L.

2014-01-01

This pilot study focuses on the use real-time visual feedback technology (VFT) in vocal training. The empirical research has two aims: to ascertain the effectiveness of the real-time visual feedback software "Sing & See" in the vocal training of pre-service music teachers and the teachers' perspective on their experience with…

Use of visual CO2 feedback as a retrofit solution for improving classroom air quality.

PubMed

Wargocki, P; Da Silva, N A F

2015-02-01

Carbon dioxide (CO2 ) sensors that provide a visual indication were installed in classrooms during normal school operation. During 2-week periods, teachers and students were instructed to open the windows in response to the visual CO2 feedback in 1 week and open them, as they would normally do, without visual feedback, in the other week. In the heating season, two pairs of classrooms were monitored, one pair naturally and the other pair mechanically ventilated. In the cooling season, two pairs of naturally ventilated classrooms were monitored, one pair with split cooling in operation and the other pair with no cooling. Classrooms were matched by grade. Providing visual CO2 feedback reduced CO2 levels, as more windows were opened in this condition. This increased energy use for heating and reduced the cooling requirement in summertime. Split cooling reduced the frequency of window opening only when no visual CO2 feedback was present. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Neural Circuit to Integrate Opposing Motions in the Visual Field.

PubMed

Mauss, Alex S; Pankova, Katarina; Arenz, Alexander; Nern, Aljoscha; Rubin, Gerald M; Borst, Alexander

2015-07-16

When navigating in their environment, animals use visual motion cues as feedback signals that are elicited by their own motion. Such signals are provided by wide-field neurons sampling motion directions at multiple image points as the animal maneuvers. Each one of these neurons responds selectively to a specific optic flow-field representing the spatial distribution of motion vectors on the retina. Here, we describe the discovery of a group of local, inhibitory interneurons in the fruit fly Drosophila key for filtering these cues. Using anatomy, molecular characterization, activity manipulation, and physiological recordings, we demonstrate that these interneurons convey direction-selective inhibition to wide-field neurons with opposite preferred direction and provide evidence for how their connectivity enables the computation required for integrating opposing motions. Our results indicate that, rather than sharpening directional selectivity per se, these circuit elements reduce noise by eliminating non-specific responses to complex visual information. Copyright © 2015 Elsevier Inc. All rights reserved.

A study on haptic collaborative game in shared virtual environment

NASA Astrophysics Data System (ADS)

Lu, Keke; Liu, Guanyang; Liu, Lingzhi

2013-03-01

A study on collaborative game in shared virtual environment with haptic feedback over computer networks is introduced in this paper. A collaborative task was used where the players located at remote sites and played the game together. The player can feel visual and haptic feedback in virtual environment compared to traditional networked multiplayer games. The experiment was desired in two conditions: visual feedback only and visual-haptic feedback. The goal of the experiment is to assess the impact of force feedback on collaborative task performance. Results indicate that haptic feedback is beneficial for performance enhancement for collaborative game in shared virtual environment. The outcomes of this research can have a powerful impact on the networked computer games.

Effects of Varied Enhancement Strategies (Chunking, Feedback, Gaming) in Complementing Animated Instruction in Facilitating Different Types of Learning Objectives

ERIC Educational Resources Information Center

Munyofu, Mine

2008-01-01

The purpose of this study was to examine the instructional effectiveness of different levels of chunking (simple visual/text and complex visual/text), different forms of feedback (item-by-item feedback, end-of-test feedback and no feedback), and use of instructional gaming (game and no game) in complementing animated programmed instruction on a…

Balance rehabilitation: promoting the role of virtual reality in patients with diabetic peripheral neuropathy.

PubMed

Grewal, Gurtej S; Sayeed, Rashad; Schwenk, Michael; Bharara, Manish; Menzies, Robert; Talal, Talal K; Armstrong, David G; Najafi, Bijan

2013-01-01

Individuals with diabetic peripheral neuropathy frequently experience concomitant impaired proprioception and postural instability. Conventional exercise training has been demonstrated to be effective in improving balance but does not incorporate visual feedback targeting joint perception, which is an integral mechanism that helps compensate for impaired proprioception in diabetic peripheral neuropathy. This prospective cohort study recruited 29 participants (mean ± SD: age, 57 ± 10 years; body mass index [calculated as weight in kilograms divided by height in meters squared], 26.9 ± 3.1). Participants satisfying the inclusion criteria performed predefined ankle exercises through reaching tasks, with visual feedback from the ankle joint projected on a screen. Ankle motion in the mediolateral and anteroposterior directions was captured using wearable sensors attached to the participant's shank. Improvements in postural stability were quantified by measuring center of mass sway area and the reciprocal compensatory index before and after training using validated body-worn sensor technology. Findings revealed a significant reduction in center of mass sway after training (mean, 22%; P = .02). A higher postural stability deficit (high body sway) at baseline was associated with higher training gains in postural balance (reduction in center of mass sway) (r = -0.52, P < .05). In addition, significant improvement was observed in postural coordination between the ankle and hip joints (mean, 10.4%; P = .04). The present research implemented a novel balance rehabilitation strategy based on virtual reality technology. The method included wearable sensors and an interactive user interface for real-time visual feedback based on ankle joint motion, similar to a video gaming environment, for compensating impaired joint proprioception. These findings support that visual feedback generated from the ankle joint coupled with motor learning may be effective in improving postural stability in patients with diabetic peripheral neuropathy.

Augmented reality and haptic interfaces for robot-assisted surgery.

PubMed

Yamamoto, Tomonori; Abolhassani, Niki; Jung, Sung; Okamura, Allison M; Judkins, Timothy N

2012-03-01

Current teleoperated robot-assisted minimally invasive surgical systems do not take full advantage of the potential performance enhancements offered by various forms of haptic feedback to the surgeon. Direct and graphical haptic feedback systems can be integrated with vision and robot control systems in order to provide haptic feedback to improve safety and tissue mechanical property identification. An interoperable interface for teleoperated robot-assisted minimally invasive surgery was developed to provide haptic feedback and augmented visual feedback using three-dimensional (3D) graphical overlays. The software framework consists of control and command software, robot plug-ins, image processing plug-ins and 3D surface reconstructions. The feasibility of the interface was demonstrated in two tasks performed with artificial tissue: palpation to detect hard lumps and surface tracing, using vision-based forbidden-region virtual fixtures to prevent the patient-side manipulator from entering unwanted regions of the workspace. The interoperable interface enables fast development and successful implementation of effective haptic feedback methods in teleoperation. Copyright © 2011 John Wiley & Sons, Ltd.

Spatial asymmetry in tactile sensor skin deformation aids perception of edge orientation during haptic exploration.

PubMed

Ponce Wong, Ruben D; Hellman, Randall B; Santos, Veronica J

2014-01-01

Upper-limb amputees rely primarily on visual feedback when using their prostheses to interact with others or objects in their environment. A constant reliance upon visual feedback can be mentally exhausting and does not suffice for many activities when line-of-sight is unavailable. Upper-limb amputees could greatly benefit from the ability to perceive edges, one of the most salient features of 3D shape, through touch alone. We present an approach for estimating edge orientation with respect to an artificial fingertip through haptic exploration using a multimodal tactile sensor on a robot hand. Key parameters from the tactile signals for each of four exploratory procedures were used as inputs to a support vector regression model. Edge orientation angles ranging from -90 to 90 degrees were estimated with an 85-input model having an R (2) of 0.99 and RMS error of 5.08 degrees. Electrode impedance signals provided the most useful inputs by encoding spatially asymmetric skin deformation across the entire fingertip. Interestingly, sensor regions that were not in direct contact with the stimulus provided particularly useful information. Methods described here could pave the way for semi-autonomous capabilities in prosthetic or robotic hands during haptic exploration, especially when visual feedback is unavailable.

The adenosine triphosphate method as a quality control tool to assess 'cleanliness' of frequently touched hospital surfaces.

PubMed

Knape, L; Hambraeus, A; Lytsy, B

2015-10-01

The adenosine triphosphate (ATP) method is widely accepted as a quality control method to complement visual assessment, in the specifications of requirements, when purchasing cleaning contractors in Swedish hospitals. To examine whether the amount of biological load, as measured by ATP on frequently touched near-patient surfaces, had been reduced after an intervention; to evaluate the correlation between visual assessment and ATP levels on the same surfaces; to identify aspects of the performance of the ATP method as a tool in evaluating hospital cleanliness. A prospective intervention study in three phases was carried out in a medical ward and an intensive care unit (ICU) at a regional hospital in mid-Sweden between 2012 and 2013. Existing cleaning procedures were defined and baseline tests were sampled by visual inspection and ATP measurements of ten frequently touched surfaces in patients' rooms before and after intervention. The intervention consisted of educating nursing staff about the importance of hospital cleaning and direct feedback of ATP levels before and after cleaning. The mixed model showed a significant decrease in ATP levels after the intervention (P < 0.001). Relative light unit values were lower in the ICU. Cleanliness as judged by visual assessments improved. In the logistic regression analysis, there was a significant association between visual assessments and ATP levels. Direct feedback of ATP levels, together with education and introduction of written cleaning protocols, were effective tools to improve cleanliness. Visual assessment correlated with the level of ATP but the correlation was not absolute. The ATP method could serve as an educational tool for staff, but is not enough to assess hospital cleanliness in general as only a limited part of a large area is covered. Copyright © 2015 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

Solar and Wind Forecasting | Grid Modernization | NREL

Science.gov Websites

and Wind Forecasting Solar and Wind Forecasting As solar and wind power become more common system operators. An aerial photo of the National Wind Technology Center's PV arrays. Capabilities value of accurate forecasting Wind power visualization to direct questions and feedback during industry

Variability in Stepping Direction Explains the Veering Behavior of Blind Walkers

ERIC Educational Resources Information Center

Kallie, Christopher S.; Schrater, Paul R.; Legge, Gordon E.

2007-01-01

Walking without vision results in veering, an inability to maintain a straight path that has important consequences for blind pedestrians. In this study, the authors addressed whether the source of veering in the absence of visual and auditory feedback is better attributed to errors in perceptual encoding or undetected motor error. Three…

Teleoperation of steerable flexible needles by combining kinesthetic and vibratory feedback.

PubMed

Pacchierotti, Claudio; Abayazid, Momen; Misra, Sarthak; Prattichizzo, Domenico

2014-01-01

Needle insertion in soft-tissue is a minimally invasive surgical procedure that demands high accuracy. In this respect, robotic systems with autonomous control algorithms have been exploited as the main tool to achieve high accuracy and reliability. However, for reasons of safety and responsibility, autonomous robotic control is often not desirable. Therefore, it is necessary to focus also on techniques enabling clinicians to directly control the motion of the surgical tools. In this work, we address that challenge and present a novel teleoperated robotic system able to steer flexible needles. The proposed system tracks the position of the needle using an ultrasound imaging system and computes needle's ideal position and orientation to reach a given target. The master haptic interface then provides the clinician with mixed kinesthetic-vibratory navigation cues to guide the needle toward the computed ideal position and orientation. Twenty participants carried out an experiment of teleoperated needle insertion into a soft-tissue phantom, considering four different experimental conditions. Participants were provided with either mixed kinesthetic-vibratory feedback or mixed kinesthetic-visual feedback. Moreover, we considered two different ways of computing ideal position and orientation of the needle: with or without set-points. Vibratory feedback was found more effective than visual feedback in conveying navigation cues, with a mean targeting error of 0.72 mm when using set-points, and of 1.10 mm without set-points.

Surgical evaluation of a novel tethered robotic capsule endoscope using micro-patterned treads.

PubMed

Sliker, Levin J; Kern, Madalyn D; Schoen, Jonathan A; Rentschler, Mark E

2012-10-01

The state-of-the-art technology for gastrointestinal (GI) tract exploration is a capsule endoscope (CE). Capsule endoscopes are pill-sized devices that provide visual feedback of the GI tract as they move passively through the patient. These passive devices could benefit from a mobility system enabling maneuverability and controllability. Potential benefits of a tethered robotic capsule endoscope (tRCE) include faster travel speeds, reaction force generation for biopsy, and decreased capsule retention. In this work, a tethered CE is developed with an active locomotion system for mobility within a collapsed lumen. Micro-patterned polydimethylsiloxane (PDMS) treads are implemented onto a custom capsule housing as a mobility method. The tRCE housing contains a direct current (DC) motor and gear train to drive the treads, a video camera for visual feedback, and two light sources (infrared and visible) for illumination. The device was placed within the insufflated abdomen of a live anesthetized pig to evaluate mobility performance on a planar tissue surface, as well as within the cecum to evaluate mobility performance in a collapsed lumen. The tRCE was capable of forward and reverse mobility for both planar and collapsed lumen tissue environments. Also, using an onboard visual system, the tRCE was capable of demonstrating visual feedback within an insufflated, anesthetized porcine abdomen. Proof-of-concept in vivo tRCE mobility using micro-patterned PDMS treads was shown. This suggests that a similar method could be implemented in future smaller, faster, and untethered RCEs.

The influence of visual feedback from the recent past on the programming of grip aperture is grasp-specific, shared between hands, and mediated by sensorimotor memory not task set.

PubMed

Tang, Rixin; Whitwell, Robert L; Goodale, Melvyn A

2015-05-01

Goal-directed movements, such as reaching out to grasp an object, are necessarily constrained by the spatial properties of the target such as its size, shape, and position. For example, during a reach-to-grasp movement, the peak width of the aperture formed by the thumb and fingers in flight (peak grip aperture, PGA) is linearly related to the target's size. Suppressing vision throughout the movement (visual open loop) has a small though significant effect on this relationship. Visual open loop conditions also produce a large increase in the PGA compared to when vision is available throughout the movement (visual closed loop). Curiously, this differential effect of the availability of visual feedback is influenced by the presentation order: the difference in PGA between closed- and open-loop trials is smaller when these trials are intermixed (an effect we have called 'homogenization'). Thus, grasping movements are affected not only by the availability of visual feedback (closed loop or open loop) but also by what happened on the previous trial. It is not clear, however, whether this carry-over effect is mediated through motor (or sensorimotor) memory or through the interference of different task sets for closed-loop and open-loop feedback that determine when the movements are fully specified. We reasoned that sensorimotor memory, but not a task set for closed and open loop feedback, would be specific to the type of response. We tested this prediction in a condition in which pointing to targets was alternated with grasping those same targets. Critically, in this condition, when pointing was performed in open loop, grasping was always performed in closed loop (and vice versa). Despite the fact that closed- and open-loop trials were alternating in this condition, we found no evidence for homogenization of the PGA. Homogenization did occur, however, in a follow-up experiment in which grasping movements and visual feedback were alternated between the left and the right hand, indicating that sensorimotor (or motor) memory can operate both within and between hands when the response type is kept the same. In a final experiment, we ruled out the possibility that simply alternating the hand used to perform the grasp interferes with motor or sensorimotor memory. We did this by showing that when the hand was alternated within a block of exclusively closed- or open-loop trials, homogenization of the PGA did not occur. Taken together, the results suggest that (1) interference from simply switching between task sets for closed or open-loop feedback or from switching between the hands cannot account homogenization in the PGA and that (2) the programming and execution of grasps can borrow not only from grasping movements executed in the past by the same hand, but also from grasping movements executed with the other hand. Copyright © 2015 Elsevier B.V. All rights reserved.

Visual Reliance for Balance Control in Older Adults Persists When Visual Information Is Disrupted by Artificial Feedback Delays

PubMed Central

Balasubramaniam, Ramesh

2014-01-01

Sensory information from our eyes, skin and muscles helps guide and correct balance. Less appreciated, however, is that delays in the transmission of sensory information between our eyes, limbs and central nervous system can exceed several 10s of milliseconds. Investigating how these time-delayed sensory signals influence balance control is central to understanding the postural system. Here, we investigate how delayed visual feedback and cognitive performance influence postural control in healthy young and older adults. The task required that participants position their center of pressure (COP) in a fixed target as accurately as possible without visual feedback about their COP location (eyes-open balance), or with artificial time delays imposed on visual COP feedback. On selected trials, the participants also performed a silent arithmetic task (cognitive dual task). We separated COP time series into distinct frequency components using low and high-pass filtering routines. Visual feedback delays affected low frequency postural corrections in young and older adults, with larger increases in postural sway noted for the group of older adults. In comparison, cognitive performance reduced the variability of rapid center of pressure displacements in young adults, but did not alter postural sway in the group of older adults. Our results demonstrate that older adults prioritize vision to control posture. This visual reliance persists even when feedback about the task is delayed by several hundreds of milliseconds. PMID:24614576

Patient DF's visual brain in action: Visual feedforward control in visual form agnosia.

PubMed

Whitwell, Robert L; Milner, A David; Cavina-Pratesi, Cristiana; Barat, Masihullah; Goodale, Melvyn A

2015-05-01

Patient DF, who developed visual form agnosia following ventral-stream damage, is unable to discriminate the width of objects, performing at chance, for example, when asked to open her thumb and forefinger a matching amount. Remarkably, however, DF adjusts her hand aperture to accommodate the width of objects when reaching out to pick them up (grip scaling). While this spared ability to grasp objects is presumed to be mediated by visuomotor modules in her relatively intact dorsal stream, it is possible that it may rely abnormally on online visual or haptic feedback. We report here that DF's grip scaling remained intact when her vision was completely suppressed during grasp movements, and it still dissociated sharply from her poor perceptual estimates of target size. We then tested whether providing trial-by-trial haptic feedback after making such perceptual estimates might improve DF's performance, but found that they remained significantly impaired. In a final experiment, we re-examined whether DF's grip scaling depends on receiving veridical haptic feedback during grasping. In one condition, the haptic feedback was identical to the visual targets. In a second condition, the haptic feedback was of a constant intermediate width while the visual target varied trial by trial. Despite this incongruent feedback, DF still scaled her grip aperture to the visual widths of the target blocks, showing only normal adaptation to the false haptically-experienced width. Taken together, these results strengthen the view that DF's spared grasping relies on a normal mode of dorsal-stream functioning, based chiefly on visual feedforward processing. Copyright © 2014 Elsevier B.V. All rights reserved.

Unipedal balance in healthy adults: effect of visual environments yielding decreased lateral velocity feedback.

PubMed

Deyer, T W; Ashton-Miller, J A

1999-09-01

To test the (null) hypotheses that the reliability of unipedal balance is unaffected by the attenuation of visual velocity feedback and that, relative to baseline performance, deterioration of balance success rates from attenuated visual velocity feedback will not differ between groups of young men and older women, and the presence (or absence) of a vertical foreground object will not affect balance success rates. Single blind, single case study. University research laboratory. Two volunteer samples: 26 healthy young men (mean age, 20.0yrs; SD, 1.6); 23 healthy older women (mean age, 64.9 yrs; SD, 7.8). Normalized success rates in unipedal balance task. Subjects were asked to transfer to and maintain unipedal stance for 5 seconds in a task near the limit of their balance capabilities. Subjects completed 64 trials: 54 trials of three experimental visual scenes in blocked randomized sequences of 18 trials and 10 trials in a normal visual environment. The experimental scenes included two that provided strong velocity/weak position feedback, one of which had a vertical foreground object (SVWP+) and one without (SVWP-), and one scene providing weak velocity/strong position (WVSP) feedback. Subjects' success rates in the experimental environments were normalized by the success rate in the normal environment in order to allow comparisons between subjects using a mixed model repeated measures analysis of variance. The normalized success rate was significantly greater in SVWP+ than in WVSP (p = .0001) and SVWP- (p = .013). Visual feedback significantly affected the normalized unipedal balance success rates (p = .001); neither the group effect nor the group X visual environment interaction was significant (p = .9362 and p = .5634, respectively). Normalized success rates did not differ significantly between the young men and older women in any visual environment. Near the limit of the young men's or older women's balance capability, the reliability of transfer to unipedal balance was adversely affected by visual environments offering attenuated visual velocity feedback cues and those devoid of vertical foreground objects.

Directional errors of movements and their correction in a discrete tracking task. [pilot reaction time and sensorimotor performance

NASA Technical Reports Server (NTRS)

Jaeger, R. J.; Agarwal, G. C.; Gottlieb, G. L.

1978-01-01

Subjects can correct their own errors of movement more quickly than they can react to external stimuli by using three general categories of feedback: (1) knowledge of results, primarily visually mediated; (2) proprioceptive or kinaesthetic such as from muscle spindles and joint receptors, and (3) corollary discharge or efference copy within the central nervous system. The effects of these feedbacks on simple reaction time, choice reaction time, and error correction time were studied in four normal human subjects. The movement used was plantarflexion and dorsiflexion of the ankle joint. The feedback loops were modified, by changing the sign of the visual display to alter the subject's perception of results, and by applying vibration at 100 Hz simultaneously to both the agonist and antagonist muscles of the ankle joint. The central processing was interfered with when the subjects were given moderate doses of alcohol (blood alcohol concentration levels of up to 0.07%). Vibration and alcohol increase both the simple and choice reaction times but not the error correction time.

Lingual electrotactile stimulation as an alternative sensory feedback pathway for brain-computer interface applications

NASA Astrophysics Data System (ADS)

Wilson, J. Adam; Walton, Léo M.; Tyler, Mitch; Williams, Justin

2012-08-01

This article describes a new method of providing feedback during a brain-computer interface movement task using a non-invasive, high-resolution electrotactile vision substitution system. We compared the accuracy and movement times during a center-out cursor movement task, and found that the task performance with tactile feedback was comparable to visual feedback for 11 participants. These subjects were able to modulate the chosen BCI EEG features during both feedback modalities, indicating that the type of feedback chosen does not matter provided that the task information is clearly conveyed through the chosen medium. In addition, we tested a blind subject with the tactile feedback system, and found that the training time, accuracy, and movement times were indistinguishable from results obtained from subjects using visual feedback. We believe that BCI systems with alternative feedback pathways should be explored, allowing individuals with severe motor disabilities and accompanying reduced visual and sensory capabilities to effectively use a BCI.

Secondary adaptation of memory-guided saccades

PubMed Central

Srimal, Riju; Curtis, Clayton E.

2011-01-01

Adaptation of saccade gains in response to errors keeps vision and action co-registered in the absence of awareness or effort. Timing is key, as the visual error must be available shortly after the saccade is generated or adaptation does not occur. Here, we tested the hypothesis that when feedback is delayed, learning still occurs, but does so through small secondary corrective saccades. Using a memory-guided saccade task, we gave feedback about the accuracy of saccades that was falsely displaced by a consistent amount, but only after long delays. Despite the delayed feedback, over time subjects improved in accuracy toward the false feedback. They did so not by adjusting their primary saccades, but via directed corrective saccades made before feedback was given. We propose that saccade learning may be driven by different types of feedback teaching signals. One teaching signal relies upon a tight temporal relation with the saccade and contributes to obligatory learning independent of awareness. When this signal is ineffective due to delayed error feedback, a second compensatory teaching signal enables flexible adjustments to the spatial goal of saccades and helps maintain sensorimotor accuracy. PMID:20803135

Quantitative impact of direct, personal feedback on hand hygiene technique.

PubMed

Lehotsky, Á; Szilágyi, L; Ferenci, T; Kovács, L; Pethes, R; Wéber, G; Haidegger, T

2015-09-01

This study investigated the effectiveness of targeting hand hygiene technique using a new training device that provides objective, personal and quantitative feedback. One hundred and thirty-six healthcare workers in three Hungarian hospitals participated in a repetitive hand hygiene technique assessment study. Ultraviolet (UV)-labelled hand rub was used at each event, and digital images of the hands were subsequently taken under UV light. Immediate objective visual feedback was given to participants, showing missed areas on their hands. The rate of inadequate hand rubbing reduced from 50% to 15% (P < 0.001). However, maintenance of this reduced rate is likely to require continuous use of the electronic equipment. Copyright © 2015 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

Visual Feedback of the Non-Moving Limb Improves Active Joint-Position Sense of the Impaired Limb in Spastic Hemiparetic Cerebral Palsy

ERIC Educational Resources Information Center

Smorenburg, Ana R. P.; Ledebt, Annick; Deconinck, Frederik J. A.; Savelsbergh, Geert J. P.

2011-01-01

This study examined the active joint-position sense in children with Spastic Hemiparetic Cerebral Palsy (SHCP) and the effect of static visual feedback and static mirror visual feedback, of the non-moving limb, on the joint-position sense. Participants were asked to match the position of one upper limb with that of the contralateral limb. The task…

Reducing Trunk Compensation in Stroke Survivors: A Randomized Crossover Trial Comparing Visual and Force Feedback Modalities.

PubMed

Valdés, Bulmaro Adolfo; Schneider, Andrea Nicole; Van der Loos, H F Machiel

2017-10-01

To investigate whether the compensatory trunk movements of stroke survivors observed during reaching tasks can be decreased by force and visual feedback, and to examine whether one of these feedback modalities is more efficacious than the other in reducing this compensatory tendency. Randomized crossover trial. University research laboratory. Community-dwelling older adults (N=15; 5 women; mean age, 64±11y) with hemiplegia from nontraumatic hemorrhagic or ischemic stroke (>3mo poststroke), recruited from stroke recovery groups, the research group's website, and the community. In a single session, participants received augmented feedback about their trunk compensation during a bimanual reaching task. Visual feedback (60 trials) was delivered through a computer monitor, and force feedback (60 trials) was delivered through 2 robotic devices. Primary outcome measure included change in anterior trunk displacement measured by motion tracking camera. Secondary outcomes included trunk rotation, index of curvature (measure of straightness of hands' path toward target), root mean square error of hands' movement (differences between hand position on every iteration of the program), completion time for each trial, and posttest questionnaire to evaluate users' experience and system's usability. Both visual (-45.6% [45.8 SD] change from baseline, P=.004) and force (-41.1% [46.1 SD], P=.004) feedback were effective in reducing trunk compensation. Scores on secondary outcome measures did not improve with either feedback modality. Neither feedback condition was superior. Visual and force feedback show promise as 2 modalities that could be used to decrease trunk compensation in stroke survivors during reaching tasks. It remains to be established which one of these 2 feedback modalities is more efficacious than the other as a cue to reduce compensatory trunk movement. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Visually driven chaining of elementary swim patterns into a goal-directed motor sequence: a virtual reality study of zebrafish prey capture

PubMed Central

Trivedi, Chintan A.; Bollmann, Johann H.

2013-01-01

Prey capture behavior critically depends on rapid processing of sensory input in order to track, approach, and catch the target. When using vision, the nervous system faces the problem of extracting relevant information from a continuous stream of input in order to detect and categorize visible objects as potential prey and to select appropriate motor patterns for approach. For prey capture, many vertebrates exhibit intermittent locomotion, in which discrete motor patterns are chained into a sequence, interrupted by short periods of rest. Here, using high-speed recordings of full-length prey capture sequences performed by freely swimming zebrafish larvae in the presence of a single paramecium, we provide a detailed kinematic analysis of first and subsequent swim bouts during prey capture. Using Fourier analysis, we show that individual swim bouts represent an elementary motor pattern. Changes in orientation are directed toward the target on a graded scale and are implemented by an asymmetric tail bend component superimposed on this basic motor pattern. To further investigate the role of visual feedback on the efficiency and speed of this complex behavior, we developed a closed-loop virtual reality setup in which minimally restrained larvae recapitulated interconnected swim patterns closely resembling those observed during prey capture in freely moving fish. Systematic variation of stimulus properties showed that prey capture is initiated within a narrow range of stimulus size and velocity. Furthermore, variations in the delay and location of swim triggered visual feedback showed that the reaction time of secondary and later swims is shorter for stimuli that appear within a narrow spatio-temporal window following a swim. This suggests that the larva may generate an expectation of stimulus position, which enables accelerated motor sequencing if the expectation is met by appropriate visual feedback. PMID:23675322

Watch what you type: the role of visual feedback from the screen and hands in skilled typewriting.

PubMed

Snyder, Kristy M; Logan, Gordon D; Yamaguchi, Motonori

2015-01-01

Skilled typing is controlled by two hierarchically structured processing loops (Logan & Crump, 2011): The outer loop, which produces words, commands the inner loop, which produces keystrokes. Here, we assessed the interplay between the two loops by investigating how visual feedback from the screen (responses either were or were not echoed on the screen) and the hands (the hands either were or were not covered with a box) influences the control of skilled typing. Our results indicated, first, that the reaction time of the first keystroke was longer when responses were not echoed than when they were. Also, the interkeystroke interval (IKSI) was longer when the hands were covered than when they were visible, and the IKSI for responses that were not echoed was longer when explicit error monitoring was required (Exp. 2) than when it was not required (Exp. 1). Finally, explicit error monitoring was more accurate when response echoes were present than when they were absent, and implicit error monitoring (i.e., posterror slowing) was not influenced by visual feedback from the screen or the hands. These findings suggest that the outer loop adjusts the inner-loop timing parameters to compensate for reductions in visual feedback. We suggest that these adjustments are preemptive control strategies designed to execute keystrokes more cautiously when visual feedback from the hands is absent, to generate more cautious motor programs when visual feedback from the screen is absent, and to enable enough time for the outer loop to monitor keystrokes when visual feedback from the screen is absent and explicit error reports are required.

Fast visual prediction and slow optimization of preferred walking speed.

PubMed

O'Connor, Shawn M; Donelan, J Maxwell

2012-05-01

People prefer walking speeds that minimize energetic cost. This may be accomplished by directly sensing metabolic rate and adapting gait to minimize it, but only slowly due to the compounded effects of sensing delays and iterative convergence. Visual and other sensory information is available more rapidly and could help predict which gait changes reduce energetic cost, but only approximately because it relies on prior experience and an indirect means to achieve economy. We used virtual reality to manipulate visually presented speed while 10 healthy subjects freely walked on a self-paced treadmill to test whether the nervous system beneficially combines these two mechanisms. Rather than manipulating the speed of visual flow directly, we coupled it to the walking speed selected by the subject and then manipulated the ratio between these two speeds. We then quantified the dynamics of walking speed adjustments in response to perturbations of the visual speed. For step changes in visual speed, subjects responded with rapid speed adjustments (lasting <2 s) and in a direction opposite to the perturbation and consistent with returning the visually presented speed toward their preferred walking speed, when visual speed was suddenly twice (one-half) the walking speed, subjects decreased (increased) their speed. Subjects did not maintain the new speed but instead gradually returned toward the speed preferred before the perturbation (lasting >300 s). The timing and direction of these responses strongly indicate that a rapid predictive process informed by visual feedback helps select preferred speed, perhaps to complement a slower optimization process that seeks to minimize energetic cost.

Congenitally blind individuals rapidly adapt to coriolis force perturbations of their reaching movements

NASA Technical Reports Server (NTRS)

DiZio, P.; Lackner, J. R.

2000-01-01

Reaching movements made to visual targets in a rotating room are initially deviated in path and endpoint in the direction of transient Coriolis forces generated by the motion of the arm relative to the rotating environment. With additional reaches, movements become progressively straighter and more accurate. Such adaptation can occur even in the absence of visual feedback about movement progression or terminus. Here we examined whether congenitally blind and sighted subjects without visual feedback would demonstrate adaptation to Coriolis forces when they pointed to a haptically specified target location. Subjects were tested pre-, per-, and postrotation at 10 rpm counterclockwise. Reaching to straight ahead targets prerotation, both groups exhibited slightly curved paths. Per-rotation, both groups showed large initial deviations of movement path and curvature but within 12 reaches on average had returned to prerotation curvature levels and endpoints. Postrotation, both groups showed mirror image patterns of curvature and endpoint to the per-rotation pattern. The groups did not differ significantly on any of the performance measures. These results provide compelling evidence that motor adaptation to Coriolis perturbations can be achieved on the basis of proprioceptive, somatosensory, and motor information in the complete absence of visual experience.

Cortical feedback signals generalise across different spatial frequencies of feedforward inputs.

PubMed

Revina, Yulia; Petro, Lucy S; Muckli, Lars

2017-09-22

Visual processing in cortex relies on feedback projections contextualising feedforward information flow. Primary visual cortex (V1) has small receptive fields and processes feedforward information at a fine-grained spatial scale, whereas higher visual areas have larger, spatially invariant receptive fields. Therefore, feedback could provide coarse information about the global scene structure or alternatively recover fine-grained structure by targeting small receptive fields in V1. We tested if feedback signals generalise across different spatial frequencies of feedforward inputs, or if they are tuned to the spatial scale of the visual scene. Using a partial occlusion paradigm, functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA) we investigated whether feedback to V1 contains coarse or fine-grained information by manipulating the spatial frequency of the scene surround outside an occluded image portion. We show that feedback transmits both coarse and fine-grained information as it carries information about both low (LSF) and high spatial frequencies (HSF). Further, feedback signals containing LSF information are similar to feedback signals containing HSF information, even without a large overlap in spatial frequency bands of the HSF and LSF scenes. Lastly, we found that feedback carries similar information about the spatial frequency band across different scenes. We conclude that cortical feedback signals contain information which generalises across different spatial frequencies of feedforward inputs. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Connectivity Reveals Sources of Predictive Coding Signals in Early Visual Cortex During Processing of Visual Optic Flow.

PubMed

Schindler, Andreas; Bartels, Andreas

2017-05-01

Superimposed on the visual feed-forward pathway, feedback connections convey higher level information to cortical areas lower in the hierarchy. A prominent framework for these connections is the theory of predictive coding where high-level areas send stimulus interpretations to lower level areas that compare them with sensory input. Along these lines, a growing body of neuroimaging studies shows that predictable stimuli lead to reduced blood oxygen level-dependent (BOLD) responses compared with matched nonpredictable counterparts, especially in early visual cortex (EVC) including areas V1-V3. The sources of these modulatory feedback signals are largely unknown. Here, we re-examined the robust finding of relative BOLD suppression in EVC evident during processing of coherent compared with random motion. Using functional connectivity analysis, we show an optic flow-dependent increase of functional connectivity between BOLD suppressed EVC and a network of visual motion areas including MST, V3A, V6, the cingulate sulcus visual area (CSv), and precuneus (Pc). Connectivity decreased between EVC and 2 areas known to encode heading direction: entorhinal cortex (EC) and retrosplenial cortex (RSC). Our results provide first evidence that BOLD suppression in EVC for predictable stimuli is indeed mediated by specific high-level areas, in accord with the theory of predictive coding. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Spatial updating depends on gaze direction even after loss of vision.

PubMed

Reuschel, Johanna; Rösler, Frank; Henriques, Denise Y P; Fiehler, Katja

2012-02-15

Direction of gaze (eye angle + head angle) has been shown to be important for representing space for action, implying a crucial role of vision for spatial updating. However, blind people have no access to vision yet are able to perform goal-directed actions successfully. Here, we investigated the role of visual experience for localizing and updating targets as a function of intervening gaze shifts in humans. People who differed in visual experience (late blind, congenitally blind, or sighted) were briefly presented with a proprioceptive reach target while facing it. Before they reached to the target's remembered location, they turned their head toward an eccentric direction that also induced corresponding eye movements in sighted and late blind individuals. We found that reaching errors varied systematically as a function of shift in gaze direction only in participants with early visual experience (sighted and late blind). In the late blind, this effect was solely present in people with moveable eyes but not in people with at least one glass eye. Our results suggest that the effect of gaze shifts on spatial updating develops on the basis of visual experience early in life and remains even after loss of vision as long as feedback from the eyes and head is available.

Real-time computer-based visual feedback improves visual acuity in downbeat nystagmus - a pilot study.

PubMed

Teufel, Julian; Bardins, S; Spiegel, Rainer; Kremmyda, O; Schneider, E; Strupp, M; Kalla, R

2016-01-04

Patients with downbeat nystagmus syndrome suffer from oscillopsia, which leads to an unstable visual perception and therefore impaired visual acuity. The aim of this study was to use real-time computer-based visual feedback to compensate for the destabilizing slow phase eye movements. The patients were sitting in front of a computer screen with the head fixed on a chin rest. The eye movements were recorded by an eye tracking system (EyeSeeCam®). We tested the visual acuity with a fixed Landolt C (static) and during real-time feedback driven condition (dynamic) in gaze straight ahead and (20°) sideward gaze. In the dynamic condition, the Landolt C moved according to the slow phase eye velocity of the downbeat nystagmus. The Shapiro-Wilk test was used to test for normal distribution and one-way ANOVA for comparison. Ten patients with downbeat nystagmus were included in the study. Median age was 76 years and the median duration of symptoms was 6.3 years (SD +/- 3.1y). The mean slow phase velocity was moderate during gaze straight ahead (1.44°/s, SD +/- 1.18°/s) and increased significantly in sideward gaze (mean left 3.36°/s; right 3.58°/s). In gaze straight ahead, we found no difference between the static and feedback driven condition. In sideward gaze, visual acuity improved in five out of ten subjects during the feedback-driven condition (p = 0.043). This study provides proof of concept that non-invasive real-time computer-based visual feedback compensates for the SPV in DBN. Therefore, real-time visual feedback may be a promising aid for patients suffering from oscillopsia and impaired text reading on screen. Recent technological advances in the area of virtual reality displays might soon render this approach feasible in fully mobile settings.

The absence or temporal offset of visual feedback does not influence adaptation to novel movement dynamics.

PubMed

McKenna, Erin; Bray, Laurence C Jayet; Zhou, Weiwei; Joiner, Wilsaan M

2017-10-01

Delays in transmitting and processing sensory information require correctly associating delayed feedback to issued motor commands for accurate error compensation. The flexibility of this alignment between motor signals and feedback has been demonstrated for movement recalibration to visual manipulations, but the alignment dependence for adapting movement dynamics is largely unknown. Here we examined the effect of visual feedback manipulations on force-field adaptation. Three subject groups used a manipulandum while experiencing a lag in the corresponding cursor motion (0, 75, or 150 ms). When the offset was applied at the start of the session (continuous condition), adaptation was not significantly different between groups. However, these similarities may be due to acclimation to the offset before motor adaptation. We tested additional subjects who experienced the same delays concurrent with the introduction of the perturbation (abrupt condition). In this case adaptation was statistically indistinguishable from the continuous condition, indicating that acclimation to feedback delay was not a factor. In addition, end-point errors were not significantly different across the delay or onset conditions, but end-point correction (e.g., deceleration duration) was influenced by the temporal offset. As an additional control, we tested a group of subjects who performed without visual feedback and found comparable movement adaptation results. These results suggest that visual feedback manipulation (absence or temporal misalignment) does not affect adaptation to novel dynamics, independent of both acclimation and perceptual awareness. These findings could have implications for modeling how the motor system adjusts to errors despite concurrent delays in sensory feedback information. NEW & NOTEWORTHY A temporal offset between movement and distorted visual feedback (e.g., visuomotor rotation) influences the subsequent motor recalibration, but the effects of this offset for altered movement dynamics are largely unknown. Here we examined the influence of 1 ) delayed and 2 ) removed visual feedback on the adaptation to novel movement dynamics. These results contribute to understanding of the control strategies that compensate for movement errors when there is a temporal separation between motion state and sensory information. Copyright © 2017 the American Physiological Society.

Upper extremity rehabilitation of stroke: facilitation of corticospinal excitability using virtual mirror paradigm.

PubMed

Kang, Youn Joo; Park, Hae Kyung; Kim, Hyun Jung; Lim, Taeo; Ku, Jeonghun; Cho, Sangwoo; Kim, Sun I; Park, Eun Sook

2012-10-04

Several experimental studies in stroke patients suggest that mirror therapy and various virtual reality programs facilitate motor rehabilitation. However, the underlying mechanisms for these therapeutic effects have not been previously described. We attempted to delineate the changes in corticospinal excitability when individuals were asked to exercise their upper extremity using a real mirror and virtual mirror. Moreover, we attempted to delineate the role of visual modulation within the virtual environment that affected corticospinal excitability in healthy subjects and stroke patients. A total of 18 healthy subjects and 18 hemiplegic patients were enrolled into the study. Motor evoked potential (MEP)s from transcranial magnetic stimulation were recorded in the flexor carpi radialis of the non-dominant or affected upper extremity using three different conditions: (A) relaxation; (B) real mirror; and (C) virtual mirror. Moreover, we compared the MEPs from the virtual mirror paradigm using continuous visual feedback or intermittent visual feedback. The rates of amplitude increment and latency decrement of MEPs in both groups were higher during the virtual mirror task than during the real mirror. In healthy subjects and stroke patients, the virtual mirror task with intermittent visual feedback significantly facilitated corticospinal excitability of MEPs compared with continuous visual feedback. Corticospinal excitability was facilitated to a greater extent in the virtual mirror paradigm than in the real mirror and in intermittent visual feedback than in the continuous visual feedback, in both groups. This provides neurophysiological evidence supporting the application of the virtual mirror paradigm using various visual modulation technologies to upper extremity rehabilitation in stroke patients.

Upper extremity rehabilitation of stroke: Facilitation of corticospinal excitability using virtual mirror paradigm

PubMed Central

2012-01-01

Background Several experimental studies in stroke patients suggest that mirror therapy and various virtual reality programs facilitate motor rehabilitation. However, the underlying mechanisms for these therapeutic effects have not been previously described. Objectives We attempted to delineate the changes in corticospinal excitability when individuals were asked to exercise their upper extremity using a real mirror and virtual mirror. Moreover, we attempted to delineate the role of visual modulation within the virtual environment that affected corticospinal excitability in healthy subjects and stroke patients. Methods A total of 18 healthy subjects and 18 hemiplegic patients were enrolled into the study. Motor evoked potential (MEP)s from transcranial magnetic stimulation were recorded in the flexor carpi radialis of the non-dominant or affected upper extremity using three different conditions: (A) relaxation; (B) real mirror; and (C) virtual mirror. Moreover, we compared the MEPs from the virtual mirror paradigm using continuous visual feedback or intermittent visual feedback. Results The rates of amplitude increment and latency decrement of MEPs in both groups were higher during the virtual mirror task than during the real mirror. In healthy subjects and stroke patients, the virtual mirror task with intermittent visual feedback significantly facilitated corticospinal excitability of MEPs compared with continuous visual feedback. Conclusion Corticospinal excitability was facilitated to a greater extent in the virtual mirror paradigm than in the real mirror and in intermittent visual feedback than in the continuous visual feedback, in both groups. This provides neurophysiological evidence supporting the application of the virtual mirror paradigm using various visual modulation technologies to upper extremity rehabilitation in stroke patients. PMID:23035951

Effects of Vibrotactile Feedback on Human Learning of Arm Motions

PubMed Central

Bark, Karlin; Hyman, Emily; Tan, Frank; Cha, Elizabeth; Jax, Steven A.; Buxbaum, Laurel J.; Kuchenbecker, Katherine J.

2015-01-01

Tactile cues generated from lightweight, wearable actuators can help users learn new motions by providing immediate feedback on when and how to correct their movements. We present a vibrotactile motion guidance system that measures arm motions and provides vibration feedback when the user deviates from a desired trajectory. A study was conducted to test the effects of vibrotactile guidance on a subject’s ability to learn arm motions. Twenty-six subjects learned motions of varying difficulty with both visual (V), and visual and vibrotactile (VVT) feedback over the course of four days of training. After four days of rest, subjects returned to perform the motions from memory with no feedback. We found that augmenting visual feedback with vibrotactile feedback helped subjects reduce the root mean square (rms) angle error of their limb significantly while they were learning the motions, particularly for 1DOF motions. Analysis of the retention data showed no significant difference in rms angle errors between feedback conditions. PMID:25486644

Multimodal Excitatory Interfaces with Automatic Content Classification

NASA Astrophysics Data System (ADS)

Williamson, John; Murray-Smith, Roderick

We describe a non-visual interface for displaying data on mobile devices, based around active exploration: devices are shaken, revealing the contents rattling around inside. This combines sample-based contact sonification with event playback vibrotactile feedback for a rich and compelling display which produces an illusion much like balls rattling inside a box. Motion is sensed from accelerometers, directly linking the motions of the user to the feedback they receive in a tightly closed loop. The resulting interface requires no visual attention and can be operated blindly with a single hand: it is reactive rather than disruptive. This interaction style is applied to the display of an SMS inbox. We use language models to extract salient features from text messages automatically. The output of this classification process controls the timbre and physical dynamics of the simulated objects. The interface gives a rapid semantic overview of the contents of an inbox, without compromising privacy or interrupting the user.

Surgical simulation software for insertion of pedicle screws.

PubMed

Eftekhar, Behzad; Ghodsi, Mohammad; Ketabchi, Ebrahim; Rasaee, Saman

2002-01-01

As the first step toward finding noninvasive alternatives to the traditional methods of surgical training, we have developed a small, stand-alone computer program that simulates insertion of pedicle screws in different spinal vertebrae (T10-L5). We used Delphi 5.0 and DirectX 7.0 extension for Microsoft Windows. This is a stand-alone and portable program. The program can run on most personal computers. It provides the trainee with visual feedback during practice of the technique. At present, it uses predefined three-dimensional images of the vertebrae, but we are attempting to adapt the program to three-dimensional objects based on real computed tomographic scans of the patients. The program can be downloaded at no cost from the web site: www.tums.ac.ir/downloads As a preliminary work, it requires further development, particularly toward better visual, auditory, and even proprioceptive feedback and use of the individual patient's data.

Wrist Camera Orientation for Effective Telerobotic Orbital Replaceable Unit (ORU) Changeout

NASA Technical Reports Server (NTRS)

Jones, Sharon Monica; Aldridge, Hal A.; Vazquez, Sixto L.

1997-01-01

The Hydraulic Manipulator Testbed (HMTB) is the kinematic replica of the Flight Telerobotic Servicer (FTS). One use of the HMTB is to evaluate advanced control techniques for accomplishing robotic maintenance tasks on board the Space Station. Most maintenance tasks involve the direct manipulation of the robot by a human operator when high-quality visual feedback is important for precise control. An experiment was conducted in the Systems Integration Branch at the Langley Research Center to compare several configurations of the manipulator wrist camera for providing visual feedback during an Orbital Replaceable Unit changeout task. Several variables were considered such as wrist camera angle, camera focal length, target location, lighting. Each study participant performed the maintenance task by using eight combinations of the variables based on a Latin square design. The results of this experiment and conclusions based on data collected are presented.

Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind.

PubMed

Kim, Donghun; Kim, Kwangtaek; Lee, Sangyoun

2014-06-13

In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.

Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind

PubMed Central

Kim, Donghun; Kim, Kwangtaek; Lee, Sangyoun

2014-01-01

In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind. PMID:24932864

Acoustic-tactile rendering of visual information

NASA Astrophysics Data System (ADS)

Silva, Pubudu Madhawa; Pappas, Thrasyvoulos N.; Atkins, Joshua; West, James E.; Hartmann, William M.

2012-03-01

In previous work, we have proposed a dynamic, interactive system for conveying visual information via hearing and touch. The system is implemented with a touch screen that allows the user to interrogate a two-dimensional (2-D) object layout by active finger scanning while listening to spatialized auditory feedback. Sound is used as the primary source of information for object localization and identification, while touch is used both for pointing and for kinesthetic feedback. Our previous work considered shape and size perception of simple objects via hearing and touch. The focus of this paper is on the perception of a 2-D layout of simple objects with identical size and shape. We consider the selection and rendition of sounds for object identification and localization. We rely on the head-related transfer function for rendering sound directionality, and consider variations of sound intensity and tempo as two alternative approaches for rendering proximity. Subjective experiments with visually-blocked subjects are used to evaluate the effectiveness of the proposed approaches. Our results indicate that intensity outperforms tempo as a proximity cue, and that the overall system for conveying a 2-D layout is quite promising.

Estimating the implicit component of visuomotor rotation learning by constraining movement preparation time.

PubMed

Leow, Li-Ann; Gunn, Reece; Marinovic, Welber; Carroll, Timothy J

2017-08-01

When sensory feedback is perturbed, accurate movement is restored by a combination of implicit processes and deliberate reaiming to strategically compensate for errors. Here, we directly compare two methods used previously to dissociate implicit from explicit learning on a trial-by-trial basis: 1 ) asking participants to report the direction that they aim their movements, and contrasting this with the directions of the target and the movement that they actually produce, and 2 ) manipulating movement preparation time. By instructing participants to reaim without a sensory perturbation, we show that reaiming is possible even with the shortest possible preparation times, particularly when targets are narrowly distributed. Nonetheless, reaiming is effortful and comes at the cost of increased variability, so we tested whether constraining preparation time is sufficient to suppress strategic reaiming during adaptation to visuomotor rotation with a broad target distribution. The rate and extent of error reduction under preparation time constraints were similar to estimates of implicit learning obtained from self-report without time pressure, suggesting that participants chose not to apply a reaiming strategy to correct visual errors under time pressure. Surprisingly, participants who reported aiming directions showed less implicit learning according to an alternative measure, obtained during trials performed without visual feedback. This suggests that the process of reporting can affect the extent or persistence of implicit learning. The data extend existing evidence that restricting preparation time can suppress explicit reaiming and provide an estimate of implicit visuomotor rotation learning that does not require participants to report their aiming directions. NEW & NOTEWORTHY During sensorimotor adaptation, implicit error-driven learning can be isolated from explicit strategy-driven reaiming by subtracting self-reported aiming directions from movement directions, or by restricting movement preparation time. Here, we compared the two methods. Restricting preparation times did not eliminate reaiming but was sufficient to suppress reaiming during adaptation with widely distributed targets. The self-report method produced a discrepancy in implicit learning estimated by subtracting aiming directions and implicit learning measured in no-feedback trials. Copyright © 2017 the American Physiological Society.

Corticothalamic feedback enhances stimulus response precision in the visual system

PubMed Central

Andolina, Ian M.; Jones, Helen E.; Wang, Wei; Sillito, Adam M.

2007-01-01

There is a tightly coupled bidirectional interaction between visual cortex and visual thalamus [lateral geniculate nucleus (LGN)]. Using drifting sinusoidal grating stimuli, we compared the response of cells in the LGN with and without feedback from the visual cortex. Raster plots revealed a striking difference in the response pattern of cells with and without feedback. This difference was reflected in the results from computing vector sum plots and the ratio of zero harmonic to the fundamental harmonic of the fast Fourier transform (FFT) for these responses. The variability of responses assessed by using the Fano factor was also different for the two groups, with the cells without feedback showing higher variability. We examined the covariance of these measures between pairs of simultaneously recorded cells with and without feedback, and they were much more strongly positively correlated with feedback. We constructed orientation tuning curves from the central 5 ms in the raw cross-correlograms of the outputs of pairs of LGN cells, and these curves revealed much sharper tuning with feedback. We discuss the significance of these data for cortical function and suggest that the precision in stimulus-linked firing in the LGN appears as an emergent factor from the corticothalamic interaction. PMID:17237220

Stability of hand force production. I. Hand level control variables and multifinger synergies.

PubMed

Reschechtko, Sasha; Latash, Mark L

2017-12-01

We combined the theory of neural control of movement with referent coordinates and the uncontrolled manifold hypothesis to explore synergies stabilizing the hand action in accurate four-finger pressing tasks. In particular, we tested a hypothesis on two classes of synergies, those among the four fingers and those within a pair of control variables, stabilizing hand action under visual feedback and disappearing without visual feedback. Subjects performed four-finger total force and moment production tasks under visual feedback; the feedback was later partially or completely removed. The "inverse piano" device was used to lift and lower the fingers smoothly at the beginning and at the end of each trial. These data were used to compute pairs of hypothetical control variables. Intertrial analysis of variance within the finger force space was used to quantify multifinger synergies stabilizing both force and moment. A data permutation method was used to quantify synergies among control variables. Under visual feedback, synergies in the spaces of finger forces and hypothetical control variables were found to stabilize total force. Without visual feedback, the subjects showed a force drift to lower magnitudes and a moment drift toward pronation. This was accompanied by disappearance of the four-finger synergies and strong attenuation of the control variable synergies. The indexes of the two types of synergies correlated with each other. The findings are interpreted within the scheme with multiple levels of abundant variables. NEW & NOTEWORTHY We extended the idea of hierarchical control with referent spatial coordinates for the effectors and explored two types of synergies stabilizing multifinger force production tasks. We observed synergies among finger forces and synergies between hypothetical control variables that stabilized performance under visual feedback but failed to stabilize it after visual feedback had been removed. Indexes of two types of synergies correlated with each other. The data suggest the existence of multiple mechanisms stabilizing motor actions. Copyright © 2017 the American Physiological Society.

Adaptation to Coriolis force perturbation of movement trajectory; role of proprioceptive and cutaneous somatosensory feedback

NASA Technical Reports Server (NTRS)

Lackner, James R.; DiZio, Paul

2002-01-01

Subjects exposed to constant velocity rotation in a large fully-enclosed room that rotates initially make large reaching errors in pointing to targets. The paths and endpoints of their reaches are deviated in the direction of the transient lateral Coriolis forces generated by the forward velocity of their reaches. With additional reaches, subjects soon reach in straighter paths and become more accurate at landing on target even in the absence of visual feedback about their movements. Two factors contribute to this adaptation: first, muscle spindle and golgi tendon organ feedback interpreted in relation to efferent commands provide information about movement trajectory, and second, somatosensory stimulation of the fingertip at the completion of a reach provides information about the location of the fingertip relative to the torso.

Effect of visual distraction and auditory feedback on patient effort during robot-assisted movement training after stroke

PubMed Central

2011-01-01

Background Practicing arm and gait movements with robotic assistance after neurologic injury can help patients improve their movement ability, but patients sometimes reduce their effort during training in response to the assistance. Reduced effort has been hypothesized to diminish clinical outcomes of robotic training. To better understand patient slacking, we studied the role of visual distraction and auditory feedback in modulating patient effort during a common robot-assisted tracking task. Methods Fourteen participants with chronic left hemiparesis from stroke, five control participants with chronic right hemiparesis and fourteen non-impaired healthy control participants, tracked a visual target with their arms while receiving adaptive assistance from a robotic arm exoskeleton. We compared four practice conditions: the baseline tracking task alone; tracking while also performing a visual distracter task; tracking with the visual distracter and sound feedback; and tracking with sound feedback. For the distracter task, symbols were randomly displayed in the corners of the computer screen, and the participants were instructed to click a mouse button when a target symbol appeared. The sound feedback consisted of a repeating beep, with the frequency of repetition made to increase with increasing tracking error. Results Participants with stroke halved their effort and doubled their tracking error when performing the visual distracter task with their left hemiparetic arm. With sound feedback, however, these participants increased their effort and decreased their tracking error close to their baseline levels, while also performing the distracter task successfully. These effects were significantly smaller for the participants who used their non-paretic arm and for the participants without stroke. Conclusions Visual distraction decreased participants effort during a standard robot-assisted movement training task. This effect was greater for the hemiparetic arm, suggesting that the increased demands associated with controlling an affected arm make the motor system more prone to slack when distracted. Providing an alternate sensory channel for feedback, i.e., auditory feedback of tracking error, enabled the participants to simultaneously perform the tracking task and distracter task effectively. Thus, incorporating real-time auditory feedback of performance errors might improve clinical outcomes of robotic therapy systems. PMID:21513561

Concurrent audio-visual feedback for supporting drivers at intersections: A study using two linked driving simulators.

PubMed

Houtenbos, M; de Winter, J C F; Hale, A R; Wieringa, P A; Hagenzieker, M P

2017-04-01

A large portion of road traffic crashes occur at intersections for the reason that drivers lack necessary visual information. This research examined the effects of an audio-visual display that provides real-time sonification and visualization of the speed and direction of another car approaching the crossroads on an intersecting road. The location of red blinking lights (left vs. right on the speedometer) and the lateral input direction of beeps (left vs. right ear in headphones) corresponded to the direction from where the other car approached, and the blink and beep rates were a function of the approaching car's speed. Two driving simulators were linked so that the participant and the experimenter drove in the same virtual world. Participants (N = 25) completed four sessions (two with the audio-visual display on, two with the audio-visual display off), each session consisting of 22 intersections at which the experimenter approached from the left or right and either maintained speed or slowed down. Compared to driving with the display off, the audio-visual display resulted in enhanced traffic efficiency (i.e., greater mean speed, less coasting) while not compromising safety (i.e., the time gap between the two vehicles was equivalent). A post-experiment questionnaire showed that the beeps were regarded as more useful than the lights. It is argued that the audio-visual display is a promising means of supporting drivers until fully automated driving is technically feasible. Copyright © 2016. Published by Elsevier Ltd.

Probing feedforward and feedback contributions to awareness with visual masking and transcranial magnetic stimulation.

PubMed

Tapia, Evelina; Beck, Diane M

2014-01-01

A number of influential theories posit that visual awareness relies not only on the initial, stimulus-driven (i.e., feedforward) sweep of activation but also on recurrent feedback activity within and between brain regions. These theories of awareness draw heavily on data from masking paradigms in which visibility of one stimulus is reduced due to the presence of another stimulus. More recently transcranial magnetic stimulation (TMS) has been used to study the temporal dynamics of visual awareness. TMS over occipital cortex affects performance on visual tasks at distinct time points and in a manner that is comparable to visual masking. We draw parallels between these two methods and examine evidence for the neural mechanisms by which visual masking and TMS suppress stimulus visibility. Specifically, both methods have been proposed to affect feedforward as well as feedback signals when applied at distinct time windows relative to stimulus onset and as a result modify visual awareness. Most recent empirical evidence, moreover, suggests that while visual masking and TMS impact stimulus visibility comparably, the processes these methods affect may not be as similar as previously thought. In addition to reviewing both masking and TMS studies that examine feedforward and feedback processes in vision, we raise questions to guide future studies and further probe the necessary conditions for visual awareness.

Can You Hear That Peak? Utilization of Auditory and Visual Feedback at Peak Limb Velocity

ERIC Educational Resources Information Center

Loria, Tristan; de Grosbois, John; Tremblay, Luc

2016-01-01

Purpose: At rest, the central nervous system combines and integrates multisensory cues to yield an optimal percept. When engaging in action, the relative weighing of sensory modalities has been shown to be altered. Because the timing of peak velocity is the critical moment in some goal-directed movements (e.g., overarm throwing), the current study…

Visualization-by-Sketching: An Artist's Interface for Creating Multivariate Time-Varying Data Visualizations.

PubMed

Schroeder, David; Keefe, Daniel F

2016-01-01

We present Visualization-by-Sketching, a direct-manipulation user interface for designing new data visualizations. The goals are twofold: First, make the process of creating real, animated, data-driven visualizations of complex information more accessible to artists, graphic designers, and other visual experts with traditional, non-technical training. Second, support and enhance the role of human creativity in visualization design, enabling visual experimentation and workflows similar to what is possible with traditional artistic media. The approach is to conceive of visualization design as a combination of processes that are already closely linked with visual creativity: sketching, digital painting, image editing, and reacting to exemplars. Rather than studying and tweaking low-level algorithms and their parameters, designers create new visualizations by painting directly on top of a digital data canvas, sketching data glyphs, and arranging and blending together multiple layers of animated 2D graphics. This requires new algorithms and techniques to interpret painterly user input relative to data "under" the canvas, balance artistic freedom with the need to produce accurate data visualizations, and interactively explore large (e.g., terabyte-sized) multivariate datasets. Results demonstrate a variety of multivariate data visualization techniques can be rapidly recreated using the interface. More importantly, results and feedback from artists support the potential for interfaces in this style to attract new, creative users to the challenging task of designing more effective data visualizations and to help these users stay "in the creative zone" as they work.

Bedside assistance in freehand ultrasonic diagnosis by real-time visual feedback of 3D scatter diagram of pulsatile tissue-motion

NASA Astrophysics Data System (ADS)

Fukuzawa, M.; Kawata, K.; Nakamori, N.; Kitsunezuka, Y.

2011-03-01

By real-time visual feedback of 3D scatter diagram of pulsatile tissue-motion, freehand ultrasonic diagnosis of neonatal ischemic diseases has been assisted at the bedside. The 2D ultrasonic movie was taken with a conventional ultrasonic apparatus (ATL HDI5000) and ultrasonic probes of 5-7 MHz with the compact tilt-sensor to measure the probe orientation. The real-time 3D visualization was realized by developing an extended version of the PC-based visualization system. The software was originally developed on the DirectX platform and optimized with the streaming SIMD extensions. The 3D scatter diagram of the latest pulsatile tissues has been continuously generated and visualized as projection image with the ultrasonic movie in the current section more than 15 fps. It revealed the 3D structure of pulsatile tissues such as middle and posterior cerebral arteries, Willis ring and cerebellar arteries, in which pediatricians have great interests in the blood flow because asphyxiated and/or low-birth-weight neonates have a high risk of ischemic diseases such as hypoxic-ischemic encephalopathy and periventricular leukomalacia. Since the pulsatile tissue-motion is due to local blood flow, it can be concluded that the system developed in this work is very useful to assist freehand ultrasonic diagnosis of ischemic diseases in the neonatal cranium.

Mirror Visual Feedback Training Improves Intermanual Transfer in a Sport-Specific Task: A Comparison between Different Skill Levels.

PubMed

Steinberg, Fabian; Pixa, Nils Henrik; Doppelmayr, Michael

2016-01-01

Mirror training therapy is a promising tool to initiate neural plasticity and facilitate the recovery process of motor skills after diseases such as stroke or hemiparesis by improving the intermanual transfer of fine motor skills in healthy people as well as in patients. This study evaluated whether these augmented performance improvements by mirror visual feedback (MVF) could be used for learning a sport-specific skill and if the effects are modulated by skill level. A sample of 39 young, healthy, and experienced basketball and handball players and 41 novices performed a stationary basketball dribble task at a mirror box in a standing position and received either MVF or direct feedback. After four training days using only the right hand, performance of both hands improved from pre- to posttest measurements. Only the left hand (untrained) performance of the experienced participants receiving MVF was more pronounced than for the control group. This indicates that intermanual motor transfer can be improved by MVF in a sport-specific task. However, this effect cannot be generalized to motor learning per se since it is modulated by individuals' skill level, a factor that might be considered in mirror therapy research.

Mirror Visual Feedback Training Improves Intermanual Transfer in a Sport-Specific Task: A Comparison between Different Skill Levels

PubMed Central

Pixa, Nils Henrik; Doppelmayr, Michael

2016-01-01

Mirror training therapy is a promising tool to initiate neural plasticity and facilitate the recovery process of motor skills after diseases such as stroke or hemiparesis by improving the intermanual transfer of fine motor skills in healthy people as well as in patients. This study evaluated whether these augmented performance improvements by mirror visual feedback (MVF) could be used for learning a sport-specific skill and if the effects are modulated by skill level. A sample of 39 young, healthy, and experienced basketball and handball players and 41 novices performed a stationary basketball dribble task at a mirror box in a standing position and received either MVF or direct feedback. After four training days using only the right hand, performance of both hands improved from pre- to posttest measurements. Only the left hand (untrained) performance of the experienced participants receiving MVF was more pronounced than for the control group. This indicates that intermanual motor transfer can be improved by MVF in a sport-specific task. However, this effect cannot be generalized to motor learning per se since it is modulated by individuals' skill level, a factor that might be considered in mirror therapy research. PMID:27642526

Visual crowding illustrates the inadequacy of local vs. global and feedforward vs. feedback distinctions in modeling visual perception

PubMed Central

Clarke, Aaron M.; Herzog, Michael H.; Francis, Gregory

2014-01-01

Experimentalists tend to classify models of visual perception as being either local or global, and involving either feedforward or feedback processing. We argue that these distinctions are not as helpful as they might appear, and we illustrate these issues by analyzing models of visual crowding as an example. Recent studies have argued that crowding cannot be explained by purely local processing, but that instead, global factors such as perceptual grouping are crucial. Theories of perceptual grouping, in turn, often invoke feedback connections as a way to account for their global properties. We examined three types of crowding models that are representative of global processing models, and two of which employ feedback processing: a model based on Fourier filtering, a feedback neural network, and a specific feedback neural architecture that explicitly models perceptual grouping. Simulations demonstrate that crucial empirical findings are not accounted for by any of the models. We conclude that empirical investigations that reject a local or feedforward architecture offer almost no constraints for model construction, as there are an uncountable number of global and feedback systems. We propose that the identification of a system as being local or global and feedforward or feedback is less important than the identification of a system's computational details. Only the latter information can provide constraints on model development and promote quantitative explanations of complex phenomena. PMID:25374554

Visual Feedback Dominates the Sense of Agency for Brain-Machine Actions

PubMed Central

Evans, Nathan; Gale, Steven; Schurger, Aaron; Blanke, Olaf

2015-01-01

Recent advances in neuroscience and engineering have led to the development of technologies that permit the control of external devices through real-time decoding of brain activity (brain-machine interfaces; BMI). Though the feeling of controlling bodily movements (sense of agency; SOA) has been well studied and a number of well-defined sensorimotor and cognitive mechanisms have been put forth, very little is known about the SOA for BMI-actions. Using an on-line BMI, and verifying that our subjects achieved a reasonable level of control, we sought to describe the SOA for BMI-mediated actions. Our results demonstrate that discrepancies between decoded neural activity and its resultant real-time sensory feedback are associated with a decrease in the SOA, similar to SOA mechanisms proposed for bodily actions. However, if the feedback discrepancy serves to correct a poorly controlled BMI-action, then the SOA can be high and can increase with increasing discrepancy, demonstrating the dominance of visual feedback on the SOA. Taken together, our results suggest that bodily and BMI-actions rely on common mechanisms of sensorimotor integration for agency judgments, but that visual feedback dominates the SOA in the absence of overt bodily movements or proprioceptive feedback, however erroneous the visual feedback may be. PMID:26066840

Visuomotor adaptation needs a validation of prediction error by feedback error

PubMed Central

Gaveau, Valérie; Prablanc, Claude; Laurent, Damien; Rossetti, Yves; Priot, Anne-Emmanuelle

2014-01-01

The processes underlying short-term plasticity induced by visuomotor adaptation to a shifted visual field are still debated. Two main sources of error can induce motor adaptation: reaching feedback errors, which correspond to visually perceived discrepancies between hand and target positions, and errors between predicted and actual visual reafferences of the moving hand. These two sources of error are closely intertwined and difficult to disentangle, as both the target and the reaching limb are simultaneously visible. Accordingly, the goal of the present study was to clarify the relative contributions of these two types of errors during a pointing task under prism-displaced vision. In “terminal feedback error” condition, viewing of their hand by subjects was allowed only at movement end, simultaneously with viewing of the target. In “movement prediction error” condition, viewing of the hand was limited to movement duration, in the absence of any visual target, and error signals arose solely from comparisons between predicted and actual reafferences of the hand. In order to prevent intentional corrections of errors, a subthreshold, progressive stepwise increase in prism deviation was used, so that subjects remained unaware of the visual deviation applied in both conditions. An adaptive aftereffect was observed in the “terminal feedback error” condition only. As far as subjects remained unaware of the optical deviation and self-assigned pointing errors, prediction error alone was insufficient to induce adaptation. These results indicate a critical role of hand-to-target feedback error signals in visuomotor adaptation; consistent with recent neurophysiological findings, they suggest that a combination of feedback and prediction error signals is necessary for eliciting aftereffects. They also suggest that feedback error updates the prediction of reafferences when a visual perturbation is introduced gradually and cognitive factors are eliminated or strongly attenuated. PMID:25408644

The influence of visual feedback and register changes on sign language production: A kinematic study with deaf signers

PubMed Central

EMMOREY, KAREN; GERTSBERG, NELLY; KORPICS, FRANCO; WRIGHT, CHARLES E.

2009-01-01

Speakers monitor their speech output by listening to their own voice. However, signers do not look directly at their hands and cannot see their own face. We investigated the importance of a visual perceptual loop for sign language monitoring by examining whether changes in visual input alter sign production. Deaf signers produced American Sign Language (ASL) signs within a carrier phrase under five conditions: blindfolded, wearing tunnel-vision goggles, normal (citation) signing, shouting, and informal signing. Three-dimensional movement trajectories were obtained using an Optotrak Certus system. Informally produced signs were shorter with less vertical movement. Shouted signs were displaced forward and to the right and were produced within a larger volume of signing space, with greater velocity, greater distance traveled, and a longer duration. Tunnel vision caused signers to produce less movement within the vertical dimension of signing space, but blind and citation signing did not differ significantly on any measure, except duration. Thus, signers do not “sign louder” when they cannot see themselves, but they do alter their sign production when vision is restricted. We hypothesize that visual feedback serves primarily to fine-tune the size of signing space rather than as input to a comprehension-based monitor. PMID:20046943

The influence of visual feedback and register changes on sign language production: A kinematic study with deaf signers.

PubMed

Emmorey, Karen; Gertsberg, Nelly; Korpics, Franco; Wright, Charles E

2009-01-01

Speakers monitor their speech output by listening to their own voice. However, signers do not look directly at their hands and cannot see their own face. We investigated the importance of a visual perceptual loop for sign language monitoring by examining whether changes in visual input alter sign production. Deaf signers produced American Sign Language (ASL) signs within a carrier phrase under five conditions: blindfolded, wearing tunnel-vision goggles, normal (citation) signing, shouting, and informal signing. Three-dimensional movement trajectories were obtained using an Optotrak Certus system. Informally produced signs were shorter with less vertical movement. Shouted signs were displaced forward and to the right and were produced within a larger volume of signing space, with greater velocity, greater distance traveled, and a longer duration. Tunnel vision caused signers to produce less movement within the vertical dimension of signing space, but blind and citation signing did not differ significantly on any measure, except duration. Thus, signers do not "sign louder" when they cannot see themselves, but they do alter their sign production when vision is restricted. We hypothesize that visual feedback serves primarily to fine-tune the size of signing space rather than as input to a comprehension-based monitor.

Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired.

PubMed

Rastogi, Ravi; Pawluk, T V Dianne; Ketchum, Jessica

2013-07-01

One possibility of providing access to visual graphics for those who are visually impaired is to present them tactually: unfortunately, details easily available to vision need to be magnified to be accessible through touch. For this, we propose an "intuitive" zooming algorithm to solve potential problems with directly applying visual zooming techniques to haptic displays that sense the current location of a user on a virtual diagram with a position sensor and, then, provide the appropriate local information either through force or tactile feedback. Our technique works by determining and then traversing the levels of an object tree hierarchy of a diagram. In this manner, the zoom steps adjust to the content to be viewed, avoid clipping and do not zoom when no object is present. The algorithm was tested using a small, "mouse-like" display with tactile feedback on pictures representing houses in a community and boats on a lake. We asked the users to answer questions related to details in the pictures. Comparing our technique to linear and logarithmic step zooming, we found a significant increase in the correctness of the responses (odds ratios of 2.64:1 and 2.31:1, respectively) and usability (differences of 36% and 19%, respectively) using our "intuitive" zooming technique.

Towards a Teleoperated Needle Driver Robot with Haptic Feedback for RFA of Breast Tumors under Continuous MRI1

PubMed Central

Kokes, Rebecca; Lister, Kevin; Gullapalli, Rao; Zhang, Bao; MacMillan, Alan; Richard, Howard; Desai, Jaydev P.

2009-01-01

Objective The purpose of this paper is to explore the feasibility of developing a MRI-compatible needle driver system for radiofrequency ablation (RFA) of breast tumors under continuous MRI imaging while being teleoperated by a haptic feedback device from outside the scanning room. The developed needle driver prototype was designed and tested for both tumor targeting capability as well as RFA. Methods The single degree-of-freedom (DOF) prototype was interfaced with a PHANToM haptic device controlled from outside the scanning room. Experiments were performed to demonstrate MRI-compatibility and position control accuracy with hydraulic actuation, along with an experiment to determine the PHANToM’s ability to guide the RFA tool to a tumor nodule within a phantom breast tissue model while continuously imaging within the MRI and receiving force feedback from the RFA tool. Results Hydraulic actuation is shown to be a feasible actuation technique for operation in an MRI environment. The design is MRI-compatible in all aspects except for force sensing in the directions perpendicular to the direction of motion. Experiments confirm that the user is able to detect healthy vs. cancerous tissue in a phantom model when provided with both visual (imaging) feedback and haptic feedback. Conclusion The teleoperated 1-DOF needle driver system presented in this paper demonstrates the feasibility of implementing a MRI-compatible robot for RFA of breast tumors with haptic feedback capability. PMID:19303805

Self-regulation strategy, feedback timing and hemodynamic properties modulate learning in a simulated fMRI neurofeedback environment.

PubMed

Oblak, Ethan F; Lewis-Peacock, Jarrod A; Sulzer, James S

2017-07-01

Direct manipulation of brain activity can be used to investigate causal brain-behavior relationships. Current noninvasive neural stimulation techniques are too coarse to manipulate behaviors that correlate with fine-grained spatial patterns recorded by fMRI. However, these activity patterns can be manipulated by having people learn to self-regulate their own recorded neural activity. This technique, known as fMRI neurofeedback, faces challenges as many participants are unable to self-regulate. The causes of this non-responder effect are not well understood due to the cost and complexity of such investigation in the MRI scanner. Here, we investigated the temporal dynamics of the hemodynamic response measured by fMRI as a potential cause of the non-responder effect. Learning to self-regulate the hemodynamic response involves a difficult temporal credit-assignment problem because this signal is both delayed and blurred over time. Two factors critical to this problem are the prescribed self-regulation strategy (cognitive or automatic) and feedback timing (continuous or intermittent). Here, we sought to evaluate how these factors interact with the temporal dynamics of fMRI without using the MRI scanner. We first examined the role of cognitive strategies by having participants learn to regulate a simulated neurofeedback signal using a unidimensional strategy: pressing one of two buttons to rotate a visual grating that stimulates a model of visual cortex. Under these conditions, continuous feedback led to faster regulation compared to intermittent feedback. Yet, since many neurofeedback studies prescribe implicit self-regulation strategies, we created a computational model of automatic reward-based learning to examine whether this result held true for automatic processing. When feedback was delayed and blurred based on the hemodynamics of fMRI, this model learned more reliably from intermittent feedback compared to continuous feedback. These results suggest that different self-regulation mechanisms prefer different feedback timings, and that these factors can be effectively explored and optimized via simulation prior to deployment in the MRI scanner.

Self-regulation strategy, feedback timing and hemodynamic properties modulate learning in a simulated fMRI neurofeedback environment

PubMed Central

Sulzer, James S.

2017-01-01

Direct manipulation of brain activity can be used to investigate causal brain-behavior relationships. Current noninvasive neural stimulation techniques are too coarse to manipulate behaviors that correlate with fine-grained spatial patterns recorded by fMRI. However, these activity patterns can be manipulated by having people learn to self-regulate their own recorded neural activity. This technique, known as fMRI neurofeedback, faces challenges as many participants are unable to self-regulate. The causes of this non-responder effect are not well understood due to the cost and complexity of such investigation in the MRI scanner. Here, we investigated the temporal dynamics of the hemodynamic response measured by fMRI as a potential cause of the non-responder effect. Learning to self-regulate the hemodynamic response involves a difficult temporal credit-assignment problem because this signal is both delayed and blurred over time. Two factors critical to this problem are the prescribed self-regulation strategy (cognitive or automatic) and feedback timing (continuous or intermittent). Here, we sought to evaluate how these factors interact with the temporal dynamics of fMRI without using the MRI scanner. We first examined the role of cognitive strategies by having participants learn to regulate a simulated neurofeedback signal using a unidimensional strategy: pressing one of two buttons to rotate a visual grating that stimulates a model of visual cortex. Under these conditions, continuous feedback led to faster regulation compared to intermittent feedback. Yet, since many neurofeedback studies prescribe implicit self-regulation strategies, we created a computational model of automatic reward-based learning to examine whether this result held true for automatic processing. When feedback was delayed and blurred based on the hemodynamics of fMRI, this model learned more reliably from intermittent feedback compared to continuous feedback. These results suggest that different self-regulation mechanisms prefer different feedback timings, and that these factors can be effectively explored and optimized via simulation prior to deployment in the MRI scanner. PMID:28753639

Modeling trial by trial and block feedback in perceptual learning

PubMed Central

Liu, Jiajuan; Dosher, Barbara; Lu, Zhong-Lin

2014-01-01

Feedback has been shown to play a complex role in visual perceptual learning. It is necessary for performance improvement in some conditions while not others. Different forms of feedback, such as trial-by-trial feedback or block feedback, may both facilitate learning, but with different mechanisms. False feedback can abolish learning. We account for all these results with the Augmented Hebbian Reweight Model (AHRM). Specifically, three major factors in the model advance performance improvement: the external trial-by-trial feedback when available, the self-generated output as an internal feedback when no external feedback is available, and the adaptive criterion control based on the block feedback. Through simulating a comprehensive feedback study (Herzog & Fahle 1997, Vision Research, 37 (15), 2133–2141), we show that the model predictions account for the pattern of learning in seven major feedback conditions. The AHRM can fully explain the complex empirical results on the role of feedback in visual perceptual learning. PMID:24423783

Shaping with Visual Feedback and Token Reinforcement: Effects on Voice Volume Changes in Mentally Retarded Adults.

ERIC Educational Resources Information Center

Bieber, Carrie; Gurski, John C.

In an attempt to confirm earlier results with a group of mentally retarded females, 12 mentally retarded institutionalized adults (8 male, 4 female) were trained to either reduce (Loud group) or increase (Soft group) their voice volumes with a combination of visual feedback and token reinforcement. The feedback unit provided a binary light on-off…

Effect of Training Japanese L1 Speakers in the Production of American English /r/ Using Spectrographic Visual Feedback

ERIC Educational Resources Information Center

Patten, Iomi; Edmonds, Lisa A.

2015-01-01

The present study examines the effects of training native Japanese speakers in the production of American /r/ using spectrographic visual feedback. Within a modified single-subject design, two native Japanese participants produced single words containing /r/ in a variety of positions while viewing live spectrographic feedback with the aim of…

fMRI characterisation of widespread brain networks relevant for behavioural variability in fine hand motor control with and without visual feedback.

PubMed

Mayhew, Stephen D; Porcaro, Camillo; Tecchio, Franca; Bagshaw, Andrew P

2017-03-01

A bilateral visuo-parietal-motor network is responsible for fine control of hand movements. However, the sub-regions which are devoted to maintenance of contraction stability and how these processes fluctuate with trial-quality of task execution and in the presence/absence of visual feedback remains unclear. We addressed this by integrating behavioural and fMRI measurements during right-hand isometric compression of a compliant rubber bulb, at 10% and 30% of maximum voluntary contraction, both with and without visual feedback of the applied force. We quantified single-trial behavioural performance during 1) the whole task period and 2) stable contraction maintenance, and regressed these metrics against the fMRI data to identify the brain activity most relevant to trial-by-trial fluctuations in performance during specific task phases. fMRI-behaviour correlations in a bilateral network of visual, premotor, primary motor, parietal and inferior frontal cortical regions emerged during performance of the entire feedback task, but only in premotor, parietal cortex and thalamus during the stable contraction period. The trials with the best task performance showed increased bilaterality and amplitude of fMRI responses. With feedback, stronger BOLD-behaviour coupling was found during 10% compared to 30% contractions. Only a small subset of regions in this network were weakly correlated with behaviour without feedback, despite wider network activated during this task than in the presence of feedback. These findings reflect a more focused network strongly coupled to behavioural fluctuations when providing visual feedback, whereas without it the task recruited widespread brain activity almost uncoupled from behavioural performance. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Improving lower limb weight distribution asymmetry during the squat using Nintendo Wii Balance Boards and real-time feedback.

PubMed

McGough, Rian; Paterson, Kade; Bradshaw, Elizabeth J; Bryant, Adam L; Clark, Ross A

2012-01-01

Weight-bearing asymmetry (WBA) may be detrimental to performance and could increase the risk of injury; however, detecting and reducing it is difficult in a field setting. This study assessed whether a portable and simple-to-use system designed with multiple Nintendo Wii Balance Boards (NWBBs) and customized software can be used to evaluate and improve WBA. Fifteen elite Australian Rules Footballers and 32 age-matched, untrained participants were tested for measures of WBA while squatting. The NWBB and customized software provided real-time visual feedback of WBA during half of the trials. Outcome measures included the mean mass difference (MMD) between limbs, interlimb symmetry index (SI), and percentage of time spent favoring a single limb (TFSL). Significant reductions in MMD (p = 0.028) and SI (p = 0.007) with visual feedback were observed for the entire group data. Subgroup analysis revealed significant reductions in MMD (p = 0.047) and SI (p = 0.026) with visual feedback in the untrained sample; however, the reductions in the trained sample were nonsignificant. The trained group showed significantly less WBA for TFSL under both visual conditions (no feedback: p = 0.015, feedback: p = 0.017). Correlation analysis revealed that participants with high levels of WBA had the greatest response to feedback (p < 0.001, ρ = 0.557). In conclusion, WBA exists in healthy untrained adults, and these asymmetries can be reduced using real-time visual feedback provided by an NWBB-based system. Healthy, well-trained professional athletes do not possess the same magnitude of WBA. Inexpensive, portable, and widely available gaming technology may be used to evaluate and improve WBA in clinical and sporting settings.

Mirror Visual Feedback Induces Lower Neuromuscular Activity in Children with Spastic Hemiparetic Cerebral Palsy

ERIC Educational Resources Information Center

Feltham, Max G.; Ledebt, Annick; Deconinck, Frederik J. A.; Savelsbergh, Geert J. P.

2010-01-01

The study examined the effects of mirror feedback information on neuromuscular activation during bimanual coordination in eight children with spastic hemiparetic cerebral palsy (SHCP) and a matched control group. The "mirror box" creates a visual illusion, which gives rise to a visual perception of a zero lag, symmetric movement between the two…

Probing feedforward and feedback contributions to awareness with visual masking and transcranial magnetic stimulation

PubMed Central

Tapia, Evelina; Beck, Diane M.

2014-01-01

A number of influential theories posit that visual awareness relies not only on the initial, stimulus-driven (i.e., feedforward) sweep of activation but also on recurrent feedback activity within and between brain regions. These theories of awareness draw heavily on data from masking paradigms in which visibility of one stimulus is reduced due to the presence of another stimulus. More recently transcranial magnetic stimulation (TMS) has been used to study the temporal dynamics of visual awareness. TMS over occipital cortex affects performance on visual tasks at distinct time points and in a manner that is comparable to visual masking. We draw parallels between these two methods and examine evidence for the neural mechanisms by which visual masking and TMS suppress stimulus visibility. Specifically, both methods have been proposed to affect feedforward as well as feedback signals when applied at distinct time windows relative to stimulus onset and as a result modify visual awareness. Most recent empirical evidence, moreover, suggests that while visual masking and TMS impact stimulus visibility comparably, the processes these methods affect may not be as similar as previously thought. In addition to reviewing both masking and TMS studies that examine feedforward and feedback processes in vision, we raise questions to guide future studies and further probe the necessary conditions for visual awareness. PMID:25374548

A real-time articulatory visual feedback approach with target presentation for second language pronunciation learning.

PubMed

Suemitsu, Atsuo; Dang, Jianwu; Ito, Takayuki; Tiede, Mark

2015-10-01

Articulatory information can support learning or remediating pronunciation of a second language (L2). This paper describes an electromagnetic articulometer-based visual-feedback approach using an articulatory target presented in real-time to facilitate L2 pronunciation learning. This approach trains learners to adjust articulatory positions to match targets for a L2 vowel estimated from productions of vowels that overlap in both L1 and L2. Training of Japanese learners for the American English vowel /æ/ that included visual training improved its pronunciation regardless of whether audio training was also included. Articulatory visual feedback is shown to be an effective method for facilitating L2 pronunciation learning.

Effect of Real-Time Feedback on Screw Placement Into Synthetic Cancellous Bone.

PubMed

Gustafson, Peter A; Geeslin, Andrew G; Prior, David M; Chess, Joseph L

2016-08-01

The objective of this study is to evaluate whether real-time torque feedback may reduce the occurrence of stripping when inserting nonlocking screws through fracture plates into synthetic cancellous bone. Five attending orthopaedic surgeons and 5 senior level orthopaedic residents inserted 8 screws in each phase. In phase I, screws were inserted without feedback simulating conventional techniques. In phase II, screws were driven with visual torque feedback. In phase III, screws were again inserted with conventional techniques. Comparison of these 3 phases with respect to screw insertion torque, surgeon rank, and perception of stripping was used to establish the effects of feedback. Seventy-three of 239 screws resulted in stripping. During the first phase, no feedback was provided and the overall strip rate was 41.8%; this decreased to 15% with visual feedback (P < 0.001) and returned to 35% when repeated without feedback. With feedback, a lower average torque was applied over a narrower torque distribution. Residents stripped 40.8% of screws compared with 20.2% for attending surgeons. Surgeons were poor at perceiving whether they stripped. Prevention and identification of stripping is influenced by surgeon perception of tactile sensation. This is significantly improved with utilization of real-time visual feedback of a torque versus roll curve. This concept of real-time feedback seems beneficial toward performance in synthetic cancellous bone and may lead to improved fixation in cancellous bone in a surgical setting.

Direct imaging of isofrequency contours in photonic structures

DOE PAGES

Regan, E. C.; Igarashi, Y.; Zhen, B.; ...

2016-11-25

The isofrequency contours of a photonic crystal are important for predicting and understanding exotic optical phenomena that are not apparent from high-symmetry band structure visualizations. We demonstrate a method to directly visualize the isofrequency contours of high-quality photonic crystal slabs that show quantitatively good agreement with numerical results throughout the visible spectrum. Our technique relies on resonance-enhanced photon scattering from generic fabrication disorder and surface roughness, so it can be applied to general photonic and plasmonic crystals or even quasi-crystals. We also present an analytical model of the scattering process, which explains the observation of isofrequency contours in our technique.more » Furthermore, the isofrequency contours provide information about the characteristics of the disorder and therefore serve as a feedback tool to improve fabrication processes.« less

Reproducibility of The Abdominal and Chest Wall Position by Voluntary Breath-Hold Technique Using a Laser-Based Monitoring and Visual Feedback System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nakamura, Katsumasa; Shioyama, Yoshiyuki; Nomoto, Satoru

2007-05-01

Purpose: The voluntary breath-hold (BH) technique is a simple method to control the respiration-related motion of a tumor during irradiation. However, the abdominal and chest wall position may not be accurately reproduced using the BH technique. The purpose of this study was to examine whether visual feedback can reduce the fluctuation in wall motion during BH using a new respiratory monitoring device. Methods and Materials: We developed a laser-based BH monitoring and visual feedback system. For this study, five healthy volunteers were enrolled. The volunteers, practicing abdominal breathing, performed shallow end-expiration BH (SEBH), shallow end-inspiration BH (SIBH), and deep end-inspirationmore » BH (DIBH) with or without visual feedback. The abdominal and chest wall positions were measured at 80-ms intervals during BHs. Results: The fluctuation in the chest wall position was smaller than that of the abdominal wall position. The reproducibility of the wall position was improved by visual feedback. With a monitoring device, visual feedback reduced the mean deviation of the abdominal wall from 2.1 {+-} 1.3 mm to 1.5 {+-} 0.5 mm, 2.5 {+-} 1.9 mm to 1.1 {+-} 0.4 mm, and 6.6 {+-} 2.4 mm to 2.6 {+-} 1.4 mm in SEBH, SIBH, and DIBH, respectively. Conclusions: Volunteers can perform the BH maneuver in a highly reproducible fashion when informed about the position of the wall, although in the case of DIBH, the deviation in the wall position remained substantial.« less

Memory-guided force control in healthy younger and older adults.

PubMed

Neely, Kristina A; Samimy, Shaadee; Blouch, Samantha L; Wang, Peiyuan; Chennavasin, Amanda; Diaz, Michele T; Dennis, Nancy A

2017-08-01

Successful performance of a memory-guided motor task requires participants to store and then recall an accurate representation of the motor goal. Further, participants must monitor motor output to make adjustments in the absence of visual feedback. The goal of this study was to examine memory-guided grip force in healthy younger and older adults and compare it to performance on behavioral tasks of working memory. Previous work demonstrates that healthy adults decrease force output as a function of time when visual feedback is not available. We hypothesized that older adults would decrease force output at a faster rate than younger adults, due to age-related deficits in working memory. Two groups of participants, younger adults (YA: N = 32, mean age 21.5 years) and older adults (OA: N = 33, mean age 69.3 years), completed four 20-s trials of isometric force with their index finger and thumb, equal to 25% of their maximum voluntary contraction. In the full-vision condition, visual feedback was available for the duration of the trial. In the no vision condition, visual feedback was removed for the last 12 s of each trial. Participants were asked to maintain constant force output in the absence of visual feedback. Participants also completed tasks of word recall and recognition and visuospatial working memory. Counter to our predictions, when visual feedback was removed, younger adults decreased force at a faster rate compared to older adults and the rate of decay was not associated with behavioral performance on tests of working memory.

Stimulus change as a factor in response maintenance with free food available.

PubMed Central

Osborne, S R; Shelby, M

1975-01-01

Rats bar pressed for food on a reinforcement schedule in which every response was reinforced, even though a dish of pellets was present. Initially, auditory and visual stimuli accompanied response-produced food presentation. With stimulus feedback as an added consequence of bar pressing, responding was maintained in the presence of free food; without stimulus feedback, responding decreased to a low level. Auditory feedback maintained slightly more responding than did visual feedback, and both together maintained more responding than did either separately. Almost no responding occurred when the only consequence of bar pressing was stimulus feedback. The data indicated conditioned and sensory reinforcement effects of response-produced stimulus feedback. PMID:1202121

Unintentional Interpersonal Synchronization Represented as a Reciprocal Visuo-Postural Feedback System: A Multivariate Autoregressive Modeling Approach.

PubMed

Okazaki, Shuntaro; Hirotani, Masako; Koike, Takahiko; Bosch-Bayard, Jorge; Takahashi, Haruka K; Hashiguchi, Maho; Sadato, Norihiro

2015-01-01

People's behaviors synchronize. It is difficult, however, to determine whether synchronized behaviors occur in a mutual direction--two individuals influencing one another--or in one direction--one individual leading the other, and what the underlying mechanism for synchronization is. To answer these questions, we hypothesized a non-leader-follower postural sway synchronization, caused by a reciprocal visuo-postural feedback system operating on pairs of individuals, and tested that hypothesis both experimentally and via simulation. In the behavioral experiment, 22 participant pairs stood face to face either 20 or 70 cm away from each other wearing glasses with or without vision blocking lenses. The existence and direction of visual information exchanged between pairs of participants were systematically manipulated. The time series data for the postural sway of these pairs were recorded and analyzed with cross correlation and causality. Results of cross correlation showed that postural sway of paired participants was synchronized, with a shorter time lag when participant pairs could see one another's head motion than when one of the participants was blindfolded. In addition, there was less of a time lag in the observed synchronization when the distance between participant pairs was smaller. As for the causality analysis, noise contribution ratio (NCR), the measure of influence using a multivariate autoregressive model, was also computed to identify the degree to which one's postural sway is explained by that of the other's and how visual information (sighted vs. blindfolded) interacts with paired participants' postural sway. It was found that for synchronization to take place, it is crucial that paired participants be sighted and exert equal influence on one another by simultaneously exchanging visual information. Furthermore, a simulation for the proposed system with a wider range of visual input showed a pattern of results similar to the behavioral results.

Effects of Visual Force Feedback on Robot-Assisted Surgical Task Performance

PubMed Central

Reiley, Carol E.; Akinbiyi, Takintope; Burschka, Darius; Chang, David C.; Okamura, Allison M.; Yuh, David D.

2009-01-01

Background Direct haptic (force or tactile) feedback is negligible in current surgical robotic systems. The relevance of haptic feedback in robot-assisted performances of surgical tasks is controversial. We studied the effects of visual force feedback (VFF), a haptic feedback surrogate, on tying surgical knots with fine sutures similar to those used in cardiovascular surgery. Methods Using a modified da Vinci robotic system (Intuitive Surgical, Inc.) equipped with force-sensing instrument tips and real-time VFF overlays in the console image, ten surgeons each tied 10 knots with and 10 knots without VFF. Four surgeons had significant prior da Vinci experience while the remaining six surgeons did not. Performance parameters, including suture breakage and secure knots, peak and standard deviation of applied forces, and completion times using 5-0 silk sutures were recorded. Chi-square and Student’s t-test analyses determined differences between groups. Results Among surgeon subjects with robotic experience, no differences in measured performance parameters were found between robot-assisted knot ties executed with and without VFF. Among surgeons without robotic experience, however, VFF was associated with lower suture breakage rates, peak applied forces, and standard deviations of applied forces. VFF did not impart differences in knot completion times or loose knots for either surgeon group. Conclusions VFF resulted in reduced suture breakage, lower forces, and decreased force inconsistencies among novice robotic surgeons, although elapsed time and knot quality were unaffected. In contrast, VFF did not affect these metrics among experienced da Vinci surgeons. These results suggest that VFF primarily benefits novice robot-assisted surgeons, with diminishing benefits among experienced surgeons. PMID:18179942

Selective Activation of the Deep Layers of the Human Primary Visual Cortex by Top-Down Feedback.

PubMed

Kok, Peter; Bains, Lauren J; van Mourik, Tim; Norris, David G; de Lange, Floris P

2016-02-08

In addition to bottom-up input, the visual cortex receives large amounts of feedback from other cortical areas [1-3]. One compelling example of feedback activation of early visual neurons in the absence of bottom-up input occurs during the famous Kanizsa illusion, where a triangular shape is perceived, even in regions of the image where there is no bottom-up visual evidence for it. This illusion increases the firing activity of neurons in the primary visual cortex with a receptive field on the illusory contour [4]. Feedback signals are largely segregated from feedforward signals within each cortical area, with feedforward signals arriving in the middle layer, while top-down feedback avoids the middle layers and predominantly targets deep and superficial layers [1, 2, 5, 6]. Therefore, the feedback-mediated activity increase in V1 during the perception of illusory shapes should lead to a specific laminar activity profile that is distinct from the activity elicited by bottom-up stimulation. Here, we used fMRI at high field (7 T) to empirically test this hypothesis, by probing the cortical response to illusory figures in human V1 at different cortical depths [7-14]. We found that, whereas bottom-up stimulation activated all cortical layers, feedback activity induced by illusory figures led to a selective activation of the deep layers of V1. These results demonstrate the potential for non-invasive recordings of neural activity with laminar specificity in humans and elucidate the role of top-down signals during perceptual processing. Copyright © 2016 Elsevier Ltd. All rights reserved.

Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains.

PubMed

Sklar, A E; Sarter, N B

1999-12-01

Observed breakdowns in human-machine communication can be explained, in part, by the nature of current automation feedback, which relies heavily on focal visual attention. Such feedback is not well suited for capturing attention in case of unexpected changes and events or for supporting the parallel processing of large amounts of data in complex domains. As suggested by multiple-resource theory, one possible solution to this problem is to distribute information across various sensory modalities. A simulator study was conducted to compare the effectiveness of visual, tactile, and redundant visual and tactile cues for indicating unexpected changes in the status of an automated cockpit system. Both tactile conditions resulted in higher detection rates for, and faster response times to, uncommanded mode transitions. Tactile feedback did not interfere with, nor was its effectiveness affected by, the performance of concurrent visual tasks. The observed improvement in task-sharing performance indicates that the introduction of tactile feedback is a promising avenue toward better supporting human-machine communication in event-driven, information-rich domains.

Game-Based Augmented Visual Feedback for Enlarging Speech Movements in Parkinson's Disease.

PubMed

Yunusova, Yana; Kearney, Elaine; Kulkarni, Madhura; Haworth, Brandon; Baljko, Melanie; Faloutsos, Petros

2017-06-22

The purpose of this pilot study was to demonstrate the effect of augmented visual feedback on acquisition and short-term retention of a relatively simple instruction to increase movement amplitude during speaking tasks in patients with dysarthria due to Parkinson's disease (PD). Nine patients diagnosed with PD, hypokinetic dysarthria, and impaired speech intelligibility participated in a training program aimed at increasing the size of their articulatory (tongue) movements during sentences. Two sessions were conducted: a baseline and training session, followed by a retention session 48 hr later. At baseline, sentences were produced at normal, loud, and clear speaking conditions. Game-based visual feedback regarding the size of the articulatory working space (AWS) was presented during training. Eight of nine participants benefited from training, increasing their sentence AWS to a greater degree following feedback as compared with the baseline loud and clear conditions. The majority of participants were able to demonstrate the learned skill at the retention session. This study demonstrated the feasibility of augmented visual feedback via articulatory kinematics for training movement enlargement in patients with hypokinesia due to PD. https://doi.org/10.23641/asha.5116840.

Effect of Concurrent Visual Feedback Frequency on Postural Control Learning in Adolescents.

PubMed

Marco-Ahulló, Adrià; Sánchez-Tormo, Alexis; García-Pérez, José A; Villarrasa-Sapiña, Israel; González, Luis M; García-Massó, Xavier

2018-04-13

The purpose was to find better augmented visual feedback frequency (100% or 67%) for learning a balance task in adolescents. Thirty subjects were divided randomly into a control group, and 100% and 67% feedback groups. The three groups performed pretest (3 trials), practice (12 trials), posttest (3 trials) and retention (3 trials, 24 hours later). The reduced feedback group showed lower RMS in the posttest than in the pretest (p = 0.04). The control and reduced feedback groups showed significant lower median frequency in the posttest than in the pretest (p < 0.05). Both feedback groups showed lower values in retention than in the pretest (p < 0.05). Even when the effect of feedback frequency could not be detected in motor learning, 67% of the feedback was recommended for motor adaptation.

Experimental test of visuomotor updating models that explain perisaccadic mislocalization.

PubMed

Van Wetter, Sigrid M C I; Van Opstal, A John

2008-10-23

Localization of a brief visual target is inaccurate when presented around saccade onset. Perisaccadic mislocalization is maximal in the saccade direction and varies systematically with the target-saccade onset disparity. It has been hypothesized that this effect is either due to a sluggish representation of eye position, to low-pass filtering of the visual event, to saccade-induced compression of visual space, or to a combination of these effects. Despite their differences, these schemes all predict that the pattern of localization errors varies systematically with the saccade amplitude and kinematics. We tested these predictions for the double-step paradigm by analyzing the errors for saccades of widely varying amplitudes. Our data show that the measured error patterns are only mildly influenced by the primary-saccade amplitude over a large range of saccade properties. An alternative possibility, better accounting for the data, assumes that around saccade onset perceived target location undergoes a uniform shift in the saccade direction that varies with amplitude only for small saccades. The strength of this visual effect saturates at about 10 deg and also depends on target duration. Hence, we propose that perisaccadic mislocalization results from errors in visual-spatial perception rather than from sluggish oculomotor feedback.

How Do Batters Use Visual, Auditory, and Tactile Information about the Success of a Baseball Swing?

ERIC Educational Resources Information Center

Gray, Rob

2009-01-01

Bat/ball contact produces visual (the ball leaving the bat), auditory (the "crack" of the bat), and tactile (bat vibration) feedback about the success of the swing. We used a batting simulation to investigate how college baseball players use visual, tactile, and auditory feedback. In Experiment 1, swing accuracy (i.e., the lateral separation…

Microstimulation of area V4 has little effect on spatial attention and on perception of phosphenes evoked in area V1

PubMed Central

Dagnino, Bruno; Gariel-Mathis, Marie-Alice

2014-01-01

Previous transcranial magnetic stimulation (TMS) studies suggested that feedback from higher to lower areas of the visual cortex is important for the access of visual information to awareness. However, the influence of cortico-cortical feedback on awareness and the nature of the feedback effects are not yet completely understood. In the present study, we used electrical microstimulation in the visual cortex of monkeys to test the hypothesis that cortico-cortical feedback plays a role in visual awareness. We investigated the interactions between the primary visual cortex (V1) and area V4 by applying microstimulation in both cortical areas at various delays. We report that the monkeys detected the phosphenes produced by V1 microstimulation but subthreshold V4 microstimulation did not influence V1 phosphene detection thresholds. A second experiment examined the influence of V4 microstimulation on the monkeys' ability to detect the dimming of one of three peripheral visual stimuli. Again, microstimulation of a group of V4 neurons failed to modulate the monkeys' perception of a stimulus in their receptive field. We conclude that conditions exist where microstimulation of area V4 has only a limited influence on visual perception. PMID:25392172

Microstimulation of area V4 has little effect on spatial attention and on perception of phosphenes evoked in area V1.

PubMed

Dagnino, Bruno; Gariel-Mathis, Marie-Alice; Roelfsema, Pieter R

2015-02-01

Previous transcranial magnetic stimulation (TMS) studies suggested that feedback from higher to lower areas of the visual cortex is important for the access of visual information to awareness. However, the influence of cortico-cortical feedback on awareness and the nature of the feedback effects are not yet completely understood. In the present study, we used electrical microstimulation in the visual cortex of monkeys to test the hypothesis that cortico-cortical feedback plays a role in visual awareness. We investigated the interactions between the primary visual cortex (V1) and area V4 by applying microstimulation in both cortical areas at various delays. We report that the monkeys detected the phosphenes produced by V1 microstimulation but subthreshold V4 microstimulation did not influence V1 phosphene detection thresholds. A second experiment examined the influence of V4 microstimulation on the monkeys' ability to detect the dimming of one of three peripheral visual stimuli. Again, microstimulation of a group of V4 neurons failed to modulate the monkeys' perception of a stimulus in their receptive field. We conclude that conditions exist where microstimulation of area V4 has only a limited influence on visual perception. Copyright © 2015 the American Physiological Society.

Consistency of handwriting movements in dementia of the Alzheimer's type: a comparison with Huntington's and Parkinson's diseases.

PubMed

Slavin, M J; Phillips, J G; Bradshaw, J L; Hall, K A; Presnell, I

1999-01-01

Patients with dementia of the Alzheimer's type (DAT) and their matched controls wrote, on a computer graphics tablet, 4 consecutive, cursive letter 'l's, with varying levels of visual feedback: noninking pen and blank paper so that only the hand movements could be seen, noninking pen and lined paper to constrain their writing, goggles to occlude the lower visual field and eliminate all relevant visual feedback, and inking pen with full vision. The kinematic measures of stroke length, duration, and peak velocity were expressed in terms of consistency via a signal-to-noise ratio (M value of each parameter divided by its SD). Irrespective of medication or severity, DAT patients had writing strokes of significantly less consistent lengths than controls', and were disproportionately impaired by reduced visual feedback. Again irrespective of medication or severity, patients' strokes were of significantly less consistent duration, and significantly less consistent peak velocity than controls', independent of feedback conditions. Patients, unlike controls, frequently perseverated, producing more than 4 'l's, or multiple sets of responses, which was not differentially affected by level of visual feedback. The more variable performance of patients supports a degradation of the base motor program, and resembles that of Huntington's rather than Parkinson's disease patients. It may indeed reflect frontal rather than basal ganglia dysfunction.

The Use of Visual Feedback During Signing: Evidence From Signers With Impaired Vision

PubMed Central

Korpics, Franco; Petronio, Karen

2009-01-01

The role of visual feedback during the production of American Sign Language was investigated by comparing the size of signing space during conversations and narrative monologues for normally sighted signers, signers with tunnel vision due to Usher syndrome, and functionally blind signers. The interlocutor for all groups was a normally sighted deaf person. Signers with tunnel vision produced a greater proportion of signs near the face than blind and normally sighted signers, who did not differ from each other. Both groups of visually impaired signers produced signs within a smaller signing space for conversations than for monologues, but we hypothesize that they did so for different reasons. Signers with tunnel vision may align their signing space with that of their interlocutor. In contrast, blind signers may enhance proprioceptive feedback by producing signs within an enlarged signing space for monologues, which do not require switching between tactile and visual signing. Overall, we hypothesize that signers use visual feedback to phonetically calibrate the dimensions of signing space, rather than to monitor language output. PMID:18495656

The use of visual feedback during signing: evidence from signers with impaired vision.

PubMed

Emmorey, Karen; Korpics, Franco; Petronio, Karen

2009-01-01

The role of visual feedback during the production of American Sign Language was investigated by comparing the size of signing space during conversations and narrative monologues for normally sighted signers, signers with tunnel vision due to Usher syndrome, and functionally blind signers. The interlocutor for all groups was a normally sighted deaf person. Signers with tunnel vision produced a greater proportion of signs near the face than blind and normally sighted signers, who did not differ from each other. Both groups of visually impaired signers produced signs within a smaller signing space for conversations than for monologues, but we hypothesize that they did so for different reasons. Signers with tunnel vision may align their signing space with that of their interlocutor. In contrast, blind signers may enhance proprioceptive feedback by producing signs within an enlarged signing space for monologues, which do not require switching between tactile and visual signing. Overall, we hypothesize that signers use visual feedback to phonetically calibrate the dimensions of signing space, rather than to monitor language output.

Cortical Feedback Regulates Feedforward Retinogeniculate Refinement

PubMed Central

Thompson, Andrew D; Picard, Nathalie; Min, Lia; Fagiolini, Michela; Chen, Chinfei

2016-01-01

SUMMARY According to the prevailing view of neural development, sensory pathways develop sequentially in a feedforward manner, whereby each local microcircuit refines and stabilizes before directing the wiring of its downstream target. In the visual system, retinal circuits are thought to mature first and direct refinement in the thalamus, after which cortical circuits refine with experience-dependent plasticity. In contrast, we now show that feedback from cortex to thalamus critically regulates refinement of the retinogeniculate projection during a discrete window in development, beginning at postnatal day 20 in mice. Disrupting cortical activity during this window, pharmacologically or chemogenetically, increases the number of retinal ganglion cells innervating each thalamic relay neuron. These results suggest that primary sensory structures develop through the concurrent and interdependent remodeling of subcortical and cortical circuits in response to sensory experience, rather than through a simple feedforward process. Our findings also highlight an unexpected function for the corticothalamic projection. PMID:27545712

Proprioceptive feedback determines visuomotor gain in Drosophila

PubMed Central

Bartussek, Jan; Lehmann, Fritz-Olaf

2016-01-01

Multisensory integration is a prerequisite for effective locomotor control in most animals. Especially, the impressive aerial performance of insects relies on rapid and precise integration of multiple sensory modalities that provide feedback on different time scales. In flies, continuous visual signalling from the compound eyes is fused with phasic proprioceptive feedback to ensure precise neural activation of wing steering muscles (WSM) within narrow temporal phase bands of the stroke cycle. This phase-locked activation relies on mechanoreceptors distributed over wings and gyroscopic halteres. Here we investigate visual steering performance of tethered flying fruit flies with reduced haltere and wing feedback signalling. Using a flight simulator, we evaluated visual object fixation behaviour, optomotor altitude control and saccadic escape reflexes. The behavioural assays show an antagonistic effect of wing and haltere signalling on visuomotor gain during flight. Compared with controls, suppression of haltere feedback attenuates while suppression of wing feedback enhances the animal’s wing steering range. Our results suggest that the generation of motor commands owing to visual perception is dynamically controlled by proprioception. We outline a potential physiological mechanism based on the biomechanical properties of WSM and sensory integration processes at the level of motoneurons. Collectively, the findings contribute to our general understanding how moving animals integrate sensory information with dynamically changing temporal structure. PMID:26909184

Spatiotemporal dynamics of brain activity during the transition from visually guided to memory-guided force control

PubMed Central

Poon, Cynthia; Chin-Cottongim, Lisa G.; Coombes, Stephen A.; Corcos, Daniel M.

2012-01-01

It is well established that the prefrontal cortex is involved during memory-guided tasks whereas visually guided tasks are controlled in part by a frontal-parietal network. However, the nature of the transition from visually guided to memory-guided force control is not as well established. As such, this study examines the spatiotemporal pattern of brain activity that occurs during the transition from visually guided to memory-guided force control. We measured 128-channel scalp electroencephalography (EEG) in healthy individuals while they performed a grip force task. After visual feedback was removed, the first significant change in event-related activity occurred in the left central region by 300 ms, followed by changes in prefrontal cortex by 400 ms. Low-resolution electromagnetic tomography (LORETA) was used to localize the strongest activity to the left ventral premotor cortex and ventral prefrontal cortex. A second experiment altered visual feedback gain but did not require memory. In contrast to memory-guided force control, altering visual feedback gain did not lead to early changes in the left central and midline prefrontal regions. Decreasing the spatial amplitude of visual feedback did lead to changes in the midline central region by 300 ms, followed by changes in occipital activity by 400 ms. The findings show that subjects rely on sensorimotor memory processes involving left ventral premotor cortex and ventral prefrontal cortex after the immediate transition from visually guided to memory-guided force control. PMID:22696535

The quality of visual information about the lower extremities influences visuomotor coordination during virtual obstacle negotiation.

PubMed

Kim, Aram; Kretch, Kari S; Zhou, Zixuan; Finley, James M

2018-05-09

Successful negotiation of obstacles during walking relies on the integration of visual information about the environment with ongoing locomotor commands. When information about the body and environment are removed through occlusion of the lower visual field, individuals increase downward head pitch angle, reduce foot placement precision, and increase safety margins during crossing. However, whether these effects are mediated by loss of visual information about the lower extremities, the obstacle, or both remains to be seen. Here, we used a fully immersive, virtual obstacle negotiation task to investigate how visual information about the lower extremities is integrated with information about the environment to facilitate skillful obstacle negotiation. Participants stepped over virtual obstacles while walking on a treadmill with one of three types of visual feedback about the lower extremities: no feedback, end-point feedback, or a link-segment model. We found that absence of visual information about the lower extremities led to an increase in the variability of leading foot placement after crossing. The presence of a visual representation of the lower extremities promoted greater downward head pitch angle during the approach to and subsequent crossing of an obstacle. In addition, having greater downward head pitch was associated with closer placement of the trailing foot to the obstacle, further placement of the leading foot after the obstacle, and higher trailing foot clearance. These results demonstrate that the fidelity of visual information about the lower extremities influences both feed-forward and feedback aspects of visuomotor coordination during obstacle negotiation.

Real-time visual biofeedback during weight bearing improves therapy compliance in patients following lower extremity fractures.

PubMed

Raaben, Marco; Holtslag, Herman R; Leenen, Luke P H; Augustine, Robin; Blokhuis, Taco J

2018-01-01

Individuals with lower extremity fractures are often instructed on how much weight to bear on the affected extremity. Previous studies have shown limited therapy compliance in weight bearing during rehabilitation. In this study we investigated the effect of real-time visual biofeedback on weight bearing in individuals with lower extremity fractures in two conditions: full weight bearing and touch-down weight bearing. 11 participants with full weight bearing and 12 participants with touch-down weight bearing after lower extremity fractures have been measured with an ambulatory biofeedback system. The participants first walked 15m and the biofeedback system was only used to register the weight bearing. The same protocol was then repeated with real-time visual feedback during weight bearing. The participants could thereby adapt their loading to the desired level and improve therapy compliance. In participants with full weight bearing, real-time visual biofeedback resulted in a significant increase in loading from 50.9±7.51% bodyweight (BW) without feedback to 63.2±6.74%BW with feedback (P=0.0016). In participants with touch-down weight bearing, the exerted lower extremity load decreased from 16.7±9.77kg without feedback to 10.27±4.56kg with feedback (P=0.0718). More important, the variance between individual steps significantly decreased after feedback (P=0.018). Ambulatory monitoring weight bearing after lower extremity fractures showed that therapy compliance is low, both in full and touch-down weight bearing. Real-time visual biofeedback resulted in significantly higher peak loads in full weight bearing and increased accuracy of individual steps in touch-down weight bearing. Real-time visual biofeedback therefore results in improved therapy compliance after lower extremity fractures. Copyright © 2017 Elsevier B.V. All rights reserved.

Unintentional force changes in cyclical tasks performed by an abundant system: Empirical observations and a dynamical model.

PubMed

Reschechtko, Sasha; Hasanbarani, Fariba; Akulin, Vladimir M; Latash, Mark L

2017-05-14

The study explored unintentional force changes elicited by removing visual feedback during cyclical, two-finger isometric force production tasks. Subjects performed two types of tasks at 1Hz, paced by an auditory metronome. One - Force task - required cyclical changes in total force while maintaining the sharing, defined as relative contribution of a finger to total force. The other task - Share task - required cyclical changes in sharing while keeping total force unchanged. Each trial started under full visual feedback on both force and sharing; subsequently, feedback on the variable that was instructed to stay constant was frozen, and finally feedback on the other variable was also removed. In both tasks, turning off visual feedback on total force elicited a drop in the mid-point of the force cycle and an increase in the peak-to-peak force amplitude. Turning off visual feedback on sharing led to a drift of mean share toward 50:50 across both tasks. Without visual feedback there was consistent deviation of the two force time series from the in-phase pattern (typical of the Force task) and from the out-of-phase pattern (typical of the Share task). This finding is in contrast to most earlier studies that demonstrated only two stable patterns, in-phase and out-of-phase. We interpret the results as consequences of drifts of parameters in a dynamical system leading in particular to drifts in the referent finger coordinates toward their actual coordinates. The relative phase desynchronization is caused by the right-left differences in the hypothesized drift processes, consistent with the dynamic dominance hypothesis. Copyright © 2017 IBRO. Published by Elsevier Ltd. All rights reserved.

Unintentional force changes in cyclical tasks performed by an abundant system: Empirical observations and a dynamical model

PubMed Central

Reschechtko, Sasha; Hasanbarani, Fariba; Akulin, Vladimir M.; Latash, Mark L.

2017-01-01

The study explored unintentional force changes elicited by removing visual feedback during cyclical, two-finger isometric force production tasks. Subjects performed two types of tasks at 1 Hz, paced by an auditory metronome. One – Force task – required cyclical changes in total force while maintaining the sharing, defined as relative contribution of a finger to total force. The other task – Share task – required cyclical changes in sharing while keeping total force unchanged. Each trial started under full visual feedback on both force and sharing; subsequently, feedback on the variable that was instructed to stay constant was frozen, and finally feedback on the other variable was also removed. In both tasks, turning off visual feedback on total force elicited a drop in the mid-point of the force cycle and an increase in the peak-to-peak force amplitude. Turning off visual feedback on sharing led to a drift of mean share toward 50:50 across both tasks. Without visual feedback there was consistent deviation of the two force time series from the in-phase pattern (typical of the Force task) and from the out-of-phase pattern (typical of the Share task). This finding is in contrast to most earlier studies that demonstrated only two stable patterns, in-phase and out-of-phase. We interpret the results as consequences of drifts of parameters in a dynamical system leading in particular to drifts in the referent finger coordinates toward their actual coordinates. The relative phase desynchronization is caused by the right-left differences in the hypothesized drift processes, consistent with the dynamic dominance hypothesis. PMID:28344070

The effect of haptic guidance and visual feedback on learning a complex tennis task.

PubMed

Marchal-Crespo, Laura; van Raai, Mark; Rauter, Georg; Wolf, Peter; Riener, Robert

2013-11-01

While haptic guidance can improve ongoing performance of a motor task, several studies have found that it ultimately impairs motor learning. However, some recent studies suggest that the haptic demonstration of optimal timing, rather than movement magnitude, enhances learning in subjects trained with haptic guidance. Timing of an action plays a crucial role in the proper accomplishment of many motor skills, such as hitting a moving object (discrete timing task) or learning a velocity profile (time-critical tracking task). The aim of the present study is to evaluate which feedback conditions-visual or haptic guidance-optimize learning of the discrete and continuous elements of a timing task. The experiment consisted in performing a fast tennis forehand stroke in a virtual environment. A tendon-based parallel robot connected to the end of a racket was used to apply haptic guidance during training. In two different experiments, we evaluated which feedback condition was more adequate for learning: (1) a time-dependent discrete task-learning to start a tennis stroke and (2) a tracking task-learning to follow a velocity profile. The effect that the task difficulty and subject's initial skill level have on the selection of the optimal training condition was further evaluated. Results showed that the training condition that maximizes learning of the discrete time-dependent motor task depends on the subjects' initial skill level. Haptic guidance was especially suitable for less-skilled subjects and in especially difficult discrete tasks, while visual feedback seems to benefit more skilled subjects. Additionally, haptic guidance seemed to promote learning in a time-critical tracking task, while visual feedback tended to deteriorate the performance independently of the task difficulty and subjects' initial skill level. Haptic guidance outperformed visual feedback, although additional studies are needed to further analyze the effect of other types of feedback visualization on motor learning of time-critical tasks.

The role of visual processing in motor learning and control: Insights from electroencephalography.

PubMed

Krigolson, Olav E; Cheng, Darian; Binsted, Gord

2015-05-01

Traditionally our understanding of goal-directed action been derived from either behavioral findings or neuroanatomically derived imaging (i.e., fMRI). While both of these approaches have proven valuable, they lack the ability to determine a direct locus of function while concurrently having the necessary temporal precision needed to understand millisecond scale neural interactions respectively. In this review we summarize some seminal behavioral findings across three broad areas (target perturbation, feed-forward control, and feedback processing) and for each discuss the application of electroencephalography (EEG) to the understanding of the temporal nature of visual cue utilization during movement planning, control, and learning using four existing scalp potentials. Specifically, we examine the appropriateness of using the N100 potential as an indicator of corrective behaviors in response to target perturbation, the N200 as an index of movement planning, the P300 potential as a metric of feed-forward processes, and the feedback-related negativity as an index of motor learning. Although these existing components have potential for insight into cognitive contributions and the timing of the neural processes that contribute to motor control further research is needed to expand the control-related potentials and to develop methods to permit their accurate characterization across a wide range of behavioral tasks. Copyright © 2015 Elsevier B.V. All rights reserved.

Social reward shapes attentional biases.

PubMed

Anderson, Brian A

2016-01-01

Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

Bimanual Coordination Learning with Different Augmented Feedback Modalities and Information Types

PubMed Central

Chiou, Shiau-Chuen; Chang, Erik Chihhung

2016-01-01

Previous studies have shown that bimanual coordination learning is more resistant to the removal of augmented feedback when acquired with auditory than with visual channel. However, it is unclear whether this differential “guidance effect” between feedback modalities is due to enhanced sensorimotor integration via the non-dominant auditory channel or strengthened linkage to kinesthetic information under rhythmic input. The current study aimed to examine how modalities (visual vs. auditory) and information types (continuous visuospatial vs. discrete rhythmic) of concurrent augmented feedback influence bimanual coordination learning. Participants either learned a 90°-out-of-phase pattern for three consecutive days with Lissajous feedback indicating the integrated position of both arms, or with visual or auditory rhythmic feedback reflecting the relative timing of the movement. The results showed diverse performance change after practice when the feedback was removed between Lissajous and the other two rhythmic groups, indicating that the guidance effect may be modulated by the type of information provided during practice. Moreover, significant performance improvement in the dual-task condition where the irregular rhythm counting task was applied as a secondary task also suggested that lower involvement of conscious control may result in better performance in bimanual coordination. PMID:26895286

Bimanual Coordination Learning with Different Augmented Feedback Modalities and Information Types.

PubMed

Chiou, Shiau-Chuen; Chang, Erik Chihhung

2016-01-01

Previous studies have shown that bimanual coordination learning is more resistant to the removal of augmented feedback when acquired with auditory than with visual channel. However, it is unclear whether this differential "guidance effect" between feedback modalities is due to enhanced sensorimotor integration via the non-dominant auditory channel or strengthened linkage to kinesthetic information under rhythmic input. The current study aimed to examine how modalities (visual vs. auditory) and information types (continuous visuospatial vs. discrete rhythmic) of concurrent augmented feedback influence bimanual coordination learning. Participants either learned a 90°-out-of-phase pattern for three consecutive days with Lissajous feedback indicating the integrated position of both arms, or with visual or auditory rhythmic feedback reflecting the relative timing of the movement. The results showed diverse performance change after practice when the feedback was removed between Lissajous and the other two rhythmic groups, indicating that the guidance effect may be modulated by the type of information provided during practice. Moreover, significant performance improvement in the dual-task condition where the irregular rhythm counting task was applied as a secondary task also suggested that lower involvement of conscious control may result in better performance in bimanual coordination.

Familial transmission of a body-related attentional bias - An eye-tracking study in a nonclinical sample of female adolescents and their mothers.

PubMed

Bauer, Anika; Schneider, Silvia; Waldorf, Manuel; Adolph, Dirk; Vocks, Silja

2017-01-01

Previous research indicates that body image disturbance is transmitted from mother to daughter via modeling of maternal body-related behaviors and attitudes (indirect transmission) and via maternal body-related feedback (direct transmission). So far, the transmission of body-related attentional biases, which according to cognitive-behavioral theories play a prominent role in the development and maintenance of eating disorders, has not been analyzed. The current eye-tracking study applied the concepts of direct and indirect transmission to body-related attentional biases by examining body-related viewing patterns on self- and other-pictures within mother-daughter dyads. Eye movements of N = 82 participants (n = 41 healthy female adolescents, mean age 15.82 years, SD = 1.80, and their mothers, mean age 47.78 years, SD = 4.52) were recorded while looking at whole-body pictures of themselves and a control peer. Based on fixations on self-defined attractive and unattractive body areas, visual attention bias scores were calculated for mothers and daughters, representing the pattern of body-related attention allocation. Based on mothers' fixations on their own daughter's and the adolescent peer's body, a second visual attention bias score was calculated, reflecting the mothers' viewing pattern on their own daughter. Analysis of variance revealed an attentional bias for self-defined unattractive body areas in adolescents. The girls' visual attention bias score correlated significantly with their mothers' bias score, indicating indirect transmission, and with their mothers' second bias score, indicating direct transmission. Moreover, the girls' bias score correlated significantly with negative body-related feedback from their mothers. Female adolescents show a deficit-oriented attentional bias for one's own and a peer's body. The correlated body-related attention patterns imply that attentional biases might be transmitted directly and indirectly from mothers to daughters. Results underline the potential relevance of maternal influences for the development of body image disturbance in girls and suggest specific family-based approaches for the prevention and treatment of eating disorders.

Development of closed-loop neural interface technology in a rat model: combining motor cortex operant conditioning with visual cortex microstimulation.

PubMed

Marzullo, Timothy Charles; Lehmkuhle, Mark J; Gage, Gregory J; Kipke, Daryl R

2010-04-01

Closed-loop neural interface technology that combines neural ensemble decoding with simultaneous electrical microstimulation feedback is hypothesized to improve deep brain stimulation techniques, neuromotor prosthetic applications, and epilepsy treatment. Here we describe our iterative results in a rat model of a sensory and motor neurophysiological feedback control system. Three rats were chronically implanted with microelectrode arrays in both the motor and visual cortices. The rats were subsequently trained over a period of weeks to modulate their motor cortex ensemble unit activity upon delivery of intra-cortical microstimulation (ICMS) of the visual cortex in order to receive a food reward. Rats were given continuous feedback via visual cortex ICMS during the response periods that was representative of the motor cortex ensemble dynamics. Analysis revealed that the feedback provided the animals with indicators of the behavioral trials. At the hardware level, this preparation provides a tractable test model for improving the technology of closed-loop neural devices.

Differential contributions of the superior and inferior parietal cortex to feedback versus feedforward control of tools.

PubMed

Macuga, Kristen L; Frey, Scott H

2014-05-15

Damage to the superior and/or inferior parietal lobules (SPL, IPL) (Sirigu et al., 1996) or cerebellum (Grealy and Lee, 2011) can selectively disrupt motor imagery, motivating the hypothesis that these regions participate in predictive (i.e., feedforward) control. If so, then the SPL, IPL, and cerebellum should show greater activity as the demands on feedforward control increase from visually-guided execution (closed-loop) to execution without visual feedback (open-loop) to motor imagery. Using fMRI and a Fitts' reciprocal aiming task with tools directed at targets in far space, we found that the SPL and cerebellum exhibited greater activity during closed-loop control. Conversely, open-loop and imagery conditions were associated with increased activity within the IPL and prefrontal areas. These results are consistent with a superior-to-inferior gradient in the representation of feedback-to-feedforward control within the posterior parietal cortex. Additionally, the anterior SPL displayed greater activity when aiming movements were performed with a stick vs. laser pointer. This may suggest that it is involved in the remapping of far into near (reachable) space (Maravita and Iriki, 2004), or in distalization of the end-effector from hand to stick (Arbib et al., 2009). Copyright © 2014 Elsevier Inc. All rights reserved.

Fitts' Law in the Control of Isometric Grip Force With Naturalistic Targets.

PubMed

Thumser, Zachary C; Slifkin, Andrew B; Beckler, Dylan T; Marasco, Paul D

2018-01-01

Fitts' law models the relationship between amplitude, precision, and speed of rapid movements. It is widely used to quantify performance in pointing tasks, study human-computer interaction, and generally to understand perceptual-motor information processes, including research to model performance in isometric force production tasks. Applying Fitts' law to an isometric grip force task would allow for quantifying grasp performance in rehabilitative medicine and may aid research on prosthetic control and design. We examined whether Fitts' law would hold when participants attempted to accurately produce their intended force output while grasping a manipulandum when presented with images of various everyday objects (we termed this the implicit task). Although our main interest was the implicit task, to benchmark it and establish validity, we examined performance against a more standard visual feedback condition via a digital force-feedback meter on a video monitor (explicit task). Next, we progressed from visual force feedback with force meter targets to the same targets without visual force feedback (operating largely on feedforward control with tactile feedback). This provided an opportunity to see if Fitts' law would hold without vision, and allowed us to progress toward the more naturalistic implicit task (which does not include visual feedback). Finally, we changed the nature of the targets from requiring explicit force values presented as arrows on a force-feedback meter (explicit targets) to the more naturalistic and intuitive target forces implied by images of objects (implicit targets). With visual force feedback the relation between task difficulty and the time to produce the target grip force was predicted by Fitts' law (average r 2 = 0.82). Without vision, average grip force scaled accurately although force variability was insensitive to the target presented. In contrast, images of everyday objects generated more reliable grip forces without the visualized force meter. In sum, population means were well-described by Fitts' law for explicit targets with vision ( r 2 = 0.96) and implicit targets ( r 2 = 0.89), but not as well-described for explicit targets without vision ( r 2 = 0.54). Implicit targets should provide a realistic see-object-squeeze-object test using Fitts' law to quantify the relative speed-accuracy relationship of any given grasper.

Neural activity in superior parietal cortex during rule-based visual-motor transformations.

PubMed

Hawkins, Kara M; Sayegh, Patricia; Yan, Xiaogang; Crawford, J Douglas; Sergio, Lauren E

2013-03-01

Cognition allows for the use of different rule-based sensorimotor strategies, but the neural underpinnings of such strategies are poorly understood. The purpose of this study was to compare neural activity in the superior parietal lobule during a standard (direct interaction) reaching task, with two nonstandard (gaze and reach spatially incongruent) reaching tasks requiring the integration of rule-based information. Specifically, these nonstandard tasks involved dissociating the planes of reach and vision or rotating visual feedback by 180°. Single unit activity, gaze, and reach trajectories were recorded from two female Macaca mulattas. In all three conditions, we observed a temporal discharge pattern at the population level reflecting early reach planning and on-line reach monitoring. In the plane-dissociated task, we found a significant overall attenuation in the discharge rate of cells from deep recording sites, relative to standard reaching. We also found that cells modulated by reach direction tended to be significantly tuned either during the standard or the plane-dissociated task but rarely during both. In the standard versus feedback reversal comparison, we observed some cells that shifted their preferred direction by 180° between conditions, reflecting maintenance of directional tuning with respect to the reach goal. Our findings suggest that the superior parietal lobule plays an important role in processing information about the nonstandard nature of a task, which, through reciprocal connections with precentral motor areas, contributes to the accurate transformation of incongruent sensory inputs into an appropriate motor output. Such processing is crucial for the integration of rule-based information into a motor act.

Similar brain networks for detecting visuo-motor and visuo-proprioceptive synchrony.

PubMed

Balslev, Daniela; Nielsen, Finn A; Lund, Torben E; Law, Ian; Paulson, Olaf B

2006-05-15

The ability to recognize feedback from own movement as opposed to the movement of someone else is important for motor control and social interaction. The neural processes involved in feedback recognition are incompletely understood. Two competing hypotheses have been proposed: the stimulus is compared with either (a) the proprioceptive feedback or with (b) the motor command and if they match, then the external stimulus is identified as feedback. Hypothesis (a) predicts that the neural mechanisms or brain areas involved in distinguishing self from other during passive and active movement are similar, whereas hypothesis (b) predicts that they are different. In this fMRI study, healthy subjects saw visual cursor movement that was either synchronous or asynchronous with their active or passive finger movements. The aim was to identify the brain areas where the neural activity depended on whether the visual stimulus was feedback from own movement and to contrast the functional activation maps for active and passive movement. We found activity increases in the right temporoparietal cortex in the condition with asynchronous relative to synchronous visual feedback from both active and passive movements. However, no statistically significant difference was found between these sets of activated areas when the active and passive movement conditions were compared. With a posterior probability of 0.95, no brain voxel had a contrast effect above 0.11% of the whole-brain mean signal. These results do not support the hypothesis that recognition of visual feedback during active and passive movement relies on different brain areas.

Automated numerical simulation of biological pattern formation based on visual feedback simulation framework

PubMed Central

Sun, Mingzhu; Xu, Hui; Zeng, Xingjuan; Zhao, Xin

2017-01-01

There are various fantastic biological phenomena in biological pattern formation. Mathematical modeling using reaction-diffusion partial differential equation systems is employed to study the mechanism of pattern formation. However, model parameter selection is both difficult and time consuming. In this paper, a visual feedback simulation framework is proposed to calculate the parameters of a mathematical model automatically based on the basic principle of feedback control. In the simulation framework, the simulation results are visualized, and the image features are extracted as the system feedback. Then, the unknown model parameters are obtained by comparing the image features of the simulation image and the target biological pattern. Considering two typical applications, the visual feedback simulation framework is applied to fulfill pattern formation simulations for vascular mesenchymal cells and lung development. In the simulation framework, the spot, stripe, labyrinthine patterns of vascular mesenchymal cells, the normal branching pattern and the branching pattern lacking side branching for lung branching are obtained in a finite number of iterations. The simulation results indicate that it is easy to achieve the simulation targets, especially when the simulation patterns are sensitive to the model parameters. Moreover, this simulation framework can expand to other types of biological pattern formation. PMID:28225811

A unified framework for image retrieval using keyword and visual features.

PubMed

Jing, Feng; Li, Mingling; Zhang, Hong-Jiang; Zhang, Bo

2005-07-01

In this paper, a unified image retrieval framework based on both keyword annotations and visual features is proposed. In this framework, a set of statistical models are built based on visual features of a small set of manually labeled images to represent semantic concepts and used to propagate keywords to other unlabeled images. These models are updated periodically when more images implicitly labeled by users become available through relevance feedback. In this sense, the keyword models serve the function of accumulation and memorization of knowledge learned from user-provided relevance feedback. Furthermore, two sets of effective and efficient similarity measures and relevance feedback schemes are proposed for query by keyword scenario and query by image example scenario, respectively. Keyword models are combined with visual features in these schemes. In particular, a new, entropy-based active learning strategy is introduced to improve the efficiency of relevance feedback for query by keyword. Furthermore, a new algorithm is proposed to estimate the keyword features of the search concept for query by image example. It is shown to be more appropriate than two existing relevance feedback algorithms. Experimental results demonstrate the effectiveness of the proposed framework.

Automated numerical simulation of biological pattern formation based on visual feedback simulation framework.

PubMed

Sun, Mingzhu; Xu, Hui; Zeng, Xingjuan; Zhao, Xin

2017-01-01

There are various fantastic biological phenomena in biological pattern formation. Mathematical modeling using reaction-diffusion partial differential equation systems is employed to study the mechanism of pattern formation. However, model parameter selection is both difficult and time consuming. In this paper, a visual feedback simulation framework is proposed to calculate the parameters of a mathematical model automatically based on the basic principle of feedback control. In the simulation framework, the simulation results are visualized, and the image features are extracted as the system feedback. Then, the unknown model parameters are obtained by comparing the image features of the simulation image and the target biological pattern. Considering two typical applications, the visual feedback simulation framework is applied to fulfill pattern formation simulations for vascular mesenchymal cells and lung development. In the simulation framework, the spot, stripe, labyrinthine patterns of vascular mesenchymal cells, the normal branching pattern and the branching pattern lacking side branching for lung branching are obtained in a finite number of iterations. The simulation results indicate that it is easy to achieve the simulation targets, especially when the simulation patterns are sensitive to the model parameters. Moreover, this simulation framework can expand to other types of biological pattern formation.

Visualizing Syllables: Real-Time Computerized Feedback within a Speech-Language Intervention

ERIC Educational Resources Information Center

DeThorne, Laura; Aparicio Betancourt, Mariana; Karahalios, Karrie; Halle, Jim; Bogue, Ellen

2015-01-01

Computerized technologies now offer unprecedented opportunities to provide real-time visual feedback to facilitate children's speech-language development. We employed a mixed-method design to examine the effectiveness of two speech-language interventions aimed at facilitating children's multisyllabic productions: one incorporated a novel…

The Inversion of Sensory Processing by Feedback Pathways: A Model of Visual Cognitive Functions.

ERIC Educational Resources Information Center

Harth, E.; And Others

1987-01-01

Explains the hierarchic structure of the mammalian visual system. Proposes a model in which feedback pathways serve to modify sensory stimuli in ways that enhance and complete sensory input patterns. Investigates the functioning of the system through computer simulations. (ML)

Learning to See: Enhancing Student Learning through Videotaped Feedback

ERIC Educational Resources Information Center

Yakura, Elaine K.

2009-01-01

Feedback is crucial to developing skills, but meaningful feedback is difficult to provide. Classroom videotaping can provide effective feedback on student performance, but for video feedback to be most helpful, students must develop a type of "visual intelligence"--analytical skills that increase critical thinking and self-awareness. The author…

Multivariable manual control with simultaneous visual and auditory presentation of information. [for improved compensatory tracking performance of human operator

NASA Technical Reports Server (NTRS)

Uhlemann, H.; Geiser, G.

1975-01-01

Multivariable manual compensatory tracking experiments were carried out in order to determine typical strategies of the human operator and conditions for improvement of his performance if one of the visual displays of the tracking errors is supplemented by an auditory feedback. Because the tracking error of the system which is only visually displayed is found to decrease, but not in general that of the auditorally supported system, it was concluded that the auditory feedback unloads the visual system of the operator who can then concentrate on the remaining exclusively visual displays.

A real-time plantar pressure feedback device for foot unloading.

PubMed

Femery, Virginie G; Moretto, Pierre G; Hespel, Jean-Michel G; Thévenon, André; Lensel, Ghislaine

2004-10-01

To develop and test a plantar pressure control device that provides both visual and auditory feedback and is suitable for correcting plantar pressure distribution patterns in persons susceptible to neuropathic foot ulceration. Pilot test. Sports medicine laboratory in a university in France. One healthy man in his mid thirties. Not applicable. Main outcome measures A device was developed based on real-time feedback, incorporating an acoustic alarm and visual signals, adjusted to a specific pressure load. Plantar pressure measured during walking, at 6 sensor locations over 27 steps under 2 different conditions: (1) natural and (2) unloaded in response to device feedback. The subject was able to modify his gait in response to the auditory and visual signals. He did not compensate for the decrease of peak pressure under the first metarsal by increasing the duration of the load shift under this area. Gait pattern modification centered on a mediolateral load shift. The auditory signal provided a warning system alerting the user to potentially harmful plantar pressures. The visual signal warned of the degree of pressure. People who have lost nociceptive perception, as in cases of diabetic neuropathy, may be able to change their walking pattern in response to the feedback provided by this device. The visual may have diagnostic value in determining plantar pressures in such patients. This pilot test indicates that further studies are warranted.

Explicit knowledge about the availability of visual feedback affects grasping with the left but not the right hand.

PubMed

Tang, Rixin; Whitwell, Robert L; Goodale, Melvyn A

2014-01-01

Previous research (Whitwell et al. in Exp Brain Res 188:603-611, 2008; Whitwell and Goodale in Exp Brain Res 194:619-629, 2009) has shown that trial history, but not anticipatory knowledge about the presence or absence of visual feedback on an upcoming trial, plays a vital role in determining how that feedback is exploited when grasping with the right hand. Nothing is known about how the non-dominant left hand behaves under the same feedback regimens. In present study, therefore, we compared peak grip aperture (PGA) for left- and right-hand grasps executed with and without visual feedback (i.e., closed- vs. open-loop conditions) in right-handed individuals under three different trial schedules: the feedback conditions were blocked separately, they were randomly interleaved, or they were alternated. When feedback conditions were blocked, the PGA was much larger for open-loop trials as compared to closed-loop trials, although this difference was more pronounced for right-hand grasps than left-hand grasps. Like Whitwell et al., we found that mixing open- and closed-loop trials together, compared to blocking them separately, homogenized the PGA for open- and closed-loop grasping in the right hand (i.e., the PGAs became smaller on open-loop trials and larger on closed-loop trials). In addition, the PGAs for right-hand grasps were entirely determined by trial history and not by knowledge of whether or not visual feedback would be available on an upcoming trial. In contrast to grasps made with the right hand, grasps made by the left hand were affected both by trial history and by anticipatory knowledge of the upcoming visual feedback condition. But these effects were observed only on closed-loop trials, i.e., the PGAs of grasps made with the left hand on closed-loop trials were smaller when participants could anticipate the availability of feedback on an upcoming trial (alternating trials) than when they could not (randomized trials). In contrast, grasps made with the left hand on open-loop trials exhibited the same large PGAs under all feedback schedules: blocked, random, or alternating. In other words, there was no evidence for homogenization. Taken together, these results suggest that in addition to the real-time demands of the task, such as the target's size and position and the availability of visual feedback, the initial (i.e., pre-movement) programming of right-hand grasping relies on what happened on the previous trial, whereas the programming of left-hand grasping is more cognitively supervised and exploits explicit information about trial order to prepare for an upcoming trial.

Adaptive Locomotor Behavior in Larval Zebrafish

PubMed Central

Portugues, Ruben; Engert, Florian

2011-01-01

In this study we report that larval zebrafish display adaptive locomotor output that can be driven by unexpected visual feedback. We develop a new assay that addresses visuomotor integration in restrained larval zebrafish. The assay involves a closed-loop environment in which the visual feedback a larva receives depends on its own motor output in a way that resembles freely swimming conditions. The experimenter can control the gain of this closed feedback loop, so that following a given motor output the larva experiences more or less visual feedback depending on whether the gain is high or low. We show that increases and decreases in this gain setting result in adaptive changes in behavior that lead to a generalized decrease or increase of motor output, respectively. Our behavioral analysis shows that both the duration and tail beat frequency of individual swim bouts can be modified, as well as the frequency with which bouts are elicited. These changes can be implemented rapidly, following an exposure to a new gain of just 175 ms. In addition, modifications in some behavioral parameters accumulate over tens of seconds and effects last for at least 30 s from trial to trial. These results suggest that larvae establish an internal representation of the visual feedback expected from a given motor output and that the behavioral modifications are driven by an error signal that arises from the discrepancy between this expectation and the actual visual feedback. The assay we develop presents a unique possibility for studying visuomotor integration using imaging techniques available in the larval zebrafish. PMID:21909325

Adaptive locomotor behavior in larval zebrafish.

PubMed

Portugues, Ruben; Engert, Florian

2011-01-01

In this study we report that larval zebrafish display adaptive locomotor output that can be driven by unexpected visual feedback. We develop a new assay that addresses visuomotor integration in restrained larval zebrafish. The assay involves a closed-loop environment in which the visual feedback a larva receives depends on its own motor output in a way that resembles freely swimming conditions. The experimenter can control the gain of this closed feedback loop, so that following a given motor output the larva experiences more or less visual feedback depending on whether the gain is high or low. We show that increases and decreases in this gain setting result in adaptive changes in behavior that lead to a generalized decrease or increase of motor output, respectively. Our behavioral analysis shows that both the duration and tail beat frequency of individual swim bouts can be modified, as well as the frequency with which bouts are elicited. These changes can be implemented rapidly, following an exposure to a new gain of just 175 ms. In addition, modifications in some behavioral parameters accumulate over tens of seconds and effects last for at least 30 s from trial to trial. These results suggest that larvae establish an internal representation of the visual feedback expected from a given motor output and that the behavioral modifications are driven by an error signal that arises from the discrepancy between this expectation and the actual visual feedback. The assay we develop presents a unique possibility for studying visuomotor integration using imaging techniques available in the larval zebrafish.

Top-down signal transmission and global hyperconnectivity in auditory-visual synesthesia: Evidence from a functional EEG resting-state study.

PubMed

Brauchli, Christian; Elmer, Stefan; Rogenmoser, Lars; Burkhard, Anja; Jäncke, Lutz

2018-01-01

Auditory-visual (AV) synesthesia is a rare phenomenon in which an auditory stimulus induces a "concurrent" color sensation. Current neurophysiological models of synesthesia mainly hypothesize "hyperconnected" and "hyperactivated" brains, but differ in the directionality of signal transmission. The two-stage model proposes bottom-up signal transmission from inducer- to concurrent- to higher-order brain areas, whereas the disinhibited feedback model postulates top-down signal transmission from inducer- to higher-order- to concurrent brain areas. To test the different models of synesthesia, we estimated local current density, directed and undirected connectivity patterns in the intracranial space during 2 min of resting-state (RS) EEG in 11 AV synesthetes and 11 nonsynesthetes. AV synesthetes demonstrated increased parietal theta, alpha, and lower beta current density compared to nonsynesthetes. Furthermore, AV synesthetes were characterized by increased top-down signal transmission from the superior parietal lobe to the left color processing area V4 in the upper beta frequency band. Analyses of undirected connectivity revealed a global, synesthesia-specific hyperconnectivity in the alpha frequency band. The involvement of the superior parietal lobe even during rest is a strong indicator for its key role in AV synesthesia. By demonstrating top-down signal transmission in AV synesthetes, we provide direct support for the disinhibited feedback model of synesthesia. Finally, we suggest that synesthesia is a consequence of global hyperconnectivity. Hum Brain Mapp 39:522-531, 2018. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Self-Management of Patient Body Position, Pose, and Motion Using Wide-Field, Real-Time Optical Measurement Feedback: Results of a Volunteer Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Parkhurst, James M.; Price, Gareth J., E-mail: gareth.price@christie.nhs.uk; Faculty of Medical and Human Sciences, Manchester Academic Health Sciences Centre, University of Manchester, Manchester

2013-12-01

Purpose: We present the results of a clinical feasibility study, performed in 10 healthy volunteers undergoing a simulated treatment over 3 sessions, to investigate the use of a wide-field visual feedback technique intended to help patients control their pose while reducing motion during radiation therapy treatment. Methods and Materials: An optical surface sensor is used to capture wide-area measurements of a subject's body surface with visualizations of these data displayed back to them in real time. In this study we hypothesize that this active feedback mechanism will enable patients to control their motion and help them maintain their setup posemore » and position. A capability hierarchy of 3 different level-of-detail abstractions of the measured surface data is systematically compared. Results: Use of the device enabled volunteers to increase their conformance to a reference surface, as measured by decreased variability across their body surfaces. The use of visual feedback also enabled volunteers to reduce their respiratory motion amplitude to 1.7 ± 0.6 mm compared with 2.7 ± 1.4 mm without visual feedback. Conclusions: The use of live feedback of their optically measured body surfaces enabled a set of volunteers to better manage their pose and motion when compared with free breathing. The method is suitable to be taken forward to patient studies.« less

Effects of acoustic feedback training in elite-standard Para-Rowing.

PubMed

Schaffert, Nina; Mattes, Klaus

2015-01-01

Assessment and feedback devices have been regularly used in technique training in high-performance sports. Biomechanical analysis is mainly visually based and so can exclude athletes with visual impairments. The aim of this study was to examine the effects of auditory feedback on mean boat speed during on-water training of visually impaired athletes. The German National Para-Rowing team (six athletes, mean ± s, age 34.8 ± 10.6 years, body mass 76.5 ± 13.5 kg, stature 179.3 ± 8.6 cm) participated in the study. Kinematics included boat acceleration and distance travelled, collected with Sofirow at two intensities of training. The boat acceleration-time traces were converted online into acoustic feedback and presented via speakers during rowing (sections with and without alternately). Repeated-measures within-participant factorial ANOVA showed greater boat speed with acoustic feedback than baseline (0.08 ± 0.01 m·s(-1)). The time structure of rowing cycles was improved (extended time of positive acceleration). Questioning of athletes showed acoustic feedback to be a supportive training aid as it provided important functional information about the boat motion independent of vision. It gave access for visually impaired athletes to biomechanical analysis via auditory information. The concept for adaptive athletes has been successfully integrated into the preparation for the Para-Rowing World Championships and Paralympics.

Feedforward and Feedback Motor Control Abnormalities Implicate Cerebellar Dysfunctions in Autism Spectrum Disorder

PubMed Central

Mohanty, Suman; Greene, Rachel K.; Cook, Edwin H.; Vaillancourt, David E.; Sweeney, John A.

2015-01-01

Sensorimotor abnormalities are common in autism spectrum disorder (ASD) and among the earliest manifestations of the disorder. They have been studied far less than the social-communication and cognitive deficits that define ASD, but a mechanistic understanding of sensorimotor abnormalities in ASD may provide key insights into the neural underpinnings of the disorder. In this human study, we examined rapid, precision grip force contractions to determine whether feedforward mechanisms supporting initial motor output before sensory feedback can be processed are disrupted in ASD. Sustained force contractions also were examined to determine whether reactive adjustments to ongoing motor behavior based on visual feedback are altered. Sustained force was studied across multiple force levels and visual gains to assess motor and visuomotor mechanisms, respectively. Primary force contractions of individuals with ASD showed greater peak rate of force increases and large transient overshoots. Individuals with ASD also showed increased sustained force variability that scaled with force level and was more severe when visual gain was highly amplified or highly degraded. When sustaining a constant force level, their reactive adjustments were more periodic than controls, and they showed increased reliance on slower feedback mechanisms. Feedforward and feedback mechanism alterations each were associated with more severe social-communication impairments in ASD. These findings implicate anterior cerebellar circuits involved in feedforward motor control and posterior cerebellar circuits involved in transforming visual feedback into precise motor adjustments in ASD. PMID:25653359

Integrative advances for OCT-guided ophthalmic surgery and intraoperative OCT: microscope integration, surgical instrumentation, and heads-up display surgeon feedback.

PubMed

Ehlers, Justis P; Srivastava, Sunil K; Feiler, Daniel; Noonan, Amanda I; Rollins, Andrew M; Tao, Yuankai K

2014-01-01

To demonstrate key integrative advances in microscope-integrated intraoperative optical coherence tomography (iOCT) technology that will facilitate adoption and utilization during ophthalmic surgery. We developed a second-generation prototype microscope-integrated iOCT system that interfaces directly with a standard ophthalmic surgical microscope. Novel features for improved design and functionality included improved profile and ergonomics, as well as a tunable lens system for optimized image quality and heads-up display (HUD) system for surgeon feedback. Novel material testing was performed for potential suitability for OCT-compatible instrumentation based on light scattering and transmission characteristics. Prototype surgical instruments were developed based on material testing and tested using the microscope-integrated iOCT system. Several surgical maneuvers were performed and imaged, and surgical motion visualization was evaluated with a unique scanning and image processing protocol. High-resolution images were successfully obtained with the microscope-integrated iOCT system with HUD feedback. Six semi-transparent materials were characterized to determine their attenuation coefficients and scatter density with an 830 nm OCT light source. Based on these optical properties, polycarbonate was selected as a material substrate for prototype instrument construction. A surgical pick, retinal forceps, and corneal needle were constructed with semi-transparent materials. Excellent visualization of both the underlying tissues and surgical instrument were achieved on OCT cross-section. Using model eyes, various surgical maneuvers were visualized, including membrane peeling, vessel manipulation, cannulation of the subretinal space, subretinal intraocular foreign body removal, and corneal penetration. Significant iterative improvements in integrative technology related to iOCT and ophthalmic surgery are demonstrated.

Social feedback processing from early to late adolescence: influence of sex, age, and attachment style

PubMed Central

Vrtička, Pascal; Sander, David; Anderson, Brittany; Badoud, Deborah; Eliez, Stephan; Debbané, Martin

2014-01-01

Objective The establishment of an accurate understanding of one's social context is a central developmental task during adolescence. A critical component of such development is to learn how to integrate the objective evaluation of one's behavior with the social response to the latter—here referred to as social feedback processing. Case report We measured brain activity by means of fMRI in 33 healthy adolescents (12–19 years old, 14 females). Participants played a difficult perceptual game with integrated verbal and visual feedback. Verbal feedback provided the participants with objective performance evaluation (won vs. lost). Visual feedback consisted of either smiling or angry faces, representing positive or negative social evaluations. Together, the combination of verbal and visual feedback gave rise to congruent versus incongruent social feedback combinations. In addition to assessing sex differences, we further tested for the effects of age and attachment style on social feedback processing. Results revealed that brain activity during social feedback processing was significantly modulated by sex, age, and attachment style in prefrontal cortical areas, ventral anterior cingulate cortex, anterior insula, caudate, and amygdala/hippocampus. We found indication for heightened activity during incongruent social feedback processing in females, older participants, and individuals with an anxious attachment style. Conversely, we observed stronger activity during processing of congruent social feedback in males and participants with an avoidant attachment style. Conclusion Our findings not only extend knowledge on the typical development of socio-emotional brain function during adolescence, but also provide first clues on how attachment insecurities, and particularly attachment avoidance, could interfere with the latter mechanisms. PMID:25328847

Improving Student Performance Using Nudge Analytics

ERIC Educational Resources Information Center

Feild, Jacqueline

2015-01-01

Providing students with continuous and personalized feedback on their performance is an important part of encouraging self regulated learning. As part of our higher education platform, we built a set of data visualizations to provide feedback to students on their assignment performance. These visualizations give students information about how they…

Brain-actuated gait trainer with visual and proprioceptive feedback

NASA Astrophysics Data System (ADS)

Liu, Dong; Chen, Weihai; Lee, Kyuhwa; Chavarriaga, Ricardo; Bouri, Mohamed; Pei, Zhongcai; Millán, José del R.

2017-10-01

Objective. Brain-machine interfaces (BMIs) have been proposed in closed-loop applications for neuromodulation and neurorehabilitation. This study describes the impact of different feedback modalities on the performance of an EEG-based BMI that decodes motor imagery (MI) of leg flexion and extension. Approach. We executed experiments in a lower-limb gait trainer (the legoPress) where nine able-bodied subjects participated in three consecutive sessions based on a crossover design. A random forest classifier was trained from the offline session and tested online with visual and proprioceptive feedback, respectively. Post-hoc classification was conducted to assess the impact of feedback modalities and learning effect (an improvement over time) on the simulated trial-based performance. Finally, we performed feature analysis to investigate the discriminant power and brain pattern modulations across the subjects. Main results. (i) For real-time classification, the average accuracy was 62.33 +/- 4.95 % and 63.89 +/- 6.41 % for the two online sessions. The results were significantly higher than chance level, demonstrating the feasibility to distinguish between MI of leg extension and flexion. (ii) For post-hoc classification, the performance with proprioceptive feedback (69.45 +/- 9.95 %) was significantly better than with visual feedback (62.89 +/- 9.20 %), while there was no significant learning effect. (iii) We reported individual discriminate features and brain patterns associated to each feedback modality, which exhibited differences between the two modalities although no general conclusion can be drawn. Significance. The study reported a closed-loop brain-controlled gait trainer, as a proof of concept for neurorehabilitation devices. We reported the feasibility of decoding lower-limb movement in an intuitive and natural way. As far as we know, this is the first online study discussing the role of feedback modalities in lower-limb MI decoding. Our results suggest that proprioceptive feedback has an advantage over visual feedback, which could be used to improve robot-assisted strategies for motor training and functional recovery.

Brain-actuated gait trainer with visual and proprioceptive feedback.

PubMed

Liu, Dong; Chen, Weihai; Lee, Kyuhwa; Chavarriaga, Ricardo; Bouri, Mohamed; Pei, Zhongcai; Del R Millán, José

2017-10-01

Brain-machine interfaces (BMIs) have been proposed in closed-loop applications for neuromodulation and neurorehabilitation. This study describes the impact of different feedback modalities on the performance of an EEG-based BMI that decodes motor imagery (MI) of leg flexion and extension. We executed experiments in a lower-limb gait trainer (the legoPress) where nine able-bodied subjects participated in three consecutive sessions based on a crossover design. A random forest classifier was trained from the offline session and tested online with visual and proprioceptive feedback, respectively. Post-hoc classification was conducted to assess the impact of feedback modalities and learning effect (an improvement over time) on the simulated trial-based performance. Finally, we performed feature analysis to investigate the discriminant power and brain pattern modulations across the subjects. (i) For real-time classification, the average accuracy was [Formula: see text]% and [Formula: see text]% for the two online sessions. The results were significantly higher than chance level, demonstrating the feasibility to distinguish between MI of leg extension and flexion. (ii) For post-hoc classification, the performance with proprioceptive feedback ([Formula: see text]%) was significantly better than with visual feedback ([Formula: see text]%), while there was no significant learning effect. (iii) We reported individual discriminate features and brain patterns associated to each feedback modality, which exhibited differences between the two modalities although no general conclusion can be drawn. The study reported a closed-loop brain-controlled gait trainer, as a proof of concept for neurorehabilitation devices. We reported the feasibility of decoding lower-limb movement in an intuitive and natural way. As far as we know, this is the first online study discussing the role of feedback modalities in lower-limb MI decoding. Our results suggest that proprioceptive feedback has an advantage over visual feedback, which could be used to improve robot-assisted strategies for motor training and functional recovery.

Marginally perceptible outcome feedback, motor learning and implicit processes.

PubMed

Masters, Rich S W; Maxwell, Jon P; Eves, Frank F

2009-09-01

Participants struck 500 golf balls to a concealed target. Outcome feedback was presented at the subjective or objective threshold of awareness of each participant or at a supraliminal threshold. Participants who received fully perceptible (supraliminal) feedback learned to strike the ball onto the target, as did participants who received feedback that was only marginally perceptible (subjective threshold). Participants who received feedback that was not perceptible (objective threshold) showed no learning. Upon transfer to a condition in which the target was unconcealed, performance increased in both the subjective and the objective threshold condition, but decreased in the supraliminal condition. In all three conditions, participants reported minimal declarative knowledge of their movements, suggesting that deliberate hypothesis testing about how best to move in order to perform the motor task successfully was disrupted by the impoverished disposition of the visual outcome feedback. It was concluded that sub-optimally perceptible visual feedback evokes implicit processes.

Visual feedback training improves postural adjustments associated with moving obstacle avoidance in elderly women.

PubMed

Hatzitaki, V; Voudouris, D; Nikodelis, T; Amiridis, I G

2009-02-01

The study examined the impact of visually guided weight shifting (WS) practice on the postural adjustments evoked by elderly women when avoiding collision with a moving obstacle while standing. Fifty-six healthy elderly women (70.9+/-5.7 years, 87.5+/-9.6 kg) were randomly assigned into one of three groups: a group that completed 12 sessions (25 min, 3s/week) of WS practice in the Anterior/Posterior direction (A/P group, n=20), a group that performed the same practice in the medio/lateral direction (M/L group, n=20) and a control group (n=16). Pre- and post-training, participants were tested in a moving obstacle avoidance task. As a result of practice, postural response onset shifted closer to the time of collision with the obstacle. Side-to-side WS resulted in a reduction of the M/L sway amplitude and an increase of the trunk's velocity during avoidance. It is concluded that visually guided WS practice enhances elderly's ability for on-line visuo-motor processing when avoiding collision eliminating reliance on anticipatory scaling. Specifying the direction of WS seems to be critical for optimizing the transfer of training adaptations.

Predictive Feedback and Conscious Visual Experience

PubMed Central

Panichello, Matthew F.; Cheung, Olivia S.; Bar, Moshe

2012-01-01

The human brain continuously generates predictions about the environment based on learned regularities in the world. These predictions actively and efficiently facilitate the interpretation of incoming sensory information. We review evidence that, as a result of this facilitation, predictions directly influence conscious experience. Specifically, we propose that predictions enable rapid generation of conscious percepts and bias the contents of awareness in situations of uncertainty. The possible neural mechanisms underlying this facilitation are discussed. PMID:23346068

Using Screencasts to Enhance Assessment Feedback: Students' Perceptions and Preferences

ERIC Educational Resources Information Center

Marriott, Pru; Teoh, Lim Keong

2012-01-01

In the UK, assessment and feedback have been regularly highlighted by the National Student Survey as critical aspects that require improvement. An innovative approach to delivering feedback that has proved successful in non-business-related disciplines is the delivery of audio and visual feedback using screencast technology. The feedback on…

Color Processing in the Early Visual System of Drosophila.

PubMed

Schnaitmann, Christopher; Haikala, Väinö; Abraham, Eva; Oberhauser, Vitus; Thestrup, Thomas; Griesbeck, Oliver; Reiff, Dierk F

2018-01-11

Color vision extracts spectral information by comparing signals from photoreceptors with different visual pigments. Such comparisons are encoded by color-opponent neurons that are excited at one wavelength and inhibited at another. Here, we examine the circuit implementation of color-opponent processing in the Drosophila visual system by combining two-photon calcium imaging with genetic dissection of visual circuits. We report that color-opponent processing of UV short /blue and UV long /green is already implemented in R7/R8 inner photoreceptor terminals of "pale" and "yellow" ommatidia, respectively. R7 and R8 photoreceptors of the same type of ommatidia mutually inhibit each other directly via HisCl1 histamine receptors and receive additional feedback inhibition that requires the second histamine receptor Ort. Color-opponent processing at the first visual synapse represents an unexpected commonality between Drosophila and vertebrates; however, the differences in the molecular and cellular implementation suggest that the same principles evolved independently. Copyright © 2017 Elsevier Inc. All rights reserved.

TADtool: visual parameter identification for TAD-calling algorithms.

PubMed

Kruse, Kai; Hug, Clemens B; Hernández-Rodríguez, Benjamín; Vaquerizas, Juan M

2016-10-15

Eukaryotic genomes are hierarchically organized into topologically associating domains (TADs). The computational identification of these domains and their associated properties critically depends on the choice of suitable parameters of TAD-calling algorithms. To reduce the element of trial-and-error in parameter selection, we have developed TADtool: an interactive plot to find robust TAD-calling parameters with immediate visual feedback. TADtool allows the direct export of TADs called with a chosen set of parameters for two of the most common TAD calling algorithms: directionality and insulation index. It can be used as an intuitive, standalone application or as a Python package for maximum flexibility. TADtool is available as a Python package from GitHub (https://github.com/vaquerizaslab/tadtool) or can be installed directly via PyPI, the Python package index (tadtool). kai.kruse@mpi-muenster.mpg.de, jmv@mpi-muenster.mpg.deSupplementary information: Supplementary data are available at Bioinformatics online. © The Author 2016. Published by Oxford University Press.

Spontaneous eye movements in goldfish: oculomotor integrator performance, plasticity, and dependence on visual feedback.

PubMed

Mensh, B D; Aksay, E; Lee, D D; Seung, H S; Tank, D W

2004-03-01

To quantify performance of the goldfish oculomotor neural integrator and determine its dependence on visual feedback, we measured the relationship between eye drift-velocity and position during spontaneous gaze fixations in the light and in the dark. In the light, drift-velocities were typically less than 1 deg/s, similar to those observed in humans. During brief periods in darkness, drift-velocities were only slightly larger, but showed greater variance. One hour in darkness degraded fixation-holding performance. These findings suggest that while visual feedback is not essential for online fixation stability, it may be used to tune the mechanism of persistent neural activity in the oculomotor integrator.

Visuomotor adaptability in older adults with mild cognitive decline.

PubMed

Schaffert, Jeffrey; Lee, Chi-Mei; Neill, Rebecca; Bo, Jin

2017-02-01

The current study examined the augmentation of error feedback on visuomotor adaptability in older adults with varying degrees of cognitive decline (assessed by the Montreal Cognitive Assessment; MoCA). Twenty-three participants performed a center-out computerized visuomotor adaptation task when the visual feedback of their hand movement error was presented in a regular (ratio=1:1) or enhanced (ratio=1:2) error feedback schedule. Results showed that older adults with lower scores on the MoCA had less adaptability than those with higher MoCA scores during the regular feedback schedule. However, participants demonstrated similar adaptability during the enhanced feedback schedule, regardless of their cognitive ability. Furthermore, individuals with lower MoCA scores showed larger after-effects in spatial control during the enhanced schedule compared to the regular schedule, whereas individuals with higher MoCA scores displayed the opposite pattern. Additional neuro-cognitive assessments revealed that spatial working memory and processing speed were positively related to motor adaptability during the regular scheduled but negatively related to adaptability during the enhanced schedule. We argue that individuals with mild cognitive decline employed different adaptation strategies when encountering enhanced visual feedback, suggesting older adults with mild cognitive impairment (MCI) may benefit from enhanced visual error feedback during sensorimotor adaptation. Copyright © 2016 Elsevier B.V. All rights reserved.

Improving training of laparoscopic tissue manipulation skills using various visual force feedback types.

PubMed

Smit, Daan; Spruit, Edward; Dankelman, Jenny; Tuijthof, Gabrielle; Hamming, Jaap; Horeman, Tim

2017-01-01

Visual force feedback allows trainees to learn laparoscopic tissue manipulation skills. The aim of this experimental study was to find the most efficient visual force feedback method to acquire these skills. Retention and transfer validity to an untrained task were assessed. Medical students without prior experience in laparoscopy were randomized in three groups: Constant Force Feedback (CFF) (N = 17), Bandwidth Force Feedback (BFF) (N = 16) and Fade-in Force Feedback (N = 18). All participants performed a pretest, training, post-test and follow-up test. The study involved two dissimilar tissue manipulation tasks, one for training and one to assess transferability. Participants performed six trials of the training task. A force platform was used to record several force parameters. A paired-sample t test showed overall lower force parameter outcomes in the post-test compared to the pretest (p < .001). A week later, the force parameter outcomes were still significantly lower than found in the pretest (p < .005). Participants also performed the transfer task in the post-test (p < .02) and follow-up (p < .05) test with lower force parameter outcomes compared to the pretest. A one-way MANOVA indicated that in the post-test the CFF group applied 50 % less Mean Absolute Nonzero Force (p = .005) than the BFF group. All visual force feedback methods showed to be effective in decreasing tissue manipulation force as no major differences were found between groups in the post and follow-up trials. The BFF method is preferred for it respects individual progress and minimizes distraction.

Designing between Pedagogies and Cultures: Audio-Visual Chinese Language Resources for Australian Schools

ERIC Educational Resources Information Center

Yuan, Yifeng; Shen, Huizhong

2016-01-01

This design-based study examines the creation and development of audio-visual Chinese language teaching and learning materials for Australian schools by incorporating users' feedback and content writers' input that emerged in the designing process. Data were collected from workshop feedback of two groups of Chinese-language teachers from primary…

Using Real-Time Visual Feedback to Improve Posture at Computer Workstations

ERIC Educational Resources Information Center

Sigurdsson, Sigurdur O.; Austin, John

2008-01-01

The purpose of the current study was to examine the effects of a multicomponent intervention that included discrimination training, real-time visual feedback, and self-monitoring on postural behavior at a computer workstation in a simulated office environment. Using a nonconcurrent multiple baseline design across 8 participants, the study assessed…

Effects of visual feedback balance training on the balance and ankle instability in adult men with functional ankle instability.

PubMed

Nam, Seung-Min; Kim, Kyoung; Lee, Do Youn

2018-01-01

[Purpose] This study examined the effects of visual feedback balance training on the balance and ankle instability in adult men with functional ankle instability. [Subjects and Methods] Twenty eight adults with functional ankle instability, divided randomly into an experimental group, which performed visual feedback balance training for 20 minutes and ankle joint exercises for 10 minutes, and a control group, which performed ankle joint exercise for 30 minutes. Exercises were completed three times a week for 8 weeks. Bio rescue was used for balance ability. It measured limit of stability at one minute. For ankle instability was measured using Cumberland ankle instability tool (CAIT). This measure was performed before and after the experiments in each group. [Results] The experimental group had significant increase in the Limit of Stability and CAIT score. The control group had significant increase in CAIT score. While the Limit of Stability increased without significance. [Conclusion] In conclusion, visual feedback balance training can be recommended as a treatment method for patients with functional ankle instability.

Hierarchical representation of shapes in visual cortex—from localized features to figural shape segregation

PubMed Central

Tschechne, Stephan; Neumann, Heiko

2014-01-01

Visual structures in the environment are segmented into image regions and those combined to a representation of surfaces and prototypical objects. Such a perceptual organization is performed by complex neural mechanisms in the visual cortex of primates. Multiple mutually connected areas in the ventral cortical pathway receive visual input and extract local form features that are subsequently grouped into increasingly complex, more meaningful image elements. Such a distributed network of processing must be capable to make accessible highly articulated changes in shape boundary as well as very subtle curvature changes that contribute to the perception of an object. We propose a recurrent computational network architecture that utilizes hierarchical distributed representations of shape features to encode surface and object boundary over different scales of resolution. Our model makes use of neural mechanisms that model the processing capabilities of early and intermediate stages in visual cortex, namely areas V1–V4 and IT. We suggest that multiple specialized component representations interact by feedforward hierarchical processing that is combined with feedback signals driven by representations generated at higher stages. Based on this, global configurational as well as local information is made available to distinguish changes in the object's contour. Once the outline of a shape has been established, contextual contour configurations are used to assign border ownership directions and thus achieve segregation of figure and ground. The model, thus, proposes how separate mechanisms contribute to distributed hierarchical cortical shape representation and combine with processes of figure-ground segregation. Our model is probed with a selection of stimuli to illustrate processing results at different processing stages. We especially highlight how modulatory feedback connections contribute to the processing of visual input at various stages in the processing hierarchy. PMID:25157228

Hierarchical representation of shapes in visual cortex-from localized features to figural shape segregation.

PubMed

Tschechne, Stephan; Neumann, Heiko

2014-01-01

Visual structures in the environment are segmented into image regions and those combined to a representation of surfaces and prototypical objects. Such a perceptual organization is performed by complex neural mechanisms in the visual cortex of primates. Multiple mutually connected areas in the ventral cortical pathway receive visual input and extract local form features that are subsequently grouped into increasingly complex, more meaningful image elements. Such a distributed network of processing must be capable to make accessible highly articulated changes in shape boundary as well as very subtle curvature changes that contribute to the perception of an object. We propose a recurrent computational network architecture that utilizes hierarchical distributed representations of shape features to encode surface and object boundary over different scales of resolution. Our model makes use of neural mechanisms that model the processing capabilities of early and intermediate stages in visual cortex, namely areas V1-V4 and IT. We suggest that multiple specialized component representations interact by feedforward hierarchical processing that is combined with feedback signals driven by representations generated at higher stages. Based on this, global configurational as well as local information is made available to distinguish changes in the object's contour. Once the outline of a shape has been established, contextual contour configurations are used to assign border ownership directions and thus achieve segregation of figure and ground. The model, thus, proposes how separate mechanisms contribute to distributed hierarchical cortical shape representation and combine with processes of figure-ground segregation. Our model is probed with a selection of stimuli to illustrate processing results at different processing stages. We especially highlight how modulatory feedback connections contribute to the processing of visual input at various stages in the processing hierarchy.

Perception of CPR quality: Influence of CPR feedback, Just-in-Time CPR training and provider role.

PubMed

Cheng, Adam; Overly, Frank; Kessler, David; Nadkarni, Vinay M; Lin, Yiqun; Doan, Quynh; Duff, Jonathan P; Tofil, Nancy M; Bhanji, Farhan; Adler, Mark; Charnovich, Alex; Hunt, Elizabeth A; Brown, Linda L

2015-02-01

Many healthcare providers rely on visual perception to guide cardiopulmonary resuscitation (CPR), but little is known about the accuracy of provider perceptions of CPR quality. We aimed to describe the difference between perceived versus measured CPR quality, and to determine the impact of provider role, real-time visual CPR feedback and Just-in-Time (JIT) CPR training on provider perceptions. We conducted secondary analyses of data collected from a prospective, multicenter, randomized trial of 324 healthcare providers who participated in a simulated cardiac arrest scenario between July 2012 and April 2014. Participants were randomized to one of four permutations of: JIT CPR training and real-time visual CPR feedback. We calculated the difference between perceived and measured quality of CPR and reported the proportion of subjects accurately estimating the quality of CPR within each study arm. Participants overestimated achieving adequate chest compression depth (mean difference range: 16.1-60.6%) and rate (range: 0.2-51%), and underestimated chest compression fraction (0.2-2.9%) across all arms. Compared to no intervention, the use of real-time feedback and JIT CPR training (alone or in combination) improved perception of depth (p<0.001). Accurate estimation of CPR quality was poor for chest compression depth (0-13%), rate (5-46%) and chest compression fraction (60-63%). Perception of depth is more accurate in CPR providers versus team leaders (27.8% vs. 7.4%; p=0.043) when using real-time feedback. Healthcare providers' visual perception of CPR quality is poor. Perceptions of CPR depth are improved by using real-time visual feedback and with prior JIT CPR training. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Impact of online visual feedback on motor acquisition and retention when learning to reach in a force field.

PubMed

Batcho, C S; Gagné, M; Bouyer, L J; Roy, J S; Mercier, C

2016-11-19

When subjects learn a novel motor task, several sources of feedback (proprioceptive, visual or auditory) contribute to the performance. Over the past few years, several studies have investigated the role of visual feedback in motor learning, yet evidence remains conflicting. The aim of this study was therefore to investigate the role of online visual feedback (VFb) on the acquisition and retention stages of motor learning associated with training in a reaching task. Thirty healthy subjects made ballistic reaching movements with their dominant arm toward two targets, on 2 consecutive days using a robotized exoskeleton (KINARM). They were randomly assigned to a group with (VFb) or without (NoVFb) VFb of index position during movement. On day 1, the task was performed before (baseline) and during the application of a velocity-dependent resistive force field (adaptation). To assess retention, participants repeated the task with the force field on day 2. Motor learning was characterized by: (1) the final endpoint error (movement accuracy) and (2) the initial angle (iANG) of deviation (motor planning). Even though both groups showed motor adaptation, the NoVFb-group exhibited slower learning and higher final endpoint error than the VFb-group. In some condition, subjects trained without visual feedback used more curved initial trajectories to anticipate for the perturbation. This observation suggests that learning to reach targets in a velocity-dependent resistive force field is possible even when feedback is limited. However, the absence of VFb leads to different strategies that were only apparent when reaching toward the most challenging target. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

3D visualization of movements can amplify motor cortex activation during subsequent motor imagery

PubMed Central

Sollfrank, Teresa; Hart, Daniel; Goodsell, Rachel; Foster, Jonathan; Tan, Tele

2015-01-01

A repetitive movement practice by motor imagery (MI) can influence motor cortical excitability in the electroencephalogram (EEG). This study investigated if a realistic visualization in 3D of upper and lower limb movements can amplify motor related potentials during subsequent MI. We hypothesized that a richer sensory visualization might be more effective during instrumental conditioning, resulting in a more pronounced event related desynchronization (ERD) of the upper alpha band (10–12 Hz) over the sensorimotor cortices thereby potentially improving MI based brain-computer interface (BCI) protocols for motor rehabilitation. The results show a strong increase of the characteristic patterns of ERD of the upper alpha band components for left and right limb MI present over the sensorimotor areas in both visualization conditions. Overall, significant differences were observed as a function of visualization modality (VM; 2D vs. 3D). The largest upper alpha band power decrease was obtained during MI after a 3-dimensional visualization. In total in 12 out of 20 tasks the end-user of the 3D visualization group showed an enhanced upper alpha ERD relative to 2D VM group, with statistical significance in nine tasks.With a realistic visualization of the limb movements, we tried to increase motor cortex activation during subsequent MI. The feedback and the feedback environment should be inherently motivating and relevant for the learner and should have an appeal of novelty, real-world relevance or aesthetic value (Ryan and Deci, 2000; Merrill, 2007). Realistic visual feedback, consistent with the participant’s MI, might be helpful for accomplishing successful MI and the use of such feedback may assist in making BCI a more natural interface for MI based BCI rehabilitation. PMID:26347642

3D visualization of movements can amplify motor cortex activation during subsequent motor imagery.

PubMed

Sollfrank, Teresa; Hart, Daniel; Goodsell, Rachel; Foster, Jonathan; Tan, Tele

2015-01-01

A repetitive movement practice by motor imagery (MI) can influence motor cortical excitability in the electroencephalogram (EEG). This study investigated if a realistic visualization in 3D of upper and lower limb movements can amplify motor related potentials during subsequent MI. We hypothesized that a richer sensory visualization might be more effective during instrumental conditioning, resulting in a more pronounced event related desynchronization (ERD) of the upper alpha band (10-12 Hz) over the sensorimotor cortices thereby potentially improving MI based brain-computer interface (BCI) protocols for motor rehabilitation. The results show a strong increase of the characteristic patterns of ERD of the upper alpha band components for left and right limb MI present over the sensorimotor areas in both visualization conditions. Overall, significant differences were observed as a function of visualization modality (VM; 2D vs. 3D). The largest upper alpha band power decrease was obtained during MI after a 3-dimensional visualization. In total in 12 out of 20 tasks the end-user of the 3D visualization group showed an enhanced upper alpha ERD relative to 2D VM group, with statistical significance in nine tasks.With a realistic visualization of the limb movements, we tried to increase motor cortex activation during subsequent MI. The feedback and the feedback environment should be inherently motivating and relevant for the learner and should have an appeal of novelty, real-world relevance or aesthetic value (Ryan and Deci, 2000; Merrill, 2007). Realistic visual feedback, consistent with the participant's MI, might be helpful for accomplishing successful MI and the use of such feedback may assist in making BCI a more natural interface for MI based BCI rehabilitation.

The integration of temporally shifted visual feedback in a synchronization task: The role of perceptual stability in a visuo-proprioceptive conflict situation.

PubMed

Ceux, Tanja; Montagne, Gilles; Buekers, Martinus J

2010-12-01

The present study examined whether the beneficial role of coherently grouped visual motion structures for performing complex (interlimb) coordination patterns can be generalized to synchronization behavior in a visuo-proprioceptive conflict situation. To achieve this goal, 17 participants had to synchronize a self-moved circle, representing the arm movement, with a visual target signal corresponding to five temporally shifted visual feedback conditions (0%, 25%, 50%, 75%, and 100% of the target cycle duration) in three synchronization modes (in-phase, anti-phase, and intermediate). The results showed that the perception of a newly generated perceptual Gestalt between the visual feedback of the arm and the target signal facilitated the synchronization performance in the preferred in-phase synchronization mode in contrast to the less stable anti-phase and intermediate mode. Our findings suggest that the complexity of the synchronization mode defines to what extent the visual and/or proprioceptive information source affects the synchronization performance in the present unimanual synchronization task. Copyright © 2010 Elsevier B.V. All rights reserved.

Analysis of Feedback in after Action Reviews

DTIC Science & Technology

1987-06-01

CONNTSM Page INTRODUCTIUN . . . . . . . . . . . . . . . . . . . A Perspective on Feedback. . ....... • • ..... • 1 Overviev of %,•urrent Research...part of their training program . The AAR is in marked contrast to the critique method of feedback which is often used in military training. The AAR...feedback is task-inherent feedback. Task-inherent feedback refers to human-machine interacting systems, e.g., computers , where in a visual tracking task

The interaction of respiration and visual feedback on the control of force and neural activation of the agonist muscle

PubMed Central

Baweja, Harsimran S.; Patel, Bhavini K.; Neto, Osmar P.; Christou, Evangelos A.

2011-01-01

The purpose of this study was to compare force variability and the neural activation of the agonist muscle during constant isometric contractions at different force levels when the amplitude of respiration and visual feedback were varied. Twenty young adults (20–32 years, 10 men and 10 women) were instructed to accurately match a target force at 15 and 50% of their maximal voluntary contraction (MVC) with abduction of the index finger while controlling their respiration at different amplitudes (85, 100 and 125% normal) in the presence and absence of visual feedback. Each trial lasted 22 s and visual feedback was removed from 8–12 to 16–20 s. Each subject performed 3 trials with each respiratory condition at each force level. Force variability was quantified as the standard deviation of the detrended force data. The neural activation of the first dorsal interosseus (FDI) was measured with bipolar surface electrodes placed distal to the innervation zone. Relative to normal respiration, force variability increased significantly only during high-amplitude respiration (~63%). The increase in force variability from normal- to high-amplitude respiration was strongly associated with amplified force oscillations from 0–3 Hz (R2 ranged from .68 – .84; p < .001). Furthermore, the increase in force variability was exacerbated in the presence of visual feedback at 50% MVC (vision vs. no-vision: .97 vs. .87 N) and was strongly associated with amplified force oscillations from 0–1 Hz (R2 = .82) and weakly associated with greater power from 12–30 Hz (R2 = .24) in the EMG of the agonist muscle. Our findings demonstrate that high-amplitude respiration and visual feedback of force interact and amplify force variability in young adults during moderate levels of effort. PMID:21546109

Prior history of FDI muscle contraction: different effect on MEP amplitude and muscle activity.

PubMed

Talis, V L; Kazennikov, O V; Castellote, J M; Grishin, A A; Ioffe, M E

2014-03-01

Motor evoked potentials (MEPs) in the right first dorsal interosseous (FDI) muscle elicited by transcranial magnetic stimulation of left motor cortex were assessed in ten healthy subjects during maintenance of a fixed FDI contraction level. Subjects maintained an integrated EMG (IEMG) level with visual feedback and reproduced this level by memory afterwards in the following tasks: stationary FDI muscle contraction at the level of 40 ± 5 % of its maximum voluntary contraction (MVC; 40 % task), at the level of 20 ± 5 % MVC (20 % task), and also when 20 % MVC was preceded by either no contraction (0-20 task), by stronger muscle contraction (40-20 task) or by no contraction with a previous strong contraction (40-0-20 task). The results show that the IEMG level was within the prescribed limits when 20 and 40 % stationary tasks were executed with and without visual feedback. In 0-20, 40-20, and 40-0-20 tasks, 20 % IEMG level was precisely controlled in the presence of visual feedback, but without visual feedback the IEMG and force during 20 % IEMG maintenance were significantly higher in the 40-0-20 task than those in 0-20 and 40-20 tasks. That is, without visual feedback, there were significant variations in muscle activity due to different prehistory of contraction. In stationary tasks, MEP amplitudes in 40 % task were higher than in 20 % task. MEPs did not differ significantly during maintenance of the 20 % level in tasks with different prehistory of muscle contraction with and without visual feedback. Thus, in spite of variations in muscle background activity due to different prehistory of contraction MEPs did not vary significantly. This dissociation suggests that the voluntary maintenance of IEMG level is determined not only by cortical mechanisms, as reflected by corticospinal excitability, but also by lower levels of CNS, where afferent signals and influences from other brain structures and spinal cord are convergent.

Dissociable contributions of motor-execution and action-observation to intramanual transfer.

PubMed

Hayes, Spencer J; Elliott, Digby; Andrew, Matthew; Roberts, James W; Bennett, Simon J

2012-09-01

We examined the hypothesis that different processes and representations are associated with the learning of a movement sequence through motor-execution and action-observation. Following a pre-test in which participants attempted to achieve an absolute, and relative, time goal in a sequential goal-directed aiming movement, participants received either physical or observational practice with feedback. Post-test performance indicated that motor-execution and action-observation participants learned equally well. Participants then transferred to conditions where the gain between the limb movements and their visual consequences were manipulated. Under both bigger and smaller transfer conditions, motor-execution and action-observation participants exhibited similar intramanual transfer of absolute timing. However, participants in the action-observation group exhibited superior transfer of relative timing than the motor-execution group. These findings suggest that learning via action-observation is underpinned by a visual-spatial representation, while learning via motor-execution depends more on specific force-time planning (feed forward) and afferent processing associated with sensorimotor feedback. These behavioural effects are discussed with reference to neural processes associated with striatum, cerebellum and motor cortical regions (pre-motor cortex; SMA; pre-SMA).

Augmented reality in surgical procedures

NASA Astrophysics Data System (ADS)

Samset, E.; Schmalstieg, D.; Vander Sloten, J.; Freudenthal, A.; Declerck, J.; Casciaro, S.; Rideng, Ø.; Gersak, B.

2008-02-01

Minimally invasive therapy (MIT) is one of the most important trends in modern medicine. It includes a wide range of therapies in videoscopic surgery and interventional radiology and is performed through small incisions. It reduces hospital stay-time by allowing faster recovery and offers substantially improved cost-effectiveness for the hospital and the society. However, the introduction of MIT has also led to new problems. The manipulation of structures within the body through small incisions reduces dexterity and tactile feedback. It requires a different approach than conventional surgical procedures, since eye-hand co-ordination is not based on direct vision, but more predominantly on image guidance via endoscopes or radiological imaging modalities. ARIS*ER is a multidisciplinary consortium developing a new generation of decision support tools for MIT by augmenting visual and sensorial feedback. We will present tools based on novel concepts in visualization, robotics and haptics providing tailored solutions for a range of clinical applications. Examples from radio-frequency ablation of liver-tumors, laparoscopic liver surgery and minimally invasive cardiac surgery will be presented. Demonstrators were developed with the aim to provide a seamless workflow for the clinical user conducting image-guided therapy.

Fitts’ Law in the Control of Isometric Grip Force With Naturalistic Targets

PubMed Central

Thumser, Zachary C.; Slifkin, Andrew B.; Beckler, Dylan T.; Marasco, Paul D.

2018-01-01

Fitts’ law models the relationship between amplitude, precision, and speed of rapid movements. It is widely used to quantify performance in pointing tasks, study human-computer interaction, and generally to understand perceptual-motor information processes, including research to model performance in isometric force production tasks. Applying Fitts’ law to an isometric grip force task would allow for quantifying grasp performance in rehabilitative medicine and may aid research on prosthetic control and design. We examined whether Fitts’ law would hold when participants attempted to accurately produce their intended force output while grasping a manipulandum when presented with images of various everyday objects (we termed this the implicit task). Although our main interest was the implicit task, to benchmark it and establish validity, we examined performance against a more standard visual feedback condition via a digital force-feedback meter on a video monitor (explicit task). Next, we progressed from visual force feedback with force meter targets to the same targets without visual force feedback (operating largely on feedforward control with tactile feedback). This provided an opportunity to see if Fitts’ law would hold without vision, and allowed us to progress toward the more naturalistic implicit task (which does not include visual feedback). Finally, we changed the nature of the targets from requiring explicit force values presented as arrows on a force-feedback meter (explicit targets) to the more naturalistic and intuitive target forces implied by images of objects (implicit targets). With visual force feedback the relation between task difficulty and the time to produce the target grip force was predicted by Fitts’ law (average r2 = 0.82). Without vision, average grip force scaled accurately although force variability was insensitive to the target presented. In contrast, images of everyday objects generated more reliable grip forces without the visualized force meter. In sum, population means were well-described by Fitts’ law for explicit targets with vision (r2 = 0.96) and implicit targets (r2 = 0.89), but not as well-described for explicit targets without vision (r2 = 0.54). Implicit targets should provide a realistic see-object-squeeze-object test using Fitts’ law to quantify the relative speed-accuracy relationship of any given grasper. PMID:29773999

Feedforward and feedback motor control abnormalities implicate cerebellar dysfunctions in autism spectrum disorder.

PubMed

Mosconi, Matthew W; Mohanty, Suman; Greene, Rachel K; Cook, Edwin H; Vaillancourt, David E; Sweeney, John A

2015-02-04

Sensorimotor abnormalities are common in autism spectrum disorder (ASD) and among the earliest manifestations of the disorder. They have been studied far less than the social-communication and cognitive deficits that define ASD, but a mechanistic understanding of sensorimotor abnormalities in ASD may provide key insights into the neural underpinnings of the disorder. In this human study, we examined rapid, precision grip force contractions to determine whether feedforward mechanisms supporting initial motor output before sensory feedback can be processed are disrupted in ASD. Sustained force contractions also were examined to determine whether reactive adjustments to ongoing motor behavior based on visual feedback are altered. Sustained force was studied across multiple force levels and visual gains to assess motor and visuomotor mechanisms, respectively. Primary force contractions of individuals with ASD showed greater peak rate of force increases and large transient overshoots. Individuals with ASD also showed increased sustained force variability that scaled with force level and was more severe when visual gain was highly amplified or highly degraded. When sustaining a constant force level, their reactive adjustments were more periodic than controls, and they showed increased reliance on slower feedback mechanisms. Feedforward and feedback mechanism alterations each were associated with more severe social-communication impairments in ASD. These findings implicate anterior cerebellar circuits involved in feedforward motor control and posterior cerebellar circuits involved in transforming visual feedback into precise motor adjustments in ASD. Copyright © 2015 the authors 0270-6474/15/352015-11$15.00/0.

Saccadic adaptation to a systematically varying disturbance.

PubMed

Cassanello, Carlos R; Ohl, Sven; Rolfs, Martin

2016-08-01

Saccadic adaptation maintains the correct mapping between eye movements and their targets, yet the dynamics of saccadic gain changes in the presence of systematically varying disturbances has not been extensively studied. Here we assessed changes in the gain of saccade amplitudes induced by continuous and periodic postsaccadic visual feedback. Observers made saccades following a sequence of target steps either along the horizontal meridian (Two-way adaptation) or with unconstrained saccade directions (Global adaptation). An intrasaccadic step-following a sinusoidal variation as a function of the trial number (with 3 different frequencies tested in separate blocks)-consistently displaced the target along its vector. The oculomotor system responded to the resulting feedback error by modifying saccade amplitudes in a periodic fashion with similar frequency of variation but lagging the disturbance by a few tens of trials. This periodic response was superimposed on a drift toward stronger hypometria with similar asymptotes and decay rates across stimulus conditions. The magnitude of the periodic response decreased with increasing frequency and was smaller and more delayed for Global than Two-way adaptation. These results suggest that-in addition to the well-characterized return-to-baseline response observed in protocols using constant visual feedback-the oculomotor system attempts to minimize the feedback error by integrating its variation across trials. This process resembles a convolution with an internal response function, whose structure would be determined by coefficients of the learning model. Our protocol reveals this fast learning process in single short experimental sessions, qualifying it for the study of sensorimotor learning in health and disease. Copyright © 2016 the American Physiological Society.

Flying Drosophila stabilize their vision-based velocity controller by sensing wind with their antennae

PubMed Central

Fuller, Sawyer Buckminster; Straw, Andrew D.; Peek, Martin Y.; Murray, Richard M.; Dickinson, Michael H.

2014-01-01

Flies and other insects use vision to regulate their groundspeed in flight, enabling them to fly in varying wind conditions. Compared with mechanosensory modalities, however, vision requires a long processing delay (~100 ms) that might introduce instability if operated at high gain. Flies also sense air motion with their antennae, but how this is used in flight control is unknown. We manipulated the antennal function of fruit flies by ablating their aristae, forcing them to rely on vision alone to regulate groundspeed. Arista-ablated flies in flight exhibited significantly greater groundspeed variability than intact flies. We then subjected them to a series of controlled impulsive wind gusts delivered by an air piston and experimentally manipulated antennae and visual feedback. The results show that an antenna-mediated response alters wing motion to cause flies to accelerate in the same direction as the gust. This response opposes flying into a headwind, but flies regularly fly upwind. To resolve this discrepancy, we obtained a dynamic model of the fly’s velocity regulator by fitting parameters of candidate models to our experimental data. The model suggests that the groundspeed variability of arista-ablated flies is the result of unstable feedback oscillations caused by the delay and high gain of visual feedback. The antenna response drives active damping with a shorter delay (~20 ms) to stabilize this regulator, in exchange for increasing the effect of rapid wind disturbances. This provides insight into flies’ multimodal sensory feedback architecture and constitutes a previously unknown role for the antennae. PMID:24639532

Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision.

PubMed

Wen, Haiguang; Shi, Junxing; Zhang, Yizhen; Lu, Kun-Han; Cao, Jiayue; Liu, Zhongming

2017-10-20

Convolutional neural network (CNN) driven by image recognition has been shown to be able to explain cortical responses to static pictures at ventral-stream areas. Here, we further showed that such CNN could reliably predict and decode functional magnetic resonance imaging data from humans watching natural movies, despite its lack of any mechanism to account for temporal dynamics or feedback processing. Using separate data, encoding and decoding models were developed and evaluated for describing the bi-directional relationships between the CNN and the brain. Through the encoding models, the CNN-predicted areas covered not only the ventral stream, but also the dorsal stream, albeit to a lesser degree; single-voxel response was visualized as the specific pixel pattern that drove the response, revealing the distinct representation of individual cortical location; cortical activation was synthesized from natural images with high-throughput to map category representation, contrast, and selectivity. Through the decoding models, fMRI signals were directly decoded to estimate the feature representations in both visual and semantic spaces, for direct visual reconstruction and semantic categorization, respectively. These results corroborate, generalize, and extend previous findings, and highlight the value of using deep learning, as an all-in-one model of the visual cortex, to understand and decode natural vision. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

A mobile phone system to find crosswalks for visually impaired pedestrians

PubMed Central

Shen, Huiying; Chan, Kee-Yip; Coughlan, James; Brabyn, John

2010-01-01

Urban intersections are the most dangerous parts of a blind or visually impaired pedestrian’s travel. A prerequisite for safely crossing an intersection is entering the crosswalk in the right direction and avoiding the danger of straying outside the crosswalk. This paper presents a proof of concept system that seeks to provide such alignment information. The system consists of a standard mobile phone with built-in camera that uses computer vision algorithms to detect any crosswalk visible in the camera’s field of view; audio feedback from the phone then helps the user align him/herself to it. Our prototype implementation on a Nokia mobile phone runs in about one second per image, and is intended for eventual use in a mobile phone system that will aid blind and visually impaired pedestrians in navigating traffic intersections. PMID:20411035

The efficacy of VIPP-V parenting training for parents of young children with a visual or visual-and-intellectual disability: a randomized controlled trial.

PubMed

Platje, Evelien; Sterkenburg, Paula; Overbeek, Mathile; Kef, Sabina; Schuengel, Carlo

2018-01-23

Video-feedback Intervention to promote positive parenting-visual (VIPP-V) or visual-and-intellectual disability is an attachment-based intervention aimed at enhancing sensitive parenting and promoting positive parent-child relationships. A randomized controlled trial was conducted to assess the efficacy of VIPP-V for parents of children aged 1-5 with visual or visual-and-intellectual disabilities. A total of 37 dyads received only care-as-usual (CAU) and 40 received VIPP-V besides CAU. The parents receiving VIPP-V did not show increased parental sensitivity or parent-child interaction quality, however, their parenting self-efficacy increased. Moreover, the increase in parental self-efficacy predicted the increase in parent-child interaction. In conclusion, VIPP-V does not appear to directly improve the quality of contact between parent and child, but does contribute to the self-efficacy of parents to support and to comfort their child. Moreover, as parents experience their parenting as more positive, this may eventually lead to higher sensitive responsiveness and more positive parent-child interactions.

Selective and divided attention modulates auditory-vocal integration in the processing of pitch feedback errors.

PubMed

Liu, Ying; Hu, Huijing; Jones, Jeffery A; Guo, Zhiqiang; Li, Weifeng; Chen, Xi; Liu, Peng; Liu, Hanjun

2015-08-01

Speakers rapidly adjust their ongoing vocal productions to compensate for errors they hear in their auditory feedback. It is currently unclear what role attention plays in these vocal compensations. This event-related potential (ERP) study examined the influence of selective and divided attention on the vocal and cortical responses to pitch errors heard in auditory feedback regarding ongoing vocalisations. During the production of a sustained vowel, participants briefly heard their vocal pitch shifted up two semitones while they actively attended to auditory or visual events (selective attention), or both auditory and visual events (divided attention), or were not told to attend to either modality (control condition). The behavioral results showed that attending to the pitch perturbations elicited larger vocal compensations than attending to the visual stimuli. Moreover, ERPs were likewise sensitive to the attentional manipulations: P2 responses to pitch perturbations were larger when participants attended to the auditory stimuli compared to when they attended to the visual stimuli, and compared to when they were not explicitly told to attend to either the visual or auditory stimuli. By contrast, dividing attention between the auditory and visual modalities caused suppressed P2 responses relative to all the other conditions and caused enhanced N1 responses relative to the control condition. These findings provide strong evidence for the influence of attention on the mechanisms underlying the auditory-vocal integration in the processing of pitch feedback errors. In addition, selective attention and divided attention appear to modulate the neurobehavioral processing of pitch feedback errors in different ways. © 2015 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Coherence of structural visual cues and pictorial gravity paves the way for interceptive actions.

PubMed

Zago, Myrka; La Scaleia, Barbara; Miller, William L; Lacquaniti, Francesco

2011-09-20

Dealing with upside-down objects is difficult and takes time. Among the cues that are critical for defining object orientation, the visible influence of gravity on the object's motion has received limited attention. Here, we manipulated the alignment of visible gravity and structural visual cues between each other and relative to the orientation of the observer and physical gravity. Participants pressed a button triggering a hitter to intercept a target accelerated by a virtual gravity. A factorial design assessed the effects of scene orientation (normal or inverted) and target gravity (normal or inverted). We found that interception was significantly more successful when scene direction was concordant with target gravity direction, irrespective of whether both were upright or inverted. This was so independent of the hitter type and when performance feedback to the participants was either available (Experiment 1) or unavailable (Experiment 2). These results show that the combined influence of visible gravity and structural visual cues can outweigh both physical gravity and viewer-centered cues, leading to rely instead on the congruence of the apparent physical forces acting on people and objects in the scene.

Visual information transfer. 1: Assessment of specific information needs. 2: The effects of degraded motion feedback. 3: Parameters of appropriate instrument scanning behavior

NASA Technical Reports Server (NTRS)

Comstock, J. R., Jr.; Kirby, R. H.; Coates, G. D.

1984-01-01

Pilot and flight crew assessment of visually displayed information is examined as well as the effects of degraded and uncorrected motion feedback, and instrument scanning efficiency by the pilot. Computerized flight simulation and appropriate physiological measurements are used to collect data for standardization.

The Use of Visual Feedback during Signing: Evidence from Signers with Impaired Vision

ERIC Educational Resources Information Center

Emmorey, Karen; Korpics, Franco; Petronio, Karen

2009-01-01

The role of visual feedback during the production of American Sign Language was investigated by comparing the size of signing space during conversations and narrative monologues for normally sighted signers, signers with tunnel vision due to Usher syndrome, and functionally blind signers. The interlocutor for all groups was a normally sighted deaf…

The Effects of Task Clarification, Visual Prompts, and Graphic Feedback on Customer Greeting and Up-Selling in a Restaurant

ERIC Educational Resources Information Center

Squires, James; Wilder, David A.; Fixsen, Amanda; Hess, Erica; Rost, Kristen; Curran, Ryan; Zonneveld, Kimberly

2007-01-01

An intervention consisting of task clarification, visual prompts, and graphic feedback was evaluated to increase customer greeting and up-selling in a restaurant. A combination multiple baseline and reversal design was used to evaluate intervention effects. Although all interventions improved performance over baseline, the delivery of graphic…

Ultrasound as Visual Feedback in Speech Habilitation: Exploring Consultative Use in Rural British Columbia, Canada

ERIC Educational Resources Information Center

Bernhardt, B. May; Bacsfalvi, Penelope; Adler-Bock, Marcy; Shimizu, Reiko; Cheney, Audrey; Giesbrecht, Nathan; O'Connell, Maureen; Sirianni, Jason; Radanov, Bosko

2008-01-01

Ultrasound has shown promise as a visual feedback tool in speech therapy. Rural clients, however, often have minimal access to new technologies. The purpose of the current study was to evaluate consultative treatment using ultrasound in rural communities. Two speech-language pathologists (SLPs) trained in ultrasound use provided consultation with…

Examining the effect of state anxiety on compensatory and strategic adjustments in the planning of goal-directed aiming.

PubMed

Roberts, James W; Wilson, Mark R; Skultety, Jessica K; Lyons, James L

2018-04-01

The anxiety-perceptual-motor performance relationship may be enriched by investigations involving discrete manual responses due to the definitive demarcation of planning and control processes, which comprise the early and late portions of movement, respectively. To further examine the explanatory power of self-focus and distraction theories, we explored the potential of anxiety causing changes to movement planning that accommodate for anticipated negative effects in online control. As a result, we posed two hypotheses where anxiety causes performers to initially undershoot the target and enable more time to use visual feedback ("play-it-safe"), or fire a ballistic reach to cover a greater distance without later undertaking online control ("go-for-it"). Participants were tasked with an upper-limb movement to a single target under counter-balanced instructions to execute fast and accurate responses (low/normal anxiety) with non-contingent negative performance feedback (high anxiety). The results indicated that the previously identified negative impact of anxiety in online control was replicated. While anxiety caused a longer displacement to reach peak velocity and greater tendency to overshoot the target, there appeared to be no shift in the attempts to utilise online visual feedback. Thus, the tendency to initially overshoot may manifest from an inefficient auxiliary procedure that manages to uphold overall movement time and response accuracy. Copyright © 2018 Elsevier B.V. All rights reserved.

Error correcting mechanisms during antisaccades: contribution of online control during primary saccades and offline control via secondary saccades.

PubMed

Bedi, Harleen; Goltz, Herbert C; Wong, Agnes M F; Chandrakumar, Manokaraananthan; Niechwiej-Szwedo, Ewa

2013-01-01

Errors in eye movements can be corrected during the ongoing saccade through in-flight modifications (i.e., online control), or by programming a secondary eye movement (i.e., offline control). In a reflexive saccade task, the oculomotor system can use extraretinal information (i.e., efference copy) online to correct errors in the primary saccade, and offline retinal information to generate a secondary corrective saccade. The purpose of this study was to examine the error correction mechanisms in the antisaccade task. The roles of extraretinal and retinal feedback in maintaining eye movement accuracy were investigated by presenting visual feedback at the spatial goal of the antisaccade. We found that online control for antisaccade is not affected by the presence of visual feedback; that is whether visual feedback is present or not, the duration of the deceleration interval was extended and significantly correlated with reduced antisaccade endpoint error. We postulate that the extended duration of deceleration is a feature of online control during volitional saccades to improve their endpoint accuracy. We found that secondary saccades were generated more frequently in the antisaccade task compared to the reflexive saccade task. Furthermore, we found evidence for a greater contribution from extraretinal sources of feedback in programming the secondary "corrective" saccades in the antisaccade task. Nonetheless, secondary saccades were more corrective for the remaining antisaccade amplitude error in the presence of visual feedback of the target. Taken together, our results reveal a distinctive online error control strategy through an extension of the deceleration interval in the antisaccade task. Target feedback does not improve online control, rather it improves the accuracy of secondary saccades in the antisaccade task.

Error Correcting Mechanisms during Antisaccades: Contribution of Online Control during Primary Saccades and Offline Control via Secondary Saccades

PubMed Central

Bedi, Harleen; Goltz, Herbert C.; Wong, Agnes M. F.; Chandrakumar, Manokaraananthan; Niechwiej-Szwedo, Ewa

2013-01-01

Errors in eye movements can be corrected during the ongoing saccade through in-flight modifications (i.e., online control), or by programming a secondary eye movement (i.e., offline control). In a reflexive saccade task, the oculomotor system can use extraretinal information (i.e., efference copy) online to correct errors in the primary saccade, and offline retinal information to generate a secondary corrective saccade. The purpose of this study was to examine the error correction mechanisms in the antisaccade task. The roles of extraretinal and retinal feedback in maintaining eye movement accuracy were investigated by presenting visual feedback at the spatial goal of the antisaccade. We found that online control for antisaccade is not affected by the presence of visual feedback; that is whether visual feedback is present or not, the duration of the deceleration interval was extended and significantly correlated with reduced antisaccade endpoint error. We postulate that the extended duration of deceleration is a feature of online control during volitional saccades to improve their endpoint accuracy. We found that secondary saccades were generated more frequently in the antisaccade task compared to the reflexive saccade task. Furthermore, we found evidence for a greater contribution from extraretinal sources of feedback in programming the secondary “corrective” saccades in the antisaccade task. Nonetheless, secondary saccades were more corrective for the remaining antisaccade amplitude error in the presence of visual feedback of the target. Taken together, our results reveal a distinctive online error control strategy through an extension of the deceleration interval in the antisaccade task. Target feedback does not improve online control, rather it improves the accuracy of secondary saccades in the antisaccade task. PMID:23936308

Visual feedback attenuates mean concentric barbell velocity loss, and improves motivation, competitiveness, and perceived workload in male adolescent athletes.

PubMed

Weakley, Jonathon Js; Wilson, Kyle M; Till, Kevin; Read, Dale B; Darrall-Jones, Joshua; Roe, Gregory; Phibbs, Padraic J; Jones, Ben

2017-07-12

It is unknown whether instantaneous visual feedback of resistance training outcomes can enhance barbell velocity in younger athletes. Therefore, the purpose of this study was to quantify the effects of visual feedback on mean concentric barbell velocity in the back squat, and to identify changes in motivation, competitiveness, and perceived workload. In a randomised-crossover design (Feedback vs. Control) feedback of mean concentric barbell velocity was or was not provided throughout a set of 10 repetitions in the barbell back squat. Magnitude-based inferences were used to assess changes between conditions, with almost certainly greater differences in mean concentric velocity between the Feedback (0.70 ±0.04 m·s) and Control (0.65 ±0.05 m·s) observed. Additionally, individual repetition mean concentric velocity ranged from possibly (repetition number two: 0.79 ±0.04 vs. 0.78 ±0.04 m·s) to almost certainly (repetition number 10: 0.58 ±0.05 vs. 0.49 ±0.05 m·s) greater when provided feedback, while almost certain differences were observed in motivation, competitiveness, and perceived workload, respectively. Providing adolescent male athletes with visual kinematic information while completing resistance training is beneficial for the maintenance of barbell velocity during a training set, potentially enhancing physical performance. Moreover, these improvements were observed alongside increases in motivation, competitiveness and perceived workload providing insight into the underlying mechanisms responsible for the performance gains observed. Given the observed maintenance of barbell velocity during a training set, practitioners can use this technique to manipulate training outcomes during resistance training.

A survey of telerobotic surface finishing

NASA Astrophysics Data System (ADS)

Höglund, Thomas; Alander, Jarmo; Mantere, Timo

2018-05-01

This is a survey of research published on the subjects of telerobotics, haptic feedback, and mixed reality applied to surface finishing. The survey especially focuses on how visuo-haptic feedback can be used to improve a grinding process using a remote manipulator or robot. The benefits of teleoperation and reasons for using haptic feedback are presented. The use of genetic algorithms for optimizing haptic sensing is briefly discussed. Ways of augmenting the operator's vision are described. Visual feedback can be used to find defects and analyze the quality of the surface resulting from the surface finishing process. Visual cues can also be used to aid a human operator in manipulating a robot precisely and avoiding collisions.

Real-Time Performance Feedback for the Manual Control of Spacecraft

NASA Astrophysics Data System (ADS)

Karasinski, John Austin

Real-time performance metrics were developed to quantify workload, situational awareness, and manual task performance for use as visual feedback to pilots of aerospace vehicles. Results from prior lunar lander experiments with variable levels of automation were replicated and extended to provide insights for the development of real-time metrics. Increased levels of automation resulted in increased flight performance, lower workload, and increased situational awareness. Automated Speech Recognition (ASR) was employed to detect verbal callouts as a limited measure of subjects' situational awareness. A one-dimensional manual tracking task and simple instructor-model visual feedback scheme was developed. This feedback was indicated to the operator by changing the color of a guidance element on the primary flight display, similar to how a flight instructor points out elements of a display to a student pilot. Experiments showed that for this low-complexity task, visual feedback did not change subject performance, but did increase the subjects' measured workload. Insights gained from these experiments were applied to a Simplified Aid for EVA Rescue (SAFER) inspection task. The effects of variations of an instructor-model performance-feedback strategy on human performance in a novel SAFER inspection task were investigated. Real-time feedback was found to have a statistically significant effect of improving subject performance and decreasing workload in this complicated four degree of freedom manual control task with two secondary tasks.

The Understanding and Interpretation of Innovative Technology-Enabled Multidimensional Physical Activity Feedback in Patients at Risk of Future Chronic Disease

PubMed Central

Western, Max J.; Peacock, Oliver J.; Stathi, Afroditi; Thompson, Dylan

2015-01-01

Background Innovative physical activity monitoring technology can be used to depict rich visual feedback that encompasses the various aspects of physical activity known to be important for health. However, it is unknown whether patients who are at risk of chronic disease would understand such sophisticated personalised feedback or whether they would find it useful and motivating. The purpose of the present study was to determine whether technology-enabled multidimensional physical activity graphics and visualisations are comprehensible and usable for patients at risk of chronic disease. Method We developed several iterations of graphics depicting minute-by-minute activity patterns and integrated physical activity health targets. Subsequently, patients at moderate/high risk of chronic disease (n=29) and healthcare practitioners (n=15) from South West England underwent full 7-days activity monitoring followed by individual semi-structured interviews in which they were asked to comment on their own personalised visual feedback Framework analysis was used to gauge their interpretation and of personalised feedback, graphics and visualisations. Results We identified two main components focussing on (a) the interpretation of feedback designs and data and (b) the impact of personalised visual physical activity feedback on facilitation of health behaviour change. Participants demonstrated a clear ability to understand the sophisticated personal information plus an enhanced physical activity knowledge. They reported that receiving multidimensional feedback was motivating and could be usefully applied to facilitate their efforts in becoming more physically active. Conclusion Multidimensional physical activity feedback can be made comprehensible, informative and motivational by using appropriate graphics and visualisations. There is an opportunity to exploit the full potential created by technological innovation and provide sophisticated personalised physical activity feedback as an adjunct to support behaviour change. PMID:25938455

Simultaneous tDCS-fMRI Identifies Resting State Networks Correlated with Visual Search Enhancement.

PubMed

Callan, Daniel E; Falcone, Brian; Wada, Atsushi; Parasuraman, Raja

2016-01-01

This study uses simultaneous transcranial direct current stimulation (tDCS) and functional MRI (fMRI) to investigate tDCS modulation of resting state activity and connectivity that underlies enhancement in behavioral performance. The experiment consisted of three sessions within the fMRI scanner in which participants conducted a visual search task: Session 1: Pre-training (no performance feedback), Session 2: Training (performance feedback given), Session 3: Post-training (no performance feedback). Resting state activity was recorded during the last 5 min of each session. During the 2nd session one group of participants underwent 1 mA tDCS stimulation and another underwent sham stimulation over the right posterior parietal cortex. Resting state spontaneous activity, as measured by fractional amplitude of low frequency fluctuations (fALFF), for session 2 showed significant differences between the tDCS stim and sham groups in the precuneus. Resting state functional connectivity from the precuneus to the substantia nigra, a subcortical dopaminergic region, was found to correlate with future improvement in visual search task performance for the stim over the sham group during active stimulation in session 2. The after-effect of stimulation on resting state functional connectivity was measured following a post-training experimental session (session 3). The left cerebellum Lobule VIIa Crus I showed performance related enhancement in resting state functional connectivity for the tDCS stim over the sham group. The ability to determine the relationship that the relative strength of resting state functional connectivity for an individual undergoing tDCS has on future enhancement in behavioral performance has wide ranging implications for neuroergonomic as well as therapeutic, and rehabilitative applications.

Integrative Advances for OCT-Guided Ophthalmic Surgery and Intraoperative OCT: Microscope Integration, Surgical Instrumentation, and Heads-Up Display Surgeon Feedback

PubMed Central

Ehlers, Justis P.; Srivastava, Sunil K.; Feiler, Daniel; Noonan, Amanda I.; Rollins, Andrew M.; Tao, Yuankai K.

2014-01-01

Purpose To demonstrate key integrative advances in microscope-integrated intraoperative optical coherence tomography (iOCT) technology that will facilitate adoption and utilization during ophthalmic surgery. Methods We developed a second-generation prototype microscope-integrated iOCT system that interfaces directly with a standard ophthalmic surgical microscope. Novel features for improved design and functionality included improved profile and ergonomics, as well as a tunable lens system for optimized image quality and heads-up display (HUD) system for surgeon feedback. Novel material testing was performed for potential suitability for OCT-compatible instrumentation based on light scattering and transmission characteristics. Prototype surgical instruments were developed based on material testing and tested using the microscope-integrated iOCT system. Several surgical maneuvers were performed and imaged, and surgical motion visualization was evaluated with a unique scanning and image processing protocol. Results High-resolution images were successfully obtained with the microscope-integrated iOCT system with HUD feedback. Six semi-transparent materials were characterized to determine their attenuation coefficients and scatter density with an 830 nm OCT light source. Based on these optical properties, polycarbonate was selected as a material substrate for prototype instrument construction. A surgical pick, retinal forceps, and corneal needle were constructed with semi-transparent materials. Excellent visualization of both the underlying tissues and surgical instrument were achieved on OCT cross-section. Using model eyes, various surgical maneuvers were visualized, including membrane peeling, vessel manipulation, cannulation of the subretinal space, subretinal intraocular foreign body removal, and corneal penetration. Conclusions Significant iterative improvements in integrative technology related to iOCT and ophthalmic surgery are demonstrated. PMID:25141340

The role of early stages of cortical visual processing in size and distance judgment: a transcranial direct current stimulation study.

PubMed

Costa, Thiago L; Costa, Marcelo F; Magalhães, Adsson; Rêgo, Gabriel G; Nagy, Balázs V; Boggio, Paulo S; Ventura, Dora F

2015-02-19

Recent research suggests that V1 plays an active role in the judgment of size and distance. Nevertheless, no research has been performed using direct brain stimulation to address this issue. We used transcranial direct-current stimulation (tDCS) to directly modulate the early stages of cortical visual processing while measuring size and distance perception with a psychophysical scaling method of magnitude estimation in a repeated-measures design. The subjects randomly received anodal, cathodal, and sham tDCS in separate sessions starting with size or distance judgment tasks. Power functions were fit to the size judgment data, whereas logarithmic functions were fit to distance judgment data. Slopes and R(2) were compared with separate repeated-measures analyses of variance with two factors: task (size vs. distance) and tDCS (anodal vs. cathodal vs. sham). Anodal tDCS significantly decreased slopes, apparently interfering with size perception. No effects were found for distance perception. Consistent with previous studies, the results of the size task appeared to reflect a prothetic continuum, whereas the results of the distance task seemed to reflect a metathetic continuum. The differential effects of tDCS on these tasks may support the hypothesis that different physiological mechanisms underlie judgments on these two continua. The results further suggest the complex involvement of the early visual cortex in size judgment tasks that go beyond the simple representation of low-level stimulus properties. This supports predictive coding models and experimental findings that suggest that higher-order visual areas may inhibit incoming information from the early visual cortex through feedback connections when complex tasks are performed. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The effects of augmented visual feedback during balance training in Parkinson's disease: study design of a randomized clinical trial.

PubMed

van den Heuvel, Maarten R C; van Wegen, Erwin E H; de Goede, Cees J T; Burgers-Bots, Ingrid A L; Beek, Peter J; Daffertshofer, Andreas; Kwakkel, Gert

2013-10-04

Patients with Parkinson's disease often suffer from reduced mobility due to impaired postural control. Balance exercises form an integral part of rehabilitative therapy but the effectiveness of existing interventions is limited. Recent technological advances allow for providing enhanced visual feedback in the context of computer games, which provide an attractive alternative to conventional therapy. The objective of this randomized clinical trial is to investigate whether a training program capitalizing on virtual-reality-based visual feedback is more effective than an equally-dosed conventional training in improving standing balance performance in patients with Parkinson's disease. Patients with idiopathic Parkinson's disease will participate in a five-week balance training program comprising ten treatment sessions of 60 minutes each. Participants will be randomly allocated to (1) an experimental group that will receive balance training using augmented visual feedback, or (2) a control group that will receive balance training in accordance with current physical therapy guidelines for Parkinson's disease patients. Training sessions consist of task-specific exercises that are organized as a series of workstations. Assessments will take place before training, at six weeks, and at twelve weeks follow-up. The functional reach test will serve as the primary outcome measure supplemented by comprehensive assessments of functional balance, posturography, and electroencephalography. We hypothesize that balance training based on visual feedback will show greater improvements on standing balance performance than conventional balance training. In addition, we expect that learning new control strategies will be visible in the co-registered posturographic recordings but also through changes in functional connectivity.

Problem solving in great apes (Pan paniscus, Pan troglodytes, Gorilla gorilla, and Pongo abelii): the effect of visual feedback.

PubMed

Völter, Christoph J; Call, Josep

2012-09-01

What kind of information animals use when solving problems is a controversial topic. Previous research suggests that, in some situations, great apes prefer to use causally relevant cues over arbitrary ones. To further examine to what extent great apes are able to use information about causal relations, we presented three different puzzle box problems to the four nonhuman great ape species. Of primary interest here was a comparison between one group of apes that received visual access to the functional mechanisms of the puzzle boxes and one group that did not. Apes' performance in the first two, less complex puzzle boxes revealed that they are able to solve such problems by means of trial-and-error learning, requiring no information about the causal structure of the problem. However, visual inspection of the functional mechanisms of the puzzle boxes reduced the amount of time needed to solve the problems. In the case of the most complex problem, which required the use of a crank, visual feedback about what happened when the handle of the crank was turned was necessary for the apes to solve the task. Once the solution was acquired, however, visual feedback was no longer required. We conclude that visual feedback about the consequences of their actions helps great apes to solve complex problems. As the crank task matches the basic requirements of vertical string pulling in birds, the present results are discussed in light of recent findings with corvids.

Updating Target Location at the End of an Orienting Saccade Affects the Characteristics of Simple Point-to-Point Movements

ERIC Educational Resources Information Center

Desmurget, Michel; Turner, Robert S.; Prablanc, Claude; Russo, Gary S.; Alexander, Garret E.; Grafton, Scott T.

2005-01-01

Six results are reported. (a) Reaching accuracy increases when visual capture of the target is allowed (e.g., target on vs. target off at saccade onset). (b) Whatever the visual condition, trajectories diverge only after peak acceleration, suggesting that accuracy is improved through feedback mechanisms. (c) Feedback corrections are smoothly…

Encouraging Electricity Savings in a University Residential Hall through a Combination of Feedback, Visual Prompts, and Incentives

ERIC Educational Resources Information Center

Bekker, Marthinus J.; Cumming, Tania D.; Osborne, Nikola K. P.; Bruining, Angela M.; McClean, Julia I.; Leland, Louis S., Jr.

2010-01-01

This experiment investigated the combined use of visual prompts, daily feedback, and rewards to reduce electricity consumption in a university residential hall. After a 17-day baseline period, the experimental intervention was introduced in the intervention hall, and no change was made in the control hall. Energy usage decreased in the…

THE EFFECT OF VISUAL FEEDBACK ON PRONUNCIATION IN FOREIGN LANGUAGE LEARNING. TERMINATION OF RESEARCH REPORT.

ERIC Educational Resources Information Center

JENSON, PAUL G.; WESTERMEIER, FRANZ X.

A RESEARCH PROJECT USING THE OSCILLOSCOPE TO DETERMINE VISUAL FEEDBACK IN THE TEACHING OF FOREIGN LANGUAGE PRONUNCIATION WAS TERMINATED BECAUSE OF TECHNICAL DIFFICULTIES THAT COULD NOT BE RESOLVED WITH THE EQUIPMENT AVAILABLE. FAILURE IS ATTRIBUTED TO SUCH FACTORS AS (1) THE SPEECH SOUND WAVES SOUND THE SAME THOUGH THEIR WAVE SHAPES DIFFER, (2)…

The Impact of Feedback on Self-Rated Driving Ability and Driving Self-Regulation among Older Adults

ERIC Educational Resources Information Center

Ackerman, Michelle L.; Crowe, Michael; Vance, David E.; Wadley, Virginia G.; Owsley, Cynthia; Ball, Karlene K.

2011-01-01

In 129 community-dwelling older adults, feedback regarding qualification for an insurance discount (based on a visual speed of processing test; Useful Field of View) was examined as a prospective predictor of change in self-reported driving ability, driving avoidance, and driving exposure over 3 months, along with physical, visual, health, and…

Ultrasound visual feedback treatment and practice variability for residual speech sound errors

PubMed Central

Preston, Jonathan L.; McCabe, Patricia; Rivera-Campos, Ahmed; Whittle, Jessica L.; Landry, Erik; Maas, Edwin

2014-01-01

Purpose The goals were to (1) test the efficacy of a motor-learning based treatment that includes ultrasound visual feedback for individuals with residual speech sound errors, and (2) explore whether the addition of prosodic cueing facilitates speech sound learning. Method A multiple baseline single subject design was used, replicated across 8 participants. For each participant, one sound context was treated with ultrasound plus prosodic cueing for 7 sessions, and another sound context was treated with ultrasound but without prosodic cueing for 7 sessions. Sessions included ultrasound visual feedback as well as non-ultrasound treatment. Word-level probes assessing untreated words were used to evaluate retention and generalization. Results For most participants, increases in accuracy of target sound contexts at the word level were observed with the treatment program regardless of whether prosodic cueing was included. Generalization between onset singletons and clusters was observed, as well as generalization to sentence-level accuracy. There was evidence of retention during post-treatment probes, including at a two-month follow-up. Conclusions A motor-based treatment program that includes ultrasound visual feedback can facilitate learning of speech sounds in individuals with residual speech sound errors. PMID:25087938

Prism adaptation in virtual and natural contexts: Evidence for a flexible adaptive process.

PubMed

Veilleux, Louis-Nicolas; Proteau, Luc

2015-01-01

Prism exposure when aiming at a visual target in a virtual condition (e.g., when the hand is represented by a video representation) produces no or only small adaptations (after-effects), whereas prism exposure in a natural condition produces large after-effects. Some researchers suggested that this difference may arise from distinct adaptive processes, but other studies suggested a unique process. The present study reconciled these conflicting interpretations. Forty participants were divided into two groups: One group used visual feedback of their hand (natural context), and the other group used computer-generated representational feedback (virtual context). Visual feedback during adaptation was concurrent or terminal. All participants underwent laterally displacing prism perturbation. The results showed that the after-effects were twice as large in the "natural context" than in the "virtual context". No significant differences were observed between the concurrent and terminal feedback conditions. The after-effects generalized to untested targets and workspace. These results suggest that prism adaptation in virtual and natural contexts involves the same process. The smaller after-effects in the virtual context suggest that the depth of adaptation is a function of the degree of convergence between the proprioceptive and visual information that arises from the hand.

Semi-Immersive Virtual Turbine Engine Simulation System

NASA Astrophysics Data System (ADS)

Abidi, Mustufa H.; Al-Ahmari, Abdulrahman M.; Ahmad, Ali; Darmoul, Saber; Ameen, Wadea

2018-05-01

The design and verification of assembly operations is essential for planning product production operations. Recently, virtual prototyping has witnessed tremendous progress, and has reached a stage where current environments enable rich and multi-modal interaction between designers and models through stereoscopic visuals, surround sound, and haptic feedback. The benefits of building and using Virtual Reality (VR) models in assembly process verification are discussed in this paper. In this paper, we present the virtual assembly (VA) of an aircraft turbine engine. The assembly parts and sequences are explained using a virtual reality design system. The system enables stereoscopic visuals, surround sounds, and ample and intuitive interaction with developed models. A special software architecture is suggested to describe the assembly parts and assembly sequence in VR. A collision detection mechanism is employed that provides visual feedback to check the interference between components. The system is tested for virtual prototype and assembly sequencing of a turbine engine. We show that the developed system is comprehensive in terms of VR feedback mechanisms, which include visual, auditory, tactile, as well as force feedback. The system is shown to be effective and efficient for validating the design of assembly, part design, and operations planning.

Cortical excitability correlates with the event-related desynchronization during brain-computer interface control

NASA Astrophysics Data System (ADS)

Daly, Ian; Blanchard, Caroline; Holmes, Nicholas P.

2018-04-01

Objective. Brain-computer interfaces (BCIs) based on motor control have been suggested as tools for stroke rehabilitation. Some initial successes have been achieved with this approach, however the mechanism by which they work is not yet fully understood. One possible part of this mechanism is a, previously suggested, relationship between the strength of the event-related desynchronization (ERD), a neural correlate of motor imagination and execution, and corticospinal excitability. Additionally, a key component of BCIs used in neurorehabilitation is the provision of visual feedback to positively reinforce attempts at motor control. However, the ability of visual feedback of the ERD to modulate the activity in the motor system has not been fully explored. Approach. We investigate these relationships via transcranial magnetic stimulation delivered at different moments in the ongoing ERD related to hand contraction and relaxation during BCI control of a visual feedback bar. Main results. We identify a significant relationship between ERD strength and corticospinal excitability, and find that our visual feedback does not affect corticospinal excitability. Significance. Our results imply that efforts to promote functional recovery in stroke by targeting increases in corticospinal excitability may be aided by accounting for the time course of the ERD.

Use of Visual and Proprioceptive Feedback to Improve Gait Speed and Spatiotemporal Symmetry Following Chronic Stroke: A Case Series

PubMed Central

Feasel, Jeff; Wentz, Erin; Brooks, Frederick P.; Whitton, Mary C.

2012-01-01

Background and Purpose Persistent deficits in gait speed and spatiotemporal symmetry are prevalent following stroke and can limit the achievement of community mobility goals. Rehabilitation can improve gait speed, but has shown limited ability to improve spatiotemporal symmetry. The incorporation of combined visual and proprioceptive feedback regarding spatiotemporal symmetry has the potential to be effective at improving gait. Case Description A 60-year-old man (18 months poststroke) and a 53-year-old woman (21 months poststroke) each participated in gait training to improve gait speed and spatiotemporal symmetry. Each patient performed 18 sessions (6 weeks) of combined treadmill-based gait training followed by overground practice. To assist with relearning spatiotemporal symmetry, treadmill-based training for both patients was augmented with continuous, real-time visual and proprioceptive feedback from an immersive virtual environment and a dual belt treadmill, respectively. Outcomes Both patients improved gait speed (patient 1: 0.35 m/s improvement; patient 2: 0.26 m/s improvement) and spatiotemporal symmetry. Patient 1, who trained with step-length symmetry feedback, improved his step-length symmetry ratio, but not his stance-time symmetry ratio. Patient 2, who trained with stance-time symmetry feedback, improved her stance-time symmetry ratio. She had no step-length asymmetry before training. Discussion Both patients made improvements in gait speed and spatiotemporal symmetry that exceeded those reported in the literature. Further work is needed to ascertain the role of combined visual and proprioceptive feedback for improving gait speed and spatiotemporal symmetry after chronic stroke. PMID:22228605

Independent voluntary correction and savings in locomotor learning.

PubMed

Leech, Kristan A; Roemmich, Ryan T

2018-06-14

People can acquire new walking patterns in many different ways. For example, we can change our gait voluntarily in response to instruction or adapt by sensing our movement errors. Here we investigated how acquisition of a new walking pattern through simultaneous voluntary correction and adaptive learning affected the resulting motor memory of the learned pattern. We studied adaptation to split-belt treadmill walking with and without visual feedback of stepping patterns. As expected, visual feedback enabled faster acquisition of the new walking pattern. However, upon later re-exposure to the same split-belt perturbation, participants exhibited similar motor memories whether they had learned with or without visual feedback. Participants who received feedback did not re-engage the mechanism used to accelerate initial acquisition of the new walking pattern to similarly accelerate subsequent relearning. These findings reveal that voluntary correction neither benefits nor interferes with the ability to save a new walking pattern over time. © 2018. Published by The Company of Biologists Ltd.

Learning receptive fields using predictive feedback.

PubMed

Jehee, Janneke F M; Rothkopf, Constantin; Beck, Jeffrey M; Ballard, Dana H

2006-01-01

Previously, it was suggested that feedback connections from higher- to lower-level areas carry predictions of lower-level neural activities, whereas feedforward connections carry the residual error between the predictions and the actual lower-level activities [Rao, R.P.N., Ballard, D.H., 1999. Nature Neuroscience 2, 79-87.]. A computational model implementing the hypothesis learned simple cell receptive fields when exposed to natural images. Here, we use predictive feedback to explain tuning properties in medial superior temporal area (MST). We implement the hypothesis using a new, biologically plausible, algorithm based on matching pursuit, which retains all the features of the previous implementation, including its ability to efficiently encode input. When presented with natural images, the model developed receptive field properties as found in primary visual cortex. In addition, when exposed to visual motion input resulting from movements through space, the model learned receptive field properties resembling those in MST. These results corroborate the idea that predictive feedback is a general principle used by the visual system to efficiently encode natural input.

Effects of Continuous Kinaesthetic Feedback Based on Tendon Vibration on Motor Imagery BCI Performance.

PubMed

Barsotti, Michele; Leonardis, Daniele; Vanello, Nicola; Bergamasco, Massimo; Frisoli, Antonio

2018-01-01

Feedback plays a crucial role for using brain computer interface systems. This paper proposes the use of vibration-evoked kinaesthetic illusions as part of a novel multisensory feedback for a motor imagery (MI)-based BCI and investigates its contributions in terms of BCI performance and electroencephalographic (EEG) correlates. sixteen subjects performed two different right arm MI-BCI sessions: with the visual feedback only and with both visual and vibration-evoked kinaesthetic feedback, conveyed by the stimulation of the biceps brachi tendon. In both conditions, the sensory feedback was driven by the MI-BCI. The rich and more natural multisensory feedback was expected to facilitate the execution of MI, and thus to improve the performance of the BCI. The EEG correlates of the proposed feedback were also investigated with and without the performing of MI. the contribution of vibration-evoked kinaesthetic feedback led to statistically higher BCI performance (Anova, F (1,14) = 18.1, p < .01) and more stable EEG event-related-desynchronization. Obtained results suggest promising application of the proposed method in neuro-rehabilitation scenarios: the advantage of an improved usability could make the MI-BCIs more applicable for those patients having difficulties in performing kinaesthetic imagery.

Visual-perceptual-kinesthetic inputs on influencing writing performances in children with handwriting difficulties.

PubMed

Tse, Linda F L; Thanapalan, Kannan C; Chan, Chetwyn C H

2014-02-01

This study investigated the role of visual-perceptual input in writing Chinese characters among senior school-aged children who had handwriting difficulties (CHD). The participants were 27 CHD (9-11 years old) and 61 normally developed control. There were three writing conditions: copying, and dictations with or without visual feedback. The motor-free subtests of the Developmental Test of Visual Perception (DTVP-2) were conducted. The CHD group showed significantly slower mean speeds of character production and less legibility of produced characters than the control group in all writing conditions (ps<0.001). There were significant deteriorations in legibility from copying to dictation without visual feedback. Nevertheless, the Group by Condition interaction effect was not statistically significant. Only position in space of DTVP-2 was significantly correlated with the legibility among CHD (r=-0.62, p=0.001). Poor legibility seems to be related to the less-intact spatial representation of the characters in working memory, which can be rectified by viewing the characters during writing. Visual feedback regarding one's own actions in writing can also improve legibility of characters among these children. Copyright © 2013 Elsevier Ltd. All rights reserved.

Perceptual learning increases the strength of the earliest signals in visual cortex.

PubMed

Bao, Min; Yang, Lin; Rios, Cristina; He, Bin; Engel, Stephen A

2010-11-10

Training improves performance on most visual tasks. Such perceptual learning can modify how information is read out from, and represented in, later visual areas, but effects on early visual cortex are controversial. In particular, it remains unknown whether learning can reshape neural response properties in early visual areas independent from feedback arising in later cortical areas. Here, we tested whether learning can modify feedforward signals in early visual cortex as measured by the human electroencephalogram. Fourteen subjects were trained for >24 d to detect a diagonal grating pattern in one quadrant of the visual field. Training improved performance, reducing the contrast needed for reliable detection, and also reliably increased the amplitude of the earliest component of the visual evoked potential, the C1. Control orientations and locations showed smaller effects of training. Because the C1 arises rapidly and has a source in early visual cortex, our results suggest that learning can increase early visual area response through local receptive field changes without feedback from later areas.

Altered visual strategies and attention are related to increased force fluctuations during a pinch grip task in older adults.

PubMed

Keenan, Kevin G; Huddleston, Wendy E; Ernest, Bradley E

2017-11-01

The purpose of the study was to determine the visual strategies used by older adults during a pinch grip task and to assess the relations between visual strategy, deficits in attention, and increased force fluctuations in older adults. Eye movements of 23 older adults (>65 yr) were monitored during a low-force pinch grip task while subjects viewed three common visual feedback displays. Performance on the Grooved Pegboard test and an attention task (which required no concurrent hand movements) was also measured. Visual strategies varied across subjects and depended on the type of visual feedback provided to the subjects. First, while viewing a high-gain compensatory feedback display (horizontal bar moving up and down with force), 9 of 23 older subjects adopted a strategy of performing saccades during the task, which resulted in 2.5 times greater force fluctuations in those that exhibited saccades compared with those who maintained fixation near the target line. Second, during pursuit feedback displays (force trace moving left to right across screen and up and down with force), all subjects exhibited multiple saccades, and increased force fluctuations were associated ( r s = 0.6; P = 0.002) with fewer saccades during the pursuit task. Also, decreased low-frequency (<4 Hz) force fluctuations and Grooved Pegboard times were significantly related ( P = 0.033 and P = 0.005, respectively) with higher (i.e., better) attention z scores. Comparison of these results with our previously published results in young subjects indicates that saccadic eye movements and attention are related to force control in older adults. NEW & NOTEWORTHY The significant contributions of the study are the addition of eye movement data and an attention task to explain differences in hand motor control across different visual displays in older adults. Older participants used different visual strategies across varying feedback displays, and saccadic eye movements were related with motor performance. In addition, those older individuals with deficits in attention had impaired motor performance on two different hand motor control tasks, including the Grooved Pegboard test. Copyright © 2017 the American Physiological Society.

Manipulating the fidelity of lower extremity visual feedback to identify obstacle negotiation strategies in immersive virtual reality.

PubMed

Kim, Aram; Zhou, Zixuan; Kretch, Kari S; Finley, James M

2017-07-01

The ability to successfully navigate obstacles in our environment requires integration of visual information about the environment with estimates of our body's state. Previous studies have used partial occlusion of the visual field to explore how information about the body and impending obstacles are integrated to mediate a successful clearance strategy. However, because these manipulations often remove information about both the body and obstacle, it remains to be seen how information about the lower extremities alone is utilized during obstacle crossing. Here, we used an immersive virtual reality (VR) interface to explore how visual feedback of the lower extremities influences obstacle crossing performance. Participants wore a head-mounted display while walking on treadmill and were instructed to step over obstacles in a virtual corridor in four different feedback trials. The trials involved: (1) No visual feedback of the lower extremities, (2) an endpoint-only model, (3) a link-segment model, and (4) a volumetric multi-segment model. We found that the volumetric model improved success rate, placed their trailing foot before crossing and leading foot after crossing more consistently, and placed their leading foot closer to the obstacle after crossing compared to no model. This knowledge is critical for the design of obstacle negotiation tasks in immersive virtual environments as it may provide information about the fidelity necessary to reproduce ecologically valid practice environments.

Promoting Increased Pitch Variation in Oral Presentations with Transient Visual Feedback

ERIC Educational Resources Information Center

Hincks, Rebecca; Edlund, Jens

2009-01-01

This paper investigates learner response to a novel kind of intonation feedback generated from speech analysis. Instead of displays of pitch curves, our feedback is flashing lights that show how much pitch variation the speaker has produced. The variable used to generate the feedback is the standard deviation of fundamental frequency as measured…

Low Cost Embedded Stereo System for Underwater Surveys

NASA Astrophysics Data System (ADS)

Nawaf, M. M.; Boï, J.-M.; Merad, D.; Royer, J.-P.; Drap, P.

2017-11-01

This paper provides details of both hardware and software conception and realization of a hand-held stereo embedded system for underwater imaging. The designed system can run most image processing techniques smoothly in real-time. The developed functions provide direct visual feedback on the quality of the taken images which helps taking appropriate actions accordingly in terms of movement speed and lighting conditions. The proposed functionalities can be easily customized or upgraded whereas new functions can be easily added thanks to the available supported libraries. Furthermore, by connecting the designed system to a more powerful computer, a real-time visual odometry can run on the captured images to have live navigation and site coverage map. We use a visual odometry method adapted to low computational resources systems and long autonomy. The system is tested in a real context and showed its robustness and promising further perspectives.

Detecting Traversable Area and Water Hazards for the Visually Impaired with a pRGB-D Sensor

PubMed Central

Yang, Kailun; Wang, Kaiwei; Cheng, Ruiqi; Hu, Weijian; Huang, Xiao; Bai, Jian

2017-01-01

The use of RGB-Depth (RGB-D) sensors for assisting visually impaired people (VIP) has been widely reported as they offer portability, function-diversity and cost-effectiveness. However, polarization cues to assist traversability awareness without precautions against stepping into water areas are weak. In this paper, a polarized RGB-Depth (pRGB-D) framework is proposed to detect traversable area and water hazards simultaneously with polarization-color-depth-attitude information to enhance safety during navigation. The approach has been tested on a pRGB-D dataset, which is built for tuning parameters and evaluating the performance. Moreover, the approach has been integrated into a wearable prototype which generates a stereo sound feedback to guide visually impaired people (VIP) follow the prioritized direction to avoid obstacles and water hazards. Furthermore, a preliminary study with ten blindfolded participants suggests its effectivity and reliability. PMID:28817069

Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users.

PubMed

Witteveen, Heidi J B; Rietman, Hans S; Veltink, Peter H

2015-06-01

User feedback about grasping force and hand aperture is very important in object handling with myoelectric forearm prostheses but is lacking in current prostheses. Vibrotactile feedback increases the performance of healthy subjects in virtual grasping tasks, but no extensive validation on potential users has been performed. Investigate the performance of upper-limb loss subjects in grasping tasks with vibrotactile stimulation, providing hand aperture, and grasping force feedback. Cross-over trial. A total of 10 subjects with upper-limb loss performed virtual grasping tasks while perceiving vibrotactile feedback. Hand aperture feedback was provided through an array of coin motors and grasping force feedback through a single miniature stimulator or an array of coin motors. Objects with varying sizes and weights had to be grasped by a virtual hand. Percentages correctly applied hand apertures and correct grasping force levels were all higher for the vibrotactile feedback condition compared to the no-feedback condition. With visual feedback, the results were always better compared to the vibrotactile feedback condition. Task durations were comparable for all feedback conditions. Vibrotactile grasping force and hand aperture feedback improves grasping performance of subjects with upper-limb loss. However, it should be investigated whether this is of additional value in daily-life tasks. This study is a first step toward the implementation of sensory vibrotactile feedback for users of myoelectric forearm prostheses. Grasping force feedback is crucial for optimal object handling, and hand aperture feedback is essential for reduction of required visual attention. Grasping performance with feedback is evaluated for the potential users. © The International Society for Prosthetics and Orthotics 2014.

Man-systems evaluation of moving base vehicle simulation motion cues. [human acceleration perception involving visual feedback

NASA Technical Reports Server (NTRS)

Kirkpatrick, M.; Brye, R. G.

1974-01-01

A motion cue investigation program is reported that deals with human factor aspects of high fidelity vehicle simulation. General data on non-visual motion thresholds and specific threshold values are established for use as washout parameters in vehicle simulation. A general purpose similator is used to test the contradictory cue hypothesis that acceleration sensitivity is reduced during a vehicle control task involving visual feedback. The simulator provides varying acceleration levels. The method of forced choice is based on the theory of signal detect ability.

Self-controlled concurrent feedback facilitates the learning of the final approach phase in a fixed-base flight simulator.

PubMed

Huet, Michaël; Jacobs, David M; Camachon, Cyril; Goulon, Cedric; Montagne, Gilles

2009-12-01

This study (a) compares the effectiveness of different types of feedback for novices who learn to land a virtual aircraft in a fixed-base flight simulator and (b) analyzes the informational variables that learners come to use after practice. An extensive body of research exists concerning the informational variables that allow successful landing. In contrast, few studies have examined how the attention of pilots can be directed toward these sources of information. In this study, 15 participants were asked to land a virtual Cessna 172 on 245 trials while trying to follow the glide-slope area as accurately as possible. Three groups of participants practiced under different feedback conditions: with self-controlled concurrent feedback (the self-controlled group), with imposed concurrent feedback (the yoked group), or without concurrent feedback (the control group). The self-controlled group outperformed the yoked group, which in turn outperformed the control group. Removing or manipulating specific sources of information during transfer tests had different effects for different individuals. However, removing the cockpit from the visual scene had a detrimental effect on the performance of the majority of the participants. Self-controlled concurrent feedback helps learners to more quickly attune to the informational variables that allow them to control the aircraft during the approach phase. Knowledge concerning feedback schedules can be used for the design of optimal practice methods for student pilots, and knowledge about the informational variables used by expert performers has implications for the design of cockpits and runways that facilitate the detection of these variables.

A systematic review: the influence of real time feedback on wheelchair propulsion biomechanics.

PubMed

Symonds, Andrew; Barbareschi, Giulia; Taylor, Stephen; Holloway, Catherine

2018-01-01

Clinical guidelines recommend that, in order to minimize upper limb injury risk, wheelchair users adopt a semi-circular pattern with a slow cadence and a large push arc. To examine whether real time feedback can be used to influence manual wheelchair propulsion biomechanics. Clinical trials and case series comparing the use of real time feedback against no feedback were included. A general review was performed and methodological quality assessed by two independent practitioners using the Downs and Black checklist. The review was completed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines. Six papers met the inclusion criteria. Selected studies involved 123 participants and analysed the effect of visual and, in one case, haptic feedback. Across the studies it was shown that participants were able to achieve significant changes in propulsion biomechanics, when provided with real time feedback. However, the effect of targeting a single propulsion variable might lead to unwanted alterations in other parameters. Methodological assessment identified weaknesses in external validity. Visual feedback could be used to consistently increase push arc and decrease push rate, and may be the best focus for feedback training. Further investigation is required to assess such intervention during outdoor propulsion. Implications for Rehabilitation Upper limb pain and injuries are common secondary disorders that negatively affect wheelchair users' physical activity and quality of life. Clinical guidelines suggest that manual wheelchair users should aim to propel with a semi-circular pattern with low a push rate and large push arc in the range in order to minimise upper limbs' loading. Real time visual and haptic feedback are effective tools for improving propulsion biomechanics in both complete novices and experienced manual wheelchair users.

Randomised crossover trial of rate feedback and force during chest compressions for paediatric cardiopulmonary resuscitation.

PubMed

Gregson, Rachael Kathleen; Cole, Tim James; Skellett, Sophie; Bagkeris, Emmanouil; Welsby, Denise; Peters, Mark John

2017-05-01

To determine the effect of visual feedback on rate of chest compressions, secondarily relating the forces used. Randomised crossover trial. Tertiary teaching hospital. Fifty trained hospital staff. A thin sensor-mat placed over the manikin's chest measured rate and force. Rescuers applied compressions to the same paediatric manikin for two sessions. During one session they received visual feedback comparing their real-time rate with published guidelines. Primary: compression rate. Secondary: compression and residual forces. Rate of chest compressions (compressions per minute (compressions per minute; cpm)) varied widely (mean (SD) 111 (13), range 89-168), with a fourfold difference in variation during session 1 between those receiving and not receiving feedback (108 (5) vs 120 (20)). The interaction of session by feedback order was highly significant, indicating that this difference in mean rate between sessions was 14 cpm less (95% CI -22 to -5, p=0.002) in those given feedback first compared with those given it second. Compression force (N) varied widely (mean (SD) 306 (94); range 142-769). Those receiving feedback second (as opposed to first) used significantly lower force (adjusted mean difference -80 (95% CI -128 to -32), p=0.002). Mean residual force (18 N, SD 12, range 0-49) was unaffected by the intervention. While visual feedback restricted excessive compression rates to within the prescribed range, applied force remained widely variable. The forces required may differ with growth, but such variation treating one manikin is alarming. Feedback technologies additionally measuring force (effort) could help to standardise and define effective treatments throughout childhood. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Successful inhibitory control over an immediate reward is associated with attentional disengagement in visual processing areas.

PubMed

O'Connor, David A; Rossiter, Sarah; Yücel, Murat; Lubman, Dan I; Hester, Robert

2012-09-01

We examined the neural basis of the capacity to resist an immediately rewarding stimulus in order to obtain a larger delayed reward. This was investigated with a Go/No-go task employing No-go targets that provided two types of reward outcomes. These were contingent on inhibitory control performance: failure to inhibit Reward No-go targets provided a small monetary reward with immediate feedback; while successful inhibitory control resulted in larger rewards with delayed feedback based on the highest number of consecutive inhibitions. We observed faster Go trial responses with maintained levels of inhibition accuracy during the Reward No-go condition compared to a neutral No-go condition. Comparisons between conditions of BOLD activity showed successful inhibitory control over rewarding No-Go targets was associated with hypoactivity in regions previously associated with regulating emotion and inhibitory control, including insula and right inferior frontal gyrus. In addition, regions previously associated with visual processing centers that are modulated as a function of visual attention, namely the left fusiform and right superior temporal gyri, were hypoactive. These findings suggest a role for attentional disengagement as an aid to withholding response over a rewarding stimulus and are consistent with the notion that gratification can be delayed by directing attention away from immediate rewards. Crown Copyright © 2012. Published by Elsevier Inc. All rights reserved.

Effectiveness of basic display augmentation in vehicular control by visual field cues

NASA Technical Reports Server (NTRS)

Grunwald, A. J.; Merhav, S. J.

1978-01-01

The paper investigates the effectiveness of different basic display augmentation concepts - fixed reticle, velocity vector, and predicted future vehicle path - for RPVs controlled by a vehicle-mounted TV camera. The task is lateral manual control of a low flying RPV along a straight reference line in the presence of random side gusts. The man-machine system and the visual interface are modeled as a linear time-invariant system. Minimization of a quadratic performance criterion is assumed to underlie the control strategy of a well-trained human operator. The solution for the optimal feedback matrix enables the explicit computation of the variances of lateral deviation and directional error of the vehicle and of the control force that are used as performance measures.

A Randomized Control Trial of Cardiopulmonary Feedback Devices and Their Impact on Infant Chest Compression Quality: A Simulation Study.

PubMed

Austin, Andrea L; Spalding, Carmen N; Landa, Katrina N; Myer, Brian R; Donald, Cure; Smith, Jason E; Platt, Gerald; King, Heather C

2017-10-27

In effort to improve chest compression quality among health care providers, numerous feedback devices have been developed. Few studies, however, have focused on the use of cardiopulmonary resuscitation feedback devices for infants and children. This study evaluated the quality of chest compressions with standard team-leader coaching, a metronome (MetroTimer by ONYX Apps), and visual feedback (SkillGuide Cardiopulmonary Feedback Device) during simulated infant cardiopulmonary resuscitation. Seventy voluntary health care providers who had recently completed Pediatric Advanced Life Support or Basic Life Support courses were randomized to perform simulated infant cardiopulmonary resuscitation into 1 of 3 groups: team-leader coaching alone (control), coaching plus metronome, or coaching plus SkillGuide for 2 minutes continuously. Rate, depth, and frequency of complete recoil during cardiopulmonary resuscitation were recorded by the Laerdal SimPad device for each participant. American Heart Association-approved compression techniques were randomized to either 2-finger or encircling thumbs. The metronome was associated with more ideal compression rate than visual feedback or coaching alone (104/min vs 112/min and 113/min; P = 0.003, 0.019). Visual feedback was associated with more ideal depth than auditory (41 mm vs 38.9; P = 0.03). There were no significant differences in complete recoil between groups. Secondary outcomes of compression technique revealed a difference of 1 mm. Subgroup analysis of male versus female showed no difference in mean number of compressions (221.76 vs 219.79; P = 0.72), mean compression depth (40.47 vs 39.25; P = 0.09), or rate of complete release (70.27% vs 64.96%; P = 0.54). In the adult literature, feedback devices often show an increase in quality of chest compressions. Although more studies are needed, this study did not demonstrate a clinically significant improvement in chest compressions with the addition of a metronome or visual feedback device, no clinically significant difference in Pediatric Advanced Life Support-approved compression technique, and no difference between compression quality between genders.

Objective Assessment of Laparoscopic Force and Psychomotor Skills in a Novel Virtual Reality-Based Haptic Simulator.

PubMed

Prasad, M S Raghu; Manivannan, Muniyandi; Manoharan, Govindan; Chandramohan, S M

2016-01-01

Most of the commercially available virtual reality-based laparoscopic simulators do not effectively evaluate combined psychomotor and force-based laparoscopic skills. Consequently, the lack of training on these critical skills leads to intraoperative errors. To assess the effectiveness of the novel virtual reality-based simulator, this study analyzed the combined psychomotor (i.e., motion or movement) and force skills of residents and expert surgeons. The study also examined the effectiveness of real-time visual force feedback and tool motion during training. Bimanual fundamental (i.e., probing, pulling, sweeping, grasping, and twisting) and complex tasks (i.e., tissue dissection) were evaluated. In both tasks, visual feedback on applied force and tool motion were provided. The skills of the participants while performing the early tasks were assessed with and without visual feedback. Participants performed 5 repetitions of fundamental and complex tasks. Reaction force and instrument acceleration were used as metrics. Surgical Gastroenterology, Government Stanley Medical College and Hospital; Institute of Surgical Gastroenterology, Madras Medical College and Rajiv Gandhi Government General Hospital. Residents (N = 25; postgraduates and surgeons with <2 years of laparoscopic surgery) and expert surgeons (N = 25; surgeons with >4 and ≤10 years of laparoscopic surgery). Residents applied large forces compared with expert surgeons and performed abrupt tool movements (p < 0.001). However, visual + haptic feedback improved the performance of residents (p < 0.001). In complex tasks, visual + haptic feedback did not influence the applied force of expert surgeons, but influenced their tool motion (p < 0.001). Furthermore, in complex tissue sweeping task, expert surgeons applied more force, but were within the tissue damage limits. In both groups, exertion of large forces and abrupt tool motion were observed during grasping, probing or pulling, and tissue sweeping maneuvers (p < 0.001). Modern day curriculum-based training should evaluate the skills of residents with robust force and psychomotor-based exercises for proficient laparoscopy. Visual feedback on force and motion during training has the potential to enhance the learning curve of residents. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Combined contributions of feedforward and feedback inputs to bottom-up attention

PubMed Central

Khorsand, Peyman; Moore, Tirin; Soltani, Alireza

2015-01-01

In order to deal with a large amount of information carried by visual inputs entering the brain at any given point in time, the brain swiftly uses the same inputs to enhance processing in one part of visual field at the expense of the others. These processes, collectively called bottom-up attentional selection, are assumed to solely rely on feedforward processing of the external inputs, as it is implied by the nomenclature. Nevertheless, evidence from recent experimental and modeling studies points to the role of feedback in bottom-up attention. Here, we review behavioral and neural evidence that feedback inputs are important for the formation of signals that could guide attentional selection based on exogenous inputs. Moreover, we review results from a modeling study elucidating mechanisms underlying the emergence of these signals in successive layers of neural populations and how they depend on feedback from higher visual areas. We use these results to interpret and discuss more recent findings that can further unravel feedforward and feedback neural mechanisms underlying bottom-up attention. We argue that while it is descriptively useful to separate feedforward and feedback processes underlying bottom-up attention, these processes cannot be mechanistically separated into two successive stages as they occur at almost the same time and affect neural activity within the same brain areas using similar neural mechanisms. Therefore, understanding the interaction and integration of feedforward and feedback inputs is crucial for better understanding of bottom-up attention. PMID:25784883

Attainment and retention of force moderation following laparoscopic resection training with visual force feedback.

PubMed

Hernandez, Rafael; Onar-Thomas, Arzu; Travascio, Francesco; Asfour, Shihab

2017-11-01

Laparoscopic training with visual force feedback can lead to immediate improvements in force moderation. However, the long-term retention of this kind of learning and its potential decay are yet unclear. A laparoscopic resection task and force sensing apparatus were designed to assess the benefits of visual force feedback training. Twenty-two male university students with no previous experience in laparoscopy underwent relevant FLS proficiency training. Participants were randomly assigned to either a control or treatment group. Both groups trained on the task for 2 weeks as follows: initial baseline, sixteen training trials, and post-test immediately after. The treatment group had visual force feedback during training, whereas the control group did not. Participants then performed four weekly test trials to assess long-term retention of training. Outcomes recorded were maximum pulling and pushing forces, completion time, and rated task difficulty. Extreme maximum pulling force values were tapered throughout both the training and retention periods. Average maximum pushing forces were significantly lowered towards the end of training and during retention period. No significant decay of applied force learning was found during the 4-week retention period. Completion time and rated task difficulty were higher during training, but results indicate that the difference eventually fades during the retention period. Significant differences in aptitude across participants were found. Visual force feedback training improves on certain aspects of force moderation in a laparoscopic resection task. Results suggest that with enough training there is no significant decay of learning within the first month of the retention period. It is essential to account for differences in aptitude between individuals in this type of longitudinal research. This study shows how an inexpensive force measuring system can be used with an FLS Trainer System after some retrofitting. Surgical instructors can develop their own tasks and adjust force feedback levels accordingly.

Visual Feedback of Tongue Movement for Novel Speech Sound Learning

PubMed Central

Katz, William F.; Mehta, Sonya

2015-01-01

Pronunciation training studies have yielded important information concerning the processing of audiovisual (AV) information. Second language (L2) learners show increased reliance on bottom-up, multimodal input for speech perception (compared to monolingual individuals). However, little is known about the role of viewing one's own speech articulation processes during speech training. The current study investigated whether real-time, visual feedback for tongue movement can improve a speaker's learning of non-native speech sounds. An interactive 3D tongue visualization system based on electromagnetic articulography (EMA) was used in a speech training experiment. Native speakers of American English produced a novel speech sound (/ɖ/; a voiced, coronal, palatal stop) before, during, and after trials in which they viewed their own speech movements using the 3D model. Talkers' productions were evaluated using kinematic (tongue-tip spatial positioning) and acoustic (burst spectra) measures. The results indicated a rapid gain in accuracy associated with visual feedback training. The findings are discussed with respect to neural models for multimodal speech processing. PMID:26635571

Selective visual scaling of time-scale processes facilitates broadband learning of isometric force frequency tracking.

PubMed

King, Adam C; Newell, Karl M

2015-10-01

The experiment investigated the effect of selectively augmenting faster time scales of visual feedback information on the learning and transfer of continuous isometric force tracking tasks to test the generality of the self-organization of 1/f properties of force output. Three experimental groups tracked an irregular target pattern either under a standard fixed gain condition or with selectively enhancement in the visual feedback display of intermediate (4-8 Hz) or high (8-12 Hz) frequency components of the force output. All groups reduced tracking error over practice, with the error lowest in the intermediate scaling condition followed by the high scaling and fixed gain conditions, respectively. Selective visual scaling induced persistent changes across the frequency spectrum, with the strongest effect in the intermediate scaling condition and positive transfer to novel feedback displays. The findings reveal an interdependence of the timescales in the learning and transfer of isometric force output frequency structures consistent with 1/f process models of the time scales of motor output variability.

A hierarchy of timescales explains distinct effects of local inhibition of primary visual cortex and frontal eye fields

PubMed Central

Cocchi, Luca; Sale, Martin V; L Gollo, Leonardo; Bell, Peter T; Nguyen, Vinh T; Zalesky, Andrew; Breakspear, Michael; Mattingley, Jason B

2016-01-01

Within the primate visual system, areas at lower levels of the cortical hierarchy process basic visual features, whereas those at higher levels, such as the frontal eye fields (FEF), are thought to modulate sensory processes via feedback connections. Despite these functional exchanges during perception, there is little shared activity between early and late visual regions at rest. How interactions emerge between regions encompassing distinct levels of the visual hierarchy remains unknown. Here we combined neuroimaging, non-invasive cortical stimulation and computational modelling to characterize changes in functional interactions across widespread neural networks before and after local inhibition of primary visual cortex or FEF. We found that stimulation of early visual cortex selectively increased feedforward interactions with FEF and extrastriate visual areas, whereas identical stimulation of the FEF decreased feedback interactions with early visual areas. Computational modelling suggests that these opposing effects reflect a fast-slow timescale hierarchy from sensory to association areas. DOI: http://dx.doi.org/10.7554/eLife.15252.001 PMID:27596931

A hierarchy of timescales explains distinct effects of local inhibition of primary visual cortex and frontal eye fields.

PubMed

Cocchi, Luca; Sale, Martin V; L Gollo, Leonardo; Bell, Peter T; Nguyen, Vinh T; Zalesky, Andrew; Breakspear, Michael; Mattingley, Jason B

2016-09-06

Within the primate visual system, areas at lower levels of the cortical hierarchy process basic visual features, whereas those at higher levels, such as the frontal eye fields (FEF), are thought to modulate sensory processes via feedback connections. Despite these functional exchanges during perception, there is little shared activity between early and late visual regions at rest. How interactions emerge between regions encompassing distinct levels of the visual hierarchy remains unknown. Here we combined neuroimaging, non-invasive cortical stimulation and computational modelling to characterize changes in functional interactions across widespread neural networks before and after local inhibition of primary visual cortex or FEF. We found that stimulation of early visual cortex selectively increased feedforward interactions with FEF and extrastriate visual areas, whereas identical stimulation of the FEF decreased feedback interactions with early visual areas. Computational modelling suggests that these opposing effects reflect a fast-slow timescale hierarchy from sensory to association areas.

Hebbian learning in a model with dynamic rate-coded neurons: an alternative to the generative model approach for learning receptive fields from natural scenes.

PubMed

Hamker, Fred H; Wiltschut, Jan

2007-09-01

Most computational models of coding are based on a generative model according to which the feedback signal aims to reconstruct the visual scene as close as possible. We here explore an alternative model of feedback. It is derived from studies of attention and thus, probably more flexible with respect to attentive processing in higher brain areas. According to this model, feedback implements a gain increase of the feedforward signal. We use a dynamic model with presynaptic inhibition and Hebbian learning to simultaneously learn feedforward and feedback weights. The weights converge to localized, oriented, and bandpass filters similar as the ones found in V1. Due to presynaptic inhibition the model predicts the organization of receptive fields within the feedforward pathway, whereas feedback primarily serves to tune early visual processing according to the needs of the task.

Real-time decoding of the direction of covert visuospatial attention

NASA Astrophysics Data System (ADS)

Andersson, Patrik; Ramsey, Nick F.; Raemaekers, Mathijs; Viergever, Max A.; Pluim, Josien P. W.

2012-08-01

Brain-computer interfaces (BCIs) make it possible to translate a person’s intentions into actions without depending on the muscular system. Brain activity is measured and classified into commands, thereby creating a direct link between the mind and the environment, enabling, e.g., cursor control or navigation of a wheelchair or robot. Most BCI research is conducted with scalp EEG but recent developments move toward intracranial electrodes for paralyzed people. The vast majority of BCI studies focus on the motor system as the appropriate target for recording and decoding movement intentions. However, properties of the visual system may make the visual system an attractive and intuitive alternative. We report on a study investigating feasibility of decoding covert visuospatial attention in real time, exploiting the full potential of a 7 T MRI scanner to obtain the necessary signal quality, capitalizing on earlier fMRI studies indicating that covert visuospatial attention changes activity in the visual areas that respond to stimuli presented in the attended area of the visual field. Healthy volunteers were instructed to shift their attention from the center of the screen to one of four static targets in the periphery, without moving their eyes from the center. During the first part of the fMRI-run, the relevant brain regions were located using incremental statistical analysis. During the second part, the activity in these regions was extracted and classified, and the subject was given visual feedback of the result. Performance was assessed as the number of trials where the real-time classifier correctly identified the direction of attention. On average, 80% of trials were correctly classified (chance level <25%) based on a single image volume, indicating very high decoding performance. While we restricted the experiment to five attention target regions (four peripheral and one central), the number of directions can be higher provided the brain activity patterns can be distinguished. In summary, the visual system promises to be an effective target for BCI control.

Altered figure-ground perception in monkeys with an extra-striate lesion.

PubMed

Supèr, Hans; Lamme, Victor A F

2007-11-05

The visual system binds and segments the elements of an image into coherent objects and their surroundings. Recent findings demonstrate that primary visual cortex is involved in this process of figure-ground organization. In the primary visual cortex the late part of a neural response to a stimulus correlates with figure-ground segregation and perception. Such a late onset indicates an involvement of feedback projections from higher visual areas. To investigate the possible role of feedback in figure-ground perception we removed dorsal extra-striate areas of the monkey visual cortex. The findings show that figure-ground perception is reduced when the figure is presented in the lesioned hemifield and perception is normal when the figure appeared in the intact hemifield. In conclusion, our observations show the importance for recurrent processing in visual perception.

Performance drifts in two-finger cyclical force production tasks performed by one and two actors.

PubMed

Hasanbarani, Fariba; Reschechtko, Sasha; Latash, Mark L

2018-03-01

We explored changes in the cyclical two-finger force performance task caused by turning visual feedback off performed either by the index and middle fingers of the dominant hand or by two index fingers of two persons. Based on an earlier study, we expected drifts in finger force amplitude and midpoint without a drift in relative phase. The subjects performed two rhythmical tasks at 1 Hz while paced by an auditory metronome. One of the tasks required cyclical changes in total force magnitude without changes in the sharing of the force between the two fingers. The other task required cyclical changes in the force sharing without changing total force magnitude. Subjects were provided with visual feedback, which showed total force magnitude and force sharing via cursor motion along the vertical and horizontal axes, respectively. Further, visual feedback was turned off, first on the variable that was not required to change and then on both variables. Turning visual feedback off led to a mean force drift toward lower magnitudes while force amplitude increased. There was a consistent drift in the relative phase in the one-hand task with the index finger leading the middle finger. No consistent relative phase drift was seen in the two-person tasks. The shape of the force cycle changed without visual feedback reflected in the lower similarity to a perfect cosine shape and in the higher time spent at lower force magnitudes. The data confirm findings of earlier studies regarding force amplitude and midpoint changes, but falsify predictions of an earlier proposed model with respect to the relative phase changes. We discuss factors that could contribute to the observed relative phase drift in the one-hand tasks including the leader-follower pattern generalized for two-effector tasks performed by one person.

The effect of step stool use and provider height on CPR quality during pediatric cardiac arrest: A simulation-based multicentre study.

PubMed

Cheng, Adam; Lin, Yiqun; Nadkarni, Vinay; Wan, Brandi; Duff, Jonathan; Brown, Linda; Bhanji, Farhan; Kessler, David; Tofil, Nancy; Hecker, Kent; Hunt, Elizabeth A

2018-01-01

We aimed to explore whether a) step stool use is associated with improved cardiopulmonary resuscitation (CPR) quality; b) provider adjusted height is associated with improved CPR quality; and if associations exist, c) determine whether just-in-time (JIT) CPR training and/or CPR visual feedback attenuates the effect of height and/or step stool use on CPR quality. We analysed data from a trial of simulated cardiac arrests with three study arms: No intervention; CPR visual feedback; and JIT CPR training. Step stool use was voluntary. We explored the association between 1) step stool use and CPR quality, and 2) provider adjusted height and CPR quality. Adjusted height was defined as provider height + 23 cm (if step stool was used). Below-average height participants were ≤ gender-specific average height; the remainder were above average height. We assessed for interaction between study arm and both adjusted height and step stool use. One hundred twenty-four subjects participated; 1,230 30-second epochs of CPR were analysed. Step stool use was associated with improved compression depth in below-average (female, p=0.007; male, p<0.001) and above-average (female, p=0.001; male, p<0.001) height providers. There is an association between adjusted height and compression depth (p<0.001). Visual feedback attenuated the effect of height (p=0.025) on compression depth; JIT training did not (p=0.918). Visual feedback and JIT training attenuated the effect of step stool use (p<0.001) on compression depth. Step stool use is associated with improved compression depth regardless of height. Increased provider height is associated with improved compression depth, with visual feedback attenuating the effects of height and step stool use.

Seeing the Errors You Feel Enhances Locomotor Performance but Not Learning.

PubMed

Roemmich, Ryan T; Long, Andrew W; Bastian, Amy J

2016-10-24

In human motor learning, it is thought that the more information we have about our errors, the faster we learn. Here, we show that additional error information can lead to improved motor performance without any concomitant improvement in learning. We studied split-belt treadmill walking that drives people to learn a new gait pattern using sensory prediction errors detected by proprioceptive feedback. When we also provided visual error feedback, participants acquired the new walking pattern far more rapidly and showed accelerated restoration of the normal walking pattern during washout. However, when the visual error feedback was removed during either learning or washout, errors reappeared with performance immediately returning to the level expected based on proprioceptive learning alone. These findings support a model with two mechanisms: a dual-rate adaptation process that learns invariantly from sensory prediction error detected by proprioception and a visual-feedback-dependent process that monitors learning and corrects residual errors but shows no learning itself. We show that our voluntary correction model accurately predicted behavior in multiple situations where visual feedback was used to change acquisition of new walking patterns while the underlying learning was unaffected. The computational and behavioral framework proposed here suggests that parallel learning and error correction systems allow us to rapidly satisfy task demands without necessarily committing to learning, as the relative permanence of learning may be inappropriate or inefficient when facing environments that are liable to change. Copyright © 2016 Elsevier Ltd. All rights reserved.

Effect of vibrotactile feedback on an EMG-based proportional cursor control system.

PubMed

Li, Shunchong; Chen, Xingyu; Zhang, Dingguo; Sheng, Xinjun; Zhu, Xiangyang

2013-01-01

Surface electromyography (sEMG) has been introduced into the bio-mechatronics systems, however, most of them are lack of the sensory feedback. In this paper, the effect of vibrotactile feedback for a myoelectric cursor control system is investigated quantitatively. Simultaneous and proportional control signals are extracted from EMG using a muscle synergy model. Different types of feedback including vibrotactile feedback and visual feedback are added, assessed and compared with each other. The results show that vibrotactile feedback is capable of improving the performance of EMG-based human machine interface.

Design and test of a Microsoft Kinect-based system for delivering adaptive visual feedback to stroke patients during training of upper limb movement.

PubMed

Simonsen, Daniel; Popovic, Mirjana B; Spaich, Erika G; Andersen, Ole Kæseler

2017-11-01

The present paper describes the design and test of a low-cost Microsoft Kinect-based system for delivering adaptive visual feedback to stroke patients during the execution of an upper limb exercise. Eleven sub-acute stroke patients with varying degrees of upper limb function were recruited. Each subject participated in a control session (repeated twice) and a feedback session (repeated twice). In each session, the subjects were presented with a rectangular pattern displayed on a vertical mounted monitor embedded in the table in front of the patient. The subjects were asked to move a marker inside the rectangular pattern by using their most affected hand. During the feedback session, the thickness of the rectangular pattern was changed according to the performance of the subject, and the color of the marker changed according to its position, thereby guiding the subject's movements. In the control session, the thickness of the rectangular pattern and the color of the marker did not change. The results showed that the movement similarity and smoothness was higher in the feedback session than in the control session while the duration of the movement was longer. The present study showed that adaptive visual feedback delivered by use of the Kinect sensor can increase the similarity and smoothness of upper limb movement in stroke patients.

Viewer-centered and body-centered frames of reference in direct visuomotor transformations.

PubMed

Carrozzo, M; McIntyre, J; Zago, M; Lacquaniti, F

1999-11-01

It has been hypothesized that the end-point position of reaching may be specified in an egocentric frame of reference. In most previous studies, however, reaching was toward a memorized target, rather than an actual target. Thus, the role played by sensorimotor transformation could not be disassociated from the role played by storage in short-term memory. In the present study the direct process of sensorimotor transformation was investigated in reaching toward continuously visible targets that need not be stored in memory. A virtual reality system was used to present visual targets in different three-dimensional (3D) locations in two different tasks, one with visual feedback of the hand and arm position (Seen Hand) and the other without such feedback (Unseen Hand). In the Seen Hand task, the axes of maximum variability and of maximum contraction converge toward the mid-point between the eyes. In the Unseen Hand task only the maximum contraction correlates with the sight-line and the axes of maximum variability are not viewer-centered but rotate anti-clockwise around the body and the effector arm during the move from the right to the left workspace. The bulk of findings from these and previous experiments support the hypothesis of a two-stage process, with a gradual transformation from viewer-centered to body-centered and arm-centered coordinates. Retinal, extra-retinal and arm-related signals appear to be progressively combined in superior and inferior parietal areas, giving rise to egocentric representations of the end-point position of reaching.

[Nursing Experience of Using Mirror Visual Feedback for a Schizophrenia Patient With Visual Hallucinations].

PubMed

Lan, Shu-Ling; Chen, Yu-Chi; Chang, Hsiu-Ju

2018-06-01

The aim of this paper was to describe the nursing application of mirror visual feedback in a patient suffering from long-term visual hallucinations. The intervention period was from May 15th to October 19th, 2015. Using the five facets of psychiatric nursing assessment, several health problems were observed, including disturbed sensory perceptions (prominent visual hallucinations) and poor self-care (e.g. limited abilities to self-bathe and put on clothing). Furthermore, "caregiver role strain" due to the related intense care burden was noted. After building up a therapeutic interpersonal relationship, the technique of brain plasticity and mirror visual feedback were performed using multiple nursing care methods in order to help the patient suppress her visual hallucinations by enhancing a different visual stimulus. We also taught her how to cope with visual hallucinations in a proper manner. The frequency and content of visual hallucinations were recorded to evaluate the effects of management. The therapeutic plan was formulated together with the patient in order to boost her self-confidence, and a behavior contract was implemented in order to improve her personal hygiene. In addition, psychoeducation on disease-related topics was provided to the patient's family, and they were encouraged to attend relevant therapeutic activities. As a result, her family became less passive and negative and more engaged in and positive about her future. The crisis of "caregiver role strain" was successfully resolved. The current experience is hoped to serve as a model for enhancing communication and cooperation between family and staff in similar medical settings.

Ultrasound visual feedback in articulation therapy following partial glossectomy.

PubMed

Blyth, Katrina M; Mccabe, Patricia; Madill, Catherine; Ballard, Kirrie J

2016-01-01

Disordered speech is common following treatment for tongue cancer, however there is insufficient high quality evidence to guide clinical decision making about treatment. This study investigated use of ultrasound tongue imaging as a visual feedback tool to guide tongue placement during articulation therapy with two participants following partial glossectomy. A Phase I multiple baseline design across behaviors was used to investigate therapeutic effect of ultrasound visual feedback during speech rehabilitation. Percent consonants correct and speech intelligibility at sentence level were used to measure acquisition, generalization and maintenance of speech skills for treated and untreated related phonemes, while unrelated phonemes were tested to demonstrate experimental control. Swallowing and oromotor measures were also taken to monitor change. Sentence intelligibility was not a sensitive measure of speech change, but both participants demonstrated significant change in percent consonants correct for treated phonemes. One participant also demonstrated generalization to non-treated phonemes. Control phonemes along with swallow and oromotor measures remained stable throughout the study. This study establishes therapeutic benefit of ultrasound visual feedback in speech rehabilitation following partial glossectomy. Readers will be able to explain why and how tongue cancer surgery impacts on articulation precision. Readers will also be able to explain the acquisition, generalization and maintenance effects in the study. Copyright © 2016. Published by Elsevier Inc.

A recurrent neural model for proto-object based contour integration and figure-ground segregation.

PubMed

Hu, Brian; Niebur, Ernst

2017-12-01

Visual processing of objects makes use of both feedforward and feedback streams of information. However, the nature of feedback signals is largely unknown, as is the identity of the neuronal populations in lower visual areas that receive them. Here, we develop a recurrent neural model to address these questions in the context of contour integration and figure-ground segregation. A key feature of our model is the use of grouping neurons whose activity represents tentative objects ("proto-objects") based on the integration of local feature information. Grouping neurons receive input from an organized set of local feature neurons, and project modulatory feedback to those same neurons. Additionally, inhibition at both the local feature level and the object representation level biases the interpretation of the visual scene in agreement with principles from Gestalt psychology. Our model explains several sets of neurophysiological results (Zhou et al. Journal of Neuroscience, 20(17), 6594-6611 2000; Qiu et al. Nature Neuroscience, 10(11), 1492-1499 2007; Chen et al. Neuron, 82(3), 682-694 2014), and makes testable predictions about the influence of neuronal feedback and attentional selection on neural responses across different visual areas. Our model also provides a framework for understanding how object-based attention is able to select both objects and the features associated with them.

Short Term Motor-Skill Acquisition Improves with Size of Self-Controlled Virtual Hands

PubMed Central

Ossmy, Ori; Mukamel, Roy

2017-01-01

Visual feedback in general, and from the body in particular, is known to influence the performance of motor skills in humans. However, it is unclear how the acquisition of motor skills depends on specific visual feedback parameters such as the size of performing effector. Here, 21 healthy subjects physically trained to perform sequences of finger movements with their right hand. Through the use of 3D Virtual Reality devices, visual feedback during training consisted of virtual hands presented on the screen, tracking subject’s hand movements in real time. Importantly, the setup allowed us to manipulate the size of the displayed virtual hands across experimental conditions. We found that performance gains increase with the size of virtual hands. In contrast, when subjects trained by mere observation (i.e., in the absence of physical movement), manipulating the size of the virtual hand did not significantly affect subsequent performance gains. These results demonstrate that when it comes to short-term motor skill learning, the size of visual feedback matters. Furthermore, these results suggest that highest performance gains in individual subjects are achieved when the size of the virtual hand matches their real hand size. These results may have implications for optimizing motor training schemes. PMID:28056023

Effect of biased feedback on motor imagery learning in BCI-teleoperation system.

PubMed

Alimardani, Maryam; Nishio, Shuichi; Ishiguro, Hiroshi

2014-01-01

Feedback design is an important issue in motor imagery BCI systems. Regardless, to date it has not been reported how feedback presentation can optimize co-adaptation between a human brain and such systems. This paper assesses the effect of realistic visual feedback on users' BCI performance and motor imagery skills. We previously developed a tele-operation system for a pair of humanlike robotic hands and showed that BCI control of such hands along with first-person perspective visual feedback of movements can arouse a sense of embodiment in the operators. In the first stage of this study, we found that the intensity of this ownership illusion was associated with feedback presentation and subjects' performance during BCI motion control. In the second stage, we probed the effect of positive and negative feedback bias on subjects' BCI performance and motor imagery skills. Although the subject specific classifier, which was set up at the beginning of experiment, detected no significant change in the subjects' online performance, evaluation of brain activity patterns revealed that subjects' self-regulation of motor imagery features improved due to a positive bias of feedback and a possible occurrence of ownership illusion. Our findings suggest that in general training protocols for BCIs, manipulation of feedback can play an important role in the optimization of subjects' motor imagery skills.

OpinionSeer: interactive visualization of hotel customer feedback.

PubMed

Wu, Yingcai; Wei, Furu; Liu, Shixia; Au, Norman; Cui, Weiwei; Zhou, Hong; Qu, Huamin

2010-01-01

The rapid development of Web technology has resulted in an increasing number of hotel customers sharing their opinions on the hotel services. Effective visual analysis of online customer opinions is needed, as it has a significant impact on building a successful business. In this paper, we present OpinionSeer, an interactive visualization system that could visually analyze a large collection of online hotel customer reviews. The system is built on a new visualization-centric opinion mining technique that considers uncertainty for faithfully modeling and analyzing customer opinions. A new visual representation is developed to convey customer opinions by augmenting well-established scatterplots and radial visualization. To provide multiple-level exploration, we introduce subjective logic to handle and organize subjective opinions with degrees of uncertainty. Several case studies illustrate the effectiveness and usefulness of OpinionSeer on analyzing relationships among multiple data dimensions and comparing opinions of different groups. Aside from data on hotel customer feedback, OpinionSeer could also be applied to visually analyze customer opinions on other products or services.

Toward guidance of epicardial cardiac radiofrequency ablation therapy using optical coherence tomography

NASA Astrophysics Data System (ADS)

Fleming, Christine P.; Quan, Kara J.; Rollins, Andrew M.

2010-07-01

Radiofrequency ablation (RFA) is the standard of care to cure many cardiac arrhythmias. Epicardial ablation for the treatment of ventricular tachycardia has limited success rates due in part to the presence of epicardial fat, which prevents proper rf energy delivery, inadequate contact of ablation catheter with tissue, and increased likelihood of complications with energy delivery in close proximity to coronary vessels. A method to directly visualize the epicardial surface during RFA could potentially provide feedback to reduce complications and titrate rf energy dose by detecting critical structures, assessing probe contact, and confirming energy delivery by visualizing lesion formation. Currently, there is no technology available for direct visualization of the heart surface during epicardial RFA therapy. We demonstrate that optical coherence tomography (OCT) imaging has the potential to fill this unmet need. Spectral domain OCT at 1310 nm is employed to image the epicardial surface of freshly excised swine hearts using a microscope integrated bench-top scanner and a forward imaging catheter probe. OCT image features are observed that clearly distinguish untreated myocardium, ablation lesions, epicardial fat, and coronary vessels, and assess tissue contact with catheter-based imaging. These results support the potential for real-time guidance of epicardial RFA therapy using OCT imaging.

Hunger-Dependent Enhancement of Food Cue Responses in Mouse Postrhinal Cortex and Lateral Amygdala.

PubMed

Burgess, Christian R; Ramesh, Rohan N; Sugden, Arthur U; Levandowski, Kirsten M; Minnig, Margaret A; Fenselau, Henning; Lowell, Bradford B; Andermann, Mark L

2016-09-07

The needs of the body can direct behavioral and neural processing toward motivationally relevant sensory cues. For example, human imaging studies have consistently found specific cortical areas with biased responses to food-associated visual cues in hungry subjects, but not in sated subjects. To obtain a cellular-level understanding of these hunger-dependent cortical response biases, we performed chronic two-photon calcium imaging in postrhinal association cortex (POR) and primary visual cortex (V1) of behaving mice. As in humans, neurons in mouse POR, but not V1, exhibited biases toward food-associated cues that were abolished by satiety. This emergent bias was mirrored by the innervation pattern of amygdalo-cortical feedback axons. Strikingly, these axons exhibited even stronger food cue biases and sensitivity to hunger state and trial history. These findings highlight a direct pathway by which the lateral amygdala may contribute to state-dependent cortical processing of motivationally relevant sensory cues. Published by Elsevier Inc.

Technology-Based Feedback and Its Efficacy in Improving Gait Parameters in Patients with Abnormal Gait: A Systematic Review

PubMed Central

Chamorro-Moriana, Gema; Moreno, Antonio José

2018-01-01

This systematic review synthesized and analyzed clinical findings related to the effectiveness of innovative technological feedback for tackling functional gait recovery. An electronic search of PUBMED, PEDro, WOS, CINAHL, and DIALNET was conducted from January 2011 to December 2016. The main inclusion criteria were: patients with modified or abnormal gait; application of technology-based feedback to deal with functional recovery of gait; any comparison between different kinds of feedback applied by means of technology, or any comparison between technological and non-technological feedback; and randomized controlled trials. Twenty papers were included. The populations were neurological patients (75%), orthopedic and healthy subjects. All participants were adults, bar one. Four studies used exoskeletons, 6 load platforms and 5 pressure sensors. The breakdown of the type of feedback used was as follows: 60% visual, 40% acoustic and 15% haptic. 55% used terminal feedback versus 65% simultaneous feedback. Prescriptive feedback was used in 60% of cases, while 50% used descriptive feedback. 62.5% and 58.33% of the trials showed a significant effect in improving step length and speed, respectively. Efficacy in improving other gait parameters such as balance or range of movement is observed in more than 75% of the studies with significant outcomes. Conclusion: Treatments based on feedback using innovative technology in patients with abnormal gait are mostly effective in improving gait parameters and therefore useful for the functional recovery of patients. The most frequently highlighted types of feedback were immediate visual feedback followed by terminal and immediate acoustic feedback. PMID:29316645

Technology-Based Feedback and Its Efficacy in Improving Gait Parameters in Patients with Abnormal Gait: A Systematic Review.

PubMed

Chamorro-Moriana, Gema; Moreno, Antonio José; Sevillano, José Luis

2018-01-06

This systematic review synthesized and analyzed clinical findings related to the effectiveness of innovative technological feedback for tackling functional gait recovery. An electronic search of PUBMED, PEDro, WOS, CINAHL, and DIALNET was conducted from January 2011 to December 2016. The main inclusion criteria were: patients with modified or abnormal gait; application of technology-based feedback to deal with functional recovery of gait; any comparison between different kinds of feedback applied by means of technology, or any comparison between technological and non-technological feedback; and randomized controlled trials. Twenty papers were included. The populations were neurological patients (75%), orthopedic and healthy subjects. All participants were adults, bar one. Four studies used exoskeletons, 6 load platforms and 5 pressure sensors. The breakdown of the type of feedback used was as follows: 60% visual, 40% acoustic and 15% haptic. 55% used terminal feedback versus 65% simultaneous feedback. Prescriptive feedback was used in 60% of cases, while 50% used descriptive feedback. 62.5% and 58.33% of the trials showed a significant effect in improving step length and speed, respectively. Efficacy in improving other gait parameters such as balance or range of movement is observed in more than 75% of the studies with significant outcomes. Treatments based on feedback using innovative technology in patients with abnormal gait are mostly effective in improving gait parameters and therefore useful for the functional recovery of patients. The most frequently highlighted types of feedback were immediate visual feedback followed by terminal and immediate acoustic feedback.

Investigations of the pathogenesis of acquired pendular nystagmus

NASA Technical Reports Server (NTRS)

Averbuch-Heller, L.; Zivotofsky, A. Z.; Das, V. E.; DiScenna, A. O.; Leigh, R. J.

1995-01-01

We investigated the pathogenesis of acquired pendular nystagmus (APN) in six patients, three of whom had multiple sclerosis. First, we tested the hypothesis that the oscillations of APN are due to a delay in visual feedback secondary, for example, to demyelination of the optic nerves. We manipulated the latency to onset of visually guided eye movements using an electronic technique that induces sinusoidal oscillations in normal subjects. This manipulation did not change the characteristics of the APN, but did superimpose lower-frequency oscillations similar to those induced in normal subjects. These results are consistent with current models for smooth (non-saccadic) eye movements, which predict that prolongation of visual feedback could not account for the high-frequency oscillations that often characterize APN. Secondly, we attempted to determine whether an increase in the gain of the visually-enhanced vestibulo-ocular reflex (VOR), produced by viewing a near target, was accompanied by a commensurate increase in the amplitude of APN. Increases in horizontal or vertical VOR gain during near viewing occurred in four patients, but only two of them showed a parallel increase in APN amplitude. On the other hand, APN amplitude decreased during viewing of the near target in the two patients who showed no change in VOR gain. Taken together, these data suggest that neither delayed visual feedback nor a disorder of central vestibular mechanisms is primarily responsible for APN. More likely, these ocular oscillations are produced by abnormalities of internal feedback circuits, such as the reciprocal connections between brainstem nuclei and cerebellum.

Integrating sentiment analysis and term associations with geo-temporal visualizations on customer feedback streams

NASA Astrophysics Data System (ADS)

Hao, Ming; Rohrdantz, Christian; Janetzko, Halldór; Keim, Daniel; Dayal, Umeshwar; Haug, Lars-Erik; Hsu, Mei-Chun

2012-01-01

Twitter currently receives over 190 million tweets (small text-based Web posts) and manufacturing companies receive over 10 thousand web product surveys a day, in which people share their thoughts regarding a wide range of products and their features. A large number of tweets and customer surveys include opinions about products and services. However, with Twitter being a relatively new phenomenon, these tweets are underutilized as a source for determining customer sentiments. To explore high-volume customer feedback streams, we integrate three time series-based visual analysis techniques: (1) feature-based sentiment analysis that extracts, measures, and maps customer feedback; (2) a novel idea of term associations that identify attributes, verbs, and adjectives frequently occurring together; and (3) new pixel cell-based sentiment calendars, geo-temporal map visualizations and self-organizing maps to identify co-occurring and influential opinions. We have combined these techniques into a well-fitted solution for an effective analysis of large customer feedback streams such as for movie reviews (e.g., Kung-Fu Panda) or web surveys (buyers).

Evaluation of Augmented Reality Feedback in Surgical Training Environment.

PubMed

Zahiri, Mohsen; Nelson, Carl A; Oleynikov, Dmitry; Siu, Ka-Chun

2018-02-01

Providing computer-based laparoscopic surgical training has several advantages that enhance the training process. Self-evaluation and real-time performance feedback are 2 of these advantages, which avoid dependency of trainees on expert feedback. The goal of this study was to investigate the use of a visual time indicator as real-time feedback correlated with the laparoscopic surgical training. Twenty novices participated in this study working with (and without) different presentations of time indicators. They performed a standard peg transfer task, and their completion times and muscle activity were recorded and compared. Also of interest was whether the use of this type of feedback induced any side effect in terms of motivation or muscle fatigue. Of the 20 participants, 15 (75%) preferred using a time indicator in the training process rather than having no feedback. However, time to task completion showed no significant difference in performance with the time indicator; furthermore, no significant differences in muscle activity or muscle fatigue were detected with/without time feedback. The absence of significant difference between task performance with/without time feedback shows that using visual real-time feedback can be included in surgical training based on user preference. Trainees may benefit from this type of feedback in the form of increased motivation. The extent to which this can influence training frequency leading to performance improvement is a question for further study.

Direct cortical control of 3D neuroprosthetic devices.

PubMed

Taylor, Dawn M; Tillery, Stephen I Helms; Schwartz, Andrew B

2002-06-07

Three-dimensional (3D) movement of neuroprosthetic devices can be controlled by the activity of cortical neurons when appropriate algorithms are used to decode intended movement in real time. Previous studies assumed that neurons maintain fixed tuning properties, and the studies used subjects who were unaware of the movements predicted by their recorded units. In this study, subjects had real-time visual feedback of their brain-controlled trajectories. Cell tuning properties changed when used for brain-controlled movements. By using control algorithms that track these changes, subjects made long sequences of 3D movements using far fewer cortical units than expected. Daily practice improved movement accuracy and the directional tuning of these units.

Feedback of personal retinal images appears to have a motivational impact in people with non-proliferative diabetic retinopathy and suboptimal HbA1c: findings of a pilot study.

PubMed

Rees, G; Lamoureux, E L; Nicolaou, T E; Hodgson, L A B; Weinman, J; Speight, J

2013-09-01

To conduct a pilot study to explore the potential impact of visual feedback of personal retinal images on diabetes outcomes. Twenty-five participants with non-proliferative diabetic retinopathy and suboptimal HbA(1c) (> 53 mmol/mol; > 7%) were randomized to receive visual feedback of their own retinal images or to a control group. At baseline and 3-month follow-up, HbA(1c), standard measures of beliefs, diabetes-related distress and self-care activities were assessed. In unadjusted models, relative to controls, the intervention group showed significantly greater improvement in HbA(1c) at 3-month follow-up (-0.6% vs. +0.3%, P < 0.01), as well as enhanced motivation to improve blood glucose management (P < 0.05). This small pilot study provides preliminary evidence that visual feedback of personal retinal images may offer a practical educational strategy for clinicians in eye care services to improve diabetes outcomes in non-target compliant patients. A fully powered randomized controlled trial is required to confirm these findings and determine the optimal use of feedback to produce sustained effects. © 2013 The Authors. Diabetic Medicine © 2013 Diabetes UK.

Visual feedback training using WII Fit improves balance in Parkinson's disease.

PubMed

Zalecki, Tomasz; Gorecka-Mazur, Agnieszka; Pietraszko, Wojciech; Surowka, Artur D; Novak, Pawel; Moskala, Marek; Krygowska-Wajs, Anna

2013-01-01

Postural instability including imbalance is the most disabling long term problem in Parkinson's disease (PD) that does not respond to pharmacotherapy. This study aimed at investigating the effectiveness of a novel visual-feedback training method, using Wii Fit balance board in improving balance in patients with PD. Twenty four patients with moderate PD were included in the study which comprised of a 6-week home-based balance training program using Nintendo Wii Fit and balance board. The PD patients significantly improved their results in Berg Balance Scale, Tinnet's Performance-Oriented Mobility Assessment, Timed Up-and-Go, Sit-to-stand test, 10-Meter Walk test and Activities-specific Balance Confidence scale at the end of the programme. This study suggests that visual feedback training using Wii-Fit with balance board could improve dynamic and functional balance as well as motor disability in PD patients.

Prosody production networks are modulated by sensory cues and social context.

PubMed

Klasen, Martin; von Marschall, Clara; Isman, Güldehen; Zvyagintsev, Mikhail; Gur, Ruben C; Mathiak, Klaus

2018-03-05

The neurobiology of emotional prosody production is not well investigated. In particular, the effects of cues and social context are not known. The present study sought to differentiate cued from free emotion generation and the effect of social feedback from a human listener. Online speech filtering enabled fMRI during prosodic communication in 30 participants. Emotional vocalizations were a) free, b) auditorily cued, c) visually cued, or d) with interactive feedback. In addition to distributed language networks, cued emotions increased activity in auditory and - in case of visual stimuli - visual cortex. Responses were larger in pSTG at the right hemisphere and the ventral striatum when participants were listened to and received feedback from the experimenter. Sensory, language, and reward networks contributed to prosody production and were modulated by cues and social context. The right pSTG is a central hub for communication in social interactions - in particular for interpersonal evaluation of vocal emotions.

Vibrotactile Feedbacks System for Assisting the Physically Impaired Persons for Easy Navigation

NASA Astrophysics Data System (ADS)

Safa, M.; Geetha, G.; Elakkiya, U.; Saranya, D.

2018-04-01

NAYAN architecture is for a visually impaired person to help for navigation. As well known, all visually impaired people desperately requires special requirements even to access services like the public transportation. This prototype system is a portable device; it is so easy to carry in any conduction to travel through a familiar and unfamiliar environment. The system consists of GPS receiver and it can get NEMA data through the satellite and it is provided to user's Smartphone through Arduino board. This application uses two vibrotactile feedbacks that will be placed in the left and right shoulder for vibration feedback, which gives information about the current location. The ultrasonic sensor is used for obstacle detection which is found in front of the visually impaired person. The Bluetooth modules connected with Arduino board is to send information to the user's mobile phone which it receives from GPS.

Adaptive strategies of remote systems operators exposed to perturbed camera-viewing conditions

NASA Technical Reports Server (NTRS)

Stuart, Mark A.; Manahan, Meera K.; Bierschwale, John M.; Sampaio, Carlos E.; Legendre, A. J.

1991-01-01

This report describes a preliminary investigation of the use of perturbed visual feedback during the performance of simulated space-based remote manipulation tasks. The primary objective of this NASA evaluation was to determine to what extent operators exhibit adaptive strategies which allow them to perform these specific types of remote manipulation tasks more efficiently while exposed to perturbed visual feedback. A secondary objective of this evaluation was to establish a set of preliminary guidelines for enhancing remote manipulation performance and reducing the adverse effects. These objectives were accomplished by studying the remote manipulator performance of test subjects exposed to various perturbed camera-viewing conditions while performing a simulated space-based remote manipulation task. Statistical analysis of performance and subjective data revealed that remote manipulation performance was adversely affected by the use of perturbed visual feedback and performance tended to improve with successive trials in most perturbed viewing conditions.

On the Adaptation of Pelvic Motion by Applying 3-dimensional Guidance Forces Using TPAD.

PubMed

Kang, Jiyeon; Vashista, Vineet; Agrawal, Sunil K

2017-09-01

Pelvic movement is important to human locomotion as the center of mass is located near the center of pelvis. Lateral pelvic motion plays a crucial role to shift the center of mass on the stance leg, while swinging the other leg and keeping the body balanced. In addition, vertical pelvic movement helps to reduce metabolic energy expenditure by exchanging potential and kinetic energy during the gait cycle. However, patient groups with cerebral palsy or stroke have excessive pelvic motion that leads to high energy expenditure. In addition, they have higher chances of falls as the center ofmass could deviate outside the base of support. In this paper, a novel control method is suggested using tethered pelvic assist device (TPAD) to teach subjects to walk with a specified target pelvic trajectory while walking on a treadmill. In this method, a force field is applied to the pelvis to guide it to move on a target trajectory and correctional forces are applied, if the pelvis motion has excessive deviations from the target trajectory. Three different experimentswith healthy subjects were conducted to teach them to walk on a new target pelvic trajectory with the presented control method. For all three experiments, the baseline trajectory of the pelvis was experimentally determined for each participating subject. To design a target pelvic trajectory which is different from the baseline, Experiment I scaled up the lateral component of the baseline pelvic trajectory, while Experiment II scaled down the lateral component of the baseline trajectory. For both Experiments I and II, the controller generated a 2-D force field in the transverse plane to provide the guidance force. In this paper, seven subjects were recruited for each experiment who walked on the treadmill with suggested control methods and visual feedback of their pelvic trajectory. The results show that the subjects were able to learn the target pelvic trajectory in each experiment and also retained the training effects after the completion of the experiment. In Experiment III, both lateral and vertical components of the pelvic trajectory were scaled down from the baseline trajectory. The force field was extended to three dimensions in order to correct the vertical pelvic movement as well. Three subgroups (force feedback alone, visual feedback alone, and both force and visual feedback) were recruited to understand the effects of force feedback and visual feedback alone to distinguish the results from Experiments I and II. The results showthat a trainingmethod that combines visual and force feedback is superior to the training methods with visual or force feedback alone. We believe that the present control strategy holds potential in training and correcting abnormal pelvic movements in different patient populations.

Removing own-limb visual input using mixed reality (MR) produces a "telescoping" illusion in healthy individuals.

PubMed

Thøgersen, Mikkel; Hansen, John; Arendt-Nielsen, Lars; Flor, Herta; Petrini, Laura

2018-07-16

The purpose of the present study was to assess changes in body perception when visual feedback was removed from the hand and arm with the purpose of resembling the visual deprivation arising from amputation. The illusion was created by removing the visual feedback from the participants' own left forearm using a mixed reality (MR) and green screen environment. Thirty healthy persons (15 female) participated in the study. Each subject experienced two MR conditions, one with and one without visual feedback from the left hand, and a baseline condition with normal vision of the limb (no MR). Body perception was assessed using proprioceptive drift, questionnaires on body perception, and thermal sensitivity measures (cold, warm, heat pain and cold pain detection thresholds). The proprioceptive drift showed a significant shift of the tip of the index finger (p<0.001) towards the elbow in the illusion condition (mean drift: -3.71 cm). Self-report showed a significant decrease in ownership (p<0.001), shift in perceptual distortions, (e.g. "It feels as if my lower arm has become shorter") (p=0.025), and changes in sensations of the hand (tingling, tickling) (p=0.025). A significant decrease was also observed in cold detection threshold (p<0.001), i.e. the detection threshold was cooler than for the control conditions. The proprioceptive drift together with the self-reported questionnaire showed that the participants felt a proximal retraction of their limb, resembling the telescoping experienced by phantom limb patients. The study highlights the influence of missing visual feedback and its possible contribution to phantom limb phenomena. Copyright © 2018 Elsevier B.V. All rights reserved.

Dormitory Residents Reduce Electricity Consumption when Exposed to Real-Time Visual Feedback and Incentives

ERIC Educational Resources Information Center

Petersen, John E.; Shunturov, Vladislav; Janda, Kathryn; Platt, Gavin; Weinberger, Kate

2007-01-01

Purpose: In residential buildings, personal choices influence electricity and water consumption. Prior studies indicate that information feedback can stimulate resource conservation. College dormitories provide an excellent venue for controlled study of the effects of feedback. The goal of this study is to assess how different resolutions of…

Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study.

PubMed

Gonzalez, Jose; Soma, Hirokazu; Sekine, Masashi; Yu, Wenwei

2012-06-09

Prosthetic hand users have to rely extensively on visual feedback, which seems to lead to a high conscious burden for the users, in order to manipulate their prosthetic devices. Indirect methods (electro-cutaneous, vibrotactile, auditory cues) have been used to convey information from the artificial limb to the amputee, but the usability and advantages of these feedback methods were explored mainly by looking at the performance results, not taking into account measurements of the user's mental effort, attention, and emotions. The main objective of this study was to explore the feasibility of using psycho-physiological measurements to assess cognitive effort when manipulating a robot hand with and without the usage of a sensory substitution system based on auditory feedback, and how these psycho-physiological recordings relate to temporal and grasping performance in a static setting. 10 male subjects (26+/-years old), participated in this study and were asked to come for 2 consecutive days. On the first day the experiment objective, tasks, and experiment setting was explained. Then, they completed a 30 minutes guided training. On the second day each subject was tested in 3 different modalities: Auditory Feedback only control (AF), Visual Feedback only control (VF), and Audiovisual Feedback control (AVF). For each modality they were asked to perform 10 trials. At the end of each test, the subject had to answer the NASA TLX questionnaire. Also, during the test the subject's EEG, ECG, electro-dermal activity (EDA), and respiration rate were measured. The results show that a higher mental effort is needed when the subjects rely only on their vision, and that this effort seems to be reduced when auditory feedback is added to the human-machine interaction (multimodal feedback). Furthermore, better temporal performance and better grasping performance was obtained in the audiovisual modality. The performance improvements when using auditory cues, along with vision (multimodal feedback), can be attributed to a reduced attentional demand during the task, which can be attributed to a visual "pop-out" or enhance effect. Also, the NASA TLX, the EEG's Alpha and Beta band, and the Heart Rate could be used to further evaluate sensory feedback systems in prosthetic applications.

The effect of force feedback on student reasoning about gravity, mass, force and motion

NASA Astrophysics Data System (ADS)

Bussell, Linda

The purpose of this study was to examine whether force feedback within a computer simulation had an effect on reasoning by fifth grade students about gravity, mass, force, and motion, concepts which can be difficult for learners to grasp. Few studies have been done on cognitive learning and haptic feedback, particularly with young learners, but there is an extensive base of literature on children's conceptions of science and a number of studies focus specifically on children's conceptions of force and motion. This case study used a computer-based paddleball simulation with guided inquiry as the primary stimulus. Within the simulation, the learner could adjust the mass of the ball and the gravitational force. The experimental group used the simulation with visual and force feedback; the control group used the simulation with visual feedback but without force feedback. The proposition was that there would be differences in reasoning between the experimental and control groups, with force feedback being helpful with concepts that are more obvious when felt. Participants were 34 fifth-grade students from three schools. Students completed a modal (visual, auditory, and haptic) learning preference assessment and a pretest. The sessions, including participant experimentation and interviews, were audio recorded and observed. The interviews were followed by a written posttest. These data were analyzed to determine whether there were differences based on treatment, learning style, demographics, prior gaming experience, force feedback experience, or prior knowledge. Work with the simulation, regardless of group, was found to increase students' understanding of key concepts. The experimental group appeared to benefit from the supplementary help that force feedback provided. Those in the experimental group scored higher on the posttest than those in the control group. The greatest difference between mean group scores was on a question concerning the effects of increased gravitational force.

A cognitive neuroprosthetic that uses cortical stimulation for somatosensory feedback.

PubMed

Klaes, Christian; Shi, Ying; Kellis, Spencer; Minxha, Juri; Revechkis, Boris; Andersen, Richard A

2014-10-01

Present day cortical brain-machine interfaces (BMIs) have made impressive advances using decoded brain signals to control extracorporeal devices. Although BMIs are used in a closed-loop fashion, sensory feedback typically is visual only. However medical case studies have shown that the loss of somesthesis in a limb greatly reduces the agility of the limb even when visual feedback is available. To overcome this limitation, this study tested a closed-loop BMI that utilizes intracortical microstimulation to provide 'tactile' sensation to a non-human primate. Using stimulation electrodes in Brodmann area 1 of somatosensory cortex (BA1) and recording electrodes in the anterior intraparietal area, the parietal reach region and dorsal area 5 (area 5d), it was found that this form of feedback can be used in BMI tasks. Providing somatosensory feedback has the poyential to greatly improve the performance of cognitive neuroprostheses especially for fine control and object manipulation. Adding stimulation to a BMI system could therefore improve the quality of life for severely paralyzed patients.

Programming of left hand exploits task set but that of right hand depends on recent history.

PubMed

Tang, Rixin; Zhu, Hong

2017-07-01

There are many differences between the left hand and the right hand. But it is not clear if there is a difference in programming between left hand and right hand when the hands perform the same movement. In current study, we carried out two experiments to investigate whether the programming of two hands was equivalent or they exploited different strategies. In the first experiment, participants were required to use one hand to grasp an object with visual feedback or to point to the center of one object without visual feedback on alternate trials, or to grasp an object without visual feedback and to point the center of one object with visual feedback on alternating trials. They then performed the tasks with the other hand. The result was that previous pointing task affected current grasping when it was performed by the left hand, but not the right hand. In experiment 2, we studied if the programming of the left (or right) hand would be affected by the pointing task performed on the previous trial not only by the same hand, but also by the right (or left) hand. Participants pointed and grasped the objects alternately with two hands. The result was similar with Experiment 1, i.e., left-hand grasping was affected by right-hand pointing, whereas right-hand grasping was immune from the interference from left hand. Taken together, the results suggest that when open- and closed-loop trials are interleaved, motor programming of grasping with the right hand was affected by the nature of the online feedback on the previous trial only if it was a grasping trial, suggesting that the trial-to-trial transfer depends on sensorimotor memory and not on task set. In contrast, motor programming of grasping with the left hand can use information about the nature of the online feedback on the previous trial to specify the parameters of the movement, even when the type of movement that occurred was quite different (i.e., pointing) and was performed with the right hand. This suggests that trial-to-trial transfer with the left hand depends on some sort of carry-over of task set for dealing with the availability of visual feedback.

Visually induced analgesia in a deep tissue experimental pain model: A randomised crossover experiment.

PubMed

van Selm, M J; Gibson, W I; Travers, M J; Moseley, G L; Hince, D; Wand, B M

2018-04-20

Visualizing one's own painful body part appears to have an effect on reported pain intensity. Furthermore, it seems that manipulating the size of the viewed image can determine the direction and extent of this phenomenon. When visual distortion has been applied to clinical populations, the analgesic effects have been in opposition to those observed in some experimental pain models. To help resolve this problem, we explored the effect of visualisation and magnification of the visual image on reported pain using a delayed onset muscle soreness (DOMS) pain model. We induced DOMS in the quadriceps of 20 healthy volunteers. Forty-eight hours later, participants performed a series of painful contractions of the DOMS-affected muscle under four randomised conditions: (1) Viewing the injured thigh; (2) Viewing the contralateral thigh; (3) Viewing a neutral object; and (4) Viewing the injured thigh through magnifying glasses. For each condition, participants rated their pain intensity during a series of painful contractions. We observed that direct visualisation of the injured thigh had no effect on pain intensity when compared to viewing the contralateral thigh or neutral object. However, magnification of the DOMS-affected leg during the performance of painful contractions caused participants to report more pain than when viewing the injured thigh normally. These results further demonstrate that the effect of visualisation varies between different pain conditions. These results may have implications for the integration of visual feedback into clinical practice. We present delayed onset muscle soreness as a model for exploring visually induced analgesia. Our findings suggest that this phenomenon is expressed differently in exogenous and endogenous experimental pain models. Further exploration may offer a potential pathway for the integration of visual analgesia into the management of clinical pain. © 2018 European Pain Federation - EFIC®.

Brain-computer interface: changes in performance using virtual reality techniques.

PubMed

Ron-Angevin, Ricardo; Díaz-Estrella, Antonio

2009-01-09

The ability to control electroencephalographic (EEG) signals when different mental tasks are carried out would provide a method of communication for people with serious motor function problems. This system is known as a brain-computer interface (BCI). Due to the difficulty of controlling one's own EEG signals, a suitable training protocol is required to motivate subjects, as it is necessary to provide some type of visual feedback allowing subjects to see their progress. Conventional systems of feedback are based on simple visual presentations, such as a horizontal bar extension. However, virtual reality is a powerful tool with graphical possibilities to improve BCI-feedback presentation. The objective of the study is to explore the advantages of the use of feedback based on virtual reality techniques compared to conventional systems of feedback. Sixteen untrained subjects, divided into two groups, participated in the experiment. A group of subjects was trained using a BCI system, which uses conventional feedback (bar extension), and another group was trained using a BCI system, which submits subjects to a more familiar environment, such as controlling a car to avoid obstacles. The obtained results suggest that EEG behaviour can be modified via feedback presentation. Significant differences in classification error rates between both interfaces were obtained during the feedback period, confirming that an interface based on virtual reality techniques can improve the feedback control, specifically for untrained subjects.

The role of attention in figure-ground segregation in areas V1 and V4 of the visual cortex.

PubMed

Poort, Jasper; Raudies, Florian; Wannig, Aurel; Lamme, Victor A F; Neumann, Heiko; Roelfsema, Pieter R

2012-07-12

Our visual system segments images into objects and background. Figure-ground segregation relies on the detection of feature discontinuities that signal boundaries between the figures and the background and on a complementary region-filling process that groups together image regions with similar features. The neuronal mechanisms for these processes are not well understood and it is unknown how they depend on visual attention. We measured neuronal activity in V1 and V4 in a task where monkeys either made an eye movement to texture-defined figures or ignored them. V1 activity predicted the timing and the direction of the saccade if the figures were task relevant. We found that boundary detection is an early process that depends little on attention, whereas region filling occurs later and is facilitated by visual attention, which acts in an object-based manner. Our findings are explained by a model with local, bottom-up computations for boundary detection and feedback processing for region filling. Copyright © 2012 Elsevier Inc. All rights reserved.

In Flight Evaluation of Active Inceptor Force-Feel Characteristics and Handling Qualities

DTIC Science & Technology

2012-05-01

DEGRADED ACCEPTABLE Mitchell Aponso (1995) Watson Schroeder (1990) 0.75 lb/in 2.3 lb/in2.9 lb/in5.9 lb/in Side Stk - lon Side Stk - lat Center Stk Figure...vestibular feedback ( and respectively), and the visual error compensation ( ). A key feature of this approach is the modeling of proprioceptive...and vestibular feedback, and is the proportional component of the visual compensation strategy. At its core the fundamental concept of the HQSF

Memory-guided force output is associated with self-reported ADHD symptoms in young adults.

PubMed

Neely, Kristina A; Chennavasin, Amanda P; Yoder, Arie; Williams, Genevieve K R; Loken, Eric; Huang-Pollock, Cynthia L

2016-11-01

Attention-deficit/hyperactivity disorder (ADHD) is the most commonly diagnosed mental health disorder in childhood and persists into adulthood in up to 65 % of cases. ADHD is associated with adverse outcomes such as the ability to gain and maintain employment and is associated with an increased risk for substance abuse obesity workplace injuries and traffic accidents A majority of diagnosed children have motor deficits; however, few studies have examined motor deficits in young adults. This study provides a novel examination of visuomotor control of grip force in young adults with and without ADHD. Participants were instructed to maintain force production over a 20-second trial with and without real-time visual feedback about their performance. The results demonstrated that when visual feedback was available, adults with ADHD produced slightly higher grip force than controls. However, when visual feedback was removed, adults with ADHD had a faster rate of decay of force, which was associated with ADHD symptom severity and trait impulsivity. These findings suggest that there may be important differences in the way that adults with ADHD integrate visual feedback during continuous motor tasks. These may account for some of the motor impairments reported in children with ADHD. These deficits could result from (1) dysfunctional sensory motor integration and/or (2) deficits in short-term visuomotor memory.

Processing speed in recurrent visual networks correlates with general intelligence.

PubMed

Jolij, Jacob; Huisman, Danielle; Scholte, Steven; Hamel, Ronald; Kemner, Chantal; Lamme, Victor A F

2007-01-08

Studies on the neural basis of general fluid intelligence strongly suggest that a smarter brain processes information faster. Different brain areas, however, are interconnected by both feedforward and feedback projections. Whether both types of connections or only one of the two types are faster in smarter brains remains unclear. Here we show, by measuring visual evoked potentials during a texture discrimination task, that general fluid intelligence shows a strong correlation with processing speed in recurrent visual networks, while there is no correlation with speed of feedforward connections. The hypothesis that a smarter brain runs faster may need to be refined: a smarter brain's feedback connections run faster.

Monocular Patching May Induce Ipsilateral “Where” Spatial Bias

PubMed Central

Chen, Peii; Erdahl, Lillian; Barrett, Anna M.

2009-01-01

Spatial bias is an asymmetry of perception and/or representation of spatial information —“where” bias —, or of spatially directed actions — “aiming” bias. A monocular patch may induce contralateral “where” spatial bias (the Sprague effect; Sprague (1966) Science, 153, 1544–1547). However, an ipsilateral patch-induced spatial bias may be observed if visual occlusion results in top-down, compensatory re-allocation of spatial perceptual or representational resources toward the region of visual deprivation. Tactile distraction from a monocular patch may also contribute to an ipsilateral bias. To examine these hypotheses, neurologically normal adults bisected horizontal lines at baseline without a patch, while wearing a monocular patch, and while wearing tactile-only and visual-only monocular occlusion. We fractionated “where” and “aiming” spatial bias components using a video apparatus to reverse visual feedback for half of the test trials. The results support monocular patch-induced ipsilateral “where” spatial errors, which are not consistent with the Sprague effect. Further, the present findings suggested that the induced ipsilateral bias may be primarily induced by visual deprivation, consistent with compensatory “where” resource re-allocation. PMID:19100274

Analysis of User Interaction with a Brain-Computer Interface Based on Steady-State Visually Evoked Potentials: Case Study of a Game

PubMed Central

de Carvalho, Sarah Negreiros; Costa, Thiago Bulhões da Silva; Attux, Romis; Hornung, Heiko Horst; Arantes, Dalton Soares

2018-01-01

This paper presents a systematic analysis of a game controlled by a Brain-Computer Interface (BCI) based on Steady-State Visually Evoked Potentials (SSVEP). The objective is to understand BCI systems from the Human-Computer Interface (HCI) point of view, by observing how the users interact with the game and evaluating how the interface elements influence the system performance. The interactions of 30 volunteers with our computer game, named “Get Coins,” through a BCI based on SSVEP, have generated a database of brain signals and the corresponding responses to a questionnaire about various perceptual parameters, such as visual stimulation, acoustic feedback, background music, visual contrast, and visual fatigue. Each one of the volunteers played one match using the keyboard and four matches using the BCI, for comparison. In all matches using the BCI, the volunteers achieved the goals of the game. Eight of them achieved a perfect score in at least one of the four matches, showing the feasibility of the direct communication between the brain and the computer. Despite this successful experiment, adaptations and improvements should be implemented to make this innovative technology accessible to the end user. PMID:29849549

Visualizing Complex Environments in the Geo- and BioSciences

NASA Astrophysics Data System (ADS)

Prabhu, A.; Fox, P. A.; Zhong, H.; Eleish, A.; Ma, X.; Zednik, S.; Morrison, S. M.; Moore, E. K.; Muscente, D.; Meyer, M.; Hazen, R. M.

2017-12-01

Earth's living and non-living components have co-evolved for 4 billion years through numerous positive and negative feedbacks. Earth and life scientists have amassed vast amounts of data in diverse fields related to planetary evolution through deep time-mineralogy and petrology, paleobiology and paleontology, paleotectonics and paleomagnetism, geochemistry and geochrononology, genomics and proteomics, and more. Integrating the data from these complimentary disciplines is very useful in gaining an understanding of the evolution of our planet's environment. The integrated data however, represent many extremely complex environments. In order to gain insights and make discoveries using this data, it is important for us to model and visualize these complex environments. As part of work in understanding the "Co-Evolution of Geo and Biospheres using Data Driven Methodologies," we have developed several visualizations to help represent the information stored in the datasets from complimentary disciplines. These visualizations include 2D and 3D force directed Networks, Chord Diagrams, 3D Klee Diagrams. Evolving Network Diagrams, Skyline Diagrams and Tree Diagrams. Combining these visualizations with the results of machine learning and data analysis methods leads to a powerful way to discover patterns and relationships about the Earth's past and today's changing environment.

Analysis of User Interaction with a Brain-Computer Interface Based on Steady-State Visually Evoked Potentials: Case Study of a Game.

PubMed

Leite, Harlei Miguel de Arruda; de Carvalho, Sarah Negreiros; Costa, Thiago Bulhões da Silva; Attux, Romis; Hornung, Heiko Horst; Arantes, Dalton Soares

2018-01-01

This paper presents a systematic analysis of a game controlled by a Brain-Computer Interface (BCI) based on Steady-State Visually Evoked Potentials (SSVEP). The objective is to understand BCI systems from the Human-Computer Interface (HCI) point of view, by observing how the users interact with the game and evaluating how the interface elements influence the system performance. The interactions of 30 volunteers with our computer game, named "Get Coins," through a BCI based on SSVEP, have generated a database of brain signals and the corresponding responses to a questionnaire about various perceptual parameters, such as visual stimulation, acoustic feedback, background music, visual contrast, and visual fatigue. Each one of the volunteers played one match using the keyboard and four matches using the BCI, for comparison. In all matches using the BCI, the volunteers achieved the goals of the game. Eight of them achieved a perfect score in at least one of the four matches, showing the feasibility of the direct communication between the brain and the computer. Despite this successful experiment, adaptations and improvements should be implemented to make this innovative technology accessible to the end user.

Error amplification to promote motor learning and motivation in therapy robotics.

PubMed

Shirzad, Navid; Van der Loos, H F Machiel

2012-01-01

To study the effects of different feedback error amplification methods on a subject's upper-limb motor learning and affect during a point-to-point reaching exercise, we developed a real-time controller for a robotic manipulandum. The reaching environment was visually distorted by implementing a thirty degrees rotation between the coordinate systems of the robot's end-effector and the visual display. Feedback error amplification was provided to subjects as they trained to learn reaching within the visually rotated environment. Error amplification was provided either visually or through both haptic and visual means, each method with two different amplification gains. Subjects' performance (i.e., trajectory error) and self-reports to a questionnaire were used to study the speed and amount of adaptation promoted by each error amplification method and subjects' emotional changes. We found that providing haptic and visual feedback promotes faster adaptation to the distortion and increases subjects' satisfaction with the task, leading to a higher level of attentiveness during the exercise. This finding can be used to design a novel exercise regimen, where alternating between error amplification methods is used to both increase a subject's motor learning and maintain a minimum level of motivational engagement in the exercise. In future experiments, we will test whether such exercise methods will lead to a faster learning time and greater motivation to pursue a therapy exercise regimen.

Corticocortical feedback increases the spatial extent of normalization.

PubMed

Nassi, Jonathan J; Gómez-Laberge, Camille; Kreiman, Gabriel; Born, Richard T

2014-01-01

Normalization has been proposed as a canonical computation operating across different brain regions, sensory modalities, and species. It provides a good phenomenological description of non-linear response properties in primary visual cortex (V1), including the contrast response function and surround suppression. Despite its widespread application throughout the visual system, the underlying neural mechanisms remain largely unknown. We recently observed that corticocortical feedback contributes to surround suppression in V1, raising the possibility that feedback acts through normalization. To test this idea, we characterized area summation and contrast response properties in V1 with and without feedback from V2 and V3 in alert macaques and applied a standard normalization model to the data. Area summation properties were well explained by a form of divisive normalization, which computes the ratio between a neuron's driving input and the spatially integrated activity of a "normalization pool." Feedback inactivation reduced surround suppression by shrinking the spatial extent of the normalization pool. This effect was independent of the gain modulation thought to mediate the influence of contrast on area summation, which remained intact during feedback inactivation. Contrast sensitivity within the receptive field center was also unaffected by feedback inactivation, providing further evidence that feedback participates in normalization independent of the circuit mechanisms involved in modulating contrast gain and saturation. These results suggest that corticocortical feedback contributes to surround suppression by increasing the visuotopic extent of normalization and, via this mechanism, feedback can play a critical role in contextual information processing.

Corticocortical feedback increases the spatial extent of normalization

PubMed Central

Nassi, Jonathan J.; Gómez-Laberge, Camille; Kreiman, Gabriel; Born, Richard T.

2014-01-01

Normalization has been proposed as a canonical computation operating across different brain regions, sensory modalities, and species. It provides a good phenomenological description of non-linear response properties in primary visual cortex (V1), including the contrast response function and surround suppression. Despite its widespread application throughout the visual system, the underlying neural mechanisms remain largely unknown. We recently observed that corticocortical feedback contributes to surround suppression in V1, raising the possibility that feedback acts through normalization. To test this idea, we characterized area summation and contrast response properties in V1 with and without feedback from V2 and V3 in alert macaques and applied a standard normalization model to the data. Area summation properties were well explained by a form of divisive normalization, which computes the ratio between a neuron's driving input and the spatially integrated activity of a “normalization pool.” Feedback inactivation reduced surround suppression by shrinking the spatial extent of the normalization pool. This effect was independent of the gain modulation thought to mediate the influence of contrast on area summation, which remained intact during feedback inactivation. Contrast sensitivity within the receptive field center was also unaffected by feedback inactivation, providing further evidence that feedback participates in normalization independent of the circuit mechanisms involved in modulating contrast gain and saturation. These results suggest that corticocortical feedback contributes to surround suppression by increasing the visuotopic extent of normalization and, via this mechanism, feedback can play a critical role in contextual information processing. PMID:24910596

Topological analysis of metabolic control.

PubMed

Sen, A K

1990-12-01

A topological approach is presented for the analysis of control and regulation in metabolic pathways. In this approach, the control structure of a metabolic pathway is represented by a weighted directed graph. From an inspection of the topology of the graph, the control coefficients of the enzymes are evaluated in a heuristic manner in terms of the enzyme elasticities. The major advantage of the topological approach is that it provides a visual framework for (1) calculating the control coefficients of the enzymes, (2) analyzing the cause-effect relationships of the individual enzymes, (3) assessing the relative importance of the enzymes in metabolic regulation, and (4) simplifying the structure of a given pathway, from a regulatory viewpoint. Results are obtained for (a) an unbranched pathway in the absence of feedback the feedforward regulation and (b) an unbranched pathway with feedback inhibition. Our formulation is based on the metabolic control theory of Kacser and Burns (1973) and Heinrich and Rapoport (1974).

Variations in Static Force Control and Motor Unit Behavior with Error Amplification Feedback in the Elderly.

PubMed

Chen, Yi-Ching; Lin, Linda L; Lin, Yen-Ting; Hu, Chia-Ling; Hwang, Ing-Shiou

2017-01-01

Error amplification (EA) feedback is a promising approach to advance visuomotor skill. As error detection and visuomotor processing at short time scales decline with age, this study examined whether older adults could benefit from EA feedback that included higher-frequency information to guide a force-tracking task. Fourteen young and 14 older adults performed low-level static isometric force-tracking with visual guidance of typical visual feedback and EA feedback containing augmented high-frequency errors. Stabilogram diffusion analysis was used to characterize force fluctuation dynamics. Also, the discharge behaviors of motor units and pooled motor unit coherence were assessed following the decomposition of multi-channel surface electromyography (EMG). EA produced different behavioral and neurophysiological impacts on young and older adults. Older adults exhibited inferior task accuracy with EA feedback than with typical visual feedback, but not young adults. Although stabilogram diffusion analysis revealed that EA led to a significant decrease in critical time points for both groups, EA potentiated the critical point of force fluctuations [Formula: see text], short-term effective diffusion coefficients (Ds), and short-term exponent scaling only for the older adults. Moreover, in older adults, EA added to the size of discharge variability of motor units and discharge regularity of cumulative discharge rate, but suppressed the pooled motor unit coherence in the 13-35 Hz band. Virtual EA alters the strategic balance between open-loop and closed-loop controls for force-tracking. Contrary to expectations, the prevailing use of closed-loop control with EA that contained high-frequency error information enhanced the motor unit discharge variability and undermined the force steadiness in the older group, concerning declines in physiological complexity in the neurobehavioral system and the common drive to the motoneuronal pool against force destabilization.

Variations in Static Force Control and Motor Unit Behavior with Error Amplification Feedback in the Elderly

PubMed Central

Chen, Yi-Ching; Lin, Linda L.; Lin, Yen-Ting; Hu, Chia-Ling; Hwang, Ing-Shiou

2017-01-01

Error amplification (EA) feedback is a promising approach to advance visuomotor skill. As error detection and visuomotor processing at short time scales decline with age, this study examined whether older adults could benefit from EA feedback that included higher-frequency information to guide a force-tracking task. Fourteen young and 14 older adults performed low-level static isometric force-tracking with visual guidance of typical visual feedback and EA feedback containing augmented high-frequency errors. Stabilogram diffusion analysis was used to characterize force fluctuation dynamics. Also, the discharge behaviors of motor units and pooled motor unit coherence were assessed following the decomposition of multi-channel surface electromyography (EMG). EA produced different behavioral and neurophysiological impacts on young and older adults. Older adults exhibited inferior task accuracy with EA feedback than with typical visual feedback, but not young adults. Although stabilogram diffusion analysis revealed that EA led to a significant decrease in critical time points for both groups, EA potentiated the critical point of force fluctuations <ΔFc2>, short-term effective diffusion coefficients (Ds), and short-term exponent scaling only for the older adults. Moreover, in older adults, EA added to the size of discharge variability of motor units and discharge regularity of cumulative discharge rate, but suppressed the pooled motor unit coherence in the 13–35 Hz band. Virtual EA alters the strategic balance between open-loop and closed-loop controls for force-tracking. Contrary to expectations, the prevailing use of closed-loop control with EA that contained high-frequency error information enhanced the motor unit discharge variability and undermined the force steadiness in the older group, concerning declines in physiological complexity in the neurobehavioral system and the common drive to the motoneuronal pool against force destabilization. PMID:29167637

The Sense of Agency Is More Sensitive to Manipulations of Outcome than Movement-Related Feedback Irrespective of Sensory Modality

PubMed Central

David, Nicole; Skoruppa, Stefan; Gulberti, Alessandro

2016-01-01

The sense of agency describes the ability to experience oneself as the agent of one's own actions. Previous studies of the sense of agency manipulated the predicted sensory feedback related either to movement execution or to the movement’s outcome, for example by delaying the movement of a virtual hand or the onset of a tone that resulted from a button press. Such temporal sensorimotor discrepancies reduce the sense of agency. It remains unclear whether movement-related feedback is processed differently than outcome-related feedback in terms of agency experience, especially if these types of feedback differ with respect to sensory modality. We employed a mixed-reality setup, in which participants tracked their finger movements by means of a virtual hand. They performed a single tap, which elicited a sound. The temporal contingency between the participants’ finger movements and (i) the movement of the virtual hand or (ii) the expected auditory outcome was systematically varied. In a visual control experiment, the tap elicited a visual outcome. For each feedback type and participant, changes in the sense of agency were quantified using a forced-choice paradigm and the Method of Constant Stimuli. Participants were more sensitive to delays of outcome than to delays of movement execution. This effect was very similar for visual or auditory outcome delays. Our results indicate different contributions of movement- versus outcome-related sensory feedback to the sense of agency, irrespective of the modality of the outcome. We propose that this differential sensitivity reflects the behavioral importance of assessing authorship of the outcome of an action. PMID:27536948

Age-Specific Effects of Mirror-Muscle Activity on Cross-Limb Adaptations Under Mirror and Non-Mirror Visual Feedback Conditions.

PubMed

Reissig, Paola; Stöckel, Tino; Garry, Michael I; Summers, Jeffery J; Hinder, Mark R

2015-01-01

Cross-limb transfer (CLT) describes the observation of bilateral performance gains due to unilateral motor practice. Previous research has suggested that CLT may be reduced, or absent, in older adults, possibly due to age-related structural and functional brain changes. Based on research showing increases in CLT due to the provision of mirror visual feedback (MVF) during task execution in young adults, our study aimed to investigate whether MVF can facilitate CLT in older adults, who are known to be more reliant on visual feedback for accurate motor performance. Participants (N = 53) engaged in a short-term training regime (300 movements) involving a ballistic finger task using their dominant hand, while being provided with either visual feedback of their active limb, or a mirror reflection of their active limb (superimposed over the quiescent limb). Performance in both limbs was examined before, during and following the unilateral training. Furthermore, we measured corticospinal excitability (using TMS) at these time points, and assessed muscle activity bilaterally during the task via EMG; these parameters were used to investigate the mechanisms mediating and predicting CLT. Training resulted in significant bilateral performance gains that did not differ as a result of age or visual feedback (both p > 0.1). Training also elicited bilateral increases in corticospinal excitability (p < 0.05). For younger adults, CLT was significantly predicted by performance gains in the trained hand (β = 0.47), whereas for older adults it was significantly predicted by mirror activity in the untrained hand during training (β = 0.60). The present study suggests that older adults are capable of exhibiting CLT to a similar degree to younger adults. The prominent role of mirror activity in the untrained hand for CLT in older adults indicates that bilateral cortical activity during unilateral motor tasks is a compensatory mechanism. In this particular task, MVF did not facilitate the extent of CLT.

Cortical potentials evoked by confirming and disconfirming feedback following an auditory discrimination.

NASA Technical Reports Server (NTRS)

Squires, K. C.; Hillyard, S. A.; Lindsay, P. H.

1973-01-01

Vertex potentials elicited by visual feedback signals following an auditory intensity discrimination have been studied with eight subjects. Feedback signals which confirmed the prior sensory decision elicited small P3s, while disconfirming feedback elicited P3s that were larger. On the average, the latency of P3 was also found to increase with increasing disparity between the judgment and the feedback information. These effects were part of an overall dichotomy in wave shape following confirming vs disconfirming feedback. These findings are incorporated in a general model of the role of P3 in perceptual decision making.

An evaluation of end-point trajectory planning during skilled kicking.

PubMed

Ford, Paul; Hodges, Nicola J; Mark Williams, A

2009-01-01

There is evidence that actions are planned by anticipation of their external effects, with the strength of this effect being dependent on the amount of prior practice. In Experiment 1, skilled soccer players performed a kicking task under four conditions: planning in terms of an external action effect (i.e., ball trajectory) or in terms of body movements, either with or without visual error feedback. When feedback was withheld, a ball focus resulted in more accurate outcomes than a body focus. When visual feedback was allowed, there was no difference between these two conditions. In Experiment 2, both skilled and novice soccer players were tested with the addition of a control condition and in the absence of visual feedback. For both groups there was evidence that a ball focus was more beneficial for performance than a body focus, particularly in terms of movement kinematics where correlations across the joints were generally higher for body rather than ball planning. Most skilled participants reported that ball planning felt more normal than body planning. These experiments provide some evidence that actions are planned in terms of their external action effects, supporting the common-coding hypothesis of action planning.

Event Display for the Visualization of CMS Events

NASA Astrophysics Data System (ADS)

Bauerdick, L. A. T.; Eulisse, G.; Jones, C. D.; Kovalskyi, D.; McCauley, T.; Mrak Tadel, A.; Muelmenstaedt, J.; Osborne, I.; Tadel, M.; Tu, Y.; Yagil, A.

2011-12-01

During the last year the CMS experiment engaged in consolidation of its existing event display programs. The core of the new system is based on the Fireworks event display program which was by-design directly integrated with the CMS Event Data Model (EDM) and the light version of the software framework (FWLite). The Event Visualization Environment (EVE) of the ROOT framework is used to manage a consistent set of 3D and 2D views, selection, user-feedback and user-interaction with the graphics windows; several EVE components were developed by CMS in collaboration with the ROOT project. In event display operation simple plugins are registered into the system to perform conversion from EDM collections into their visual representations which are then managed by the application. Full event navigation and filtering as well as collection-level filtering is supported. The same data-extraction principle can also be applied when Fireworks will eventually operate as a service within the full software framework.

Ventromedial Frontal Cortex Is Critical for Guiding Attention to Reward-Predictive Visual Features in Humans.

PubMed

Vaidya, Avinash R; Fellows, Lesley K

2015-09-16

Adaptively interacting with our environment requires extracting information that will allow us to successfully predict reward. This can be a challenge, particularly when there are many candidate cues, and when rewards are probabilistic. Recent work has demonstrated that visual attention is allocated to stimulus features that have been associated with reward on previous trials. The ventromedial frontal lobe (VMF) has been implicated in learning in dynamic environments of this kind, but the mechanism by which this region influences this process is not clear. Here, we hypothesized that the VMF plays a critical role in guiding attention to reward-predictive stimulus features based on feedback. We tested the effects of VMF damage in human subjects on a visual search task in which subjects were primed to attend to task-irrelevant colors associated with different levels of reward, incidental to the search task. Consistent with previous work, we found that distractors had a greater influence on reaction time when they appeared in colors associated with high reward in the previous trial compared with colors associated with low reward in healthy control subjects and patients with prefrontal damage sparing the VMF. However, this reward modulation of attentional priming was absent in patients with VMF damage. Thus, an intact VMF is necessary for directing attention based on experience with cue-reward associations. We suggest that this region plays a role in selecting reward-predictive cues to facilitate future learning. There has been a swell of interest recently in the ventromedial frontal cortex (VMF), a brain region critical to associative learning. However, the underlying mechanism by which this region guides learning is not well understood. Here, we tested the effects of damage to this region in humans on a task in which rewards were linked incidentally to visual features, resulting in trial-by-trial attentional priming. Controls and subjects with prefrontal damage sparing the VMF showed normal reward priming, but VMF-damaged patients did not. This work sheds light on a potential mechanism through which this region influences behavior. We suggest that the VMF is necessary for directing attention to reward-predictive visual features based on feedback, facilitating future learning and decision-making. Copyright © 2015 the authors 0270-6474/15/3512813-11$15.00/0.

A cognitive neuroprosthetic that uses cortical stimulation for somatosensory feedback

PubMed Central

Klaes, Christian; Shi, Ying; Kellis, Spencer; Minxha, Juri; Revechkis, Boris; Andersen, Richard A.

2015-01-01

Present day cortical brain machine interfaces (BMI) have made impressive advances using decoded brain signals to control extracorporeal devices. Although BMIs are used in a closed-loop fashion, sensory feedback typically is visual only. However medical case studies have shown that the loss of somesthesis in a limb greatly reduces the agility of the limb even when visual feedback is available (for review see Robles-De-La-Torre, 2006). To overcome this limitation, this study tested a closed-loop BMI that utilizes intracortical microstimulation (ICMS) to provide ‘tactile’ sensation to a non-human primate (NHP). Using stimulation electrodes in Brodmann area 1 of somatosensory cortex (BA1) and recording electrodes in the anterior intraparietal area (AIP), the parietal reach region (PRR) and dorsal area 5 (area 5d), it was found that this form of feedback can be used in BMI tasks. PMID:25242377

Real-time evaluation and visualization of learner performance in a mixed-reality environment for clinical breast examination.

PubMed

Kotranza, Aaron; Lind, D Scott; Lok, Benjamin

2012-07-01

We investigate the efficacy of incorporating real-time feedback of user performance within mixed-reality environments (MREs) for training real-world tasks with tightly coupled cognitive and psychomotor components. This paper presents an approach to providing real-time evaluation and visual feedback of learner performance in an MRE for training clinical breast examination (CBE). In a user study of experienced and novice CBE practitioners (n = 69), novices receiving real-time feedback performed equivalently or better than more experienced practitioners in the completeness and correctness of the exam. A second user study (n = 8) followed novices through repeated practice of CBE in the MRE. Results indicate that skills improvement in the MRE transfers to the real-world task of CBE of human patients. This initial case study demonstrates the efficacy of MREs incorporating real-time feedback for training real-world cognitive-psychomotor tasks.

EMG-Torque Dynamics Change With Contraction Bandwidth.

PubMed

Golkar, Mahsa A; Jalaleddini, Kian; Kearney, Robert E

2018-04-01

An accurate model for ElectroMyoGram (EMG)-torque dynamics has many uses. One of its applications which has gained high attention among researchers is its use, in estimating the muscle contraction level for the efficient control of prosthesis. In this paper, the dynamic relationship between the surface EMG and torque during isometric contractions at the human ankle was studied using system identification techniques. Subjects voluntarily modulated their ankle torque in dorsiflexion direction, by activating their tibialis anterior muscle, while tracking a pseudo-random binary sequence in a torque matching task. The effects of contraction bandwidth, described by torque spectrum, on EMG-torque dynamics were evaluated by varying the visual command switching time. Nonparametric impulse response functions (IRF) were estimated between the processed surface EMG and torque. It was demonstrated that: 1) at low contraction bandwidths, the identified IRFs had unphysiological anticipatory (i.e., non-causal) components, whose amplitude decreased as the contraction bandwidth increased. We hypothesized that this non-causal behavior arose, because the EMG input contained a component due to feedback from the output torque, i.e., it was recorded from within a closed-loop. Vision was not the feedback source since the non-causal behavior persisted when visual feedback was removed. Repeating the identification using a nonparametric closed-loop identification algorithm yielded causal IRFs at all bandwidths, supporting this hypothesis. 2) EMG-torque dynamics became faster and the bandwidth of system increased as contraction modulation rate increased. Thus, accurate prediction of torque from EMG signals must take into account the contraction bandwidth sensitivity of this system.

Saccadic adaptation to a systematically varying disturbance

PubMed Central

Ohl, Sven; Rolfs, Martin

2016-01-01

Saccadic adaptation maintains the correct mapping between eye movements and their targets, yet the dynamics of saccadic gain changes in the presence of systematically varying disturbances has not been extensively studied. Here we assessed changes in the gain of saccade amplitudes induced by continuous and periodic postsaccadic visual feedback. Observers made saccades following a sequence of target steps either along the horizontal meridian (Two-way adaptation) or with unconstrained saccade directions (Global adaptation). An intrasaccadic step—following a sinusoidal variation as a function of the trial number (with 3 different frequencies tested in separate blocks)—consistently displaced the target along its vector. The oculomotor system responded to the resulting feedback error by modifying saccade amplitudes in a periodic fashion with similar frequency of variation but lagging the disturbance by a few tens of trials. This periodic response was superimposed on a drift toward stronger hypometria with similar asymptotes and decay rates across stimulus conditions. The magnitude of the periodic response decreased with increasing frequency and was smaller and more delayed for Global than Two-way adaptation. These results suggest that—in addition to the well-characterized return-to-baseline response observed in protocols using constant visual feedback—the oculomotor system attempts to minimize the feedback error by integrating its variation across trials. This process resembles a convolution with an internal response function, whose structure would be determined by coefficients of the learning model. Our protocol reveals this fast learning process in single short experimental sessions, qualifying it for the study of sensorimotor learning in health and disease. PMID:27098027

Advanced Maintenance Simulation by Means of Hand-Based Haptic Interfaces

NASA Astrophysics Data System (ADS)

Nappi, Michele; Paolino, Luca; Ricciardi, Stefano; Sebillo, Monica; Vitiello, Giuliana

Aerospace industry has been involved in virtual simulation for design and testing since the birth of virtual reality. Today this industry is showing a growing interest in the development of haptic-based maintenance training applications, which represent the most advanced way to simulate maintenance and repair tasks within a virtual environment by means of a visual-haptic approach. The goal is to allow the trainee to experiment the service procedures not only as a workflow reproduced at a visual level but also in terms of the kinaesthetic feedback involved with the manipulation of tools and components. This study, conducted in collaboration with aerospace industry specialists, is aimed to the development of an immersive virtual capable of immerging the trainees into a virtual environment where mechanics and technicians can perform maintenance simulation or training tasks by directly manipulating 3D virtual models of aircraft parts while perceiving force feedback through the haptic interface. The proposed system is based on ViRstperson, a virtual reality engine under development at the Italian Center for Aerospace Research (CIRA) to support engineering and technical activities such as design-time maintenance procedure validation, and maintenance training. This engine has been extended to support haptic-based interaction, enabling a more complete level of interaction, also in terms of impedance control, and thus fostering the development of haptic knowledge in the user. The user’s “sense of touch” within the immersive virtual environment is simulated through an Immersion CyberForce® hand-based force-feedback device. Preliminary testing of the proposed system seems encouraging.

Randomized crossover trial of a pressure sensing visual feedback system to improve mask fitting in noninvasive ventilation.

PubMed

Brill, Anne-Kathrin; Moghal, Mohammad; Morrell, Mary J; Simonds, Anita K

2017-10-01

A good mask fit, avoiding air leaks and pressure effects on the skin are key elements for a successful noninvasive ventilation (NIV). However, delivering practical training for NIV is challenging, and it takes time to build experience and competency. This study investigated whether a pressure sensing system with real-time visual feedback improved mask fitting. During an NIV training session, 30 healthcare professionals (14 trained in mask fitting and 16 untrained) performed two mask fittings on the same healthy volunteer in a randomized order: one using standard mask-fitting procedures and one with additional visual feedback on mask pressure on the nasal bridge. Participants were required to achieve a mask fit with low mask pressure and minimal air leak (<10 L/min). Pressure exerted on the nasal bridge, perceived comfort of mask fit and staff- confidence were measured. Compared with standard mask fitting, a lower pressure was exerted on the nasal bridge using the feedback system (71.1 ± 17.6 mm Hg vs 63.2 ± 14.6 mm Hg, P < 0.001). Both untrained and trained healthcare professionals were able to reduce the pressure on the nasal bridge (74.5 ± 21.2 mm Hg vs 66.1 ± 17.4 mm Hg, P = 0.023 and 67 ± 12.1 mm Hg vs 60 ± 10.6 mm Hg, P = 0.002, respectively) using the feedback system and self-rated confidence increased in the untrained group. Real-time visual feedback using pressure sensing technology supported healthcare professionals during mask-fitting training, resulted in a lower pressure on the skin and better mask fit for the volunteer, with increased staff confidence. © 2017 Asian Pacific Society of Respirology.

Contextual cuing contributes to the independent modification of multiple internal models for vocal control

PubMed Central

Keough, Dwayne

2011-01-01

Research on the control of visually guided limb movements indicates that the brain learns and continuously updates an internal model that maps the relationship between motor commands and sensory feedback. A growing body of work suggests that an internal model that relates motor commands to sensory feedback also supports vocal control. There is evidence from arm-reaching studies that shows that when provided with a contextual cue, the motor system can acquire multiple internal models, which allows an animal to adapt to different perturbations in diverse contexts. In this study we show that trained singers can rapidly acquire multiple internal models regarding voice fundamental frequency (F0). These models accommodate different perturbations to ongoing auditory feedback. Participants heard three musical notes and reproduced each one in succession. The musical targets could serve as a contextual cue to indicate which direction (up or down) feedback would be altered on each trial; however, participants were not explicitly instructed to use this strategy. When participants were gradually exposed to altered feedback adaptation was observed immediately following vocal onset. Aftereffects were target specific and did not influence vocal productions on subsequent trials. When target notes were no longer a contextual cue, adaptation occurred during altered feedback trials and evidence for trial-by-trial adaptation was found. These findings indicate that the brain is exceptionally sensitive to the deviations between auditory feedback and the predicted consequence of a motor command during vocalization. Moreover, these results indicate that, with contextual cues, the vocal control system may maintain multiple internal models that are capable of independent modification during different tasks or environments. PMID:21346208

Computer-aided training sensorimotor cortex functions in humans before the upper limb transplantation using virtual reality and sensory feedback.

PubMed

Kurzynski, Marek; Jaskolska, Anna; Marusiak, Jaroslaw; Wolczowski, Andrzej; Bierut, Przemyslaw; Szumowski, Lukasz; Witkowski, Jerzy; Kisiel-Sajewicz, Katarzyna

2017-08-01

One of the biggest problems of upper limb transplantation is lack of certainty as to whether a patient will be able to control voluntary movements of transplanted hands. Based on findings of the recent research on brain cortex plasticity, a premise can be drawn that mental training supported with visual and sensory feedback can cause structural and functional reorganization of the sensorimotor cortex, which leads to recovery of function associated with the control of movements performed by the upper limbs. In this study, authors - based on the above observations - propose the computer-aided training (CAT) system, which generating visual and sensory stimuli, should enhance the effectiveness of mental training applied to humans before upper limb transplantation. The basis for the concept of computer-aided training system is a virtual hand whose reaching and grasping movements the trained patient can observe on the VR headset screen (visual feedback) and whose contact with virtual objects the patient can feel as a touch (sensory feedback). The computer training system is composed of three main components: (1) the system generating 3D virtual world in which the patient sees the virtual limb from the perspective as if it were his/her own hand; (2) sensory feedback transforming information about the interaction of the virtual hand with the grasped object into mechanical vibration; (3) the therapist's panel for controlling the training course. Results of the case study demonstrate that mental training supported with visual and sensory stimuli generated by the computer system leads to a beneficial change of the brain activity related to motor control of the reaching in the patient with bilateral upper limb congenital transverse deficiency. Copyright © 2017 Elsevier Ltd. All rights reserved.

Time to CUSUM: simplified reporting of outcomes in colorectal surgery.

PubMed

Bowles, Thomas A; Watters, David A

2007-07-01

Surgical audit has added value when outcomes can be compared and individual surgeons receive feedback. It is expected that surgeons compare their results with others in similar local practice, the published work, or peers from a craft group audit. Although feedback and comparison are worthy aims, for many surgeons the standards have not been agreed nor is there a craft group audit. The aim of this paper was to develop a reporting format for surgeons carrying out colorectal surgery in a regional hospital. The performance of 13 individual surgeons was analysed using a comprehensive colorectal audit with more than 600 cases. Feedback included caseload and type. Risk stratification of outcomes included; operation urgency, age and Physiological and Operative Severity Score for enUmeration of Mortality and Morbidity. Outcome measures were anastomotic leaks, end stoma rates, unplanned reoperations and mortality. Visual feedback included cumulative summation graphs for elective leaks, mortality and unplanned reoperations. A single A4 page of an individuals performance could be prepared that allowed comparison to the groups data overall. Alerts were set at 2-5% elective leaks, 4-7.5% mortality and 4-11% unplanned return to theatre. Cumulative summation graphs added to this allowed a visual guide to the key performance indicators. Surgeons need to determine how they will review their individual and collective results. These are equally important to the reported work. Detailed analysis of risk-stratified data should occur. Binary outcomes such as leak, mortality and unplanned reoperations may be followed by cumulative summation graphs. This provides a continually updated method of feedback, enabling immediate visual feedback of a surgeon's performance.

Virtual reality visual feedback for hand-controlled scanning probe microscopy manipulation of single molecules.

PubMed

Leinen, Philipp; Green, Matthew F B; Esat, Taner; Wagner, Christian; Tautz, F Stefan; Temirov, Ruslan

2015-01-01

Controlled manipulation of single molecules is an important step towards the fabrication of single molecule devices and nanoscale molecular machines. Currently, scanning probe microscopy (SPM) is the only technique that facilitates direct imaging and manipulations of nanometer-sized molecular compounds on surfaces. The technique of hand-controlled manipulation (HCM) introduced recently in Beilstein J. Nanotechnol. 2014, 5, 1926-1932 simplifies the identification of successful manipulation protocols in situations when the interaction pattern of the manipulated molecule with its environment is not fully known. Here we present a further technical development that substantially improves the effectiveness of HCM. By adding Oculus Rift virtual reality goggles to our HCM set-up we provide the experimentalist with 3D visual feedback that displays the currently executed trajectory and the position of the SPM tip during manipulation in real time, while simultaneously plotting the experimentally measured frequency shift (Δf) of the non-contact atomic force microscope (NC-AFM) tuning fork sensor as well as the magnitude of the electric current (I) flowing between the tip and the surface. The advantages of the set-up are demonstrated by applying it to the model problem of the extraction of an individual PTCDA molecule from its hydrogen-bonded monolayer grown on Ag(111) surface.

Anatomy of hierarchy: Feedforward and feedback pathways in macaque visual cortex

PubMed Central

Markov, Nikola T; Vezoli, Julien; Chameau, Pascal; Falchier, Arnaud; Quilodran, René; Huissoud, Cyril; Lamy, Camille; Misery, Pierre; Giroud, Pascale; Ullman, Shimon; Barone, Pascal; Dehay, Colette; Knoblauch, Kenneth; Kennedy, Henry

2013-01-01

The laminar location of the cell bodies and terminals of interareal connections determines the hierarchical structural organization of the cortex and has been intensively studied. However, we still have only a rudimentary understanding of the connectional principles of feedforward (FF) and feedback (FB) pathways. Quantitative analysis of retrograde tracers was used to extend the notion that the laminar distribution of neurons interconnecting visual areas provides an index of hierarchical distance (percentage of supragranular labeled neurons [SLN]). We show that: 1) SLN values constrain models of cortical hierarchy, revealing previously unsuspected areal relations; 2) SLN reflects the operation of a combinatorial distance rule acting differentially on sets of connections between areas; 3) Supragranular layers contain highly segregated bottom-up and top-down streams, both of which exhibit point-to-point connectivity. This contrasts with the infragranular layers, which contain diffuse bottom-up and top-down streams; 4) Cell filling of the parent neurons of FF and FB pathways provides further evidence of compartmentalization; 5) FF pathways have higher weights, cross fewer hierarchical levels, and are less numerous than FB pathways. Taken together, the present results suggest that cortical hierarchies are built from supra- and infragranular counterstreams. This compartmentalized dual counterstream organization allows point-to-point connectivity in both bottom-up and top-down directions. PMID:23983048

An Algorithm Enabling Blind Users to Find and Read Barcodes

PubMed Central

Tekin, Ender; Coughlan, James M.

2010-01-01

Most camera-based systems for finding and reading barcodes are designed to be used by sighted users (e.g. the Red Laser iPhone app), and assume the user carefully centers the barcode in the image before the barcode is read. Blind individuals could benefit greatly from such systems to identify packaged goods (such as canned goods in a supermarket), but unfortunately in their current form these systems are completely inaccessible because of their reliance on visual feedback from the user. To remedy this problem, we propose a computer vision algorithm that processes several frames of video per second to detect barcodes from a distance of several inches; the algorithm issues directional information with audio feedback (e.g. “left,” “right”) and thereby guides a blind user holding a webcam or other portable camera to locate and home in on a barcode. Once the barcode is detected at sufficiently close range, a barcode reading algorithm previously developed by the authors scans and reads aloud the barcode and the corresponding product information. We demonstrate encouraging experimental results of our proposed system implemented on a desktop computer with a webcam held by a blindfolded user; ultimately the system will be ported to a camera phone for use by visually impaired users. PMID:20617114

Fiber optic tracheal detection device

NASA Astrophysics Data System (ADS)

Souhan, Brian E.; Nawn, Corinne D.; Shmel, Richard; Watts, Krista L.; Ingold, Kirk A.

2017-02-01

Poorly performed airway management procedures can lead to a wide variety of adverse events, such as laryngeal trauma, stenosis, cardiac arrest, hypoxemia, or death as in the case of failed airway management or intubation of the esophagus. Current methods for confirming tracheal placement, such as auscultation, direct visualization or capnography, may be subjective, compromised due to clinical presentation or require additional specialized equipment that is not always readily available during the procedure. Consequently, there exists a need for a non-visual detection mechanism for confirming successful airway placement that can give the provider rapid feedback during the procedure. Based upon our previously presented work characterizing the reflectance spectra of tracheal and esophageal tissue, we developed a fiber-optic prototype to detect the unique spectral characteristics of tracheal tissue. Device performance was tested by its ability to differentiate ex vivo samples of tracheal and esophageal tissue. Pig tissue samples were tested with the larynx, trachea and esophagus intact as well as excised and mounted on cork. The device positively detected tracheal tissue 18 out of 19 trials and 1 false positive out of 19 esophageal trials. Our proof of concept device shows great promise as a potential mechanism for rapid user feedback during airway management procedures to confirm tracheal placement. Ongoing studies will investigate device optimizations of the probe for more refined sensing and in vivo testing.

Connectivity-based neurofeedback: Dynamic causal modeling for real-time fMRI☆

PubMed Central

Koush, Yury; Rosa, Maria Joao; Robineau, Fabien; Heinen, Klaartje; W. Rieger, Sebastian; Weiskopf, Nikolaus; Vuilleumier, Patrik; Van De Ville, Dimitri; Scharnowski, Frank

2013-01-01

Neurofeedback based on real-time fMRI is an emerging technique that can be used to train voluntary control of brain activity. Such brain training has been shown to lead to behavioral effects that are specific to the functional role of the targeted brain area. However, real-time fMRI-based neurofeedback so far was limited to mainly training localized brain activity within a region of interest. Here, we overcome this limitation by presenting near real-time dynamic causal modeling in order to provide feedback information based on connectivity between brain areas rather than activity within a single brain area. Using a visual–spatial attention paradigm, we show that participants can voluntarily control a feedback signal that is based on the Bayesian model comparison between two predefined model alternatives, i.e. the connectivity between left visual cortex and left parietal cortex vs. the connectivity between right visual cortex and right parietal cortex. Our new approach thus allows for training voluntary control over specific functional brain networks. Because most mental functions and most neurological disorders are associated with network activity rather than with activity in a single brain region, this novel approach is an important methodological innovation in order to more directly target functionally relevant brain networks. PMID:23668967

Investigating the Effects of Multimodal Feedback through Tracking State in Pen-Based Interfaces

ERIC Educational Resources Information Center

Sun, Minghui; Ren, Xiangshi

2011-01-01

A tracking state increases the bandwidth of pen-based interfaces. However, this state is difficult to detect with default visual feedback. This paper reports on two experiments that are designed to evaluate multimodal feedback for pointing tasks (both 1D and 2D) in tracking state. In 1D pointing experiments, results show that there is a…

Exploring Formative Feedback on Textual Assignments with the Help of Automatically Created Visual Representations

ERIC Educational Resources Information Center

Berlanga, A. J.; van Rosmalen, P.; Boshuizen, H. P. A.; Sloep, P. B.

2012-01-01

Learners, particularly lifelong learners, often find it difficult to determine the scope of their expertise. Formative feedback could help them do so. To use this feedback productively, it is essential to then suggest to them the remedial actions they need to overcome the gaps in their knowledge. This paper presents the design considerations of a…

Effect of visual and tactile feedback on kinematic synergies in the grasping hand.

PubMed

Patel, Vrajeshri; Burns, Martin; Vinjamuri, Ramana

2016-08-01

The human hand uses a combination of feedforward and feedback mechanisms to accomplish high degree of freedom in grasp control efficiently. In this study, we used a synergy-based control model to determine the effect of sensory feedback on kinematic synergies in the grasping hand. Ten subjects performed two types of grasps: one that included feedback (real) and one without feedback (memory-guided), at two different speeds (rapid and natural). Kinematic synergies were extracted from rapid real and rapid memory-guided grasps using principal component analysis. Synergies extracted from memory-guided grasps revealed greater preservation of natural inter-finger relationships than those found in corresponding synergies extracted from real grasps. Reconstruction of natural real and natural memory-guided grasps was used to test performance and generalizability of synergies. A temporal analysis of reconstruction patterns revealed the differing contribution of individual synergies in real grasps versus memory-guided grasps. Finally, the results showed that memory-guided synergies could not reconstruct real grasps as accurately as real synergies could reconstruct memory-guided grasps. These results demonstrate how visual and tactile feedback affects a closed-loop synergy-based motor control system.

The mechanisms of feature inheritance as predicted by a systems-level model of visual attention and decision making.

PubMed

Hamker, Fred H

2008-07-15

Feature inheritance provides evidence that properties of an invisible target stimulus can be attached to a following mask. We apply a systemslevel model of attention and decision making to explore the influence of memory and feedback connections in feature inheritance. We find that the presence of feedback loops alone is sufficient to account for feature inheritance. Although our simulations do not cover all experimental variations and focus only on the general principle, our result appears of specific interest since the model was designed for a completely different purpose than to explain feature inheritance. We suggest that feedback is an important property in visual perception and provide a description of its mechanism and its role in perception.

Feedback between Population and Evolutionary Dynamics Determines the Fate of Social Microbial Populations

PubMed Central

Sanchez, Alvaro; Gore, Jeff

2013-01-01

The evolutionary spread of cheater strategies can destabilize populations engaging in social cooperative behaviors, thus demonstrating that evolutionary changes can have profound implications for population dynamics. At the same time, the relative fitness of cooperative traits often depends upon population density, thus leading to the potential for bi-directional coupling between population density and the evolution of a cooperative trait. Despite the potential importance of these eco-evolutionary feedback loops in social species, they have not yet been demonstrated experimentally and their ecological implications are poorly understood. Here, we demonstrate the presence of a strong feedback loop between population dynamics and the evolutionary dynamics of a social microbial gene, SUC2, in laboratory yeast populations whose cooperative growth is mediated by the SUC2 gene. We directly visualize eco-evolutionary trajectories of hundreds of populations over 50–100 generations, allowing us to characterize the phase space describing the interplay of evolution and ecology in this system. Small populations collapse despite continual evolution towards increased cooperative allele frequencies; large populations with a sufficient number of cooperators “spiral” to a stable state of coexistence between cooperator and cheater strategies. The presence of cheaters does not significantly affect the equilibrium population density, but it does reduce the resilience of the population as well as its ability to adapt to a rapidly deteriorating environment. Our results demonstrate the potential ecological importance of coupling between evolutionary dynamics and the population dynamics of cooperatively growing organisms, particularly in microbes. Our study suggests that this interaction may need to be considered in order to explain intraspecific variability in cooperative behaviors, and also that this feedback between evolution and ecology can critically affect the demographic fate of those species that rely on cooperation for their survival. PMID:23637571

Coding the presence of visual objects in a recurrent neural network of visual cortex.

PubMed

Zwickel, Timm; Wachtler, Thomas; Eckhorn, Reinhard

2007-01-01

Before we can recognize a visual object, our visual system has to segregate it from its background. This requires a fast mechanism for establishing the presence and location of objects independently of their identity. Recently, border-ownership neurons were recorded in monkey visual cortex which might be involved in this task [Zhou, H., Friedmann, H., von der Heydt, R., 2000. Coding of border ownership in monkey visual cortex. J. Neurosci. 20 (17), 6594-6611]. In order to explain the basic mechanisms required for fast coding of object presence, we have developed a neural network model of visual cortex consisting of three stages. Feed-forward and lateral connections support coding of Gestalt properties, including similarity, good continuation, and convexity. Neurons of the highest area respond to the presence of an object and encode its position, invariant of its form. Feedback connections to the lowest area facilitate orientation detectors activated by contours belonging to potential objects, and thus generate the experimentally observed border-ownership property. This feedback control acts fast and significantly improves the figure-ground segregation required for the consecutive task of object recognition.

Audio-visual feedback improves the BCI performance in the navigational control of a humanoid robot

PubMed Central

Tidoni, Emmanuele; Gergondet, Pierre; Kheddar, Abderrahmane; Aglioti, Salvatore M.

2014-01-01

Advancement in brain computer interfaces (BCI) technology allows people to actively interact in the world through surrogates. Controlling real humanoid robots using BCI as intuitively as we control our body represents a challenge for current research in robotics and neuroscience. In order to successfully interact with the environment the brain integrates multiple sensory cues to form a coherent representation of the world. Cognitive neuroscience studies demonstrate that multisensory integration may imply a gain with respect to a single modality and ultimately improve the overall sensorimotor performance. For example, reactivity to simultaneous visual and auditory stimuli may be higher than to the sum of the same stimuli delivered in isolation or in temporal sequence. Yet, knowledge about whether audio-visual integration may improve the control of a surrogate is meager. To explore this issue, we provided human footstep sounds as audio feedback to BCI users while controlling a humanoid robot. Participants were asked to steer their robot surrogate and perform a pick-and-place task through BCI-SSVEPs. We found that audio-visual synchrony between footsteps sound and actual humanoid's walk reduces the time required for steering the robot. Thus, auditory feedback congruent with the humanoid actions may improve motor decisions of the BCI's user and help in the feeling of control over it. Our results shed light on the possibility to increase robot's control through the combination of multisensory feedback to a BCI user. PMID:24987350

Adaptive learning in a compartmental model of visual cortex—how feedback enables stable category learning and refinement

PubMed Central

Layher, Georg; Schrodt, Fabian; Butz, Martin V.; Neumann, Heiko

2014-01-01

The categorization of real world objects is often reflected in the similarity of their visual appearances. Such categories of objects do not necessarily form disjunct sets of objects, neither semantically nor visually. The relationship between categories can often be described in terms of a hierarchical structure. For instance, tigers and leopards build two separate mammalian categories, both of which are subcategories of the category Felidae. In the last decades, the unsupervised learning of categories of visual input stimuli has been addressed by numerous approaches in machine learning as well as in computational neuroscience. However, the question of what kind of mechanisms might be involved in the process of subcategory learning, or category refinement, remains a topic of active investigation. We propose a recurrent computational network architecture for the unsupervised learning of categorial and subcategorial visual input representations. During learning, the connection strengths of bottom-up weights from input to higher-level category representations are adapted according to the input activity distribution. In a similar manner, top-down weights learn to encode the characteristics of a specific stimulus category. Feedforward and feedback learning in combination realize an associative memory mechanism, enabling the selective top-down propagation of a category's feedback weight distribution. We suggest that the difference between the expected input encoded in the projective field of a category node and the current input pattern controls the amplification of feedforward-driven representations. Large enough differences trigger the recruitment of new representational resources and the establishment of additional (sub-) category representations. We demonstrate the temporal evolution of such learning and show how the proposed combination of an associative memory with a modulatory feedback integration successfully establishes category and subcategory representations. PMID:25538637

Detecting delay in visual feedback of an action as a monitor of self recognition.

PubMed

Hoover, Adria E N; Harris, Laurence R

2012-10-01

How do we distinguish "self" from "other"? The correlation between willing an action and seeing it occur is an important cue. We exploited the fact that this correlation needs to occur within a restricted temporal window in order to obtain a quantitative assessment of when a body part is identified as "self". We measured the threshold and sensitivity (d') for detecting a delay between movements of the finger (of both the dominant and non-dominant hands) and visual feedback as seen from four visual perspectives (the natural view, and mirror-reversed and/or inverted views). Each trial consisted of one presentation with minimum delay and another with a delay of between 33 and 150 ms. Participants indicated which presentation contained the delayed view. We varied the amount of efference copy available for this task by comparing performances for discrete movements and continuous movements. Discrete movements are associated with a stronger efference copy. Sensitivity to detect asynchrony between visual and proprioceptive information was significantly higher when movements were viewed from a "plausible" self perspective compared with when the view was reversed or inverted. Further, we found differences in performance between dominant and non-dominant hand finger movements across the continuous and single movements. Performance varied with the viewpoint from which the visual feedback was presented and on the efferent component such that optimal performance was obtained when the presentation was in the normal natural orientation and clear efferent information was available. Variations in sensitivity to visual/non-visual temporal incongruence with the viewpoint in which a movement is seen may help determine the arrangement of the underlying visual representation of the body.

CO2 forcing induces semi-direct effects with consequences for climate feedback interpretations

NASA Astrophysics Data System (ADS)

Andrews, Timothy; Forster, Piers M.

2008-02-01

Climate forcing and feedbacks are diagnosed from seven slab-ocean GCMs for 2 × CO2 using a regression method. Results are compared to those using conventional methodologies to derive a semi-direct forcing due to tropospheric adjustment, analogous to the semi-direct effect of absorbing aerosols. All models show a cloud semi-direct effect, indicating a rapid cloud response to CO2; cloud typically decreases, enhancing the warming. Similarly there is evidence of semi-direct effects from water-vapour, lapse-rate, ice and snow. Previous estimates of climate feedbacks are unlikely to have taken these semi-direct effects into account and so misinterpret processes as feedbacks that depend only on the forcing, but not the global surface temperature. We show that the actual cloud feedback is smaller than what previous methods suggest and that a significant part of the cloud response and the large spread between previous model estimates of cloud feedback is due to the semi-direct forcing.

When hawks attack: animal-borne video studies of goshawk pursuit and prey-evasion strategies

PubMed Central

Kane, Suzanne Amador; Fulton, Andrew H.; Rosenthal, Lee J.

2015-01-01

Video filmed by a camera mounted on the head of a Northern Goshawk (Accipiter gentilis) was used to study how the raptor used visual guidance to pursue prey and land on perches. A combination of novel image analysis methods and numerical simulations of mathematical pursuit models was used to determine the goshawk's pursuit strategy. The goshawk flew to intercept targets by fixing the prey at a constant visual angle, using classical pursuit for stationary prey, lures or perches, and usually using constant absolute target direction (CATD) for moving prey. Visual fixation was better maintained along the horizontal than vertical direction. In some cases, we observed oscillations in the visual fix on the prey, suggesting that the goshawk used finite-feedback steering. Video filmed from the ground gave similar results. In most cases, it showed goshawks intercepting prey using a trajectory consistent with CATD, then turning rapidly to attack by classical pursuit; in a few cases, it showed them using curving non-CATD trajectories. Analysis of the prey's evasive tactics indicated that only sharp sideways turns caused the goshawk to lose visual fixation on the prey, supporting a sensory basis for the surprising frequency and effectiveness of this tactic found by previous studies. The dynamics of the prey's looming image also suggested that the goshawk used a tau-based interception strategy. We interpret these results in the context of a concise review of pursuit–evasion in biology, and conjecture that some prey deimatic ‘startle’ displays may exploit tau-based interception. PMID:25609783

Multimodal representation of limb endpoint position in the posterior parietal cortex.

PubMed

Shi, Ying; Apker, Gregory; Buneo, Christopher A

2013-04-01

Understanding the neural representation of limb position is important for comprehending the control of limb movements and the maintenance of body schema, as well as for the development of neuroprosthetic systems designed to replace lost limb function. Multiple subcortical and cortical areas contribute to this representation, but its multimodal basis has largely been ignored. Regarding the parietal cortex, previous results suggest that visual information about arm position is not strongly represented in area 5, although these results were obtained under conditions in which animals were not using their arms to interact with objects in their environment, which could have affected the relative weighting of relevant sensory signals. Here we examined the multimodal basis of limb position in the superior parietal lobule (SPL) as monkeys reached to and actively maintained their arm position at multiple locations in a frontal plane. On half of the trials both visual and nonvisual feedback of the endpoint of the arm were available, while on the other trials visual feedback was withheld. Many neurons were tuned to arm position, while a smaller number were modulated by the presence/absence of visual feedback. Visual modulation generally took the form of a decrease in both firing rate and variability with limb vision and was associated with more accurate decoding of position at the population level under these conditions. These findings support a multimodal representation of limb endpoint position in the SPL but suggest that visual signals are relatively weakly represented in this area, and only at the population level.

Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study

PubMed Central

2012-01-01

Background Prosthetic hand users have to rely extensively on visual feedback, which seems to lead to a high conscious burden for the users, in order to manipulate their prosthetic devices. Indirect methods (electro-cutaneous, vibrotactile, auditory cues) have been used to convey information from the artificial limb to the amputee, but the usability and advantages of these feedback methods were explored mainly by looking at the performance results, not taking into account measurements of the user’s mental effort, attention, and emotions. The main objective of this study was to explore the feasibility of using psycho-physiological measurements to assess cognitive effort when manipulating a robot hand with and without the usage of a sensory substitution system based on auditory feedback, and how these psycho-physiological recordings relate to temporal and grasping performance in a static setting. Methods 10 male subjects (26+/-years old), participated in this study and were asked to come for 2 consecutive days. On the first day the experiment objective, tasks, and experiment setting was explained. Then, they completed a 30 minutes guided training. On the second day each subject was tested in 3 different modalities: Auditory Feedback only control (AF), Visual Feedback only control (VF), and Audiovisual Feedback control (AVF). For each modality they were asked to perform 10 trials. At the end of each test, the subject had to answer the NASA TLX questionnaire. Also, during the test the subject’s EEG, ECG, electro-dermal activity (EDA), and respiration rate were measured. Results The results show that a higher mental effort is needed when the subjects rely only on their vision, and that this effort seems to be reduced when auditory feedback is added to the human-machine interaction (multimodal feedback). Furthermore, better temporal performance and better grasping performance was obtained in the audiovisual modality. Conclusions The performance improvements when using auditory cues, along with vision (multimodal feedback), can be attributed to a reduced attentional demand during the task, which can be attributed to a visual “pop-out” or enhance effect. Also, the NASA TLX, the EEG’s Alpha and Beta band, and the Heart Rate could be used to further evaluate sensory feedback systems in prosthetic applications. PMID:22682425

Effect of an auditory feedback substitution, tactilo-kinesthetic, or visual feedback on kinematics of pouring water from kettle into cup.

PubMed

Portnoy, Sigal; Halaby, Orli; Dekel-Chen, Dotan; Dierick, Frédéric

2015-11-01

Pouring hot water from a kettle into a cup may prove a hazardous task, especially for the elderly or the visually-impaired. Individuals with deteriorating eyesight may endanger their hands by performing this task with both hands, relaying on tactilo-kinesthetic feedback (TKF). Auditory feedback (AF) may allow them to perform the task singlehandedly, thereby reducing the risk for injury. However since relying on an AF is not intuitive and requires practice, we aimed to determine if AF supplied during the task of pouring water can be used naturally as visual feedback (VF) following practice. For this purpose, we quantified, in young healthy sighted subjects (n = 20), the performance and kinematics of pouring water in the presence of three isolated feedbacks: visual, tactilo-kinesthetic, or auditory. There were no significant differences between the weights of spilled water in the AF condition compared to the TKF condition in the first, fifth or thirteenth trials. The subjectively-reported difficulty levels of using the TKF and the AF were significantly reduced between the first and thirteenth trials for both TKF (p = 0.01) and AF (p = 0.001). Trunk rotation during the first trial using the TKF was significantly lower than the trunk rotation while using VF. Also, shoulder adduction during the first trial using the TKF was significantly higher than the shoulder adduction while using the VF. During the AF trials, the median travel distance of the tip of the kettle was significantly reduced in the first trials so that in the thirtieth trial it did not differ significantly from the median travel distance during the thirtieth trial using TKF and VF. The maximal velocity of the tip of the kettle was constant for each of the feedback conditions but was higher in 10 cm s(-1) using VF than TKF, which was higher in 10 cm s(-1) from using AF. The smoothness of movement of the TKF and AF conditions, expressed by the normalized jerk score (NJSM), was one and two orders of magnitude higher from the VF, respectively. The median NJSM then decreased significantly by the fifth trial. Monitoring in-house activity via motion capture and classification of movements, i.e. liquid pouring, can assist with daily activities via AF. As a built-in feature in a smart home, this task-specific AF may prevent burn injuries of the visually-impaired. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Caudate nucleus reactivity predicts perceptual learning rate for visual feature conjunctions.

PubMed

Reavis, Eric A; Frank, Sebastian M; Tse, Peter U

2015-04-15

Useful information in the visual environment is often contained in specific conjunctions of visual features (e.g., color and shape). The ability to quickly and accurately process such conjunctions can be learned. However, the neural mechanisms responsible for such learning remain largely unknown. It has been suggested that some forms of visual learning might involve the dopaminergic neuromodulatory system (Roelfsema et al., 2010; Seitz and Watanabe, 2005), but this hypothesis has not yet been directly tested. Here we test the hypothesis that learning visual feature conjunctions involves the dopaminergic system, using functional neuroimaging, genetic assays, and behavioral testing techniques. We use a correlative approach to evaluate potential associations between individual differences in visual feature conjunction learning rate and individual differences in dopaminergic function as indexed by neuroimaging and genetic markers. We find a significant correlation between activity in the caudate nucleus (a component of the dopaminergic system connected to visual areas of the brain) and visual feature conjunction learning rate. Specifically, individuals who showed a larger difference in activity between positive and negative feedback on an unrelated cognitive task, indicative of a more reactive dopaminergic system, learned visual feature conjunctions more quickly than those who showed a smaller activity difference. This finding supports the hypothesis that the dopaminergic system is involved in visual learning, and suggests that visual feature conjunction learning could be closely related to associative learning. However, no significant, reliable correlations were found between feature conjunction learning and genotype or dopaminergic activity in any other regions of interest. Copyright © 2015 Elsevier Inc. All rights reserved.

Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis.

PubMed

Schiefer, Matthew; Tan, Daniel; Sidek, Steven M; Tyler, Dustin J

2016-02-01

Tactile feedback is critical to grip and object manipulation. Its absence results in reliance on visual and auditory cues. Our objective was to assess the effect of sensory feedback on task performance in individuals with limb loss. Stimulation of the peripheral nerves using implanted cuff electrodes provided two subjects with sensory feedback with intensity proportional to forces on the thumb, index, and middle fingers of their prosthetic hand during object manipulation. Both subjects perceived the sensation on their phantom hand at locations corresponding to the locations of the forces on the prosthetic hand. A bend sensor measured prosthetic hand span. Hand span modulated the intensity of sensory feedback perceived on the thenar eminence for subject 1 and the middle finger for subject 2. We performed three functional tests with the blindfolded subjects. First, the subject tried to determine whether or not a wooden block had been placed in his prosthetic hand. Second, the subject had to locate and remove magnetic blocks from a metal table. Third, the subject performed the Southampton Hand Assessment Procedure (SHAP). We also measured the subject's sense of embodiment with a survey and his self-confidence. Blindfolded performance with sensory feedback was similar to sighted performance in the wooden block and magnetic block tasks. Performance on the SHAP, a measure of hand mechanical function and control, was similar with and without sensory feedback. An embodiment survey showed an improved sense of integration of the prosthesis in self body image with sensory feedback. Sensory feedback by peripheral nerve stimulation improved object discrimination and manipulation, embodiment, and confidence. With both forms of feedback, the blindfolded subjects tended toward results obtained with visual feedback.

Crystal accumulation in the Hanford Waste Treatment Plant high level waste melter: Summary of 2017 experiments

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fox, K.; Fowley, M.

A full-scale, transparent mock-up of the Hanford Tank Waste Treatment and Immobilization Project High Level Waste glass melter riser and pour spout has been constructed to allow for testing with visual feedback of particle settling, accumulation, and resuspension when operating with a controlled fraction of crystals in the glass melt. Room temperature operation with silicone oil and magnetite particles simulating molten glass and spinel crystals, respectively, allows for direct observation of flow patterns and settling patterns. The fluid and particle mixture is recycled within the system for each test.

Saliency affects feedforward more than feedback processing in early visual cortex.

PubMed

Emmanouil, Tatiana Aloi; Avigan, Philip; Persuh, Marjan; Ro, Tony

2013-07-01

Early visual cortex activity is influenced by both bottom-up and top-down factors. To investigate the influences of bottom-up (saliency) and top-down (task) factors on different stages of visual processing, we used transcranial magnetic stimulation (TMS) of areas V1/V2 to induce visual suppression at varying temporal intervals. Subjects were asked to detect and discriminate the color or the orientation of briefly-presented small lines that varied on color saliency based on color contrast with the surround. Regardless of task, color saliency modulated the magnitude of TMS-induced visual suppression, especially at earlier temporal processing intervals that reflect the feedforward stage of visual processing in V1/V2. In a second experiment we found that our color saliency effects were also influenced by an inherent advantage of the color red relative to other hues and that color discrimination difficulty did not affect visual suppression. These results support the notion that early visual processing is stimulus driven and that feedforward and feedback processing encode different types of information about visual scenes. They further suggest that certain hues can be prioritized over others within our visual systems by being more robustly represented during early temporal processing intervals. Copyright © 2013 Elsevier Ltd. All rights reserved.

Visualizing Without Vision at the Microscale: Students With Visual Impairments Explore Cells With Touch

NASA Astrophysics Data System (ADS)

Jones, M. Gail; Minogue, James; Oppewal, Tom; Cook, Michelle P.; Broadwell, Bethany

2006-12-01

Science instruction is typically highly dependent on visual representations of scientific concepts that are communicated through textbooks, teacher presentations, and computer-based multimedia materials. Little is known about how students with visual impairments access and interpret these types of visually-dependent instructional materials. This study explored the efficacy of new haptic (simulated tactile feedback and kinesthetics) instructional technology for teaching cell morphology and function to middle and high school students with visual impairments. The study examined students' prior experiences learning about the cell and cell functions in classroom instruction, as well as how haptic feedback technology impacted students' awareness of the 3-D nature of an animal cell, the morphology and function of cell organelles, and students' interest in the haptic technology as an instructional tool. Twenty-one students with visual impairment participated in the study. Students explored a tactile model of the cell with a haptic point probe that allowed them to feel the cell and its organelles. Results showed that students made significant gains in their ability to identify cell organelles and found the technology to be highly interesting as an instructional tool. The need for additional adaptive technology for students with visual impairments is discussed.

The 'not-so-strange' body in the mirror: A principal components analysis of direct and mirror self-observation.

PubMed

Jenkinson, Paul M; Preston, Catherine

2017-02-01

In this study we adopted a psychometric approach to examine how the body is subjectively experienced in a mirror. One hundred and twenty-four healthy participants viewed their body for five minutes directly or via a mirror, and then completed a 20-item questionnaire designed to capture subjective experiences of the body. PCA revealed a two-component structure for both direct and mirror conditions, comprising body evaluations (and alienation) and unusual feelings and perceptions. The relationship between these components and pre-existing tendencies for appearance anxiety, body dysmorphic-type beliefs, dissociative symptomatology, self-objectification and delusion ideation further supported the similarity between direct and mirror conditions; however, the occurrence of strange experiences like those reported to occur during prolonged face viewing was not confirmed. These results suggest that, despite obvious differences in visual feedback, observing the body via a mirror (as an outside observer) is subjectively equivalent to observing the body directly (from our own viewpoint). Copyright © 2016 Elsevier Inc. All rights reserved.

Cognitive loading affects motor awareness and movement kinematics but not locomotor trajectories during goal-directed walking in a virtual reality environment.

PubMed

Kannape, Oliver Alan; Barré, Arnaud; Aminian, Kamiar; Blanke, Olaf

2014-01-01

The primary purpose of this study was to investigate the effects of cognitive loading on movement kinematics and trajectory formation during goal-directed walking in a virtual reality (VR) environment. The secondary objective was to measure how participants corrected their trajectories for perturbed feedback and how participants' awareness of such perturbations changed under cognitive loading. We asked 14 healthy young adults to walk towards four different target locations in a VR environment while their movements were tracked and played back in real-time on a large projection screen. In 75% of all trials we introduced angular deviations of ±5° to ±30° between the veridical walking trajectory and the visual feedback. Participants performed a second experimental block under cognitive load (serial-7 subtraction, counter-balanced across participants). We measured walking kinematics (joint-angles, velocity profiles) and motor performance (end-point-compensation, trajectory-deviations). Motor awareness was determined by asking participants to rate the veracity of the feedback after every trial. In-line with previous findings in natural settings, participants displayed stereotypical walking trajectories in a VR environment. Our results extend these findings as they demonstrate that taxing cognitive resources did not affect trajectory formation and deviations although it interfered with the participants' movement kinematics, in particular walking velocity. Additionally, we report that motor awareness was selectively impaired by the secondary task in trials with high perceptual uncertainty. Compared with data on eye and arm movements our findings lend support to the hypothesis that the central nervous system (CNS) uses common mechanisms to govern goal-directed movements, including locomotion. We discuss our results with respect to the use of VR methods in gait control and rehabilitation.

A neural model of the temporal dynamics of figure-ground segregation in motion perception.

PubMed

Raudies, Florian; Neumann, Heiko

2010-03-01

How does the visual system manage to segment a visual scene into surfaces and objects and manage to attend to a target object? Based on psychological and physiological investigations, it has been proposed that the perceptual organization and segmentation of a scene is achieved by the processing at different levels of the visual cortical hierarchy. According to this, motion onset detection, motion-defined shape segregation, and target selection are accomplished by processes which bind together simple features into fragments of increasingly complex configurations at different levels in the processing hierarchy. As an alternative to this hierarchical processing hypothesis, it has been proposed that the processing stages for feature detection and segregation are reflected in different temporal episodes in the response patterns of individual neurons. Such temporal epochs have been observed in the activation pattern of neurons as low as in area V1. Here, we present a neural network model of motion detection, figure-ground segregation and attentive selection which explains these response patterns in an unifying framework. Based on known principles of functional architecture of the visual cortex, we propose that initial motion and motion boundaries are detected at different and hierarchically organized stages in the dorsal pathway. Visual shapes that are defined by boundaries, which were generated from juxtaposed opponent motions, are represented at different stages in the ventral pathway. Model areas in the different pathways interact through feedforward and modulating feedback, while mutual interactions enable the communication between motion and form representations. Selective attention is devoted to shape representations by sending modulating feedback signals from higher levels (working memory) to intermediate levels to enhance their responses. Areas in the motion and form pathway are coupled through top-down feedback with V1 cells at the bottom end of the hierarchy. We propose that the different temporal episodes in the response pattern of V1 cells, as recorded in recent experiments, reflect the strength of modulating feedback signals. This feedback results from the consolidated shape representations from coherent motion patterns and the attentive modulation of responses along the cortical hierarchy. The model makes testable predictions concerning the duration and delay of the temporal episodes of V1 cell responses as well as their response variations that were caused by modulating feedback signals. Copyright 2009 Elsevier Ltd. All rights reserved.

Does the vestibular system contribute to head direction cell activity in the rat?

NASA Technical Reports Server (NTRS)

Brown, J. E.; Yates, B. J.; Taube, J. S.; Oman, C. M. (Principal Investigator)

2002-01-01

Head direction cells (HDC) located in several regions of the brain, including the anterior dorsal nucleus of the thalamus (ADN), postsubiculum (PoS), and lateral mammillary nuclei (LMN), provide the neural substrate for the determination of head direction. Although activity of HDC is influenced by various sensory signals and internally generated cues, lesion studies and some anatomical and physiological evidence suggest that vestibular inputs are critical for the maintenance of directional sensitivity of these cells. However, vestibular inputs must be transformed considerably in order to signal head direction, and the neuronal circuitry that accomplishes this signal processing has not been fully established. Furthermore, it is unclear why the removal of vestibular inputs abolishes the directional sensitivity of HDC, as visual and other sensory inputs and motor feedback signals strongly affect the firing of these neurons and would be expected to maintain their directional-related activity. Further physiological studies will be required to establish the role of vestibular system in producing HDC responses, and anatomical studies are needed to determine the neural circuitry that mediates vestibular influences on determination of head direction.

Lateral Spread of Orientation Selectivity in V1 is Controlled by Intracortical Cooperativity

PubMed Central

Chavane, Frédéric; Sharon, Dahlia; Jancke, Dirk; Marre, Olivier; Frégnac, Yves; Grinvald, Amiram

2011-01-01

Neurons in the primary visual cortex receive subliminal information originating from the periphery of their receptive fields (RF) through a variety of cortical connections. In the cat primary visual cortex, long-range horizontal axons have been reported to preferentially bind to distant columns of similar orientation preferences, whereas feedback connections from higher visual areas provide a more diverse functional input. To understand the role of these lateral interactions, it is crucial to characterize their effective functional connectivity and tuning properties. However, the overall functional impact of cortical lateral connections, whatever their anatomical origin, is unknown since it has never been directly characterized. Using direct measurements of postsynaptic integration in cat areas 17 and 18, we performed multi-scale assessments of the functional impact of visually driven lateral networks. Voltage-sensitive dye imaging showed that local oriented stimuli evoke an orientation-selective activity that remains confined to the cortical feedforward imprint of the stimulus. Beyond a distance of one hypercolumn, the lateral spread of cortical activity gradually lost its orientation preference approximated as an exponential with a space constant of about 1 mm. Intracellular recordings showed that this loss of orientation selectivity arises from the diversity of converging synaptic input patterns originating from outside the classical RF. In contrast, when the stimulus size was increased, we observed orientation-selective spread of activation beyond the feedforward imprint. We conclude that stimulus-induced cooperativity enhances the long-range orientation-selective spread. PMID:21629708

Predictive Coding in Area V4: Dynamic Shape Discrimination under Partial Occlusion

PubMed Central

Choi, Hannah; Pasupathy, Anitha; Shea-Brown, Eric

2018-01-01

The primate visual system has an exquisite ability to discriminate partially occluded shapes. Recent electrophysiological recordings suggest that response dynamics in intermediate visual cortical area V4, shaped by feedback from prefrontal cortex (PFC), may play a key role. To probe the algorithms that may underlie these findings, we build and test a model of V4 and PFC interactions based on a hierarchical predictive coding framework. We propose that probabilistic inference occurs in two steps. Initially, V4 responses are driven solely by bottom-up sensory input and are thus strongly influenced by the level of occlusion. After a delay, V4 responses combine both feedforward input and feedback signals from the PFC; the latter reflect predictions made by PFC about the visual stimulus underlying V4 activity. We find that this model captures key features of V4 and PFC dynamics observed in experiments. Specifically, PFC responses are strongest for occluded stimuli and delayed responses in V4 are less sensitive to occlusion, supporting our hypothesis that the feedback signals from PFC underlie robust discrimination of occluded shapes. Thus, our study proposes that area V4 and PFC participate in hierarchical inference, with feedback signals encoding top-down predictions about occluded shapes. PMID:29566355

Learning of Temporal and Spatial Movement Aspects: A Comparison of Four Types of Haptic Control and Concurrent Visual Feedback.

PubMed

Rauter, Georg; Sigrist, Roland; Riener, Robert; Wolf, Peter

2015-01-01

In literature, the effectiveness of haptics for motor learning is controversially discussed. Haptics is believed to be effective for motor learning in general; however, different types of haptic control enhance different movement aspects. Thus, in dependence on the movement aspects of interest, one type of haptic control may be effective whereas another one is not. Therefore, in the current work, it was investigated if and how different types of haptic controllers affect learning of spatial and temporal movement aspects. In particular, haptic controllers that enforce active participation of the participants were expected to improve spatial aspects. Only haptic controllers that provide feedback about the task's velocity profile were expected to improve temporal aspects. In a study on learning a complex trunk-arm rowing task, the effect of training with four different types of haptic control was investigated: position control, path control, adaptive path control, and reactive path control. A fifth group (control) trained with visual concurrent augmented feedback. As hypothesized, the position controller was most effective for learning of temporal movement aspects, while the path controller was most effective in teaching spatial movement aspects of the rowing task. Visual feedback was also effective for learning temporal and spatial movement aspects.

Auditory display as feedback for a novel eye-tracking system for sterile operating room interaction.

PubMed

Black, David; Unger, Michael; Fischer, Nele; Kikinis, Ron; Hahn, Horst; Neumuth, Thomas; Glaser, Bernhard

2018-01-01

The growing number of technical systems in the operating room has increased attention on developing touchless interaction methods for sterile conditions. However, touchless interaction paradigms lack the tactile feedback found in common input devices such as mice and keyboards. We propose a novel touchless eye-tracking interaction system with auditory display as a feedback method for completing typical operating room tasks. Auditory display provides feedback concerning the selected input into the eye-tracking system as well as a confirmation of the system response. An eye-tracking system with a novel auditory display using both earcons and parameter-mapping sonification was developed to allow touchless interaction for six typical scrub nurse tasks. An evaluation with novice participants compared auditory display with visual display with respect to reaction time and a series of subjective measures. When using auditory display to substitute for the lost tactile feedback during eye-tracking interaction, participants exhibit reduced reaction time compared to using visual-only display. In addition, the auditory feedback led to lower subjective workload and higher usefulness and system acceptance ratings. Due to the absence of tactile feedback for eye-tracking and other touchless interaction methods, auditory display is shown to be a useful and necessary addition to new interaction concepts for the sterile operating room, reducing reaction times while improving subjective measures, including usefulness, user satisfaction, and cognitive workload.

A Portable Sensory Augmentation Device for Balance Rehabilitation Using Fingertip Skin Stretch Feedback.

PubMed

Pan, Yi-Tsen; Yoon, Han U; Hur, P

2017-01-01

Neurological disorders are the leading causes of poor balance. Previous studies have shown that biofeedback can compensate for weak or missing sensory information in people with sensory deficits. These biofeedback inputs can be easily recognized and converted into proper information by the central nervous system (CNS), which integrates the appropriate sensorimotor information and stabilizes the human posture. In this study, we proposed a form of cutaneous feedback which stretches the fingertip pad with a rotational contactor, so-called skin stretch. Skin stretch at a fingertip pad can be simply perceived and its small contact area makes it favored for small wearable devices. Taking advantage of skin stretch feedback, we developed a portable sensory augmentation device (SAD) for rehabilitation of balance. SAD was designed to provide postural sway information through additional skin stretch feedback. To demonstrate the feasibility of the SAD, quiet standing on a force plate was evaluated while sensory deficits were simulated. Fifteen healthy young adults were asked to stand quietly under six sensory conditions: three levels of sensory deficits (normal, visual deficit, and visual + vestibular deficits) combined with and without augmented sensation provided by SAD. The results showed that augmented sensation via skin stretch feedback helped subjects correct their posture and balance, especially as the deficit level of sensory feedback increased. These findings demonstrate the potential use of skin stretch feedback in balance rehabilitation.

Virtual reality and exercise: behavioral and psychological effects of visual feedback.

PubMed

Mestre, Daniel R; Ewald, Marine; Maiano, Christophe

2011-01-01

We herein report an experimental study examining the potential positive effects of Virtual Reality (VR) feedback during an indoor bicycling exercise. Using a regular bike coupled to a VR system, we compared conditions of no VR feedback, VR feedback and VR feedback with the presence of a virtual coach, acting as a pacer. In VR feedback conditions, we observed a decreased level of perceived exertion and an increased level of enjoyment of physical activity, when compared to a regular exercise situation (no VR feedback). We also observed a shift in the subjects' attentional focus, from association (in the absence of VR feedback) to dissociation (in VR feedback conditions). Moreover, the presence of a virtual coach in the VR environment triggered a systematic regulation of the (virtual) displacement speed, whose relationship with perceived enjoyment and exertion require further work.

Assisting the visually impaired: obstacle detection and warning system by acoustic feedback.

PubMed

Rodríguez, Alberto; Yebes, J Javier; Alcantarilla, Pablo F; Bergasa, Luis M; Almazán, Javier; Cela, Andrés

2012-12-17

The aim of this article is focused on the design of an obstacle detection system for assisting visually impaired people. A dense disparity map is computed from the images of a stereo camera carried by the user. By using the dense disparity map, potential obstacles can be detected in 3D in indoor and outdoor scenarios. A ground plane estimation algorithm based on RANSAC plus filtering techniques allows the robust detection of the ground in every frame. A polar grid representation is proposed to account for the potential obstacles in the scene. The design is completed with acoustic feedback to assist visually impaired users while approaching obstacles. Beep sounds with different frequencies and repetitions inform the user about the presence of obstacles. Audio bone conducting technology is employed to play these sounds without interrupting the visually impaired user from hearing other important sounds from its local environment. A user study participated by four visually impaired volunteers supports the proposed system.

Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback

PubMed Central

Rodríguez, Alberto; Yebes, J. Javier; Alcantarilla, Pablo F.; Bergasa, Luis M.; Almazán, Javier; Cela, Andrés

2012-01-01

The aim of this article is focused on the design of an obstacle detection system for assisting visually impaired people. A dense disparity map is computed from the images of a stereo camera carried by the user. By using the dense disparity map, potential obstacles can be detected in 3D in indoor and outdoor scenarios. A ground plane estimation algorithm based on RANSAC plus filtering techniques allows the robust detection of the ground in every frame. A polar grid representation is proposed to account for the potential obstacles in the scene. The design is completed with acoustic feedback to assist visually impaired users while approaching obstacles. Beep sounds with different frequencies and repetitions inform the user about the presence of obstacles. Audio bone conducting technology is employed to play these sounds without interrupting the visually impaired user from hearing other important sounds from its local environment. A user study participated by four visually impaired volunteers supports the proposed system. PMID:23247413

Virtual Worlds, Virtual Literacy: An Educational Exploration

ERIC Educational Resources Information Center

Stoerger, Sharon

2008-01-01

Virtual worlds enable students to learn through seeing, knowing, and doing within visually rich and mentally engaging spaces. Rather than reading about events, students become part of the events through the adoption of a pre-set persona. Along with visual feedback that guides the players' activities and the development of visual skills, visual…

Have 3D, Will Travel

ERIC Educational Resources Information Center

Duncan, Mike R.; Birrell, Bob; Williams, Toni

2005-01-01

Virtual Reality (VR) is primarily a visual technology. Elements such as haptics (touch feedback) and sound can augment an experience, but the visual cues are the prime driver of what an audience will experience from a VR presentation. At its inception in 2001 the Centre for Advanced Visualization (CFAV) at Niagara College of Arts and Technology…

Effects of body lean and visual information on the equilibrium maintenance during stance.

PubMed

Duarte, Marcos; Zatsiorsky, Vladimir M

2002-09-01

Maintenance of equilibrium was tested in conditions when humans assume different leaning postures during upright standing. Subjects ( n=11) stood in 13 different body postures specified by visual center of pressure (COP) targets within their base of support (BOS). Different types of visual information were tested: continuous presentation of visual target, no vision after target presentation, and with simultaneous visual feedback of the COP. The following variables were used to describe the equilibrium maintenance: the mean of the COP position, the area of the ellipse covering the COP sway, and the resultant median frequency of the power spectral density of the COP displacement. The variability of the COP displacement, quantified by the COP area variable, increased when subjects occupied leaning postures, irrespective of the kind of visual information provided. This variability also increased when vision was removed in relation to when vision was present. Without vision, drifts in the COP data were observed which were larger for COP targets farther away from the neutral position. When COP feedback was given in addition to the visual target, the postural control system did not control stance better than in the condition with only visual information. These results indicate that the visual information is used by the postural control system at both short and long time scales.

Visualization and analysis of flow structures in an open cavity

NASA Astrophysics Data System (ADS)

Liu, Jun; Cai, Jinsheng; Yang, Dangguo; Wu, Junqiang; Wang, Xiansheng

2018-05-01

A numerical study is performed on the supersonic flow over an open cavity at Mach number of 1.5. A newly developed visualization method is employed to visualize the complicated flow structures, which provide an insight into major flow physics. Four types of shock/compressive waves which existed in experimental schlieren are observed in numerical visualization results. Furthermore, other flow structures such as multi-scale vortices are also obtained in the numerical results. And a new type of shocklet which is beneath large vortices is found. The shocklet beneath the vortex originates from leading edge, then, is strengthened by successive interactions between feedback compressive waves and its attached vortex. Finally, it collides against the trailing surface and generates a large number of feedback compressive waves and intensive pressure fluctuations. It is suggested that the shocklets beneath vortex play an important role of cavity self-sustained oscillation.

Feedbacks between air pollution and weather, Part 1: Effects on weather

NASA Astrophysics Data System (ADS)

Makar, P. A.; Gong, W.; Milbrandt, J.; Hogrefe, C.; Zhang, Y.; Curci, G.; Žabkar, R.; Im, U.; Balzarini, A.; Baró, R.; Bianconi, R.; Cheung, P.; Forkel, R.; Gravel, S.; Hirtl, M.; Honzak, L.; Hou, A.; Jiménez-Guerrero, P.; Langer, M.; Moran, M. D.; Pabla, B.; Pérez, J. L.; Pirovano, G.; San José, R.; Tuccella, P.; Werhahn, J.; Zhang, J.; Galmarini, S.

2015-08-01

The meteorological predictions of fully coupled air-quality models running in ;feedback; versus ;no-feedback; simulations were compared against each other and observations as part of Phase 2 of the Air Quality Model Evaluation International Initiative. In the ;no-feedback; mode, the aerosol direct and indirect effects were disabled, with the models reverting to either climatologies of aerosol properties, or a no-aerosol weather simulation. In the ;feedback; mode, the model-generated aerosols were allowed to modify the radiative transfer and/or cloud formation parameterizations of the respective models. Annual simulations with and without feedbacks were conducted on domains over North America for the years 2006 and 2010, and over Europe for the year 2010. The incorporation of feedbacks was found to result in systematic changes to forecast predictions of meteorological variables, both in time and space, with the largest impacts occurring in the summer and near large sources of pollution. Models incorporating only the aerosol direct effect predicted feedback-induced reductions in temperature, surface downward and upward shortwave radiation, precipitation and PBL height, and increased upward shortwave radiation, in both Europe and North America. The feedback response of models incorporating both the aerosol direct and indirect effects varied across models, suggesting the details of implementation of the indirect effect have a large impact on model results, and hence should be a focus for future research. The feedback response of models incorporating both direct and indirect effects was also consistently larger in magnitude to that of models incorporating the direct effect alone, implying that the indirect effect may be the dominant process. Comparisons across modelling platforms suggested that direct and indirect effect feedbacks may often act in competition: the sign of residual changes associated with feedbacks often changed between those models incorporating the direct effect alone versus those incorporating both feedback processes. Model comparisons to observations for no-feedback and feedback implementations of the same model showed that differences in performance between models were larger than the performance changes associated with implementing feedbacks within a given model. However, feedback implementation was shown to result in improved forecasts of meteorological parameters such as the 2 m surface temperature and precipitation. These findings suggest that meteorological forecasts may be improved through the use of fully coupled feedback models, or through incorporation of improved climatologies of aerosol properties, the latter designed to include spatial, temporal and aerosol size and/or speciation variations.

Selective effects of 5-HT2C receptor modulation on performance of a novel valence-probe visual discrimination task and probabilistic reversal learning in mice.

PubMed

Phillips, Benjamin U; Dewan, Sigma; Nilsson, Simon R O; Robbins, Trevor W; Heath, Christopher J; Saksida, Lisa M; Bussey, Timothy J; Alsiö, Johan

2018-04-22

Dysregulation of the serotonin (5-HT) system is a pathophysiological component in major depressive disorder (MDD), a condition closely associated with abnormal emotional responsivity to positive and negative feedback. However, the precise mechanism through which 5-HT tone biases feedback responsivity remains unclear. 5-HT2C receptors (5-HT2CRs) are closely linked with aspects of depressive symptomatology, including abnormalities in reinforcement processes and response to stress. Thus, we aimed to determine the impact of 5-HT2CR function on response to feedback in biased reinforcement learning. We used two touchscreen assays designed to assess the impact of positive and negative feedback on probabilistic reinforcement in mice, including a novel valence-probe visual discrimination (VPVD) and a probabilistic reversal learning procedure (PRL). Systemic administration of a 5-HT2CR agonist and antagonist resulted in selective changes in the balance of feedback sensitivity bias on these tasks. Specifically, on VPVD, SB 242084, the 5-HT2CR antagonist, impaired acquisition of a discrimination dependent on appropriate integration of positive and negative feedback. On PRL, SB 242084 at 1 mg/kg resulted in changes in behaviour consistent with reduced sensitivity to positive feedback. In contrast, WAY 163909, the 5-HT2CR agonist, resulted in changes associated with increased sensitivity to positive feedback and decreased sensitivity to negative feedback. These results suggest that 5-HT2CRs tightly regulate feedback sensitivity bias in mice with consequent effects on learning and cognitive flexibility and specify a framework for the influence of 5-HT2CRs on sensitivity to reinforcement.

Brain-Computer Interfaces With Multi-Sensory Feedback for Stroke Rehabilitation: A Case Study.

PubMed

Irimia, Danut C; Cho, Woosang; Ortner, Rupert; Allison, Brendan Z; Ignat, Bogdan E; Edlinger, Guenter; Guger, Christoph

2017-11-01

Conventional therapies do not provide paralyzed patients with closed-loop sensorimotor integration for motor rehabilitation. This work presents the recoveriX system, a hardware and software platform that combines a motor imagery (MI)-based brain-computer interface (BCI), functional electrical stimulation (FES), and visual feedback technologies for a complete sensorimotor closed-loop therapy system for poststroke rehabilitation. The proposed system was tested on two chronic stroke patients in a clinical environment. The patients were instructed to imagine the movement of either the left or right hand in random order. During these two MI tasks, two types of feedback were provided: a bar extending to the left or right side of a monitor as visual feedback and passive hand opening stimulated from FES as proprioceptive feedback. Both types of feedback relied on the BCI classification result achieved using common spatial patterns and a linear discriminant analysis classifier. After 10 sessions of recoveriX training, one patient partially regained control of wrist extension in her paretic wrist and the other patient increased the range of middle finger movement by 1 cm. A controlled group study is planned with a new version of the recoveriX system, which will have several improvements. © 2017 International Center for Artificial Organs and Transplantation and Wiley Periodicals, Inc.

Error Argumentation Enhance Adaptability in Adults With Low Motor Ability.

PubMed

Lee, Chi-Mei; Bo, Jin

2016-01-01

The authors focused on young adults with varying degrees of motor difficulties and examined their adaptability in a visuomotor adaptation task where the visual feedback of participants' movement error was presented with either 1:1 ratio (i.e., regular feedback schedule) or 1:2 ratio (i.e., enhanced feedback schedule). Within-subject design was used with two feedback schedules counter-balanced and separated for 10 days. Results revealed that participants with greater motor difficulties showed less adaptability than those with normal motor abilities in the regular feedback schedule; however, all participants demonstrated similar level of adaptability in the enhanced feedback schedule. The results suggest that error argumentation enhances adaptability in adults with low motor ability.

The difference in visuomotor feedback velocity control during spiral drawing between Parkinson's disease and essential tremor.

PubMed

Chen, Kai-Hsiang; Lin, Po-Chieh; Yang, Bing-Shiang; Chen, Yu-Jung

2018-06-01

In a spiral task, the accuracy of the spiral trajectory, which is affected by tracing or tracking ability, differs between patients with Parkinson's disease (PD) and essential tremor (ET). However, not many studies have analyzed velocity differences between the groups during this task. This study aimed to examine differences between the groups related to this characteristic using a tablet. Fourteen PD, 12 ET, and 12 control group participants performed two tasks: tracing a given spiral (T1) and following a guiding point (T2). A digitized tablet was used to record movements and trajectory. Effects of direct visual feedback on intergroup and intragroup velocity were measured. Although PD patients had a significantly lower T1 velocity than the control group (p < 0.05), they could match the velocity of the guiding point (3.0 cm/s) in T2. There was no significant difference in the average T1 velocity between ET and the control groups (p = 0.26); however, the T2 velocity of ET patients was significantly higher than the control group (p < 0.05). They were also unable to adjust the velocity to match the guiding point, indicating that ET patients have a poorer ability to follow dynamic guidance. When both groups of patients have similar action tremor severity, their ability to follow dynamic guidance was still significantly different. Our study combined visual feedback with spiral drawing and demonstrated differences in the following-velocity distribution in PD and ET. This method may be used to distinguish the tremor presentation of both diseases, and thus, provide accurate diagnosis.

Robust design of feedback feed-forward iterative learning control based on 2D system theory for linear uncertain systems

NASA Astrophysics Data System (ADS)

Li, Zhifu; Hu, Yueming; Li, Di

2016-08-01

For a class of linear discrete-time uncertain systems, a feedback feed-forward iterative learning control (ILC) scheme is proposed, which is comprised of an iterative learning controller and two current iteration feedback controllers. The iterative learning controller is used to improve the performance along the iteration direction and the feedback controllers are used to improve the performance along the time direction. First of all, the uncertain feedback feed-forward ILC system is presented by an uncertain two-dimensional Roesser model system. Then, two robust control schemes are proposed. One can ensure that the feedback feed-forward ILC system is bounded-input bounded-output stable along time direction, and the other can ensure that the feedback feed-forward ILC system is asymptotically stable along time direction. Both schemes can guarantee the system is robust monotonically convergent along the iteration direction. Third, the robust convergent sufficient conditions are given, which contains a linear matrix inequality (LMI). Moreover, the LMI can be used to determine the gain matrix of the feedback feed-forward iterative learning controller. Finally, the simulation results are presented to demonstrate the effectiveness of the proposed schemes.

Formation of visual memories controlled by gamma power phase-locked to alpha oscillations.

PubMed

Park, Hyojin; Lee, Dong Soo; Kang, Eunjoo; Kang, Hyejin; Hahm, Jarang; Kim, June Sic; Chung, Chun Kee; Jiang, Haiteng; Gross, Joachim; Jensen, Ole

2016-06-16

Neuronal oscillations provide a window for understanding the brain dynamics that organize the flow of information from sensory to memory areas. While it has been suggested that gamma power reflects feedforward processing and alpha oscillations feedback control, it remains unknown how these oscillations dynamically interact. Magnetoencephalography (MEG) data was acquired from healthy subjects who were cued to either remember or not remember presented pictures. Our analysis revealed that in anticipation of a picture to be remembered, alpha power decreased while the cross-frequency coupling between gamma power and alpha phase increased. A measure of directionality between alpha phase and gamma power predicted individual ability to encode memory: stronger control of alpha phase over gamma power was associated with better memory. These findings demonstrate that encoding of visual information is reflected by a state determined by the interaction between alpha and gamma activity.

Formation of visual memories controlled by gamma power phase-locked to alpha oscillations

PubMed Central

Park, Hyojin; Lee, Dong Soo; Kang, Eunjoo; Kang, Hyejin; Hahm, Jarang; Kim, June Sic; Chung, Chun Kee; Jiang, Haiteng; Gross, Joachim; Jensen, Ole

2016-01-01

Neuronal oscillations provide a window for understanding the brain dynamics that organize the flow of information from sensory to memory areas. While it has been suggested that gamma power reflects feedforward processing and alpha oscillations feedback control, it remains unknown how these oscillations dynamically interact. Magnetoencephalography (MEG) data was acquired from healthy subjects who were cued to either remember or not remember presented pictures. Our analysis revealed that in anticipation of a picture to be remembered, alpha power decreased while the cross-frequency coupling between gamma power and alpha phase increased. A measure of directionality between alpha phase and gamma power predicted individual ability to encode memory: stronger control of alpha phase over gamma power was associated with better memory. These findings demonstrate that encoding of visual information is reflected by a state determined by the interaction between alpha and gamma activity. PMID:27306959

Formation of visual memories controlled by gamma power phase-locked to alpha oscillations

NASA Astrophysics Data System (ADS)

Park, Hyojin; Lee, Dong Soo; Kang, Eunjoo; Kang, Hyejin; Hahm, Jarang; Kim, June Sic; Chung, Chun Kee; Jiang, Haiteng; Gross, Joachim; Jensen, Ole

2016-06-01

Neuronal oscillations provide a window for understanding the brain dynamics that organize the flow of information from sensory to memory areas. While it has been suggested that gamma power reflects feedforward processing and alpha oscillations feedback control, it remains unknown how these oscillations dynamically interact. Magnetoencephalography (MEG) data was acquired from healthy subjects who were cued to either remember or not remember presented pictures. Our analysis revealed that in anticipation of a picture to be remembered, alpha power decreased while the cross-frequency coupling between gamma power and alpha phase increased. A measure of directionality between alpha phase and gamma power predicted individual ability to encode memory: stronger control of alpha phase over gamma power was associated with better memory. These findings demonstrate that encoding of visual information is reflected by a state determined by the interaction between alpha and gamma activity.

Motor Experts Care about Consistency and Are Reluctant to Change Motor Outcome.

PubMed

Kast, Volker; Leukel, Christian

2016-01-01

Thousands of hours of physical practice substantially change the way movements are performed. The mechanisms underlying altered behavior in highly-trained individuals are so far little understood. We studied experts (handballers) and untrained individuals (novices) in visuomotor adaptation of free throws, where subjects had to adapt their throwing direction to a visual displacement induced by prismatic glasses. Before visual displacement, experts expressed lower variability of motor errors than novices. Experts adapted and de-adapted slower, and also forgot the adaptation slower than novices. The variability during baseline was correlated with the learning rate during adaptation. Subjects adapted faster when variability was higher. Our results indicate that experts produced higher consistency of motor outcome. They were still susceptible to the sensory feedback informing about motor error, but made smaller adjustments than novices. The findings of our study relate to previous investigations emphasizing the importance of action exploration, expressed in terms of outcome variability, to facilitate learning.

Optimality and stability of intentional and unintentional actions: I. Origins of drifts in performance.

PubMed

Parsa, Behnoosh; Terekhov, Alexander; Zatsiorsky, Vladimir M; Latash, Mark L

2017-02-01

We address the nature of unintentional changes in performance in two papers. This first paper tested a hypothesis that unintentional changes in performance variables during continuous tasks without visual feedback are due to two processes. First, there is a drift of the referent coordinate for the salient performance variable toward the actual coordinate of the effector. Second, there is a drift toward minimum of a cost function. We tested this hypothesis in four-finger isometric pressing tasks that required the accurate production of a combination of total moment and total force with natural and modified finger involvement. Subjects performed accurate force-moment production tasks under visual feedback, and then visual feedback was removed for some or all of the salient variables. Analytical inverse optimization was used to compute a cost function. Without visual feedback, both force and moment drifted slowly toward lower absolute magnitudes. Over 15 s, the force drop could reach 20% of its initial magnitude while moment drop could reach 30% of its initial magnitude. Individual finger forces could show drifts toward both higher and lower forces. The cost function estimated using the analytical inverse optimization reduced its value as a consequence of the drift. We interpret the results within the framework of hierarchical control with referent spatial coordinates for salient variables at each level of the hierarchy combined with synergic control of salient variables. The force drift is discussed as a natural relaxation process toward states with lower potential energy in the physical (physiological) system involved in the task.

Optimality and stability of intentional and unintentional actions: I. Origins of drifts in performance

PubMed Central

Parsa, Behnoosh; Terekhov, Alexander; Zatsiorsky, Vladimir M.; Latash, Mark L.

2016-01-01

We address the nature of unintentional changes in performance in two papers. This first paper tested a hypothesis that unintentional changes in performance variables during continuous tasks without visual feedback are due to two processes. First, there is a drift of the referent coordinate for the salient performance variable toward the actual coordinate of the effector. Second, there is a drift toward minimum of a cost function. We tested this hypothesis in four-finger isometric pressing tasks that required the accurate production of a combination of total moment and total force with natural and modified finger involvement. Subjects performed accurate force/moment production tasks under visual feedback, and then visual feedback was removed for some or all of the salient variables. Analytical inverse optimization was used to compute a cost function. Without visual feedback, both force and moment drifted slowly toward lower absolute magnitudes. Over 15 s, the force drop could reach 20% of its initial magnitude while moment drop could reach 30% of its initial magnitude. Individual finger forces could show drifts toward both higher and lower forces. The cost function estimated using the analytical inverse optimization reduced its value as a consequence of the drift. We interpret the results within the framework of hierarchical control with referent spatial coordinates for salient variables at each level of the hierarchy combined with synergic control of salient variables. The force drift is discussed as a natural relaxation process toward states with lower potential energy in the physical (physiological) system involved in the task. PMID:27785549

A Photo Storm Report Mobile Application, Processing/Distribution System, and AWIPS-II Display Concept

NASA Astrophysics Data System (ADS)

Longmore, S. P.; Bikos, D.; Szoke, E.; Miller, S. D.; Brummer, R.; Lindsey, D. T.; Hillger, D.

2014-12-01

The increasing use of mobile phones equipped with digital cameras and the ability to post images and information to the Internet in real-time has significantly improved the ability to report events almost instantaneously. In the context of severe weather reports, a representative digital image conveys significantly more information than a simple text or phone relayed report to a weather forecaster issuing severe weather warnings. It also allows the forecaster to reasonably discern the validity and quality of a storm report. Posting geo-located, time stamped storm report photographs utilizing a mobile phone application to NWS social media weather forecast office pages has generated recent positive feedback from forecasters. Building upon this feedback, this discussion advances the concept, development, and implementation of a formalized Photo Storm Report (PSR) mobile application, processing and distribution system and Advanced Weather Interactive Processing System II (AWIPS-II) plug-in display software.The PSR system would be composed of three core components: i) a mobile phone application, ii) a processing and distribution software and hardware system, and iii) AWIPS-II data, exchange and visualization plug-in software. i) The mobile phone application would allow web-registered users to send geo-location, view direction, and time stamped PSRs along with severe weather type and comments to the processing and distribution servers. ii) The servers would receive PSRs, convert images and information to NWS network bandwidth manageable sizes in an AWIPS-II data format, distribute them on the NWS data communications network, and archive the original PSRs for possible future research datasets. iii) The AWIPS-II data and exchange plug-ins would archive PSRs, and the visualization plug-in would display PSR locations, times and directions by hour, similar to surface observations. Hovering on individual PSRs would reveal photo thumbnails and clicking on them would display the full resolution photograph.Here, we present initial NWS forecaster feedback received from social media posted PSRs, motivating the possible advantages of PSRs within AWIPS-II, the details of developing and implementing a PSR system, and possible future applications beyond severe weather reports and AWIPS-II.

Auditory short-term memory activation during score reading.

PubMed

Simoens, Veerle L; Tervaniemi, Mari

2013-01-01

Performing music on the basis of reading a score requires reading ahead of what is being played in order to anticipate the necessary actions to produce the notes. Score reading thus not only involves the decoding of a visual score and the comparison to the auditory feedback, but also short-term storage of the musical information due to the delay of the auditory feedback during reading ahead. This study investigates the mechanisms of encoding of musical information in short-term memory during such a complicated procedure. There were three parts in this study. First, professional musicians participated in an electroencephalographic (EEG) experiment to study the slow wave potentials during a time interval of short-term memory storage in a situation that requires cross-modal translation and short-term storage of visual material to be compared with delayed auditory material, as it is the case in music score reading. This delayed visual-to-auditory matching task was compared with delayed visual-visual and auditory-auditory matching tasks in terms of EEG topography and voltage amplitudes. Second, an additional behavioural experiment was performed to determine which type of distractor would be the most interfering with the score reading-like task. Third, the self-reported strategies of the participants were also analyzed. All three parts of this study point towards the same conclusion according to which during music score reading, the musician most likely first translates the visual score into an auditory cue, probably starting around 700 or 1300 ms, ready for storage and delayed comparison with the auditory feedback.

Auditory Short-Term Memory Activation during Score Reading

PubMed Central

Simoens, Veerle L.; Tervaniemi, Mari

2013-01-01

Performing music on the basis of reading a score requires reading ahead of what is being played in order to anticipate the necessary actions to produce the notes. Score reading thus not only involves the decoding of a visual score and the comparison to the auditory feedback, but also short-term storage of the musical information due to the delay of the auditory feedback during reading ahead. This study investigates the mechanisms of encoding of musical information in short-term memory during such a complicated procedure. There were three parts in this study. First, professional musicians participated in an electroencephalographic (EEG) experiment to study the slow wave potentials during a time interval of short-term memory storage in a situation that requires cross-modal translation and short-term storage of visual material to be compared with delayed auditory material, as it is the case in music score reading. This delayed visual-to-auditory matching task was compared with delayed visual-visual and auditory-auditory matching tasks in terms of EEG topography and voltage amplitudes. Second, an additional behavioural experiment was performed to determine which type of distractor would be the most interfering with the score reading-like task. Third, the self-reported strategies of the participants were also analyzed. All three parts of this study point towards the same conclusion according to which during music score reading, the musician most likely first translates the visual score into an auditory cue, probably starting around 700 or 1300 ms, ready for storage and delayed comparison with the auditory feedback. PMID:23326487

Use of cues in virtual reality depends on visual feedback.

PubMed

Fulvio, Jacqueline M; Rokers, Bas

2017-11-22

3D motion perception is of central importance to daily life. However, when tested in laboratory settings, sensitivity to 3D motion signals is found to be poor, leading to the view that heuristics and prior assumptions are critical for 3D motion perception. Here we explore an alternative: sensitivity to 3D motion signals is context-dependent and must be learned based on explicit visual feedback in novel environments. The need for action-contingent visual feedback is well-established in the developmental literature. For example, young kittens that are passively moved through an environment, but unable to move through it themselves, fail to develop accurate depth perception. We find that these principles also obtain in adult human perception. Observers that do not experience visual consequences of their actions fail to develop accurate 3D motion perception in a virtual reality environment, even after prolonged exposure. By contrast, observers that experience the consequences of their actions improve performance based on available sensory cues to 3D motion. Specifically, we find that observers learn to exploit the small motion parallax cues provided by head jitter. Our findings advance understanding of human 3D motion processing and form a foundation for future study of perception in virtual and natural 3D environments.

Targeted brain activation using an MR-compatible wrist torque measurement device and isometric motor tasks during functional magnetic resonance imaging.

PubMed

Vlaar, Martijn P; Mugge, Winfred; Groot, Paul F C; Sharifi, Sarvi; Bour, Lo J; van der Helm, Frans C T; van Rootselaar, Anne-Fleur; Schouten, Alfred C

2016-07-01

Dedicated pairs of isometric wrist flexion tasks, with and without visual feedback of the exerted torque, were designed to target activation of the CBL and BG in healthy subjects during functional magnetic resonance imaging (fMRI). Selective activation of the cerebellum (CBL) and basal ganglia (BG), often implicated in movement disorders such as tremor and dystonia, may help identify pathological changes and expedite diagnosis. A prototyped MR-compatible wrist torque measurement device, free of magnetic and conductive materials, allowed safe execution of tasks during fMRI without causing artifacts. A significant increase of activity in CBL and BG was found in healthy volunteers during a constant torque task with visual feedback compared to a constant torque task without visual feedback. This study shows that specific pairs of motor tasks using MR-compatible equipment at the wrist allow for targeted activation of CBL and BG, paving a new way for research into the pathophysiology of movement disorders. Copyright © 2016 Elsevier Inc. All rights reserved.

A virtual reality-based method of decreasing transmission time of visual feedback for a tele-operative robotic catheter operating system.

PubMed

Guo, Jin; Guo, Shuxiang; Tamiya, Takashi; Hirata, Hideyuki; Ishihara, Hidenori

2016-03-01

An Internet-based tele-operative robotic catheter operating system was designed for vascular interventional surgery, to afford unskilled surgeons the opportunity to learn basic catheter/guidewire skills, while allowing experienced physicians to perform surgeries cooperatively. Remote surgical procedures, limited by variable transmission times for visual feedback, have been associated with deterioration in operability and vascular wall damage during surgery. At the patient's location, the catheter shape/position was detected in real time and converted into three-dimensional coordinates in a world coordinate system. At the operation location, the catheter shape was reconstructed in a virtual-reality environment, based on the coordinates received. The data volume reduction significantly reduced visual feedback transmission times. Remote transmission experiments, conducted over inter-country distances, demonstrated the improved performance of the proposed prototype. The maximum error for the catheter shape reconstruction was 0.93 mm and the transmission time was reduced considerably. The results were positive and demonstrate the feasibility of remote surgery using conventional network infrastructures. Copyright © 2015 John Wiley & Sons, Ltd.

Feedback in formative OSCEs: comparison between direct observation and video-based formats

PubMed Central

Junod Perron, Noëlle; Louis-Simonet, Martine; Cerutti, Bernard; Pfarrwaller, Eva; Sommer, Johanna; Nendaz, Mathieu

2016-01-01

Introduction Medical students at the Faculty of Medicine, University of Geneva, Switzerland, have the opportunity to practice clinical skills with simulated patients during formative sessions in preparation for clerkships. These sessions are given in two formats: 1) direct observation of an encounter followed by verbal feedback (direct feedback) and 2) subsequent review of the videotaped encounter by both student and supervisor (video-based feedback). The aim of the study was to evaluate whether content and process of feedback differed between both formats. Methods In 2013, all second- and third-year medical students and clinical supervisors involved in formative sessions were asked to take part in the study. A sample of audiotaped feedback sessions involving supervisors who gave feedback in both formats were analyzed (content and process of the feedback) using a 21-item feedback scale. Results Forty-eight audiotaped feedback sessions involving 12 supervisors were analyzed (2 direct and 2 video-based sessions per supervisor). When adjusted for the length of feedback, there were significant differences in terms of content and process between both formats; the number of communication skills and clinical reasoning items addressed were higher in the video-based format (11.29 vs. 7.71, p=0.002 and 3.71 vs. 2.04, p=0.010, respectively). Supervisors engaged students more actively during the video-based sessions than during direct feedback sessions (self-assessment: 4.00 vs. 3.17, p=0.007; active problem-solving: 3.92 vs. 3.42, p=0.009). Students made similar observations and tended to consider that the video feedback was more useful for improving some clinical skills. Conclusion Video-based feedback facilitates discussion of clinical reasoning, communication, and professionalism issues while at the same time actively engaging students. Different time and conceptual frameworks may explain observed differences. The choice of feedback format should depend on the educational goal. PMID:27834170

Feedback in formative OSCEs: comparison between direct observation and video-based formats.

PubMed

Junod Perron, Noëlle; Louis-Simonet, Martine; Cerutti, Bernard; Pfarrwaller, Eva; Sommer, Johanna; Nendaz, Mathieu

2016-01-01

Medical students at the Faculty of Medicine, University of Geneva, Switzerland, have the opportunity to practice clinical skills with simulated patients during formative sessions in preparation for clerkships. These sessions are given in two formats: 1) direct observation of an encounter followed by verbal feedback (direct feedback) and 2) subsequent review of the videotaped encounter by both student and supervisor (video-based feedback). The aim of the study was to evaluate whether content and process of feedback differed between both formats. In 2013, all second- and third-year medical students and clinical supervisors involved in formative sessions were asked to take part in the study. A sample of audiotaped feedback sessions involving supervisors who gave feedback in both formats were analyzed (content and process of the feedback) using a 21-item feedback scale. Forty-eight audiotaped feedback sessions involving 12 supervisors were analyzed (2 direct and 2 video-based sessions per supervisor). When adjusted for the length of feedback, there were significant differences in terms of content and process between both formats; the number of communication skills and clinical reasoning items addressed were higher in the video-based format (11.29 vs. 7.71, p= 0.002 and 3.71 vs. 2.04, p= 0.010, respectively). Supervisors engaged students more actively during the video-based sessions than during direct feedback sessions (self-assessment: 4.00 vs. 3.17, p= 0.007; active problem-solving: 3.92 vs. 3.42, p= 0.009). Students made similar observations and tended to consider that the video feedback was more useful for improving some clinical skills. Video-based feedback facilitates discussion of clinical reasoning, communication, and professionalism issues while at the same time actively engaging students. Different time and conceptual frameworks may explain observed differences. The choice of feedback format should depend on the educational goal.

A design of hardware haptic interface for gastrointestinal endoscopy simulation.

PubMed

Gu, Yunjin; Lee, Doo Yong

2011-01-01

Gastrointestinal endoscopy simulations have been developed to train endoscopic procedures which require hundreds of practices to be competent in the skills. Even though realistic haptic feedback is important to provide realistic sensation to the user, most of previous simulations including commercialized simulation have mainly focused on providing realistic visual feedback. In this paper, we propose a novel design of portable haptic interface, which provides 2DOF force feedback, for the gastrointestinal endoscopy simulation. The haptic interface consists of translational and rotational force feedback mechanism which are completely decoupled, and gripping mechanism for controlling connection between the endoscope and the force feedback mechanism.

Noise destroys feedback enhanced figure-ground segmentation but not feedforward figure-ground segmentation.

PubMed

Romeo, August; Arall, Marina; Supèr, Hans

2012-01-01

Figure-ground (FG) segmentation is the separation of visual information into background and foreground objects. In the visual cortex, FG responses are observed in the late stimulus response period, when neurons fire in tonic mode, and are accompanied by a switch in cortical state. When such a switch does not occur, FG segmentation fails. Currently, it is not known what happens in the brain on such occasions. A biologically plausible feedforward spiking neuron model was previously devised that performed FG segmentation successfully. After incorporating feedback the FG signal was enhanced, which was accompanied by a change in spiking regime. In a feedforward model neurons respond in a bursting mode whereas in the feedback model neurons fired in tonic mode. It is known that bursts can overcome noise, while tonic firing appears to be much more sensitive to noise. In the present study, we try to elucidate how the presence of noise can impair FG segmentation, and to what extent the feedforward and feedback pathways can overcome noise. We show that noise specifically destroys the feedback enhanced FG segmentation and leaves the feedforward FG segmentation largely intact. Our results predict that noise produces failure in FG perception.

Noise destroys feedback enhanced figure-ground segmentation but not feedforward figure-ground segmentation

PubMed Central

Romeo, August; Arall, Marina; Supèr, Hans

2012-01-01

Figure-ground (FG) segmentation is the separation of visual information into background and foreground objects. In the visual cortex, FG responses are observed in the late stimulus response period, when neurons fire in tonic mode, and are accompanied by a switch in cortical state. When such a switch does not occur, FG segmentation fails. Currently, it is not known what happens in the brain on such occasions. A biologically plausible feedforward spiking neuron model was previously devised that performed FG segmentation successfully. After incorporating feedback the FG signal was enhanced, which was accompanied by a change in spiking regime. In a feedforward model neurons respond in a bursting mode whereas in the feedback model neurons fired in tonic mode. It is known that bursts can overcome noise, while tonic firing appears to be much more sensitive to noise. In the present study, we try to elucidate how the presence of noise can impair FG segmentation, and to what extent the feedforward and feedback pathways can overcome noise. We show that noise specifically destroys the feedback enhanced FG segmentation and leaves the feedforward FG segmentation largely intact. Our results predict that noise produces failure in FG perception. PMID:22934028

Cortical depth dependent population receptive field attraction by spatial attention in human V1.

PubMed

Klein, Barrie P; Fracasso, Alessio; van Dijk, Jelle A; Paffen, Chris L E; Te Pas, Susan F; Dumoulin, Serge O

2018-04-27

Visual spatial attention concentrates neural resources at the attended location. Recently, we demonstrated that voluntary spatial attention attracts population receptive fields (pRFs) toward its location throughout the visual hierarchy. Theoretically, both a feed forward or feedback mechanism could underlie pRF attraction in a given cortical area. Here, we use sub-millimeter ultra-high field functional MRI to measure pRF attraction across cortical depth and assess the contribution of feed forward and feedback signals to pRF attraction. In line with previous findings, we find consistent attraction of pRFs with voluntary spatial attention in V1. When assessed as a function of cortical depth, we find pRF attraction in every cortical portion (deep, center and superficial), although the attraction is strongest in deep cortical portions (near the gray-white matter boundary). Following the organization of feed forward and feedback processing across V1, we speculate that a mixture of feed forward and feedback processing underlies pRF attraction in V1. Specifically, we propose that feedback processing contributes to the pRF attraction in deep cortical portions. Copyright © 2018. Published by Elsevier Inc.

Learning effects of dynamic postural control by auditory biofeedback versus visual biofeedback training.

PubMed

Hasegawa, Naoya; Takeda, Kenta; Sakuma, Moe; Mani, Hiroki; Maejima, Hiroshi; Asaka, Tadayoshi

2017-10-01

Augmented sensory biofeedback (BF) for postural control is widely used to improve postural stability. However, the effective sensory information in BF systems of motor learning for postural control is still unknown. The purpose of this study was to investigate the learning effects of visual versus auditory BF training in dynamic postural control. Eighteen healthy young adults were randomly divided into two groups (visual BF and auditory BF). In test sessions, participants were asked to bring the real-time center of pressure (COP) in line with a hidden target by body sway in the sagittal plane. The target moved in seven cycles of sine curves at 0.23Hz in the vertical direction on a monitor. In training sessions, the visual and auditory BF groups were required to change the magnitude of a visual circle and a sound, respectively, according to the distance between the COP and target in order to reach the target. The perceptual magnitudes of visual and auditory BF were equalized according to Stevens' power law. At the retention test, the auditory but not visual BF group demonstrated decreased postural performance errors in both the spatial and temporal parameters under the no-feedback condition. These findings suggest that visual BF increases the dependence on visual information to control postural performance, while auditory BF may enhance the integration of the proprioceptive sensory system, which contributes to motor learning without BF. These results suggest that auditory BF training improves motor learning of dynamic postural control. Copyright © 2017 Elsevier B.V. All rights reserved.

Brain negativity as an indicator of predictive error processing: the contribution of visual action effect monitoring.

PubMed

Joch, Michael; Hegele, Mathias; Maurer, Heiko; Müller, Hermann; Maurer, Lisa Katharina

2017-07-01

The error (related) negativity (Ne/ERN) is an event-related potential in the electroencephalogram (EEG) correlating with error processing. Its conditions of appearance before terminal external error information suggest that the Ne/ERN is indicative of predictive processes in the evaluation of errors. The aim of the present study was to specifically examine the Ne/ERN in a complex motor task and to particularly rule out other explaining sources of the Ne/ERN aside from error prediction processes. To this end, we focused on the dependency of the Ne/ERN on visual monitoring about the action outcome after movement termination but before result feedback (action effect monitoring). Participants performed a semi-virtual throwing task by using a manipulandum to throw a virtual ball displayed on a computer screen to hit a target object. Visual feedback about the ball flying to the target was masked to prevent action effect monitoring. Participants received a static feedback about the action outcome (850 ms) after each trial. We found a significant negative deflection in the average EEG curves of the error trials peaking at ~250 ms after ball release, i.e., before error feedback. Furthermore, this Ne/ERN signal did not depend on visual ball-flight monitoring after release. We conclude that the Ne/ERN has the potential to indicate error prediction in motor tasks and that it exists even in the absence of action effect monitoring. NEW & NOTEWORTHY In this study, we are separating different kinds of possible contributors to an electroencephalogram (EEG) error correlate (Ne/ERN) in a throwing task. We tested the influence of action effect monitoring on the Ne/ERN amplitude in the EEG. We used a task that allows us to restrict movement correction and action effect monitoring and to control the onset of result feedback. We ascribe the Ne/ERN to predictive error processing where a conscious feeling of failure is not a prerequisite. Copyright © 2017 the American Physiological Society.

Performing a reaching task with one arm while adapting to a visuomotor rotation with the other can lead to complete transfer of motor learning across the arms

PubMed Central

Lei, Yuming; Binder, Jeffrey R.

2015-01-01

The extent to which motor learning is generalized across the limbs is typically very limited. Here, we investigated how two motor learning hypotheses could be used to enhance the extent of interlimb transfer. According to one hypothesis, we predicted that reinforcement of successful actions by providing binary error feedback regarding task success or failure, in addition to terminal error feedback, during initial training would increase the extent of interlimb transfer following visuomotor adaptation (experiment 1). According to the other hypothesis, we predicted that performing a reaching task repeatedly with one arm without providing performance feedback (which prevented learning the task with this arm), while concurrently adapting to a visuomotor rotation with the other arm, would increase the extent of transfer (experiment 2). Results indicate that providing binary error feedback, compared with continuous visual feedback that provided movement direction and amplitude information, had no influence on the extent of transfer. In contrast, repeatedly performing (but not learning) a specific task with one arm while visuomotor adaptation occurred with the other arm led to nearly complete transfer. This suggests that the absence of motor instances associated with specific effectors and task conditions is the major reason for limited interlimb transfer and that reinforcement of successful actions during initial training is not beneficial for interlimb transfer. These findings indicate crucial contributions of effector- and task-specific motor instances, which are thought to underlie (a type of) model-free learning, to optimal motor learning and interlimb transfer. PMID:25632082

Optical sensor feedback assistive technology to enable patients to play an active role in the management of their body dynamics during radiotherapy treatment

NASA Astrophysics Data System (ADS)

Parkhurst, J. M.; Price, G. J.; Sharrock, P. J.; Stratford, J.; Moore, C. J.

2013-04-01

Patient motion during treatment is well understood as a prime factor limiting radiotherapy success, with the risks most pronounced in modern safety critical therapies promising the greatest benefit. In this paper we describe a real-time visual feedback device designed to help patients to actively manage their body position, pose and motion. In addition to technical device details, we present preliminary trial results showing that its use enables volunteers to successfully manage their respiratory motion. The device enables patients to view their live body surface measurements relative to a prior reference, operating on the concept that co-operative engagement with patients will both improve geometric conformance and remove their perception of isolation, in turn easing stress related motion. The device is driven by a real-time wide field optical sensor system developed at The Christie. Feedback is delivered through three intuitive visualization modes of hierarchically increasing display complexity. The device can be used with any suitable display technology; in the presented study we use both personal video glasses and a standard LCD projector. The performance characteristics of the system were measured, with the frame rate, throughput and latency of the feedback device being 22.4 fps, 47.0 Mbps, 109.8 ms, and 13.7 fps, 86.4 Mbps, 119.1 ms for single and three-channel modes respectively. The pilot study, using ten healthy volunteers over three sessions, shows that the use of visual feedback resulted in both a reduction in the participants' respiratory amplitude, and a decrease in their overall body motion variability.

Contributions of the 12 neuron classes in the fly lamina to motion vision

PubMed Central

Tuthill, John C.; Nern, Aljoscha; Holtz, Stephen L.; Rubin, Gerald M.; Reiser, Michael B.

2013-01-01

SUMMARY Motion detection is a fundamental neural computation performed by many sensory systems. In the fly, local motion computation is thought to occur within the first two layers of the visual system, the lamina and medulla. We constructed specific genetic driver lines for each of the 12 neuron classes in the lamina. We then depolarized and hyperpolarized each neuron type, and quantified fly behavioral responses to a diverse set of motion stimuli. We found that only a small number of lamina output neurons are essential for motion detection, while most neurons serve to sculpt and enhance these feedforward pathways. Two classes of feedback neurons (C2 and C3), and lamina output neurons (L2 and L4), are required for normal detection of directional motion stimuli. Our results reveal a prominent role for feedback and lateral interactions in motion processing, and demonstrate that motion-dependent behaviors rely on contributions from nearly all lamina neuron classes. PMID:23849200

Contributions of the 12 neuron classes in the fly lamina to motion vision.

PubMed

Tuthill, John C; Nern, Aljoscha; Holtz, Stephen L; Rubin, Gerald M; Reiser, Michael B

2013-07-10

Motion detection is a fundamental neural computation performed by many sensory systems. In the fly, local motion computation is thought to occur within the first two layers of the visual system, the lamina and medulla. We constructed specific genetic driver lines for each of the 12 neuron classes in the lamina. We then depolarized and hyperpolarized each neuron type and quantified fly behavioral responses to a diverse set of motion stimuli. We found that only a small number of lamina output neurons are essential for motion detection, while most neurons serve to sculpt and enhance these feedforward pathways. Two classes of feedback neurons (C2 and C3), and lamina output neurons (L2 and L4), are required for normal detection of directional motion stimuli. Our results reveal a prominent role for feedback and lateral interactions in motion processing and demonstrate that motion-dependent behaviors rely on contributions from nearly all lamina neuron classes. Copyright © 2013 Elsevier Inc. All rights reserved.

Assessment of feedback modalities for wearable visual aids in blind mobility

PubMed Central

Sorrentino, Paige; Bohlool, Shadi; Zhang, Carey; Arditti, Mort; Goodrich, Gregory; Weiland, James D.

2017-01-01

Sensory substitution devices engage sensory modalities other than vision to communicate information typically obtained through the sense of sight. In this paper, we examine the ability of subjects who are blind to follow simple verbal and vibrotactile commands that allow them to navigate a complex path. A total of eleven visually impaired subjects were enrolled in the study. Prototype systems were developed to deliver verbal and vibrotactile commands to allow an investigator to guide a subject through a course. Using this mode, subjects could follow commands easily and navigate significantly faster than with their cane alone (p <0.05). The feedback modes were similar with respect to the increased speed for course completion. Subjects rated usability of the feedback systems as “above average” with scores of 76.3 and 90.9 on the system usability scale. PMID:28182731

Utilizing Oral-Motor Feedback in Auditory Conceptualization.

ERIC Educational Resources Information Center

Howard, Marilyn

The Auditory Discrimination in Depth (ADD) program, an oral-motor approach to beginning reading instruction, trains first grade children in auditory skills by a process in which language and oral-motor feedback are used to integrate auditory properties with visual properties. This emphasis of the ADD program makes the child's perceptual…

Arbitrary frequency stabilization of a diode laser based on visual Labview PID VI and sound card output

NASA Astrophysics Data System (ADS)

Feng, Guo-Sheng; Wu, Ji-Zhou; Wang, Xiao-Feng; Zheng, Ning-Xuan; Li, Yu-Qing; Ma, Jie; Xiao, Lian-Tuan; Jia, Suo-Tang

2015-10-01

We report a robust method of directly stabilizing a grating feedback diode laser to an arbitrary frequency in a large range. The error signal, induced from the difference between the frequency measured by a wavelength meter and the preset target frequency, is fed back to the piezoelectric transducer module of the diode laser via a sound card in the computer. A visual Labview procedure is developed to realize a feedback system. In our experiment the frequency drift of the diode laser is reduced to 8 MHz within 25 min. The robust scheme can be adapted to realize the arbitrary frequency stabilization for many other kinds of lasers. Project supported by the National Basic Research Program of China (Grant No. 2012CB921603), the Program for Changjiang Scholars and Innovative Research Team in University of Ministry of Education of China (Grant No. IRT13076), the Major Research Plan of the National Natural Science Foundation of China (Grant No. 91436108), the National Natural Science Foundation of China (Grant Nos. 61378014, 61308023, 61378015, and 11434007), the Fund for Fostering Talents in Basic Science of the National Natural Science Foundation of China (Grant No. J1103210), the New Teacher Fund of the Ministry of Education of China (Grant No. 20131401120012), and the Natural Science Foundation for Young Scientists of Shanxi Province, China (Grant No. 2013021005-1).

Self-regulation of inter-hemispheric visual cortex balance through real-time fMRI neurofeedback training.

PubMed

Robineau, F; Rieger, S W; Mermoud, C; Pichon, S; Koush, Y; Van De Ville, D; Vuilleumier, P; Scharnowski, F

2014-10-15

Recent advances in neurofeedback based on real-time functional magnetic resonance imaging (fMRI) allow for learning to control spatially localized brain activity in the range of millimeters across the entire brain. Real-time fMRI neurofeedback studies have demonstrated the feasibility of self-regulating activation in specific areas that are involved in a variety of functions, such as perception, motor control, language, and emotional processing. In most of these previous studies, participants trained to control activity within one region of interest (ROI). In the present study, we extended the neurofeedback approach by now training healthy participants to control the interhemispheric balance between their left and right visual cortices. This was accomplished by providing feedback based on the difference in activity between a target visual ROI and the corresponding homologue region in the opposite hemisphere. Eight out of 14 participants learned to control the differential feedback signal over the course of 3 neurofeedback training sessions spread over 3 days, i.e., they produced consistent increases in the visual target ROI relative to the opposite visual cortex. Those who learned to control the differential feedback signal were subsequently also able to exert that control in the absence of neurofeedback. Such learning to voluntarily control the balance between cortical areas of the two hemispheres might offer promising rehabilitation approaches for neurological or psychiatric conditions associated with pathological asymmetries in brain activity patterns, such as hemispatial neglect, dyslexia, or mood disorders. Copyright © 2014 Elsevier Inc. All rights reserved.

Neurofeedback training of gamma band oscillations improves perceptual processing.

PubMed

Salari, Neda; Büchel, Christian; Rose, Michael

2014-10-01

In this study, a noninvasive electroencephalography-based neurofeedback method is applied to train volunteers to deliberately increase gamma band oscillations (40 Hz) in the visual cortex. Gamma band oscillations in the visual cortex play a functional role in perceptual processing. In a previous study, we were able to demonstrate that gamma band oscillations prior to stimulus presentation have a significant influence on perceptual processing of visual stimuli. In the present study, we aimed to investigate longer lasting effects of gamma band neurofeedback training on perceptual processing. For this purpose, a feedback group was trained to modulate oscillations in the gamma band, while a control group participated in a task with an identical design setting but without gamma band feedback. Before and after training, both groups participated in a perceptual object detection task and a spatial attention task. Our results clearly revealed that only the feedback group but not the control group exhibited a visual processing advantage and an increase in oscillatory gamma band activity in the pre-stimulus period of the processing of the visual object stimuli after the neurofeedback training. Results of the spatial attention task showed no difference between the groups, which underlines the specific role of gamma band oscillations for perceptual processing. In summary, our results show that modulation of gamma band activity selectively affects perceptual processing and therefore supports the relevant role of gamma band activity for this specific process. Furthermore, our results demonstrate the eligibility of gamma band oscillations as a valuable tool for neurofeedback applications.

Visualizing Motion Patterns in Acupuncture Manipulation.

PubMed

Lee, Ye-Seul; Jung, Won-Mo; Lee, In-Seon; Lee, Hyangsook; Park, Hi-Joon; Chae, Younbyoung

2016-07-16

Acupuncture manipulation varies widely among practitioners in clinical settings, and it is difficult to teach novice students how to perform acupuncture manipulation techniques skillfully. The Acupuncture Manipulation Education System (AMES) is an open source software system designed to enhance acupuncture manipulation skills using visual feedback. Using a phantom acupoint and motion sensor, our method for acupuncture manipulation training provides visual feedback regarding the actual movement of the student's acupuncture manipulation in addition to the optimal or intended movement, regardless of whether the manipulation skill is lifting, thrusting, or rotating. Our results show that students could enhance their manipulation skills by training using this method. This video shows the process of manufacturing phantom acupoints and discusses several issues that may require the attention of individuals interested in creating phantom acupoints or operating this system.

Feature saliency and feedback information interactively impact visual category learning

PubMed Central

Hammer, Rubi; Sloutsky, Vladimir; Grill-Spector, Kalanit

2015-01-01

Visual category learning (VCL) involves detecting which features are most relevant for categorization. VCL relies on attentional learning, which enables effectively redirecting attention to object’s features most relevant for categorization, while ‘filtering out’ irrelevant features. When features relevant for categorization are not salient, VCL relies also on perceptual learning, which enables becoming more sensitive to subtle yet important differences between objects. Little is known about how attentional learning and perceptual learning interact when VCL relies on both processes at the same time. Here we tested this interaction. Participants performed VCL tasks in which they learned to categorize novel stimuli by detecting the feature dimension relevant for categorization. Tasks varied both in feature saliency (low-saliency tasks that required perceptual learning vs. high-saliency tasks), and in feedback information (tasks with mid-information, moderately ambiguous feedback that increased attentional load, vs. tasks with high-information non-ambiguous feedback). We found that mid-information and high-information feedback were similarly effective for VCL in high-saliency tasks. This suggests that an increased attentional load, associated with the processing of moderately ambiguous feedback, has little effect on VCL when features are salient. In low-saliency tasks, VCL relied on slower perceptual learning; but when the feedback was highly informative participants were able to ultimately attain the same performance as during the high-saliency VCL tasks. However, VCL was significantly compromised in the low-saliency mid-information feedback task. We suggest that such low-saliency mid-information learning scenarios are characterized by a ‘cognitive loop paradox’ where two interdependent learning processes have to take place simultaneously. PMID:25745404

Real-time feedback enhances forward propulsion during walking in old adults.

PubMed

Franz, Jason R; Maletis, Michela; Kram, Rodger

2014-01-01

Reduced propulsive function during the push-off phase of walking plays a central role in the deterioration of walking ability with age. We used real-time propulsive feedback to test the hypothesis that old adults have an underutilized propulsive reserve available during walking. 8 old adults (mean [SD], age: 72.1 [3.9] years) and 11 young adults (age: 21.0 [1.5] years) participated. For our primary aim, old subjects walked: 1) normally, 2) with visual feedback of their peak propulsive ground reaction forces, and 3) with visual feedback of their medial gastrocnemius electromyographic activity during push-off. We asked those subjects to match a target set to 20% and 40% greater propulsive force or push-off muscle activity than normal walking. We tested young subjects walking normally only to provide reference ground reaction force values. Walking normally, old adults exerted 12.5% smaller peak propulsive forces than young adults (P<0.01). However, old adults significantly increased their propulsive forces and push-off muscle activities when we provided propulsive feedback. Most notably, force feedback elicited propulsive forces that were equal to or 10.5% greater than those of young adults (+20% target, P=0.87; +40% target, P=0.02). With electromyographic feedback, old adults significantly increased their push-off muscle activities but without increasing their propulsive forces. Old adults with propulsive deficits have a considerable and underutilized propulsive reserve available during level walking. Further, real-time propulsive feedback represents a promising therapeutic strategy to improve the forward propulsion of old adults and thus maintain their walking ability and independence. © 2013.

Comparison of sensory modes of biofeedback in relaxation training of frontalis muscle.

PubMed

Chen, W

1981-12-01

The purpose of this study was to compare the effectiveness of various sensory modes of EMG biofeedback to relaxation training of the frontalis muscle. 19 male and 29 female subjects were randomly selected from a pool of college volunteers. They were then randomly assigned 12 each to audiofeedback, visual feedback, audiovisual feedback, and no feedback groups. There were 11 20-min. sessions per subject. Subjects in the biofeedback groups were trained to reduce muscle tension voluntarily by utilizing Cyborg J33 EMG portable trainers. The subjects in the three feedback groups exhibited significantly lower muscle tension than did the subjects in the no-feedback control group. There were no significant differences in relaxation among the three feedback groups.

The Role of Audio-Visual Feedback in a Thought-Based Control of a Humanoid Robot: A BCI Study in Healthy and Spinal Cord Injured People.

PubMed

Tidoni, Emmanuele; Gergondet, Pierre; Fusco, Gabriele; Kheddar, Abderrahmane; Aglioti, Salvatore M

2017-06-01

The efficient control of our body and successful interaction with the environment are possible through the integration of multisensory information. Brain-computer interface (BCI) may allow people with sensorimotor disorders to actively interact in the world. In this study, visual information was paired with auditory feedback to improve the BCI control of a humanoid surrogate. Healthy and spinal cord injured (SCI) people were asked to embody a humanoid robot and complete a pick-and-place task by means of a visual evoked potentials BCI system. Participants observed the remote environment from the robot's perspective through a head mounted display. Human-footsteps and computer-beep sounds were used as synchronous/asynchronous auditory feedback. Healthy participants achieved better placing accuracy when listening to human footstep sounds relative to a computer-generated sound. SCI people demonstrated more difficulty in steering the robot during asynchronous auditory feedback conditions. Importantly, subjective reports highlighted that the BCI mask overlaying the display did not limit the observation of the scenario and the feeling of being in control of the robot. Overall, the data seem to suggest that sensorimotor-related information may improve the control of external devices. Further studies are required to understand how the contribution of residual sensory channels could improve the reliability of BCI systems.

Sensitivity of system stability to model structure

USGS Publications Warehouse

Hosack, G.R.; Li, H.W.; Rossignol, P.A.

2009-01-01

A community is stable, and resilient, if the levels of all community variables can return to the original steady state following a perturbation. The stability properties of a community depend on its structure, which is the network of direct effects (interactions) among the variables within the community. These direct effects form feedback cycles (loops) that determine community stability. Although feedback cycles have an intuitive interpretation, identifying how they form the feedback properties of a particular community can be intractable. Furthermore, determining the role that any specific direct effect plays in the stability of a system is even more daunting. Such information, however, would identify important direct effects for targeted experimental and management manipulation even in complex communities for which quantitative information is lacking. We therefore provide a method that determines the sensitivity of community stability to model structure, and identifies the relative role of particular direct effects, indirect effects, and feedback cycles in determining stability. Structural sensitivities summarize the degree to which each direct effect contributes to stabilizing feedback or destabilizing feedback or both. Structural sensitivities prove useful in identifying ecologically important feedback cycles within the community structure and for detecting direct effects that have strong, or weak, influences on community stability. The approach may guide the development of management intervention and research design. We demonstrate its value with two theoretical models and two empirical examples of different levels of complexity. ?? 2009 Elsevier B.V. All rights reserved.

Soft X-ray Foucault test: A path to diffraction-limited imaging

NASA Astrophysics Data System (ADS)

Ray-Chaudhuri, A. K.; Ng, W.; Liang, S.; Cerrina, F.

1994-08-01

We present the development of a soft X-ray Foucault test capable of characterizing the imaging properties of a soft X-ray optical system at its operational wavelength and its operational configuration. This optical test enables direct visual inspection of imaging aberrations and provides real-time feedback for the alignment of high resolution soft X-ray optical systems. A first application of this optical test was carried out on a Mo-Si multilayer-coated Schwarzschild objective as part of the MAXIMUM project. Results from the alignment procedure are presented as well as the possibility for testing in the hard X-ray regime.

Kinematic control of robot with degenerate wrist

NASA Technical Reports Server (NTRS)

Barker, L. K.; Moore, M. C.

1984-01-01

Kinematic resolved rate equations allow an operator with visual feedback to dynamically control a robot hand. When the robot wrist is degenerate, the computed joint angle rates exceed operational limits, and unwanted hand movements can result. The generalized matrix inverse solution can also produce unwanted responses. A method is introduced to control the robot hand in the region of the degenerate robot wrist. The method uses a coordinated movement of the first and third joints of the robot wrist to locate the second wrist joint axis for movement of the robot hand in the commanded direction. The method does not entail infinite joint angle rates.

Active Manual Movement Improves Directional Perception of Illusory Force.

PubMed

Amemiya, Tomohiro; Gomi, Hiroaki

2016-01-01

Active touch sensing is known to facilitate the discrimination or recognition of the spatial properties of an object from the movement of tactile sensors on the skin and by integrating proprioceptive feedback about hand positions or motor commands related to ongoing hand movements. On the other hand, several studies have reported that tactile processing is suppressed by hand movement. Thus, it is unclear whether or not the active exploration of force direction by using hand or arm movement improves the perception of the force direction. Here, we show that active manual movement in both the rotational and translational directions enhances the precise perception of the force direction. To make it possible to move a hand in space without any physical constraints, we have adopted a method of inducing the sensation of illusory force by asymmetric vibration. We found that the precision of the perceived force direction was significantly better when the shoulder is rotated medially and laterally. We also found that directional errors supplied by the motor response of the perceived force were smaller than those resulting from perceptual judgments between visual and haptic directional stimuli. These results demonstrate that active manual movement boosts the precision of the perceived direction of an illusory force.

Unintentional Interpersonal Synchronization Represented as a Reciprocal Visuo-Postural Feedback System: A Multivariate Autoregressive Modeling Approach

PubMed Central

Okazaki, Shuntaro; Hirotani, Masako; Koike, Takahiko; Bosch-Bayard, Jorge; Takahashi, Haruka K.; Hashiguchi, Maho; Sadato, Norihiro

2015-01-01

People’s behaviors synchronize. It is difficult, however, to determine whether synchronized behaviors occur in a mutual direction—two individuals influencing one another—or in one direction—one individual leading the other, and what the underlying mechanism for synchronization is. To answer these questions, we hypothesized a non-leader-follower postural sway synchronization, caused by a reciprocal visuo-postural feedback system operating on pairs of individuals, and tested that hypothesis both experimentally and via simulation. In the behavioral experiment, 22 participant pairs stood face to face either 20 or 70 cm away from each other wearing glasses with or without vision blocking lenses. The existence and direction of visual information exchanged between pairs of participants were systematically manipulated. The time series data for the postural sway of these pairs were recorded and analyzed with cross correlation and causality. Results of cross correlation showed that postural sway of paired participants was synchronized, with a shorter time lag when participant pairs could see one another’s head motion than when one of the participants was blindfolded. In addition, there was less of a time lag in the observed synchronization when the distance between participant pairs was smaller. As for the causality analysis, noise contribution ratio (NCR), the measure of influence using a multivariate autoregressive model, was also computed to identify the degree to which one’s postural sway is explained by that of the other’s and how visual information (sighted vs. blindfolded) interacts with paired participants’ postural sway. It was found that for synchronization to take place, it is crucial that paired participants be sighted and exert equal influence on one another by simultaneously exchanging visual information. Furthermore, a simulation for the proposed system with a wider range of visual input showed a pattern of results similar to the behavioral results. PMID:26398768

Experimental Test of Spatial Updating Models for Monkey Eye-Head Gaze Shifts

PubMed Central

Van Grootel, Tom J.; Van der Willigen, Robert F.; Van Opstal, A. John

2012-01-01

How the brain maintains an accurate and stable representation of visual target locations despite the occurrence of saccadic gaze shifts is a classical problem in oculomotor research. Here we test and dissociate the predictions of different conceptual models for head-unrestrained gaze-localization behavior of macaque monkeys. We adopted the double-step paradigm with rapid eye-head gaze shifts to measure localization accuracy in response to flashed visual stimuli in darkness. We presented the second target flash either before (static), or during (dynamic) the first gaze displacement. In the dynamic case the brief visual flash induced a small retinal streak of up to about 20 deg at an unpredictable moment and retinal location during the eye-head gaze shift, which provides serious challenges for the gaze-control system. However, for both stimulus conditions, monkeys localized the flashed targets with accurate gaze shifts, which rules out several models of visuomotor control. First, these findings exclude the possibility that gaze-shift programming relies on retinal inputs only. Instead, they support the notion that accurate eye-head motor feedback updates the gaze-saccade coordinates. Second, in dynamic trials the visuomotor system cannot rely on the coordinates of the planned first eye-head saccade either, which rules out remapping on the basis of a predictive corollary gaze-displacement signal. Finally, because gaze-related head movements were also goal-directed, requiring continuous access to eye-in-head position, we propose that our results best support a dynamic feedback scheme for spatial updating in which visuomotor control incorporates accurate signals about instantaneous eye- and head positions rather than relative eye- and head displacements. PMID:23118883

Feedback Enhances Feedforward Figure-Ground Segmentation by Changing Firing Mode

PubMed Central

Supèr, Hans; Romeo, August

2011-01-01

In the visual cortex, feedback projections are conjectured to be crucial in figure-ground segregation. However, the precise function of feedback herein is unclear. Here we tested a hypothetical model of reentrant feedback. We used a previous developed 2-layered feedforwardspiking network that is able to segregate figure from ground and included feedback connections. Our computer model data show that without feedback, neurons respond with regular low-frequency (∼9 Hz) bursting to a figure-ground stimulus. After including feedback the firing pattern changed into a regular (tonic) spiking pattern. In this state, we found an extra enhancement of figure responses and a further suppression of background responses resulting in a stronger figure-ground signal. Such push-pull effect was confirmed by comparing the figure-ground responses withthe responses to a homogenous texture. We propose that feedback controlsfigure-ground segregation by influencing the neural firing patterns of feedforward projecting neurons. PMID:21738747

Feedback enhances feedforward figure-ground segmentation by changing firing mode.

PubMed

Supèr, Hans; Romeo, August

2011-01-01

In the visual cortex, feedback projections are conjectured to be crucial in figure-ground segregation. However, the precise function of feedback herein is unclear. Here we tested a hypothetical model of reentrant feedback. We used a previous developed 2-layered feedforward spiking network that is able to segregate figure from ground and included feedback connections. Our computer model data show that without feedback, neurons respond with regular low-frequency (∼9 Hz) bursting to a figure-ground stimulus. After including feedback the firing pattern changed into a regular (tonic) spiking pattern. In this state, we found an extra enhancement of figure responses and a further suppression of background responses resulting in a stronger figure-ground signal. Such push-pull effect was confirmed by comparing the figure-ground responses with the responses to a homogenous texture. We propose that feedback controls figure-ground segregation by influencing the neural firing patterns of feedforward projecting neurons.

Children with Heavy Prenatal Alcohol Exposure have Different Frequency Domain Signal Characteristics when Producing Isometric Force

PubMed Central

Nguyen, Tanya T.; Ashrafi, Ashkan; Thomas, Jennifer D.; Riley, Edward P.; Simmons, Roger W.

2013-01-01

To extend our current understanding of the teratogenic effects of prenatal alcohol exposure on the control of isometric force, the present study investigated the signal characteristics of power spectral density functions resulting from sustained control of isometric force by children with and without heavy prenatal exposure to alcohol. It was predicted that the functions associated with the force signals would be fundamentally different for the two groups. Twenty-five children aged between 7 and 17 years with heavy prenatal alcohol exposure and 21 non-alcohol exposed control children attempted to duplicate a visually represented target force by pressing on a load cell. The level of target force (5 and 20% of maximum voluntary contraction) and the time interval between visual feedback (20ms, 320ms and 740ms) were manipulated. A multivariate spectral estimation method with sinusoidal windows was applied to individual isometric force-time signals. Analysis of the resulting power spectral density functions revealed that the alcohol-exposed children had a lower mean frequency, less spectral variability, greater peak power and a lower frequency at which peak power occurred. Furthermore, mean frequency and spectral variability produced by the alcohol-exposed group remained constant across target load and visual feedback interval, suggesting that these children were limited to making long-time scale corrections to the force signal. In contrast, the control group produced decreased mean frequency and spectral variability as target force and the interval between visual feedback increased, indicating that when feedback was frequently presented these children used the information to make short-time scale adjustments to the ongoing force signal. Knowledge of these differences could facilitate the design of motor rehabilitation exercises that specifically target isometric force control deficits in alcohol-exposed children. PMID:23238099

Children with Heavy Prenatal Alcohol Exposure Experience Reduced Control of Isotonic Force

PubMed Central

Nguyen, Tanya T.; Levy, Susan S.; Riley, Edward P.; Thomas, Jennifer D.; Simmons, Roger W.

2013-01-01

Background Heavy prenatal alcohol exposure can result in diverse and extensive damage to the central nervous system, including the cerebellum, basal ganglia, and cerebral cortex. Given that these brain regions are involved in the generation and maintenance of motor force, we predicted that prenatal alcohol exposure would adversely affect this parameter of motor control. We previously reported that children with gestational alcohol exposure experience significant deficits in regulating isometric (i.e., constant) force. The purpose of the present study was to determine if these children exhibit similar deficits when producing isotonic (i.e., graded) force. Methods Children with heavy prenatal alcohol exposure and typically developing children completed a series of isotonic force contractions by exerting force on a load cell to match a criterion target force displayed on a computer monitor. Two levels of target force (5% or 20% of maximum voluntary force) were investigated in combination with varying levels of visual feedback. Results Compared to controls, children with heavy prenatal alcohol exposure generated isotonic force signals that were less accurate, more variable, and less complex in the time domain compared to control children. Specifically, interactions were found between group and visual feedback for response accuracy and signal complexity, suggesting that these children have greater difficulty altering their motor output when visual feedback is low. Conclusions These data suggest that prenatal alcohol exposure produces deficits in regulating isotonic force, which presumably result from alcohol-related damage to developing brain regions involved in motor control. These children will most likely experience difficulty performing basic motor skills and daily functional skills that require coordination of finely graded force. Therapeutic strategies designed to increase feedback and, consequently, facilitate visual-motor integration could improve isotonic force production in these children. PMID:22834891

Cortical interactions in vision and awareness: hierarchies in reverse.

PubMed

Juan, Chi-Hung; Campana, Gianluca; Walsh, Vincent

2004-01-01

The anatomical connections between visual areas can be organized in 'feedforward', 'feedback' or 'horizontal' laminar patterns. We report here four experiments that test the function of some of the feedback projections in visual cortex. Projections from V5 to V1 have been suggested to be important in visual awareness, and in the first experiment we show this to be the case in the blindsight patient GY. This demonstration is replicated, in principle, in the second experiment and we also show the timing of the V5-V1 interaction to correspond to findings from single unit physiology. In the third experiment we show that V1 is important for stimulus detection in visual search arrays and that the timing of V1 interference with TMS is late (up to 240 ms after the onset of the visual array). Finally we report an experiment showing that the parietal cortex is not involved in visual motion priming, whereas V5 is, suggesting that the parietal cortex does not modulate V5 in this task. We interpret the data in terms of Bullier's recent physiological recordings and Ahissar and Hochstein's reverse hierarchy theory of vision.

A memory advantage for past-oriented over future-oriented performance feedback.

PubMed

Nash, Robert A; Winstone, Naomi E; Gregory, Samantha E A; Papps, Emily

2018-03-05

People frequently receive performance feedback that describes how well they achieved in the past, and how they could improve in future. In educational contexts, future-oriented (directive) feedback is often argued to be more valuable to learners than past-oriented (evaluative) feedback; critically, prior research led us to predict that it should also be better remembered. We tested this prediction in six experiments. Subjects read written feedback containing evaluative and directive comments, which supposedly related to essays they had previously written (Experiments 1-2), or to essays another person had written (Experiments 3-6). Subjects then tried to reproduce the feedback from memory after a short delay. In all six experiments, the data strongly revealed the opposite effect to the one we predicted: despite only small differences in wording, evaluative feedback was in fact recalled consistently better than directive feedback. Furthermore, even when adult subjects did recall directive feedback, they frequently misremembered it in an evaluative style. These findings appear at odds with the position that being oriented toward the future is advantageous to memory. They also raise important questions about the possible behavioral effects and generalizability of such biases, in terms of students' academic performance. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The Effect of Direct and Indirect Corrective Feedback on Iranian EFL Learners' Spelling Errors

ERIC Educational Resources Information Center

Ghandi, Maryam; Maghsoudi, Mojtaba

2014-01-01

The aim of the current study was to investigate the impact of indirect corrective feedback on promoting Iranian high school students' spelling accuracy in English (as a foreign language). It compared the effect of direct feedback with indirect feedback on students' written work dictated by their teacher from Chicken Soup for the Mother and…

Examining the Function of Visual Feedback in Text Production.

ERIC Educational Resources Information Center

Hull, Glynda A.; Smith, William L.

Composing is controlled by information feedback from prior behavior which serves to influence future behavior. This model posits movement toward a desired end product through a continual interchange of writing and examining and evaluating what has been written against internal standards. A study was conducted to determine the extent to which…

Formative Assessment in the Visual Arts

ERIC Educational Resources Information Center

Andrade, Heidi; Hefferen, Joanna; Palma, Maria

2014-01-01

Classroom assessment is a hot topic in K-12 education because of compelling evidence that assessment in the form of feedback is a powerful teaching and learning tool (Hattie & Timperley, 2007). Although formal evaluation has been anathema to many art specialists and teachers (Colwell, 2004), informal assessment in the form of feedback is not.…

Matching Feedback and Cognitive Style in Visual CAI Tasks.

ERIC Educational Resources Information Center

Hedberg, John G.; McNamara, Suzanne E.

The effects of different types of feedback in computer assisted instruction were studied in 30 college students with different cognitive styles. The program, written in Apple Pilot and administered on an Apple IIE microcomputer, consisted of 16 problem solving tasks; for each, a graphic display and a textual question were presented. Two feedback…

An Investigation on the Role of Multimodal Metaphors in e-Feedback Interfaces

ERIC Educational Resources Information Center

Rigas, Dimitrios; Alharbi, Abdulrhman

2011-01-01

Purpose: The purpose of this paper is to investigate the usability (effectiveness, efficiency and user satisfaction) of e-feedback interfaces. The experiment compares a traditional visual approach with a multimodal approach in order to determine the impact of multimodal metaphors upon the user's understanding, reasoning and engagement with the…

Feedback control of one's own action: Self-other sensory attribution in motor control.

PubMed

Asai, Tomohisa

2015-12-15

The sense of agency, the subjective experience of controlling one's own action, has an important function in motor control. When we move our own body or even external tools, we attribute that movement to ourselves and utilize that sensory information in order to correct "our own" movement in theory. The dynamic relationship between conscious self-other attribution and feedback control, however, is still unclear. Participants were required to make a sinusoidal reaching movement and received its visual feedback (i.e., cursor). When participants received a fake movement that was spatio-temporally close to their actual movement, illusory self-attribution of the fake movement was observed. In this situation, since participants tried to control the cursor but it was impossible to do so, the movement error was increased (Experiment 1). However, when the visual feedback was reduced to make self-other attribution difficult, there was no further increase in the movement error (Experiment 2). These results indicate that conscious self-other sensory attribution might coordinate sensory input and motor output. Copyright © 2015 Elsevier Inc. All rights reserved.

When they listen and when they watch: Pianists’ use of nonverbal audio and visual cues during duet performance

PubMed Central

Goebl, Werner

2015-01-01

Nonverbal auditory and visual communication helps ensemble musicians predict each other’s intentions and coordinate their actions. When structural characteristics of the music make predicting co-performers’ intentions difficult (e.g., following long pauses or during ritardandi), reliance on incoming auditory and visual signals may change. This study tested whether attention to visual cues during piano–piano and piano–violin duet performance increases in such situations. Pianists performed the secondo part to three duets, synchronizing with recordings of violinists or pianists playing the primo parts. Secondos’ access to incoming audio and visual signals and to their own auditory feedback was manipulated. Synchronization was most successful when primo audio was available, deteriorating when primo audio was removed and only cues from primo visual signals were available. Visual cues were used effectively following long pauses in the music, however, even in the absence of primo audio. Synchronization was unaffected by the removal of secondos’ own auditory feedback. Differences were observed in how successfully piano–piano and piano–violin duos synchronized, but these effects of instrument pairing were not consistent across pieces. Pianists’ success at synchronizing with violinists and other pianists is likely moderated by piece characteristics and individual differences in the clarity of cueing gestures used. PMID:26279610

Does Top-Down Feedback Modulate the Encoding of Orthographic Representations During Visual-Word Recognition?

PubMed

Perea, Manuel; Marcet, Ana; Vergara-Martínez, Marta

2016-09-01

In masked priming lexical decision experiments, there is a matched-case identity advantage for nonwords, but not for words (e.g., ERTAR-ERTAR <  ertar-ERTAR; ALTAR-ALTAR = altar-ALTAR). This dissociation has been interpreted in terms of feedback from higher levels of processing during orthographic encoding. Here, we examined whether a matched-case identity advantage also occurs for words when top-down feedback is minimized. We employed a task that taps prelexical orthographic processes: the masked prime same-different task. For "same" trials, results showed faster response times for targets when preceded by a briefly presented matched-case identity prime than when preceded by a mismatched-case identity prime. Importantly, this advantage was similar in magnitude for nonwords and words. This finding constrains the interplay of bottom-up versus top-down mechanisms in models of visual-word identification.

Spatial frequency-dependent feedback of visual cortical area 21a modulating functional orientation column maps in areas 17 and 18 of the cat.

PubMed

Huang, Luoxiu; Chen, Xin; Shou, Tiande

2004-02-20

The feedback effect of activity of area 21a on orientation maps of areas 17 and 18 was investigated in cats using intrinsic signal optical imaging. A spatial frequency-dependent decrease in response amplitude of orientation maps to grating stimuli was observed in areas 17 and 18 when area 21a was inactivated by local injection of GABA, or by a lesion induced by liquid nitrogen freezing. The decrease in response amplitude of orientation maps of areas 17 and 18 after the area 21a inactivation paralleled the normal response without the inactivation. Application in area 21a of bicuculline, a GABAa receptor antagonist caused an increase in response amplitude of orientation maps of area 17. The results indicate a positive feedback from high-order visual cortical area 21a to lower-order areas underlying a spatial frequency-dependent mechanism.

Sonification of optical coherence tomography data and images

PubMed Central

Ahmad, Adeel; Adie, Steven G.; Wang, Morgan; Boppart, Stephen A.

2010-01-01

Sonification is the process of representing data as non-speech audio signals. In this manuscript, we describe the auditory presentation of OCT data and images. OCT acquisition rates frequently exceed our ability to visually analyze image-based data, and multi-sensory input may therefore facilitate rapid interpretation. This conversion will be especially valuable in time-sensitive surgical or diagnostic procedures. In these scenarios, auditory feedback can complement visual data without requiring the surgeon to constantly monitor the screen, or provide additional feedback in non-imaging procedures such as guided needle biopsies which use only axial-scan data. In this paper we present techniques to translate OCT data and images into sound based on the spatial and spatial frequency properties of the OCT data. Results obtained from parameter-mapped sonification of human adipose and tumor tissues are presented, indicating that audio feedback of OCT data may be useful for the interpretation of OCT images. PMID:20588846

Social stories, written text cues, and video feedback: effects on social communication of children with autism.

PubMed Central

Thiemann, K S; Goldstein, H

2001-01-01

This study investigated the effects of written text and pictorial cuing with supplemental video feedback on the social communication of 5 students with autism and social deficits. Two peers without disabilities participated as social partners with each child with autism to form five triads. Treatment was implemented twice per week and consisted of 10 min of systematic instruction using visual stimuli, 10 min of social interaction, and 10 min of self-evaluation using video feedback. Results showed increases in targeted social communication skills when the treatment was implemented. Some generalized treatment effects were observed across untrained social behaviors, and 1 participant generalized improvements within the classroom. In addition, naive judges reported perceived improvements in the quality of reciprocal interactions. These findings support recommendations for using visually cued instruction to guide the social language development of young children with autism as they interact with peers without disabilities. PMID:11800183

Twelve tips to promote successful development of a learner performance dashboard within a medical education program.

PubMed

Boscardin, Christy; Fergus, Kirkpatrick B; Hellevig, Bonnie; Hauer, Karen E

2017-11-09

Easily accessible and interpretable performance data constitute critical feedback for learners that facilitate informed self-assessment and learning planning. To provide this feedback, there has been a proliferation of educational dashboards in recent years. An educational (learner) dashboard systematically delivers timely and continuous feedback on performance and can provide easily visualized and interpreted performance data. In this paper, we provide practical tips for developing a functional, user-friendly individual learner performance dashboard and literature review of dashboard development, assessment theory, and users' perspectives. Considering key design principles and maximizing current technological advances in data visualization techniques can increase dashboard utility and enhance the user experience. By bridging current technology with assessment strategies that support learning, educators can continue to improve the field of learning analytics and design of information management tools such as dashboards in support of improved learning outcomes.

Control of impact loading during distracted running before and after gait retraining in runners.

PubMed

Cheung, Roy T H; An, Winko W; Au, Ivan P H; Zhang, Janet H; Chan, Zoe Y S; MacPhail, Aislinn J

2018-07-01

Gait retraining using visual biofeedback has been reported to reduce impact loading in runners. However, most of the previous studies did not adequately examine the level of motor learning after training, as the modified gait pattern was not tested in a dual-task condition. Hence, this study sought to compare the landing peak positive acceleration (PPA) and vertical loading rates during distracted running before and after gait retraining. Sixteen recreational runners underwent a two-week visual biofeedback gait retraining program for impact loading reduction, with feedback on the PPA measured at heel. In the evaluation of PPA and vertical loading rates before and after the retraining, the participants performed a cognitive and verbal counting task while running. Repeated measures ANOVA indicated a significant interaction between feedback and training on PPA (F = 4.642; P = 0.048) but not vertical loading rates (F > 1.953; P > 0.067). Pairwise comparisons indicated a significantly lower PPA and vertical loading rates after gait retraining (P < 0.007; Cohen's d > 0.68). Visual feedback after gait retraining reduced PPA and vertical loading rates during distracted running (P < 0.033; Cohen's d > 0.36). Gait retraining is effective in lowering impact loading even when the runners are distracted. In dual-task situation, visual biofeedback provided beneficial influence on kinetics control after gait retraining.

Review of surgical robotics user interface: what is the best way to control robotic surgery?

PubMed

Simorov, Anton; Otte, R Stephen; Kopietz, Courtni M; Oleynikov, Dmitry

2012-08-01

As surgical robots begin to occupy a larger place in operating rooms around the world, continued innovation is necessary to improve our outcomes. A comprehensive review of current surgical robotic user interfaces was performed to describe the modern surgical platforms, identify the benefits, and address the issues of feedback and limitations of visualization. Most robots currently used in surgery employ a master/slave relationship, with the surgeon seated at a work-console, manipulating the master system and visualizing the operation on a video screen. Although enormous strides have been made to advance current technology to the point of clinical use, limitations still exist. A lack of haptic feedback to the surgeon and the inability of the surgeon to be stationed at the operating table are the most notable examples. The future of robotic surgery sees a marked increase in the visualization technologies used in the operating room, as well as in the robots' abilities to convey haptic feedback to the surgeon. This will allow unparalleled sensation for the surgeon and almost eliminate inadvertent tissue contact and injury. A novel design for a user interface will allow the surgeon to have access to the patient bedside, remaining sterile throughout the procedure, employ a head-mounted three-dimensional visualization system, and allow the most intuitive master manipulation of the slave robot to date.